Skip to content

Understanding Amazon’s Website Crawlers

Use Amazon’s published crawler purposes rather than inferring model training or product use from a request.

Published

Amazon publishes information about its website crawlers and how site owners can recognize them and express crawl preferences. Consult the current Amazonbot documentation for agent purposes and verification.

Avoid inferring more than the evidence shows

An Amazonbot request is not sufficient evidence that a particular page trained a model or powered a specific Amazon product. Search, user-triggered retrieval, and other crawling purposes should be distinguished using the documented agent and available request data.

The Amazon Q console screenshot below illustrates a product interface. It does not identify a crawler or prove a connection between a logged request and that product.

Measure your own website

Review eligible requests, status codes, and classification limits. Verify identity where the provider supplies a supported method. Keep crawler activity separate from human referrals and answer citations.

See agent analytics categories and visibility metrics.

Article illustration

Built for the answer era

Build a website people can use & AI can understand.

Build and deploy with your coding agent, or add an AI companion to your existing website.