Amazonbot: user agent, IP verification and robots.txt

Amazonbot is operated by Amazon. It is classified here as Training (Product improvement and AI training). Verification method: Published, but not machine-readable.

Exact user-agent string

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36

robots.txt token: Amazonbot. The user-agent string is self-asserted and can be forged by anyone. It is a claim, not proof.

How to verify Amazonbot is genuine

Amazon publishes addresses at https://developer.amazon.com/amazonbot/ip-addresses/, but as a rendered HTML page rather than a machine-readable file, so it cannot be pulled automatically.

How to block or allow Amazonbot

User-agent: Amazonbot
Disallow: /

Replace Disallow with Allow to permit it explicitly.

What blocking Amazonbot costs you

Amazon says Amazonbot data improves its products and services and may be used to train Amazon AI models. Search visibility in Alexa is governed by the separate Amzn-SearchBot token, so blocking Amazonbot alone does not cost you Alexa surfacing.

What is specific to Amazonbot

Amazon publishes its IP addresses on HTML pages rather than as JSON files, and the three pages do not behave the same way. The Amzn-SearchBot page ships 512 CIDR blocks in its static HTML and can be scraped. The Amazonbot page and the Amzn-User page return zero without executing JavaScript, so the addresses for Amazon's training crawler, the one most site owners actually want to gate, are the ones you cannot fetch. That inconsistency is not documented anywhere; it is only visible by fetching all three. Amazon also warns that a robots.txt change can take around 24 hours to take effect, and notes that if your robots.txt does not mention Amzn-SearchBot but allows other search bots, Amazon will crawl in accordance with the rules you gave those other bots.

Verify a request claiming to be Amazonbot

Check a Amazonbot request against Amazon's published ranges

Source

Primary documentation: https://developer.amazon.com/amazonbot. Last verified 2026-08-02.

Other Amazon crawlers

All crawlers and the full comparison table