Vasukai

AI crawlers · Amazon · Model training

Amazonbot: Amazon's crawler for AI training

Amazonbot is a crawler from Amazon that collects pages for Amazon's AI, including Alexa. It is a training crawler, so blocking it is a common and reasonable choice.

Is Amazonbot allowed on your site?

Or try: · · ·

At a glance

robots.txt nameAmazonbot
CompanyAmazon
KindModel training. Collects pages for Amazon's AI, including Alexa
Visits sitesYes
Official pagedeveloper.amazon.com

Amazonbot collects pages that may be used to train AI models for Amazon's AI, including Alexa. As a training crawler, it gathers content to improve these systems. For businesses, this means Amazonbot may read your site to help train Amazon's AI, which could influence how that AI understands and represents your business. Being readable by AI does not mean being recommended by AI assistants.

Whether to block or allow Amazonbot depends on your goals. Blocking it is a common, reasonable choice and does not stop AI search crawlers. If you want to limit how your content trains Amazon's AI, blocking is sensible. If you prefer to allow it, you can leave it unblocked. Remember that robots.txt is a request, not a lock, and reputable crawlers follow it. A firewall or bot-protection service can block a crawler even when robots.txt allows it.

robots.txt lines

Block Amazonbot
User-agent: Amazonbot
Disallow: /
Allow Amazonbot
User-agent: Amazonbot
Allow: /

Questions

What is Amazonbot?

Amazonbot is a crawler from Amazon that collects pages for Amazon's AI, including Alexa. It is a training crawler, meaning it gathers content that may be used to train AI models.

Should I block Amazonbot?

Blocking Amazonbot is a common, reasonable choice. It does not stop AI search crawlers. Whether to block depends on whether you want your content used to train Amazon's AI.

How do I block Amazonbot in robots.txt?

To block Amazonbot for the whole site, add these two lines to robots.txt: User-agent: Amazonbot Disallow: /

Does blocking Amazonbot affect AI search or Google?

Blocking Amazonbot does not stop AI search crawlers. It also does not affect Google, as Amazonbot is separate from Google's crawlers.