At a glance
| robots.txt name | Applebot-Extended |
|---|---|
| Company | Apple |
| Kind | Model training. Use in Apple's AI models. A rule only; it never visits |
| Visits sites | No. It is a robots.txt rule only |
| Official page | support.apple.com |
Applebot-Extended is a training crawler from Apple. It collects pages that may be used to train AI models. It is a rule only and never visits sites. Blocking it is a common, reasonable choice and does not stop AI search crawlers.
To block Applebot-Extended for the whole site, add a group to robots.txt with its User-agent line and Disallow: /. To allow it, use Allow: / or no rule for it. Remember that robots.txt is a request, not a lock. A firewall or bot-protection service can block a crawler even when robots.txt allows it.
robots.txt lines
User-agent: Applebot-Extended Disallow: /
User-agent: Applebot-Extended Allow: /
Questions
What is Applebot-Extended?
Applebot-Extended is a training crawler from Apple. It collects pages that may be used to train AI models. It is a rule only and never visits sites.
Should I block Applebot-Extended?
Blocking it is a common, reasonable choice and does not stop AI search crawlers. It depends on whether you want your content used for AI model training.
How do I block Applebot-Extended in robots.txt?
To block it for the whole site, add these two lines to robots.txt: User-agent: Applebot-Extended Disallow: /
Does blocking Applebot-Extended affect AI search or Google?
Blocking Applebot-Extended does not stop AI search crawlers. It is a training crawler, so it does not affect AI search. It also does not affect Google.