Applebot-Extended: what it is and how to block it
What is Applebot-Extended?
Applebot-Extended is a robots.txt token, not a crawler. It controls whether pages that Applebot crawls can be used to train Apple's generative AI models.
- Operator
- Apple
- Used for
- Model training
- robots.txt token
Applebot-Extended- robots.txt
- Control token
- IP ranges
- Not published
Checked against Apple's documentation
What is the Applebot-Extended user agent string?
Apple says Applebot-Extended does not crawl webpages, so it has no user agent string. Applebot does the crawling.
How do I block Applebot-Extended in robots.txt?
Add these two lines to the robots.txt file at the root of your domain. It only exists as a robots.txt token that Apple reads alongside Applebot.
User-agent: Applebot-Extended
Disallow: /To allow it everywhere instead, use:
User-agent: Applebot-Extended
Allow: /What happens if you block Applebot-Extended?
Apple says pages that disallow Applebot-Extended can still be included in search results in Spotlight, Siri and Safari.
Should you block Applebot-Extended?
Block it to opt out of Apple model training while staying in Siri, Spotlight and Safari search. Keep Applebot itself allowed.
Other AI crawlers
- GPTBotOpenAI, model training
- OAI-SearchBotOpenAI, AI search
- ChatGPT-UserOpenAI, user-triggered
- ClaudeBotAnthropic, model training
- PerplexityBotPerplexity, AI search
- Perplexity-UserPerplexity, user-triggered
See the full AI crawler list or read the official Apple docs
A blog AI search can read
Every Ranken blog ships a robots.txt that welcomes AI search crawlers, plus server-rendered pages, schema and llms.txt.