NewFirst month of Starter or Pro for $1Your first month of Starter or Pro for just $1, then cancel anytimeSee pricing
Ranken logoRanken.io

Applebot-Extended: what it is and how to block it

What is Applebot-Extended?

Applebot-Extended is a robots.txt token, not a crawler. It controls whether pages that Applebot crawls can be used to train Apple's generative AI models.

Operator
Apple
Used for
Model training
robots.txt token
Applebot-Extended
robots.txt
Control token
IP ranges
Not published

Checked against Apple's documentation

robots.txtApplebot-Extended
User-agent: *
Allow: /
 
User-agent: Applebot-Extended
Disallow: /
With this rule
Apple model trainingBlocked
Siri, Spotlight and Safari searchNot affected

What is the Applebot-Extended user agent string?

Apple says Applebot-Extended does not crawl webpages, so it has no user agent string. Applebot does the crawling.

How do I block Applebot-Extended in robots.txt?

Add these two lines to the robots.txt file at the root of your domain. It only exists as a robots.txt token that Apple reads alongside Applebot.

User-agent: Applebot-Extended
Disallow: /

To allow it everywhere instead, use:

User-agent: Applebot-Extended
Allow: /

What happens if you block Applebot-Extended?

Apple says pages that disallow Applebot-Extended can still be included in search results in Spotlight, Siri and Safari.

Should you block Applebot-Extended?

Block it to opt out of Apple model training while staying in Siri, Spotlight and Safari search. Keep Applebot itself allowed.

Which AI crawlers does your site block?The free AI Visibility Checker reads your robots.txt and shows which AI search and training crawlers can reach a page.Check a URL

See the full AI crawler list or read the official Apple docs

A blog AI search can read

Every Ranken blog ships a robots.txt that welcomes AI search crawlers, plus server-rendered pages, schema and llms.txt.