What is Applebot-Extended?
Short answer: Applebot-Extended is a robots.txt token that controls whether Apple may use content crawled by Applebot to train its foundation models, which power generative AI features across Apple products including Apple Intelligence. Apple says it does not crawl webpages, and pages that disallow it can still be included in search results.
Applebot-Extended at a glance
- Run by
- Apple
- Type
- Control token
- Used for
- Training Apple's foundation models
- robots.txt name
-
Applebot-Extended - Follows robots.txt
- Control token, never visits
- Last checked
- 18 November 2026
- User agent
- None of its own Apple says Applebot-Extended does not crawl webpages. It is only used to decide how data crawled by Applebot may be used.
What does Applebot-Extended do?
Apple says data crawled by Applebot may be used to help train Apple foundation models powering generative AI features across Apple products, including Apple Intelligence, Services and Developer Tools. Applebot-Extended is how a site opts out of that use.
Apple says Applebot-Extended does not crawl webpages; it is only used to determine how to use the data crawled by the Applebot user agent.
What happens if you block Applebot-Extended?
Disallowing Applebot-Extended tells Apple not to use your content to train its foundation models. Apple says webpages that disallow Applebot-Extended can still be included in search results.
It does not stop crawling. Apple notes that even if you disallow Applebot-Extended and use the nosnippet meta tag, your rules may still allow Applebot to crawl your pages.
How do you set Applebot-Extended in robots.txt?
Is Applebot-Extended a crawler? It is a control, not a crawler. Apple reads your Applebot-Extended rules when deciding how to use data that Applebot collected.
Add one of these groups to the robots.txt file at the root of your site. Several User-agent lines in a row share the rules below them, and a crawler follows only the most specific group that names it, so repeat any private paths in that group.
Opt out with Applebot-Extended
User-agent: Applebot-Extended
Disallow: / Allow Applebot-Extended
User-agent: Applebot-Extended
Allow: / Should you block Applebot-Extended?
Our view: A clean opt out if you do not want Apple training on your content: it keeps you in Siri, Spotlight and Safari search while removing the training use.
How do you verify a real Applebot-Extended request?
There is nothing to verify, because Applebot-Extended never visits your site. Crawling is done by Applebot.
Related AI crawlers
-
ApplebotApple · Search crawler Crawls the web for Siri and Spotlight suggestions. -
Google-ExtendedGoogle · Control token Not a separate crawler. A token that controls whether Google may use your content to train Gemini models and to ground answers in Gemini apps.
See every AI crawler in one table, check your own robots.txt with the free AI crawler checker, or give AI tools a clean summary of your site with the llms.txt generator.
Applebot-Extended questions
What is the Applebot-Extended user agent?
Does Applebot-Extended follow robots.txt?
Does blocking Applebot-Extended remove me from Siri or Spotlight?
Is Applebot-Extended a crawler?
What does Applebot-Extended control?
How do I check whether my site allows Applebot-Extended?
Crawlers can read you. Does AI recommend you?
See your ONE Score first · 7 day free trial, no card needed · Pay only if you keep tracking