Skip to content
Control token Run by Apple

What is Applebot-Extended?

Short answer: Applebot-Extended is a robots.txt token that controls whether Apple may use content crawled by Applebot to train its foundation models, which power generative AI features across Apple products including Apple Intelligence. Apple says it does not crawl webpages, and pages that disallow it can still be included in search results.

Applebot-Extended at a glance

Run by
Apple
Type
Control token
Used for
Training Apple's foundation models
robots.txt name
Applebot-Extended
Follows robots.txt
Control token, never visits
Last checked
18 November 2026
User agent
None of its own Apple says Applebot-Extended does not crawl webpages. It is only used to decide how data crawled by Applebot may be used.

What does Applebot-Extended do?

Apple says data crawled by Applebot may be used to help train Apple foundation models powering generative AI features across Apple products, including Apple Intelligence, Services and Developer Tools. Applebot-Extended is how a site opts out of that use.

Apple says Applebot-Extended does not crawl webpages; it is only used to determine how to use the data crawled by the Applebot user agent.

What happens if you block Applebot-Extended?

Disallowing Applebot-Extended tells Apple not to use your content to train its foundation models. Apple says webpages that disallow Applebot-Extended can still be included in search results.

It does not stop crawling. Apple notes that even if you disallow Applebot-Extended and use the nosnippet meta tag, your rules may still allow Applebot to crawl your pages.

How do you set Applebot-Extended in robots.txt?

Is Applebot-Extended a crawler? It is a control, not a crawler. Apple reads your Applebot-Extended rules when deciding how to use data that Applebot collected.

Add one of these groups to the robots.txt file at the root of your site. Several User-agent lines in a row share the rules below them, and a crawler follows only the most specific group that names it, so repeat any private paths in that group.

Opt out with Applebot-Extended

User-agent: Applebot-Extended
Disallow: /

Allow Applebot-Extended

User-agent: Applebot-Extended
Allow: /

Should you block Applebot-Extended?

Our view: A clean opt out if you do not want Apple training on your content: it keeps you in Siri, Spotlight and Safari search while removing the training use.

How do you verify a real Applebot-Extended request?

There is nothing to verify, because Applebot-Extended never visits your site. Crawling is done by Applebot.

Applebot-Extended questions

What is the Applebot-Extended user agent?
Applebot-Extended has no user agent of its own. Apple says Applebot-Extended does not crawl webpages. It is only used to decide how data crawled by Applebot may be used.
Does Applebot-Extended follow robots.txt?
It is a control, not a crawler. Apple reads your Applebot-Extended rules when deciding how to use data that Applebot collected.
Does blocking Applebot-Extended remove me from Siri or Spotlight?
No. Apple says pages that disallow Applebot-Extended can still be included in search results.
Is Applebot-Extended a crawler?
No. Apple says it does not crawl webpages. It controls how data crawled by Applebot may be used.
What does Applebot-Extended control?
Whether Apple may use your content to train the foundation models behind generative AI features in its products, including Apple Intelligence.
How do I check whether my site allows Applebot-Extended?
Run your domain through the free ONEGO AI crawler checker. It reads your robots.txt and shows whether Applebot-Extended and 15 other AI crawlers are allowed, blocked or partly restricted, and what each rule means.

Crawlers can read you. Does AI recommend you?

See your ONE Score first · 7 day free trial, no card needed · Pay only if you keep tracking