Applebot-Extended: What It Does and How to Control It
A controls token for Apple's robots.txt: it governs whether your content may be used to train Apple's foundation models behind Apple Intelligence and Siri. General Applebot (Apple's search crawler) is a separate user-agent.
What happens if you allow or block it
The vendor's AI features may use your content according to the vendor's default policy.
Apple stops using your content for Apple Intelligence training, while Apple's web search results keep following Applebot rules.
The robots.txt rule
This is the exact rule auditme.dev publishes for Applebot-Extended:
User-agent: Applebot-Extended Allow: / Disallow: /auth/ /_next/ /private/ /dashboard /settings /profile Disallow: ... (25 more paths)
The full path list lives in our robots.txt.
Frequently Asked Questions
Is Applebot-Extended allowed on auditme.dev?
Yes. Our robots.txt explicitly allows Applebot-Extended to crawl public pages while keeping private areas (auth, dashboard, internal APIs) disallowed.
Does blocking Applebot-Extended hurt Google rankings?
No. Applebot-Extended is Apple's crawler and works independently from Googlebot. Blocking it never changes your Google rankings — it only changes Apple stops using your content for Apple Intelligence training, while Apple's web search results keep following Applebot rules.
How do I allow or block Applebot-Extended on my own site?
Add a "User-agent: Applebot-Extended" block to your robots.txt with Allow or Disallow rules, then verify the file parses correctly.