AI agent directory / Applebot
Applebot
Crawler from Apple
Crawls pages for Siri and Spotlight search; Apple may also use them for its AI models.
| Run by | Apple |
|---|---|
| Type | Crawler |
| Purpose | Training and search |
| Acts for | Its operator |
| robots.txt token | Applebot |
| Documentation | Apple's documentation |
How Airglow identifies it
- DeclaredIt names itself in the User-Agent:
Applebot.
Every visit in Airglow says which of these applied, so you can decide how much to trust it.
Seeing it on your site
It reads pages without running JavaScript, so Airglow counts it through a server connection (Cloudflare). It's labeled as context, not replayed.
Allowing or blocking Applebot
Applebot reads the Applebot group in your robots.txt. To keep it out of the whole site:
User-agent: Applebot Disallow: /
Airglow shows, for every agent that visits, whether your robots.txt lets it in, and helps you write rules by purpose (training, search, acting for a person).
See when Applebot visits your site
Airglow names every AI agent on your website, replays what it did and links the visitors it sends you. Free for one website.