AI agent directory / Google-Extended
Google-Extended
Crawler from Google
A robots.txt token that controls whether Google may use your pages to train Gemini; it never visits on its own.
| Run by | |
|---|---|
| Type | Crawler |
| Purpose | Training |
| Acts for | Its operator |
| robots.txt token | Google-Extended |
| Documentation | Google's documentation |
How Airglow identifies it
- DeclaredIt names itself in the User-Agent:
Google-Extended.
Every visit in Airglow says which of these applied, so you can decide how much to trust it.
Seeing it on your site
It never visits. It's a robots.txt setting that controls whether Google may use your pages to train Gemini, so there is nothing to count.
Allowing or blocking Google-Extended
Google-Extended reads the Google-Extended group in your robots.txt. To keep it out of the whole site:
User-agent: Google-Extended Disallow: /
Airglow shows, for every agent that visits, whether your robots.txt lets it in, and helps you write rules by purpose (training, search, acting for a person).
Other agents from Google
See when Google-Extended visits your site
Airglow names every AI agent on your website, replays what it did and links the visitors it sends you. Free for one website.