AI agent directory / OAI-SearchBot
OAI-SearchBot
Crawler from OpenAI
Crawls pages so they can appear in ChatGPT search results.
| Run by | OpenAI |
|---|---|
| Type | Crawler |
| Purpose | Search |
| Acts for | Its operator |
| robots.txt token | OAI-SearchBot |
| IP ranges | Published by OpenAI |
| Documentation | OpenAI's documentation |
How Airglow identifies it
- DeclaredIt names itself in the User-Agent:
OAI-SearchBot.
Every visit in Airglow says which of these applied, so you can decide how much to trust it.
Seeing it on your site
It usually reads pages without running JavaScript, so Airglow counts every visit through a server connection (Cloudflare). When it does run JavaScript, the script sees and replays it too.
Allowing or blocking OAI-SearchBot
OAI-SearchBot reads the OAI-SearchBot group in your robots.txt. To keep it out of the whole site:
User-agent: OAI-SearchBot Disallow: /
OpenAI runs a separate bot for each purpose, so blocking OAI-SearchBot doesn't block its other agents listed below.
Airglow shows, for every agent that visits, whether your robots.txt lets it in, and helps you write rules by purpose (training, search, acting for a person).
Other agents from OpenAI
See when OAI-SearchBot visits your site
Airglow names every AI agent on your website, replays what it did and links the visitors it sends you. Free for one website.