OAI-SearchBot
Tier 1Retrieves content for ChatGPT search features. Does not collect training data.
OAI-SearchBot๐ฏWhat is OAI-SearchBot?
OAI-SearchBot is an AI search crawler operated by OpenAI. Powers AI-enhanced search features.
Real-time retrieval only. Content shown with attribution, not used for training.
Your site won't appear in ChatGPT search results or citations. Significant traffic loss potential.
Blocking this is like blocking Googlebot for AI search. Consider allowing for visibility.
๐ขAbout OpenAI
OpenAI operates 5 known bots for AI-powered search. Their service reaches 300M+ weekly active users.
๐ก๏ธOAI-SearchBot robots.txt Configuration
Control OAI-SearchBot access to your website using robots.txt directives.
Block OAI-SearchBot
To completely block OAI-SearchBot from crawling your site:
User-agent: OAI-SearchBot
Disallow: /Allow OAI-SearchBot Full Access
To explicitly allow OAI-SearchBot to crawl your entire site:
User-agent: OAI-SearchBot
Allow: /Selective Access for OAI-SearchBot
To allow OAI-SearchBot but restrict certain directories:
User-agent: OAI-SearchBot
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /โ OAI-SearchBot respects robots.txt directives.
OAI-SearchBot User-Agent String
The user-agent token for OAI-SearchBot is:
OAI-SearchBot๐Who Blocks OAI-SearchBot?
๐Other OpenAI Bots
Check Your Site's AI Policy
See if you're blocking or allowing OAI-SearchBot and other AI crawlers.