ChatGPT-User
Tier 1Fetches pages when users ask ChatGPT to browse. User-triggered, not automatic crawling.
ChatGPT-User๐ฏWhat is ChatGPT-User?
ChatGPT-User is an AI assistant fetcher operated by OpenAI. Fetches content for AI assistant responses.
On-demand retrieval for user queries. Not stored or used for training.
Users can't ask ChatGPT to read your pages. May frustrate users trying to learn about you.
User-initiated browsing, similar to a human using a browser. Low volume, high intent traffic.
๐ขAbout OpenAI
OpenAI operates 5 known bots for AI assistant features. Their service reaches 300M+ weekly active users.
๐ก๏ธChatGPT-User robots.txt Configuration
Control ChatGPT-User access to your website using robots.txt directives.
Block ChatGPT-User
To completely block ChatGPT-User from crawling your site:
User-agent: ChatGPT-User
Disallow: /Allow ChatGPT-User Full Access
To explicitly allow ChatGPT-User to crawl your entire site:
User-agent: ChatGPT-User
Allow: /Selective Access for ChatGPT-User
To allow ChatGPT-User but restrict certain directories:
User-agent: ChatGPT-User
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /โ ChatGPT-User respects robots.txt directives.
ChatGPT-User User-Agent String
The user-agent token for ChatGPT-User is:
ChatGPT-User๐Who Blocks ChatGPT-User?
๐Other OpenAI Bots
Check Your Site's AI Policy
See if you're blocking or allowing ChatGPT-User and other AI crawlers.