r
robots.txt AI directives
AISite has AI-specific directives in robots.txt (GPTBot, ChatGPT-User, etc.)
AI Policy & Governance
AI Policy & Governance
Category
AI Tool
Type
About robots.txt AI directives
Site has AI-specific directives in robots.txt (GPTBot, ChatGPT-User, etc.)
Example Sites Using robots.txt AI directives
Wondering if your favorite site uses robots.txt AI directives?
There's only one way to find out.
Analyze a Site