AI robots.txt Generator
Control how AI crawlers access your site in 4 easy steps.
⚠️
Important: robots.txt has limitations
robots.txt only works for bots that choose to respect it. New AI agents like OpenAI Operator and Claude Computer Use browse as regular browsers and cannot be blocked via robots.txt. For comprehensive protection, consider rate limiting, authentication, or services like Cloudflare Bot Management.
Start Fresh
Create AI crawler rules from scratch. Choose a preset or customize individually.
Import Existing robots.txt
Have rules already? We'll preserve Googlebot, Sitemap, etc. and let you edit AI rules.
or paste