datasette.simonwillison.net
How this site handles AI crawlers, chatbots, and training
Updated Feb 9, 2026Visit site
Last checked: 16h ago
datasette.simonwillison.net blocks all crawlers in its robots.txt, including AI bots from OpenAI, Anthropic, Google, and Perplexity.
datasette.simonwillison.net does not publish an llms.txt file.
🦊
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site