arstechnica.co.uk
#175,810 GlobalHow this site handles AI crawlers, chatbots, and training
Updated Apr 2, 2026Visit site
Last checked: 1h ago
arstechnica.co.uk blocks AI crawlers from Anthropic, Google, and Perplexity but does not block OpenAI. Training crawlers face the most restrictions, though some search bots are also blocked.
arstechnica.co.uk does not publish an llms.txt file.
🦊
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site