duotrope.com
#334,618 GlobalHow this site handles AI crawlers, chatbots, and training
Updated May 25, 2026Visit site
Last checked: 3h ago
duotrope.com blocks AI crawlers from OpenAI, Anthropic, Google, and Perplexity in its robots.txt. Both training and search crawlers are restricted.
duotrope.com does not publish an llms.txt file. The site uses Content-Signal headers to opt out of AI training.
🦊
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site