tld-list.com
#198,356 GlobalHow this site handles AI crawlers, chatbots, and training
Updated Apr 9, 2026Visit site
Last checked: 3h ago
tld-list.com blocks AI crawlers from OpenAI but does not block Anthropic, Google, and Perplexity. Training crawlers are restricted while search and assistant bots remain accessible.
tld-list.com does not publish an llms.txt file.
๐ฆ
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site