history-hunters.pl
#346,813 GlobalHow this site handles AI crawlers, chatbots, and training
Updated May 30, 2026Visit site
Last checked: 9h ago
history-hunters.pl blocks all crawlers in its robots.txt, including AI bots from OpenAI, Anthropic, Google, and Perplexity. Training crawlers face the most restrictions, though some search bots are also blocked.
history-hunters.pl does not publish an llms.txt file.
Stack Health
View all →🦊
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site