pro-football-reference.com
#20,426 GlobalHow this site handles AI crawlers, chatbots, and training
Updated Feb 5, 2026Visit site
Last checked: 5d ago
pro-football-reference.com blocks AI crawlers from OpenAI but does not block Anthropic, Google, and Perplexity. Training crawlers are restricted while search and assistant bots remain accessible.
pro-football-reference.com does not publish an llms.txt file.
๐ฆ
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site