mining-technology.com
#73,676 GlobalHow this site handles AI crawlers, chatbots, and training
Updated Feb 22, 2026Visit site
Last checked: 2/22/2026
mining-technology.com blocks AI crawlers from OpenAI but does not block Anthropic, Google, and Perplexity. Training crawlers are restricted while search and assistant bots remain accessible.
mining-technology.com does not publish an llms.txt file.
🦊
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site