indeed.co.uk
#192,274 GlobalHow this site handles AI crawlers, chatbots, and training
Updated Apr 7, 2026Visit site
Last checked: 2h ago
indeed.co.uk blocks AI crawlers from OpenAI but does not block Anthropic, Google, and Perplexity. Training crawlers face the most restrictions, though some search bots are also blocked.
indeed.co.uk publishes an llms.txt file to declare its AI usage preferences.
Stack Health
View all →🦊
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site