wilcotecapetown.co.za
#219,718 GlobalHow this site handles AI crawlers, chatbots, and training
Updated Apr 18, 2026Visit site
Last checked: 2d ago
wilcotecapetown.co.za blocks AI crawlers from Google but does not block OpenAI, Anthropic, and Perplexity. Training crawlers face the most restrictions, though some search bots are also blocked.
wilcotecapetown.co.za publishes an llms.txt file to declare its AI usage preferences.
🦊
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site