Site History
Track how franceculture.fr's technology stack and AI policy have changed over time
๐
Feb 14, 2026, 02:41 PMPolicy SnapshotLatest
CLOSED46 AI bots blocked (25 training)
robots.txt
Policy changes:
Started blocking:
Cohere AIMeta External AgentMeta External FetcherOmgiliOmgilibotPetalBotCohere Training CrawlerScrapyimg2dataset (LAION)Mistral AI UserDuckAssistBotGrokBotDeepSeekBotPanguBotAI2BotAI2Bot-DeepResearchEvalAi2Bot-DolmaAmazon KendraBedrock BotChatGLM-SpiderCotoyogiGemini Deep ResearchGoogle-CloudVertexBotGoogle NotebookLMProject MarineriAsk SpiderLinerBotQualifiedBotTikTokSpiderTimpibotVelen Public Web CrawlerZanistaBotKlaviyoAIBot
Stopped blocking:
cohere-aimeta-externalagentMeta-ExternalFetcher
๐
๐ก๏ธ
Jan 29, 2026, 05:03 PMPolicy Snapshot
CLOSED16 AI bots blocked (9 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
11
Current Techs
0
Techs Added (All Time)