Site History
Track how amazon.fr's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 10:20 PMTech ScanLatest
View Details4 technologies detected
📍
Feb 9, 2026, 04:57 AMPolicy SnapshotLatest
CLOSED33 AI bots blocked (15 training)
robots.txt
Policy changes:
Started blocking:
Project MarinerMeta External AgentOmgiliGemini Deep ResearchMistral AI UserGoogle NotebookLMMeta External FetcheriAsk SpiderCohere AIimg2dataset (LAION)Velen Public Web Crawler
Stopped blocking:
GoogleAgent-Marinermeta-externalagentomgiliGemini-Deep-ResearchMistralAI-UserGoogle-NotebookLMMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawler
Removed llms.txt
📦
Feb 9, 2026, 04:57 AMTech Scan
View Details4 technologies detected
📦
Feb 7, 2026, 11:28 PMTech Scan
View Details4 technologies detected
Changes from previous scan:
- Removed:
HSTS
🛡️
Jan 29, 2026, 07:02 AMPolicy Snapshot
CLOSED33 AI bots blocked (15 training)
robots.txtllms.txt
Policy changes:
UNKNOWN→CLOSED
Started blocking:
GPTBotCCBotPerplexityBotGoogle-ExtendedGoogleAgent-MarinerClaudeBotmeta-externalagentBytespiderScrapyPetalBotDevinomgiliAI2BotGemini-Deep-ResearchPanguBotMistralAI-UserDiffbotGoogle-NotebookLMDuckAssistBotAi2Bot-DolmaGoogle-CloudVertexBotMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawlerYouBotClaude-UserClaude-SearchBotPerplexity-UserChatGPT-UserOAI-SearchBotTimpibot
🛡️
Jan 29, 2026, 06:35 AMPolicy Snapshot
UNKNOWN0 AI bots blocked
llms.txt
Policy changes:
CLOSED→UNKNOWN
Stopped blocking:
GPTBotCCBotPerplexityBotGoogle-ExtendedGoogleAgent-MarinerClaudeBotmeta-externalagentBytespiderScrapyPetalBotDevinomgiliAI2BotGemini-Deep-ResearchPanguBotMistralAI-UserDiffbotGoogle-NotebookLMDuckAssistBotAi2Bot-DolmaGoogle-CloudVertexBotMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawlerYouBotClaude-UserClaude-SearchBotPerplexity-UserChatGPT-UserOAI-SearchBotTimpibot
🛡️
Jan 29, 2026, 06:20 AMPolicy Snapshot
CLOSED33 AI bots blocked (15 training)
robots.txtllms.txt
First recorded policy snapshot
📦
Summary
4
Tech Scans
4
Policy Snapshots
4
Current Techs
0
Techs Added (All Time)