Site History
Track how amazon.co.jp's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 10:14 PMTech ScanLatest
View Details3 technologies detected
📍
Feb 9, 2026, 04:50 AMPolicy SnapshotLatest
CLOSED33 AI bots blocked (15 training)
robots.txt
Policy changes:
Started blocking:
Project MarinerMeta External AgentOmgiliGemini Deep ResearchMistral AI UserGoogle NotebookLMMeta External FetcheriAsk SpiderCohere AIimg2dataset (LAION)Velen Public Web Crawler
Stopped blocking:
GoogleAgent-Marinermeta-externalagentomgiliGemini-Deep-ResearchMistralAI-UserGoogle-NotebookLMMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawler
📦
Feb 9, 2026, 04:50 AMTech Scan
View Details3 technologies detected
📦
Feb 7, 2026, 11:20 PMTech Scan
View Details3 technologies detected
Changes from previous scan:
- Removed:
HSTSAmazon Advertising
🛡️
Feb 2, 2026, 09:53 PMPolicy Snapshot
CLOSED33 AI bots blocked (15 training)
robots.txt
Policy changes:
Removed llms.txt
🛡️
Jan 29, 2026, 07:00 AMPolicy Snapshot
CLOSED33 AI bots blocked (15 training)
robots.txtllms.txt
Policy changes:
UNKNOWN→CLOSED
Started blocking:
GPTBotCCBotPerplexityBotGoogle-ExtendedGoogleAgent-MarinerClaudeBotmeta-externalagentBytespiderScrapyPetalBotDevinomgiliAI2BotGemini-Deep-ResearchPanguBotMistralAI-UserDiffbotGoogle-NotebookLMDuckAssistBotAi2Bot-DolmaGoogle-CloudVertexBotMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawlerYouBotClaude-UserClaude-SearchBotPerplexity-UserChatGPT-UserOAI-SearchBotTimpibot
🛡️
Jan 29, 2026, 06:35 AMPolicy Snapshot
UNKNOWN0 AI bots blocked
llms.txt
Policy changes:
CLOSED→UNKNOWN
Stopped blocking:
GPTBotCCBotPerplexityBotGoogle-ExtendedGoogleAgent-MarinerClaudeBotmeta-externalagentBytespiderScrapyPetalBotDevinomgiliAI2BotGemini-Deep-ResearchPanguBotMistralAI-UserDiffbotGoogle-NotebookLMDuckAssistBotAi2Bot-DolmaGoogle-CloudVertexBotMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawlerYouBotClaude-UserClaude-SearchBotPerplexity-UserChatGPT-UserOAI-SearchBotTimpibot
🛡️
Jan 29, 2026, 06:20 AMPolicy Snapshot
CLOSED33 AI bots blocked (15 training)
robots.txtllms.txt
First recorded policy snapshot
📦
Summary
4
Tech Scans
5
Policy Snapshots
3
Current Techs
0
Techs Added (All Time)