Site History
Track how amazon.in's technology stack and AI policy have changed over time
๐
Feb 9, 2026, 10:29 PMTech ScanLatest
View Details8 technologies detected
Changes from previous scan:
+ Added:
HSTSReactAnt Designcore-jsAmazon Advertising
๐
Feb 9, 2026, 05:04 AMPolicy SnapshotLatest
CLOSED33 AI bots blocked (15 training)
robots.txt
Policy changes:
Started blocking:
Project MarinerMeta External AgentOmgiliGemini Deep ResearchMistral AI UserGoogle NotebookLMMeta External FetcheriAsk SpiderCohere AIimg2dataset (LAION)Velen Public Web Crawler
Stopped blocking:
GoogleAgent-Marinermeta-externalagentomgiliGemini-Deep-ResearchMistralAI-UserGoogle-NotebookLMMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawler
๐ฆ
Feb 9, 2026, 05:04 AMTech Scan
View Details3 technologies detected
Changes from previous scan:
- Removed:
HSTS
๐ก๏ธ
Feb 2, 2026, 09:51 PMPolicy Snapshot
CLOSED33 AI bots blocked (15 training)
robots.txt
Policy changes:
Removed llms.txt
๐ก๏ธ
Jan 30, 2026, 11:11 PMPolicy Snapshot
CLOSED33 AI bots blocked (15 training)
robots.txtllms.txt
Policy changes:
UNKNOWNโCLOSED
Started blocking:
GPTBotCCBotPerplexityBotGoogle-ExtendedGoogleAgent-MarinerClaudeBotmeta-externalagentBytespiderScrapyPetalBotDevinomgiliAI2BotGemini-Deep-ResearchPanguBotMistralAI-UserDiffbotGoogle-NotebookLMDuckAssistBotAi2Bot-DolmaGoogle-CloudVertexBotMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawlerYouBotClaude-UserClaude-SearchBotPerplexity-UserChatGPT-UserOAI-SearchBotTimpibot
๐ก๏ธ
Jan 29, 2026, 06:35 AMPolicy Snapshot
UNKNOWN0 AI bots blocked
llms.txt
Policy changes:
CLOSEDโUNKNOWN
Stopped blocking:
GPTBotCCBotPerplexityBotGoogle-ExtendedGoogleAgent-MarinerClaudeBotmeta-externalagentBytespiderScrapyPetalBotDevinomgiliAI2BotGemini-Deep-ResearchPanguBotMistralAI-UserDiffbotGoogle-NotebookLMDuckAssistBotAi2Bot-DolmaGoogle-CloudVertexBotMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawlerYouBotClaude-UserClaude-SearchBotPerplexity-UserChatGPT-UserOAI-SearchBotTimpibot
๐ก๏ธ
Jan 29, 2026, 06:20 AMPolicy Snapshot
CLOSED33 AI bots blocked (15 training)
robots.txtllms.txt
First recorded policy snapshot
๐ฆ
Summary
3
Tech Scans
5
Policy Snapshots
8
Current Techs
4
Techs Added (All Time)