Site History

Track how amazon.com.au's technology stack and AI policy have changed over time

๐Ÿ“
Feb 10, 2026, 12:10 AMTech ScanLatest
View Details
3 technologies detected
๐Ÿ“
Feb 9, 2026, 05:17 AMPolicy SnapshotLatest
CLOSED
33 AI bots blocked (15 training)
robots.txt
Policy changes:
Started blocking:
Project MarinerMeta External AgentOmgiliGemini Deep ResearchMistral AI UserGoogle NotebookLMMeta External FetcheriAsk SpiderCohere AIimg2dataset (LAION)Velen Public Web Crawler
Stopped blocking:
GoogleAgent-Marinermeta-externalagentomgiliGemini-Deep-ResearchMistralAI-UserGoogle-NotebookLMMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawler
Removed llms.txt
๐Ÿ“ฆ
Feb 9, 2026, 05:17 AMTech Scan
View Details
3 technologies detected
Changes from previous scan:
+ Added:
Amazon CloudFront
- Removed:
HSTSAmazon Advertising
๐Ÿ“ฆ
Feb 7, 2026, 11:53 PMTech Scan
View Details
4 technologies detected
First recorded analysis
๐Ÿ›ก๏ธ
Jan 31, 2026, 03:28 PMPolicy Snapshot
CLOSED
33 AI bots blocked (15 training)
robots.txtllms.txt
Policy changes:
UNKNOWNโ†’CLOSED
Started blocking:
GPTBotCCBotPerplexityBotGoogle-ExtendedGoogleAgent-MarinerClaudeBotmeta-externalagentBytespiderScrapyPetalBotDevinomgiliAI2BotGemini-Deep-ResearchPanguBotMistralAI-UserDiffbotGoogle-NotebookLMDuckAssistBotAi2Bot-DolmaGoogle-CloudVertexBotMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawlerYouBotClaude-UserClaude-SearchBotPerplexity-UserChatGPT-UserOAI-SearchBotTimpibot
๐Ÿ›ก๏ธ
Jan 29, 2026, 07:10 AMPolicy Snapshot
UNKNOWN
0 AI bots blocked
llms.txt
Policy changes:
CLOSEDโ†’UNKNOWN
Stopped blocking:
GPTBotCCBotPerplexityBotGoogle-ExtendedGoogleAgent-MarinerClaudeBotmeta-externalagentBytespiderScrapyPetalBotDevinomgiliAI2BotGemini-Deep-ResearchPanguBotMistralAI-UserDiffbotGoogle-NotebookLMDuckAssistBotAi2Bot-DolmaGoogle-CloudVertexBotMeta-ExternalFetcheriaskspidercohere-aiimg2datasetVelenPublicWebCrawlerYouBotClaude-UserClaude-SearchBotPerplexity-UserChatGPT-UserOAI-SearchBotTimpibot
๐Ÿ›ก๏ธ
Jan 29, 2026, 06:20 AMPolicy Snapshot
CLOSED
33 AI bots blocked (15 training)
robots.txtllms.txt
First recorded policy snapshot

Summary

3
Tech Scans
4
Policy Snapshots
3
Current Techs
1
Techs Added (All Time)