Site History
Track how guardianbookshop.com's technology stack and AI policy have changed over time
📍
May 14, 2026, 10:34 PMPolicy SnapshotLatest
CLOSED33 AI bots blocked (22 training)
robots.txt
Policy changes:
OPEN→CLOSED
Started blocking:
AI2BotAi2Bot-DolmaAmazonbotApplebotApplebot-ExtendedBytespiderCCBotChatGPT-UserClaude-WebClaudeBotDiffbotFacebookBotGPTBotGoogle-ExtendedGoogleOtherGoogleOther-ImageGoogleOther-VideoKangaroo BotMeta External AgentMeta External FetcherOAI-SearchBotPerplexityBotPetalBotScrapyTimpibotVelen Public Web CrawlerWebz.io ExtendedYouBotanthropic-aiCohere AIimg2dataset (LAION)OmgiliOmgilibot
📍
🛡️
Feb 2, 2026, 10:28 AMPolicy Snapshot
OPEN0 AI bots blocked
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
13
Current Techs
0
Techs Added (All Time)