Site History
Track how howlongtobeat.com's technology stack and AI policy have changed over time
📍
Feb 14, 2026, 02:04 AMPolicy SnapshotLatest
CLOSED59 AI bots blocked (27 training)
robots.txt
Policy changes:
OPEN→CLOSED
Started blocking:
AddSearchBotAI2BotAI2Bot-DeepResearchEvalAi2Bot-DolmaAmazonbotAmazon Buy For Meanthropic-aiApplebotApplebot-ExtendedAtlassian BotBravebotBytespiderCCBotChatGLM-SpiderChatGPT-UserClaude-SearchBotClaude-UserClaude-WebClaudeBotCohere AICohere Training CrawlerCotoyogiCrawl4AIDeepSeekBotDevinDiffbotDuckAssistBotFacebookBotGPTBotiAsk SpiderimageSpiderKangaroo BotKlaviyoAIBotLAION HuggingFace ProcessorLeipzig Corpora CollectionLinerBotLinkupBotManus-UserMeta External AgentMeta External FetcherMistral AI UserNovaActOAI-SearchBotOmgiliPanguBotPerplexity-UserPerplexityBotPetalBotQualifiedBotSBIntuitionsBotScrapySpiderTavilyBotTimpibotTwinAgentVelen Public Web CrawlerWebz.io ExtendedYouBotZanistaBot
Removed llms.txt
📍
Feb 14, 2026, 02:04 AMTech ScanLatest
View Details19 technologies detected
Changes from previous scan:
+ Added:
OneTrustGoogle AnalyticsMicrosoft AdvertisingChartbeatcomScoreFastlyAdmiralLiveIntentGoogle WorkspaceAmazon Route 53
- Removed:
Next.js App RouterWebpackApolloGraphQL
📦
🛡️
Feb 1, 2026, 02:07 AMPolicy Snapshot
OPEN0 AI bots blocked
robots.txtllms.txt
🛡️
Jan 29, 2026, 03:39 PMPolicy Snapshot
OPEN0 AI bots blocked
robots.txtllms.txt
First recorded policy snapshot
Summary
2
Tech Scans
3
Policy Snapshots
19
Current Techs
10
Techs Added (All Time)