Site History
Track how buckscountycouriertimes.com's technology stack and AI policy have changed over time
📍
May 21, 2026, 04:40 PMPolicy SnapshotLatest
CLOSED76 AI bots blocked (37 training)
robots.txt
Policy changes:
Started blocking:
Cohere AIOmgiliOmgilibotMeta External AgentCohere Training Crawlerimg2dataset (LAION)Meta External FetcherVelen Public Web CrawlerWebz.io ExtendedInternet ArchiveInternet Archive BotiAsk SpiderMistral AI UserDeepSeekBotChatGLM-SpiderGoogleOtherFirecrawlCrawl4AIimageSpiderLAION HuggingFace ProcessorLeipzig Corpora CollectionSpiderCloudflare AutoRAGBravebotAddSearchBotAtlassian BotLinkupBotZanistaBotGemini Deep ResearchGoogle NotebookLMPerplexity-UserTavilyBotPhindBotAI2Bot-DeepResearchEvalKlaviyoAIBotLinerBotDevinChatGPT AgentProject MarinerAmazon Buy For MeManus-UserTwinAgent
Stopped blocking:
cohere-aiomgiliomgilibotmeta-externalagentcohere-training-data-crawlerimg2datasetMeta-ExternalFetcherVelenPublicWebCrawlerwebzio-extendedia_archiverarchive.org_botiaskspiderMistralAI-User
📍
🛡️
Feb 2, 2026, 12:53 PMPolicy Snapshot
CLOSED47 AI bots blocked (28 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
16
Current Techs
0
Techs Added (All Time)