Site History
Track how gazetteandherald.co.uk's technology stack and AI policy have changed over time
📍
Apr 3, 2026, 12:39 AMPolicy SnapshotLatest
CLOSED43 AI bots blocked (25 training)
robots.txt
Policy changes:
Started blocking:
Cohere AIimg2dataset (LAION)Meta External AgentMeta External FetcherOmgiliOmgilibotVelen Public Web CrawlerWebz.io ExtendedCohere Training CrawlerCotoyogiInternet ArchiveMistral AI UserNovaActQualifiedBotSBIntuitionsBotTikTokSpiderYandexAdditionalYandexAdditionalBotInternet Archive BotClaude-User
Stopped blocking:
cohere-aiimg2datasetmeta-externalagentMeta-ExternalFetcheromgiliomgilibotVelenPublicWebCrawlerwebzio-extended
📍
🛡️
Feb 1, 2026, 08:00 PMPolicy Snapshot
CLOSED31 AI bots blocked (18 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
15
Current Techs
0
Techs Added (All Time)