Site History
Track how rutlandherald.com's technology stack and AI policy have changed over time
📍
Mar 29, 2026, 03:48 PMPolicy SnapshotLatest
CLOSED26 AI bots blocked (18 training)
robots.txt
Policy changes:
Started blocking:
Meta External AgentVelen Public Web CrawlerWebz.io ExtendedCohere AIimg2dataset (LAION)OmgiliOmgilibot
Stopped blocking:
meta-externalagentVelenPublicWebCrawlerwebzio-extendedcohere-aiimg2datasetomgiliomgilibot
Removed llms.txt
📍
🛡️
Jan 30, 2026, 10:11 AMPolicy Snapshot
CLOSED26 AI bots blocked (18 training)
robots.txtllms.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
18
Current Techs
0
Techs Added (All Time)