Site History
Track how pennlive.com's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 03:52 PMPolicy SnapshotLatest
CLOSED22 AI bots blocked (13 training)
robots.txt
Policy changes:
Started blocking:
Internet ArchiveInternet Archive BotOmgiliMeta External FetcherMeta External AgentCohere AIOmgilibot
Stopped blocking:
ia_archiverarchive.org_botomgiliMeta-ExternalFetchermeta-externalagentcohere-aiomgilibot
📍
🛡️
Jan 29, 2026, 11:12 AMPolicy Snapshot
CLOSED22 AI bots blocked (12 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
30
Current Techs
0
Techs Added (All Time)