Site History
Track how usatoday.com's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 10:12 PMTech ScanLatest
View Details19 technologies detected
📍
Feb 9, 2026, 04:49 AMPolicy SnapshotLatest
CLOSED47 AI bots blocked (28 training)
robots.txt
Policy changes:
Started blocking:
Cohere AIOmgiliOmgilibotMeta External AgentCohere Training Crawlerimg2dataset (LAION)Meta External FetcherVelen Public Web CrawlerWebz.io ExtendedInternet ArchiveInternet Archive BotiAsk SpiderMistral AI User
Stopped blocking:
cohere-aiomgiliomgilibotmeta-externalagentcohere-training-data-crawlerimg2datasetMeta-ExternalFetcherVelenPublicWebCrawlerwebzio-extendedia_archiverarchive.org_botiaskspiderMistralAI-User
📦
Feb 9, 2026, 04:49 AMTech Scan
View Details19 technologies detected
📦
Feb 7, 2026, 11:18 PMTech Scan
View Details19 technologies detected
Changes from previous scan:
+ Added:
Admiral
- Removed:
AI PoweredUnderscore.jsreCAPTCHACriteoPubMaticRubicon ProjectID533AcrossBackbone.jsMixpanel
🛡️
Feb 2, 2026, 09:52 PMPolicy Snapshot
CLOSED47 AI bots blocked (28 training)
robots.txt
🛡️
Jan 29, 2026, 07:00 AMPolicy Snapshot
CLOSED47 AI bots blocked (27 training)
robots.txt
🛡️
Jan 29, 2026, 06:20 AMPolicy Snapshot
CLOSED47 AI bots blocked (27 training)
robots.txt
First recorded policy snapshot
📦
Summary
4
Tech Scans
4
Policy Snapshots
19
Current Techs
1
Techs Added (All Time)