Site History
Track how nyt.com's technology stack and AI policy have changed over time
๐
Feb 9, 2026, 09:50 AMPolicy SnapshotLatest
CLOSED27 AI bots blocked (14 training)
robots.txt
Policy changes:
Started blocking:
Internet Archive BotCohere AIMeta External AgentMeta External FetcherOmgiliOmgilibot
Stopped blocking:
archive.org_botcohere-aimeta-externalagentMeta-ExternalFetcheromgiliomgilibot
๐
Feb 9, 2026, 09:50 AMTech ScanLatest
View Details28 technologies detected
Changes from previous scan:
+ Added:
Tailwind CSSAI PoweredEnvoyZipkincore-jsGoogle PayDaisyUI
๐ฆ
๐ก๏ธ
Jan 29, 2026, 08:44 AMPolicy Snapshot
CLOSED27 AI bots blocked (14 training)
robots.txt
First recorded policy snapshot
Summary
2
Tech Scans
2
Policy Snapshots
28
Current Techs
7
Techs Added (All Time)