Site History
Track how thesun.co.uk's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 05:55 AMPolicy SnapshotLatest
CLOSED0 AI bots blocked
robots.txt
Policy changes:
UNKNOWN→CLOSED
Removed llms.txt
📍
Feb 9, 2026, 05:55 AMTech ScanLatest
View Details25 technologies detected
Changes from previous scan:
+ Added:
core-js
- Removed:
Angular
📦
Feb 8, 2026, 12:32 AMTech Scan
View Details25 technologies detected
Changes from previous scan:
+ Added:
Angular
📦
🛡️
Jan 29, 2026, 07:32 AMPolicy Snapshot
UNKNOWN0 AI bots blocked
llms.txt
Policy changes:
CLOSED→UNKNOWN
Stopped blocking:
CCBotanthropic-aicohere-aiia_archiveromgiliomgilibotGoogle-ExtendedClaude-WebClaudeBotBytespiderFacebookBotApplebotApplebot-ExtendedPerplexityBotmeta-externalagentScrapy
🛡️
Jan 29, 2026, 06:30 AMPolicy Snapshot
CLOSED16 AI bots blocked (10 training)
robots.txtllms.txt
First recorded policy snapshot
Summary
3
Tech Scans
3
Policy Snapshots
25
Current Techs
1
Techs Added (All Time)