Site History
Track how metro.co.uk's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 06:44 AMPolicy SnapshotLatest
CLOSED47 AI bots blocked (29 training)
robots.txt
Policy changes:
Started blocking:
Bedrock BotCohere AIGemini Deep Researchimg2dataset (LAION)Meta External AgentMeta External FetcherMistral AI UserOmgiliOmgilibotVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
bedrockbotcohere-aiGemini-Deep-Researchimg2datasetmeta-externalagentMeta-ExternalFetcherMistralAI-UseromgiliomgilibotVelenPublicWebCrawlerwebzio-extended
📍
Feb 9, 2026, 06:43 AMTech ScanLatest
View Details25 technologies detected
📦
Feb 8, 2026, 01:43 AMTech Scan
View Details25 technologies detected
Changes from previous scan:
- Removed:
AI PoweredAkamaiAkamai Bot Manager
📦
🛡️
Jan 29, 2026, 07:54 AMPolicy Snapshot
CLOSED47 AI bots blocked (29 training)
robots.txt
First recorded policy snapshot
Summary
3
Tech Scans
2
Policy Snapshots
25
Current Techs
0
Techs Added (All Time)