Site History
Track how delfi.lv's technology stack and AI policy have changed over time
📍
Feb 12, 2026, 05:51 AMPolicy SnapshotLatest
CLOSED27 AI bots blocked (17 training)
robots.txt
Policy changes:
Started blocking:
Cohere AICohere Training CrawlerMeta External AgentMeta External FetcherOmgiliWebz.io Extended
Stopped blocking:
cohere-aicohere-training-data-crawlermeta-externalagentMeta-ExternalFetcheromgiliwebzio-extended
Removed llms.txt
📍
🛡️
Jan 29, 2026, 11:31 AMPolicy Snapshot
CLOSED27 AI bots blocked (17 training)
robots.txtllms.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
35
Current Techs
0
Techs Added (All Time)