Site History
Track how nsd.se's technology stack and AI policy have changed over time
๐
Mar 3, 2026, 10:35 AMPolicy SnapshotLatest
CLOSED38 AI bots blocked (25 training)
robots.txt
Policy changes:
Started blocking:
Cohere AICohere Training Crawlerimg2dataset (LAION)Meta External AgentMeta External FetcherOmgiliOmgilibotVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
cohere-aicohere-training-data-crawlerimg2datasetmeta-externalagentMeta-ExternalFetcheromgiliomgilibotVelenPublicWebCrawlerwebzio-extended
Removed llms.txt
๐
๐ก๏ธ
Feb 1, 2026, 10:18 AMPolicy Snapshot
CLOSED38 AI bots blocked (25 training)
robots.txtllms.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
8
Current Techs
0
Techs Added (All Time)