Site History

Track how information.dk's technology stack and AI policy have changed over time

📍

Mar 10, 2026, 07:59 AMPolicy SnapshotLatest

CLOSED

59 AI bots blocked (33 training)

robots.txt

Policy changes:

Started blocking:

FirecrawlGemini Deep ResearchProject MarinerMeta External AgentMeta External FetcherMistral AI UserQuillBot CrawlerVelen Public Web CrawlerWebz.io ExtendedBedrock BotCohere AICohere Training Crawlerimg2dataset (LAION)OmgiliOmgilibot

Stopped blocking:

FirecrawlAgentGemini-Deep-ResearchGoogleAgent-Marinermeta-externalagentMeta-ExternalFetcherMistralAI-UserQuillBotVelenPublicWebCrawlerwebzio-extendedbedrockbotcohere-aicohere-training-data-crawlerimg2datasetomgiliomgilibot

📍

Mar 10, 2026, 07:55 AMTech ScanLatest

View Details

13 technologies detected

First recorded analysis

🛡️

Feb 2, 2026, 08:15 PMPolicy Snapshot

CLOSED

59 AI bots blocked (33 training)

robots.txt

First recorded policy snapshot

Summary

Tech Scans

Policy Snapshots

Current Techs

Techs Added (All Time)