Site History
Track how computerbild.de's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 03:52 PMPolicy SnapshotLatest
CLOSED52 AI bots blocked (32 training)
robots.txt
Policy changes:
Started blocking:
Bedrock BotCohere AICohere Training CrawlerFirecrawlGemini Deep ResearchProject Marinerimg2dataset (LAION)Meta External AgentMeta External FetcherMistral AI UserOmgiliOmgilibotQuillBot CrawlerVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
bedrockbotcohere-aicohere-training-data-crawlerFirecrawlAgentGemini-Deep-ResearchGoogleAgent-Marinerimg2datasetmeta-externalagentMeta-ExternalFetcherMistralAI-UseromgiliomgilibotQuillBotVelenPublicWebCrawlerwebzio-extended
📍
🛡️
Jan 29, 2026, 11:12 AMPolicy Snapshot
CLOSED52 AI bots blocked (32 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
12
Current Techs
0
Techs Added (All Time)