Site History

Track how derwesten.de's technology stack and AI policy have changed over time

📍

Feb 9, 2026, 07:29 PMPolicy SnapshotLatest

CLOSED

61 AI bots blocked (33 training)

robots.txt

Policy changes:

Started blocking:

Bedrock BotCloudflare AutoRAGCohere AICohere Training CrawlerFirecrawlGemini Deep ResearchGoogle NotebookLMProject MarinerInternet Archiveimg2dataset (LAION)Mistral AI UserOmgiliOmgilibotQuillBot CrawlerVelen Public Web CrawlerWebz.io Extended

Stopped blocking:

bedrockbotCloudflare-AutoRAGcohere-aicohere-training-data-crawlerFirecrawlAgentGemini-Deep-ResearchGoogle-NotebookLMGoogleAgent-Marineria_archiverimg2datasetMistralAI-UseromgiliomgilibotQuillBotVelenPublicWebCrawlerwebzio-extended

📍

Feb 9, 2026, 07:27 PMTech ScanLatest

View Details

12 technologies detected

Changes from previous scan:

+ Added:

ReactSnowplow AnalyticsRadix UIMicrosoft 365

📦

Feb 5, 2026, 03:38 AMTech Scan

View Details

8 technologies detected

First recorded analysis

🛡️

Jan 29, 2026, 12:02 PMPolicy Snapshot

CLOSED

61 AI bots blocked (32 training)

robots.txt

First recorded policy snapshot

Summary

Tech Scans

Policy Snapshots

Current Techs

Techs Added (All Time)