Site History
Track how fr.de's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 10:28 AMPolicy SnapshotLatest
CLOSED39 AI bots blocked (31 training)
robots.txt
Policy changes:
Started blocking:
Cohere Training CrawlerLAION HuggingFace ProcessorLeipzig Corpora CollectionMeta External AgentOmgiliVelen Public Web CrawlerWebz.io ExtendediAsk Spiderimg2dataset (LAION)netEstate Imprint CrawlerInternet Archive BotInternet ArchiveCohere AIOmgilibot
Stopped blocking:
cohere-training-data-crawlerlaion-huggingface-processorLCCmeta-externalagentomgiliVelenPublicWebCrawlerwebzio-extendediaskspiderimg2datasetnetEstate NE Crawlerarchive.org_botia_archivercohere-aiomgilibot
📍
Feb 9, 2026, 10:28 AMTech ScanLatest
View Details10 technologies detected
Changes from previous scan:
+ Added:
core-jsBrain.js
📦
Feb 8, 2026, 05:20 AMTech Scan
View Details8 technologies detected
📦
🛡️
Jan 29, 2026, 08:54 AMPolicy Snapshot
CLOSED39 AI bots blocked (30 training)
robots.txt
First recorded policy snapshot
Summary
3
Tech Scans
2
Policy Snapshots
10
Current Techs
2
Techs Added (All Time)