Site History
Track how augsburger-allgemeine.de's technology stack and AI policy have changed over time
📍
Feb 11, 2026, 02:32 AMPolicy SnapshotLatest
CLOSED55 AI bots blocked (35 training)
robots.txt
Policy changes:
Started blocking:
Internet ArchiveOmgiliOmgilibotLeipzig Corpora CollectionBedrock BotCohere AICohere Training CrawlerFirecrawlGemini Deep ResearchProject Marinerimg2dataset (LAION)Meta External AgentMeta External FetcherMistral AI UserQuillBot CrawlerVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
ia_archiveromgiliomgilibotLCCbedrockbotcohere-aicohere-training-data-crawlerFirecrawlAgentGemini-Deep-ResearchGoogleAgent-Marinerimg2datasetmeta-externalagentMeta-ExternalFetcherMistralAI-UserQuillBotVelenPublicWebCrawlerwebzio-extended
Removed llms.txt
📍
Feb 11, 2026, 02:31 AMTech ScanLatest
View Details10 technologies detected
📦
Feb 8, 2026, 07:47 AMTech Scan
View Details10 technologies detected
📦
🛡️
Jan 29, 2026, 09:31 AMPolicy Snapshot
CLOSED55 AI bots blocked (34 training)
robots.txtllms.txt
First recorded policy snapshot
Summary
3
Tech Scans
2
Policy Snapshots
10
Current Techs
0
Techs Added (All Time)