Site History

Track how ludwigshafen24.de's technology stack and AI policy have changed over time

📍

Feb 14, 2026, 03:31 AMPolicy SnapshotLatest

CLOSED

39 AI bots blocked (31 training)

robots.txt

Policy changes:

Started blocking:

Cohere Training CrawlerLAION HuggingFace ProcessorLeipzig Corpora CollectionMeta External AgentOmgiliVelen Public Web CrawlerWebz.io ExtendediAsk Spiderimg2dataset (LAION)netEstate Imprint CrawlerInternet Archive BotInternet ArchiveCohere AIOmgilibot

Stopped blocking:

cohere-training-data-crawlerlaion-huggingface-processorLCCmeta-externalagentomgiliVelenPublicWebCrawlerwebzio-extendediaskspiderimg2datasetnetEstate NE Crawlerarchive.org_botia_archivercohere-aiomgilibot

📍

Feb 14, 2026, 03:31 AMTech ScanLatest

View Details

5 technologies detected

Changes from previous scan:

+ Added:

core-jsPrebid

📦

Feb 6, 2026, 10:19 AMTech Scan

View Details

3 technologies detected

First recorded analysis

🛡️

Jan 29, 2026, 03:47 PMPolicy Snapshot

CLOSED

39 AI bots blocked (30 training)

robots.txt

First recorded policy snapshot

Summary

Tech Scans

Policy Snapshots

Current Techs

Techs Added (All Time)