Site History
Track how lparchive.org's technology stack and AI policy have changed over time
📍
Apr 2, 2026, 06:34 PMPolicy SnapshotLatest
CLOSED52 AI bots blocked (33 training)
robots.txt
Policy changes:
Started blocking:
Bedrock BotCohere AICohere Training CrawlerFirecrawlimg2dataset (LAION)Meta External AgentMeta External FetcherOmgiliOmgilibotQuillBot CrawlerVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
bedrockbotcohere-aicohere-training-data-crawlerFirecrawlAgentimg2datasetmeta-externalagentMeta-ExternalFetcheromgiliomgilibotQuillBotVelenPublicWebCrawlerwebzio-extended
📍
🛡️
Feb 1, 2026, 07:55 PMPolicy Snapshot
CLOSED52 AI bots blocked (33 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
3
Current Techs
0
Techs Added (All Time)