Site History
Track how anglers.jp's technology stack and AI policy have changed over time
📍
Mar 9, 2026, 06:50 PMPolicy SnapshotLatest
CLOSED28 AI bots blocked (20 training)
robots.txt
Policy changes:
Started blocking:
Cohere AICohere Training Crawlerimg2dataset (LAION)Meta External AgentMeta External FetcherOmgiliOmgilibotVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
cohere-aicohere-training-data-crawlerimg2datasetmeta-externalagentMeta-ExternalFetcheromgiliomgilibotVelenPublicWebCrawlerwebzio-extended
📍
🛡️
Feb 1, 2026, 12:03 PMPolicy Snapshot
CLOSED28 AI bots blocked (20 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
5
Current Techs
0
Techs Added (All Time)