Site History
Track how retailrebel.com's technology stack and AI policy have changed over time
📍
Apr 4, 2026, 02:40 AMPolicy SnapshotLatest
CLOSED23 AI bots blocked (19 training)
robots.txt
Policy changes:
Started blocking:
Cohere AICohere Training Crawlerimg2dataset (LAION)Meta External AgentOmgiliOmgilibot
Stopped blocking:
cohere-aicohere-training-data-crawlerimg2datasetmeta-externalagentomgiliomgilibot
📍
🛡️
Jan 30, 2026, 11:58 AMPolicy Snapshot
CLOSED23 AI bots blocked (19 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
10
Current Techs
0
Techs Added (All Time)