Site History
Track how payless.com's technology stack and AI policy have changed over time
📍
Apr 12, 2026, 08:13 PMPolicy SnapshotLatest
CLOSED10 AI bots blocked (9 training)
robots.txt
Policy changes:
Started blocking:
Cohere Training Crawlerimg2dataset (LAION)OmgiliOmgilibot
Stopped blocking:
anthropic-aiApplebot-ExtendedClaudeBotcohere-aicohere-training-data-crawlerDuckAssistBotFacebookBotGoogle-ExtendedGoogleOtherGoogleOther-ImageGoogleOther-VideoGPTBotimg2datasetmeta-externalagentomgiliomgilibotYouBot
📍
🛡️
Feb 1, 2026, 11:08 PMPolicy Snapshot
CLOSED23 AI bots blocked (19 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
15
Current Techs
0
Techs Added (All Time)