Site History

Track how closerweekly.com's technology stack and AI policy have changed over time

📍

Mar 9, 2026, 10:03 AMPolicy SnapshotLatest

CLOSED

41 AI bots blocked (25 training)

robots.txt

Policy changes:

Started blocking:

Internet Archive BotCohere Training CrawlerCohere AIOmgilibotOmgiliFirecrawlInternet Archiveimg2dataset (LAION)Mistral AI UserMeta External AgentMeta External FetcherQuillBot CrawlerVelen Public Web CrawlerWebz.io Extended

Stopped blocking:

cohere-training-data-crawlercohere-aiomgilibotomgiliFirecrawlAgentimg2datasetMistralAI-Usermeta-externalagentMeta-ExternalFetcherQuillBotVelenPublicWebCrawlerwebzio-extended

📍

Mar 9, 2026, 10:03 AMTech ScanLatest

View Details

22 technologies detected

First recorded analysis

🛡️

Feb 2, 2026, 07:57 PMPolicy Snapshot

CLOSED

39 AI bots blocked (24 training)

robots.txt

First recorded policy snapshot

Summary

Tech Scans

Policy Snapshots

Current Techs

Techs Added (All Time)