Site History

Track how cityweekly.net's technology stack and AI policy have changed over time

📍

May 30, 2026, 04:23 AMPolicy SnapshotLatest

CLOSED

67 AI bots blocked (32 training)

robots.txt

Policy changes:

Started blocking:

Amazon KendraAmazon Buy For MeBedrock BotCloudflare AutoRAGCohere AICohere Training CrawlerFirecrawlGemini Deep ResearchGoogle NotebookLMProject MarineriAsk Spiderimg2dataset (LAION)LAION HuggingFace ProcessorLAION DownloaderLeipzig Corpora CollectionMeta External AgentMeta External FetcherMistral AI UserOmgiliOmgilibotQuillBot CrawlerWebz.io ExtendedInternet Archive BotInternet Archive

Stopped blocking:

amazon-kendraAmazonBuyForMebedrockbotCloudflare-AutoRAGcohere-aicohere-training-data-crawlerFirecrawlAgentGemini-Deep-ResearchGoogle-NotebookLMGoogleAgent-Marineriaskspiderimg2datasetlaion-huggingface-processorLAIONDownloaderLCCmeta-externalagentMeta-ExternalFetcherMistralAI-UseromgiliomgilibotQuillBotwebzio-extended

📍

May 30, 2026, 04:22 AMTech ScanLatest

View Details

14 technologies detected

First recorded analysis

🛡️

Feb 2, 2026, 03:47 PMPolicy Snapshot

CLOSED

65 AI bots blocked (31 training)

robots.txt

First recorded policy snapshot

Summary

Tech Scans

Policy Snapshots

Current Techs

Techs Added (All Time)