Site History
Track how insidehalton.com's technology stack and AI policy have changed over time
📍
Mar 10, 2026, 03:39 PMPolicy SnapshotLatest
CLOSED61 AI bots blocked (31 training)
robots.txt
Policy changes:
Started blocking:
Meta External AgentVelen Public Web CrawlerWebz.io ExtendedCohere AIimg2dataset (LAION)OmgiliOmgilibotCohere Training CrawlerMeta External FetcherGemini Deep ResearchMistral AI UserGoogle NotebookLMAtlassian BotCloudflare AutoRAGLAION HuggingFace ProcessorLeipzig Corpora Collection
Stopped blocking:
meta-externalagentVelenPublicWebCrawlerwebzio-extendedcohere-aiimg2datasetomgiliomgilibotcohere-training-data-crawlerMeta-ExternalFetcherGemini-Deep-ResearchMistralAI-UserGoogle-NotebookLMatlassian-botCloudflare-AutoRAGlaion-huggingface-processorLCC
📍
🛡️
Feb 2, 2026, 08:16 PMPolicy Snapshot
CLOSED61 AI bots blocked (31 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
21
Current Techs
0
Techs Added (All Time)