Site History
Track how gld.nl's technology stack and AI policy have changed over time
📍
Feb 23, 2026, 02:48 AMPolicy SnapshotLatest
CLOSED61 AI bots blocked (30 training)
robots.txt
Policy changes:
Started blocking:
OmgilibotAtlassian BotCloudflare AutoRAGCohere AICohere Training CrawlerGemini Deep ResearchGoogle NotebookLMiAsk SpiderLAION HuggingFace ProcessorLeipzig Corpora CollectionMeta External AgentMeta External FetcherMistral AI UserOmgiliVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
omgilibotatlassian-botCloudflare-AutoRAGcohere-aicohere-training-data-crawlerGemini-Deep-ResearchGoogle-NotebookLMiaskspiderlaion-huggingface-processorLCCmeta-externalagentMeta-ExternalFetcherMistralAI-UseromgiliVelenPublicWebCrawlerwebzio-extended
📍
🛡️
Jan 30, 2026, 12:30 AMPolicy Snapshot
CLOSED61 AI bots blocked (30 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
19
Current Techs
0
Techs Added (All Time)