Site History
Track how tonymacx86.com's technology stack and AI policy have changed over time
📍
Mar 8, 2026, 03:58 PMPolicy SnapshotLatest
CLOSED63 AI bots blocked (34 training)
robots.txt
Policy changes:
RESTRICTIVE→CLOSED
Started blocking:
Meta External AgentAddSearchBotAI2BotAi2Bot-Dolmaanthropic-aiApplebotBedrock BotBravebotChatGPT AgentChatGPT-UserClaude-SearchBotClaude-UserClaude-WebCloudflare AutoRAGCohere AICohere Training CrawlerCotoyogiDeepSeekBotDevinDiffbotDuckAssistBotFacebookBotFirecrawlGemini Deep ResearchGoogle-CloudVertexBotGoogle NotebookLMProject MarinerGoogleOtherGoogleOther-ImageGoogleOther-Videoimg2dataset (LAION)Kangaroo BotLinerBotMeta External FetcherMistral AI UserNovaActOAI-SearchBotOmgiliOmgilibotOperatorPanguBotPerplexity-UserPerplexityBotPetalBotPhindBotQualifiedBotQuillBot CrawlerSBIntuitionsBotScrapyTikTokSpiderTimpibotVelen Public Web CrawlerWebz.io ExtendedYandexAdditionalYandexAdditionalBotYouBot
Stopped blocking:
meta-externalagent
📍
🛡️
Feb 2, 2026, 07:55 PMPolicy Snapshot
RESTRICTIVE8 AI bots blocked (7 training)
robots.txt
First recorded policy snapshot
Summary
1
Tech Scans
2
Policy Snapshots
16
Current Techs
0
Techs Added (All Time)