Site History
Track how askmen.com's technology stack and AI policy have changed over time
📍
Feb 13, 2026, 08:46 AMPolicy SnapshotLatest
CLOSED59 AI bots blocked (27 training)
robots.txt
Policy changes:
Started blocking:
Amazon Buy For MeAtlassian BotCohere AICohere Training CrawlerCrawl4AIiAsk SpiderimageSpiderLAION HuggingFace ProcessorLeipzig Corpora CollectionLinkupBotManus-UserMeta External AgentMeta External FetcherMistral AI UserOmgiliSBIntuitionsBotSpiderTavilyBotTwinAgentVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
atlassian-botcohere-aicohere-training-data-crawlermeta-externalagentMeta-ExternalFetcherMistralAI-UseromgiliVelenPublicWebCrawlerwebzio-extended
📍
Feb 13, 2026, 08:46 AMTech ScanLatest
View Details15 technologies detected
Changes from previous scan:
+ Added:
Google WorkspaceCloudflare DNS
- Removed:
RubyID5Alpine.js
📦
🛡️
Jan 29, 2026, 01:59 PMPolicy Snapshot
CLOSED47 AI bots blocked (21 training)
robots.txt
First recorded policy snapshot
Summary
2
Tech Scans
2
Policy Snapshots
15
Current Techs
2
Techs Added (All Time)