Site History
Track how seekingalpha.com's technology stack and AI policy have changed over time
📍
Feb 9, 2026, 07:42 AMPolicy SnapshotLatest
CLOSED43 AI bots blocked (24 training)
robots.txt
Policy changes:
Started blocking:
Bedrock BotCohere AICohere Training CrawlerFirecrawlProject Marinerimg2dataset (LAION)Meta External AgentMeta External FetcherMistral AI UserOmgiliOmgilibotQuillBot CrawlerVelen Public Web CrawlerWebz.io Extended
Stopped blocking:
bedrockbotcohere-aicohere-training-data-crawlerFirecrawlAgentGoogleAgent-Marinerimg2datasetmeta-externalagentMeta-ExternalFetcherMistralAI-UseromgiliomgilibotQuillBotVelenPublicWebCrawlerwebzio-extended
📍
Feb 9, 2026, 07:42 AMTech ScanLatest
View Details28 technologies detected
Changes from previous scan:
+ Added:
Angularcore-js
- Removed:
OpenAIGPT Mentioned
📦
Feb 8, 2026, 02:47 AMTech Scan
View Details28 technologies detected
Changes from previous scan:
+ Added:
OpenAIGPT Mentioned
📦
🛡️
Jan 29, 2026, 08:12 AMPolicy Snapshot
CLOSED43 AI bots blocked (24 training)
robots.txt
First recorded policy snapshot
Summary
3
Tech Scans
2
Policy Snapshots
28
Current Techs
2
Techs Added (All Time)