Research
Analysis and insights on AI crawlers, bot behavior, and how the web is adapting to AI.
Web StandardsFebruary 2026
WebMCP: Your Website Is Now a Function Call
Google and Microsoft shipped the first browser implementation of WebMCP. Here's what it is, how it works, and who it disrupts.
Bot AnalysisFebruary 2026
Grok Bot User Agent: xAI's Crawler Spoofs Its Identity
GrokBot is documented but never seen in logs. xAI's crawler uses spoofed Chrome and Safari headers. Here's how I caught it.
Industry ReportJanuary 2026
Who's Blocking AI?
We analyzed 10,000 top websites to see how they handle AI crawlers. The results show a web splitting in two.