21st.dev
#264,873 GlobalHow this site handles AI crawlers, chatbots, and training
Updated May 5, 2026Visit site
Last checked: 2h ago
21st.dev blocks AI crawlers from OpenAI, Anthropic, and Perplexity but does not block Google. Both training and search crawlers are restricted.
21st.dev publishes an llms.txt file to declare its AI usage preferences.
Stack Health
View all →SendGrid
Degraded2h ago
HubSpot
Operational5m ago
Clerk
Operational5h ago
Vercel
Operational1h ago
Postmark
Operational26d ago
+1 more monitored services — see all
🦊
Check any site's AI policy
Discover how websites handle AI crawlers, chatbots, and training data collection
Analyze Another Site