Devin🎯What is Devin?
Devin is an autonomous AI agent operated by Cognition AI. Autonomous AI browsing for tasks.
Task execution for software development.
Devin AI can't browse your site to complete coding tasks.
First AI software engineer. Can browse docs, write code, debug. May become important for developer-focused sites.
🏢About Cognition AI
Cognition AI operates 1 known bot for autonomous AI tasks. Their service reaches Early access users.
🛡️Devin robots.txt Configuration
Control Devin access to your website using robots.txt directives.
Block Devin
To completely block Devin from crawling your site:
User-agent: Devin
Disallow: /Allow Devin Full Access
To explicitly allow Devin to crawl your entire site:
User-agent: Devin
Allow: /Selective Access for Devin
To allow Devin but restrict certain directories:
User-agent: Devin
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /✓ Devin respects robots.txt directives.
Devin User-Agent String
The user-agent token for Devin is:
Devin🌐Who Blocks Devin?
Check Your Site's AI Policy
See if you're blocking or allowing Devin and other AI crawlers.