Google-Extended
Tier 1Controls whether content is used for Gemini/Vertex AI training. Does NOT affect Google Search.
Google-Extended🎯What is Google-Extended?
Google-Extended is an AI training crawler operated by Google. Collects data to train AI models.
Pre-training for Gemini models. Separate from Search indexing (Googlebot).
Content won't train Gemini models. Google Search ranking completely UNAFFECTED.
Safe to block without SEO impact. Only affects AI training, not search visibility.
🏢About Google
Google operates 9 known bots for AI model training. Their service reaches 350M+ Gemini users, 4B+ Google users.
🛡️Google-Extended robots.txt Configuration
Control Google-Extended access to your website using robots.txt directives.
Block Google-Extended
To completely block Google-Extended from crawling your site:
User-agent: Google-Extended
Disallow: /Allow Google-Extended Full Access
To explicitly allow Google-Extended to crawl your entire site:
User-agent: Google-Extended
Allow: /Selective Access for Google-Extended
To allow Google-Extended but restrict certain directories:
User-agent: Google-Extended
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /✓ Google-Extended respects robots.txt directives.
Google-Extended User-Agent String
The user-agent token for Google-Extended is:
Google-Extended🌐Who Blocks Google-Extended?
🔗Other Google Bots
Check Your Site's AI Policy
See if you're blocking or allowing Google-Extended and other AI crawlers.