Google-CloudVertexBot
Tier 2Collects data for Vertex AI model building.
Google-CloudVertexBot🎯What is Google-CloudVertexBot?
Google-CloudVertexBot is an AI training crawler operated by Google. Collects data to train AI models.
Enterprise AI platform training data.
Content won't be used for custom enterprise AI models on Google Cloud.
Used by businesses building custom AI on Google Cloud.
🏢About Google
🛡️Google-CloudVertexBot robots.txt Configuration
Control Google-CloudVertexBot access to your website using robots.txt directives.
Block Google-CloudVertexBot
To completely block Google-CloudVertexBot from crawling your site:
User-agent: Google-CloudVertexBot
Disallow: /Allow Google-CloudVertexBot Full Access
To explicitly allow Google-CloudVertexBot to crawl your entire site:
User-agent: Google-CloudVertexBot
Allow: /Selective Access for Google-CloudVertexBot
To allow Google-CloudVertexBot but restrict certain directories:
User-agent: Google-CloudVertexBot
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /✓ Google-CloudVertexBot respects robots.txt directives.
Google-CloudVertexBot User-Agent String
The user-agent token for Google-CloudVertexBot is:
Google-CloudVertexBot🌐Who Blocks Google-CloudVertexBot?
🔗Other Google Bots
Check Your Site's AI Policy
See if you're blocking or allowing Google-CloudVertexBot and other AI crawlers.