Meta External Agent
Tier 2Collects data for Meta AI model training.
meta-externalagent🎯What is Meta External Agent?
Meta External Agent is an AI training crawler operated by Meta. Collects data to train AI models.
Pre-training for Llama models. Powers Meta AI across all Meta apps.
Content won't train future Llama models or Meta AI features.
Llama models are open-source and widely used. Meta AI integrated into Facebook, Instagram, WhatsApp.
🏢About Meta
Meta operates 4 known bots for AI model training. Their service reaches 600M+ Meta AI users across FB, IG, WhatsApp.
🛡️meta-externalagent robots.txt Configuration
Control meta-externalagent access to your website using robots.txt directives.
Block meta-externalagent
To completely block Meta External Agent from crawling your site:
User-agent: meta-externalagent
Disallow: /Allow meta-externalagent Full Access
To explicitly allow Meta External Agent to crawl your entire site:
User-agent: meta-externalagent
Allow: /Selective Access for meta-externalagent
To allow Meta External Agent but restrict certain directories:
User-agent: meta-externalagent
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /✓ Meta External Agent respects robots.txt directives.
meta-externalagent User-Agent String
The user-agent token for Meta External Agent is:
meta-externalagent🌐Who Blocks Meta External Agent?
🔗Other Meta Bots
Check Your Site's AI Policy
See if you're blocking or allowing Meta External Agent and other AI crawlers.