Meta External Fetcher
Tier 2Fetches content for Meta AI assistant responses.
Meta-ExternalFetcher🎯What is Meta External Fetcher?
Meta External Fetcher is an AI assistant fetcher operated by Meta. Fetches content for AI assistant responses.
Real-time retrieval for Meta AI responses. May be cached.
Meta AI can't fetch your content when users ask questions.
Powers the 'search the web' feature in Meta AI across FB/IG/WhatsApp.
🏢About Meta
Meta operates 4 known bots for AI assistant features. Their service reaches 600M+ Meta AI users.
🛡️Meta-ExternalFetcher robots.txt Configuration
Control Meta-ExternalFetcher access to your website using robots.txt directives.
Block Meta-ExternalFetcher
To completely block Meta External Fetcher from crawling your site:
User-agent: Meta-ExternalFetcher
Disallow: /Allow Meta-ExternalFetcher Full Access
To explicitly allow Meta External Fetcher to crawl your entire site:
User-agent: Meta-ExternalFetcher
Allow: /Selective Access for Meta-ExternalFetcher
To allow Meta External Fetcher but restrict certain directories:
User-agent: Meta-ExternalFetcher
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /Meta-ExternalFetcher User-Agent String
The user-agent token for Meta External Fetcher is:
Meta-ExternalFetcher🌐Who Blocks Meta External Fetcher?
🔗Other Meta Bots
Check Your Site's AI Policy
See if you're blocking or allowing Meta External Fetcher and other AI crawlers.