Perplexity-User
Tier 2Fetches pages when users click citations.
Perplexity-User๐ฏWhat is Perplexity-User?
Perplexity-User is an AI assistant fetcher operated by Perplexity. Fetches content for AI assistant responses.
User-initiated page fetch. On-demand, not bulk crawling.
Users can't click through to read your full content from Perplexity.
Does NOT respect robots.txt by design (user-initiated). Similar to a user clicking a link.
๐ขAbout Perplexity
Perplexity operates 2 known bots for AI assistant features. Their service reaches 100M+ monthly active users.
๐ก๏ธPerplexity-User robots.txt Configuration
Control Perplexity-User access to your website using robots.txt directives.
Block Perplexity-User
To completely block Perplexity-User from crawling your site:
User-agent: Perplexity-User
Disallow: /Allow Perplexity-User Full Access
To explicitly allow Perplexity-User to crawl your entire site:
User-agent: Perplexity-User
Allow: /Selective Access for Perplexity-User
To allow Perplexity-User but restrict certain directories:
User-agent: Perplexity-User
Disallow: /private/
Disallow: /api/
Disallow: /admin/
Allow: /โ Perplexity-User may not fully respect robots.txt. Consider additional server-side controls if needed.
Perplexity-User User-Agent String
The user-agent token for Perplexity-User is:
Perplexity-User๐Who Blocks Perplexity-User?
๐Other Perplexity Bots
Check Your Site's AI Policy
See if you're blocking or allowing Perplexity-User and other AI crawlers.