PerplexityBot: what it is and how to block it
What is PerplexityBot?
PerplexityBot is the crawler Perplexity uses to find websites and link them in its search results. Perplexity says it is not used to crawl content for training foundation models.
- Operator
- Perplexity
- Used for
- AI search
- robots.txt token
PerplexityBot- robots.txt
- Opt out in robots.txt
- IP ranges
- Published list
Checked against Perplexity's documentation
What is the PerplexityBot user agent string?
Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)Perplexity publishes this as an example. The version number can change.
How do I block PerplexityBot in robots.txt?
Add these two lines to the robots.txt file at the root of your domain. Perplexity documents the PerplexityBot token in robots.txt.
User-agent: PerplexityBot
Disallow: /To allow it everywhere instead, use:
User-agent: PerplexityBot
Allow: /What happens if you block PerplexityBot?
Perplexity recommends allowing it so your pages can appear and be linked in its answers.
Should you block PerplexityBot?
Allow it if you want Perplexity to cite and link your pages. It is a search crawler, not a training crawler.
Other Perplexity crawlers and AI agents
- Perplexity-UserPerplexity, user-triggered
- GPTBotOpenAI, model training
- OAI-SearchBotOpenAI, AI search
- ChatGPT-UserOpenAI, user-triggered
- ClaudeBotAnthropic, model training
- Google-ExtendedGoogle, model training
See the full AI crawler list or read the official Perplexity docs
A blog AI search can read
Every Ranken blog ships a robots.txt that welcomes AI search crawlers, plus server-rendered pages, schema and llms.txt.