Skip to content
Search crawler Run by Perplexity

What is PerplexityBot?

Short answer: PerplexityBot is Perplexity's search crawler. Perplexity says it is designed to surface and link websites in Perplexity's search results and is not used to crawl content for AI foundation models. If you want Perplexity to cite you, allow PerplexityBot in robots.txt and in your firewall.

PerplexityBot at a glance

Run by
Perplexity
Type
Search crawler
Used for
Perplexity search results
robots.txt name
PerplexityBot
Follows robots.txt
Yes
Last checked
18 November 2026
User agent
Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot) As listed by Perplexity. The version number may change.

What does PerplexityBot do?

PerplexityBot indexes pages so Perplexity can show and link them as sources in its answers. Perplexity states it is not used to crawl content for AI foundation models.

Perplexity recommends allowing PerplexityBot in robots.txt and permitting its published IP addresses in your firewall, since bot protection that blocks it has the same effect as a robots.txt block.

What happens if you block PerplexityBot?

Blocking PerplexityBot means Perplexity will not index your page text, so it is much less likely to cite you. Perplexity says it may still index the domain, headline and a brief factual summary of a blocked page.

Blocking PerplexityBot does not control Perplexity-User, which fetches pages when a user's question needs them.

How do you allow or block PerplexityBot in robots.txt?

Does PerplexityBot follow robots.txt? Yes. Perplexity says PerplexityBot will not index the full or partial text of a site that disallows it in robots.txt, although it may still index the domain, headline and a brief factual summary.

Add one of these groups to the robots.txt file at the root of your site. Several User-agent lines in a row share the rules below them, and a crawler follows only the most specific group that names it, so repeat any private paths in that group.

Block PerplexityBot

User-agent: PerplexityBot
Disallow: /

Allow PerplexityBot, keep /admin/ private

User-agent: PerplexityBot
Allow: /
Disallow: /admin/

Should you block PerplexityBot?

Our view: Allow it if you want to appear as a source in Perplexity. There is no training trade off to weigh, because Perplexity says PerplexityBot is not used to train foundation models.

How do you verify a real PerplexityBot request?

Perplexity publishes PerplexityBot's IP addresses at perplexity.ai/perplexitybot.json and says to treat that file as the source of truth, because the ranges change. Its sample firewall rule matches both the user agent and the IP list.

PerplexityBot questions

What is the PerplexityBot user agent?
Perplexity lists it as: Mozilla/5.0 (compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot). As listed by Perplexity. The version number may change.
Does PerplexityBot follow robots.txt?
Yes. Perplexity says PerplexityBot will not index the full or partial text of a site that disallows it in robots.txt, although it may still index the domain, headline and a brief factual summary.
Does PerplexityBot train AI models?
No. Perplexity says PerplexityBot is not used to crawl content for AI foundation models.
Can Perplexity show my page if I block PerplexityBot?
Partly. Perplexity says it will not index the page text, but may still index the domain, headline and a brief factual summary.
Why can't Perplexity read my site even though robots.txt allows it?
Often a firewall or bot protection service is blocking it. Perplexity recommends allowing the IP addresses in perplexity.ai/perplexitybot.json.
How do I check whether my site allows PerplexityBot?
Run your domain through the free ONEGO AI crawler checker. It reads your robots.txt and shows whether PerplexityBot and 15 other AI crawlers are allowed, blocked or partly restricted, and what each rule means.

Crawlers can read you. Does AI recommend you?

See your ONE Score first · 7 day free trial, no card needed · Pay only if you keep tracking