Perplexity SEO: How It Finds and Cites Pages

Perplexity finds pages with two fetchers. Perplexity's crawler docs say PerplexityBot crawls sites to surface and link them in Perplexity search results, and Perplexity-User visits pages when a person asks a question. Allow PerplexityBot in robots.txt so your pages can show up. Then check citations by hand, with dates.

In this post, facts come from Perplexity's and Google's own docs. Anything else is marked as a hypothesis.

Which crawler does Perplexity use, and how do you allow it?

Perplexity uses PerplexityBot for its search results. Perplexity's crawler docs say PerplexityBot is designed to surface and link websites in Perplexity search results, and that it is not used to crawl content for AI foundation models.

To allow it, the same Perplexity docs recommend allowing PerplexityBot in your robots.txt file and allowing requests from its published IP ranges. A simple allow rule looks like this:

User-agent: PerplexityBot
Allow: /

If your site sits behind a firewall, check it too. Perplexity's docs say you may need to explicitly allow its crawlers in a web application firewall, and suggest matching both the user-agent and the IP address.

Does robots.txt control whether Perplexity cites you?

Only in part. Robots.txt controls PerplexityBot, but Perplexity's crawler docs say Perplexity-User generally ignores robots.txt rules, since a person asked for the fetch. That fetcher may visit a page to answer a question and include a link to it.

Robots.txt was never a hiding tool anyway. Google's robots.txt guide says it is mainly for managing crawler traffic, and warns not to use it to hide pages from search results. That warning is about Google, but the lesson carries over. If a page must stay private, put it behind a login.

How do you check whether Perplexity cites your page?

Check by hand on a fixed list of questions. Pick five to ten questions your readers ask. Ask each one in Perplexity on the same day each week. Write down the date, the question, and every source Perplexity links.

Answers can change from run to run, so one check proves little. Look for patterns across several weeks. Use my AI search visibility audit to collect your baseline.

What page traits make an answer easy to cite?

This section is a hypothesis, not a documented rule. Perplexity's crawler docs cover access, not how it picks sources. Here is what I would test:

• Open each section with a direct answer to its heading.
• Keep each claim next to the source that backs it.
• Put the important text in plain HTML, not only in images.
• Give each page one clear question to answer.

None of this is promised to work. Test one change at a time and watch your log.

How is this different from Google AI Overviews?

Google uses its normal search crawler and rules for AI features. Google's AI features guide says there are no extra requirements to appear in AI Overviews or AI Mode, and that robots.txt rules for Googlebot are the control for how your site is crawled for Search.

Perplexity is separate. It has its own crawler, its own user fetcher, and its own rules, per Perplexity's crawler docs. So you need to check both. My guide on how AEO and SEO work together covers how to plan one site for both.

Does blocking PerplexityBot stop citations?

Not fully. Blocking PerplexityBot stops the crawler that builds Perplexity's search results. But Perplexity's crawler docs say Perplexity-User generally ignores robots.txt when a person asks for a page. So your page could still be fetched and linked.

Where to go next

The AI search topic page has my other guides on this. The tools page has more to work with.

If you want to compare notes with other marketers, join the Cosmic AI community.