Skip to content
此页面有中文版本。切换到中文 →
AI visibility

In AI search, see who reads your content — and who sends people back

ChatGPT, Perplexity, Claude and Gemini are changing how people find things. PathClue keeps two ledgers: the visitors AI assistants send you, and the pages their crawlers read.

  • AI assistants as their own source
  • AI crawlers counted separately
  • robots.txt compliance checks
2
ledgers: AI visitors and AI crawlers
197+
bot and crawler rules
404 · 5xx
crawl health for every crawler
llms.txt
and robots.txt rule generator
Why now

A new traffic source most reports can’t see

Industry reports through 2026 show AI referrals and AI crawler requests growing quickly — while most analytics tools still file them under “referral” and “bots”.

01

AI answers send visitors

When an assistant cites your page, some readers click through. Those visits convert differently from search — you should know how.

02

AI crawlers read a lot

Training and answer-engine crawlers fetch thousands of pages. Some send people back; some only take.

03

You need both numbers

Crawls without visits, or visits without knowing what was crawled, tell half the story. Together they show what your content is worth in AI search.

What you get

Two ledgers, read together

Visitors from AI on one side, crawls by AI companies on the other — matched by company, so the ratio is plain.

01

Crawled vs. sent back

For each AI company: how many pages its crawlers read, how many visitors its assistant sent, and the ratio between them. Spot the crawlers that only take.

  • Crawl-to-visit ratio per AI company
  • Pages AI sends people to most
  • Conversion: AI visitors vs search visitors
ClueByteDance crawled 2,650 pages and sent no visitors
02

AI visitors as a channel

ChatGPT, Perplexity, Claude, Gemini and Copilot each appear as their own source, with landing pages, conversion and revenue — right next to search and social.

  • Visitors and conversion per assistant
  • Landing pages people reach from AI answers
  • Trends you can alert on
ClueVisitors from Perplexity converted at 4.8% this month
03

Crawl health and compliance

Crawl volume, success rate and errors for every search engine and AI crawler, plus a check of real crawls against your robots.txt and llms.txt — with evidence, block snippets and a rule-file generator.

  • Crawl volume, 404s and 5xx per crawler
  • Violations of Disallow and Crawl-delay rules
  • Generate robots.txt and llms.txt rules
Setup

Both ledgers in three steps

AI visitors appear with the tracking script alone. Crawlers rarely run JavaScript, so the crawler ledger needs one server-side source.

  1. 1

    Add the snippet

    Visitors from AI assistants show up as their own source from the first visit.

  2. 2

    Connect a server-side source

    Send server events through the API or import Nginx / Apache access logs, so crawlers that skip JavaScript are counted too.

  3. 3

    Add your sitemap

    PathClue compares your sitemap and robots.txt with what each crawler actually fetched.

FAQ

AI visibility questions

Anything else — open the chat in the corner and ask.

Which AI assistants and crawlers are recognised?
Assistants such as ChatGPT, Perplexity, Claude, Gemini and Copilot are grouped as AI sources. Crawlers such as GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Bytespider and CCBot are identified among 197+ rules and kept up to date.
Why do I need server-side data for crawlers?
Most crawlers do not run JavaScript, so a browser script never sees them. Send server events through the API or import your Nginx or Apache logs and every crawl is recorded — with status code and response time.
Can PathClue block AI crawlers?
PathClue does not sit in front of your site, so it does not block requests. It shows which crawlers ignore your rules, and gives you robots.txt lines and an Nginx snippet to block them on your own server.
Does this show whether my brand is cited in AI answers?
It shows what reaches your site: crawls of your pages and the visitors AI assistants send. It does not run queries inside AI assistants to measure mentions.
Is this a separate product?
No. AI visitors are part of traffic analytics and the crawler reports are part of bot detection — this page brings them together.

Start on the free plan.
Find your first clue today.

No credit card. Paste one snippet and your first visitors show up within minutes — humans and bots already told apart.