All insights
AI search research
8 min read26 August 2026Nathan Mzumara

Your AI Visibility Tool Is Blind to 79% of the Web ChatGPT Reads

Your AI Visibility Tool Is Blind to 79% of the Web ChatGPT Reads

ChatGPT pulled 564 distinct domains into context across 60 software buying answers. It cited 118 of them. Every AI visibility tool on the market measures the 118 and cannot see the other 446. That is 79.1% of the corpus the model actually consulted, invisible – including, in many cases, the pages that shaped the answer's framing without earning a link. If your dashboard says "not cited", you do not know whether you were absent from the room or present and overruled.

This article sets out what the measurement gap is, why it exists, and a framework for closing it.

The gap, in numbers

StageCountVisible to citation-only tools
Search results returned2,680No
Unique URLs considered2,327No
Distinct domains retrieved564No
Citations rendered367Yes
Unique URLs cited258Yes
Distinct domains cited118Yes

Two survival rates fall out, and they are not the same number.

URL survival is 11.09% – the odds that a specific page, having been retrieved, appears as a link. Domain survival is 20.9% – the odds that a publisher, having been read at all, is named anywhere.

Of 564 domains ChatGPT consulted, 446 were read and discarded. 2,069 of 2,327 unique URLs – 88.91% – never became a citation.

Why the gap exists

ChatGPT streams its answer over a server-sent-event connection. That stream carries far more than the visible text: the resolved model, the tool invocations, the full set of search results returned to the model, and the citation objects attached to the final message.

Almost every AI visibility product on the market works from the rendered page, or from an API response, and therefore sees only the last of those. The retrieval set – what the model read – is available in the stream and discarded before render.

The gap between the retrieval set and the citation set is the single most useful thing in this dataset, and no third-party AI-visibility tool currently exposes it.

What you lose by measuring citations only

You cannot distinguish absence from defeat. A brand that was never retrieved has a discoverability problem: the query fan-out is not surfacing its pages at all. A brand that was retrieved five times and cited zero times has a conversion problem: its pages surface but do not contain the extractable, checkable claims that citations bind to. Those are completely different diagnoses with completely different fixes, and citation-only monitoring reports both as zero.

You mis-rank source types. Review aggregators convert retrievals into citations at 28.8%, the best rate of any source type in the corpus, but were retrieved only 52 times across sixty answers – 1.9% of everything read. From a citation-only view, aggregators look weak. From a retrieval view, they look strong but starved. The fix in one case is content structure; in the other it is discoverability. Same data, opposite conclusions.

Source typeRetrieval shareCitation shareConversion
Review aggregator1.9%4.1%28.8%
Independent comparison site9.3%14.4%21.3%
Editorial media3.0%4.1%18.5%
Analyst / market research3.2%4.4%18.4%
Vendor-owned55.1%65.9%16.4%
Independent testing lab0.8%0.8%13.6%
Government / regulator0.6%0.5%11.8%
Agency / consultancy / partner7.7%5.7%10.2%
Community / UGC1.2%0.0%0.0%

You miss the long tail entirely. 339 domains in this corpus were retrieved fewer than twice and never cited – 453 retrievals, 16.9% of everything read, contributing zero citations. That tail is where new comparison sites appear before they start winning citations. By the time one shows up in a citation-only dashboard, it has already been shaping your category's shortlist for months.

A measurement framework that survives this data

Four principles, each of which follows directly from a finding in the corpus.

1. Measure retrieval and citation as separate funnels

Report three numbers per brand per category: retrieval rate (share of answers in which any page on your domain was pulled into context), citation rate (share in which you were cited), and conversion (citation rate divided by retrieval rate). Conversion isolates the content-structure problem from the discoverability problem.

2. Measure the prompt space, not the prompt

Six phrasings of the same buying question returned brand sets overlapping by a mean Jaccard of 0.338, and the top-ranked vendor changed 3.8 times out of six across ten categories. A single tracked prompt is close to noise. Run all six archetypes – unconstrained best-of, segment-constrained, head-to-head, alternatives-to, budget-constrained, category landscape – and report the distribution with its variance.

3. Separate "cited" from "recommended"

69.3% of the 358 brand recommendations in this corpus had no citation to that vendor anywhere in the answer, and the top-ranked pick was unsupported 28.3% of the time. Citation share and recommendation share are different metrics with different levers on different timescales. Merging them into one "AI visibility score" destroys the signal.

Your AI Visibility Tool Is Blind to 79% of the Web ChatGPT Reads

Report recommendation separately as: presence rate, mean rank, and times ranked first.

4. Track the publisher tail, not a watchlist

118 cited domains, a Herfindahl–Hirschman index of 177, top domain share 4.9%, and 55 domains cited exactly once. There is no publisher watchlist that covers this. Monitoring has to be built around discovering unfamiliar domains that recur, not checking a fixed list of known ones.

The minimum viable instrumentation

You do not need a vendor to do this. The method used for this study is reproducible.

ChatGPT streams to /backend-api/f/conversation. A fetch interceptor installed in the page tees the response body – the browser renders one copy, your harness parses the other. Nothing about the request is altered. For each prompt, record:

  • Resolved model slug – the model that actually served the turn, not the one selected in the UI. All sixty runs here resolved to gpt-5-6-mini under automatic routing.
  • The retrieval set – every search result group, keyed by domain, with URL, page title and publication date. This is what the model read.
  • The citation set – every source pill rendered into the answer, with its resolved URL. This is what the user sees.
  • The answer text, response latency, and the ordered position of every brand mention.

Then normalise domains to the registrable domain so help.asana.com and www.asana.com resolve to one publisher, and classify each domain by source type. In this study all 225 cited-or-repeatedly-retrieved domains were classified by hand, and where a domain's nature was not obvious the site itself was read before classifying it.

Controls that make the numbers mean something

Run every prompt in a fresh conversation so no answer conditions another. Use temporary chat where possible – it is excluded from history and from model personalisation. Record the resolved model on every run, because automatic routing can change what serves the turn.

For brand detection, use a fixed lexicon scoped to each category with overlapping matches masked longest-first, so that "Microsoft Dynamics 365" is never double-counted as "Dynamics 365". That single detail will otherwise inflate your mention counts materially.

And state your limits. Sixty prompts is a probe, not a census. Geography varied by prompt wording rather than by IP means geo-routing effects are not measured. Citation pills grouped behind a "+1" affordance counted by primary URL means the citation count is a floor. A Free-tier account routing to a small model may behave differently from a paid tier routing to a large one.

Measurement that states its own limits is worth more than a confident single number that cannot be interrogated. That is as true in AI visibility as it was in organic search.

FAQ

Why do AI visibility tools only show citations?

Because they work from the rendered answer or an API response, which contains only the citation objects. The full retrieval set - every search result returned to the model - is present in the response stream but discarded before render. Capturing it requires instrumenting the stream itself.

How much does a citation-only view miss?

79.1% of the domains the model consulted. Across 60 answers ChatGPT retrieved 564 distinct domains and cited 118. At URL level, 2,069 of 2,327 unique URLs - 88.91% - never appeared as a citation.

What is the difference between retrieval rate and citation rate?

Retrieval rate is the share of answers where your pages were pulled into the model's context. Citation rate is the share where you were linked. Conversion - citation divided by retrieval - separates a discoverability problem from a content-structure problem, and citation-only tools report both as zero.

How many prompts do I need to measure AI visibility reliably?

More than one per question. With shortlist overlap at a mean Jaccard of 0.338 and the category leader changing 3.8 times across six phrasings, single-prompt tracking is close to noise. Run all six buying archetypes per category and report the distribution with its variance.

Can I measure ChatGPT retrieval myself?

Yes. ChatGPT streams to /backend-api/f/conversation over server-sent events. A fetch interceptor tees the response body so you can parse the retrieval set, citation set, resolved model and answer text while the browser renders normally. Nothing about the request is altered.

About the research. Nathan Mzumara is an organic growth and AI search practitioner working on measurement methodology for AI search. All figures here come from a live capture of the ChatGPT response stream on 26 August 2026: 60 prompts, 2,680 retrieved results, 367 citations, 225 hand-classified domains. Method and limitations are stated in the pillar report.

Tags

GEOAEOAI visibilitymeasurementanalytics

Primary research · August 2026

How ChatGPT Shortlists Software Brands

An audit across 10 categories and 60 buying questions. I recorded what ChatGPT reads, throws away and links to when a buyer asks it which software to buy, and what that decides.

60
Questions asked
10
Software markets
2,680
Results read
367
Links shown
Free35 pages · PDF · 536 KBDiscovery Digest every Friday

Free download

Get the full report

35 pages · PDF · 536 KB. Enter your details and it downloads straight away.

Downloading How ChatGPT Shortlists Software Brands also subscribes you to the Discovery Digest, one email every Friday. No spam, unsubscribe anytime.