Article may be outdated

This article is 2 days old. Some details may have changed since publication.

Hacker News·4 min read·medium

A third of Perplexity's citations don't contain the number they're cited for

J
jakobgreenfeld
A third of Perplexity's citations don't contain the number they're cited for
AI Summary

A study of Perplexity's search models reveals that over a third of citations for numerical claims either point to inaccessible pages or do not contain the cited data. The audit highlights significant reliability issues in AI-generated provenance markers.

Why it matters

As AI search tools become primary information sources, the accuracy of their citations is critical for maintaining public trust and preventing the spread of misinformation.

Dive DeeperCreate a free account to unlock

Of 1,826 citations Perplexity's search models attached to a sentence stating a figure, 34.7% pointed at a page that either would not open or did not contain a single figure from that sentence; scored per claim rather than per citation, 14.4% of 872 claims fail.

We asked Perplexity's two search models 310 factual questions about 210 technology companies, collected every source they cited, fetched all of them, and checked whether the page said the thing it was cited for. Of the 1,826 citations attached to a sentence stating a figure — the ones checkable without a second opinion — 34.7% pointed at a page that would not open to an ordinary reader, or opened and contained none of the numbers in the sentence they were attached to. The models placed 2,511 citation markers in all.

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
technologybusiness

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in