Artificial Intelligence1 min read

Only 40% of AI-cited statistics trace back to a study

By · Published by Everything Blog

In short

The underlying problem is rarely outright hallucination, as the cited source pages actually contained the specified numbers 82 percent of the time. However, a mere 21 percent of those links directed readers straight to authentic research papers instead of secondary intermediaries like corporate blogs and news articles. Across the tested models, ChatGPT achieved the highest accuracy while citing the fewest figures, averaging only 1.3 numbers per response.

Key points

  • Most untraceable statistics stem from artificial intelligence referencing secondary aggre…: Most untraceable statistics stem from artificial intelligence referencing secondary aggregators rather than fabricating numbers entirely from scratch.
  • Models that cite fewer statistics per response tend to produce more verifiable references…: Models that cite fewer statistics per response tend to produce more verifiable references than tools that cite heavily.
  • Users relying on artificial intelligence queries must independently audit citations becau…: Users relying on artificial intelligence queries must independently audit citations because more than half fail to lead to original research.

Sources checked by our analysis pipeline: 1

One number, followed.

We asked ChatGPT, Perplexity, Gemini, Claude and Google’s AI Overviews 200 questions that call for a number, the kind people ask every day.Note 1A statistic is a share, rate, average, count or cost that an assistant states as fact. We left out advice (“save 20% of your income”) and prices. Then we clicked the citations, and kept clicking. Here is one trail, from the answer to the end.

Google AI Overviews

What percentage of salespeople give up after one follow-up?

44% of salespeople give up after just one follow-up attempt.

- 44%

- 44%

- 44%

- 44%

- 44%

44% of salespeople give up after one follow-up attempt (source).

80 Percent of Sales Require 5 Follow-up Calls after Meeting; 44 Percent Salespeople Give Up After One Follow-up

No study behind itNo survey, no sample, no date.

- In the answer

Every assistant got the same question: “What percentage of salespeople give up after one follow-up?” All five assistants gave the same figure, and only ChatGPT said the evidence behind it was unclear.

- One click in

Artificial Intelligence