RATINGS/DECODED

Explainers / READING

Is a perfect 5.0 rating a red flag?

Not on its own. With fewer than about 20 reviews, a perfect score is what you would often see from a good business by chance, and it is weak evidence either way. With several hundred reviews and no rating below five, the pattern is unusual enough that the collection method deserves a look.

Shoppers seem to sense that perfection is fishy. Northwestern's Spiegel Research Center found that purchase likelihood typically peaks at ratings in the range of 4.0 to 4.7 and then begins to decrease as ratings approach 5.0.11 Medill Spiegel Research Center, Northwestern University, How Online Reviews Influence Sales The instinct is half right. Whether a 5.0 is suspicious depends almost entirely on how many reviews stand behind it.

How often an honest business would show 5.0

Suppose a business is very good: 90% of its reviewers give five stars and 10% give something lower. What is the chance that its first n reviews are all fives? Multiply 0.9 by itself n times.

ReviewsChance all are 5 stars if 90% of reviewers give 5If 80% doIf 95% do
373%51%86%
559%33%77%
1035%11%60%
2012%1%36%
500.5%under 0.01%8%
100under 0.01%effectively zero0.6%
300effectively zeroeffectively zeroeffectively zero
Chance of a perfect 5.0 if nine in ten reviewers give five stars020406080733595351012200.5500100Number of reviewsPercent
Our calculation: 0.9 raised to the power n. Assumes reviews are independent.

Read across the first three rows. With five reviews, a perfect score turns up a third of the time even for a business where one reviewer in five is less than thrilled. A 5.0 from five reviews cannot separate an outstanding business from a decent one.

Now read the bottom rows. For a business to show 5.0 across 100 honest, independent reviews, its true five-star rate has to be extraordinary: at a 99% rate the chance is still only 37%. At 300 reviews, even a 99% five-star rate gives a perfect record just 5% of the time.

So the same number means opposite things at different counts.

  • 5.0 from 6 reviews: uninformative. Could be anyone.
  • 5.0 from 40 reviews: a very good business, or a managed profile. Cannot tell which from the number.
  • 5.0 from 400 reviews: either a business with an almost unheard-of consistency, or a set of reviews that is not an independent sample of customers.

Why a large perfect score might not be an independent sample

"Not an independent sample" covers several things, not all of them dishonest.

Selective asking. If only customers who signaled satisfaction are sent the review link, the fives are genuine and the sample is curated. This is review gating, which Google prohibits.22 Google Maps Help, Prohibited and restricted content, Maps user-contributed content policy

In-person asks. A stylist who asks each happy client, phone in hand, will collect fives from people who would feel awkward leaving four.

Recovery before review. Some businesses resolve complaints so effectively that unhappy customers never post. That is good service, and it also removes the low tail from the public record.

Removal of negatives. On a business's own website, low reviews can simply go unpublished, the practice at issue in the FTC's Fashion Nova case.33 Federal Trade Commission, Fashion Nova will Pay $4.2 Million as part of Settlement of FTC Allegations it Blocked Negative Reviews (January 2022)

Fabrication. The research on Yelp found review fraud more likely when a business has few reviews or has recently received bad ones.44 Luca and Zervas, Management Science 62(12), 2016, Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud A new business with a wall of early fives fits the incentive, which is not the same as fitting the crime.

The low-volume case: friends and family

New businesses often open with five to ten perfect reviews from people who know the owner. Under the FTC rule, an officer or manager may not solicit reviews from immediate relatives or employees in a way that produces reviews without disclosure of the relationship.55 Code of Federal Regulations, 16 CFR 465.5, Insider consumer reviews and consumer testimonials Google treats reviews based on a conflict of interest, including family ties, as prohibited content.22 Google Maps Help, Prohibited and restricted content, Maps user-contributed content policy

In practice these early reviews are common and usually easy to spot: they arrive in the first weeks, they are short and warm, and several reviewers share a surname or have reviewed nothing else. Discount them and wait for the reviews from strangers.

How platforms defuse the tiny perfect score

Trustpilot's formula includes seven neutral 3.5-star reviews, so on the prior alone five genuine five-star reviews come out near 4.1, not 5.0.66 Trustpilot Help Center, TrustScore and star rating explained Meta holds business reviews back until it has "enough unique reviews" for a meaningful score.77 Meta Business Help Center, About business ratings and reviews Google's published method has no such cushion, which is why 5.0 from three reviews is such a common sight on Maps.88 Google Business Profile Help, Understand review scores for local places and businesses

You can apply the cushion yourself. Add seven imaginary reviews at 3.5 stars to any small profile and recompute:

DisplayedReviewsWith seven neutral reviews added
5.033.95
5.0104.38
4.8254.52
4.81004.71
4.69004.59

The big profile barely moves. The tiny ones fall into a more believable range. More on this in the seven phantom reviews.

What to check when you see one

  1. Count first. Under 20, treat as "too early to say" and move on to other evidence.
  2. Dates. Did the reviews arrive steadily or in clumps?
  3. Reviewer depth. Do the reviewers have other reviews, of other kinds of business, in the same area?
  4. Text. Do reviews describe specific jobs with details that differ from one another?
  5. A second platform. A perfect Google score beside a 3.5 on Yelp is a question worth asking the business directly.
  6. A four-star review. Paradoxically reassuring. A profile with a few thoughtful four-star reviews has let lukewarm customers speak.

A perfect score is not a defect

Small, careful businesses with a few dozen loyal customers do earn straight fives. A solo piano tuner with 30 clients a year and 25 reviews, all perfect, is not a puzzle. The math says only that the number is unable to prove what it appears to prove. Treat a small-sample 5.0 as an absence of bad news, which is worth something, and look elsewhere for the good news.

Questions readers ask

Is 4.9 better than 5.0?

Neither is better in itself. A 4.9 from 200 reviews carries far more evidence than a 5.0 from 8, because of the count, not the digit.

How many reviews before a 5.0 becomes implausible?

It depends on how good the business is. If 95% of its honest reviewers would give five stars, a perfect record is still an 8% event at 50 reviews and under 1% at 100.

Do platforms penalize perfect ratings?

None of the policies we read says so. Platforms act on patterns of manipulation, not on the score itself.

Method Probabilities are our own binomial calculations under stated assumptions. The buyer-behavior finding is from the Spiegel Research Center; the fraud-incentive finding is from Luca and Zervas. See how we source and check.

Sources

Every source below was opened and read for this page. Links go to the publisher's own copy.

  1. Medill Spiegel Research Center, Northwestern University. How Online Reviews Influence Sales
  2. Google Maps Help. Prohibited and restricted content, Maps user-contributed content policy
  3. Federal Trade Commission. Fashion Nova will Pay $4.2 Million as part of Settlement of FTC Allegations it Blocked Negative Reviews (January 2022)
  4. Luca and Zervas, Management Science 62(12), 2016. Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud
  5. Code of Federal Regulations. 16 CFR 465.5, Insider consumer reviews and consumer testimonials
  6. Trustpilot Help Center. TrustScore and star rating explained
  7. Meta Business Help Center. About business ratings and reviews
  8. Google Business Profile Help. Understand review scores for local places and businesses