Explainers / READING
How should you read reviews before hiring a contractor or home service?
Use the rating to rule businesses out, not to pick the winner. Read the most recent reviews and the lowest ones for repeated, specific problems. Then confirm what no review can show: the license with the state board and the scope and price in writing. Marketplace badges tell you what the marketplace checked, which is usually less than the badge name suggests.
Home services are where review-reading matters most and works least well. The jobs are expensive, infrequent and hard to inspect. Many contractors are small independents, the group for whom ratings move the most business and who therefore have the strongest incentive to manage them.11 Michael Luca, Harvard Business School Working Paper 12-016, Reviews, Reputation, and Revenue: The Case of Yelp.com22 Luca and Zervas, Management Science 62(12), 2016, Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud And a contractor's profile often rests on dozens of reviews, not thousands.
Here is a sequence that respects those limits.
Step 1: Screen with the rating and count together
Open the candidates on the platform where each has the most reviews. Drop any with a clearly low average backed by a real count. A 3.6 from 150 reviews is a pattern.
Do not rank the survivors by rating. With 40 reviews apiece, a 4.9 and a 4.6 are not distinguishable; the margin of error on each is around 0.3 stars. Our table in how many reviews are enough gives margins for other counts.
Step 2: Read the newest ten
Crews turn over. Owners sell. On Google the average includes every published rating, whatever its age.33 Google Business Profile Help, Understand review scores for local places and businesses The last ten reviews describe the company as it is now. If they read differently from the headline number, believe them.
Step 3: Read every low review from the past two years
You are looking for repetition and specificity.
| What recurs in low reviews | What it tends to indicate |
|---|---|
| No-shows, missed windows, unanswered calls | Overbooked or disorganized; affects every customer |
| Final bill above the quote | Estimating or change-order practices; ask how changes are priced |
| Callbacks for the same fault | Workmanship; the most serious pattern |
| Rudeness from one named person | May be a single employee; check dates |
| Dispute over a deposit or cancellation | Read the contract terms before signing |
| Never hired them, complaining about a quote | Price sensitivity, usually not a quality signal |
The right-hand column is our interpretation, not research. A single instance of anything is noise. The same complaint from three unrelated customers in a year is the most useful thing a review page can tell you.
Step 4: Read the replies
How the business answers a complaint is the nearest thing to a sample of how it would treat yours. See how business responses change reviews.
Step 5: Understand what the marketplace badge checked
Home-service marketplaces attach badges that sound like guarantees. Each has a published definition.
Angi Approved. A business "with at least one review must maintain an average rating of 3 stars or higher". The owner, principal or relevant manager must pass a criminal background check, and the business "must attest to maintaining all applicable state and local licenses".44 Angi, Frequently Asked Questions Note the verbs. The background check covers the owner or manager, not every worker sent to your house. The license is attested by the business. Angi also says Approved pros "pay to advertise", and that they are listed above other providers in search results.
Angi Super Service Award. Requires a 4.5-star or better average, at least three new reviews in the period, a lifetime average of 4.5 or better and good standing.44 Angi, Frequently Asked Questions
Thumbtack Top Pro. Described as "highly rated across several reviews from Thumbtack customers".55 Thumbtack, How we're committed to your safety
Thumbtack Licensed pro. Thumbtack has "used a public database to verify the license number the pro provided".55 Thumbtack, How we're committed to your safety That is a real check, stronger than attestation. It confirms a license number existed in a database when checked; the state board's lookup will tell you whether it is current and whether there is discipline on file.
Hired on Thumbtack. Marks a review from a customer who connected with the pro through the platform.55 Thumbtack, How we're committed to your safety
Thumbtack also says it runs a criminal background check on "all new account owners" and states that account owners are responsible for ensuring their employees and contractors comply with the law, "including local licensing requirements".55 Thumbtack, How we're committed to your safety Again: the account owner is checked, and compliance for everyone else is delegated.
Step 6: Know that position in results is partly paid
On Thumbtack, a pro's rank in search results takes into account review rating and number of reviews, responsiveness, profile engagement and lead prices. The help page says "setting competitive prices helps you show up higher in search results", where the price in question is what the pro pays Thumbtack per lead.66 Thumbtack Help, How to improve my rank in search results On Angi, pros who meet the criteria can pay to advertise and are shown first.44 Angi, Frequently Asked Questions
Neither platform hides this. It means the top result is the product of ratings and spending together, and scrolling down costs you nothing.
Step 7: Cross-check outside the review system
- State contractor licensing board. Look up the license by number or business name. Check status, classification and any disciplinary history. This is the authority; a marketplace badge is not.
- Insurance. Ask for a certificate of insurance issued to you by the insurer or agent.
- BBB complaints. The letter grade mostly reflects whether complaints were answered, so open the complaints themselves. Details are in BBB letter grade versus customer reviews.
- Permits. For work that needs one, ask who pulls it.
- References for large jobs. Ask for two customers from more than a year ago. Reviews are written at completion; defects show up later.
Step 8: Weigh reviews by what the reviewer could know
A review saying the crew was polite and cleaned up is reliable on those points. A review saying "excellent electrical work" from a homeowner is reliable only on the fact that the lights came on. Research on products found user ratings did not converge with expert test scores.77 de Langhe, Fernbach and Lichtenstein, Journal of Consumer Research 42(6), 2016, Navigating by the Stars: Investigating the Actual and Perceived Validity of Online User Ratings For skilled trades, where much of the work is hidden behind drywall, we would expect the gap to be at least as wide, though that expectation is ours and untested.
Reviews that do carry workmanship information: follow-ups written months later, reviews mentioning an inspection that passed, reviews from people who say they work in a related trade.
Red flags specific to home services
- A reward for a review. If you are offered a discount for five stars, the profile was built that way. It is also against Google's, Yelp's and Thumbtack's policies and, when tied to a positive rating, against the FTC rule.88 Code of Federal Regulations, 16 CFR 465.4, Buying positive or negative consumer reviews
- A contract clause restricting reviews. Void under the Consumer Review Fairness Act, and a sign of how the business handles criticism.99 Federal Trade Commission, Consumer Review Fairness Act: What Businesses Need to Know
- A burst of new reviews after a string of bad ones. The repair pattern described in the fraud research.22 Luca and Zervas, Management Science 62(12), 2016, Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud
- Many reviews, none on any second platform. Possible, but ask why.
Questions readers ask
Are Angi and Thumbtack reviews more reliable than Google reviews?
They are differently reliable. A "Hired on Thumbtack" review confirms a connection through the platform. Google reviews are open to anyone with an account, which admits more noise and also more people who were never converted into customers.
Does a marketplace background check cover the workers who come to my home?
On the published descriptions, Angi's check covers the owner, principal or relevant manager, and Thumbtack's covers account owners.44 Angi, Frequently Asked Questions55 Thumbtack, How we're committed to your safety
What matters more, the star rating or the license?
The license. A rating reports past customers' satisfaction. A license check reports legal authority to do the work and any regulator action, and it comes from the state.
Method Platform screening and badge criteria are quoted from Angi and Thumbtack pages. The reading sequence is our own synthesis of the research cited across this site and is labeled as advice, not findings. See how we source and check.
Sources
Every source below was opened and read for this page. Links go to the publisher's own copy.
- Michael Luca, Harvard Business School Working Paper 12-016. Reviews, Reputation, and Revenue: The Case of Yelp.com
- Luca and Zervas, Management Science 62(12), 2016. Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud
- Google Business Profile Help. Understand review scores for local places and businesses
- Angi. Frequently Asked Questions
- Thumbtack. How we're committed to your safety
- Thumbtack Help. How to improve my rank in search results
- de Langhe, Fernbach and Lichtenstein, Journal of Consumer Research 42(6), 2016. Navigating by the Stars: Investigating the Actual and Perceived Validity of Online User Ratings
- Code of Federal Regulations. 16 CFR 465.4, Buying positive or negative consumer reviews
- Federal Trade Commission. Consumer Review Fairness Act: What Businesses Need to Know