Do online ratings actually reflect independent customer opinions?
How much do previously-posted ratings shape the ones that come after, and does this social influence distort what ratings supposedly measure? Understanding this matters for anyone relying on review aggregates to judge product quality.
The standard implicit assumption when reading online ratings is that each rating is an independent observation of customer experience: average them and you have an estimate of product quality. Moe and Trusov's analysis decomposes observed ratings into a baseline ratings component (the consumer's "socially unbiased" evaluation), a social-dynamics component (the influence of previously-posted ratings), and an idiosyncratic error component, then models product sales as a function of these components.
The findings are nuanced. Substantial social dynamics exist in the ratings environment — previously-posted ratings influence subsequent ones. These dynamics have both direct effects on sales (changes in average rating drive immediate purchases) and indirect effects (today's ratings influence tomorrow's ratings, which affect future sales). Some of the indirect effects mitigate long-term impact: when opinion variance is high, the social-dynamics-induced shifts get averaged out over time.
But the headline conclusion is that observed ratings do not always accurately reflect product performance. Even before Schlosser's negativity-bias finding or Hu et al.'s self-selection result, this paper documents that ratings are influenced by prior ratings. Marketers, recognizing this, invest in creating favorable ratings environments — not because they expect to fool customers but because the system actually works that way.
For recommender systems consuming ratings as input: the data is socially-conditioned, not just preference-conditioned. Treating ratings as independent observations leads to biased estimates of product quality and consequently biased recommendations toward whatever ratings dynamics happened to favor early. The fix is structural, not statistical: model the social conditioning explicitly.
Inquiring lines that use this note as a source 33
This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.
- Why do humans publish more negative reviews in public than in private?
- Can graded relevance assumptions hold when user ratings are temporally inconsistent?
- Does rating noise compound with self-selection bias in online reviews?
- Can side information alone predict preferences without rating history?
- Why do explicit ratings fail to capture uncertainty in user preferences?
- Can recommender systems correct for ratings that have been socially shaped?
- How do strong-opinion raters amplify social dynamics in rating communities?
- Why do marketers invest in creating favorable rating environments early on?
- Does opinion variance eventually correct social-dynamics distortions in ratings?
- How do early reviewers shape what later buyers think a product is?
- Can readers learn true product quality from reviews despite selection bias?
- Do reviewers write about objective product quality or personal experience?
- Why do more detailed rating systems sometimes improve learning from reviews?
- Why do online ratings fail to represent independent individual preferences?
- What economic value does recommendation drive at companies like Netflix and YouTube?
- Do negative reviewers actually appear more intelligent or competent than positive ones?
- How much do social audience effects distort the true average satisfaction in review aggregates?
- Can recommender systems correct for audience-driven negativity bias in aggregated ratings?
- Does the U-shaped distribution of raters compound the negativity bias from public posting?
- How do different audience segments rate the same product differently?
- Can platforms predict which recommender type will stabilize ratings?
- What feedback loops form between recommender choice and review data?
- How much do individual ratings influence future ratings in networks?
- Can factual product data improve the credibility of subjective opinion summaries?
- How do social position and moral framing create irreducibly different interpretations of reviews?
- How do rating anchors shift meaning within short temporal windows for individual users?
- What metrics capture whether recommendations reflect a user's full taste range?
- How do surface signals like confidence override actual quality in user judgment?
- How do self-selection effects in purchase and review compound together?
- Why do strong-opinion raters dominate public rating distributions?
- Can small incentives like discounts recover representative rating participation?
- Why does preference measurement validity matter more than aggregation methods?
- Why does preference measurement validity matter before any aggregation?
Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Why do online reviewers publish negative ratings despite positive experiences?
When people post reviews publicly, do they adjust their honest opinions to seem more discerning? Schlosser's experiments test whether audience awareness shifts how people rate products compared to private ratings.
extends: the social-dynamics-shaping-future-ratings finding adds the temporal compounding to Schlosser's audience-effect finding
-
Do online reviews actually measure product quality or just buyer preferences?
Online reviews come only from customers who already expected to like a product. This self-selection might hide the true quality signal beneath layers of preference bias and writing motivation. What can aggregated ratings actually tell us?
complements: self-selection and social-dynamics together describe the multi-layered non-independence of public ratings
-
Why do the same users rate items differently each time?
User ratings are assumed to be clean preference signals, but do they actually fluctuate unpredictably? This matters because recommender systems rely on ratings as ground truth, yet temporal inconsistency and individual rating styles may contaminate that signal.
complements: this adds a between-user noise dimension to the within-user noise Amatriain documents
-
Do different recommender types shape opinion convergence differently?
Explores whether the mechanism by which products are recommended—buying together versus viewing together—creates distinct patterns in how product ratings converge or diverge across a network.
complements: same opinion-shaping mechanism at network level — recommender networks shape product reputation as social dynamics shape rating reputation
-
Why do people bother writing online ratings at all?
People rate products without pay or recognition, yet do it anyway. Understanding what motivates raters—and how costs affect who rates—reveals why rating distributions may not reflect true customer satisfaction.
complements: who chooses to rate amplifies social-dynamics effects — strong-opinion raters drive the future-rating influence
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Measuring the Value of Social Dynamics in Online Product Ratings Forums
- On Information Distortions in Online Ratings
- Why Do People Rate? Theory and Evidence on Online Ratings
- Fast and Slow Learning From Reviews
- Self Selection and Information Role of Online Product Reviews
- Posting versus Lurking: Communicating in a Multiple Audience Context
- Man vs machine – Detecting deception in online reviews
- Collaborative Filtering with Temporal Dynamics
Original note title
online ratings have small social-dynamics effects that compound through future-rating influence — ratings forums are not independent observations