SYNTHESIS NOTE
Topics›Recommenders General›this note

Do online ratings actually reflect independent customer opinions?

How much do previously-posted ratings shape the ones that come after, and does this social influence distort what ratings supposedly measure? Understanding this matters for anyone relying on review aggregates to judge product quality.

Synthesis note · 2026-05-03 · sourced from Recommenders General
How do people decide what to share with AI systems?

The standard implicit assumption when reading online ratings is that each rating is an independent observation of customer experience: average them and you have an estimate of product quality. Moe and Trusov's analysis decomposes observed ratings into a baseline ratings component (the consumer's "socially unbiased" evaluation), a social-dynamics component (the influence of previously-posted ratings), and an idiosyncratic error component, then models product sales as a function of these components.

The findings are nuanced. Substantial social dynamics exist in the ratings environment — previously-posted ratings influence subsequent ones. These dynamics have both direct effects on sales (changes in average rating drive immediate purchases) and indirect effects (today's ratings influence tomorrow's ratings, which affect future sales). Some of the indirect effects mitigate long-term impact: when opinion variance is high, the social-dynamics-induced shifts get averaged out over time.

But the headline conclusion is that observed ratings do not always accurately reflect product performance. Even before Schlosser's negativity-bias finding or Hu et al.'s self-selection result, this paper documents that ratings are influenced by prior ratings. Marketers, recognizing this, invest in creating favorable ratings environments — not because they expect to fool customers but because the system actually works that way.

For recommender systems consuming ratings as input: the data is socially-conditioned, not just preference-conditioned. Treating ratings as independent observations leads to biased estimates of product quality and consequently biased recommendations toward whatever ratings dynamics happened to favor early. The fix is structural, not statistical: model the social conditioning explicitly.

Inquiring lines that read this note 45

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How much do feedback loops and social biases compound in rating systems? What systematic failures occur in human preference-based model evaluation? How should conversational recommenders decide when to ask versus recommend? How can recommendation systems balance individual and population-level goals? Does polished AI output mislead users about actual accuracy and expertise? Can AI systems adequately substitute for or supplement human peer review? Can we reliably measure and demonstrate AI's actual productivity impact? What systematic biases emerge in AI shopping agents' decision-making?

Related concepts in this collection 5

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
12 direct connections · 93 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

online ratings have small social-dynamics effects that compound through future-rating influence — ratings forums are not independent observations