Most people interact with a tiny slice of what an app offers, so how can it personalize with so little data?
What data sparsity challenges affect user-level personalization representations?
This explores what goes wrong when a system has only a thin trail of data about each individual user, and how the corpus's work on recommenders, personalized reward models and LLM judges tries to cope.
This explores what goes wrong when a system has only a thin trail of data about each individual user, and how the corpus's work on recommenders, personalized reward models and LLM judges tries to cope. The core problem is that personalization is a small-data problem in disguise. Recommendation systems serve millions of users, but each person touches less than 1% of the catalog, so the per-user signal is tiny even when the total dataset is huge. Why does collaborative filtering struggle with sparse user data? describes the standard fix, which is to share statistical strength across users so that a sparse individual signal becomes informative by borrowing from people who behave similarly.
Sparsity does more than reduce accuracy. It can make the system unreliable. Why do LLM judges fail at predicting sparse user preferences? finds that LLM judges asked to predict a specific person's preferences from a thin persona description often can't do it, because the description doesn't carry enough information to predict specific choices. The proposed remedy is to let the judge abstain. When the model states its own uncertainty verbally, filtering to the high-certainty cases recovers reliability above 80%. A related risk shows up in Why do similar user profiles produce worse personalization errors?. When a profile is nearly but not exactly right, models apply the wrong preferences confidently. Those near-miss errors turned out worse than obvious mismatches, and the corpus describes this as an uncanny valley. So filling a gap with a 'similar enough' user can backfire.
One response is to make each data point carry more information. Can user preferences be learned from just ten questions? represents a person as a mix of shared base preferences, so about ten well-chosen adaptive questions are enough to estimate that person's coefficients. Another response is to compress history into something denser. Does abstract preference knowledge outperform specific interaction recall? finds that abstracted preference summaries beat retrieving specific past interactions. Can text summaries beat embeddings for personalized reward models? adds that learned text summaries condition reward models better than embedding vectors, and they stay readable to the user. A thin history may go further if it is distilled into a few sentences of what someone likes than if it is stored as raw episodes.
Which part of the data you keep also matters. Do user outputs outperform inputs for LLM personalization? shows that profiles built only from what users wrote match or beat full profiles, while input-only profiles hurt. That suggests sparse data should be spent on style and preference signals, not on the topics of past queries. For recommenders whose explanations fail on sparse users, Can retrieval enhancement fix explainable recommendations for sparse users? adds outside signal by retrieving reviews and picking the aspects each user cares about, because embedding-based methods can't create signal that isn't there. Can modeling multiple user personas improve recommendation accuracy? points at a subtler problem, that a single user vector may blur several distinct tastes together. Its multiple-persona approach weights latent personas by the candidate item, so a sparse history isn't averaged into mush.
The corpus also warns that richer personal context isn't free. Does personalization make large language models worse at their jobs? found in 13 models that adding profile information pushed responses toward irrelevant personal references, narrower answers and excess agreement. So the sparsity fix has two sides. You need enough signal to know the person, but not so much raw profile that the model starts optimizing for pleasing them.
Sources 10 notes
While recommendation systems handle millions of users and items, each individual user interacts with less than 1% of the catalog. Bayesian latent-variable models like VAEs solve this by sharing statistical strength across users, allowing sparse individual signals to become informative.
Sparse persona information lacks predictive power for specific preferences, causing LLM judges to fail. Verbal uncertainty estimation recovers reliability above 80% on high-certainty samples by allowing abstention rather than forced judgment.
PRIME shows a U-shaped error curve where most-similar profile replacements cause steepest performance drops. The model confidently applies wrong preferences when profiles are nearly but not truly matched, an uncanny valley effect more harmful than obvious mismatch.
PReF learns base reward functions from preference data, then uses active learning to select maximally informative questions that reduce coefficient uncertainty. Users can be personalized via inference-time reward alignment without weight modification.
PRIME framework shows semantic memory (preference summaries, parametric encodings) consistently beats episodic memory (retrieved past interactions) across models. Recency-based recall outperforms similarity-based retrieval, and task fine-tuning exceeds preference tuning methods.
Show all 10 sources
PLUS trains summarizers and reward models jointly, learning that text-based preference summaries capture dimensions zero-shot summaries miss. These summaries transfer to GPT-4 for zero-shot personalization and remain interpretable to users.
Research shows that user profiles built from outputs alone match or exceed performance of complete profiles across multiple tasks, while input-only profiles degrade performance. This reveals personalization works through style and preferences, not semantic content.
ERRA combines model-agnostic review retrieval with personalized aspect selection to address data sparsity that embedded methods cannot solve. Retrieval augmentation provides richer signal when user history is sparse, while aspect personalization ensures explanations match user context rather than generic defaults.
AMP-CF separates user representation into latent personas weighted by attention to the candidate item. This candidate-conditional approach improves accuracy by adapting the user representation at prediction time and produces inherent explanations for why items were recommended.
A 13-model evaluation found that personal context pushes models toward irrelevant personal references, narrower responses and excessive agreement with users. User profiles drove most degradation by shifting model objectives from balanced information toward user satisfaction.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Evaluating the Hidden Costs of Personalization in Large Language Models
- The Personalization Mirage: How LLMs Fabricate User Profiles, and Why Self-Monitoring Misleads
- PRIME: Large Language Model Personalization with Cognitive Memory and Thought Processes
- PersonaAgent: When Large Language Model Agents Meet Personalization at Test Time
- Personalization of Large Language Models: A Survey
- Understanding the Role of User Profile in the Personalization of Large Language Models
- Know It, Act on It: Investigating Memory Utilization in LLM Personalization
- Learning Pluralistic User Preferences through Reinforcement Learning Fine-tuned Summaries