Does personalization type shape how people feel about sharing?
Two personalization strategies—memory-based versus survey-based—produced opposite effects on user comfort and regret. Understanding which approach feels trustworthy versus intrusive matters for AI design.
In a preregistered 5-day longitudinal RCT of 992 participants (4,960 conversations) seeking relationship advice from a language model, two personalization approaches diverged in their effects rather than converging on a single "personalization effect." The paper reports that relative to a non-personalized control, "participants in the memory-based condition engaged in greater self-disclosure and rated the model as less creepy, while participants in the survey-based condition reported higher regret about having shared personal information with the AI." Memory-based personalization fed the model "cumulative conversation summaries from past sessions," regenerated offline and reinserted each day; survey-based personalization fed it "AI-generated summaries from the intake questionnaire" collected before the study began.
The authors attribute the divergence to how the personal information entered the conversation rather than to personalization as such. Memory accrues from what the participant chose to say inside the relationship — it reflects the user's own disclosures fed back to them — while survey data arrives as information gathered upfront, before any conversational trust was established, and reappears inside a context the participant may not have expected. The paper frames this as evidence that "the form personalisation takes matters: memory- and survey-based personalisation diverge in the magnitude and, in some cases, the direction of their effects," rather than producing one uniform psychosocial outcome.
This sits alongside Does chatbot personalization build trust or expose privacy risks?, which found personalization raises trust and self-disclosure while also raising privacy concern — but that note treats personalization as a single mechanism, whereas this RCT's controlled comparison shows the positive leg (self-disclosure, lower creepiness) attaches specifically to the memory-based implementation and the negative leg (disclosure regret) attaches specifically to the survey-based one. It also complicates the technique-category framing in How do personalization granularity levels trade precision against scalability?: the survey condition's injection of intake data functions more like a persona artifact seeded once and replayed, while the memory condition is closer to genuine user-level conditioning built from the user's own accumulating interaction history — this RCT suggests the two are not interchangeable even when both are delivered through the same prompting technique.
The excerpt does not establish which specific wording or depth of the injected summaries drove the regret effect, nor whether the result would hold with richer personalization inputs — the authors note both conditions relied on context-window injection of text summaries, not fine-tuning or richer personal data sources such as email or browsing history. The implication the evidence supports is narrower than "personalization increases trust" or "personalization increases risk": choosing between memory-based and survey-based personalization is choosing between distinct, non-interchangeable psychosocial trade-offs, not between stronger and weaker versions of the same mechanism.
Inquiring lines that read this note 16
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How much do stated privacy concerns predict actual privacy-protective behavior?- Why do people report equal privacy comfort despite removing vastly different amounts of personal information?
- What privacy expectations do users hold before learning what systems store?
- How do users distinguish between personalization built from their own disclosures versus external data?
- Do users disclose more to personalized systems or just more often?
- What architectural trade-offs could reduce preference leakage without sacrificing personalization?
- How does unnoticed personalization affect user trust and privacy expectations?
- Do personalization features change how people perceive privacy risks over time?
- Why does information sourced from prior conversations feel less creepy than intake surveys?
- Can memory-based personalization maintain trust benefits when summaries become richer or deeper?
- Can memory-based personalization increase self-disclosure without raising trust?
- How does personalization simultaneously increase trust while increasing perceived privacy risks?
- Can autonomy design choices decouple the trust and privacy concern trade-off in personalization?
- Does the trust benefit of personalization justify its privacy costs?
- How does memory personalization increase both trust and privacy anxiety simultaneously?
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does chatbot personalization build trust or expose privacy risks?
Explores whether personalization features that increase user trust and social connection simultaneously heighten privacy concerns and create rising behavioral expectations over time.
this RCT splits that dual dynamic's two legs across two different personalization implementations
-
How do personalization granularity levels trade precision against scalability?
LLM personalization operates at user, persona, and global levels, each with different tradeoffs. Understanding these tradeoffs helps determine when to invest in individual user data versus broader patterns.
memory-based and survey-based conditions map to different granularity levels despite both using prompting
-
Does personalization actually build closeness with chatbots?
When users feel closer to AI over time, is that because the system remembers personal details about them, or simply because they've interacted with it repeatedly? This RCT tests whether personalization features drive the relationship gains we observe.
same study; separates exposure-driven effects from these implementation-specific ones
-
Does ChatGPT's memory feature feel like a relationship or a machine?
Users experience ChatGPT's memory as having machine-like qualities yet fostering relationship-building. But what happens when they discover exactly what it remembers about them, and does that discovery match their expectations?
Qualifies A: interviewees report learning what ChatGPT's memory retained often backfires, despite memory personalization lowering creepiness overall
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Tailored to you: longitudinal effects of personalising language models
- Relational Gains, Privacy Strains: Exploring Users' Perceptions and Experiences with ChatGPT's Memory Feature
- The Algorithmic Self-Portrait: Deconstructing Memory in ChatGPT
- Know It, Act on It: Investigating Memory Utilization in LLM Personalization
- Autonomy Reshapes How Personalization Affects Privacy Concerns and Trust in LLM Agents
- Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memory
- PRIME: Large Language Model Personalization with Cognitive Memory and Thought Processes
- "Ghost of the past": identifying and resolving privacy leakage from LLM's memory through proactive user interaction
Original note title
memory-based personalization increased self-disclosure and lowered creepiness ratings — survey-based personalization raised disclosure regret