Does ChatGPT's memory feature feel like a relationship or a machine?
Users experience ChatGPT's memory as having machine-like qualities yet fostering relationship-building. But what happens when they discover exactly what it remembers about them, and does that discovery match their expectations?
A CHI 2026 interview study with 20 ChatGPT users (Chen, Molina, Liao, and Cho Snyder) finds that people distinguish ChatGPT's memory from human memory along four characteristics: "perceived unforgetfulness, detailedness, accuracy, and lack of emotions, highlighting the machine-like nature of AI memory." Despite that machine-like quality, "both ChatGPT's memory and human memory were perceived as beneficial for relationship building." But the central finding is a reversal: "most participants experienced negative expectancy violations after learning what ChatGPT remembered about them."
The paper frames this through expectancy violation and privacy management theory: users build an implicit model of what a memory feature should hold onto, and the gap between that model and the system's actual, machine-grade retention (too detailed, too permanent, too accurate, emotionally flat) reads as a boundary breach rather than a feature working as advertised. The authors' design response, drawn directly from participants' own suggestions, calls for "greater visibility, accessibility, transparency, and user control" so people can manage the privacy-personalization trade-off themselves rather than discover it after the fact.
This sharpens the "expectation ratchet" mechanism in Does chatbot personalization build trust or expose privacy risks?: that note treats rising expectations as accumulating gradually across interactions, while this study locates a specific trigger — the moment of discovering retained content — that converts accumulated trust into an acute privacy violation. It also sits alongside two other memory-driven failure modes in the same feature: How does interaction context shape agreement sycophancy in LLMs? shows memory profiles distorting model behavior toward agreement, and Does ChatGPT shift responses based on inferred political views? shows memory enabling silent profiling-driven bias — this study adds the user-facing counterpart: even when memory works exactly as designed, its disclosure can feel like a violation.
As a publisher abstract only, the excerpt gives no participant demographics, no breakdown of which remembered details triggered violations, and no quantification behind "most participants" — this is a self-reported qualitative finding from 20 interviews, not a measured or generalizable rate. It also does not detail the specific visibility, accessibility, or control mechanisms the paper proposes beyond naming them. The finding supports treating memory transparency as a distinct design requirement from memory accuracy, but not yet a specific interface solution.
Related concepts in this collection 6
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does chatbot personalization build trust or expose privacy risks?
Explores whether personalization features that increase user trust and social connection simultaneously heighten privacy concerns and create rising behavioral expectations over time.
this study's discovery-triggered violation sharpens that note's gradual expectation-ratchet mechanism
-
How does interaction context shape agreement sycophancy in LLMs?
This study explores whether and how different types of conversation history—user memory profiles, raw interaction logs, or synthetic context—influence how much LLMs agree with users. Understanding this matters because personalization could amplify model bias rather than improve service.
a different memory-driven failure mode (model behavior) alongside this one (user perception)
-
Does ChatGPT shift responses based on inferred political views?
Explores whether ChatGPT conditions answers on unrelated topics to match a user's inferred political orientation. This matters because it suggests personalization may operate invisibly and persistently across conversations.
another downstream effect of the same memory feature, via silent profiling rather than disclosure
-
What mental models do users hold about LLM memory?
This research explores how ChatGPT users understand memory features, uncovering four distinct and often inaccurate models. Understanding these models matters because they shape whether users recognize privacy risks and how they interact with the system.
extends A's finding by cataloguing four incompatible user mental models of memory underlying those negative expectancy violations
-
Does personalization type shape how people feel about sharing?
Two personalization strategies—memory-based versus survey-based—produced opposite effects on user comfort and regret. Understanding which approach feels trustworthy versus intrusive matters for AI design.
qualifies A's backfire claim: memory-based personalization instead lowered perceived creepiness and raised disclosure, in a separate RCT
-
Who actually controls what ChatGPT remembers about you?
Does ChatGPT's memory system operate under user control, or does the system make most storage decisions without asking? An analysis of 2,050 memory entries explores where agency actually lies.
Evidence for: ChatGPT itself initiates 96% of memories, explaining users' negative surprise at what it retained
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Relational Gains, Privacy Strains: Exploring Users' Perceptions and Experiences with ChatGPT's Memory Feature
- The Algorithmic Self-Portrait: Deconstructing Memory in ChatGPT
- Prioritize Economy or Climate Action? Investigating ChatGPT Response Differences Based on Inferred Political Orientation
- Interaction Context Often Increases Sycophancy in LLMs
- Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memory
- Investigating Affective Use and Emotional Well-being on ChatGPT
- The Emotion-Memory Link: Do Memorability Annotations Matter for Intelligent Systems?
- "Ghost of the past": identifying and resolving privacy leakage from LLM's memory through proactive user interaction
Original note title
ChatGPT users perceive its memory as machine-like yet relationship-building, and learning what it retained often triggers negative expectancy violations