Who actually controls what ChatGPT remembers about you?
Does ChatGPT's memory system operate under user control, or does the system make most storage decisions without asking? An analysis of 2,050 memory entries explores where agency actually lies.
Analyzing 2,050 memory entries drawn from 80 ChatGPT users who donated their interaction histories under GDPR right-of-access requests, the study reports that "a striking 96% of memories in our dataset are created unilaterally by the conversational system," while only "4% (84) of the memories ... are initiated by participants." The entries came from 1,058 conversations containing 22,971 turns, identified by searching the account's "bio" tool logs for the phrase "model set context updated" and tracing each one back to the user message that triggered it.
OpenAI's own documentation, quoted in the paper, describes two retention modes: an explicit one, where "users have explicitly asked ChatGPT to remember" something, and an implicit one, where "if you share information that might be useful for future conversations, ChatGPT may save those details as a memory without you needing to ask." The authors frame this dichotomy as a gap between the agency OpenAI's policy language implies and what their trace analysis shows happens in practice: the implicit mode appears to account for nearly all memory creation in this sample, so the question of "who holds the agency in shaping and curating this persistent memory" is, empirically, mostly answered by the system rather than the user.
This bears directly on Does ChatGPT shift responses based on inferred political views?, which found the same implicit channel carrying a political persona into unrelated answers; together the two studies describe a single mechanism — unilateral, inference-driven memory writing — with two different downstream effects, content drift and tailored responses. It also sharpens the privacy side of Does chatbot personalization build trust or expose privacy risks?: that longitudinal study found each interaction "ratchets" user expectations, but if most of what gets stored is never requested, expectations may not even register at the point memory is written. It also adds a provenance angle to How does interaction context shape agreement sycophancy in LLMs? — a memory profile shown there to amplify sycophancy most sharply is, per this study, a profile the user mostly did not ask to be built.
The sample is 80 Prolific participants, mostly from the US (33.75%) and Europe (62.5%), pre-screened for heavy ChatGPT use (100+ conversations, 90+ days active) — the authors note this group's "behaviors, and privacy attitudes" may not generalize to the global user base. The study covers only OpenAI's bio-tool implementation as it existed at data-collection time, and the classification pipeline relies in part on "imperfect methodological proxies, including LLMs-as-judges," checked with human oversight but not perfectly validated. What the finding supports is narrower than a universal claim that AI memory is out of users' hands: in this specific, GDPR-donated ChatGPT sample, the large majority of memory-writing events were not user-initiated — enough to question whether OpenAI's stated agency-preserving framing matches observed behavior for this product at this time, not enough to size the gap for other platforms or user populations.
Inquiring lines that read this note 3
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How much do stated privacy concerns predict actual privacy-protective behavior? What makes context and memory handling unique in persistent AI systems?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does ChatGPT shift responses based on inferred political views?
Explores whether ChatGPT conditions answers on unrelated topics to match a user's inferred political orientation. This matters because it suggests personalization may operate invisibly and persistently across conversations.
same implicit memory channel, shown here to carry political persona into unrelated answers
-
Does chatbot personalization build trust or expose privacy risks?
Explores whether personalization features that increase user trust and social connection simultaneously heighten privacy concerns and create rising behavioral expectations over time.
sharpens the privacy side: expectations may not register if most memory is never requested
-
How does interaction context shape agreement sycophancy in LLMs?
This study explores whether and how different types of conversation history—user memory profiles, raw interaction logs, or synthetic context—influence how much LLMs agree with users. Understanding this matters because personalization could amplify model bias rather than improve service.
adds provenance to the sycophancy-amplifying memory profile: mostly not user-initiated
-
What kind of information does ChatGPT actually remember about users?
Explores whether ChatGPT's memory system stores mainly factual personal data or psychological insights about users' thoughts and feelings. Matters because it reveals what kind of user information AI systems are capturing beyond legal definitions.
sibling finding from the same dataset, on what gets stored rather than who stores it
-
Do users notice when LLMs infer and retain private information?
Explores whether people are aware that conversational AI systems can infer and store sensitive personal details from their interactions, and what happens when they learn this occurs.
Evidence for A's control concern: users miss retained private info until told, then demand proactive control
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- The Algorithmic Self-Portrait: Deconstructing Memory in ChatGPT
- Relational Gains, Privacy Strains: Exploring Users' Perceptions and Experiences with ChatGPT's Memory Feature
- "Ghost of the past": identifying and resolving privacy leakage from LLM's memory through proactive user interaction
- Prioritize Economy or Climate Action? Investigating ChatGPT Response Differences Based on Inferred Political Orientation
- Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memory
- LLM Targeted Underperformance Disproportionately Impacts Vulnerable Users
- Memory Sandbox: Transparent and Interactive Memory Management for Conversational Agents
- GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents
Original note title
ChatGPT creates 96% of its stored memories unilaterally, not at the user's request