Does what you need an AI to remember shift as you move from starting a task to picking it up again later?
How often do users' memory organization needs change during different task stages?
This explores whether what people need from an AI's memory shifts as they move through a task (starting, working, picking up later), and how often. The corpus has no direct frequency data, but it shows clearly that different stages call for different kinds of memory.
This explores whether what people need from an AI's memory shifts as they move through the stages of a task, and how often that happens. The direct answer is that the collection doesn't measure frequency. No study here tracks users across task stages and counts how often their memory needs change. What the corpus does show is that memory needs are layered by how long each kind of information stays useful, and that this layering is where the stage-by-stage shifts come from.
The clearest user-side evidence is that people already sort memory into tiers. They put general knowledge at the top, then personal details, then task-specific information How should AI agents organize their memory for users?. The task-specific tier is the one that changes most as work moves forward. The general tier barely moves. Tools don't expose this hierarchy, so users handle the shifts by hand: they start a new chat thread for a new phase, write custom prompts, or even keep separate accounts. Those workarounds are a rough, indirect sign of how often needs change. Each time someone opens a fresh thread to keep context clean, they're marking a stage boundary the product didn't notice. Users also want control at the moment memory is captured, not later Do users prefer controlling what gets remembered over auditing what was stored?. Prompts that ask where a memory should go, and boundary settings, beat reviewing a log after the fact. That points to stage transitions as the moments where users want a say.
Research on the agent side gives the same picture from the machine's point of view. One framework splits an agent's working memory into parts that last for the whole conversation (history, a scratchpad) and parts that change every turn (examples, the current task trajectory). Each kind has its own update rules and fails in its own ways How should agent memory split across time scales?. Web-agent work goes further: memory indexed by the agent's exact current state (what's on screen right now, what to click next) beats memory stored as high-level workflow summaries Does state-indexed memory outperform high-level workflow memory for web agents?. At the execution level, then, the useful memory can change with every step. Big-picture plans are too coarse to help with the click-by-click part.
The less obvious lesson is that the right memory isn't only a question of what's relevant. It depends on what job the memory is doing at that moment. Memory that clarifies a request improves accuracy, while loosely related memory actively makes answers worse Does retrieved memory quality depend on its functional role?. Long multi-turn agents break down from weak control over what gets written down and kept, not from missing knowledge. Separating temporary recall from permanent memory writes prevents drift Can agents fail from weak memory control rather than missing knowledge?. If memory has to be filtered differently by role and by permanence, then a change of stage is really a change in which roles matter.
One design response is to make stages visible instead of guessing at them. A shared canvas puts prompts, references, versions and feedback on screen as typed objects that both the user and the agent can see. That lets someone resume unfinished work or update one piece without re-explaining the whole task Can a shared canvas serve both human and agent memory?. It also matters that which memories get surfaced is a product decision, not a property of the model How do AI products decide what to remember between conversations?. So 'how often do needs change' is partly a question about how often the product notices a change. Today, users mostly do that noticing themselves.
Sources 8 notes
A CHI study of six AI tool users and 54 Reddit threads found participants want memories organized from generalized knowledge through personal details to task-specific information. Because no tools expose this hierarchy, users build workarounds using chat threads, custom prompts, and multiple accounts.
A speed-dating evaluation of 12 memory-control designs with 121 users found clear preference for proactive controls like destination prompts and boundary settings over passive audits or causal graph inspections. Users prioritize preventing misalignment at the moment of capture over reviewing complete records after the fact.
RAISE shows that agent memory consists of four components organized by two design axes: dialogue-level (conversation history, scratchpad) versus turn-level (examples, task trajectory). This granularity distinction predicts different failure modes and update policies for each component.
PRAXIS shows that indexing procedures by environment state and local action pairs yields consistent accuracy and reliability gains across VLM backbones on the REAL benchmark, compared to higher-level workflow abstractions that lose click-by-click specifics.
Retrieved memory type drives response quality more than relevance alone: clarifying memory improves factual accuracy and constraint awareness, while irrelevant memory actively degrades both. Role-aware retrieval and filtering are robustness requirements, not optional optimizations.
Show all 8 sources
Agent performance degrades in long workflows because transcript replay and retrieval-based memory lack gating mechanisms. A bounded, schema-governed committed state that separates artifact recall from permanent memory write prevents error accumulation and constraint drift.
JarvisHub proposes that placing prompts, references, versions, and feedback as typed canvas nodes visible to both users and agents—rather than hiding agent memory in chat or transient state—enables local updates, artifact reuse, and unfinished work continuation without process opacity.
Nielsen Norman Group's glossary shows that context is dynamically assembled from multiple sources—including stored memory—for each request. Because products control which memories get surfaced, claims about what an AI remembers describe the product, not the underlying model.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Characterizing Memory Misalignment in Human-LLM Interaction From User Perspectives
- Understanding Users' Privacy Perceptions Towards LLM's RAG-based Memory
- Users' Expectations and Practices with Agent Memory
- Are We Ready For An Agent-Native Memory System?
- Agent Memory Distillation: Empowering Small LLM Agents with Hierarchical Teacher Memory
- Demystifying Agent Skills: Why They Work-Until They Don't
- GateMem: Benchmarking Memory Governance in Multi-Principal Shared-Memory Agents
- Know It, Act on It: Investigating Memory Utilization in LLM Personalization