INQUIRING LINE

Voice assistants now keep facts and feelings in separate memory tracks, but is that the same as remembering events versus knowing things?

Can episodic and semantic memory split the same way emotion and facts do?

This explores whether the human split between episodic memory (things that happened to you) and semantic memory (things you know) is the same cut as the emotional-versus-factual split some voice agents now build in, or whether the two cut across each other.


This explores whether the episodic/semantic split and the emotion/facts split are the same cut through memory. The corpus suggests they aren't. Episodic versus semantic divides memory by what kind of thing is stored: an event you lived through, or a general fact. The emotion/facts split, as VoiceMem builds it, divides memory by what it's used for: what to say versus how to say it. VoiceMem runs an informational branch and an emotional branch in parallel, and finishes retrieval in 134 ms inside the silent gaps of a voice conversation. It beats competitors on factual retrieval and persona benchmarks Can memory retrieval hide inside voice agent silence?. Neither branch is 'episodic' or 'semantic'. A fact can be about a specific event, and an emotional tone can be a lasting trait of a person.

The closest thing to an episodic/semantic split in the corpus is a survey's 'functions' axis, which separates factual, experiential, and working memory. Emotion isn't a category there. The survey's point is that agent memory should be described on several independent axes (form, function, dynamics) instead of one split, and it treats even short-term versus long-term as a pattern over time rather than separate machinery Can three axes replace the short-term long-term memory split?. Read that way, emotion is something that can show up in any cell of the grid. The brain-inspired framing offers a third cut. Transformer weights play the slow-learning neocortex, RAG plays the fast-encoding hippocampus, and agentic state plays the prefrontal cortex. That split is about learning speed, and it points out that current systems lack the consolidation step that turns episodes into stable knowledge Can brain memory systems explain how LLMs should store knowledge?.

Emotion does connect to episodic memory in one place. In group conversations, the emotions a person experienced drive what gets encoded as memorable, but emotions observed from outside don't predict memorability above chance Can we detect memorable moments by observing emotional expressions?. So emotion looks less like a separate store and more like a signal attached to an experience when it is encoded. An agent that infers 'emotional memory' from someone's outward expression is working from a weak proxy. A related finding points the same way: emotional phrases appended to prompts improve performance through motivational framing, not by adding information Can emotional phrases in prompts improve language model performance?. In both cases emotion acts as a modulator over content, not another kind of content, which is a reason to doubt it is as natural a dividing line as episodic versus semantic.

Facts are the part that already separates cleanly. In-weight memorization is capped by model size, and fine-tuning overwrites prior knowledge, while tool use gives unbounded factual recall Can models store unlimited facts without growing larger?. A dedicated memory model can also carry new knowledge without touching the LLM at all Can a separate memory model inject knowledge without touching the LLM?. Nothing in the corpus shows the same for emotional or experiential memory. Every extra memory channel also carries a risk. In MemTrapBench, all five memory frameworks did worse than having no memory, by more than 10%, even though the memories were accurate and relevant Can relevant memories actually harm LLM reasoning?. Nobody here has tested whether an emotional branch avoids that failure, or whether the episodic/semantic and emotion/facts splits can be combined, so both questions remain open.


Sources 8 notes

Can memory retrieval hide inside voice agent silence?

VoiceMem splits memory into parallel informational and emotional branches, completing retrieval in 134 ms inside existing VAD gaps. The system outperforms competitors on factual retrieval and persona benchmarks while adding no conversational latency.

Can three axes replace the short-term long-term memory split?

A 2025 survey reframes agent memory along forms (token/parametric/latent), functions (factual/experiential/working), and dynamics (formation/evolution/retrieval), showing that short/long-term phenomena emerge from temporal patterns rather than architectural separation. This enables precise system comparison and replaces vague implementation-based claims.

Can brain memory systems explain how LLMs should store knowledge?

Research shows transformer weights function as a distributed neocortex for consolidated knowledge, RAG stores as hippocampal indexing for rapid encoding, and agentic state as prefrontal executive control. The CLS framework predicts why hybrid systems outperform single-tier approaches and identifies missing consolidation mechanisms that prevent memory integration.

Can we detect memorable moments by observing emotional expressions?

Continuous emotion and memorability annotations in group conversations show no reliable relationship above chance. Experienced emotions drive memory encoding, but observed behavior diverges from internal experience—especially in groups where emotional expression converges.

Can emotional phrases in prompts improve language model performance?

Testing EmotionPrompt across ChatGPT, Bard, and Llama 2 showed consistent performance gains from appending psychological phrases like "This is very important to my career." The effect works through motivational framing rather than new information, with positive emotional words driving over 50% of improvements.

Show all 8 sources
Can models store unlimited facts without growing larger?

A formal proof and experiments show in-weight memorization is bounded by model size, while tool-use enables unbounded factual recall through a simple circuit. In-weight finetuning also degrades general capability by overwriting prior knowledge.

Can a separate memory model inject knowledge without touching the LLM?

MeMo trains a dedicated memory model to encode new knowledge, eliminating inference-time search costs that scale with corpus size. It avoids fine-tuning risks and works with frozen proprietary models, but trades this for up-front training cost and capacity limits.

Can relevant memories actually harm LLM reasoning?

MemTrapBench shows that all five tested memory frameworks underperform a no-memory baseline, with drops exceeding 10%, despite memories being accurately stored and task-relevant. This reveals a failure mode at the point of use that standard memory benchmarks miss.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.