SYNTHESIS NOTE
Agentic Systems and Tool Use Model Architecture and Internals

Can three axes replace the short-term long-term memory split?

Does breaking agent memory into forms, functions, and dynamics provide a clearer framework than the traditional short-term/long-term distinction? This matters because current agent-memory literature lacks a unified vocabulary, making comparison between systems nearly impossible.

Synthesis note · 2026-05-18 · sourced from Memory
Why do multi-agent systems fail despite individual capability? What kind of thing is an LLM really?

The agent-memory literature has fragmented faster than the field can taxonomize. "Memory in the Age of AI Agents" (2512.13564) argues the older long/short-term split was the source of confusion: it conflates where memory lives, what role it plays, and how it changes — three independent questions that need three separate taxonomies.

Forms answer where memory physically lives: token-level (memory as text in the prompt or external store retrieved into the prompt), parametric (memory as model weights, including fine-tuned adapters and PKM-style key-value layers), or latent (memory as continuous hidden states preserved across turns or sessions). A single agent can use all three simultaneously.

Functions answer what role memory plays: factual (a fact about the world the agent uses as a lookup), experiential (a trajectory of past actions and outcomes the agent learns from), or working (the active scratchpad holding the current goal, plan, and intermediate results). The same physical store can serve different functions at different times.

Dynamics answer how memory changes: formation (selecting which artifacts from a step become memory candidates), evolution (integrating candidates into the existing store via consolidation, conflict resolution, or pruning), retrieval (constructing task-aware queries to surface relevant content). Crucially, short-term and long-term phenomena emerge from temporal patterns of these operators, not from architecturally separate modules.

The reframing is consequential. The old taxonomy invited claims like "this system has long-term memory because it has a vector database" — implementation by furniture, not behavior. The new taxonomy forces specificity: this system stores experiential memory in token form with eager-formation, periodic-evolution, and similarity-based-retrieval dynamics. Comparing systems becomes possible because they describe themselves along comparable dimensions rather than each inventing its own vocabulary.

The survey also clarifies the scope boundary with traditional LLM memory work. KV-cache management, long-context extensions, and architectural changes to retention during inference remain LLM-internal memory — not agent memory — because they address sequence processing rather than goal-directed behavior persisting across tasks.

Inquiring lines that use this note as a source 12

This note is a source for these synthesized inquiries. Follow a line forward into its question, or open it to trace back to all of its sources.

Related concepts in this collection 3

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
18 direct connections · 109 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

agent memory unifies under three axes — forms, functions, and dynamics replacing the short-term/long-term dichotomy