Can communication pressure drive agents to learn shared abstractions?
Under what conditions do AI agents develop compact, efficient shared languages? This explores whether cooperative task pressure—rather than explicit optimization—naturally drives abstraction formation, mirroring human collaborative communication.
Cognitive science has demonstrated that humans engaged in collaborative task-oriented communication tend toward higher levels of abstraction over time, enabling shorter and more information-efficient utterances. ACE (Abstractions for Communicating Efficiently) replicates this phenomenon computationally and identifies the mechanism: the need to communicate about a shared task creates natural pressure that drives abstraction formation.
The method combines three components:
- Library learning (symbolic) — proposing candidate abstractions from patterns observed in communication
- Neural communication — generating and interpreting utterances using learned abstractions
- Bandit algorithms — controlling the exploration-exploitation trade-off when introducing new abstractions into the shared language
The result: agents develop compact collaborative languages with shorter programs. The language size is a consequence of pressures that naturally arise through communication about a shared task — not from explicit optimization for brevity.
This connects to two existing findings about communication in AI systems. Why don't conversational AI systems mirror their users' word choices? documents that current AI systems fail to adapt their vocabulary to conversational partners. ACE shows that under the right training regime (cooperative tasks with repeated interaction), agents CAN develop shared vocabulary — the capability exists but requires the right environmental pressure.
Can we teach LLMs to form linguistic conventions in context? addresses convention formation from the training side. ACE provides the theoretical framework: abstraction learning is shaped by communication pressure, and the balance between introducing new abstractions (exploration) and using established ones (exploitation) is a core design parameter.
The cognitive science framing is important: Ho et al. (2019) identified "the need to communicate and coordinate with others" as an outstanding open problem for understanding abstraction learning. ACE demonstrates that cooperative communication IS a sufficient pressure for driving abstraction — agents don't need explicit instruction to abstract, they need a reason to communicate efficiently.
Inquiring lines that read this note 8
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
When should tasks involve human-AI partnership versus full automation? How do multi-agent systems achieve genuine cooperation and reasoning? Does decoupling planning from execution improve multi-step reasoning accuracy? What coordination failures limit multi-agent LLM systems as they scale? When do multi-agent approaches outperform single model extended thinking? Why do LLM research ideas score high on novelty yet collapse into low diversity?Related concepts in this collection 5
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Why don't conversational AI systems mirror their users' word choices?
Explores whether current dialogue models exhibit lexical entrainment—the human tendency to align vocabulary with conversation partners—and what's needed to bridge this gap in AI communication.
ACE shows agents CAN develop shared vocabulary under cooperative pressure; current AI lacks this because the pressure is absent
-
Can we teach LLMs to form linguistic conventions in context?
Humans naturally shorten references as conversations progress, but LLMs don't adapt their language for efficiency even when they understand their partners do. Can training on coreference patterns teach this convention-forming behavior?
training-side fix for convention formation; ACE provides the theoretical mechanism
-
Why don't LLMs shorten messages like humans do?
Humans naturally develop shorter, efficient language during conversations. Do multimodal LLMs exhibit this same spontaneous adaptation, or do they lack this communicative behavior?
convergent problem: LLMs understand efficiency but don't produce it; ACE shows the missing ingredient is cooperative pressure
-
Can language help agents imagine goals they've never seen?
How might compositional language enable artificial agents to target outcomes beyond their training experience? This matters because it could unlock open-ended exploration without hand-coded reward functions.
IMAGINE shows the downstream consequence of communication-driven abstraction: once agents develop compact shared abstractions through cooperative pressure, language compositionality enables them to recombine these abstractions into novel goals they have never experienced
-
Can agents learn new skills without forgetting old ones?
Explores whether externalized skill libraries—storing learned behaviors as retrievable code rather than parameter updates—can solve the catastrophic forgetting problem that plagues continual learning systems.
VOYAGER's skill libraries are the behavioral analog of ACE's communicative abstractions: both develop reusable composable units under performance pressure; the shared mechanism is that cooperative task demands drive agents toward compact, composable representations
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- ACE: Abstractions for Communicating Efficiently
- Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- Towards a Science of Scaling Agent Systems
- Latent Collaboration in Multi-Agent Systems
- Multi-Agent LLMs Fail to Explore Each Other
- Agentic Reasoning for Large Language Models
- Building Cooperative Embodied Agents Modularly with Large Language Models
- Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures
Original note title
communication pressure drives agents to develop compact shared abstractions — efficiency and informativeness are co-optimized through neurosymbolic library learning