Do LLM agents develop unreadable languages when communicating under pressure?
When multiple LLMs talk to each other under task pressure, do they evolve their own languages that humans cannot understand? This matters for AI safety and monitoring multi-agent systems.
GlossoGen is a platform for studying how language changes when LLM agents talk to each other in complex scenarios, and its SaveVeyru scenario "requires agents with partial information to communicate under pressure." The abstract reports that language evolution does occur between the agents, that the resulting languages are "compositional and morphologically productive," and that they "deviate from the LLMs' English prior in ways that render them incomprehensible to humans." The introduction frames the stakes: agents that develop their own languages pose a safety risk, because "an external observer can no longer understand or monitor their communication."
The paper names three qualities as essential to this evolution: pressure toward efficiency, the strength of the models backing the agents, and access to a "postmortem" stage in which agents can agree on linguistic conventions. It adds that "different conditions govern the transmission of language to new agents," so the conditions that let a language arise are not the same as those that let it spread. The discussion pushes the transmission result further: some of the languages can be passed to new agents, including agents unable to construct them alone, which the authors take to suggest that existing LLMs already have "the foundations for cumulative cultural evolution." They present that as a suggestion drawn from the transmission results, not as a demonstrated open-ended accumulation.
Against the nearest notes, this paper confirms the pressure story and changes what it produces. Can communication pressure drive agents to learn shared abstractions? shows cooperative pressure yielding compact shared abstractions in a purpose-built neurosymbolic system; GlossoGen reports a comparable pressure-driven process in LLM-backed agents, with opacity to humans as the visible side effect. It also qualifies Why don't LLMs shorten messages like humans do?: that note finds LLM speakers do not adapt without heavy instruction, while GlossoGen finds adaptation when efficiency pressure, a strong enough model and a postmortem stage are present. The postmortem stage, where conventions are agreed explicitly, looks like the kind of scaffolding the ICCA result implies is needed, though the excerpt does not say so. And Does structured artifact sharing outperform conversational coordination? fixes the inter-agent medium by design, whereas GlossoGen studies what happens when the medium is left free to change.
The excerpt is silent on most of what would let these findings be weighed. It does not say how many agents there are, which models were used, how compositionality and morphological productivity were measured, how large the effects were, or what the conditions governing transmission actually are. It does not say whether the evolved languages help or hurt task performance, or whether the pattern holds outside SaveVeyru. What it supports is narrower: in this platform, an English prior does not keep multi-agent communication human-readable once the three named conditions are present. For monitoring, the efficiency pressure and any explicit convention-setting stage are the settings worth checking in a multi-agent design, and human readability of agent-to-agent messages should not be assumed.
Inquiring lines that read this note 1
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How do multi-agent LLM systems fail distinctly compared to single agents?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can communication pressure drive agents to learn shared abstractions?
Under what conditions do AI agents develop compact, efficient shared languages? This explores whether cooperative task pressure—rather than explicit optimization—naturally drives abstraction formation, mirroring human collaborative communication.
same pressure-driven mechanism, here in LLM-backed agents, where the outcome includes opacity to human observers
-
Why don't LLMs shorten messages like humans do?
Humans naturally develop shorter, efficient language during conversations. Do multimodal LLMs exhibit this same spontaneous adaptation, or do they lack this communicative behavior?
qualifies the no-spontaneous-adaptation result: adaptation appears once efficiency pressure, strong models and a postmortem stage are present
-
Does structured artifact sharing outperform conversational coordination?
Explores whether agents coordinating through standardized documents rather than natural language messages achieve better collaboration outcomes. Matters because it challenges the default conversational paradigm in multi-agent system design.
fixes the inter-agent medium by design; GlossoGen studies the case where the medium is free to evolve
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- GlossoGen: Emergent Language in Complex Multi-Agent LLM Interactions
- Large Language Model based Multi-Agents: A Survey of Progress and Challenges
- Scaling Behavior of Single LLM-Driven Multi-Agent Systems
- Bilevel Coordinated Reflection: A Game-Theoretic Approach to Multi-Agent LLM Systems
- Large Language Model Programs
- Cultural Evolution of Cooperation among LLM Agents
- A Technical Taxonomy of LLM Agent Communication Protocols
- Survey on Evaluation of LLM-based Agents
Original note title
language evolution occurs between LLM agents under communication pressure — the resulting languages are compositional and incomprehensible to humans