How do we map LLM outputs into symbolic agent actions?
When retrofitting large language models into classical agent architectures like BDI, a critical gap emerges: there is no established method for translating the natural language reasoning LLMs produce into discrete symbolic actions and beliefs an agent can execute.
Among five challenges this position paper identifies for building normative LLM agents, the first is architectural: "Retrofitting agent architectures: Integrating LLMs as a part of the decision-making cycle of an agent may require re-engineering of the existing agent frameworks such as the BDI architecture." The paper states plainly that "LLMs produce natural language responses that need to be converted back to actions performed by an agent," which means "in an agent's planning module, responses need some mapping function that link natural language text to actions (classes, functions etc.)" — and the reverse translation is needed too, turning "an agent's perception and beliefs into natural language prompts."
The paper points to prior neuro-symbolic work as a partial precedent rather than a solution. It cites Chaudhury et al.'s approach, where an agent "learns to perform a specific action (e.g., whether to enter a room or not) based on symbolic abstractions from textual observations," alongside other work converting "textual observations into logic... and vice versa." But it is explicit that "these works have not considered the use of LLMs for this purpose" — the existing bridges between text and symbolic agent state were not built with an LLM as the text-generating component, so the translation layer this paper's normative-agent proposal depends on does not yet exist in the form it needs.
This sharpens a boundary the vault already draws from a different angle. Do large language models reason symbolically or semantically? finds that LLMs reason from semantic association rather than symbolic manipulation; this paper's unsolved translation problem is the architectural consequence of that same gap — if an LLM's output is semantic association rather than symbolic reasoning, a mapping function from its text to an agent's discrete action classes cannot simply assume the symbolic step is happening inside the LLM. The paper's own second listed challenge — that LLMs are "prone to hallucination" and remain "far behind human reasoning capabilities" — compounds the first: even once a mapping function exists, what it maps may not be reliable.
The excerpt does not propose or evaluate a candidate mapping function; it only states the need and cites adjacent, non-LLM precedent. It also does not specify what would count as evidence that the gap is closed — there is no benchmark or test proposed for successful retrofitting. The implication the excerpt supports is that any architecture claiming to equip LLM agents with norm-following behavior is carrying an unexamined translation step between language and action, one the paper names as open and does not resolve.
Inquiring lines that read this note 3
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Why doesn't LLM knowledge translate to improved reasoning outputs? How do standardized artifacts improve coordination in multi-agent systems? What reasoning limitations and biases do language models systematically exhibit?Related concepts in this collection 2
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Do large language models reason symbolically or semantically?
Can LLMs follow explicit logical rules when those rules contradict their training knowledge? Testing whether reasoning operates independently of semantic associations reveals what computational mechanisms actually drive LLM multi-step inference.
supplies the mechanism behind why a text-to-action mapping function can't assume symbolic reasoning is happening inside the LLM
-
Can LLMs discover and apply social norms dynamically in open systems?
Can language models be extended with explicit norm discovery, reasoning, and conformance capabilities to replace static symbolic rules in multi-agent systems that operate in changing environments?
names the architecture this translation gap would need to support
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Harnessing the power of LLMs for normative reasoning in MASs
- Dynamic Planning with a LLM
- Large Language Model Programs
- Fundamentals of Building Autonomous LLM Agents
- Leveraging Pre-trained Large Language Models to Construct and Utilize World Models for Model-based Task Planning
- Large Language Models as Planning Domain Generators
- Converging Paradigms: The Synergy of Symbolic and Connectionist AI in LLM-Empowered Autonomous Agents
- Scaling Behavior of Single LLM-Driven Multi-Agent Systems
Original note title
retrofitting LLMs into BDI-style agent architectures requires an unsolved mapping between natural language reasoning and symbolic beliefs and actions