Can classical agent architectures fix agentic AI accountability?
Could AAMAS concepts like BDI models and formal protocols address the transparency and verifiability gaps in current LLM-based agents? This explores whether decades-old multi-agent theory offers practical scaffolding for trustworthy autonomous systems.
The paper argues that current agentic AI — systems that combine large language models with tool use, planning, and multi-step action — lacks the explicit architectures that the decades-old Autonomous Agents and Multi-Agent Systems (AAMAS) research tradition built for reasoning, communication, and governance, and that recovering those tools is necessary "to turn behavioural autonomy into responsible agency." It names four classical AAMAS resources agentic AI is missing: BDI (belief-desire-intention) architectures that give agents explicit mental states, formal communication protocols such as KQML and FIPA-ACL, mechanism design for aligning individual agent incentives with group objectives, and institutional or normative modeling for governance. The paper states that "AAMAS research developed rich, explicit models of cognition, communication, and social structure, but often lacked the flexibility and scalability that characterize current data-driven approaches," while "current agentic systems promise flexible reasoning and continuous action, but often lack the explicit architectures, communication and reasoning semantics, and normative grounding that earlier agent models provided."
Two properties of LLMs, in the paper's account, make this gap consequential. First, LLMs "imitate human intelligence in an input-output way" rather than executing a specifiable, verifiable function — so "the results from the past are no guarantee for results in the future," illustrated by an agent that books a convenient flight for a conference once and an unexpectedly inconvenient one the next time. Second, LLMs "live" in a world of data: patterns in training data, not an explicit specification of social context, determine their behavior, so performance degrades when context shifts or an exception arises. By contrast, BDI-style architectures give an agent explicit internal state and commitment mechanisms that support "introspection, communication of mental attitudes, and logical verification of consistency between goals and actions" — features the paper says LLM agents lack because their "intentionality is implicit, inferred from surface-level behavior rather than formally specified reasoning."
This extends the argument in What infrastructure must exist beyond training agents? that behavior training alone cannot supply governance — where that note locates the missing functions in external infrastructure built around the model, this paper locates them in classical AAMAS theory (protocols, mechanism design, institutional norms) that predates LLM agents entirely. It also sharpens How can users verify what an AI agent actually plans to do?: the complaint here is not just that users need a way to check an agent's plans, but that the agent itself has no internal commitment structure to check against, so verification has nothing stable to verify. It converges with Why do agents fail at identity verification and authorization? in calling for formal protocol-level governance, and cites the same NIST framework as a candidate alignment point for the benchmarks it proposes. And it gives a structural frame to Should AI systems stay collaborative rather than fully autonomous?: where that position paper argues from observed reliability failures, this one explains the failures as the predictable result of discarding AAMAS's explicit architectures.
The paper is a position piece, not an evaluation: it proposes that BDI architectures, formal protocols, mechanism design, and institutional modeling would make agentic AI more verifiable and accountable, but reports no implementation or test of any such hybrid system against an LLM-only baseline. Its examples — flight-booking agents, conference travel — are illustrative, not empirical. The implication the excerpt supports is a research agenda, to "operationalize these principles through concrete methods, tools, and governance structures," rather than a demonstrated fix; whether reintroducing classical agent formalisms is tractable at LLM scale remains open.
Inquiring lines that read this note 11
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Why doesn't LLM knowledge translate to improved reasoning outputs? How do standardized artifacts improve coordination in multi-agent systems?- How can formal communication protocols like FIPA-ACL improve agent transparency?
- Why do deployed LLM agents lack identity verification at protocol level?
- How does agent governance relate to traditional multiagent system design?
- How do institutional models and protocols scaffold accountability in agentic AI systems?
- What makes accountability tags inert versus load-bearing in multi-agent systems?
- Can traditional agency theory tools govern AI agents at scale?
Related concepts in this collection 6
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
What infrastructure must exist beyond training agents?
Explores whether agent behavior training alone suffices for safe, coordinated multi-agent systems, or whether external technical layers—for attribution, interaction-shaping, and harm response—are structurally necessary.
both argue behavior training must be complemented by structure external to the model, infrastructure versus AAMAS theory
-
How can users verify what an AI agent actually plans to do?
Stating goals to an AI agent isn't enough for mutual understanding. What mechanisms would let users check both the agent's proposed plan and whether it truly grasps the user's goals and constraints?
sharpened here: without BDI-style commitment structures there is nothing stable for a user to verify
-
Why do agents fail at identity verification and authorization?
Agent systems reveal critical gaps in identity verification, authorization enforcement, and proportionality constraints that don't appear in chat models. Understanding these failures is essential because they enable unauthorized real-world actions rather than just wrong answers.
both call for formal protocol governance and cite the same NIST framework
-
Should AI systems stay collaborative rather than fully autonomous?
Explores whether keeping humans in the loop with AI agents is more reliable than pursuing full autonomy. Investigates whether collaboration solves problems that autonomous systems structurally cannot.
this paper gives a structural explanation for the reliability failures that note documents empirically
-
Do LLM agents misinterpret delegated requests more than formal protocols?
Natural-language agent communication infers meaning statistically rather than formally, potentially causing agents to overstep their delegated tasks. How often does this lead to miscoordination in practice?
Extends A: KQML/FIPA-ACL are the formal communication protocols whose fixed semantics could replace agentic AI's statistical guessing of intent
-
Should organizational rules be designed separately from agent roles?
Early multiagent systems design treated roles and interactions as sufficient. But does separating organizational rules and structure from roles enable better system design, especially when constraints span multiple agents?
Extends A: Gaia supplies a concrete institutional model — organizational rules distinct from agent roles — scaffolding A calls for
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Agentifying Agentic AI
- Explaining AI Agents Through Execution Traces
- Toward an Organizational Science of Multi-Agent LLM Systems: Decoupling Who, How, and Which Algorithm
- A Comparative Study of MCP and A2A for Inter-Agent Coordination in LLM-Based Systems
- AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
- Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures
- Securing Agentic AI: From Per-Action Checks to Trajectory Assurance
- Single-agent or Multi-agent Systems? Why Not Both?
Original note title
AAMAS architectures communication protocols and institutional models provide the missing scaffolding for accountable agentic AI