How should agent capabilities be organized into functional layers?
Explores whether agent systems can be understood as stacked layers—from basic chatbots through system prompts and RAG to hierarchical supervisors—and what design trade-offs this architecture creates.
In the same talk, Dubberly lays out software-agent capability as "a stack of layers." At the base, "LLM-based chatbots are a simple form of agent" — citing ChatGPT, Claude, and Cursor in the US and ChatGLM and Ling-1T in China — that "take an input and transform* it to return an output." Agents "often have a second input — a system prompt, describing the agent's role, tone, and constraints," and "may draw on information sources outside the LLM through a process called Retrieval Augmented Generation (RAG)." Scaling up, he argues "every physical process and virtual process (that matters) will be overseen by a monitoring agent (a.k.a. Unix daemons), alerting supervisor agents when errors occur or are predicted," and that "the supervisor agents will ladder up in a management tree to an orchestrator agent at a human touch-point (though humans may drill all the way down if they like)."
The stack has two distinct axes: a capability axis (chatbot to system prompt to RAG, each adding an input that narrows or extends what the base LLM transform can act on) and a scale axis (single monitoring agents aggregating into supervisor agents aggregating into one orchestrator agent at the human interface). Dubberly pairs the scale axis with a warning rather than an endorsement, quoting Xerox PARC researcher Rich Gold's 1995 question about "intelligent houses": "How smart does your bed have to be, before you are afraid to go to sleep at night?" — flagging that a management tree of agents "everywhere" is a design problem as much as a capability one.
The scale axis parallels but does not duplicate Does machine agency exist on a spectrum rather than binary?: Rammert's spectrum rates how much initiative a single artifact takes, from passive to cooperative, while Dubberly's stack describes how many agents compose into a hierarchy regardless of any one agent's initiative level. It also gives mechanism to Can AI agents truly operate above the loop at enterprise scale?, which places humans above or within AI-first workflows without specifying what sits between the workflow and the human; Dubberly's orchestrator-agent-at-the-touch-point fills that gap. Against How does agency split between humans and AI systems?, the stack adds that supervision itself can be agentic — a supervisor or orchestrator agent, not a human, may hold the oversight role the archetypes assume belongs to a person. The companion note, Is design for agents becoming the next major design paradigm?, is the paradigm-level claim this stack is offered in service of.
The excerpt gives no mechanism for how an alert actually propagates from a monitoring agent to a supervisor agent, no accuracy or false-positive data for prediction ("errors occur or are predicted"), and no account of what happens when an orchestrator agent itself errs. "Billions of them" is a rhetorical projection, not a sourced forecast. The stack should be read as a proposed design vocabulary for talking about agent hierarchies, not a validated architecture or a measured prediction of how many agents will exist.
Inquiring lines that read this note 21
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does interface design shape effectiveness in human-AI collaboration?- Should interface design organize by pattern type or by behavioral phase?
- How does agent design differ fundamentally from interaction design practice?
- Why should service design absorb agent design rather than keep them separate?
- What evidence would prove agent design has achieved paradigm status?
- How should designers expose systemic trade-offs to users of autonomous agents?
- What evidence supports splitting agent customization into identity and interaction decisions?
- Does agent experience design produce better outcomes than screen-first design?
- How do context windows constrain AI agent interface design choices?
- What capabilities must agents have to support human-centered service delivery?
- How does agent autonomy vary across different roles and user needs?
- What makes some agent participation controls easier for groups to actually use?
- How does the agent boss model differ from traditional AI copilot metaphors?
- How do designers decide when AI agents should escalate to humans?
- What scope boundaries and context awareness matter most to workplace agent users?
Related concepts in this collection 6
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does machine agency exist on a spectrum rather than binary?
Rather than viewing AI as either autonomous or controlled, does machine agency actually operate across five distinct levels from passive to cooperative? Understanding this spectrum matters because it shapes how users calibrate trust and control expectations.
Rammert's spectrum rates a single artifact's initiative; Dubberly's stack rates how agents compose into a hierarchy
-
Can AI agents truly operate above the loop at enterprise scale?
McKinsey proposes a radical organizational shift where AI agents handle end-to-end workflows with humans positioned for strategic oversight. This exploration examines whether that model reflects current practice or remains aspirational.
both place a human touch-point above a chain of agents, though McKinsey frames it as enterprise pillars rather than a software stack
-
How does agency split between humans and AI systems?
As AI systems grow more autonomous, where does control and decision-making actually reside? Understanding agency distribution helps us design and govern AI appropriately across different use cases.
Dubberly's hierarchy adds that supervision itself can be agentic, not only human, elaborating where the archetypes draw the human/AI line
-
Is design for agents becoming the next major design paradigm?
Does the emergence of LLMs signal a fundamental shift in design practice, where agent design subsumes interaction design the way interaction design once absorbed graphic design? This explores whether we're witnessing a historical paradigm change comparable to mass manufacturing's rise.
the sibling note, giving the paradigm-level claim this capability stack supports
-
Can we design AI autonomy separately from capability?
Explores whether an AI agent's autonomy—how much it operates without user involvement—is a design choice independent of what the agent can actually do. This matters because it opens autonomy to governance and calibration rather than treating it as fixed by capability.
Qualifies A's stack: autonomy is a separate design choice from capability, not an automatic byproduct of the supervisor-orchestrator tier
-
How should organizations supervise autonomous AI agents?
Explores what structural and technical mechanisms organizations need to maintain meaningful human oversight as AI agents gain decision-making autonomy, and whether designed handoff points and audit trails can prevent oversight degradation.
Extends A's supervisor-to-orchestrator touch-point by specifying cryptographic identity, receipts, and logs supervisors need at designed handoff points
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
- AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challenges
- Intelligent AI Delegation
- Embodied LLM Agents Learn to Cooperate in Organized Teams
- Drop the Hierarchy and Roles: How Self-Organizing LLM Agents Outperform Designed Structures
- Toward an Organizational Science of Multi-Agent LLM Systems: Decoupling Who, How, and Which Algorithm
- Comparing Human Oversight Strategies for Computer-Use Agents
- Levels of Autonomy for AI Agents
Original note title
Dubberly argues agent capabilities stack from chatbot through system prompt and RAG to a supervisor-orchestrator hierarchy