What controls help groups manage AI agent participation?
How can group members configure when, where, and how an AI agent participates in shared conversations? Understanding control mechanisms could make collaborative tools less intrusive and more useful.
Having found in Study 1 that group members wanted to control their Slack brainstorming agent "Koala," Houde and colleagues built a second prototype, "Koala II," with functional controls group members could actually operate, then used it to validate and expand a taxonomy of agent-participation controls. The excerpt states the taxonomy "identifies key aspects of control over an agent's interactive behaviors and ways to control them," organized around when, what, and where a conversational AI agent in a group should respond, who can control its behavior, and how those controls are specified and implemented. This differs from the comparison case the authors cite, Gammelgård-Larsen et al., who gave users three fixed configurations (intermittent, continuous, proactive) for a music-recommendation agent; Houde and colleagues instead "examined a set of controls in which participants could create their own configurations" rather than choosing among presets.
The mechanism behind the taxonomy's "when" axis traces back to Koala's underlying operational logic: a user message triggers backend "control logic" that either passes on replying immediately or hands off to further "autonomy control logic," where the LLM generates a candidate response and then scores that same response for how valuable a contribution it would make — the model is asked to judge its own interjection before Koala decides whether to post it. The excerpt also flags a specific failure inside that logic: "the underlying LLM was unreliable in identifying the intended target for a chat utterance," meaning Koala could not reliably tell who a given group message was actually addressed to, a prerequisite for deciding whether it was the intended recipient at all.
The taxonomy sits alongside How can proactive agents avoid feeling intrusive to users? as a second multi-dimensional framework for the same underlying problem, but the two cut the space differently: the Intelligence-Adaptivity-Civility triad describes qualities of the agent's behavior itself, while Houde's when/what/where/who/how axes describe control points a group can act on, with "who" naming control ownership as its own dimension — a question the ICT framing does not pose directly. The targeting failure the excerpt reports also lands squarely inside Why do conversation agents handle turn-taking better than emotion recognition?: addressee selection is exactly the kind of agent-action-modeling task that survey found current systems handle far less reliably than raw language generation, and Koala's difficulty "identifying the intended target" is a concrete instance of that gap surfacing inside a deployed prototype rather than a benchmark.
The excerpt's description of the taxonomy itself is cut off after its introduction, so the full set of control mechanisms validated in Study 2, and any usability findings about which controls group members actually used, are not given here. It is also not established whether a five-axis taxonomy derived from one Slack brainstorming deployment covers the control needs of other group-chat contexts (customer support channels, open public threads, larger groups) where addressee ambiguity and participation norms differ. The implication, at the strength the excerpt supports, is that designing proactive group-chat agents requires treating who decides and how they decide as design variables distinct from when the agent speaks, rather than folding all of initiative behavior into a single proactivity setting.
Inquiring lines that read this note 2
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does interface design shape effectiveness in human-AI collaboration? How should organizations govern autonomy and access for agentic AI systems?Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
How can proactive agents avoid feeling intrusive to users?
Explores why proactive conversational agents often feel annoying rather than helpful, and what design dimensions could prevent them from violating user expectations and autonomy.
a second multi-dimensional control framework for the same problem, cutting the space by control-ownership rather than behavioral quality
-
Why do conversation agents handle turn-taking better than emotion recognition?
A survey of multi-party dialogue systems reveals a striking performance gap: agents excel at predicting when to speak and whom to address, but struggle with recognizing emotion, personality and engagement. What explains this disparity?
Koala's reported difficulty identifying the intended addressee is a concrete case of the capability gap that survey documents
-
Why can't conversational AI agents take the initiative?
Explores whether current LLMs lack the structural ability to lead conversations, set goals, or anticipate user needs—and what architectural changes might enable proactive dialogue.
the taxonomy's "who" and "when" axes presuppose an agent that could otherwise take unwanted initiative, extending the passivity frame into multi-party design
-
Do users want to adjust AI proactivity during conversations?
Explores whether people prefer fixed AI behavior settings or want to dynamically tune an agent's initiative level mid-conversation. Matters because it challenges assumptions about how AI assistants should participate in group settings.
the Study 1 finding this taxonomy was built to address
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Controlling AI Agent Participation in Group Conversations: A Human-Centered Approach
- Does My Chatbot Have an Agenda? Understanding Human and AI Agency in Human-Human-like Chatbot Interaction
- The Oversight Fallacy: Why AI Agents Require More than Humans-in-the-Loop
- Intelligent AI Delegation
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Challenges in Human-Agent Communication
- Choose Your Agent: Tradeoffs in Adopting AI Advisors, Coaches, and Delegates in Multi-Party Negotiation
- Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
Original note title
Houde and colleagues propose a taxonomy of when, what, where, who, and how controls shape an ai agent's group chat behavior