What UX principles do workplace users want in AI agents?
A multi-method study asked business users what design principles matter most for human-AI collaboration at work. The findings prioritize oversight and reliability over convenience.
The paper proposes a design framework of eight core UX principles for human-AI agent interaction in the workplace, each paired with "underlying criteria" that it presents as "actionable guardrails for designers and software engineers." The discussion reports that "business users prioritize principles centered on human control, reliability, context-awareness, and safety," and calls these "practical necessities that directly shape user acceptance and effective collaboration with AI agents" rather than "theoretical ideals."
The reasoning starts from a gap in existing practice. Traditional UX methods were "developed for non-agentic systems producing predictable, human-controlled outcomes," and the introduction argues they cannot account for agents that define objectives, execute multi-step plans, make decisions, and take over "organizational roles previously held exclusively by humans." The framework is meant to help enterprises integrate agents "while maintaining meaningful human oversight, fostering user trust, and adhering to organizational governance requirements." To derive it, the authors combine a participatory design workshop, paper-and-pencil exercises, expert review, meta-analysis, and in-depth interviews, and they describe the result as identified and validated through that combination.
Against the nearest notes, this adds a user-side and designer-side view to arguments made mostly from agent behavior. Should AI systems stay collaborative rather than fully autonomous? argues architecturally that humans should stay in the loop; here the same concerns appear as what workplace users say they want, and as criteria a designer can apply. The stress on human control fits the tension in Does machine agency exist on a spectrum rather than binary?, where users welcome convenience but resist ceding decisions, although this paper does not place its principles on that spectrum. The reliability priority sits beside the measured failures in Why do AI agents fail at workplace social interaction?, but the two are different kinds of evidence: one measures what agents can do, the other what users prioritize.
The excerpt leaves most of the framework's substance out. It does not name the eight principles or the underlying criteria, and it names only four themes that users prioritize. It gives no participant counts, no roles or organizations, and no account of how prioritization was measured or which method produced it. The claim that these principles "directly shape user acceptance" is asserted in the discussion, and no adoption or behavioral outcome appears in the excerpt. The introduction cites controllability, explainability, ethics, privacy, transparency, and collaboration from prior literature, and the excerpt does not say how the eight principles map onto that list. At this strength, the paper supports one narrow reading: in this study's workplace setting, stated user priorities cluster around oversight and dependability, and the authors offer a structured checklist for designing to them. It does not show that following the checklist improves trust or adoption.
Inquiring lines that read this note 2
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
When should work require human-AI partnership versus full automation? What drives appropriate trust calibration in personalized AI systems?Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Should AI systems stay collaborative rather than fully autonomous?
Explores whether keeping humans in the loop with AI agents is more reliable than pursuing full autonomy. Investigates whether collaboration solves problems that autonomous systems structurally cannot.
extends the human-in-the-loop argument from agent failure to stated user priorities and design criteria
-
Does machine agency exist on a spectrum rather than binary?
Rather than viewing AI as either autonomous or controlled, does machine agency actually operate across five distinct levels from passive to cooperative? Understanding this spectrum matters because it shapes how users calibrate trust and control expectations.
the human control priority is consistent with users resisting loss of decision authority, though this paper does not use the spectrum
-
Why do AI agents fail at workplace social interaction?
Explores why current AI agents struggle most with communicating and coordinating with colleagues in realistic workplace settings, despite strong reasoning capabilities in other domains.
the reliability priority sits beside measured agent task failure, but this paper reports user priorities rather than performance
-
Does granting agents more autonomy undermine human oversight?
Explores whether the design of autonomous AI systems—by giving agents greater independence—actually weakens the human overseer's ability to catch problems. Matters because oversight is a key safeguard against AI failures.
Qualifies: users prioritize human control, but greater agent autonomy and extended use erode users' capacity to exercise the oversight that control depends on
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- A Framework of User Experience Principles for Human-AI Agent Interaction in the Workplace
- Future of Work with AI Agents: Auditing Automation and Augmentation Potential across the U.S. Workforce
- Unaccountable Delegation, Fading Skills: Mapping the Risks of Workplace AI Agents
- AI Agents Push Humans Out of the Loop
- Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
- Design Principles for Generative AI Applications
- Assessing the Applicability of Existing Design Recommendations to AI Companion Design: A Multi-Method Study
- Explaining AI Agents Through Execution Traces
Original note title
business users prioritize human control, reliability, context-awareness, and safety in an eight-principle UX framework for workplace AI agents