Does participatory AI actually give stakeholders real power?
When AI projects claim to be participatory, how much authority do they actually give stakeholders over design decisions? This matters because genuine participation looks different from consultation.
A mixed-methods study analyzing 80 research papers that described their approach as "participatory AI," combined with semi-structured interviews with 12 of those papers' authors, finds that most participatory AI projects operate in a consultative mode: they elicit stakeholder preferences and values rather than grant stakeholders power over core design decisions. All 80 papers framed their goal as improving user experience, and 52 of 80 as better aligning AI with stakeholders' preferences and values, but only 8 of 80 (10%) involved stakeholders in shaping the system's "scope and purpose." Every project in the corpus involved stakeholders in user interface design — for instance in designing explanations of AI outputs — while only 8 of 80 (10%) let stakeholders weigh in on the type of model and features used, the design of objective or loss functions, or classification decision thresholds. None of the 80 projects allowed stakeholders to rule out AI as a solution altogether, "since these projects were defined as 'AI projects' in the first place."
The paper traces this pattern to who sets the terms of participation. In 74 of 80 projects, project leads chose which stakeholders to involve, often "based upon what they presumed to be the background of that group/person," recruiting either opportunistically ("just talk to some of your friends") or through opt-in. Only 6 of 80 projects used a community-engaged approach to identify participants, and just 3 of 80 kept community stakeholders involved across the AI system's full life cycle. Methodologically, 85% of projects (68 of 80) relied on elicitation techniques — surveys, interviews, role-playing, collaborative storyboarding — built to surface preferences rather than to transfer decision authority.
This sits alongside other recent attempts to typologize human-AI decision authority, such as How should humans and AI systems divide decision-making tasks? and How do AI novelty and scope shape employee relationships?, but shifts the unit of analysis from who decides once a system is built to who has a say while the system is being designed. It also qualifies What UX principles do workplace users want in AI agents?: that framework describes what users want from a deployed agent, whereas this corpus analysis shows that current design processes rarely let stakeholders act on that same wish for control before deployment.
The corpus is limited to published computing-venue papers that self-identify with the "participatory AI" label, so the finding describes that labeled literature rather than participatory practice in AI design generally, and the paper's authors note it may miss relevant work in HCI journals or grey literature such as policy-institute white papers. What the excerpt establishes is a pattern within that labeled corpus, not a causal account of why teams default to consultation; it implies that invoking "participation" in AI design currently signals little about how much design authority stakeholders actually receive.
Inquiring lines that read this note 3
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does interface design shape effectiveness in human-AI collaboration? How does increased AI involvement reshape human agency and accountability? What organizational factors determine whether firms successfully adopt and integrate AI?Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
How should humans and AI systems divide decision-making tasks?
Explores whether human-AI decision-making is fundamentally an organization design problem requiring choices about task division and learning configurations, not just technical optimization.
shifts the unit of analysis from post-deployment decision rights to who shapes decisions during design.
-
How do AI novelty and scope shape employee relationships?
Makarius and colleagues ask whether different types of AI systems—varying in how new they are and how broadly they reshape work—create systematically different kinds of relationships between employees and technology. Understanding these patterns could help organizations anticipate integration challenges.
both typologize AI decision authority, but this paper measures actual practice rather than proposing categories.
-
What UX principles do workplace users want in AI agents?
A multi-method study asked business users what design principles matter most for human-AI collaboration at work. The findings prioritize oversight and reliability over convenience.
shows users want control that current participatory design processes rarely let them exercise upstream.
-
What participatory traditions shape AI design practice?
How do different approaches to stakeholder participation in AI design—from user research to democratic theory—define who gets a say and what counts as meaningful input? Understanding these traditions helps clarify what "participatory AI" actually means in practice.
catalogs the traditions this finding shows current practice falling short of.
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- The Participatory Turn in AI Design: Theoretical Foundations and the Current State of Practice
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent
- Futuring Social Assemblages: How Enmeshing AIs into Social Life Challenges the Individual and the Interpersonal
- Microsoft New Future of Work Report 2025
- What does Generative UI mean for HCI Practice?
- From Junior to Senior: Allocating Agency and Navigating Professional Growth in Agentic AI-Mediated Software Engineering
- Choose Your Agent: Tradeoffs in Adopting AI Advisors, Coaches, and Delegates in Multi-Party Negotiation
- Prototyping with Prompts: Emerging Approaches and Challenges in Generative AI Design for Collaborative Software Teams
Original note title
participatory AI projects mostly elicit stakeholder preferences on interface details rather than cede power over model design decisions