Do current AI governance frameworks capture shifting stakeholder roles?
Existing AI-governance frameworks like OECD, NIST, and EU AI Act classify stakeholders into fixed categories. But do these categories miss the fine-grained, moment-to-moment shifts in whose information, authority, and agency are actually at stake inside multi-party LLM interactions?
A scoping review of LLM assistants that extend beyond a single user argues that current AI-governance frameworks, while they already "provide foundations for considering people beyond the immediate user," stop short of the finer-grained relationships multi-party assistant risk actually turns on. The review credits the OECD Framework with distinguishing users from "directly and indirectly impacted stakeholders," the NIST AI Risk Management Framework with emphasizing "context, affected stakeholders, organizational responsibilities, monitoring, and feedback throughout the AI lifecycle," and the EU AI Act with translating these concerns into "requirements for specified systems, including risk management, transparency, record-keeping, human oversight, and post-market monitoring," plus a fundamental rights impact assessment for high-risk deployments that considers "categories of people and groups likely to be affected in the context of use."
Against that backdrop, the review's own findings describe risks that "often depend on whose information is accessed or reused, whose preference is represented, whose instruction carries authority, whose resource is acted upon, and who is exposed to the resulting output." It argues these relationships "may coexist or change within the same interaction" — a bystander's speech may be captured, then a co-user's instruction acted on, then the primary user exposed to the result, all inside one exchange — "and are less explicitly captured by broader categories such as user, affected stakeholder, deployer, or provider." The conclusion drawn is that multi-party governance needs to represent these shifting relationships at the point where "information, state, and action are handled," not only classify people into fixed roles set in advance.
This sits on top of the review's own pathway-and-risk taxonomy, recorded in How do single-user AI assistants actually involve multiple people?, as the policy argument built from that empirical mapping: the pathways and risks are exactly what the fixed stakeholder categories miss. It also bears on Can AI systems delegate tasks back to humans?, since a delegation relationship reversed between an AI artifact and a human is the kind of shifting authority the review says stakeholder categories do not track. Where How well do AI assistants actually support human agency? measures whether an assistant supports one user's agency, this review's governance argument asks a different and prior question: whose agency and authority a given moment of operation is even supposed to represent.
The review does not propose or test a revised framework, and does not say which specific provision of the OECD Framework, NIST AI RMF or EU AI Act would need to change; it states only that current categories are coarser than the relationships its own pathway findings describe. It also does not say whether any governance body has acted on this gap since the review's September 2026 search cutoff. The claim is a critique of category granularity in existing frameworks, not a proposal, a legal analysis, or evidence that the gap has caused a specific documented harm.
Inquiring lines that read this note 1
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How should control and autonomy be allocated in human-AI workplace collaboration?Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
How do single-user AI assistants actually involve multiple people?
AI assistants are built for one user, but research suggests they increasingly extend to others—sometimes intentionally, sometimes not. What are the actual pathways and risks when multiple people interact with systems designed for just one?
the pathway-and-risk taxonomy this governance argument is built on top of
-
Can AI systems delegate tasks back to humans?
Explores whether agentic AI systems can reverse traditional delegation patterns by assigning tasks to humans rather than only receiving them. This matters because it challenges foundational assumptions about human-AI hierarchies in workplace design.
the kind of shifting, reversed authority relationship this review says stakeholder categories do not track
-
How well do AI assistants actually support human agency?
Researchers developed HumanAgencyBench to test whether AI assistants preserve human decision-making capacity across six key behaviors. Understanding this matters for designing AI that enhances rather than undermines human autonomy.
measures agency support for one user; this review's argument is about whose agency a moment of operation represents in the first place
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- When Single-User-Oriented LLM-based Assistants Involve Others: A Scoping Review of Pathways, Risks, and Responses
- Governing AI Agents
- Quality work in the future: New directions via a co-evolving sociotechnical systems perspective
- Keeping an Eye on AI: A Framework for Effective Human Oversight of AI Systems
- Homo agenticus in the age of agentic AI: Agency loops, power displacement, and the circulation of responsibility
- Putting AI on the Org Chart: Evidence on Delegation and Accountability
- Whom Do AI Agents Work For? Role Assignment Induces Sponsorship Bias in LLM Recommenders
- When AI Becomes an Agent of the Firm: Examining the Evolution of AI in Organizations Through an Agency Theory Lens
Original note title
OECD NIST and EU AI Act stakeholder categories do not capture the shifting cross-person roles inside multi-party LLM assistant operation