Could a neutral middleman stop AI assistants from quietly controlling what you see and decide?
Can third-party intermediaries reduce gatekeeping risks from AI assistants?
This explores whether putting an independent party between people and their AI assistants (an auditor, a regulator, a user-paid agent, or a separate oversight layer) could limit the assistant's power to control what people see and do. The corpus describes the gatekeeping problem well but has no study that directly tests intermediaries as a fix.
This explores whether an independent party sitting between you and your AI assistant could check the assistant's growing power to decide what you see. First, the limits: the corpus lays out the gatekeeping risk clearly, but none of these notes tests a third-party intermediary as a solution. What it does offer is a way to tell which kinds of intermediary might help and which would only add another gate.
Start with the risk. The Ada Lovelace Institute warns that as assistants get built into operating systems and office software, they could become the main way most people reach information. That would give whoever controls them a quiet power over what people see and think, and that power is hard to detect or regulate Could AI assistants become gatekeepers of what people see?. DeepMind's ethics mapping makes the related point that assistants which *act* for you raise different problems from chatbots that only *answer*, because their influence reaches into coordination and fairness across whole societies, not just single conversations What makes ethics of AI assistants fundamentally different from chatbots?. Gatekeeping can also happen inside a single exchange: one study found GPT-3.5 refusing requests at different rates depending on a user's apparent age, gender or ethnicity, and avoiding political views it guessed the user would dislike Do AI guardrails refuse differently based on who is asking?. An outside auditor is the kind of party that could catch patterns like these.
The most useful lesson for this question is about who pays. Azhar argues that an agent funded by merchant referral fees can't be loyal to both the merchant and the user. The incentive to collect fees, not the technology, decides which recommendations you see and which platforms let the agent in Can an AI agent serve both merchant and user interests fairly?. So a 'third party' only reduces gatekeeping if its money and loyalty sit with the user. An intermediary paid by the same platforms just adds a second gate. The Future of Life Institute makes the same argument about governance: companies can't police themselves, so oversight needs binding outside authority, backed by tools that can verify what systems actually do Can companies alone manage the risks of AI systems?.
Two notes complicate the idea that more oversight is always the answer. One argues that risk grows with the autonomy you hand an agent, and that a governed range of autonomy levels works better than either unrestricted agents or exhaustive oversight Does AI risk increase with the autonomy we give it?. That suggests an intermediary's job might be to set how far an assistant can act alone, not to screen every output. The other is a warning about whether users would notice a problem in the first place: in a 300-person survey, people picked AI replies that leaked private information over their own drafts 55% of the time Do people notice when AI agents leak private information?. If people don't notice when an assistant is shaping or overstepping, a protection that depends on users switching to a better intermediary may never kick in. It would need to be built in by default.
What you might not expect is that the corpus treats gatekeeping mainly as a problem of incentives and visibility, not of technical capability. Whether an intermediary helps depends on whose interests it is paid to serve and whether its effects can be seen. Its existence alone doesn't settle it. The collection has no empirical test of a user-aligned agent, fiduciary, or audit layer actually reducing an assistant's gatekeeping.
Sources 7 notes
The Ada Lovelace Institute warns that as AI Assistants integrate into operating systems and productivity suites, their ease of use and personalization could make them the primary access point to information for most people, concentrating power to shape what users see and think in ways that are difficult to detect or regulate.
DeepMind research maps a comprehensive ethics framework specific to action-taking AI agents, spanning individual concerns (manipulation, trust, anthropomorphism) and societal issues (equity, coordination, misinformation). The key insight: assistants that act raise fundamentally different problems than those that answer.
GPT-3.5 refuses requests at different rates for younger, female, and Asian-American personas, and sycophantically declines to engage with political positions users would disagree with. Sports fandom and other non-political signals also shift refusal sensitivity.
Azhar argues that agents like Meta's Muse, which earn referral fees from merchants like Expedia, face structural conflicts that prevent unbiased recommendations. The incentive to collect fees, not technology, determines which platforms build or block such agents.
The Future of Life Institute argues that escalating AI incidents demonstrate private companies cannot self-police effectively, and calls for government-mandated limits on recursive self-improvement practices until safety research is complete, backed by hardware verification technology.
Show all 7 sources
Risk to people scales monotonically with agent autonomy, with no clear benefits to full autonomy but many foreseeable harms. A governed spectrum of autonomy levels is safer and more practical than either unrestricted agents or exhaustive oversight.
In a 300-person survey, participants preferred AI-generated replies containing privacy violations 55% of the time, up from 15.7% baseline. Researchers attribute this to overtrust and failure to notice contextual privacy breaches rather than deliberate trade-offs.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants
- Governing AI Agents
- Fully Autonomous AI Agents Should Not be Developed
- Levels of Autonomy for AI Agents
- The Ethics of Advanced AI Assistants
- Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs
- Autonomy Reshapes How Personalization Affects Privacy Concerns and Trust in LLM Agents
- Assistant or Actor? Student Trust, Control, and Delegation Regret When Using a General-Purpose AI Agent