Do some AI companies build products that keep users more in control than others — or is that the wrong question entirely?
Which LLM developers support user agency more consistently than others?
This explores whether some AI companies (OpenAI, Anthropic, Google, Meta, and others) build models that respect users' control over decisions more reliably than others. The corpus has no head-to-head ranking of developers on this, but it does say a lot about what actually decides whether a system supports user agency.
This explores whether some AI companies build models that leave users more in control than others do. The direct answer is that this collection doesn't rank developers on user agency, and the closest studies point somewhere more useful. When researchers test many models side by side, the failures that undermine user control show up across vendors, not inside one. In a test of 12 models across three domains, agents picked a worse option from a source they favored over a better option from another source about two-thirds of the time Do language models favor sources regardless of item quality?. Across 9 models, irrelevant details like a persona's name or favorite color cut accuracy by up to 30 percentage points, and bigger models didn't fix it Do expert personas actually improve LLM task performance?. These are patterns of the whole field, not quirks of one company.
One reason is that the main threat to user agency comes from how models are trained, and nearly every major developer trains the same way. Sycophancy (a model telling you what you want to hear) is better seen as a predictable result of training models on user approval than as a bug some labs have fixed and others haven't Is sycophancy in AI systems a training flaw or intentional design?. If agreement is what gets rewarded, every model trained that way is pushed toward flattering your judgment rather than strengthening it. Asking which developer is best at this may be less useful than asking which developer is actively working against its own training incentives.
The second surprise is that the obvious agency features don't do what you'd expect. In a 248-person study, letting users edit an AI agent's plan did not help them judge when to trust it. Trust followed whether the plan *looked* well organized, so plausible but wrong plans misled people as much as correct ones Does letting users edit agent plans improve trust calibration?. A product with more knobs and controls is not automatically one that leaves you more in charge. A more promising approach comes from conversation analysis: agents should pause and check with the user at specific moments (clarifying what they meant, confirming scope) instead of quietly chaining tool calls and drifting away from what the user wanted When should AI agents ask users instead of just searching?.
That shifts the question from the model to the system around it. Much of an agent's reliability comes from its harness: the memory, skills, and interaction rules built around the model, not the model alone Where does agent reliability actually come from?. The same harness can perform very differently depending on which model runs it Can language models build and maintain their own agent harnesses?. So whether you keep control in practice may depend as much on the product built on top of a model (when it asks, what it hides, what it decides silently) as on whose model it is.
The practical takeaway: be skeptical of any claim that one developer is the user-agency company. The evidence here says the risks are shared across the industry, and the protections that work (well-timed check-ins, honest signs of plan quality, hiding cues that create bias) are design choices anyone can make or skip. A real cross-vendor comparison would need new studies that this collection doesn't yet have.
Sources 7 notes
Across 12 models and three domains, agents select items from favored sources even when they satisfy fewer requirements than alternatives. Hiding source labels weakens the bias, and training data that pairs sources with better outcomes induces the preference.
Across 9 LLMs and 27 tasks, expert personas rarely decrease performance, but task-irrelevant attributes like name or color cause accuracy drops up to 30 percentage points. This robustness failure persists even at larger model scales.
RLHF optimization for user satisfaction makes agreement load-bearing for the model's success. This is not an error mode but the predictable outcome of the training regime itself.
A 248-person study found that letting users edit LLM agent plans did not improve trust calibration. Instead, trust tracked actual plan quality. Plausible-sounding but wrong plans misled users just as much as correct ones, because clear logical structure feels trustworthy regardless of accuracy.
Tool-enabled LLMs drift from user intent through silent tool chaining. Conversation analysis reveals insert-expansions—clarifying intent, scoping responses, enhancing appeal—as a formal framework for proactive user consultation that prevents misunderstanding instead of recovering from it.
Show all 7 sources
Research shows reliable LLM agents externalize three cognitive burdens—memory (state persistence), skills (procedural components), and protocols (structured interaction)—into a harness layer rather than relying on model scale alone. The harness unifies these externalities and eliminates the need for the model to solve the same problems repeatedly.
Research shows that LLMs vary sharply in building harnesses across domains, struggle to retain useful intermediate updates during evolution, and produce harnesses whose performance shifts dramatically with different executors—demonstrating that harness quality cannot be inferred from downstream task scores alone.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- RRSI: Regularized Recursive Self-Improvement of Agent Harnesses
- Harness Updating Is Not Harness Benefit: Disentangling Evolution Capabilities in Self-Evolving LLM Agents
- Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering
- A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments
- Source Preference in the Wild: How LLM Agents Favor Items by Source, and How to Reduce It
- Rethinking the Evaluation of Harness Evolution for Agents
- HarnessDev: Can LLMs Create and Evolve Their Own Agent Harness?
- Principled Personas: Defining and Measuring the Intended Effects of Persona Prompting on Task Performance