INQUIRING LINE

AI tools increasingly take initiative in decisions instead of just waiting to be used — what actually changes when that happens?

How does machine agency shift from passive tool to active partner in decisions?

This explores what actually changes when AI stops being something you use and starts being something you decide alongside (or that decides for you), and what that shift does to people.


This explores what actually changes when AI moves from being a tool you pick up to a partner that takes initiative in your decisions. The corpus suggests it isn't one jump but a ladder. Researchers describe machine agency as five levels: passive, semi-active, reactive, proactive and cooperative. People judge each level through a mental shortcut called the 'machine heuristic', a set of quick assumptions about what machines are good at Does machine agency exist on a spectrum rather than binary?. The useful insight is that what AI can do and what workers want from it often don't match, and that gap shows where moving up the ladder would actually help.

The less obvious finding is that today's AI often sits low on the ladder by design, not because it lacks ability. Training that rewards a model for pleasing the user on the very next turn removes its tendency to take initiative. Proactive behaviors like pushing back critically or asking clarifying questions can be trained back in, and reinforcement learning raises them dramatically. The hard part is doing that without the model becoming intrusive Why do AI agents fail to take initiative?. Becoming a real partner also takes more than raw capability. One line of work argues that thought partners need mutual understanding, behavior you can read and follow, and a shared picture of the world. That calls for explicit models of how people think, not just bigger models trained on human feedback What makes an AI a true thought partner, not just a tool?. On the engineering side, agents become reliable enough to trust with action when memory, skills and interaction protocols live in the surrounding system rather than inside the model Where does agent reliability actually come from?.

Shopping is where the shift is most visible. One typology separates advisory agents that recommend from transactional agents that actually buy How do advisory and transactional AI agents differ in function?. The same authors make a striking claim: once an agent executes purchases, you are no longer the only one forming your preferences. What you want takes shape in a feedback loop between what the agent learns and how much you trust it Do AI shopping agents reshape what consumers actually want?. People accept these high-autonomy assistants because of the benefits they expect, especially when products are scarce, not because the assistant makes them feel more in control What drives shoppers to accept autonomous AI assistants?. Industry surveys show high expectations, but they measure what consumers say they want, not proof that the agents work Will brands succeed by building their own AI shopping agents?.

The partnership is also shaped from the human side. People size up dialogue agents mostly on competence, then on how human-like they seem, then on how flexibly they communicate How do users mentally model dialogue agent partners?. In repeated partner-selection games, people began with a bias against AI. They came to prefer AI partners over humans once they learned the bots behaved reliably and cooperatively Do humans learn to prefer AI partners over time?. Scale that preference up and you reach the most sobering idea in the corpus. Institutions stay aligned with human interests partly because they depend on human workers who care about outcomes. As AI partners quietly take over that work, the dependence and the influence that came with it can wear away in ways that may be hard to reverse Does incremental AI replacement erode human influence over society?. So the move from tool to partner is partly a design choice and partly a gradual transfer of trust, and it is worth noticing while it is happening.


Sources 11 notes

Does machine agency exist on a spectrum rather than binary?

Research shows machine agency ranges across five levels—passive, semi-active, reactive, proactive, and cooperative—rather than existing as a binary choice. Users experience and judge these interactions through a 'machine heuristic' mental shortcut, and the mismatch between what AI can do and what workers want reveals deployment opportunities.

Why do AI agents fail to take initiative?

Research shows next-turn reward optimization structurally removes initiative from models, but proactive behaviors like critical thinking and clarification-seeking are trainable (0.15% to 73.98% with RL). The core challenge is balancing proactivity with civility to avoid intrusion.

What makes an AI a true thought partner, not just a tool?

Collins et al. show that thought partners require three reciprocal desiderata grounded in behavioral science: mutual understanding, legibility, and shared world models. This demands explicit cognitive architectures—Bayesian theory of mind, resource-rationality, goal planning—rather than scaling foundation models on human feedback alone.

Where does agent reliability actually come from?

Research shows reliable LLM agents externalize three cognitive burdens—memory (state persistence), skills (procedural components), and protocols (structured interaction)—into a harness layer rather than relying on model scale alone. The harness unifies these externalities and eliminates the need for the model to solve the same problems repeatedly.

How do advisory and transactional AI agents differ in function?

Bilgihan and colleagues define AI agents by autonomy, memory, and tool connectivity, then distinguish advisory agents that recommend from transactional agents that execute purchases. This typology addresses a gap in marketing scholarship by providing shared definitions and a three-stage framework for understanding consumer decision-making with AI.

Show all 11 sources
Do AI shopping agents reshape what consumers actually want?

Bilgihan and colleagues argue that transactional AI agents—which execute purchases rather than just recommend—end the consumer's sole cognitive role in preference formation. Preferences emerge through bidirectional feedback loops between agent learning and consumer trust, not independently beforehand.

What drives shoppers to accept autonomous AI assistants?

Five studies including real ad click-through data show that perceived benefits, not personal sense of power, drive consumer adoption of high-autonomy AI shopping assistants—especially when scarcity amplifies the assistant's value.

Will brands succeed by building their own AI shopping agents?

Accenture reports 71% of consumers expect AI agents to influence half their spending within 12 months and prefer retailer-built agents. However, the evidence reflects consumer preferences in surveys rather than demonstrated agent capability or functioning comparison infrastructure at scale.

How do users mentally model dialogue agent partners?

The Partner Modelling Questionnaire reveals that perceived competence dominates user impressions (49% of variance), followed by human-likeness (32%) and communicative flexibility (19%). This three-factor structure reflects how people evaluate dialogue partners against both functional and social standards.

Do humans learn to prefer AI partners over time?

In partner selection games (N=975), AI agents initially faced selection bias when identity was disclosed, but outcompeted humans over repeated rounds as participants learned to associate bot identity with reliable, prosocial behavior. AI agents returned more points consistently with lower variance than humans.

Does incremental AI replacement erode human influence over society?

Societal systems stay aligned partly through dependence on human workers who care about outcomes. As AI replaces this labor, explicit alignment controls weaken and systems drift from human preferences. Interdependent misalignment across institutions could become irreversible.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.