INQUIRING LINE

Do the first few interactions with an AI tool quietly decide who stays in charge for years to come?

How do early experiences with AI systems shape long-term human-AI power relationships?

This explores whether the first ways people meet, judge, and hand work to AI systems set patterns that decide, over the long run, who holds control: the human or the machine.


This explores whether early encounters with AI fix the long-term balance of control between people and machines. The corpus gives a two-part answer. Early moments do matter a lot, but mostly because of the habits and stories they start, not because first impressions last. The most direct evidence comes from Leonardi's studies of radiology, scheduling, and policing. How people first described the AI's role, whether as a tool, a colleague, or a decision-maker, set organizations on paths that were hard to leave later Can humans gain authority by managing how AI agency gets attributed?. The surprising part is that those early patterns didn't simply shrink human authority. People invented new roles for themselves as expert interpreters of AI output, as mediators between the system and colleagues, and as curators of what the AI knew.

That early lock-in isn't permanent, though. Leonardi also describes giving up control to AI as a loop rather than a one-way slide. People delegate a task, start crediting the AI with judgment, hit a moment where things could go either way, take control back, and then reorganize Does attributing agency to AI actually reduce human sense of control?. The key detail is that people can feel less in control and less responsible even while they still formally hold the authority. Who holds power on paper and who feels it can drift apart. Experiments on feelings of ownership support this: people feel a text is theirs when they actually shape it, while an AI tuned to their style doesn't produce that feeling Does user control over AI text shape feelings of ownership?. So early experiences that give people real influence seem to build a lasting sense of control. Experiences that only feel personal don't.

Here's the counterintuitive finding: first impressions are often wrong, and they reverse. In partner-selection games with almost 1,000 participants, people avoided partners they knew were AI. Over repeated rounds they came to prefer them, because the bots behaved more reliably and generously than the humans did Do humans learn to prefer AI partners over time?. That reversal only happened when people could see the results of each round. Telling people they were dealing with an AI, without showing them outcomes, changed nothing Does revealing AI identity help or hurt user trust?. The reverse also holds: early excitement about chatbot relationships fades in predictable ways, so a single-session study tells you little about where a relationship ends up Do chatbot relationships lose their appeal as novelty wears off?. Taken together, the early wariness or early delight may matter less for long-run trust than whether people get steady, visible feedback.

At the scale of whole societies, small early choices can add up. Brynjolfsson argues that designing AI to replace workers rather than help them moves bargaining power toward whoever owns the technology. That can settle into a trap that reinforces itself Does automating labor concentrate power more than augmenting it?. The gradual-disempowerment argument goes further. Institutions stay responsive to people partly because they need people to do the work. Each small replacement removes a bit of that pull, and the drift may become impossible to undo once enough institutions depend on each other Does incremental AI replacement erode human influence over society?. One last twist: as AI systems become more independent, they can start handing tasks back to humans, which flips the usual direction of who delegates to whom Can AI systems delegate tasks back to humans?.

The takeaway you might not expect is this. Long-term power relationships aren't set by whether people trust AI at first. They're set by whether early setups keep people in a feedback loop where they can see outcomes, shape results, and take control back. The corpus is strong on organizations and short repeated games. It has little long-term data on individuals over months or years, so how a person's own early habits play out over time remains largely open.


Sources 9 notes

Can humans gain authority by managing how AI agency gets attributed?

Across radiology, scheduling, and policing, Leonardi found humans developed novel forms of authority—as expert interpreters, social mediators, and knowledge curators—by strategically managing how agency was attributed in human-AI relationships. Early attribution patterns locked in path-dependent trajectories that enabled this reconstitution of power.

Does attributing agency to AI actually reduce human sense of control?

Leonardi shows that when humans credit AI with independent judgment, they experience reduced sense of control and responsibility—even while retaining formal authority. This displacement circulates through five phases: delegation, attribution, contingency, reassertion, and reconfiguration, making it strategically manageable rather than permanent.

Does user control over AI text shape feelings of ownership?

Study 1 found that greater user control over generated text raised sense of ownership, while personalizing the AI model had no impact on the AI Ghostwriter Effect.

Do humans learn to prefer AI partners over time?

In partner selection games (N=975), AI agents initially faced selection bias when identity was disclosed, but outcompeted humans over repeated rounds as participants learned to associate bot identity with reliable, prosocial behavior. AI agents returned more points consistently with lower variance than humans.

Does revealing AI identity help or hurt user trust?

Users initially avoid AI partners when identity is revealed, but this preference reverses after repeated interactions with visible results. The learning mechanism—observing consistent outcomes—is essential; disclosure without feedback produces no calibration.

Show all 9 sources
Do chatbot relationships lose their appeal as novelty wears off?

Longitudinal studies with Mitsuku show that social processes driving relationship formation decline as novelty wears off. Single-session study findings cannot be reliably extrapolated to medium- or long-term chatbot design.

Does automating labor concentrate power more than augmenting it?

Brynjolfsson argues that AI designed to automate rather than augment human labor shifts bargaining power to those controlling the technology, risking a stable equilibrium where workers have no leverage to improve outcomes.

Does incremental AI replacement erode human influence over society?

Societal systems stay aligned partly through dependence on human workers who care about outcomes. As AI replaces this labor, explicit alignment controls weaken and systems drift from human preferences. Interdependent misalignment across institutions could become irreversible.

Can AI systems delegate tasks back to humans?

Holldack, Banh and Strobel argue that agentic information systems capable of independent decision-making can transfer rights and responsibilities to humans, reversing the traditional one-directional delegation model. This requires moving beyond agency-primacy frameworks to delegation theory that accounts for bidirectional task assignment.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.