INQUIRING LINE

When you use AI to get work done, do you actually get better at it, or just borrow its skill?

Does AI assistance help people learn skills or just delegate the task?

This explores whether working with AI leaves you with skills you keep, or whether it just gets the task done while you stay the same.


This explores whether working with AI leaves you with skills you keep, or whether it just gets the task done while you stay the same. The corpus leans toward delegation. In one study, workers using generative AI did much better on content tasks, but when they did similar tasks alone afterward, they showed no improvement Does AI assistance help workers learn lasting skills?. Another line of research calls this an 'exoskeleton'. You produce skilled-looking work while the AI is present, then drop back to baseline when it's removed Does AI assistance build lasting skills or temporary abilities?.

The likely cause is what the AI takes over. Learners without AI ran into more errors and fixed them on their own, and they retained more skill. AI-assisted learners handed debugging to the AI, and those who debugged most with AI scored lowest on skill tests Does AI assistance remove a core learning channel through error work?. But the tool alone doesn't decide the outcome. In a randomized trial of developers learning a new library, six ways of using AI split into two groups. Three low-engagement patterns scored 24-39% on a quiz. Three that included active comprehension steps scored 65-86% Does AI assistance actually harm the way developers learn?. It's the same tool, and what changes is whether you're still doing the thinking.

The timing matters too. AI productivity gains show up when people apply skills they already have. When workers used AI to learn something new, the gains disappeared and learning suffered When does AI actually boost worker productivity?. So AI tends to amplify what you know, and it's weakest at the moment you're trying to acquire something.

Most people don't expect the next part: you probably can't feel the difference. Researchers call it the LLM Fallacy. People fold fluent AI outputs into their sense of what they can do, and come to believe they have skills they don't Do AI-assisted outputs fool users about their own skills?. It's a self-perception error, separate from hallucination or over-trusting the AI. It happens whether or not the output is accurate, so making AI more accurate or forcing verification won't fix it. What helps is making clear who contributed what How does AI-assisted work reshape how people see their own abilities?. The error thrives on smooth output, because the seam between you and the machine disappears.

Even help that is correct has costs. Well-meant AI suggestions can break the cognitive immersion that reasoning depends on, and you then have to rebuild your focus Does AI assistance always help reasoning or does it carry hidden costs?. What people ask for also often differs from what the AI does. In 40% of 200,000 Bing Copilot conversations, users wanted information or writing help while the AI coached and advised Why does AI default to coaching instead of doing?. The short version: by default AI delegates the task, and it builds skill only when you keep the hard part for yourself.


Sources 9 notes

Does AI assistance help workers learn lasting skills?

Wu et al. found that workers using generative AI performed substantially better on content tasks, but when performing similar tasks independently afterward, their performance showed no improvement. The capability did not transfer across contexts.

Does AI assistance build lasting skills or temporary abilities?

Research shows AI assistance creates temporary capability extensions—workers produce skilled-looking output while AI is present but revert to baseline performance when access is removed. This differs fundamentally from true skill, which persists independently.

Does AI assistance remove a core learning channel through error work?

Research shows learners without AI encountered more errors and resolved them independently, resulting in higher skill retention. AI-assisted learners delegated debugging to AI, bypassing the cognitive work that produces learning—even those who debugged most with AI scored lowest on skill assessments.

Does AI assistance actually harm the way developers learn?

A randomized trial of developers learning new libraries showed AI use degraded conceptual understanding and debugging ability. Six interaction patterns emerged: three low-engagement patterns produced quiz scores of 24-39%, while three high-engagement patterns with active comprehension steps achieved 65-86%, suggesting the mechanism matters more than tool presence.

When does AI actually boost worker productivity?

Studies showing AI productivity gains measured tasks within workers' existing domains. When workers used AI to learn new skills, productivity gains disappeared and learning suffered, suggesting prior findings do not generalize to skill acquisition.

Show all 9 sources
Do AI-assisted outputs fool users about their own skills?

Research identifies a systematic cognitive attribution error where individuals integrate AI-generated outputs into their capability identity, believing they possess skills they don't actually have. This occurs when task output is seamless and fluent, obscuring the human-AI boundary.

How does AI-assisted work reshape how people see their own abilities?

Research shows the LLM Fallacy operates through misattribution of AI outputs to personal capability, independent of output accuracy or reliance behavior. It requires interventions that clarify human-machine contribution boundaries, not just better system accuracy or forced verification.

Does AI assistance always help reasoning or does it carry hidden costs?

Well-intentioned AI suggestions can damage reasoning performance by severing cognitive immersion, forcing users to rebuild focus before continuing. Evaluation must measure flow preservation across entire tasks, not just local suggestion accuracy.

Why does AI default to coaching instead of doing?

Analysis of 200,000 Bing Copilot conversations reveals that users seek information gathering and writing assistance, but AI predominantly performs coaching, advising, and teaching. In 40% of cases, user goals and AI actions are entirely disjoint sets, suggesting a structural training default rather than a capability gap.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.