Does careful AI use actually protect against reshaping your judgment?
Sacasas challenges the assumption that intentional, vigilant use of AI prevents cognitive changes. The question asks whether diligence can counteract the perceptual shifts that happen beneath conscious awareness.
Sacasas opens flatly: "Your AI is not a tool. It is an environment, and you are in it." He is arguing against the common defense that "technology is just a tool — what matters is what we do with it," a framing he calls "the numb stance of the technological idiot" when borrowed from McLuhan. His claim is that AI "envelops the user and works on us from the inside out while we naively think that we remain unchanged by our use so long as we are using it carefully and intentionally. The care and intentionality is beside the point." He backs this with a reported observation from inside a 600,000-person company: "The teams using AI most carefully are the ones losing the ability to tell a good option from a merely safe one. The malformation doesn't skip the diligent. It recruits them" — plus a parallel anecdote from a computer scientist who could "feel the subtle shifts in his own awareness and judgment" while watching the same thing happen to junior colleagues.
The mechanism he gives is McLuhan's medium theory, not a claim about AI's content or accuracy: "the content... is like the juicy piece of meat carried by the burglar to distract the watchdog of the mind," and technology's "effects... do not occur at the level of opinion or concepts, but alter sense ratios or patterns of perception steadily and without any resistance." He extends this with Illich, for whom tools "shape our mind" beneath the level of what we use them for, and whose proposed remedy was not information literacy but an "asceticism... of a sensual praxis" — a disciplined retraining of perception that Illich explicitly linked to the capacity for friendship. Sacasas also cites Charley Johnson's critique of advice to use AI as "a researcher, tutor, and editor at your side": "the medium is doing the work, not the information — which is why you can turn down every suggestion and still end up somewhere you wouldn't have reached alone, feeling the whole time like you walked there on your own two feet." His proposed response is accordingly "not media literacy in a cognitivist mode" but "the training of our perception in an ascetical mode."
This cuts against the vigilance framing in Does AI assistance weaken our brain's ability to think independently?, where a cited survey resolves augmentation-vs-atrophy by saying the outcome "turns on permanent cognitive vigilance." Sacasas's anecdote reports the opposite: the most careful, diligent users were the ones losing judgment fastest, which would make vigilance a thing the environment recruits rather than a lever that controls the outcome. His environment framing also supplies a mechanism for Does AI reshape expert work into knowledge management?: if the shift from creation to curation happens "gradually and almost invisibly," as that note puts it, Sacasas's claim is that this is not a choice experts are making badly but a perceptual reshaping happening beneath the level of choice altogether — which also fits that note's observation that junior workers entering the custodial era never build the reservoir of judgment that older experts have.
The excerpt does not establish any of this empirically — its evidence is one unnamed reader's report from inside a large company, one lunch conversation, and two essays by other writers, not a study of malformation or a test of whether careful use in fact fails to protect users. The McLuhan and Illich citations are analogy and authority, not measurement, and the piece does not specify what "ascetical" perception-training would consist of or whether it would work. The claim is best read as a strong reframing hypothesis — AI as environment, not instrument — that would, if right, explain why vigilance-based remedies in the AI-and-cognition literature keep falling short, rather than as itself a demonstrated mechanism.
Related concepts in this collection 4
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Does AI assistance weaken our brain's ability to think independently?
Can using language models for cognitive tasks reduce neural connectivity and learning capacity? New EEG evidence tracks how external AI support may systematically degrade our cognitive networks over time.
that note's vigilance-dependent framing is the claim Sacasas's diligent-users-malformed-too anecdote contradicts
-
Does AI reshape expert work into knowledge management?
As AI generates knowledge at scale, does expert work shift from creating new understanding to curating and validating machine outputs? This matters because curation and creation demand different cognitive skills.
Sacasas's environment framing supplies a perceptual mechanism for the "gradual and almost invisible" custodial shift that note describes
-
Can an AI summary substitute for actually reading a book?
DeLong tested whether an AI-generated conspectus of a book could replace the cognitive experience of reading it. He spot-checked the output for accuracy and found it close enough to enable convincing discussion of the book's contents.
Evidence for: even careful, hallucination-checked AI use left DeLong unsure he'd gained real knowledge, as Sacasas's claim predicts
-
Is AI's real danger superintelligence or loss of oversight?
Sacasas challenges the conventional framing of AI risk. Rather than fearing superintelligent machines, should we worry about delegating civilizational processes to an unsupervised layer of action beyond human judgment?
qualifies: B specifies the mechanism of A's claim, naming agentic delegation and loss of conscious civilizational oversight as the specific danger
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Your AI Is Not a Tool
- GenAI as a Power Persuader: How Professionals Get Persuasion Bombed When They Attempt to Validate LLMs
- Lessons from a Chimp: AI "Scheming" and the Quest for Ape Language
- How AI Can Degrade Human Performance in High-Stakes Settings
- Automation Bias in AI-Assisted Medical Decision-Making under Time Pressure in Computational Pathology
- Mechanisms of Introspective Awareness
- Sycophancy Towards Researchers Drives Performative Misalignment
- The Impact of Artificial Intelligence on Human Thought
Original note title
Sacasas argues AI is an environment that works on users from the inside rather than a tool they pick up and put down