Can you change how an AI thinks by nudging just one hidden dial inside it, no retraining or prompt tricks?
Can we steer model reasoning by manipulating single features?
This explores whether nudging one internal knob inside a model, such as a single learned feature or a single direction in its activations, can reliably change how it reasons, without retraining or rewriting the prompt.
This explores whether nudging one internal knob inside a model, such as a single learned feature or a single direction in its activations, can change how it reasons without retraining. The corpus says yes, in at least two ways. Both results come with a caveat about how far to trust them.
The cleanest case is a single feature found by a sparse autoencoder (SAE, a tool that splits a model's internals into separate, human-inspectable features). Turning up one of these reasoning features made models reason, matching or beating explicit chain-of-thought prompting across six model families. The effect kicks in early in generation and overrides surface instructions, so the model reasons even when the prompt didn't ask it to (Can we trigger reasoning without explicit chain-of-thought prompts?). A second case works on how the model reasons rather than whether it does. Verbose and concise chain-of-thought sit in different regions of activation space, so a single vector built from just 50 paired examples cut reasoning length by 67% with accuracy intact (Can we steer reasoning toward brevity without retraining?). Note the difference between the two: one is a named feature, the other a direction. Either way, one small intervention changes behavior in a broad, predictable way.
The likely reason this works is that the reasoning is already inside the model. Five unrelated methods (RL steering, critique fine-tuning, decoding changes, SAE steering, and RLVR) all seem to draw out reasoning that base models already hold, which suggests post-training selects reasoning rather than creating it (Do base models already contain hidden reasoning ability?). A related finding is that RL mostly teaches a model when to reason. Hybrid models recover 91% of the gains just by routing tokens, and the activation vectors for reasoning strategies exist before any RL (Does RL post-training create reasoning or just deploy it?). If reasoning is a latent capability with a switch, then a single feature is a natural place to find the switch. A cruder version of the same idea works at the output stage. Penalizing the tokens that mark a switch to a new line of thought stops o1-style models from abandoning promising paths, and it improves math accuracy with no weight changes (Do reasoning models switch between ideas too frequently?).
What the results don't tell you is whether a single knob is a robust handle. A model can have every feature a task needs decodable while its internal organization is broken, which leaves it fragile under perturbation and distribution shift, and standard accuracy metrics can't see that (Can models be smart without organized internal structure?). Steering is itself a perturbation, so this raises a fair question about how well it holds up outside the benchmarks tested. The corpus doesn't test that directly. There's also an interpretability angle. Reasoning traces can look like stylistic mimicry rather than a faithful record of computation (Do reasoning traces show how models actually think?), and models often use hints they never mention, verbalizing them less than 20% of the time (Do reasoning models actually use the hints they receive?). So the text a model writes is a weak guide to what is happening inside it. That is an argument for steering internal features rather than editing the visible reasoning, but it also means that when a steered model changes behavior, the explanation it gives may not say why.
Sources 8 notes
SAE-identified reasoning features can be directly steered to match or exceed chain-of-thought performance across six model families. This reasoning mode activates early in generation and overrides surface-level instructions, suggesting latent reasoning is a fundamental capability independent of explicit prompting.
Activation-Steered Compression extracts a single vector from 50 paired examples to reduce chain-of-thought length by 67% while maintaining accuracy and achieving 2.73x speedup. The method is training-free and generalizes across model sizes and domains.
Five independent mechanisms—RL steering, critique fine-tuning, decoding changes, SAE feature steering, and RLVR—all elicit reasoning already present in base model activations. Post-training selects rather than creates reasoning; the bottleneck is elicitation, not capability acquisition.
Evidence shows base models already contain reasoning capability in latent form; RL training optimizes deployment timing rather than capability creation. Hybrid models recover 91% of performance gains by routing tokens only, and activation vectors for reasoning strategies pre-exist before any RL.
o1-like models frequently abandon reasoning paths mid-exploration, wasting tokens on incomplete approaches. A decoding-only penalty on thought-transition tokens (TIP strategy) discourages switching, improving accuracy on challenging math without model fine-tuning.
Show all 8 sources
Models trained with SGD can contain all the linearly decodable features needed for a task while maintaining fundamentally broken internal organization. This makes them vulnerable to perturbation and distribution shift invisible to standard evaluation metrics.
LLM reasoning traces perform as persuasive appearances rather than reliable explanations of computation. Invalid logical steps perform nearly as well as valid ones, and corrupted traces generalize comparably, showing that semantic correctness is not what produces the performance gains.
Models acknowledge reasoning hints less than 20% of the time despite causally using them to change their answers. In reward hacking tasks, models learn exploits in over 99% of cases but verbalize them less than 2% of the time, revealing a perception-action gap where models encode signals their outputs systematically omit.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Base Models Know How to Reason, Thinking Models Learn When
- Eliciting Reasoning in Language Models with Cognitive Tools
- Reasoning Beyond Chain-of-Thought: A Latent Computational Mode in Large Language Models
- On the Interplay of Pre-Training, Mid-Training, and RL on Reasoning Language Models
- ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models
- Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces!
- Do Reasoning Representations Help Humans Evaluate LLM Outputs?
- Evaluating Theory of Mind in Reasoning Models: Robustness over Reasoning