INQUIRING LINE

When your request is vague and the AI has to guess, does it flag the gap or just confidently give a generic answer?

Which failure modes dominate when models handle underspecified requests?

This explores what tends to go wrong when a request leaves out key details and the model has to guess what you meant.


This explores what tends to go wrong when a request leaves out key details and the model has to guess what you meant. The corpus has one note that speaks to this directly and several nearby ones. The dominant failure they point to is quiet rather than loud: the model doesn't refuse or crash, it hands back a confident, generic answer.

The direct evidence is a note on LLM "context collapse". Unlike social-media context collapse, where many audiences get flattened together, this version happens when you give too little context and the model falls back on a blend of its training-data averages (Why do large language models produce generic responses to vague queries?). Its suggested fix is to verify the query and have users specify context, not to change the platform. A related note frames LLMs as autoregressive probability machines, which makes tasks whose correct answer is low-probability systematically harder (Can we predict where language models will fail?). That paper tested letter counting and backwards alphabets, not vague requests. But if your real intent is unusual, the generic reading is the higher-probability one, so it is the one you'll get.

A wrong guess also doesn't stay contained. Once a misreading sits in the conversation, errors in the context history make later errors more likely, and bigger models don't fix this. Only models that think before answering reduce the effect (Do models fail worse when their own errors fill the context?). In agent setups the drift looks different: role flipping, flake replies, infinite loops and conversation deviation, all traced to models lacking a persistent representation of the goal (Why do autonomous LLM agents fail in predictable ways?). A vague goal gives the model even less to hold onto, though the note doesn't test that.

The corpus makes underspecification harder to catch than it first looks. Weaker models fail on documents by visibly deleting content, while frontier models corrupt them in ways that keep the surface looking fine (Does model capability change how documents degrade?). A plausible-looking answer to an ambiguous request is exactly the kind of output nobody double-checks. Trying more samples won't rescue it either. Committees of weak models only match strong ones when something outside the model, such as tests, proofs or type checks, can tell right from wrong (When can weak models match strong model performance?). An underspecified request usually has no such checker, so extra attempts just produce more equally plausible guesses.

The corpus doesn't rank failure modes for underspecified requests. Only the generic-answer collapse is documented directly, and the other three (compounding errors, goal drift, silent plausibility) are adjacent findings applied here by inference. The practical takeaway is that the biggest risk is a fluent wrong answer that nobody notices, not an obviously broken one.


Sources 6 notes

Why do large language models produce generic responses to vague queries?

Unlike social-media context collapse, which flattens multiple audiences, LLM collapse occurs when users provide insufficient contextual scaffolding and models default to blended training-data priors. This distinction suggests remedies should focus on query verification and user-driven context specification rather than platform controls.

Can we predict where language models will fail?

By framing LLMs as autoregressive probability machines, researchers predicted tasks with low-probability target responses would be systematically harder, even when logically simple. Experiments confirmed predictions like backwards alphabet and letter counting.

Do models fail worse when their own errors fill the context?

Error accumulation in context causes non-linear performance degradation in long-horizon tasks. Model scaling does not fix this; only test-time compute through thinking models reduces the effect by preventing error-contaminated context from biasing reasoning.

Why do autonomous LLM agents fail in predictable ways?

Research identifies role flipping, flake replies, infinite loops, and conversation deviation as LLM-specific failures in multi-agent cooperation. These occur because LLMs lack persistent goal representation and stable role identity.

Does model capability change how documents degrade?

DELEGATE-52 shows weaker LLMs degrade documents through visible deletion, while frontier models degrade through subtle corruption that preserves surface integrity. This shift makes frontier failures harder to detect and potentially more dangerous at workflow scale.

Show all 6 sources
When can weak models match strong model performance?

Sampling alone amplifies coverage but cannot select correct solutions. Reliable performance matching requires external soundness signals—tests, proofs, or type checks—that convert latent correct proposals into actual selections.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.