INQUIRING LINE

Should an AI describe its world in its own words, or fill in a fixed form, when every world is different?

What makes open-schema state representation better than fixed schemas for diverse worlds?

This explores why letting an AI describe the state of its world in free-form terms (an open schema) might beat forcing it into predefined fields (a fixed schema) when the environments vary a lot.


This explores why letting an AI describe the state of its world in free-form terms (an open schema) might beat forcing it into predefined fields (a fixed schema) when the environments vary a lot. The corpus has no note that runs this exact head-to-head, so the evidence below is indirect. It points one way, and the case for open schemas is a well-motivated hypothesis here, not a measured result.

The closest evidence is a world model that keeps its state in plain language. Qwen-AgentWorld predicts the next state of an environment in natural language, trained on more than 10 million agent trajectories. It beat training in the real environments on three benchmarks and transferred across seven domains (Can language models learn to simulate agent environments?). The note doesn't say the format caused the transfer. Still, one representation covering seven different worlds is what a fixed schema struggles to do, because a web page, a shell session and a game each need different fields. An open format means nobody has to decide up front which fields matter.

The corpus also shows why deciding up front is risky. A state whose shape is fixed before the data arrives can't hold what it didn't anticipate. Transformers provably beat state-space models at copying and retrieving from context because state-space models squeeze everything into a fixed-size state, while transformers keep the raw context to query later (Can state-space models match transformers at copying and retrieval?). The same limit shows up in safety. Per-action checks can't state a rule like "these two individually fine actions are not fine together," because their state has no place to record history (Can stateless checks ever catch sequence-level constraint violations?). Whatever the state format leaves out, you can't ask about later.

The complication is that structure isn't the villain. DeepAgent folds its history into episodic, working and tool memory schemas, and that structure saves tokens and lets the agent pause and rethink. What prevents degradation is that the agent chooses when and what to fold, so structure and autonomy work together (Can agents compress their own memory without losing critical details?). The problem is a designer freezing in advance what counts as important. Two other notes show the alternative of deciding what matters when the question arrives. One is an agent that reconstructs memory by walking a graph guided by evidence, gaining up to 23% over fixed retrieval pipelines (Can agents reconstruct memory on demand instead of retrieving it?). The other is a layered harness that keeps disk-backed history addressable so later steps can pull out what they need (Can external state caches let models solve harder problems?).

The pattern is that an open schema postpones the question of what matters until the world shows up, which is why it fits diverse worlds. The corpus doesn't measure the cost: free-form state is harder to check, compare or constrain than a typed field. Whether the flexibility is worth that is still untested in these notes.


Sources 6 notes

Can language models learn to simulate agent environments?

Qwen-AgentWorld demonstrates that native language world models trained via next-state prediction on 10M+ trajectories outperform real-environment training on three benchmarks and transfer across seven domains, positioning next-state prediction as a foundation objective for agents.

Can state-space models match transformers at copying and retrieval?

Two-layer transformers can copy exponentially long strings while state-space models are fundamentally limited by their fixed-size latent state. Empirically, transformers dramatically outperform SSMs at copying and context retrieval in both synthetic and pretrained settings.

Can stateless checks ever catch sequence-level constraint violations?

Per-action checks are structurally unable to state constraints that depend on prior history. Only stateful monitors tracking composed multi-party behavior can verify the behavioral envelopes that prevent individually permissible actions from collectively violating system-level safety.

Can agents compress their own memory without losing critical details?

DeepAgent's autonomous memory folding consolidates interaction history into episodic, working, and tool memory schemas. This reduces token overhead while letting agents pause to reconsider strategies—the autonomy and structure together avoid degradation that plagues poorly designed consolidation.

Can agents reconstruct memory on demand instead of retrieving it?

MRAgent achieves up to 23% gains on reasoning tasks by reconstructing memory through active graph traversal that prunes paths based on accumulated evidence, while reducing token and runtime cost compared to fixed-retrieval pipelines.

Show all 6 sources
Can external state caches let models solve harder problems?

Prime Agent organizes persistent state in four levels (weights, context, persistent REPL plus subagents, disk-backed history) to let models read and write addressable state beyond their instruction stream. The approach isolates harness failures from model failures and reported gains on ARC-AGI-3, though specific components remain unablated.

Papers this line draws on 8

The research behind the notes this line reads — ranked by how closely each paper relates.