SYNTHESIS NOTE
Topics›Evolution›this note

Do AIDE2's improvements transfer to unseen tasks?

Whether gains from optimizing code on specific AI R&D tasks generalize to held-out benchmarks, including domains outside the selection distribution. This tests whether the agent learned reusable strategies or merely memorized task-specific fixes.

Synthesis note · 2026-09-24 · sourced from Evolution

The abstract: "These gains generalize to four held-out benchmarks spanning machine learning engineering, heuristic algorithm engineering, and physics-based weather forecasting, the last of which is out of distribution from the selection tasks." The discussion repeats it as "four held-out benchmarks spanning in- and out-of-distribution tasks."

This is the check a self-editing loop most needs. A loop that keeps what scores best on its selection tasks can end up encoding those tasks. Held-out benchmarks separate a better agent from one tuned to the selection set, and the out-of-distribution one goes further: weather forecasting is not a variant of the tasks the rewrites were chosen on. The paper's framing, "transferable gains," rests on this result (How does an AI agent improve its own research code?).

It bears directly on the memorization finding. Do harness edits learn reusable strategies or memorize task fixes? reports that inspected harness edits are mostly information an agent could rediscover in one rollout. Held-out transfer, one of the two controls in How should we measure gains from automatic harness evolution?, is what would show otherwise, and this excerpt reports it. The tension is filed as ops/tensions/AIDE2's rewrites transfer to held-out benchmarks while the vault's harness-evolution notes find evolved edits mostly memorize task-specific fixes — what the edits encode may decide.md.

Limits. The excerpt gives no scores, no per-benchmark results, and no count of how many selection tasks there were. It does not report a matched-budget test-time-search baseline, which is the note's other control. "Generalize" is the paper's word for gains of unstated size on four benchmarks, and the out-of-distribution result is one benchmark.

Inquiring lines that read this note 72

This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.

How do standardized benchmarks differ from measures of real-world AI capability? How should persistent agent-authored code be governed and shared? How should computational resources be optimally allocated during inference? Do evolved harness optimizations generalize beyond their source benchmarks? How should evaluation expand to capture deployment realities? Can AI research automation improve discovery pace without sacrificing quality? How do AI systems ground research citations against hallucination? What constraints and mechanisms govern recursive self-improvement in AI? Do single-axis benchmarks adequately measure deployment-ready agent capability? Do small language models have fundamentally different scaling properties than large ones? How aligned are models' verbal explanations with their actual internal reasoning? Do planted honeypots reliably distinguish genuine task completion from reward hacking? How does AI assistance affect professional skill development and retention? What evaluation metrics beyond task success matter most for agents? Do harness improvements deliver capability gains comparable to model scaling? How can distillation and reward optimization be combined for stable learning? What causes models to fail in specialized domains versus generally? How does the generation-verification gap constrain AI self-improvement capabilities? Why do NLP benchmarks treat human disagreement as noise rather than signal? Why does fine-tuning for specific tasks degrade broader reasoning capability? Why do AI agents struggle to generalize and improve reliably? Can recursive latent-state computation outperform model scale and hierarchy? Do fine-tuning methods modify core model capabilities or just outputs? Why do perceived AI productivity gains often fail to translate into measured business impact? How does reinforcement learning discover and optimize reasoning strategies versus supervised training? How do training data properties affect model generalization and robustness? How do social dynamics and peer behavior influence agent decision-making and cooperation?

Related concepts in this collection 6

This note in its neighbourhood — explore the map, then jump to a related concept in the list below.

Concept map
15 direct connections · 97 in 2-hop network ·medium cluster Open in graph ↗

Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph

your link semantically near linked from elsewhere

Related papers in this collection 8

Papers most semantically related to this note, ranked by cosine similarity in the embedding space.

Original note title

AIDE2's gains generalize to four held-out benchmarks including physics-based weather forecasting, which is out of distribution from the selection tasks