Can agents evolve their own objectives during search?
Can an AI system treat objective design itself as a searchable variable, reformulating goals in response to optimization outcomes rather than optimizing under fixed targets?
Almost every AI-for-science agent optimizes a quantitative objective a scientist hands it, and treats that objective as fixed. SAGA (Scientific Autonomous Goal-evolving Agent) breaks that assumption with a bi-level architecture: an inner loop optimizes candidate solutions under the current objective, while an outer loop of LLM agents reads the optimization outcomes, proposes new objectives in response to observed failure modes, and — crucially — converts each proposed objective into a computable scoring function the inner loop can actually run against. Objective design stops being a one-time setup step and becomes a searched variable inside the loop.
The mechanism that makes this more than a slogan is the compilation from natural-language goal to executable score. The outer loop cannot just say "also reward safety"; it must emit code that scores it, so the inner loop can immediately exploit the revised target. That closes a feedback path from results back to goals that fixed-objective systems structurally lack.
This is a different move than self-improving agents that rewrite their own code. Since Can AI systems improve themselves through trial and error?, the DGM evolves the optimizer against a fixed benchmark; SAGA evolves the benchmark — the objective itself. And since Can decentralized teams outperform central planners in long-running science?, SAGA is one concrete answer to that note's complaint: it systematically explores the space of objectives and their trade-offs. The payoff was empirical, not just architectural — validation surfaced a structurally novel antibiotic hit with promising potency and safety.
Inquiring lines that read this note 8
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
How does objective evolution guide discovery better than fixed planning?- How does compiling natural language goals into executable code enable objective evolution?
- Can objective search escape the limitations of fixed-objective central planning?
- What makes evolving the benchmark different from evolving the optimizer itself?
- Can AI systems generate and refine their own objective functions?
- How does controlled utility evolution prevent the evaluator from becoming a new bottleneck?
- Can moving or evolving objectives prevent misalignment in discovery agents?
- How would a bi-level agent restructure objective functions during discovery?
Related concepts in this collection 3
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can AI systems improve themselves through trial and error?
Explores whether replacing formal proof requirements with empirical benchmark testing enables AI systems to successfully modify and improve their own code iteratively, and what mechanisms prevent compounding failures.
contrasts: DGM evolves the optimizer under a fixed objective, SAGA evolves the objective itself
-
Can decentralized teams outperform central planners in long-running science?
Explores whether autonomous agent teams that self-organize around competing hypotheses and share failures can achieve better experimental outcomes than centrally-planned approaches, especially under fixed research budgets.
extends: evolving objectives is a concrete escape from the fixed-objective central planner
-
Can machine feedback sustain discovery at test time?
Can LLMs paired with automated evaluators discover genuinely novel solutions through iterative refinement, rather than just generating hypotheses? This matters because it tests whether autonomous research scales beyond benchmarks to real deployed innovations.
parallel: both close a loop with executable/automatic evaluation to reach genuine discovery
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems
- Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agents
- The Red Queen Gödel Machine: Co-Evolving Agents and Their Evaluators
- Evolving Deeper LLM Thinking
- Self-Improvements in Modern Agentic Systems: A Survey
- A Survey of Self-Evolving Agents: On Path to Artificial Super Intelligence
- Accelerating Scientific Discovery with Autonomous Goal-evolving Agents
- ASI-Evolve: AI Accelerates AI
Original note title
a bi-level agent that evolves its own objective functions turns goal design into part of the discovery loop