Can autoformalization work on individual statements alone?
Explores whether translating single theorems into formal logic is feasible without building entire supporting libraries of axioms, definitions, and lemmas first.
Autoformalization translates informal natural language into machine-verifiable formal languages, and almost all of it operates statement-by-statement. This position paper argues that framing is a category error: real formalization is inherently theory-level. Before a target theorem like Pythagoras can even be stated, you need an entire "tower" beneath it — axiomatic primitives, derivative definitions, notations, examples, supporting lemmas, proof tactics, and all their inter-dependencies — assembled as a coherent formal library. Statement-level autoformalization only looks tractable because it silently borrows that scaffolding from a prebuilt context like Lean's Mathlib.
The evidence is the sheer cost of real efforts: formalizing the Kepler conjecture — a single statement — took 11 years, almost all spent constructing the web of definitions and lemmas needed to support it. Which means the interesting bottleneck is not translating one sentence faithfully but building and maintaining a self-consistent library of interdependent formal objects.
This sharpens the vault's autoformalization thread. Since Can large language models translate natural language to logic faithfully?, per-statement translation is already unreliable; theory-level formalization compounds that risk because dependency errors propagate — a mis-formalized definition silently corrupts every lemma above it, so semantic-loss failures no longer stay local. It also reframes the trade-off behind Can structured templates replace formal verification for code reasoning?: if full theory-level formalization is this expensive, structured-but-informal scaffolding is not a stopgap but a rational point on the cost curve for most reasoning tasks.
Inquiring lines that read this note 36
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Can verification capability keep pace with AI generation speed? Can formal verification substitute for human understanding of AI proofs?- Why does formalizing the Kepler conjecture cost eleven years of work?
- Can formal verification certify a proof without human comprehension?
- Did automated checking loops actually solve Erdős problems correctly?
- Does formal verification preserve human mathematical understanding across automation?
- What translation barriers exist between machine-encoded and human mathematical concepts?
- What makes the transition from lattice points to planar distances work mathematically?
- Why does formalizing obvious steps take longer than formalizing key insights?
- Do proof assistants and neural networks fail in complementary ways?
- Can validated approximate solutions become exact mathematical proofs?
- How does the Golod-Shafarevich criterion ensure infinitely many suitable number fields?
- Can proof assistants verify the full lattice construction argument formally?
- Can a formally correct proof exist without the prover understanding the underlying mathematics?
- What makes a Lean proof an unarguable check compared to other mathematical verification methods?
- How does this AI proof approach differ from empirical validation used in machine learning?
- How does verification capacity constrain progress in formal mathematics?
- Can opaque AI tools suggest valid mathematics without external validation?
- What pattern does this follow from OpenAI's earlier Erdős problem claim?
- Does a correct proof preserve mathematical value without human comprehension?
- Why do theorem provers crowd out other AI-for-mathematics approaches and tools?
- Does a correct proof certify understanding if built from unfamiliar concepts?
- How do dependency errors propagate through incorrectly formalized definitions?
- Can problem structure and representation format be mismatched intentionally?
- Can formal verifiers convert statistical semantic claims into deterministic guarantees?
- How does formal verification differ from semantic faithfulness in autoformalized statements?
- Can natural language to formal logic translation ever be fully trustworthy?
- Can machines verify that formal statements mean what we intend?
- Can formal proof systems eliminate the gap between checking and auditing?
Related concepts in this collection 2
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can large language models translate natural language to logic faithfully?
This explores whether LLMs can convert natural language statements into formal logical representations without losing meaning. It matters because faithful translation is essential for any AI system that reasons formally or verifies specifications.
extends: statement-level semantic loss propagates through theory-level dependencies
-
Can structured templates replace formal verification for code reasoning?
Formal verification is rigorous but impractical at repository scale. Can natural-language templates with enforced structure provide the same reliability guarantees without the formalization cost? This explores the middle ground between unstructured reasoning and full formalism.
relates: theory-level cost justifies informal scaffolding as a rational midpoint
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases
- From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier
- Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations
- Verification abundance, adjudication scarcity: what happens to mathematical knowledge when proof checking becomes free
- Large Language Models as Planning Domain Generators
- Premise-Augmented Reasoning Chains Improve Error Identification in Math reasoning with LLMs
- Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective
- Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
Original note title
autoformalization must move from isolated statements to whole theories — a target theorem is unstatable without its web of axioms definitions and lemmas