Can autoformalization work on individual statements alone?
Explores whether translating single theorems into formal logic is feasible without building entire supporting libraries of axioms, definitions, and lemmas first.
Autoformalization translates informal natural language into machine-verifiable formal languages, and almost all of it operates statement-by-statement. This position paper argues that framing is a category error: real formalization is inherently theory-level. Before a target theorem like Pythagoras can even be stated, you need an entire "tower" beneath it — axiomatic primitives, derivative definitions, notations, examples, supporting lemmas, proof tactics, and all their inter-dependencies — assembled as a coherent formal library. Statement-level autoformalization only looks tractable because it silently borrows that scaffolding from a prebuilt context like Lean's Mathlib.
The evidence is the sheer cost of real efforts: formalizing the Kepler conjecture — a single statement — took 11 years, almost all spent constructing the web of definitions and lemmas needed to support it. Which means the interesting bottleneck is not translating one sentence faithfully but building and maintaining a self-consistent library of interdependent formal objects.
This sharpens the vault's autoformalization thread. Since Can large language models translate natural language to logic faithfully?, per-statement translation is already unreliable; theory-level formalization compounds that risk because dependency errors propagate — a mis-formalized definition silently corrupts every lemma above it, so semantic-loss failures no longer stay local. It also reframes the trade-off behind Can structured templates replace formal verification for code reasoning?: if full theory-level formalization is this expensive, structured-but-informal scaffolding is not a stopgap but a rational point on the cost curve for most reasoning tasks.
Inquiring lines that read this note 6
This note is a source for these research framings, grouped by the broader line of inquiry each explores. Scan the bold lines of inquiry; follow any specific question forward.
Why does verification consistently lag behind AI generation? How effectively do deterministic tools improve language model reasoning on formal tasks? Do language models perform faithful symbolic reasoning independent of semantic grounding? Why do reasoning models fail at systematic problem-solving and search? What role does compression play in language model capability and generalization?Related concepts in this collection 2
This note in its neighbourhood — explore the map, then jump to a related concept in the list below.
Click a node to walk · click center to open · click Open in graph to see this note in the full knowledge graph
-
Can large language models translate natural language to logic faithfully?
This explores whether LLMs can convert natural language statements into formal logical representations without losing meaning. It matters because faithful translation is essential for any AI system that reasons formally or verifies specifications.
extends: statement-level semantic loss propagates through theory-level dependencies
-
Can structured templates replace formal verification for code reasoning?
Formal verification is rigorous but impractical at repository scale. Can natural-language templates with enforced structure provide the same reliability guarantees without the formalization cost? This explores the middle ground between unstructured reasoning and full formalism.
relates: theory-level cost justifies informal scaffolding as a rational midpoint
Related papers in this collection 8
Papers most semantically related to this note, ranked by cosine similarity in the embedding space.
- Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases
- Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations
- Large Language Models as Planning Domain Generators
- Premise-Augmented Reasoning Chains Improve Error Identification in Math reasoning with LLMs
- Chain-of-Reasoning: Towards Unified Mathematical Reasoning in Large Language Models via a Multi-Paradigm Perspective
- Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning
- Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces!
- Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases
Original note title
autoformalization must move from isolated statements to whole theories — a target theorem is unstatable without its web of axioms definitions and lemmas