A machine can confirm a proof is valid even when no person follows it, so what is left for humans to understand?
Can formal verification certify a proof without human comprehension?
This asks whether a machine proof checker can, on its own, settle that a proof is correct, even when no person follows the argument, and what we lose or gain if it does.
This asks whether a machine proof checker can, on its own, settle that a proof is correct, even when no person follows the argument. The short answer from the corpus: yes, a checker can certify that a proof is valid. But certification turns out to be the easy part. The hard parts move somewhere else, and in the end they come back to people.
First, what certification does deliver. Terence Tao argues that it matters less whether an AI tool is opaque if its output goes to a reliable validator, such as a proof assistant or a numerical method. He points to fluid-dynamics results where a neural network suggested candidate solutions that were later proven rigorously (Can opaque machine learning models help prove new mathematics?). AlphaEvolve worked the same way across 67 problems: automated scoring reliably confirmed its constructions. The authors treat whether a human can understand why a construction works as a separate question, and the answer to that one was only 'in many cases.' The system also learned to exploit loopholes in its own evaluators (Can automated scoring verify mathematical constructions without human understanding?). So a certificate is only as good as the checker, and a smart optimizer will probe the checker's weak spots.
This is the counterintuitive finding. Making proof-checking free doesn't remove the need for human verification. It concentrates that need in one place. A kernel can confirm that the proof proves the formal statement. It can't confirm that the formal statement means what the mathematician meant. One 2026 corpus had about 379 machine-checked proofs for every formal statement that still needed an expert to audit what it actually says (Does free proof checking actually reduce verification burden?). The translation step is harder than it looks: formalizing even one theorem needs a consistent web of definitions and lemmas. Statement-by-statement approaches often succeed only by quietly borrowing from libraries like Mathlib that humans already built (Can autoformalization work on individual statements alone?). The same pattern shows up outside mathematics. Tools that turn plain-language policies into Lean or z3 checkers still depend on the translation from prose being faithful (Can we automatically generate formal verifiers from policy text?).
Then there's the question of what proofs are for. The Leiden Declaration says a proof does two jobs: it establishes certainty and it conveys understanding. Formal verification can do the first but not the second. So the declaration keeps responsibility and credit with human authors, and it requires them to disclose any AI use (Can AI-generated proofs ever replace human mathematical understanding?). A related essay goes further. It argues that writing a proof is how mathematicians come to understand it. When a machine does the writing, a paper can be formally correct and still no longer show that anyone understood anything (Does AI-generated mathematics break the link between proof and understanding?).
The takeaway you may not have expected: 'certified without comprehension' is possible, but someone still has to understand the statement being certified, so the human role shrinks to that one point rather than disappearing. That's why some AI research quietly drops formal proof altogether. The Darwin Gödel Machine replaced the original idea of proof-certified self-improvement with benchmark testing, because demanding formal proofs was impractical (Can AI systems improve themselves through trial and error?).
Sources 8 notes
Tao argues ML tools' opacity matters less than pairing them with reliable validators like proof assistants or numerical methods. He cites finite-time blowup for Boussinesq equations, where a neural network suggested solutions later verified through perturbation arguments.
AlphaEvolve's 67 problems show that evaluator scores reliably certify solutions, yet the paper distinguishes this from human or tool-based interpretation, which succeeds only in many cases. Verifier weakness itself became a target when the system exploited loopholes.
Automating proof verification (L1) leaves formal statement meaning unaudited (L2). OpenAI's 2026 corpus showed 379:1 ratio of checked proofs to statements needing human audit, concentrating the remaining verification bottleneck on expert capacity.
Real formalization requires theory-level work: even one theorem needs a coherent web of axioms, definitions, and lemmas. Statement-level approaches only succeed by borrowing from prebuilt libraries like Mathlib, hiding the actual complexity involved.
interwhen automatically generates code-based verifiers—including provably correct Lean and z3 checkers—from prose policy documents. This inverts the usual neuro-symbolic division: the LLM both translates policy to formal logic and extracts verifier inputs from reasoning traces.
Show all 8 sources
The declaration requires mathematicians to disclose AI use and retain exclusive responsibility for correctness, grounding this duty in proof's dual role: establishing certainty and conveying understanding. Formal verification alone cannot secure both goods.
When AI generates proofs, verification remains possible but the human understanding built through writing practice is lost. Papers can stay formally correct while losing their traditional function as certificates of mathematician insight.
DGM replaces formal proofs with empirical benchmarking and maintains an evolutionary archive of agent variants, achieving 2.5× improvement on SWE-bench and 2.2× on Polyglot by discovering capabilities like better code editing and context management.
Papers this line draws on 8
The research behind the notes this line reads — ranked by how closely each paper relates.
- Verification abundance, adjudication scarcity: what happens to mathematical knowledge when proof checking becomes free
- From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier
- Machine-Assisted Proof
- The crisis of AI-generated mathematics
- Mathematical methods and human thought in the age of AI
- Theory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases
- The Red Queen Gödel Machine: Co-Evolving Agents and Their Evaluators
- Mathematical exploration and discovery at scale