Can diffusion models perform evolutionary search in parameter space?

Diffusion models and evolutionary algorithms developed in different fields with different motivations — generative ML and population biology — but their mathematical structures are equivalent. Considering evolution as a denoising process and reverse evolution as diffusion, the iterative noise-removal of a diffusion model inherently performs selection (high-likelihood samples persist), mutation (stochastic perturbation across denoising steps), and reproductive isolation (separation between modes of the data distribution).

The equivalence is not metaphorical. Diffusion Evolution turns this insight operational by using iterative denoising to refine candidate solutions in parameter spaces — an evolutionary algorithm built on the diffusion sampling procedure. Empirically, it identifies multiple optimal solutions and outperforms prominent mainstream evolutionary algorithms, because diffusion sampling preserves multimodality where many evolutionary methods collapse to a single mode through selection pressure — the same mode-collapse failure documented in Does outcome-based RL diversity loss spread across unsolved problems?.

Two extensions follow naturally from concepts already developed in the diffusion literature. Latent space diffusion, which performs the denoising in a learned compact representation, becomes Latent Space Diffusion Evolution — a method for solving evolutionary tasks in high-dimensional complex parameter space while reducing computational steps. Accelerated sampling techniques developed for image generation transfer directly to evolutionary search.

The conceptual yield is bidirectional. For ML, evolutionary algorithms suggest non-Gaussian or discrete diffusion variants and questions about open-ended generation. For evolutionary biology, diffusion models offer a precise mathematical framework for reasoning about populations as denoising trajectories. The bridge changes which questions seem natural in each field — open-ended evolution, mode-preservation under selection, and discrete-state reproductive isolation become questions diffusion researchers can ask with their own tools.