Consistency Models are a class of generative models that learn to map any point along the diffusion process trajectory directly to the trajectory's origin (the clean data point), enabling single-step or few-step generation without requiring the iterative denoising process of standard diffusion models. Introduced by Song et al. (2023), consistency models enforce a self-consistency property: all points on the same trajectory map to the same output, enabling direct noise-to-data mapping.

Why Consistency Models Matter in AI/ML: Consistency models provide fast, high-quality generation that addresses the primary limitation of diffusion models—slow multi-step sampling—by learning a function that collapses the entire denoising trajectory into a single forward pass while maintaining generation quality competitive with multi-step diffusion.

• Self-consistency property — For any two points x_t and x_s on the same probability flow ODE trajectory, a consistency function f satisfies f(x_t, t) = f(x_s, s) for all t, s; this means the model can jump from any noise level directly to the clean image in one step • Consistency distillation — Training by distilling from a pre-trained diffusion model: enforce f_θ(x_{t_{n+1}}, t_{n+1}) = f_{θ⁻}(x̂_{t_n}, t_n) where x̂_{t_n} is obtained by one ODE step from x_{t_{n+1}}; θ⁻ is an exponential moving average of θ for stable training • Consistency training — Training from scratch without a pre-trained diffusion model: enforce self-consistency using pairs of points on estimated trajectories, using score estimation from the model itself; this eliminates the distillation dependency • Single-step generation — At inference, a single forward pass f_θ(z, T) maps noise z directly to a generated sample, providing 100-1000× speedup over standard diffusion sampling while maintaining competitive FID scores • Multi-step refinement — Optional iterative refinement: generate x̂₀ = f(z, T), add noise back to x̂_{t₁}, then refine x̂₀ = f(x̂_{t₁}, t₁); each additional step improves quality, providing a smooth speed-quality tradeoff

Consistency models represent the most promising approach to fast diffusion-quality generation, learning direct noise-to-data mappings through the elegant self-consistency constraint that enables single-step generation with quality approaching iterative diffusion sampling, fundamentally changing the speed-quality tradeoff equation for generative AI applications.