approximate bayesian computation (abc)
**Approximate Bayesian Computation (ABC)** is a family of likelihood-free inference methods that estimate posterior distributions for models where the likelihood function p(D|θ) is intractable or too expensive to evaluate, but where simulating data from the model given parameters is feasible. ABC bypasses likelihood evaluation by generating synthetic data from proposed parameters and accepting those parameters whose simulated data is "close enough" to the observed data, as measured by summary statistics and a distance threshold ε.
**Why ABC Matters in AI/ML:**
ABC enables **Bayesian inference for simulation-based models** (agent-based models, complex physical simulators, population genetics) where traditional likelihood-based methods are impossible, opening Bayesian reasoning to entire classes of scientific models.
• **Reject-accept algorithm** — The simplest ABC: (1) sample θ* from prior p(θ), (2) simulate data D* ~ p(D|θ*), (3) accept θ* if distance d(S(D*), S(D_obs)) < ε, where S(·) are summary statistics; accepted samples approximate the posterior p(θ|d(S(D*), S(D)) < ε)
• **Summary statistics** — Choosing informative summary statistics S(D) that compress the data while retaining information about parameters is critical; insufficient statistics lose information and widen the approximate posterior; neural network-based learned summaries increasingly replace hand-crafted ones
• **Tolerance threshold ε** — Smaller ε produces a better approximation to the true posterior but requires more simulations (lower acceptance rate); the practical tradeoff is between computational cost and approximation quality
• **ABC-MCMC and ABC-SMC** — More efficient variants use Markov chain Monte Carlo or Sequential Monte Carlo to explore the parameter space more intelligently than pure rejection sampling, reducing the number of required simulations by orders of magnitude
• **Neural likelihood estimation** — Modern simulation-based inference (SBI) methods train neural density estimators to approximate the likelihood or posterior directly from simulations, largely superseding classic ABC for efficiency
| ABC Variant | Efficiency | Implementation | Best For |
|-------------|-----------|---------------|----------|
| Rejection ABC | Low | Simple | Proof of concept, low-dim |
| ABC-MCMC | Moderate | Markov chain exploration | Medium-dimensional |
| ABC-SMC | Good | Sequential population refinement | Complex posteriors |
| ABC-PMC | Good | Population Monte Carlo | Multi-modal posteriors |
| Neural SBI (SNPE) | High | Neural density estimation | High-dimensional, reusable |
| Neural SBI (SNLE) | High | Neural likelihood estimation | Flexible, amortized |
**Approximate Bayesian Computation democratizes Bayesian inference for models with intractable likelihoods, enabling rigorous uncertainty quantification for simulation-based scientific models by replacing likelihood evaluation with forward simulation and data comparison, making Bayesian reasoning accessible to complex models in ecology, genetics, cosmology, and beyond.**