causal inference machine learning

**Causal Inference in Machine Learning** is the **discipline that extends predictive ML models to answer "what if" questions — estimating the causal effect of an intervention (treatment, policy, feature change) on an outcome, rather than merely predicting correlations between observed variables**. **Why Prediction Is Not Enough** A model that predicts hospital readmission with 95% accuracy tells you nothing about whether prescribing a specific drug would reduce readmission. Correlation-based predictions confound treatment effects with selection bias (sicker patients receive more treatment AND have worse outcomes). Causal inference methods isolate the true treatment effect from these confounders. **Core Frameworks** - **Potential Outcomes (Rubin Causal Model)**: For each individual, two potential outcomes exist — Y(1) under treatment and Y(0) under control. The individual treatment effect is Y(1) - Y(0), but only one is ever observed. Causal methods estimate the Average Treatment Effect (ATE) or Conditional ATE (CATE) across populations. - **Structural Causal Models (Pearl)**: Directed Acyclic Graphs (DAGs) encode causal assumptions. The do-calculus provides rules for computing interventional distributions P(Y | do(X)) from observational data when the DAG satisfies specific criteria (back-door, front-door). **ML-Powered Causal Estimators** - **Double/Debiased Machine Learning (DML)**: Uses ML models to estimate nuisance parameters (propensity scores, outcome models) while applying Neyman orthogonal moment conditions to produce valid, debiased treatment effect estimates with valid confidence intervals. - **Causal Forests**: An extension of Random Forests that partitions the feature space to find heterogeneous treatment effects — subgroups where the intervention helps most or is actively harmful. - **CATE Learners (T-Learner, S-Learner, X-Learner)**: Meta-algorithms that combine standard ML regression models to estimate conditional treatment effects. The T-Learner fits separate models for treatment and control groups; the X-Learner uses cross-imputation to handle imbalanced group sizes. **Critical Assumptions** All observational causal methods require untestable assumptions: - **Unconfoundedness**: All variables that simultaneously affect treatment assignment and outcome are observed and controlled for. - **Overlap (Positivity)**: Every individual has a non-zero probability of receiving either treatment or control. Violation of either assumption produces biased treatment effect estimates that no statistical method can correct. Causal Inference in Machine Learning is **the essential upgrade from passive pattern recognition to actionable decision science** — transforming models that describe what happened into tools that predict what will happen if you intervene.