predictability of emergence

**Predictability of emergence** is the **degree to which future capability jumps can be forecast from earlier scaling trends and auxiliary signals** - it is central to planning safe and efficient model development programs. **What Is Predictability of emergence?** - **Definition**: Predictability evaluates how well early metrics anticipate later nonlinear capability gains. - **Forecast Inputs**: May include loss trends, intermediate benchmarks, and representation diagnostics. - **Uncertainty**: Forecast confidence varies by task family and benchmark sensitivity. - **Failure Modes**: Overfitting forecasts to narrow benchmarks can miss real-world capability shifts. **Why Predictability of emergence Matters** - **Planning**: Better prediction improves compute allocation and milestone setting. - **Safety**: Early warning of emerging capabilities supports timely governance updates. - **Evaluation Design**: Encourages richer telemetry beyond a single aggregate metric. - **Cost Control**: Reduces wasted runs by identifying likely low-return scaling regions. - **Research Priority**: Key open question for responsible frontier model development. **How It Is Used in Practice** - **Forecast Audits**: Track predicted versus observed capability at each scaling step. - **Signal Diversity**: Use multi-metric models instead of single-score extrapolation. - **Scenario Planning**: Prepare contingency plans for both under- and over-emergence outcomes. Predictability of emergence is **a strategic forecasting challenge for capability and safety management** - predictability of emergence improves when forecasting pipelines include uncertainty tracking and diverse diagnostic signals.