phi

**Phi** is a **series of Small Language Models (SLMs) by Microsoft Research that fundamentally challenged AI scaling laws by demonstrating that training on extremely high-quality "textbook-grade" data produces tiny models rivaling models 10-50x their size** — with Phi-1 outperforming larger models on coding, Phi-2 (2.7B) matching Llama 2 (13B) on reasoning, and Phi-3 (3.8B) competing with GPT-3.5, proving "Textbooks Are All You Need" and catalyzing industry shift to efficient on-device AI. **The Philosophy: Data Quality Over Scale** | Model | Size | Performance Comparison | Key Result | |-------|------|------------------------|-----------| | Phi-1 | 1.3B | Outperforms 13B models on code | Coding excellence with minimal parameters | | Phi-2 | 2.7B | Matches Llama 2 13B on reasoning | Reasoning capabilities without scale | | Phi-3 | 3.8B | Competes with GPT-3.5 | Frontier performance at palm-sized scale | **Training Data Strategy**: Microsoft curated "textbook-quality" datasets instead of massive raw internet scrapes. Using synthetic data generation and careful curriculum learning, Phi models learn efficiently with far fewer tokens. **Significance**: Phi proved that **model efficiency** (not raw size) determines practical value. This shifted the industry toward SLMs, enabling on-device AI on phones, laptops, and edge devices where large models are infeasible.