maml meta learning

**Meta-Learning (MAML)** is the **gradient-based optimization framework for learning to learn — computing meta-parameters (initialization) enabling rapid task-specific adaptation with few gradient steps, achieving state-of-the-art few-shot performance across vision and language tasks**. **Learning to Learn Concept:** - Meta-learning objective: maximize performance on new tasks after few adaptation steps; not just single-task accuracy - Task diversity: train on diverse tasks; learn common structure enabling generalization to new task distributions - Rapid adaptation: few gradient steps on task-specific data sufficient; leverages learned initialization - Few-shot adaptation: contrast to transfer learning (fine-tune all parameters); MAML updates from better initialization **MAML Bilevel Optimization:** - Inner loop: task-specific optimization; gradient descent on task loss with learned initialization θ - Outer loop: meta-level optimization; update initialization θ to minimize loss on query set after inner loop steps - Bilevel structure: inner loop nested within outer loop; optimization of optimization procedure - Computational cost: requires computing gradients through inner loop (second-order derivatives); expensive but powerful **Algorithm Details:** - Meta-update: ∇_θ L_meta = ∑_tasks ∇_θ [L_task(θ - α∇L_support)] - Hessian computation: exact second-order derivatives expensive; approximate via finite differences or implicit function theorem - Computational efficiency: MAML-FOMAML (first-order) approximates second-order; significant speedup with minimal accuracy loss - Multiple inner steps: 1-5 inner gradient steps typical; more steps better performance but higher computational cost **Meta-Learning on Few-Shot Classification:** - Support set: small set of labeled examples (5 per class typical) for task-specific adaptation - Query set: test examples evaluating adapted model; loss on query set defines meta-loss - Episode sampling: randomly sample tasks during training; each task has own support/query split - Task distribution: diverse task distribution critical; meta-learning assumes test tasks from same distribution **Reptile Meta-Learning:** - First-order MAML simplification: further simplify MAML by removing second-order terms - Simplified algorithm: just average parameter updates across tasks; surprisingly effective - Computational efficiency: substantially faster than MAML; enables scaling to larger models - Empirical performance: competitive with MAML on few-shot benchmarks; simpler implementation **Model-Agnostic Property:** - Architecture independence: applicable to any model trained via gradient descent; no special modules - Flexibility: used for classification, reinforcement learning, neural ODEs, optimization itself - Black-box compatibility: applicable to any differentiable model; doesn't require interior access - Multi-modal learning: MAML applied to joint vision-language models; learns cross-modal adaptation **Prototypical Networks Comparison:** - Embedding-based vs optimization-based: prototypical networks learn embedding space; MAML learns initialization - Computational comparison: prototypical networks efficient inference; MAML requires inner loop adaptation - Performance: both state-of-the-art on few-shot; prototypical networks simpler; MAML potentially more flexible - Task adaptation: MAML more naturally incorporates task information; prototypical networks class-agnostic **Meta-Learning for Hyperparameter Optimization:** - HPO meta-learning: learn hyperparameter schedules for optimization; HPO-as-few-shot-learning - Learning rate schedules: meta-learn initial learning rates; task-specific tuning adapted quickly - Data augmentation: meta-learn augmentation policies optimized for task; transfer across tasks - Domain transfer: meta-learned initializations transfer across related domains; enables efficient fine-tuning **Applications Across Domains:** - Vision: few-shot classification on miniImageNet, Omniglot, CUB (bird classification); strong baselines - Language: few-shot language modeling; meta-learning task-specific language adaptation; pre-training improvements - Reinforcement learning: meta-RL enables rapid policy adaptation to new tasks; sample-efficient learning - Robotics: few-shot robot control; meta-learning robot manipulation skills transferable across tasks **Meta-learning Challenges:** - Task distribution assumption: test tasks must match training task distribution; distribution shift problematic - Overfitting to meta-training tasks: memorize task-specific adaptations; reduced generalization to new tasks - Computational cost: second-order derivatives expensive; limits scalability to very large models - Optimization challenges: saddle points and local minima in bilevel optimization; convergence difficult **MAML enables rapid few-shot adaptation through learned initializations — using bilevel optimization to find meta-parameters that facilitate task-specific learning with minimal gradient updates.**