Active learning for annotation is a machine learning strategy that intelligently selects which unlabeled examples should be annotated next, focusing human effort on the examples that will improve the model the most. Instead of randomly selecting data to label, active learning prioritizes the most informative, uncertain, or representative samples.

How Active Learning Works

• Step 1: Train an initial model on a small labeled seed set.
• Step 2: Use the model to score all unlabeled examples on an informativeness criterion.
• Step 3: Select the most informative examples and send them to human annotators.
• Step 4: Add the newly labeled examples to the training set, retrain, and repeat.

Selection Strategies

• Uncertainty Sampling: Select examples where the model is most uncertain — near decision boundaries, low confidence predictions. The model learns most from cases it finds difficult.
• Query by Committee: Train multiple models and select examples where they disagree most — diverse predictions indicate regions of model uncertainty.
• Expected Model Change: Select examples that would cause the largest update to model parameters if labeled.
• Diversity Sampling: Select examples that are representative of different clusters in the data, ensuring broad coverage.
• Core-Set Selection: Choose examples that best approximate the full data distribution.

Cost Savings

Active learning typically achieves equivalent model performance with 30–70% fewer labels compared to random selection. For expensive expert annotation (medical, legal), this translates to significant cost savings.

Practical Considerations

• Cold Start: The initial model trained on a tiny labeled set may be too poor for good uncertainty estimates. Semi-supervised or transfer learning helps.
• Batch Selection: In practice, examples are selected in batches (50–500 at a time) rather than one at a time, to amortize retraining cost.
• Annotation Latency: If labeling takes days, the model may have changed by the time labels arrive. Asynchronous active learning addresses this.

Active learning is widely used in production ML systems where annotation budget is limited and must be spent wisely — healthcare AI, autonomous driving, and industrial defect detection.