Contrastive Learning is a self-supervised machine learning technique where models learn meaningful representations by distinguishing between similar ("positive") and dissimilar ("negative") pairs of data — without requiring any human-labeled data, the model learns to pull representations of augmented views of the same image (or text) together while pushing representations of different images apart, producing embeddings that capture semantic structure (shapes, textures, categories) and enabling downstream tasks like classification to work with dramatically less labeled data.

What Is Contrastive Learning?

• Definition: A training paradigm where the model learns by comparing data points — pulling "positive pairs" (similar/related items) closer together in embedding space while pushing "negative pairs" (different/unrelated items) apart, optimizing a contrastive loss function.
• Self-Supervised: Unlike supervised learning (which needs labels like "cat", "dog"), contrastive learning creates its own training signal through data augmentation — two crops of the same image are a positive pair, crops from different images are negative pairs.
• Why It Matters: Labeled data is expensive (ImageNet took years to annotate). Contrastive learning produces representations nearly as good as supervised learning using zero labels — then fine-tuning with even a few hundred labeled examples achieves excellent performance.

How SimCLR Works (Simplified)

Key Contrastive Learning Methods

Applications Beyond Vision

Contrastive Learning is the foundational self-supervised technique that enabled modern representation learning without labels — proving that models can learn rich, transferable features by simply comparing data points, powering everything from CLIP's image-text understanding to sentence embeddings to code search.