Cross-View Consistency is a learning principle that enforces agreement between a model's predictions or representations across different views of the same input, training neural networks to produce invariant outputs regardless of which view (augmentation, modality, or representation) is provided. Cross-view consistency is the foundational objective of contrastive self-supervised learning and a key regularization technique in semi-supervised and multi-view learning.

Why Cross-View Consistency Matters in AI/ML: Cross-view consistency is the core principle driving modern self-supervised learning (SimCLR, BYOL, VICReg), enforcing that different augmented views of the same image should produce similar representations—providing supervision from data structure itself without labels.

• Representation consistency — Encoders are trained so that f(view₁(x)) ≈ f(view₂(x)) in embedding space; this is enforced through contrastive loss (push different samples apart, pull same-sample views together), regression loss (MSE between view embeddings), or correlation-based loss • Prediction consistency — For classification, cross-view consistency enforces that class predictions agree across views: P(y|view₁(x)) ≈ P(y|view₂(x)); this is used in semi-supervised learning (MixMatch, FixMatch) and domain adaptation (self-ensembling) • Contrastive formulation — SimCLR, MoCo, and DINO use contrastive objectives: positive pairs (two views of the same image) should have similar embeddings while negative pairs (views of different images) should be dissimilar; this prevents representation collapse to a constant • Non-contrastive formulation — BYOL, VICReg, and Barlow Twins enforce consistency without negative pairs: BYOL uses a stop-gradient predictor, VICReg uses variance/invariance/covariance regularization, and Barlow Twins decorrelates embedding dimensions • Multi-modal consistency — CLIP enforces consistency between image and text views of the same concept, creating aligned multi-modal embeddings; this extends cross-view consistency to heterogeneous modalities with shared semantic content

Cross-view consistency is the fundamental learning signal underlying modern self-supervised and multi-view representation learning, providing supervision from data structure by enforcing that different views of the same input produce similar representations, enabling powerful feature learning without labeled data through the simple principle that semantically equivalent inputs should yield equivalent representations.