zero shot learning attribute

**Zero-Shot and Few-Shot Learning** is the **transfer learning paradigm enabling recognition of novel unseen classes through semantic attributes or embeddings — critical for scaling to classes with limited or no labeled training examples**. **Attribute-Based Zero-Shot Learning:** - Semantic attributes: human-defined attributes describing classes (e.g., cats: furry, four-legged, carnivorous) - Zero-shot inference: classifier trained on seen classes; attributes transfer to predict unseen class labels - Attribute prediction: classifier learns visual-to-attribute mapping from seen classes; applies to unseen classes - Handcrafted attributes: domain expert designs attribute set; labor-intensive but interpretable - Learned attributes: automatically discovered attributes from data; more flexible and potentially more informative **Visual-Semantic Embedding Space:** - Joint embedding: visual features and semantic embeddings (word2vec, GloVe, BERT) projected to shared space - Similarity matching: unseen class prototype (semantic embedding) matched to test image embedding; nearest neighbor in shared space - Cross-modal learning: learn similarity function aligning visual and semantic modalities; enables class transfer - Embedding quality: semantic embeddings capture rich linguistic properties; word2vec encodes semantic relationships **Generalized Zero-Shot Learning:** - Seen + unseen classes: both seen and unseen classes available at test time; more realistic and challenging - Bias toward seen classes: seen classes have more training data; models biased toward seen class predictions - Hubness problem: test samples preferentially closest to seen class embeddings; seen classes dominate predictions - Balancing mechanism: bias correction or calibration methods balance predictions toward seen/unseen classes **Few-Shot Learning Evaluation Protocol:** - N-way K-shot: evaluate on N classes with K examples per class; standard benchmark (5-way 5-shot, 10-way 1-shot) - Episode evaluation: sample random tasks (N-way K-shot episodes); evaluate across many episodes and average - Meta-test performance: only new classes at test time; models not trained on test classes; true transfer capability - Benchmark datasets: miniImageNet (100 classes, 600 images/class), Omniglot (1623 classes, 20 images/class) **Prototypical Networks:** - Embedding-based meta-learning: learn embedding where same-class examples cluster; prototype = class mean - Few-shot inference: new class prototype computed from K support examples; query classified by nearest prototype - Metric learning: episodic training encourages compact clusters for same class; separated clusters for different classes - Simplicity: straightforward approach; competitive with more complex meta-learning methods **Matching Networks:** - Attention-based matching: soft matching between query and support set; learned similarity function - External memory: support set stored; matching network attends to relevant support examples - Episodic training: simulates few-shot task at training time; trains model to match on small support sets - Temporal attention: sequential attention over support set; learn which examples most relevant for query **Model-Agnostic Meta-Learning (MAML):** - Optimization-based meta-learning: learn initialization enabling rapid few-shot adaptation with few gradient steps - Inner loop: update parameters on support set (few examples) via gradient descent - Outer loop: meta-update initialization based on query set performance; learn better initialization - Few-shot adaptation: after MAML pretraining, just 1-5 gradient steps on support set; excellent performance **In-Context Learning as Implicit Few-Shot:** - Large language models: few-shot learning without parameter updates; examples in prompt condition predictions - Implicit learning: models learn through pretraining to adapt to examples; weights frozen at test time - Tokenization advantage: text examples easily incorporated; enables flexible few-shot prompting - Scaling: larger models show better few-shot learning; implicit few-shot emerges from scale **Challenges in Zero-Shot and Few-Shot Learning:** - Semantic gap: visual features and semantic embeddings from different modalities; bridging gap challenging - Attribute sparsity: limited attributes may not capture distinguishing characteristics; rich attribute sets labor-intensive - Domain shift: attributes/embeddings trained on source domain; transfer to target domain challenging - Imbalanced data: few examples limit training; high variance in few-shot learning; uncertainty quantification needed **Zero-shot and few-shot learning leverage semantic embeddings and small example sets — enabling transfer to novel classes without requiring large labeled datasets, critical for real-world applications with evolving class sets.**