grounding dino

**Grounding DINO** is a **state-of-the-art open-set object detector** — combining the transformer-based detection of DINO (DETR variant) with grounded pre-training to detect arbitrary objects specified by text inputs. **What Is Grounding DINO?** - **Definition**: A fusion of DINO detector + GLIP-style language pre-training. - **Input**: Image + Text Prompt (e.g., "person wearing red shirt"). - **Output**: Bounding boxes for the entities mentioned in the text. - **Performance**: Achieves top-tier results on ODinW (Object Detection in the Wild) benchmarks. **Architecture** - **Dual Encoders**: Image backbone (Swin/ViT) and Text backbone (BERT/RoBERTa). - **Feature Fusion**: Deep early fusion of language and vision features in the encoder. - **Query Selection**: Language-guided query selection to focus on relevant regions. **Why It Matters** - **REC (Referring Expression Comprehension)**: Can distinguish "cat on left" vs "cat on right". - **Zero-Shot Power**: Strongest performance for detecting novel categories without fine-tuning. - **Pipeline Component**: Widely used as the "eyes" for agents (checking if an action was completed). **Grounding DINO** is **the standard for text-guided detection** — serving as a critical module in modern multimodal AI systems and robotic perception pipelines.