referring expression generation

**Referring expression generation** is the **task of generating natural-language descriptions that uniquely identify a target object within an image** - it requires balancing specificity, fluency, and brevity. **What Is Referring expression generation?** - **Definition**: Given image and target region, model produces expression enabling a listener to locate that target. - **Generation Goal**: Description must distinguish target from similar distractors in the same scene. - **Content Requirements**: Often combines object attributes, spatial relations, and contextual cues. - **Evaluation Perspective**: Judged by both language quality and successful referent identification. **Why Referring expression generation Matters** - **Communication Quality**: Essential for collaborative human-AI visual tasks and dialogue systems. - **Grounding Precision**: Generation quality reflects whether model understands scene distinctions. - **Interactive Systems**: Supports instruction generation for robotics and assistive navigation. - **Dataset Utility**: Provides supervision for bidirectional grounding pipelines. - **User Trust**: Clear disambiguating language improves usability and confidence. **How It Is Used in Practice** - **Pragmatic Training**: Optimize for listener success, not only n-gram overlap metrics. - **Distractor-Aware Decoding**: Penalize generic descriptions that fail to isolate target object. - **Human Evaluation**: Assess clarity, uniqueness, and naturalness with targeted user studies. Referring expression generation is **a key generation task for grounded visual communication** - effective referring generation improves precision in multimodal collaboration workflows.