context relevance

**Context relevance** is the **degree to which retrieved passages are directly useful for answering the current user query** - it measures retrieval quality before generation quality can be expected. **What Is Context relevance?** - **Definition**: Assessment of semantic and task-level match between query intent and retrieved context. - **Granularity**: Can be scored per chunk, per citation set, or across the full context window. - **Failure Patterns**: Irrelevant but topically similar chunks, outdated content, and overly broad matches. - **Pipeline Dependency**: Strongly influenced by chunking, query rewriting, and ranking calibration. **Why Context relevance Matters** - **Answer Quality Ceiling**: Generation cannot be reliably correct when context relevance is low. - **Token Efficiency**: High-relevance context uses limited prompt space more effectively. - **Hallucination Risk**: Irrelevant context encourages speculative or confused answers. - **Latency and Cost**: Better relevance reduces reranking waste and unnecessary context packing. - **Debug Signal**: Relevance metrics quickly expose retrieval drift and domain mismatch. **How It Is Used in Practice** - **Labeled Benchmarks**: Build query-context relevance datasets for periodic retriever evaluation. - **Hybrid Ranking**: Combine lexical and semantic signals to improve relevance robustness. - **Threshold Policies**: Filter low-score chunks before generation to keep context focused. Context relevance is **a primary retrieval KPI in grounded AI systems** - maintaining high context relevance is essential for accurate and efficient answer generation.