cross-encoder re-ranking
**Cross-encoder re-ranking** is the **relevance scoring method that jointly encodes query and document text to model fine-grained token interactions** - it delivers high ranking accuracy for second-stage candidate refinement.
**What Is Cross-encoder re-ranking?**
- **Definition**: Ranker architecture that processes query-document pairs together in one transformer forward pass.
- **Interaction Strength**: Full cross-attention captures nuanced semantic alignment and contradiction patterns.
- **Computation Cost**: Cannot precompute document embeddings for pair scoring, so runtime is expensive.
- **Pipeline Role**: Typically used only on small candidate sets from first-stage retrieval.
**Why Cross-encoder re-ranking Matters**
- **High Precision**: Often significantly improves top-k relevance versus bi-encoder-only ranking.
- **Context Quality**: Better selected passages improve final answer factuality and completeness.
- **Disambiguation Power**: Handles subtle intent and negation cases more effectively.
- **RAG Reliability**: Reduces inclusion of near-miss documents that cause wrong grounding.
- **Benchmark Performance**: Strong reranking quality across many retrieval datasets.
**How It Is Used in Practice**
- **Candidate Pruning**: Limit cross-encoder scoring to top-N fast-retrieved documents.
- **Latency Budgeting**: Tune N and model size to meet serving constraints.
- **Hybrid Scoring**: Combine cross-encoder score with first-stage signals when beneficial.
Cross-encoder re-ranking is **a standard high-accuracy second-stage retrieval component** - joint query-document scoring provides deep relevance gains that materially improve downstream generation quality.