positional bias in rag

**Positional bias in RAG** is the **systematic tendency of models to weigh evidence differently based on prompt position rather than informational value** - it can distort grounded reasoning in long or complex contexts. **What Is Positional bias in RAG?** - **Definition**: Non-uniform attention behavior tied to token position in retrieval-augmented prompts. - **Bias Forms**: Includes primacy bias, recency bias, and middle-position under-attention. - **Pipeline Effects**: Interacts with chunk ordering, context placement, and truncation strategy. - **Diagnosis**: Detected through controlled position-swap experiments on fixed evidence sets. **Why Positional bias in RAG Matters** - **Answer Distortion**: Important evidence can be ignored when placed in disadvantaged positions. - **Evaluation Mismatch**: High retriever quality may not translate to high answer fidelity. - **Safety Concern**: Bias can amplify irrelevant or stale passages that appear in favored slots. - **Design Complexity**: Requires joint optimization of retrieval ranking and prompt assembly. - **Model Comparison**: Bias patterns differ across model families and context lengths. **How It Is Used in Practice** - **Position-Aware Packing**: Place critical evidence in high-attention regions of the prompt. - **Reordering Heuristics**: Rotate or duplicate key passages to reduce positional fragility. - **Bias Monitoring**: Track performance deltas under position permutations in evaluation suites. Positional bias in RAG is **an important failure mode in long-context RAG pipelines** - position-aware design is required to keep grounding quality consistent.