RAG / PRACTICAL GUIDE
Evaluate retrieval before generation.
RAG fails when evidence is missing, stale, inaccessible, or cited inaccurately. Measure the retriever and answerer independently.
Evaluation sequence
- Build questions with gold evidence.
- Measure recall and ranking.
- Verify filters and permissions.
- Score groundedness and citations.
- Track freshness and regressions.