Rate the relevance of each retrieved document to the query
  Irrelevant Somewhat Relevant Highly Relevant
Document 1
Document 2
Document 3
Document 4 (if present)
Is the synthesized answer faithful to the retrieved documents? (No unsupported claims)
Many unsupported claims
1
2
3
4
5
Fully faithful
Does the answer cover all important aspects from the retrieved documents?
Very incomplete
1
2
3
4
5
Comprehensive
How well does the answer attribute claims to source documents?
Highlight any issues in the synthesized answer
Overall quality of the synthesized answer
Very poor
1
2
3
4
5
Excellent
Could this answer mislead the user?
Additional observations about the RAG pipeline trace