QUALITY REPORT · RUN 04
Evaluation results
RAG response quality and guardrail behavior across the recorded evaluation set.
RETRIEVAL-AUGMENTED GENERATION
RAG scorecard
| Question | {% for metric in metrics %}{{ metric.label }} | {% endfor %}Avg. | Trace | ||||
|---|---|---|---|---|---|---|---|
| {{ "%02d"|format(sample.id or loop.index) }} {{ sample.question }} {{ sample.domain|replace("_", " ") }} | {% for metric in sample.metrics %}{% if metric.value is not none %} {{ "%.3f"|format(metric.value) }} {% else %} N/A {% endif %} | {% endfor %}{% if sample.average is not none %} {{ "%.3f"|format(sample.average) }} {% else %} N/A {% endif %} | View | ||||
| No RAG samples were found in this dataset. | |||||||
| Average score | {% for metric in metrics %}{{ metric.display }} | {% endfor %}{{ "%.3f"|format(overall_average) }} | {{ samples|length }} samples | ||||
QUESTION-LEVEL BREAKDOWN
RAG traces {{ samples|length }}
{{ "%02d"|format(sample.id or loop.index) }} {{ sample.question }} {{ sample.domain|replace("_", " ") }}
Reference answer
{{ sample.reference or "No reference recorded." }}
Generated answer
{{ sample.answer or "No generated answer recorded." }}
Retrieved context {{ sample.contexts|length }} passages
{% if sample.contexts %}-
{% for context in sample.contexts %}
- {{ context }} {% endfor %}
No retrieved passages recorded.
{% endif %}No RAG samples were found in this dataset.
{% endfor %}SAFETY & SCOPE
Guardrails {{ guardrail_correct }} / {{ guardrail_total }} correct
| Case | Category | Input | Expected | Actual | Result |
|---|---|---|---|---|---|
| {{ item.id }} | {{ item.type|replace("_", " ") }} | {{ item.input }} | {{ "Blocked" if item.expected_blocked else "Allowed" }} | {{ "Blocked" if item.actual_blocked else "Allowed" }} | {{ item.result }} |
| No guardrail results were found. | |||||