{% extends "base.html" %} {% block title %}Evaluation Lab • Multi-RAG{% endblock %} {% block head %} {% endblock %} {% block content %}
MR Multi-RAG / Evaluation ← Chat workspace

QUALITY REPORT · RUN 04

Evaluation results

RAG response quality and guardrail behavior across the recorded evaluation set.

Six RAG samples / {{ guardrail_total }} safety checks

RETRIEVAL-AUGMENTED GENERATION

RAG scorecard

{{ metrics_file }}
Needs attention < 0.40 Mixed 0.40–0.69 Strong ≥ 0.70
{% for metric in metrics %} {% endfor %} {% for sample in samples %} {% for metric in sample.metrics %} {% endfor %} {% else %} {% endfor %} {% for metric in metrics %} {% endfor %}
Question{{ metric.label }}Avg. Trace
{{ "%02d"|format(sample.id or loop.index) }} {{ sample.question }} {{ sample.domain|replace("_", " ") }} {% if metric.value is not none %} {{ "%.3f"|format(metric.value) }} {% else %} N/A {% endif %} {% if sample.average is not none %} {{ "%.3f"|format(sample.average) }} {% else %} N/A {% endif %} View
No RAG samples were found in this dataset.
Average score{{ metric.display }}{{ "%.3f"|format(overall_average) }} {{ samples|length }} samples

QUESTION-LEVEL BREAKDOWN

RAG traces {{ samples|length }}

{{ dataset_file }}
{% for sample in samples %}
{{ "%02d"|format(sample.id or loop.index) }} {{ sample.question }} {{ sample.domain|replace("_", " ") }}
{% for metric in sample.metrics %}
{{ metric.label }} {% if metric.value is not none %} {{ "%.3f"|format(metric.value) }} {% else %} N/A {% endif %}
{% endfor %}

Reference answer

{{ sample.reference or "No reference recorded." }}

Generated answer

{{ sample.answer or "No generated answer recorded." }}

Retrieved context {{ sample.contexts|length }} passages

{% if sample.contexts %}
    {% for context in sample.contexts %}
  1. {{ context }}
  2. {% endfor %}
{% else %}

No retrieved passages recorded.

{% endif %}
{% else %}

No RAG samples were found in this dataset.

{% endfor %}

SAFETY & SCOPE

Guardrails {{ guardrail_correct }} / {{ guardrail_total }} correct

{{ guardrails_file }}
{{ guardrail_counts.TP }}True positives
{{ guardrail_counts.TN }}True negatives
{{ guardrail_counts.FP }}False positives
{{ guardrail_counts.FN }}False negatives
{% for item in guardrails %} {% else %} {% endfor %}
CaseCategoryInputExpectedActualResult
{{ item.id }} {{ item.type|replace("_", " ") }} {{ item.input }} {{ "Blocked" if item.expected_blocked else "Allowed" }} {{ "Blocked" if item.actual_blocked else "Allowed" }} {{ item.result }}
No guardrail results were found.
{% endblock %}