RAG Evaluation Report
Generated: 2026-07-04T11:31:04.338800+00:00
Overall Metrics
- Questions Evaluated: 5
- Source Hit Rate: 0.6
- Average Latency: 13929.41 ms
Ragas Scores
{
"error": "'ChatOpenAI' object has no attribute 'set_run_config'"
}
Question Results
Q: What is Error Code 404?
A: Error Code 404 indicates that the requested server resource was not found, and you should check your network router configuration [sample_error.txt][api_docs.md].
- Source hit: True
- Retrieved contexts: 3
- Latency ms: 39687.2
Q: What does this support copilot do?
A: This support copilot is designed to answer support documentation queries using retrieved context, currently handling each query independently without conversation memory [implementation_plan.md].
- Source hit: False
- Retrieved contexts: 3
- Latency ms: 12167.86
Q: How do I reset my password?
A:
- Source hit: False
- Retrieved contexts: 0
- Latency ms: 5999.2
Q: What is the default rate limit?
A: The default API rate limit is 100 requests per minute per IP address. [api_docs.md]
- Source hit: True
- Retrieved contexts: 3
- Latency ms: 5868.04
Q: How can I contact support?
A: You can contact support via email at support@example.com or by phone at 1-800-555-0199, available Monday–Friday, 9 AM – 5 PM EST. [contact_info.html] For urgent issues, call the phone number above and press 1 for priority routing. [contact_info.html]
- Source hit: True
- Retrieved contexts: 3
- Latency ms: 5924.76