# RAG Evaluation Report

Generated: 2026-07-04T11:31:04.338800+00:00

## Overall Metrics
- **Questions Evaluated:** 5
- **Source Hit Rate:** 0.6
- **Average Latency:** 13929.41 ms

### Ragas Scores
```json
{
  "error": "'ChatOpenAI' object has no attribute 'set_run_config'"
}
```

## Question Results

### Q: What is Error Code 404?
**A:** Error Code 404 indicates that the requested server resource was not found, and you should check your network router configuration [sample_error.txt][api_docs.md].
- Source hit: True
- Retrieved contexts: 3
- Latency ms: 39687.2

### Q: What does this support copilot do?
**A:** This support copilot is designed to answer support documentation queries using retrieved context, currently handling each query independently without conversation memory [implementation_plan.md].
- Source hit: False
- Retrieved contexts: 3
- Latency ms: 12167.86

### Q: How do I reset my password?
**A:** 
- Source hit: False
- Retrieved contexts: 0
- Latency ms: 5999.2

### Q: What is the default rate limit?
**A:** The default API rate limit is 100 requests per minute per IP address. [api_docs.md]
- Source hit: True
- Retrieved contexts: 3
- Latency ms: 5868.04

### Q: How can I contact support?
**A:** You can contact support via email at support@example.com or by phone at 1-800-555-0199, available Monday–Friday, 9 AM – 5 PM EST. [contact_info.html] For urgent issues, call the phone number above and press 1 for priority routing. [contact_info.html]
- Source hit: True
- Retrieved contexts: 3
- Latency ms: 5924.76