codewraith / data /eval_report_8b_v5.md
slenk's picture
Upload folder using huggingface_hub
eeef81e verified
# CodeWraith Model Evaluation Report
## Summary
| Metric | CodeWraith-8b-v5 (Llama-3.1-8B-Instruct) |
|--------|-----|
| Avg Structural Score | 0.99 |
| Function Coverage | 0.97 |
| Class Coverage | 1.00 |
| Argument Coverage | 0.99 |
| Return Type Coverage | 1.00 |
| Good Scores (>=80%) | 36 |
| Avg Inference Time (s) | 25.29 |
## CodeWraith-8b-v5 (Llama-3.1-8B-Instruct)
- Examples evaluated: 37
- Valid (parseable): 36
- Perfect scores: 29
- Total inference time: 935.9s