Spaces:
Sleeping
Sleeping
A newer version of the Gradio SDK is available: 6.14.0
CodeWraith Model Evaluation Report
Summary
| Metric | CodeWraith-8b (Llama-3.1-8B-Instruct) |
|---|---|
| Avg Structural Score | 0.97 |
| Function Coverage | 0.94 |
| Class Coverage | 0.90 |
| Argument Coverage | 1.00 |
| Return Type Coverage | N/A |
| Good Scores (>=80%) | 22 |
| Avg Inference Time (s) | 10.88 |
CodeWraith-8b (Llama-3.1-8B-Instruct)
- Examples evaluated: 26
- Valid (parseable): 23
- Perfect scores: 19
- Total inference time: 283.0s