Spaces:
Sleeping
Sleeping
| # CodeWraith Model Evaluation Report | |
| ## Summary | |
| | Metric | CodeWraith-8b (Llama-3.1-8B-Instruct) | | |
| |--------|-----| | |
| | Avg Structural Score | 0.95 | | |
| | Function Coverage | 0.90 | | |
| | Class Coverage | 1.00 | | |
| | Argument Coverage | 0.94 | | |
| | Return Type Coverage | 0.67 | | |
| | Good Scores (>=80%) | 25 | | |
| | Avg Inference Time (s) | 27.57 | | |
| ## CodeWraith-8b (Llama-3.1-8B-Instruct) | |
| - Examples evaluated: 28 | |
| - Valid (parseable): 27 | |
| - Perfect scores: 22 | |
| - Total inference time: 772.1s | |