File size: 474 Bytes
eeef81e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
# CodeWraith Model Evaluation Report

## Summary

| Metric | CodeWraith-8b (Llama-3.1-8B-Instruct) |
|--------|-----|
| Avg Structural Score | 0.95 |
| Function Coverage | 0.90 |
| Class Coverage | 1.00 |
| Argument Coverage | 0.94 |
| Return Type Coverage | 0.67 |
| Good Scores (>=80%) | 25 |
| Avg Inference Time (s) | 27.57 |

## CodeWraith-8b (Llama-3.1-8B-Instruct)

- Examples evaluated: 28
- Valid (parseable): 27
- Perfect scores: 22
- Total inference time: 772.1s