File size: 495 Bytes
6434f64 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
base_model: TinyLlama/TinyLlama_v1.1
language: en
license: mit
---
## Metrics
| PPL | arc_easy |arc_challenge| piqa | winogrande | hellaswag |mmlu|QA Avg|
|----:|------------|-------------|------------|------------|------------|----|-----:|
|11.99|41.96 ± 1.01|24.32 ± 1.25 |66.21 ± 1.10|50.28 ± 1.41|39.00 ± 0.49|- | 44.35|
Training method based on [BitDistiller Paper](https://arxiv.org/abs/2402.10631)
- **License:** mit
- **Finetuned from:** TinyLlama/TinyLlama_v1.1 |