Update README.md
Browse files
README.md
CHANGED
|
@@ -12,7 +12,7 @@ niro is an improvement over the excellent [WizardLM-Evol-V2-Unfiltered](https://
|
|
| 12 |
|
| 13 |
#### benchmarks
|
| 14 |
|
| 15 |
-
zero-shot evaluations performed on current sota small models; mmlu is still the reason qwen models are better on average.
|
| 16 |
|
| 17 |
| Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
|
| 18 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
|
|
|
| 12 |
|
| 13 |
#### benchmarks
|
| 14 |
|
| 15 |
+
zero-shot evaluations performed on current sota small models; mmlu is still the reason qwen models are better on average. Currently, niro is on par with the best language model below 2b parameters.
|
| 16 |
|
| 17 |
| Parameters | Model | MMLU | ARC | HellaSwag | PIQA | Winogrande | Average |
|
| 18 |
| -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
|