appvoid
/

niro-preview-2409

Text Generation

text-generation-inference

Model card Files Files and versions

appvoid commited on Sep 19, 2024

Commit

f0c4fab

·

verified ·

1 Parent(s): b33bc10

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -18,5 +18,7 @@ zero-shot evaluations performed on current sota ~0.5b models.
 | Parameters | Model                          | MMLU  | ARC | HellaSwag | PIQA   | Winogrande | Average |
 | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
 | 0.5b       | arco                           |26.17|37.29|62.88|74.37|62.27|52.60|
 | 1.8B       | wizard                         |40.79|40.87|71.85|**78.02**|64.33| 59.17|
-| 1.8B       | niro                           |**41.75**|**40.96**|**72.07**|77.97|**65.51**|**59.65**|

 | Parameters | Model                          | MMLU  | ARC | HellaSwag | PIQA   | Winogrande | Average |
 | -----------|--------------------------------|-------|-------|-----------|--------|------------|---------|
 | 0.5b       | arco                           |26.17|37.29|62.88|74.37|62.27|52.60|
+| 1.7b       | smollm                         |27.65|**46.26**|65.74|76.06|60.93| 55.33|
+| 1.8B       | danube                         |40.29|40.02|**72.40**|77.04|64.25| 58.80|
 | 1.8B       | wizard                         |40.79|40.87|71.85|**78.02**|64.33| 59.17|
+| 1.8B       | niro                           |**41.75**|40.96|72.07|77.97|**65.51**|**59.65**|