alnrg2arg
/

test3_sft_4bit

Text Generation

text-generation-inference

Model card Files Files and versions

alnrg2arg commited on Jan 27, 2024

Commit

b69a40f

·

verified ·

1 Parent(s): b7558e5

Update README.md

Files changed (1) hide show

README.md +11 -1

README.md CHANGED Viewed

@@ -35,4 +35,14 @@ Benchmark Scores
 |  Tasks   |Version|Filter|n-shot|Metric|Value |   |Stderr|
 |----------|------:|------|-----:|------|-----:|---|-----:|
-|winogrande|      1|none  |     0|acc   |0.7774|±  |0.0117|

 |  Tasks   |Version|Filter|n-shot|Metric|Value |   |Stderr|
 |----------|------:|------|-----:|------|-----:|---|-----:|
+|winogrande|      1|none  |     0|acc   |0.7774|±  |0.0117|
+|Tasks|Version|  Filter  |n-shot|  Metric   |Value |   |Stderr|
+|-----|------:|----------|-----:|-----------|-----:|---|-----:|
+|gsm8k|      2|get-answer|     5|exact_match|0.6732|±  |0.0129|
+|    Tasks     |Version|Filter|n-shot|Metric|Value |   |Stderr|
+|--------------|------:|------|-----:|------|-----:|---|-----:|
+|truthfulqa_mc2|      2|none  |     0|acc   |0.4795|±  |0.0148|
+Average 65.658