Update README.md
Browse files
README.md
CHANGED
|
@@ -105,12 +105,11 @@ hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), g
|
|
| 105 |
|:----------------------------|:-----|:-----|:----- |
|
| 106 |
|gsm8k_cot |0.91 | - | - |
|
| 107 |
|gpqa_diamond_cot_n_shot |0.722 |0.70 |0.67|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 108 |
|
| 109 |
-
hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16,trust_remote_code=True), gen_kwargs: (temperature=0.9,top_p=0.9,max_new_tokens=3072), limit: 30.0, num_fewshot: 0, batch_size: 1
|
| 110 |
-
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 111 |
-
|---------|------:|------|-----:|--------|---|-----:|---|-----:|
|
| 112 |
-
|hellaswag| 1|none | 0|acc |↑ |0.3000|± |0.0851|
|
| 113 |
-
| | |none | 0|acc_norm|↑ |0.3333|± |0.0875|
|
| 114 |
|
| 115 |
|
| 116 |
## Thank you
|
|
|
|
| 105 |
|:----------------------------|:-----|:-----|:----- |
|
| 106 |
|gsm8k_cot |0.91 | - | - |
|
| 107 |
|gpqa_diamond_cot_n_shot |0.722 |0.70 |0.67|
|
| 108 |
+
|winigrande |0.785| - |-|
|
| 109 |
+
|hellaswag |0.421| - |-|
|
| 110 |
+
|arc_challenge |0.349| - |-|
|
| 111 |
+
|
| 112 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 113 |
|
| 114 |
|
| 115 |
## Thank you
|