legolasyiu commited on
Commit
4cd94e4
·
verified ·
1 Parent(s): b04b70c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -5
README.md CHANGED
@@ -105,12 +105,11 @@ hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), g
105
  |:----------------------------|:-----|:-----|:----- |
106
  |gsm8k_cot |0.91 | - | - |
107
  |gpqa_diamond_cot_n_shot |0.722 |0.70 |0.67|
 
 
 
 
108
 
109
- hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16,trust_remote_code=True), gen_kwargs: (temperature=0.9,top_p=0.9,max_new_tokens=3072), limit: 30.0, num_fewshot: 0, batch_size: 1
110
- | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
111
- |---------|------:|------|-----:|--------|---|-----:|---|-----:|
112
- |hellaswag| 1|none | 0|acc |↑ |0.3000|± |0.0851|
113
- | | |none | 0|acc_norm|↑ |0.3333|± |0.0875|
114
 
115
 
116
  ## Thank you
 
105
  |:----------------------------|:-----|:-----|:----- |
106
  |gsm8k_cot |0.91 | - | - |
107
  |gpqa_diamond_cot_n_shot |0.722 |0.70 |0.67|
108
+ |winigrande |0.785| - |-|
109
+ |hellaswag |0.421| - |-|
110
+ |arc_challenge |0.349| - |-|
111
+
112
 
 
 
 
 
 
113
 
114
 
115
  ## Thank you