Update README.md
Browse files
README.md
CHANGED
|
@@ -73,10 +73,10 @@ These benchmark are current benchmark and not final benchmark, due to recursive
|
|
| 73 |
|
| 74 |
hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), gen_kwargs: (temperature=1,top_p=1,max_new_tokens=1000), limit: 30.0, num_fewshot: 5, batch_size: 1
|
| 75 |
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
|gsm8k_cot
|
| 79 |
-
|gpqa_diamond_cot_n_shot
|
| 80 |
|
| 81 |
## Thank you
|
| 82 |
- OpenAI
|
|
|
|
| 73 |
|
| 74 |
hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), gen_kwargs: (temperature=1,top_p=1,max_new_tokens=1000), limit: 30.0, num_fewshot: 5, batch_size: 1
|
| 75 |
|
| 76 |
+
| Tasks |metatune|MiniMax M1 80k|Llama 4 Maverick|
|
| 77 |
+
|:----------------------------|:-----|:-----|:----- |
|
| 78 |
+
|gsm8k_cot |0.91 | - | - |
|
| 79 |
+
|gpqa_diamond_cot_n_shot |0.722 |0.70 |0.67|
|
| 80 |
|
| 81 |
## Thank you
|
| 82 |
- OpenAI
|