Update README.md
Browse files
README.md
CHANGED
|
@@ -70,7 +70,8 @@ print(outputs[0]["generated_text"][-1])
|
|
| 70 |
## Benchmark
|
| 71 |
These benchmark are current benchmark and not final benchmark, due to recursive fine tuning techniques self improves over time:
|
| 72 |
|
| 73 |
-
|
|
|
|
| 74 |
| Tasks |Version| Filter |n-shot| Metric | |Value |
|
| 75 |
|-------------------------------|------:|----------------|-----:|-----------|---|-----:|
|
| 76 |
|gsm8k_cot | 3|flexible-extract| 5|exact_match|↑ |0.91 |
|
|
|
|
| 70 |
## Benchmark
|
| 71 |
These benchmark are current benchmark and not final benchmark, due to recursive fine tuning techniques self improves over time:
|
| 72 |
|
| 73 |
+
hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), gen_kwargs: (temperature=1,top_p=1,max_new_tokens=1000), limit: 30.0, num_fewshot: 5, batch_size: 1
|
| 74 |
+
|
| 75 |
| Tasks |Version| Filter |n-shot| Metric | |Value |
|
| 76 |
|-------------------------------|------:|----------------|-----:|-----------|---|-----:|
|
| 77 |
|gsm8k_cot | 3|flexible-extract| 5|exact_match|↑ |0.91 |
|