legolasyiu commited on
Commit
01240ea
·
verified ·
1 Parent(s): a03a01f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -70,7 +70,8 @@ print(outputs[0]["generated_text"][-1])
70
  ## Benchmark
71
  These benchmark are current benchmark and not final benchmark, due to recursive fine tuning techniques self improves over time:
72
 
73
- - hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), gen_kwargs: (temperature=1,top_p=1,max_new_tokens=1000), limit: 30.0, num_fewshot: 5, batch_size: 1
 
74
  | Tasks |Version| Filter |n-shot| Metric | |Value |
75
  |-------------------------------|------:|----------------|-----:|-----------|---|-----:|
76
  |gsm8k_cot | 3|flexible-extract| 5|exact_match|↑ |0.91 |
 
70
  ## Benchmark
71
  These benchmark are current benchmark and not final benchmark, due to recursive fine tuning techniques self improves over time:
72
 
73
+ hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), gen_kwargs: (temperature=1,top_p=1,max_new_tokens=1000), limit: 30.0, num_fewshot: 5, batch_size: 1
74
+
75
  | Tasks |Version| Filter |n-shot| Metric | |Value |
76
  |-------------------------------|------:|----------------|-----:|-----------|---|-----:|
77
  |gsm8k_cot | 3|flexible-extract| 5|exact_match|↑ |0.91 |