legolasyiu commited on
Commit
a03a01f
·
verified ·
1 Parent(s): 0105817

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -69,7 +69,8 @@ print(outputs[0]["generated_text"][-1])
69
 
70
  ## Benchmark
71
  These benchmark are current benchmark and not final benchmark, due to recursive fine tuning techniques self improves over time:
72
- hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), gen_kwargs: (temperature=1,top_p=1,max_new_tokens=1000), limit: 30.0, num_fewshot: 5, batch_size: 1
 
73
  | Tasks |Version| Filter |n-shot| Metric | |Value |
74
  |-------------------------------|------:|----------------|-----:|-----------|---|-----:|
75
  |gsm8k_cot | 3|flexible-extract| 5|exact_match|↑ |0.91 |
 
69
 
70
  ## Benchmark
71
  These benchmark are current benchmark and not final benchmark, due to recursive fine tuning techniques self improves over time:
72
+
73
+ - hf (pretrained=EpistemeAI/metatune-gpt20b-R0,parallelize=True,dtype=bfloat16), gen_kwargs: (temperature=1,top_p=1,max_new_tokens=1000), limit: 30.0, num_fewshot: 5, batch_size: 1
74
  | Tasks |Version| Filter |n-shot| Metric | |Value |
75
  |-------------------------------|------:|----------------|-----:|-----------|---|-----:|
76
  |gsm8k_cot | 3|flexible-extract| 5|exact_match|↑ |0.91 |