legolasyiu commited on
Commit
a9306ca
·
verified ·
1 Parent(s): 82272e6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -164,6 +164,18 @@ Please use "Please reason step by step, and put your final answer within \boxed{
164
 
165
  For further details, questions, or feedback, please email episteme.ai@proton.me
166
 
 
 
 
 
 
 
 
 
 
 
 
 
167
  # Uploaded model
168
 
169
  - **Developed by:** EpistemeAI
 
164
 
165
  For further details, questions, or feedback, please email episteme.ai@proton.me
166
 
167
+ ## Benchmark
168
+
169
+ hf (pretrained=EpistemeAI/ReasoningCore-3B-R01), gen_kwargs: (None), limit: None, num_fewshot: 1, batch_size: 8
170
+ | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
171
+ |-------------|------:|------|-----:|--------|---|-----:|---|-----:|
172
+ |arc_challenge| 1|none | 1|acc |↑ |0.4113|± |0.0144|
173
+ | | |none | 1|acc_norm|↑ |0.4548|± |0.0146|
174
+ |hellaswag | 1|none | 1|acc |↑ |0.5103|± |0.0050|
175
+ | | |none | 1|acc_norm|↑ |0.6965|± |0.0046|
176
+ |winogrande | 1|none | 1|acc |↑ |0.6654|± |0.0133|
177
+
178
+
179
  # Uploaded model
180
 
181
  - **Developed by:** EpistemeAI