Update README.md
Browse files
README.md
CHANGED
|
@@ -164,6 +164,18 @@ Please use "Please reason step by step, and put your final answer within \boxed{
|
|
| 164 |
|
| 165 |
For further details, questions, or feedback, please email episteme.ai@proton.me
|
| 166 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 167 |
# Uploaded model
|
| 168 |
|
| 169 |
- **Developed by:** EpistemeAI
|
|
|
|
| 164 |
|
| 165 |
For further details, questions, or feedback, please email episteme.ai@proton.me
|
| 166 |
|
| 167 |
+
## Benchmark
|
| 168 |
+
|
| 169 |
+
hf (pretrained=EpistemeAI/ReasoningCore-3B-R01), gen_kwargs: (None), limit: None, num_fewshot: 1, batch_size: 8
|
| 170 |
+
| Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
|
| 171 |
+
|-------------|------:|------|-----:|--------|---|-----:|---|-----:|
|
| 172 |
+
|arc_challenge| 1|none | 1|acc |↑ |0.4113|± |0.0144|
|
| 173 |
+
| | |none | 1|acc_norm|↑ |0.4548|± |0.0146|
|
| 174 |
+
|hellaswag | 1|none | 1|acc |↑ |0.5103|± |0.0050|
|
| 175 |
+
| | |none | 1|acc_norm|↑ |0.6965|± |0.0046|
|
| 176 |
+
|winogrande | 1|none | 1|acc |↑ |0.6654|± |0.0133|
|
| 177 |
+
|
| 178 |
+
|
| 179 |
# Uploaded model
|
| 180 |
|
| 181 |
- **Developed by:** EpistemeAI
|