kuotient
/

EEVE-Instruct-Math-10.8B

Text Generation

Eval Results (legacy)

text-generation-inference

Model card Files Files and versions

kuotient commited on Mar 28, 2024

Commit

5878dac

·

verified ·

1 Parent(s): 6fc6e38

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -26,7 +26,7 @@ tags:
 | Model | gsm8k-ko(pass@1) |
 |---|---|
 | Base | 0.4049 |
-| EEVE-Math(epoch 1) | 0.508 |
 | EEVE-Math (epoch 2) | **0.539** |
 | [EEVE-Instruct](https://huggingface.co/yanolja/EEVE-Korean-Instruct-10.8B-v1.0) | 0.4511 |
 | EEVE-Instruct + Math(epoch 1) | 0.4951 |
@@ -79,5 +79,5 @@ lm_eval --model hf \
 |---|---|---|---|---|---|
 | yanolja/EEVE-Korean-10.8B-v1.0 | 0.4049 | - | - | - | - | - |
 | yanolja/EEVE-Korean-Instruct-10.8B-v1.0 | 0.4511 | **0.8668** | **0.7450** | **0.4940** | 0.6392 |
-| [**EEVE-Math-10.8B-SFT**](https://huggingface.co/kuotient/EEVE-Math-10.8B-SFT) | **0.5390** | 0.8027 | 0.7260 | 0.4760 | 0.6359 |
 | **EEVE-Instruct-Math-10.8B** | 0.4951 | 0.8283 | 0.7500 | 0.4880 | **0.6403** |

 | Model | gsm8k-ko(pass@1) |
 |---|---|
 | Base | 0.4049 |
+| [EEVE-Math](https://huggingface.co/kuotient/EEVE-Math-10.8B) (epoch 1) | 0.508 |
 | EEVE-Math (epoch 2) | **0.539** |
 | [EEVE-Instruct](https://huggingface.co/yanolja/EEVE-Korean-Instruct-10.8B-v1.0) | 0.4511 |
 | EEVE-Instruct + Math(epoch 1) | 0.4951 |
 |---|---|---|---|---|---|
 | yanolja/EEVE-Korean-10.8B-v1.0 | 0.4049 | - | - | - | - | - |
 | yanolja/EEVE-Korean-Instruct-10.8B-v1.0 | 0.4511 | **0.8668** | **0.7450** | **0.4940** | 0.6392 |
+| [**EEVE-Math-10.8B**](https://huggingface.co/kuotient/EEVE-Math-10.8B) | **0.5390** | 0.8027 | 0.7260 | 0.4760 | 0.6359 |
 | **EEVE-Instruct-Math-10.8B** | 0.4951 | 0.8283 | 0.7500 | 0.4880 | **0.6403** |