Jo1uck
/

gpt-oss-46b

Text Generation

8-bit precision

Model card Files Files and versions

Jo1uck commited on 19 days ago

Commit

8349073

·

verified ·

1 Parent(s): c1f912d

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -20,8 +20,8 @@ Currently, we only provide a subset of evaluations from the lm_eval repository.
 | Tasks | Metric | gpt-oss-20b | **gpt-oss-46b** | Improvement |
 | :--- | :--- | :---: | :---: | :---: |
-| **GSM8K** (0-shot) | Exact Match (flexible) | **0.2290** | 0.1638 | <font color="green">-28.47%</font> |
-| **LAMBADA** (OpenAI) | Accuracy | 0.2038  | **0.2668**| <font color="red">+30.91%</font> |
 > [!NOTE]

 | Tasks | Metric | gpt-oss-20b | **gpt-oss-46b** | Improvement |
 | :--- | :--- | :---: | :---: | :---: |
+| **GSM8K** (0-shot) | Exact Match (flexible) | **0.2290** | 0.1638 | <font color="red">-28.47%</font> |
+| **LAMBADA** (OpenAI) | Accuracy | 0.2038  | **0.2668**| <font color="green">+30.91%</font> |
 > [!NOTE]