allenai
/

Flex-code-2x7B-1T

Text Generation

Mixture of Experts

Model card Files Files and versions

akshitab commited on 8 days ago

Commit

86bcae3

·

verified ·

1 Parent(s): eb7c0e3

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -58,8 +58,8 @@ print(tokenizer.decode(out[0]))
 | Reddit | 64.7 | 36.5 | 56.1 | 25.5 | 35.5 | 19.7 | 2.5 | 54.1 | 8.6 | 32.7 | 1.7 | 30.7 |
 | **Combined** |
 | BTM (top-2) | 68.7 | 57.7 | 59.4 | 28.3 | 43.2 | 44.3 | 23.1 | 73.6 | 54.4 | 46.3 | **24.0** | 47.6 |
-| 🔥 **FlexOlmo-7x7B-1T** | **70.4** | **60.1** | **60.2** | **30.5** | 44.8 | 46.8 | 47.9 | **78.3** | 66.2 | 53.8 | 14.6 | 52.0 |
-| **FlexOlmo-7x7B-1T-RT** | 70.3 | 60.0 | **60.2** | 30.3 | **45.2** | **47.2** | 47.7 | 77.2 | **67.6** | **53.9** | 13.3 | **52.2** |
 * The evaluation of the individual model refers to the dense model, not the 2x7B MoE model.

 | Reddit | 64.7 | 36.5 | 56.1 | 25.5 | 35.5 | 19.7 | 2.5 | 54.1 | 8.6 | 32.7 | 1.7 | 30.7 |
 | **Combined** |
 | BTM (top-2) | 68.7 | 57.7 | 59.4 | 28.3 | 43.2 | 44.3 | 23.1 | 73.6 | 54.4 | 46.3 | **24.0** | 47.6 |
+| **FlexOlmo-7x7B-1T** | 65.6 | 44.7 | 50.9 | 22.1 | 37.2 | 35.6 | 25.4 | 55.8 | 39.0 | 45.9 | 10.6 | 39.3 |
+| **FlexOlmo-7x7B-1T-RT** | **70.6** | **59.7** | **60.0** | **30.5** | **44.6** | **45.9** | 47.7 | **79.7** | **67.6** | **54.5** | 11.3 | **52.0** |
 * The evaluation of the individual model refers to the dense model, not the 2x7B MoE model.