Update README.md
Browse files
README.md
CHANGED
|
@@ -16,6 +16,18 @@ This model is a Mixture of Experts (MoE) merger of the following two models:
|
|
| 16 |
|[youri-7b-instruction](https://huggingface.co/rinna/youri-7b-instruction) *| 88.83| 63.56| 93.78| 92.19| 84.59|
|
| 17 |
|[youri-7b-chat](https://huggingface.co/rinna/youri-7b-chat) *| 91.78| 70.35| 96.69| 79.62| 84.61|
|
| 18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
* From the [rinna's LM Benchmark](https://rinnakk.github.io/research/benchmarks/lm/index.html).
|
| 20 |
|
| 21 |
## 🧩 Configuration
|
|
|
|
| 16 |
|[youri-7b-instruction](https://huggingface.co/rinna/youri-7b-instruction) *| 88.83| 63.56| 93.78| 92.19| 84.59|
|
| 17 |
|[youri-7b-chat](https://huggingface.co/rinna/youri-7b-chat) *| 91.78| 70.35| 96.69| 79.62| 84.61|
|
| 18 |
|
| 19 |
+
| Model |jaqket-v2(1-shot,F1)|xlsum(1-shot,ROUGE 2)|6-AVERAGE|
|
| 20 |
+
|----------------------------------------------------------------|------:|------:|------:|
|
| 21 |
+
|[**youri-2x7b_dev**](https://huggingface.co/mlabonne/phixtral-2x2_8)| **84.59**| **22.25**| **76.03**|
|
| 22 |
+
|[youri-7b-instruction](https://huggingface.co/rinna/youri-7b-instruction) *| 83.92| 24.67| 75.13|
|
| 23 |
+
|[youri-7b-chat](https://huggingface.co/rinna/youri-7b-chat) *| 83.71| 24.21| 75.33|
|
| 24 |
+
|
| 25 |
+
| Model |xwinograd(0-shot,acc.)|mgsm(5-shot,acc.)|JCoLA(2-shot,balanced acc.)|9-AVERAGE|
|
| 26 |
+
|----------------------------------------------------------------|------:|------:|---------:|------:|
|
| 27 |
+
|[**youri-2x7b_dev**](https://huggingface.co/mlabonne/phixtral-2x2_8)| **81.43**| **22.00**| **59.84**| **68.83**|
|
| 28 |
+
|[youri-7b-instruction](https://huggingface.co/rinna/youri-7b-instruction) *| 78.94 | 17.20| 54.04| 66.35|
|
| 29 |
+
|[youri-7b-chat](https://huggingface.co/rinna/youri-7b-chat) *| 80.92| 25.20| 53.78| 67.36|
|
| 30 |
+
|
| 31 |
* From the [rinna's LM Benchmark](https://rinnakk.github.io/research/benchmarks/lm/index.html).
|
| 32 |
|
| 33 |
## 🧩 Configuration
|