HachiML commited on
Commit
1a08d74
·
verified ·
1 Parent(s): ee1c8a9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -16,6 +16,18 @@ This model is a Mixture of Experts (MoE) merger of the following two models:
16
  |[youri-7b-instruction](https://huggingface.co/rinna/youri-7b-instruction) *| 88.83| 63.56| 93.78| 92.19| 84.59|
17
  |[youri-7b-chat](https://huggingface.co/rinna/youri-7b-chat) *| 91.78| 70.35| 96.69| 79.62| 84.61|
18
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  * From the [rinna's LM Benchmark](https://rinnakk.github.io/research/benchmarks/lm/index.html).
20
 
21
  ## 🧩 Configuration
 
16
  |[youri-7b-instruction](https://huggingface.co/rinna/youri-7b-instruction) *| 88.83| 63.56| 93.78| 92.19| 84.59|
17
  |[youri-7b-chat](https://huggingface.co/rinna/youri-7b-chat) *| 91.78| 70.35| 96.69| 79.62| 84.61|
18
 
19
+ | Model |jaqket-v2(1-shot,F1)|xlsum(1-shot,ROUGE 2)|6-AVERAGE|
20
+ |----------------------------------------------------------------|------:|------:|------:|
21
+ |[**youri-2x7b_dev**](https://huggingface.co/mlabonne/phixtral-2x2_8)| **84.59**| **22.25**| **76.03**|
22
+ |[youri-7b-instruction](https://huggingface.co/rinna/youri-7b-instruction) *| 83.92| 24.67| 75.13|
23
+ |[youri-7b-chat](https://huggingface.co/rinna/youri-7b-chat) *| 83.71| 24.21| 75.33|
24
+
25
+ | Model |xwinograd(0-shot,acc.)|mgsm(5-shot,acc.)|JCoLA(2-shot,balanced acc.)|9-AVERAGE|
26
+ |----------------------------------------------------------------|------:|------:|---------:|------:|
27
+ |[**youri-2x7b_dev**](https://huggingface.co/mlabonne/phixtral-2x2_8)| **81.43**| **22.00**| **59.84**| **68.83**|
28
+ |[youri-7b-instruction](https://huggingface.co/rinna/youri-7b-instruction) *| 78.94 | 17.20| 54.04| 66.35|
29
+ |[youri-7b-chat](https://huggingface.co/rinna/youri-7b-chat) *| 80.92| 25.20| 53.78| 67.36|
30
+
31
  * From the [rinna's LM Benchmark](https://rinnakk.github.io/research/benchmarks/lm/index.html).
32
 
33
  ## 🧩 Configuration