Hugging Face's logo

HachiML
/
youri-2x7b_dev

Text Generation
Transformers
Safetensors
Japanese
mixtral
Mixture of Experts
text-generation-inference
Model card Files
xet
 Community
HachiML commited on
Commit
3f59136
·
verified ·
1 Parent(s): 2ccf343

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -14,6 +14,10 @@ This model is a Mixture of Experts (MoE) merger of the following two models:
14
 
15
  ## 🏆 Evaluation
16
 
 
 
 
 
17
  | Model |JCommonsenseQA(3-shot,acc.)|JNLI(3-shot,balanced acc.)|MARC-ja(0-shot,balanced acc.)|JSQuAD(2-shot,F1)|4-AVERAGE|
18
  |----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
19
  |[**youri-2x7b_dev**](https://huggingface.co/HachiML/youri-2x7b_dev)| **91.15**| **71.03**| **95.90**| **91.30**| **87.34**|
 
14
 
15
  ## 🏆 Evaluation
16
 
17
+ All scores for these benchmarks have been evaluated using the [Stability-AI/lm-evaluation-harness](https://github.com/Stability-AI/lm-evaluation-harness/tree/jp-stable).
18
+ The results of the benchmark scores are stored in [benchmark_scores](https://huggingface.co/HachiML/youri-2x7b_dev/tree/main/benchmark_scores).
19
+ For detailed information on the scores and the conditions under which they were obtained, please refer to this link.
20
+
21
  | Model |JCommonsenseQA(3-shot,acc.)|JNLI(3-shot,balanced acc.)|MARC-ja(0-shot,balanced acc.)|JSQuAD(2-shot,F1)|4-AVERAGE|
22
  |----------------------------------------------------------------|------:|------:|---------:|-------:|------:|
23
  |[**youri-2x7b_dev**](https://huggingface.co/HachiML/youri-2x7b_dev)| **91.15**| **71.03**| **95.90**| **91.30**| **87.34**|