Update README.md

README.md

@@ -2,7 +2,31 @@
 license: mit
 ---
 
-A Moe model was constructed using microsoft/phi-2, g-ronimo/phi-2-OpenHermes-2.5, and mlx-community/phi-2-dpo-7k as the foundation. Then qlorato all layers of q,v, and gate linear on WizardLM_evol_instruct_70k via mlx.
+The Moe model was constructed using microsoft/phi-2 as the base, with experts from microsoft/phi-2, g-ronimo/phi-2-OpenHermes-2.5, and mlx-community/phi-2-dpo-7k. Then qlora was applied to all layers of q,v, and gate linear on WizardLM_evol_instruct_70k via mlx.
+The model was created using a script from https://github.com/mzbac/mlx-moe
+
+## Evaluation
+
+### hellaswag
+|  Tasks  |Version|Filter|n-shot| Metric |Value |   |Stderr|
+|---------|------:|------|-----:|--------|-----:|---|-----:|
+|hellaswag|      1|none  |     0|acc     |0.5482|±  |0.0050|
+|         |       |none  |     0|acc_norm|0.7300|±  |0.0044|
+### MMLU
+|      Groups      |Version|Filter|n-shot|Metric|Value |   |Stderr|
+|------------------|-------|------|-----:|------|-----:|---|-----:|
+| - humanities     |N/A    |none  |     0|acc   |0.5817|±  |0.0247|
+| - other          |N/A    |none  |     0|acc   |0.5795|±  |0.0311|
+| - social_sciences|N/A    |none  |     0|acc   |0.6347|±  |0.0292|
+| - stem           |N/A    |none  |     0|acc   |0.4486|±  |0.0376|
+### BBH
+|        Tasks         |Version|  Filter  |n-shot|  Metric   |Value |   |Stderr|
+|----------------------|------:|----------|-----:|-----------|-----:|---|-----:|
+|bbh_cot_fewshot_snarks|      2|get-answer|     3|exact_match|0.5281|±  |0.0375|
+### GSM8k
+|Tasks|Version|  Filter  |n-shot|  Metric   |Value |   |Stderr|
+|-----|------:|----------|-----:|-----------|-----:|---|-----:|
+|gsm8k|      2|get-answer|     5|exact_match|0.5224|±  |0.0138|
 
 ## Example
 ```