Hugging Face's logo

GeneZC
/
MiniMA-2-1B

Text Generation
Transformers
PyTorch
Safetensors
English
Chinese
llama
text-generation-inference
Model card Files
xet
Community
1
GeneZC commited on
Commit
0c8cabc
·
verified ·
1 Parent(s): 0246a3e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -16
README.md CHANGED
@@ -21,25 +21,22 @@ widget:
21
 
22
  **Standard Benchmarks**
23
 
24
- ||TFLOPs|MMLU (5-shot)|CEval (5-shot)|DROP (3-shot)|HumanEval (0-shot)|BBH (3-shot)|GSM8K (8-shot)|
25
  |--|--|--|--|--|--|--|--|
26
- |LLaMA-MoE-v1-3.5B-4_16|84.0+4.2E9|26.69|24.67|23.40|6.10|30.26|5.38|
27
- |JetMoE-8B|16.5E9|48.24|36.03|30.63|24.39|33.86|40.71|
28
- |DeepSeek-MoE-16B-base|33.6E9|44.64|39.90|29.74|26.83|31.95|17.06|
29
- |MiniCPM-MoE-8x2B|14.4+24.0E9|55.38|54.01|31.39|47.56|37.15|54.81|
30
- |Qwen1.5-MoE-A2.7B|23.8+35.7E9|59.56|79.27|32.87|33.54|39.12|65.13|
31
- |Phixtral-2x2.8B|159.9E9|53.91|32.24|32.28|47.56|44.29|58.53|
32
- |Mixtral-8x7B-v0.1|336.0E9|70.50|53.94|57.74|32.32|48.79|59.59|
33
  ||
 
 
34
  |MiniMA-2-3B|13.4E9|40.14|44.65|23.10|14.63|31.43|8.87|
35
- |MiniMix-2/4x3B-Kickoff|+0.1E9|34.30|33.51|21.34|10.37|30.35|6.60|
36
- |MiniMix-2/4x3B-Biweek1|+2.0E9|41.17|41.75|27.24|15.85|32.17|14.25|
37
- |MiniMix-2/4x3B-Biweek2|+4.0E9|41.35|40.79|28.62|18.90|31.66|13.34|
38
- |MiniMix-2/4x3B-Biweek3|+6.0E9|41.58|44.21|30.68|17.68|32.91|16.07|
39
- |MiniMix-2/4x3B-Biweek4|+8.0E9|43.14|44.21|31.33|18.29|32.61|16.98|
40
- |MiniMix-2/4x3B-Biweek5|+10.0E9|43.75|45.10|32.47|18.29|33.71|21.99|
41
- |MiniMix-2/4x3B-Biweek6|+12.0E9|44.57|45.39|33.35|20.12|33.43|22.52|
42
- |MiniMix-2/4x3B-Release|+12.0E9|44.35|45.77|33.78|18.29|33.60|21.61|
43
 
44
  ## Bibtex
45
 
 
21
 
22
  **Standard Benchmarks**
23
 
24
+ |Method|TFLOPs|MMLU (5-shot)|CEval (5-shot)|DROP (3-shot)|HumanEval (0-shot)|BBH (3-shot)|GSM8K (8-shot)|
25
  |--|--|--|--|--|--|--|--|
26
+ |Mamba-2.8B|4.6E9|25.58|24.74|15.72|7.32|29.37|3.49|
27
+ |ShearedLLaMA-2.7B|0.8E9|26.97|22.88|19.98|4.88|30.48|3.56|
28
+ |BTLM-3B|11.3E9|27.20|26.00|17.84|10.98|30.87|4.55|
29
+ |StableLM-3B|72.0E9|44.75|31.05|22.35|15.85|32.59|10.99|
30
+ |Qwen-1.8B|23.8E9|44.05|54.75|12.97|14.02|30.80|22.97|
31
+ |Phi-2-2.8B|159.9E9|56.74|34.03|30.74|46.95|44.13|55.42|
32
+ |LLaMA-2-7B|84.0E9|46.00|34.40|31.57|12.80|32.02|14.10|
33
  ||
34
+ |MiniMA-3B|4.0E9|28.51|28.23|22.50|10.98|31.61|8.11|
35
+ |MiniMA-2-1B|6.3E9|31.34|34.92|20.08|10.37|31.16|7.28|
36
  |MiniMA-2-3B|13.4E9|40.14|44.65|23.10|14.63|31.43|8.87|
37
+ |MiniMix-2/4x3B|25.4E9|44.35|45.77|33.78|18.29|33.60|21.61|
38
+ |MiniChat-3B|4.0E9|38.40|36.48|22.58|18.29|31.36|29.72|
39
+ |MiniChat-2-3B|13.4E9|46.17|43.91|30.26|22.56|34.95|38.13|
 
 
 
 
 
40
 
41
  ## Bibtex
42