Hugging Face's logo

inclusionAI
/
Ling-3.0-tiny-base

Safetensors
bailing_hybrid
custom_code
Model card Files
xet
 Community
yuxintian commited on
Commit
4b3b2d1
·
verified ·
1 Parent(s): bdd1bdf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -33,7 +33,7 @@ These checkpoints are released to support continued pretraining, fine-tuning, an
33
  + **Scale Seamlessly:** Ling-3.0-tiny-base and Ling-3.0-flash-base share the same training recipe, enabling community to experiment on the Ling-3.0-tiny-base first and then scale validated training strategies to the larger Ling-3.0-flash-base.
34
 
35
 
36
- | Model Type | Base (final checkpoint of pre-training) |
37
  |---|---|
38
  | Architecture | Hybrid-linear MoE |
39
  | Parameter Scale | Totoal 7.9B, Activated 1.3B |
 
33
  + **Scale Seamlessly:** Ling-3.0-tiny-base and Ling-3.0-flash-base share the same training recipe, enabling community to experiment on the Ling-3.0-tiny-base first and then scale validated training strategies to the larger Ling-3.0-flash-base.
34
 
35
 
36
+ | Model Type | Base (final checkpoint of WSM merging) |
37
  |---|---|
38
  | Architecture | Hybrid-linear MoE |
39
  | Parameter Scale | Totoal 7.9B, Activated 1.3B |