Hugging Face's logo

bennny674
/
SmolMoE-256x360M

Text Generation
Transformers
Safetensors
mixtral
text-generation-inference
Model card Files
xet
Community
bennny674 commited on
Commit
6a0ef5d
·
verified ·
1 Parent(s): 5c7b473

Create README.md

Browse files

A MoE made by attempting to sparse upcycle SmolLM2-360M into a MoE, it isnt trained yet

Files changed (1) hide show
  1. README.md +5 -0
README.md ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ ---
2
+ base_model:
3
+ - HuggingFaceTB/SmolLM2-360M
4
+ library_name: transformers
5
+ ---