hbfreed commited on
Commit
d607308
·
verified ·
1 Parent(s): 5a73138

Upload folder using huggingface_hub

Browse files
Files changed (2) hide show
  1. model.safetensors +3 -0
  2. pruning_config.json +5 -0
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:039c7d17a9267807e003c9d3c23c6fb1bd4cf733f4243126927d48801e658023
3
+ size 21040268152
pruning_config.json ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {
2
+ "base_model": "allenai/Flex-math-2x7B-1T",
3
+ "importance_type": "general",
4
+ "expert_1_width": 8192
5
+ }