nielsr HF Staff commited on
Commit
c345641
·
1 Parent(s): cea7a37

Push model using huggingface_hub.

Browse files
Files changed (2) hide show
  1. config.json +1 -0
  2. pytorch_model.bin +3 -0
config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"dim": 96, "n_layers": 12, "n_heads": 12, "vocab_size": 50432, "norm_eps": 1e-05, "seq_len": 2048, "post_embed_norm": false, "weight_tying": false, "norm_type": "default_layer_norm", "apply_qk_norm": false, "rotary_old": false, "ffn_type": "swiglu"}
pytorch_model.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da887524c0e0fba1385d1af306a60fd25e7a5b3490a3391ad7d0b437fb27a5a2
3
+ size 44101066