Safetensors
Chinese
ViperEk commited on
Commit
f48bec8
·
1 Parent(s): 256897b

add model, config and param

Browse files
Files changed (2) hide show
  1. config.json +10 -0
  2. tokenizer.json +0 -0
config.json ADDED
@@ -0,0 +1,10 @@
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "vocab_size": 60000,
3
+ "n_dim": 1024,
4
+ "n_head": 16,
5
+ "d_ffn": 4096,
6
+ "m_len": 1024,
7
+ "n_layer": 12,
8
+ "norm_eps": 1e-5,
9
+ "flash_attn": true
10
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff