junnyu
/

roformer_chinese_base

Model card Files Files and versions

junnyu commited on Jun 10, 2021

Commit

aab34c5

·

1 Parent(s): c7887b9

Update config.json

Files changed (1) hide show

config.json +1 -0

config.json CHANGED Viewed

@@ -7,6 +7,7 @@
   "embedding_size": 768,
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
   "initializer_range": 0.02,
   "intermediate_size": 3072,
   "layer_norm_eps": 1e-12,

   "embedding_size": 768,
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
+  "max_position_embeddings":1536,
   "initializer_range": 0.02,
   "intermediate_size": 3072,
   "layer_norm_eps": 1e-12,