junnyu
/

electra_small_generator

Model card Files Files and versions

junnyu commited on May 16, 2021

Commit

6e7a1bb

·

1 Parent(s): 30c5aa2

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -12,7 +12,7 @@
     "layer_norm_eps": 1e-12,
     "max_position_embeddings": 512,
     "model_type": "electra",
-    "num_attention_heads": 4,
     "num_hidden_layers": 12,
     "pad_token_id": 0,
     "position_embedding_type": "absolute",

     "layer_norm_eps": 1e-12,
     "max_position_embeddings": 512,
     "model_type": "electra",
+    "num_attention_heads": 1,
     "num_hidden_layers": 12,
     "pad_token_id": 0,
     "position_embedding_type": "absolute",