Omaratef3221
/

custom_bert_with_rbf

Omaratef3221 commited on Sep 7, 2024

Commit

7563185

verified ·

1 Parent(s): 4e16720

Upload folder using huggingface_hub

Files changed (1) hide show

config.json CHANGED Viewed

@@ -10,7 +10,7 @@
   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
   "initializer_range": 0.02,
-  "intermediate_size": 3072,  # Size of intermediate feedforward layers (before RBF)
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
   "model_type": "bert",

   "hidden_dropout_prob": 0.1,
   "hidden_size": 768,
   "initializer_range": 0.02,
+  "intermediate_size": 3072,
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
   "model_type": "bert",