appvoid
/

palmer-004-overfit

Text Generation

text-generation-inference

Model card Files Files and versions

appvoid commited on May 7, 2024

Commit

21c209f

·

verified ·

1 Parent(s): 3e89555

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -13,7 +13,7 @@
   "intermediate_size": 5632,
   "max_position_embeddings": 2048,
   "model_type": "llama",
-  "num_attention_heads": 31,
   "num_hidden_layers": 22,
   "num_key_value_heads": 4,
   "pretraining_tp": 1,

   "intermediate_size": 5632,
   "max_position_embeddings": 2048,
   "model_type": "llama",
+  "num_attention_heads": 32,
   "num_hidden_layers": 22,
   "num_key_value_heads": 4,
   "pretraining_tp": 1,