ybelkada
/

tiny-random-LlamaForCausalLM-GQA

Text Generation

text-generation-inference

Model card Files Files and versions

ybelkada commited on Nov 17, 2023

Commit

eace309

·

1 Parent(s): 25978d5

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -8,7 +8,7 @@
   "bos_token_id": 0,
   "eos_token_id": 1,
   "hidden_act": "silu",
-  "hidden_size": 16,
   "initializer_range": 0.02,
   "intermediate_size": 64,
   "max_position_embeddings": 2048,

   "bos_token_id": 0,
   "eos_token_id": 1,
   "hidden_act": "silu",
+  "hidden_size": 128,
   "initializer_range": 0.02,
   "intermediate_size": 64,
   "max_position_embeddings": 2048,