AlignmentLab-AI
/

teensyorca

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Alignment-Lab-AI commited on Jan 13, 2024

Commit

e0e5042

·

verified ·

1 Parent(s): dc8a80c

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -8,7 +8,7 @@
   "bos_token_id": 1,
   "eos_token_id": 2,
   "hidden_act": "silu",
-  "hidden_size": 512,
   "initializer_range": 0.02,
   "intermediate_size": 5632,
   "max_position_embeddings": 2048,

   "bos_token_id": 1,
   "eos_token_id": 2,
   "hidden_act": "silu",
+  "hidden_size": 2048,
   "initializer_range": 0.02,
   "intermediate_size": 5632,
   "max_position_embeddings": 2048,