breadlicker45
/

MusePy

Text Generation

text-generation-inference

Model card Files Files and versions

breadlicker45 commited on Dec 27, 2022

Commit

b24d460

·

1 Parent(s): 8e6da9b

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -12,7 +12,7 @@
   "layer_norm_eps": 1e-05,
   "line_by_line": true,
   "max_position_embeddings": 2048,
-  "model_type": "gpt_neox",
   "num_attention_heads": 8,
   "num_hidden_layers": 6,
   "rotary_emb_base": 10000,

   "layer_norm_eps": 1e-05,
   "line_by_line": true,
   "max_position_embeddings": 2048,
+  "model_type": "pythia-19m",
   "num_attention_heads": 8,
   "num_hidden_layers": 6,
   "rotary_emb_base": 10000,