dilip025
/

mini-gpt1

Text Generation

decoder-only-transformer

generative-pretrained-transformer

Model card Files Files and versions

dilip025 commited on Jun 1, 2025

Commit

6228521

·

verified ·

1 Parent(s): 09d712b

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -1,7 +1,7 @@
 {
     "model_type": "decoder-only-transformer",
     "vocab_size": 35000,
-    "max_len": 256,
     "embed_dim": 512,
     "num_heads": 8,
     "depth": 6,

 {
     "model_type": "decoder-only-transformer",
     "vocab_size": 35000,
+    "max_len": 128,
     "embed_dim": 512,
     "num_heads": 8,
     "depth": 6,