zeb-42 / large-config.json
jasonyandell's picture
initial config (large-config.json)
01c6268 verified
raw
history blame contribute delete
81 Bytes
{"embed_dim": 256, "n_heads": 8, "n_layers": 6, "ff_dim": 512, "tokenizer": "v1"}