initial config (large-belief-config.json)
Browse files- large-belief-config.json +1 -0
large-belief-config.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"embed_dim": 256, "n_heads": 8, "n_layers": 6, "ff_dim": 512, "tokenizer": "v1", "belief_head": true}
|