Upload modular/mod_sorl_1L4H64d/final/sorl_config.json with huggingface_hub
Browse files
modular/mod_sorl_1L4H64d/final/sorl_config.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"K": 1, "abs_vocab": 30, "p": 113, "n_layer": 1, "n_head": 4, "n_embd": 64, "d_mlp": 256}
|