davidquarel
/

jblock.shk_64x4-sparse-3.3e-01

Upload folder using huggingface_hub

76bebfd verified 12 months ago

111 Bytes

{"block_size": 128, "vocab_size": 128, "n_layer": 4, "n_head": 4, "n_embd": 64, "norm_strategy": "DynamicTanh"}