grt-30m-tokenizer / config.json
davidhouseholter's picture
Release MatterWaveAI/grt-30m-tokenizer (BPE tokenizer + 19.57M shared polar phase-angle embedding bank)
78b5a99 verified
Raw History Blame Contribute Delete
308 Bytes
{
"model_type": "grt",
"vocab_size": 151669,
"hidden_size": 256,
"n_pairs": 128,
"bos_token_id": 151643,
"eos_token_id": 151643,
"pad_token_id": 151643,
"output_scale_init": 30.0,
"polar_embedding_parameters": 19565302,
"polar_embedding_file": "polar_embedding.safetensors"
}