pragya-e2 / tokenizer /tokenizer_config.json
ArushBuilds's picture
Push model artifacts + checkpoints (whitelisted)
bdf0b03 verified
Raw History Blame Contribute Delete
102 Bytes
{
"vocab_size": 12288,
"bos_id": 12287,
"eos_id": 12287,
"pad_id": 12287,
"unk_id": 12287
}