Llama-1B-Clean-BPE-init / tokenizer_config.json
qingy2024's picture
Init weights: Llama 1B (16L/2048H/32A/8KV) + clean BPE 32K tokenizer
7beeda2 verified
Raw
History Blame Contribute Delete
84 Bytes
{
"tokenizer_class": "PreTrainedTokenizerFast",
"model_max_length": 1000000000
}