LLM-1B-Lab / tokenizer /tokenizer_meta.json
Vjeong's picture
Upload folder using huggingface_hub
bd4e64b verified
raw
history blame contribute delete
70 Bytes
{
"vocab_size": 32000,
"bos_id": 1,
"eos_id": 2,
"pad_id": 0
}