Ivme-Conversate-v3.1-Base / tokenizer_meta.json
ereniko's picture
Add Ivme-Conversate-v3.1-Base (CPT of v3 on 31.4B dense tokens)
07d8f8e verified
Raw History Blame Contribute Delete
113 Bytes
{
"eot_token": "<|endoftext|>",
"eot_id": 0,
"pad_token": "<|pad|>",
"pad_id": 1,
"vocab_size": 16000
}