aterreno/emma-5 / tokenizer_config.json
aterreno's picture
download
raw
128 Bytes
{
"tokenizer_type": "sentencepiece",
"model_file": "bpe.model",
"pad_id": 0,
"unk_id": 1,
"bos_id": 2,
"eos_id": 3
}

Xet Storage Details

Size:
128 Bytes
·
Xet hash:
c675c8fb3deaabc2ce471b8b98a8df5a0358e4cedb0ceaa4389349a474186f3b

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.