sentseven/HRM-Text-1B-bucket / tokenizer_config.json
sentseven's picture
download
raw
326 Bytes
{
"add_prefix_space": null,
"backend": "tokenizers",
"bos_token": "<|im_start|>",
"eos_token": "<|box_end|>",
"is_local": true,
"local_files_only": false,
"model_max_length": 1000000000000000019884624838656,
"pad_token": "<|endoftext|>",
"tokenizer_class": "Qwen2Tokenizer",
"unk_token": "<|endoftext|>"
}

Xet Storage Details

Size:
326 Bytes
·
Xet hash:
5291b9183b0cc2bd87be533779ba5f8d86e58597b636fbbeae9d5087a6dd97aa

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.