DLMveloper/DuckyModel_V1-bucket / tokenizer_config.json
DLMveloper's picture
download
raw
172 Bytes
{
"model_max_length": 1024,
"bos_token": "<bos>",
"eos_token": "<eos>",
"unk_token": "<unk>",
"pad_token": "<pad>",
"tokenizer_class": "ByteLevelBPETokenizer"
}

Xet Storage Details

Size:
172 Bytes
·
Xet hash:
d881523cf46614d7197a92010cac6ea870d46c9c2ee4348e59ba6c1b78efcf33

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.