mert0_1 / tokenizer_config.json
mertefeisawesome's picture
Upload tokenizer
23ea596 verified
raw
history blame contribute delete
127 Bytes
{
"backend": "tokenizers",
"model_max_length": 1000000000000000019884624838656,
"tokenizer_class": "TokenizersBackend"
}