d-test-model / tokenizer_config.json
maybekiddo's picture
Upload folder using huggingface_hub
aab606d verified
{
"tokenizer_class": "LlamaTokenizer",
"model_max_length": 4096
}