SmolVLM-Instruct-BNB-NF4 / generation_config.json
Azaz666's picture
BitsAndBytes NF4 quantization of HuggingFaceTB/SmolVLM-Instruct
7b5b332 verified
{
"_from_model_config": true,
"bos_token_id": 0,
"eos_token_id": 49154,
"pad_token_id": 2,
"transformers_version": "5.3.0"
}