rectx
/

Qwen3.5-4B-Base-bnb-4bit

4-bit precision

Model card Files Files and versions

Qwen3.5-4B-Base-bnb-4bit / generation_config.json

rectx's picture

Upload BNB NF4 quantized model

03f2798 verified about 2 months ago

History Blame Contribute Delete

115 Bytes

	{
	"_from_model_config": true,
	"eos_token_id": 248044,
	"transformers_version": "5.9.0",
	"use_cache": true
	}