rpreite
/

granite-3.3-8b-instruct-BNB-INT4

Text Generation

4-bit precision

Model card Files Files and versions

granite-3.3-8b-instruct-BNB-INT4 / generation_config.json

rpreite's picture

Add quantized model

1098bc1 verified 8 months ago

history blame contribute delete

132 Bytes

	{
	"_from_model_config": true,
	"bos_token_id": 0,
	"eos_token_id": 0,
	"pad_token_id": 0,
	"transformers_version": "4.52.4"
	}