Barrrrry
/

DeepSeek-R1-W4AFP8

8-bit precision

Model card Files Files and versions

DeepSeek-R1-W4AFP8 / hf_quant_config.json

Barry Kang

DeepSeek-R1 W4AFP8

fd74c3f 9 months ago

history blame contribute delete

108 Bytes

	{
	"quantization": {
	"quant_algo": "MIXED_PRECISION",
	"kv_cache_quant_algo": null
	}
	}