amd
/

dbrx-base-FP8-KV

Model card Files Files and versions

dbrx-base-FP8-KV / generation_config.json

xniu's picture

fp8 quantization of dbrx-base

65828f0 verified over 1 year ago

105 Bytes

	{
	"_from_model_config": true,
	"eos_token_id": [
	100257
	],
	"transformers_version": "4.45.2"
	}