m-i
/

K2-Think-mlx-8Bit

Text Generation

text-generation-inference

8-bit precision

Model card Files Files and versions

K2-Think-mlx-8Bit / generation_config.json

m-i's picture

m-i

Upload generation_config.json with huggingface_hub

5b09f0d verified 4 months ago

history blame contribute delete

117 Bytes

	{
	"bos_token_id": 151643,
	"eos_token_id": 151645,
	"max_new_tokens": 2048,
	"transformers_version": "4.52.4"
	}