MiniMax-H3_NF4 / quantized /text_encoder-int8 /generation_config.json
corechan's picture
quantized text_encoder (int8) from memory
e477a62 verified
Raw History Blame Contribute Delete
142 Bytes
{
"_from_model_config": true,
"bos_token_id": 151643,
"eos_token_id": 151645,
"transformers_version": "5.16.1",
"use_cache": true
}