Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
Kimi-K2-Instruct-quantized.w4a16
like
12
Follow
Red Hat AI
1.75k
Text Generation
Safetensors
English
deepseek_v3
kimi-k2
MOE
neuralmagic
redhat
llmcompressor
quantized
INT4
GPTQ
conversational
compressed-tensors
custom_code
License:
modified-mit
Model card
Files
Files and versions
xet
Community
3
main
Kimi-K2-Instruct-quantized.w4a16
/
generation_config.json
ekurtic
Add files using upload-large-folder tool
e46ba8a
verified
5 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
121 Bytes
{
"_from_model_config"
:
true
,
"bos_token_id"
:
163584
,
"eos_token_id"
:
163585
,
"transformers_version"
:
"4.50.0"
}