Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
majentik
/
Mistral-Small-4-119B-RotorQuant-MLX-2bit
like
0
Text Generation
MLX
Safetensors
mistral3
rotorquant
kv-cache-quantization
mistral
Mixture of Experts
sparse-moe
multimodal
quantized
2-bit
apple-silicon
256k-context
thinking
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Use this model
main
Mistral-Small-4-119B-RotorQuant-MLX-2bit
/
generation_config.json
majentik
Add MLX quantized model weights
ba08f9e
verified
2 days ago
raw
Copy download link
history
blame
contribute
delete
Safe
132 Bytes
{
"bos_token_id"
:
1
,
"eos_token_id"
:
2
,
"max_length"
:
1048576
,
"pad_token_id"
:
11
,
"transformers_version"
:
"5.3.0.dev0"
}