majentik/Mistral-Small-4-119B-RotorQuant-MLX-4bit at main

Mistral-Small-4-119B-RotorQuant-MLX-4bit

67.8 GB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

majentik's picture

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression

9968358 verified 3 days ago

.gitattributes

1.89 kB
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
README.md

3.57 kB
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
chat_template.jinja

5.92 kB
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
config.json

11 kB
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
consolidated.safetensors.index.json

3.62 MB
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
generation_config.json

132 Bytes
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00001-of-00014.safetensors

5.36 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00002-of-00014.safetensors

4.99 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00003-of-00014.safetensors

4.89 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00004-of-00014.safetensors

4.92 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00005-of-00014.safetensors

4.92 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00006-of-00014.safetensors

4.89 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00007-of-00014.safetensors

4.92 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00008-of-00014.safetensors

4.92 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00009-of-00014.safetensors

4.89 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00010-of-00014.safetensors

4.92 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00011-of-00014.safetensors

4.92 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00012-of-00014.safetensors

4.89 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00013-of-00014.safetensors

4.92 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model-00014-of-00014.safetensors

3.37 GB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
model.safetensors.index.json

182 kB
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
params.json

1.51 kB
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
processor_config.json

701 Bytes
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
tekken.json

16.3 MB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
tokenizer.json

17.1 MB
xet

Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago
tokenizer_config.json

21.2 kB
Add MLX 4-bit quantized Mistral Small 4 with KV cache compression 3 days ago