majentik/MERaLiON-2-10B-RotorQuant-MLX-4bit at main

MERaLiON-2-10B-RotorQuant-MLX-4bit

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

majentik's picture

Add MLX quantized model with KV cache compression

6dbaaa2 verified 3 days ago

.gitattributes

1.63 kB
Add MLX quantized model with KV cache compression 3 days ago
README.md

3.45 kB
Add MLX quantized model with KV cache compression 3 days ago
adaptor.safetensors

456 MB
xet

Add MLX quantized model with KV cache compression 3 days ago
adaptor_config.json

82 Bytes
Add MLX quantized model with KV cache compression 3 days ago
config.json

2.82 kB
Add MLX quantized model with KV cache compression 3 days ago
decoder-00000.safetensors

5.2 GB
xet

Add MLX quantized model with KV cache compression 3 days ago
decoder.safetensors.index.json

79.6 kB
Add MLX quantized model with KV cache compression 3 days ago
decoder_config.json

896 Bytes
Add MLX quantized model with KV cache compression 3 days ago
encoder.safetensors

1.27 GB
xet

Add MLX quantized model with KV cache compression 3 days ago
encoder_config.json

1.21 kB
Add MLX quantized model with KV cache compression 3 days ago
generation_config.json

197 Bytes
Add MLX quantized model with KV cache compression 3 days ago
preprocessor_config.json

443 Bytes
Add MLX quantized model with KV cache compression 3 days ago
processor_config.json

281 Bytes
Add MLX quantized model with KV cache compression 3 days ago
special_tokens_map.json

636 Bytes
Add MLX quantized model with KV cache compression 3 days ago
tokenizer.json

34.4 MB
xet

Add MLX quantized model with KV cache compression 3 days ago
tokenizer.model

4.24 MB
xet

Add MLX quantized model with KV cache compression 3 days ago
tokenizer_config.json

46.9 kB
Add MLX quantized model with KV cache compression 3 days ago