majentik/MERaLiON-2-3B-RotorQuant-MLX-4bit at main

MERaLiON-2-3B-RotorQuant-MLX-4bit

3.22 GB

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

majentik's picture

Add MLX quantized model with KV cache compression

1785a33 verified 2 days ago

.gitattributes

1.63 kB
Add MLX quantized model with KV cache compression 2 days ago
README.md

3.56 kB
Add MLX quantized model with KV cache compression 2 days ago
adaptor.safetensors

439 MB
xet

Add MLX quantized model with KV cache compression 2 days ago
adaptor_config.json

82 Bytes
Add MLX quantized model with KV cache compression 2 days ago
config.json

2.79 kB
Add MLX quantized model with KV cache compression 2 days ago
decoder-00000.safetensors

1.47 GB
xet

Add MLX quantized model with KV cache compression 2 days ago
decoder.safetensors.index.json

49.3 kB
Add MLX quantized model with KV cache compression 2 days ago
decoder_config.json

975 Bytes
Add MLX quantized model with KV cache compression 2 days ago
encoder.safetensors

1.27 GB
xet

Add MLX quantized model with KV cache compression 2 days ago
encoder_config.json

1.21 kB
Add MLX quantized model with KV cache compression 2 days ago
generation_config.json

197 Bytes
Add MLX quantized model with KV cache compression 2 days ago
preprocessor_config.json

443 Bytes
Add MLX quantized model with KV cache compression 2 days ago
processor_config.json

281 Bytes
Add MLX quantized model with KV cache compression 2 days ago
special_tokens_map.json

636 Bytes
Add MLX quantized model with KV cache compression 2 days ago
tokenizer.json

34.4 MB
xet

Add MLX quantized model with KV cache compression 2 days ago
tokenizer.model

4.24 MB
xet

Add MLX quantized model with KV cache compression 2 days ago
tokenizer_config.json

46.9 kB
Add MLX quantized model with KV cache compression 2 days ago