MERaLiON-3-10B-RotorQuant-MLX-4bit / decoder_config.json

Commit History

Re-upload with properly quantized decoder (encoder/adaptor bf16)
7f1bc8b
verified

majentik commited on

Add MLX quantized model with KV cache compression
918e195
verified

majentik commited on