MERaLiON-3-10B-RotorQuant-MLX-2bit / decoder_config.json

Commit History

Re-upload with properly quantized decoder (encoder/adaptor bf16)
ebafd04
verified

majentik commited on

Add MLX quantized model with KV cache compression
e103c43
verified

majentik commited on