rtikw's picture
MLX 4-bit conversion of OpenMOSS-Team/MOSS-Music-8B-Instruct (moss_music_mlx converter, group 64)
6b3e335 verified
|
Raw
History Blame Contribute Delete
870 Bytes
---
license: apache-2.0
base_model: OpenMOSS-Team/MOSS-Music-8B-Instruct
tags:
- mlx
- music
- audio-language-model
---
# MOSS-Music-8B-Instruct — MLX 4-bit
An MLX conversion of
[OpenMOSS-Team/MOSS-Music-8B-Instruct](https://huggingface.co/OpenMOSS-Team/MOSS-Music-8B-Instruct)
(Apache-2.0), quantized to 4-bit (group size 64) with the `moss_music_mlx`
converter from the community MLX port of the MOSS-Music inference stack —
the same converter and layout as the `mlx-community/MOSS-Music-8B-Thinking-*`
quants. The language model, adapters, lm_head and token embeddings are
quantized; the audio encoder is kept in bf16.
Weights are otherwise unmodified. All credit to the OpenMOSS team; see the
base model card for capabilities, benchmarks and citation.
Converted for use in a local macOS music app; uploaded so its
model catalog has a stable download source.