Instructions to use rtikw/MOSS-Music-8B-Instruct-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use rtikw/MOSS-Music-8B-Instruct-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir MOSS-Music-8B-Instruct-4bit rtikw/MOSS-Music-8B-Instruct-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
metadata
license: apache-2.0
base_model: OpenMOSS-Team/MOSS-Music-8B-Instruct
tags:
- mlx
- music
- audio-language-model
MOSS-Music-8B-Instruct — MLX 4-bit
An MLX conversion of
OpenMOSS-Team/MOSS-Music-8B-Instruct
(Apache-2.0), quantized to 4-bit (group size 64) with the moss_music_mlx
converter from the community MLX port of the MOSS-Music inference stack —
the same converter and layout as the mlx-community/MOSS-Music-8B-Thinking-*
quants. The language model, adapters, lm_head and token embeddings are
quantized; the audio encoder is kept in bf16.
Weights are otherwise unmodified. All credit to the OpenMOSS team; see the base model card for capabilities, benchmarks and citation.
Converted for use in a local macOS music app; uploaded so its model catalog has a stable download source.