Instructions to use rtikw/MOSS-Music-8B-Instruct-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use rtikw/MOSS-Music-8B-Instruct-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir MOSS-Music-8B-Instruct-4bit rtikw/MOSS-Music-8B-Instruct-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
| license: apache-2.0 | |
| base_model: OpenMOSS-Team/MOSS-Music-8B-Instruct | |
| tags: | |
| - mlx | |
| - music | |
| - audio-language-model | |
| # MOSS-Music-8B-Instruct — MLX 4-bit | |
| An MLX conversion of | |
| [OpenMOSS-Team/MOSS-Music-8B-Instruct](https://huggingface.co/OpenMOSS-Team/MOSS-Music-8B-Instruct) | |
| (Apache-2.0), quantized to 4-bit (group size 64) with the `moss_music_mlx` | |
| converter from the community MLX port of the MOSS-Music inference stack — | |
| the same converter and layout as the `mlx-community/MOSS-Music-8B-Thinking-*` | |
| quants. The language model, adapters, lm_head and token embeddings are | |
| quantized; the audio encoder is kept in bf16. | |
| Weights are otherwise unmodified. All credit to the OpenMOSS team; see the | |
| base model card for capabilities, benchmarks and citation. | |
| Converted for use in a local macOS music app; uploaded so its | |
| model catalog has a stable download source. | |