Instructions to use rtikw/MOSS-Music-8B-Instruct-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use rtikw/MOSS-Music-8B-Instruct-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir MOSS-Music-8B-Instruct-4bit rtikw/MOSS-Music-8B-Instruct-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
File size: 870 Bytes
6b3e335 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | ---
license: apache-2.0
base_model: OpenMOSS-Team/MOSS-Music-8B-Instruct
tags:
- mlx
- music
- audio-language-model
---
# MOSS-Music-8B-Instruct — MLX 4-bit
An MLX conversion of
[OpenMOSS-Team/MOSS-Music-8B-Instruct](https://huggingface.co/OpenMOSS-Team/MOSS-Music-8B-Instruct)
(Apache-2.0), quantized to 4-bit (group size 64) with the `moss_music_mlx`
converter from the community MLX port of the MOSS-Music inference stack —
the same converter and layout as the `mlx-community/MOSS-Music-8B-Thinking-*`
quants. The language model, adapters, lm_head and token embeddings are
quantized; the audio encoder is kept in bf16.
Weights are otherwise unmodified. All credit to the OpenMOSS team; see the
base model card for capabilities, benchmarks and citation.
Converted for use in a local macOS music app; uploaded so its
model catalog has a stable download source.
|