Automatic Speech Recognition
Safetensors
MLX
mlx-audio
moss_transcribe_diarize
speaker-diarization
timestamps
custom_code
8-bit precision
Instructions to use kuotient/MOSS-Transcribe-Diarize-MLX-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use kuotient/MOSS-Transcribe-Diarize-MLX-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir MOSS-Transcribe-Diarize-MLX-8bit kuotient/MOSS-Transcribe-Diarize-MLX-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
| { | |
| "source": "OpenMOSS-Team/MOSS-Transcribe-Diarize", | |
| "format": "mlx-safetensors", | |
| "model_type": "moss_transcribe_diarize", | |
| "quantization": { | |
| "bits": 8, | |
| "group_size": 64, | |
| "mode": "affine", | |
| "scope": "text_backbone_linears_only", | |
| "excluded_prefixes": ["model.whisper_encoder", "model.vq_adaptor"], | |
| "excluded_layers": ["model.language_model.embed_tokens"], | |
| "note": "Token embedding kept full precision: mlx-audio-swift loads it as a plain Embedding and does not swap quantized embeddings, so a quantized embed_tokens fails its load-time shape check." | |
| } | |
| } | |