File size: 660 Bytes
7dcbf60 0fe2ff3 7dcbf60 0fe2ff3 2676efc 0fe2ff3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | ---
license: apache-2.0
library_name: mlx
tags:
- mlx
- int8
- automatic-speech-recognition
- speaker-diarization
base_model:
- vanch007/mlx-MOSS-Transcribe-Diarize
pipeline_tag: automatic-speech-recognition
---
# mlx-MOSS-Transcribe-Diarize 8bit
8bit MLX weight-only quantized variant of `vanch007/mlx-MOSS-Transcribe-Diarize`.
Quantization uses MLX affine quantization with `bits=8` and `group_size=64` on the text backbone, excluding the Whisper audio encoder and VQ adaptor.
```bash
python -m moss_transcribe_diarize.mlx.cli /path/to/input.wav \
--model plaincompute/mlx-MOSS-Transcribe-Diarize-8bit \
--out-dir runs/mlx_8bit_example
```
|