--- license: apache-2.0 library_name: mlx tags: - mlx - int8 - automatic-speech-recognition - speaker-diarization base_model: - vanch007/mlx-MOSS-Transcribe-Diarize pipeline_tag: automatic-speech-recognition --- # mlx-MOSS-Transcribe-Diarize 8bit 8bit MLX weight-only quantized variant of `vanch007/mlx-MOSS-Transcribe-Diarize`. Quantization uses MLX affine quantization with `bits=8` and `group_size=64` on the text backbone, excluding the Whisper audio encoder and VQ adaptor. ```bash python -m moss_transcribe_diarize.mlx.cli /path/to/input.wav \ --model plaincompute/mlx-MOSS-Transcribe-Diarize-8bit \ --out-dir runs/mlx_8bit_example ```