| license: mit | |
| tags: | |
| - mlx | |
| - 4bit | |
| - whisper | |
| - stt | |
| - metalrt | |
| - apple-silicon | |
| # Whisper Small — MLX 4-bit Quantized | |
| Custom MLX 4-bit quantization of [OpenAI Whisper Small](https://huggingface.co/openai/whisper-small) optimized for [MetalRT](https://github.com/RunanywhereAI/metalrt-binaries) GPU inference on Apple Silicon. | |
| ## Usage | |
| Used by [RCLI](https://github.com/RunanywhereAI/RCLI) with the MetalRT engine for speech-to-text: | |
| ```bash | |
| rcli setup # select MetalRT or Both engines | |
| ``` | |
| > **Note**: Whisper Small is in GPU beta. Whisper Tiny is recommended for production use. | |
| ## License | |
| Model weights: [MIT](https://github.com/openai/whisper/blob/main/LICENSE) (OpenAI) | |
| MetalRT engine: [Proprietary](https://github.com/RunanywhereAI/metalrt-binaries/blob/main/LICENSE) (RunAnywhere, Inc.) | |
| ## Contact | |
| founder@runanywhere.ai | https://runanywhere.ai | |