sm280299 commited on
Commit
74e2dc7
·
verified ·
1 Parent(s): a6685ad

Update model card with MetalRT benchmarks and usage

Browse files
Files changed (1) hide show
  1. README.md +33 -3
README.md CHANGED
@@ -1,3 +1,33 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - mlx
5
+ - 4bit
6
+ - whisper
7
+ - stt
8
+ - metalrt
9
+ - apple-silicon
10
+ ---
11
+
12
+ # Whisper Small — MLX 4-bit Quantized
13
+
14
+ Custom MLX 4-bit quantization of [OpenAI Whisper Small](https://huggingface.co/openai/whisper-small) optimized for [MetalRT](https://github.com/RunanywhereAI/metalrt-binaries) GPU inference on Apple Silicon.
15
+
16
+ ## Usage
17
+
18
+ Used by [RCLI](https://github.com/RunanywhereAI/RCLI) with the MetalRT engine for speech-to-text:
19
+
20
+ ```bash
21
+ rcli setup # select MetalRT or Both engines
22
+ ```
23
+
24
+ > **Note**: Whisper Small is in GPU beta. Whisper Tiny is recommended for production use.
25
+
26
+ ## License
27
+
28
+ Model weights: [MIT](https://github.com/openai/whisper/blob/main/LICENSE) (OpenAI)
29
+ MetalRT engine: [Proprietary](https://github.com/RunanywhereAI/metalrt-binaries/blob/main/LICENSE) (RunAnywhere, Inc.)
30
+
31
+ ## Contact
32
+
33
+ founder@runanywhere.ai | https://runanywhere.ai