sm280299 commited on
Commit
ac1edf5
·
verified ·
1 Parent(s): ea2505c

Update model card with MetalRT benchmarks and usage

Browse files
Files changed (1) hide show
  1. README.md +41 -3
README.md CHANGED
@@ -1,3 +1,41 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - mlx
5
+ - 4bit
6
+ - whisper
7
+ - stt
8
+ - metalrt
9
+ - apple-silicon
10
+ ---
11
+
12
+ # Whisper Medium — MLX 4-bit Quantized
13
+
14
+ Custom MLX 4-bit quantization of [OpenAI Whisper Medium](https://huggingface.co/openai/whisper-medium) optimized for [MetalRT](https://github.com/RunanywhereAI/metalrt-binaries) GPU inference on Apple Silicon.
15
+
16
+ ## Usage
17
+
18
+ Used by [RCLI](https://github.com/RunanywhereAI/RCLI) with the MetalRT engine for speech-to-text:
19
+
20
+ ```bash
21
+ rcli setup # select MetalRT or Both engines
22
+ ```
23
+
24
+ > **Note**: Whisper Medium is in GPU beta. Whisper Tiny is recommended for production use.
25
+
26
+ ## Performance (Apple M3 Max)
27
+
28
+ | Metric | Value |
29
+ |--------|-------|
30
+ | Latency (1.2s audio) | 233 ms |
31
+ | RTF | 0.19x |
32
+ | Quantization | MLX 4-bit |
33
+
34
+ ## License
35
+
36
+ Model weights: [MIT](https://github.com/openai/whisper/blob/main/LICENSE) (OpenAI)
37
+ MetalRT engine: [Proprietary](https://github.com/RunanywhereAI/metalrt-binaries/blob/main/LICENSE) (RunAnywhere, Inc.)
38
+
39
+ ## Contact
40
+
41
+ founder@runanywhere.ai | https://runanywhere.ai