sm280299 commited on
Commit
9be92e7
·
verified ·
1 Parent(s): 3bba25e

Update model card with MetalRT benchmarks and usage

Browse files
Files changed (1) hide show
  1. README.md +39 -3
README.md CHANGED
@@ -1,3 +1,39 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - mlx
5
+ - 4bit
6
+ - whisper
7
+ - stt
8
+ - metalrt
9
+ - apple-silicon
10
+ ---
11
+
12
+ # Whisper Tiny — MLX 4-bit Quantized
13
+
14
+ Custom MLX 4-bit quantization of [OpenAI Whisper Tiny](https://huggingface.co/openai/whisper-tiny) optimized for [MetalRT](https://github.com/RunanywhereAI/metalrt-binaries) GPU inference on Apple Silicon.
15
+
16
+ ## Usage
17
+
18
+ Used by [RCLI](https://github.com/RunanywhereAI/RCLI) with the MetalRT engine for speech-to-text:
19
+
20
+ ```bash
21
+ rcli setup # select MetalRT or Both engines
22
+ ```
23
+
24
+ ## Performance (Apple M3 Max)
25
+
26
+ | Metric | Value |
27
+ |--------|-------|
28
+ | Latency (1.2s audio) | **46 ms** |
29
+ | RTF | 0.04x |
30
+ | Quantization | MLX 4-bit |
31
+
32
+ ## License
33
+
34
+ Model weights: [MIT](https://github.com/openai/whisper/blob/main/LICENSE) (OpenAI)
35
+ MetalRT engine: [Proprietary](https://github.com/RunanywhereAI/metalrt-binaries/blob/main/LICENSE) (RunAnywhere, Inc.)
36
+
37
+ ## Contact
38
+
39
+ founder@runanywhere.ai | https://runanywhere.ai