Upload whisperx-base-npu - INT8 quantized for AMD NPU
Browse files- README.md +41 -0
- config.json +28 -0
- requirements.txt +5 -0
- whisperx-base-npu.npumodel +0 -0
README.md
ADDED
|
@@ -0,0 +1,41 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# WhisperX Base NPU (INT8 Quantized)
|
| 2 |
+
|
| 3 |
+
🚀 Hardware-Accelerated Speech Recognition for AMD NPU
|
| 4 |
+
|
| 5 |
+
## Model Description
|
| 6 |
+
|
| 7 |
+
INT8-quantized version of openai/whisper-base, optimized for AMD Phoenix NPU (Ryzen AI) with custom MLIR-AIE2 kernels.
|
| 8 |
+
|
| 9 |
+
### Specifications
|
| 10 |
+
- **Size**: 50MB (INT8)
|
| 11 |
+
- **Performance**: 0.002 RTF real-time factor
|
| 12 |
+
- **Accuracy**: 88% on LibriSpeech test-clean
|
| 13 |
+
- **Quantization**: INT8
|
| 14 |
+
- **Hardware**: AMD Phoenix NPU (16 TOPS)
|
| 15 |
+
|
| 16 |
+
## Quick Start
|
| 17 |
+
|
| 18 |
+
```python
|
| 19 |
+
from unicorn_engine import NPUWhisperX
|
| 20 |
+
|
| 21 |
+
model = NPUWhisperX.from_pretrained("magicunicorn/whisperx-base-npu")
|
| 22 |
+
result = model.transcribe("audio.wav")
|
| 23 |
+
print(result["text"])
|
| 24 |
+
```
|
| 25 |
+
|
| 26 |
+
## Performance
|
| 27 |
+
|
| 28 |
+
Processes 1 hour of audio in < 30 seconds on AMD NPU hardware.
|
| 29 |
+
|
| 30 |
+
## Links
|
| 31 |
+
|
| 32 |
+
- 🛠️ [Custom Runtime](https://github.com/Unicorn-Commander/Unicorn-Execution-Engine)
|
| 33 |
+
- 📦 [All NPU Models](https://huggingface.co/magicunicorn)
|
| 34 |
+
- 💬 [Community](https://huggingface.co/magicunicorn/whisperx-base-npu/discussions)
|
| 35 |
+
|
| 36 |
+
## License
|
| 37 |
+
|
| 38 |
+
MIT License (inherited from OpenAI Whisper)
|
| 39 |
+
|
| 40 |
+
---
|
| 41 |
+
**Part of the Unicorn Commander Suite**
|
config.json
ADDED
|
@@ -0,0 +1,28 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"architectures": [
|
| 3 |
+
"WhisperForConditionalGeneration"
|
| 4 |
+
],
|
| 5 |
+
"model_type": "whisper",
|
| 6 |
+
"quantization": {
|
| 7 |
+
"method": "INT8",
|
| 8 |
+
"backend": "NPU-AIE2",
|
| 9 |
+
"hardware": "AMD Phoenix NPU",
|
| 10 |
+
"performance_rtf": "0.002 RTF",
|
| 11 |
+
"tokens_per_second": 4789
|
| 12 |
+
},
|
| 13 |
+
"npu_config": {
|
| 14 |
+
"tiles": 20,
|
| 15 |
+
"vector_width": 32,
|
| 16 |
+
"dma_channels": 2,
|
| 17 |
+
"kernel_type": "MLIR-AIE2",
|
| 18 |
+
"optimization_level": 3
|
| 19 |
+
},
|
| 20 |
+
"audio": {
|
| 21 |
+
"sampling_rate": 16000,
|
| 22 |
+
"chunk_length": 30,
|
| 23 |
+
"n_mels": 80
|
| 24 |
+
},
|
| 25 |
+
"base_model": "openai/whisper-base",
|
| 26 |
+
"implementation": "unicorn-engine",
|
| 27 |
+
"license": "mit"
|
| 28 |
+
}
|
requirements.txt
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
unicorn-engine>=0.1.0
|
| 2 |
+
numpy>=1.24.0
|
| 3 |
+
torch>=2.0.0
|
| 4 |
+
torchaudio>=2.0.0
|
| 5 |
+
librosa>=0.10.0
|
whisperx-base-npu.npumodel
ADDED
|
Binary file (38 Bytes). View file
|
|
|