Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
## Whisper Model Quantized
|
| 2 |
+
|
| 3 |
+
The repository contains the whisper model quantized using the Smooth Quant using ONNXRuntime
|
| 4 |
+
|
| 5 |
+
1. Only the Whisper decoder is quantized in the model
|
| 6 |
+
2. The model has been modified to accept fixed shapes input of (1, 80, 3000) for the encoder and (1,448) for decoder.
|
| 7 |
+
3. This model is for testing and could be modified in the future with better versions.
|