Commit
·
dc97704
1
Parent(s):
8c5e102
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,55 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
datasets:
|
| 4 |
+
- librispeech_asr
|
| 5 |
+
metrics:
|
| 6 |
+
- wer
|
| 7 |
+
pipeline_tag: automatic-speech-recognition
|
| 8 |
+
tags:
|
| 9 |
+
- automatic-speech-recognition
|
| 10 |
+
- int8
|
| 11 |
+
- ONNX
|
| 12 |
+
- PostTrainingStatic
|
| 13 |
+
- Intel® Neural Compressor
|
| 14 |
+
- neural-compressor
|
| 15 |
+
library_name: transformers
|
| 16 |
---
|
| 17 |
+
|
| 18 |
+
## Model Details: INT8 Whisper large
|
| 19 |
+
|
| 20 |
+
Whisper is a pre-trained model for automatic speech recognition (ASR) and speech translation. Trained on 680k hours of labelled data, Whisper models demonstrate a strong ability to generalise to many datasets and domains without the need for fine-tuning.
|
| 21 |
+
|
| 22 |
+
This int8 ONNX model is generated by [neural-compressor](https://github.com/intel/neural-compressor) and the fp32 model can be exported with below command:
|
| 23 |
+
```shell
|
| 24 |
+
optimum-cli export onnx --model openai/whisper-large whisper-large-with-past/ --task automatic-speech-recognition-with-past --opset 13
|
| 25 |
+
```
|
| 26 |
+
|
| 27 |
+
| Model Detail | Description |
|
| 28 |
+
| ----------- | ----------- |
|
| 29 |
+
| Model Authors - Company | Intel |
|
| 30 |
+
| Date | May 15, 2022 |
|
| 31 |
+
| Version | 1 |
|
| 32 |
+
| Type | Speech Recognition |
|
| 33 |
+
| Paper or Other Resources | - |
|
| 34 |
+
| License | Apache 2.0 |
|
| 35 |
+
| Questions or Comments | [Community Tab](https://huggingface.co/Intel/whisper-large-int8-static/discussions)|
|
| 36 |
+
|
| 37 |
+
| Intended Use | Description |
|
| 38 |
+
| ----------- | ----------- |
|
| 39 |
+
| Primary intended uses | You can use the raw model for automatic speech recognition inference |
|
| 40 |
+
| Primary intended users | Anyone doing automatic speech recognition inference |
|
| 41 |
+
| Out-of-scope uses | This model in most cases will need to be fine-tuned for your particular task. The model should not be used to intentionally create hostile or alienating environments for people.|
|
| 42 |
+
|
| 43 |
+
|
| 44 |
+
### How to use
|
| 45 |
+
|
| 46 |
+
Download the model and script by cloning the repository:
|
| 47 |
+
```shell
|
| 48 |
+
git clone https://huggingface.co/Intel/whisper-large-int8-static
|
| 49 |
+
```
|
| 50 |
+
|
| 51 |
+
## Metrics (Model Performance):
|
| 52 |
+
| Model | Model Size (GB) | wer |
|
| 53 |
+
|---|:---:|:---:|
|
| 54 |
+
| FP32 |9.4|3.04|
|
| 55 |
+
| INT8 |2.4|2.94|
|