Hugging Face's logo

qualcomm
/
Distil-Whisper

Automatic Speech Recognition
PyTorch
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
3b7bbad
·
verified ·
1 Parent(s): 20cf119

v0.54.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.54.0 for changelog.

Files changed (2) hide show
  1. README.md +39 -43
  2. release_assets.json +4 -4
README.md CHANGED
@@ -27,9 +27,9 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.53.1/distil_whisper-onnx-float.zip)
31
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.53.1/distil_whisper-qnn_dlc-float.zip)
32
- | TFLITE | float | Universal | | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.53.1/distil_whisper-tflite-float.zip)
33
 
34
  For more device-specific assets and performance metrics, visit **[Distil-Whisper on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/distil_whisper)**.
35
 
@@ -68,37 +68,35 @@ See our repository for [Distil-Whisper on GitHub](https://github.com/qualcomm/ai
68
  | decoder | ONNX | float | Snapdragon® X Elite | 11.41 ms | 178 - 178 MB | NPU
69
  | decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 8.67 ms | 52 - 426 MB | NPU
70
  | decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 11.746 ms | 0 - 184 MB | NPU
71
- | decoder | ONNX | float | Qualcomm® QCS9075 | 13.188 ms | 40 - 82 MB | NPU
72
  | decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 7.178 ms | 16 - 472 MB | NPU
73
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.92 ms | 5 - 504 MB | NPU
74
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 7.295 ms | 5 - 548 MB | NPU
75
- | decoder | QNN_DLC | float | Snapdragon® X2 Elite | 6.086 ms | 40 - 40 MB | NPU
76
- | decoder | QNN_DLC | float | Snapdragon® X Elite | 10.901 ms | 40 - 40 MB | NPU
77
- | decoder | QNN_DLC | float | Snapdragon® X Elite | 10.901 ms | 40 - 40 MB | NPU
78
- | decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 8.613 ms | 0 - 601 MB | NPU
79
- | decoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 19.248 ms | 28 - 525 MB | NPU
80
- | decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 11.477 ms | 40 - 43 MB | NPU
81
- | decoder | QNN_DLC | float | Qualcomm® SA8775P | 12.828 ms | 30 - 522 MB | NPU
82
- | decoder | QNN_DLC | float | Qualcomm® SA8775P | 12.828 ms | 30 - 522 MB | NPU
83
- | decoder | QNN_DLC | float | Qualcomm® SA8775P | 12.828 ms | 30 - 522 MB | NPU
84
- | decoder | QNN_DLC | float | Qualcomm® QCS9075 | 16.542 ms | 40 - 86 MB | NPU
85
- | decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 18.114 ms | 26 - 330 MB | NPU
86
- | decoder | QNN_DLC | float | Qualcomm® SA7255P | 19.248 ms | 28 - 525 MB | NPU
87
- | decoder | QNN_DLC | float | Qualcomm® SA8295P | 14.11 ms | 34 - 276 MB | NPU
88
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 7.295 ms | 5 - 548 MB | NPU
89
  | decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.848 ms | 4 - 570 MB | NPU
90
  | decoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 7.215 ms | 4 - 572 MB | NPU
91
  | decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 8.619 ms | 4 - 749 MB | NPU
92
- | decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 19.275 ms | 4 - 537 MB | NPU
93
  | decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 11.713 ms | 5 - 7 MB | NPU
94
  | decoder | TFLITE | float | Qualcomm® SA8775P | 13.037 ms | 5 - 537 MB | NPU
95
  | decoder | TFLITE | float | Qualcomm® SA8775P | 13.037 ms | 5 - 537 MB | NPU
96
  | decoder | TFLITE | float | Qualcomm® SA8775P | 13.037 ms | 5 - 537 MB | NPU
97
- | decoder | TFLITE | float | Qualcomm® QCS9075 | 16.188 ms | 0 - 265 MB | NPU
98
- | decoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 18.522 ms | 5 - 466 MB | NPU
99
  | decoder | TFLITE | float | Qualcomm® SA7255P | 19.275 ms | 4 - 537 MB | NPU
100
  | decoder | TFLITE | float | Qualcomm® SA8295P | 14.231 ms | 5 - 297 MB | NPU
101
  | decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 7.215 ms | 4 - 572 MB | NPU
 
 
102
  | encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 49.731 ms | 80 - 839 MB | NPU
103
  | encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 60.575 ms | 80 - 734 MB | NPU
104
  | encoder | ONNX | float | Snapdragon® X2 Elite | 50.437 ms | 183 - 183 MB | NPU
@@ -106,37 +104,35 @@ See our repository for [Distil-Whisper on GitHub](https://github.com/qualcomm/ai
106
  | encoder | ONNX | float | Snapdragon® X Elite | 123.445 ms | 182 - 182 MB | NPU
107
  | encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 82.214 ms | 80 - 1239 MB | NPU
108
  | encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 118.816 ms | 0 - 202 MB | NPU
109
- | encoder | ONNX | float | Qualcomm® QCS9075 | 150.604 ms | 79 - 83 MB | NPU
110
  | encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 60.575 ms | 80 - 734 MB | NPU
111
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 58.551 ms | 1 - 712 MB | NPU
112
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 71.602 ms | 1 - 692 MB | NPU
113
- | encoder | QNN_DLC | float | Snapdragon® X2 Elite | 60.24 ms | 1 - 1 MB | NPU
114
- | encoder | QNN_DLC | float | Snapdragon® X Elite | 139.101 ms | 1 - 1 MB | NPU
115
- | encoder | QNN_DLC | float | Snapdragon® X Elite | 139.101 ms | 1 - 1 MB | NPU
116
- | encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 97.219 ms | 0 - 962 MB | NPU
117
- | encoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 437.836 ms | 1 - 696 MB | NPU
118
- | encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 135.253 ms | 0 - 7 MB | NPU
119
- | encoder | QNN_DLC | float | Qualcomm® SA8775P | 153.502 ms | 1 - 687 MB | NPU
120
- | encoder | QNN_DLC | float | Qualcomm® SA8775P | 153.502 ms | 1 - 687 MB | NPU
121
- | encoder | QNN_DLC | float | Qualcomm® SA8775P | 153.502 ms | 1 - 687 MB | NPU
122
- | encoder | QNN_DLC | float | Qualcomm® QCS9075 | 170.214 ms | 1 - 39 MB | NPU
123
- | encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 269.206 ms | 0 - 823 MB | NPU
124
- | encoder | QNN_DLC | float | Qualcomm® SA7255P | 437.836 ms | 1 - 696 MB | NPU
125
- | encoder | QNN_DLC | float | Qualcomm® SA8295P | 192.976 ms | 1 - 611 MB | NPU
126
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 71.602 ms | 1 - 692 MB | NPU
127
  | encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 403.997 ms | 42 - 85 MB | GPU
128
  | encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 409.903 ms | 40 - 80 MB | GPU
129
  | encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 475.908 ms | 42 - 184 MB | GPU
130
- | encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 3135.306 ms | 24 - 69 MB | GPU
131
  | encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 657.568 ms | 0 - 318 MB | GPU
132
  | encoder | TFLITE | float | Qualcomm® SA8775P | 1316.653 ms | 20 - 64 MB | GPU
133
  | encoder | TFLITE | float | Qualcomm® SA8775P | 1316.653 ms | 20 - 64 MB | GPU
134
  | encoder | TFLITE | float | Qualcomm® SA8775P | 1316.653 ms | 20 - 64 MB | GPU
135
- | encoder | TFLITE | float | Qualcomm® QCS9075 | 1271.896 ms | 0 - 40 MB | GPU
136
- | encoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 852.126 ms | 39 - 193 MB | GPU
137
  | encoder | TFLITE | float | Qualcomm® SA7255P | 3135.306 ms | 24 - 69 MB | GPU
138
  | encoder | TFLITE | float | Qualcomm® SA8295P | 671.062 ms | 38 - 81 MB | GPU
139
  | encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 409.903 ms | 40 - 80 MB | GPU
 
 
140
 
141
  ## License
142
  * The license for the original implementation of Distil-Whisper can be found
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.54.0/distil_whisper-onnx-float.zip)
31
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.54.0/distil_whisper-qnn_dlc-float.zip)
32
+ | TFLITE | float | Universal | | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.54.0/distil_whisper-tflite-float.zip)
33
 
34
  For more device-specific assets and performance metrics, visit **[Distil-Whisper on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/distil_whisper)**.
35
 
 
68
  | decoder | ONNX | float | Snapdragon® X Elite | 11.41 ms | 178 - 178 MB | NPU
69
  | decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 8.67 ms | 52 - 426 MB | NPU
70
  | decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 11.746 ms | 0 - 184 MB | NPU
 
71
  | decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 7.178 ms | 16 - 472 MB | NPU
72
+ | decoder | ONNX | float | Qualcomm® QCS9075 | 13.188 ms | 40 - 82 MB | NPU
73
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.934 ms | 39 - 538 MB | NPU
74
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 7.351 ms | 4 - 548 MB | NPU
75
+ | decoder | QNN_DLC | float | Snapdragon® X2 Elite | 5.954 ms | 40 - 40 MB | NPU
76
+ | decoder | QNN_DLC | float | Snapdragon® X Elite | 10.825 ms | 40 - 40 MB | NPU
77
+ | decoder | QNN_DLC | float | Snapdragon® X Elite | 10.825 ms | 40 - 40 MB | NPU
78
+ | decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 8.656 ms | 0 - 600 MB | NPU
79
+ | decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 11.398 ms | 40 - 634 MB | NPU
80
+ | decoder | QNN_DLC | float | Qualcomm® SA8775P | 12.874 ms | 15 - 507 MB | NPU
81
+ | decoder | QNN_DLC | float | Qualcomm® SA8775P | 12.874 ms | 15 - 507 MB | NPU
82
+ | decoder | QNN_DLC | float | Qualcomm® SA8775P | 12.874 ms | 15 - 507 MB | NPU
83
+ | decoder | QNN_DLC | float | Qualcomm® SA7255P | 19.195 ms | 31 - 528 MB | NPU
84
+ | decoder | QNN_DLC | float | Qualcomm® SA8295P | 13.997 ms | 21 - 263 MB | NPU
85
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 7.351 ms | 4 - 548 MB | NPU
86
+ | decoder | QNN_DLC | float | Qualcomm® QCS9075 | 16.524 ms | 40 - 86 MB | NPU
87
+ | decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 18.145 ms | 36 - 339 MB | NPU
88
  | decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 5.848 ms | 4 - 570 MB | NPU
89
  | decoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 7.215 ms | 4 - 572 MB | NPU
90
  | decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 8.619 ms | 4 - 749 MB | NPU
 
91
  | decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 11.713 ms | 5 - 7 MB | NPU
92
  | decoder | TFLITE | float | Qualcomm® SA8775P | 13.037 ms | 5 - 537 MB | NPU
93
  | decoder | TFLITE | float | Qualcomm® SA8775P | 13.037 ms | 5 - 537 MB | NPU
94
  | decoder | TFLITE | float | Qualcomm® SA8775P | 13.037 ms | 5 - 537 MB | NPU
 
 
95
  | decoder | TFLITE | float | Qualcomm® SA7255P | 19.275 ms | 4 - 537 MB | NPU
96
  | decoder | TFLITE | float | Qualcomm® SA8295P | 14.231 ms | 5 - 297 MB | NPU
97
  | decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 7.215 ms | 4 - 572 MB | NPU
98
+ | decoder | TFLITE | float | Qualcomm® QCS9075 | 16.188 ms | 0 - 265 MB | NPU
99
+ | decoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 18.522 ms | 5 - 466 MB | NPU
100
  | encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 49.731 ms | 80 - 839 MB | NPU
101
  | encoder | ONNX | float | Snapdragon® 8 Elite Mobile | 60.575 ms | 80 - 734 MB | NPU
102
  | encoder | ONNX | float | Snapdragon® X2 Elite | 50.437 ms | 183 - 183 MB | NPU
 
104
  | encoder | ONNX | float | Snapdragon® X Elite | 123.445 ms | 182 - 182 MB | NPU
105
  | encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 82.214 ms | 80 - 1239 MB | NPU
106
  | encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 118.816 ms | 0 - 202 MB | NPU
 
107
  | encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 60.575 ms | 80 - 734 MB | NPU
108
+ | encoder | ONNX | float | Qualcomm® QCS9075 | 150.604 ms | 79 - 83 MB | NPU
109
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 57.546 ms | 1 - 712 MB | NPU
110
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 71.556 ms | 1 - 691 MB | NPU
111
+ | encoder | QNN_DLC | float | Snapdragon® X2 Elite | 60.179 ms | 1 - 1 MB | NPU
112
+ | encoder | QNN_DLC | float | Snapdragon® X Elite | 139.254 ms | 1 - 1 MB | NPU
113
+ | encoder | QNN_DLC | float | Snapdragon® X Elite | 139.254 ms | 1 - 1 MB | NPU
114
+ | encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 96.947 ms | 0 - 963 MB | NPU
115
+ | encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 135.243 ms | 1 - 4 MB | NPU
116
+ | encoder | QNN_DLC | float | Qualcomm® SA8775P | 153.197 ms | 1 - 687 MB | NPU
117
+ | encoder | QNN_DLC | float | Qualcomm® SA8775P | 153.197 ms | 1 - 687 MB | NPU
118
+ | encoder | QNN_DLC | float | Qualcomm® SA8775P | 153.197 ms | 1 - 687 MB | NPU
119
+ | encoder | QNN_DLC | float | Qualcomm® SA7255P | 437.44 ms | 1 - 696 MB | NPU
120
+ | encoder | QNN_DLC | float | Qualcomm® SA8295P | 192.943 ms | 1 - 610 MB | NPU
121
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 71.556 ms | 1 - 691 MB | NPU
122
+ | encoder | QNN_DLC | float | Qualcomm® QCS9075 | 170.231 ms | 1 - 39 MB | NPU
123
+ | encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 267.063 ms | 5 - 828 MB | NPU
124
  | encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 403.997 ms | 42 - 85 MB | GPU
125
  | encoder | TFLITE | float | Snapdragon® 8 Elite Mobile | 409.903 ms | 40 - 80 MB | GPU
126
  | encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 475.908 ms | 42 - 184 MB | GPU
 
127
  | encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 657.568 ms | 0 - 318 MB | GPU
128
  | encoder | TFLITE | float | Qualcomm® SA8775P | 1316.653 ms | 20 - 64 MB | GPU
129
  | encoder | TFLITE | float | Qualcomm® SA8775P | 1316.653 ms | 20 - 64 MB | GPU
130
  | encoder | TFLITE | float | Qualcomm® SA8775P | 1316.653 ms | 20 - 64 MB | GPU
 
 
131
  | encoder | TFLITE | float | Qualcomm® SA7255P | 3135.306 ms | 24 - 69 MB | GPU
132
  | encoder | TFLITE | float | Qualcomm® SA8295P | 671.062 ms | 38 - 81 MB | GPU
133
  | encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 409.903 ms | 40 - 80 MB | GPU
134
+ | encoder | TFLITE | float | Qualcomm® QCS9075 | 1271.896 ms | 0 - 40 MB | GPU
135
+ | encoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 852.126 ms | 39 - 193 MB | GPU
136
 
137
  ## License
138
  * The license for the original implementation of Distil-Whisper can be found
release_assets.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "version": "0.53.1",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
@@ -7,20 +7,20 @@
7
  "tool_versions": {
8
  "litert": "1.4.3"
9
  },
10
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.53.1/distil_whisper-tflite-float.zip"
11
  },
12
  "qnn_dlc": {
13
  "tool_versions": {
14
  "qairt": "2.45.0.260326154327"
15
  },
16
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.53.1/distil_whisper-qnn_dlc-float.zip"
17
  },
18
  "onnx": {
19
  "tool_versions": {
20
  "qairt": "2.42.0.251225135753_193295",
21
  "onnx_runtime": "1.24.3"
22
  },
23
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.53.1/distil_whisper-onnx-float.zip"
24
  }
25
  }
26
  }
 
1
  {
2
+ "version": "0.54.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
 
7
  "tool_versions": {
8
  "litert": "1.4.3"
9
  },
10
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.54.0/distil_whisper-tflite-float.zip"
11
  },
12
  "qnn_dlc": {
13
  "tool_versions": {
14
  "qairt": "2.45.0.260326154327"
15
  },
16
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.54.0/distil_whisper-qnn_dlc-float.zip"
17
  },
18
  "onnx": {
19
  "tool_versions": {
20
  "qairt": "2.42.0.251225135753_193295",
21
  "onnx_runtime": "1.24.3"
22
  },
23
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/distil_whisper/releases/v0.54.0/distil_whisper-onnx-float.zip"
24
  }
25
  }
26
  }