Hugging Face's logo

qualcomm
/
TrOCR

Image-to-Text
PyTorch
android
Model card Files
xet
 Community
3
qaihm-bot commited on
Commit
5766d57
·
verified ·
1 Parent(s): 481d284

v0.50.2

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.50.2 for changelog.

Files changed (2) hide show
  1. README.md +61 -61
  2. release_assets.json +1 -1
README.md CHANGED
@@ -27,9 +27,9 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.1/trocr-onnx-float.zip)
31
- | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.1/trocr-qnn_dlc-float.zip)
32
- | TFLITE | float | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.1/trocr-tflite-float.zip)
33
 
34
  For more device-specific assets and performance metrics, visit **[TrOCR on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/trocr)**.
35
 
@@ -60,64 +60,64 @@ See our repository for [TrOCR on GitHub](https://github.com/qualcomm/ai-hub-mode
60
  ## Performance Summary
61
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
62
  |---|---|---|---|---|---|---
63
- | decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.154 ms | 0 - 229 MB | NPU
64
- | decoder | ONNX | float | Snapdragon® X2 Elite | 1.158 ms | 68 - 68 MB | NPU
65
- | decoder | ONNX | float | Snapdragon® X Elite | 2.323 ms | 67 - 67 MB | NPU
66
- | decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.488 ms | 0 - 256 MB | NPU
67
- | decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 2.146 ms | 0 - 108 MB | NPU
68
- | decoder | ONNX | float | Qualcomm® QCS9075 | 2.679 ms | 7 - 16 MB | NPU
69
- | decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.227 ms | 0 - 250 MB | NPU
70
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.126 ms | 1 - 212 MB | NPU
71
- | decoder | QNN_DLC | float | Snapdragon® X2 Elite | 1.566 ms | 7 - 7 MB | NPU
72
- | decoder | QNN_DLC | float | Snapdragon® X Elite | 2.145 ms | 7 - 7 MB | NPU
73
- | decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 1.385 ms | 0 - 234 MB | NPU
74
- | decoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 4.235 ms | 7 - 144 MB | NPU
75
- | decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 2.183 ms | 3 - 5 MB | NPU
76
- | decoder | QNN_DLC | float | Qualcomm® SA8775P | 2.852 ms | 7 - 144 MB | NPU
77
- | decoder | QNN_DLC | float | Qualcomm® QCS9075 | 2.544 ms | 7 - 16 MB | NPU
78
- | decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 2.8 ms | 1 - 215 MB | NPU
79
- | decoder | QNN_DLC | float | Qualcomm® SA7255P | 4.235 ms | 7 - 144 MB | NPU
80
- | decoder | QNN_DLC | float | Qualcomm® SA8295P | 2.948 ms | 7 - 128 MB | NPU
81
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.202 ms | 0 - 226 MB | NPU
82
- | decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.105 ms | 0 - 223 MB | NPU
83
- | decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 1.378 ms | 0 - 236 MB | NPU
84
- | decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 4.26 ms | 0 - 155 MB | NPU
85
- | decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 2.229 ms | 0 - 2 MB | NPU
86
- | decoder | TFLITE | float | Qualcomm® SA8775P | 2.886 ms | 0 - 152 MB | NPU
87
- | decoder | TFLITE | float | Qualcomm® QCS9075 | 2.571 ms | 0 - 83 MB | NPU
88
- | decoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 2.809 ms | 0 - 222 MB | NPU
89
- | decoder | TFLITE | float | Qualcomm® SA7255P | 4.26 ms | 0 - 155 MB | NPU
90
- | decoder | TFLITE | float | Qualcomm® SA8295P | 2.977 ms | 0 - 136 MB | NPU
91
- | decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.178 ms | 0 - 237 MB | NPU
92
- | encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.283 ms | 16 - 325 MB | NPU
93
- | encoder | ONNX | float | Snapdragon® X2 Elite | 7.481 ms | 48 - 48 MB | NPU
94
- | encoder | ONNX | float | Snapdragon® X Elite | 18.683 ms | 48 - 48 MB | NPU
95
- | encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 12.6 ms | 16 - 404 MB | NPU
96
- | encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 18.208 ms | 0 - 85 MB | NPU
97
- | encoder | ONNX | float | Qualcomm® QCS9075 | 22.038 ms | 15 - 19 MB | NPU
98
- | encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 8.961 ms | 16 - 331 MB | NPU
99
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.261 ms | 2 - 304 MB | NPU
100
- | encoder | QNN_DLC | float | Snapdragon® X2 Elite | 8.001 ms | 2 - 2 MB | NPU
101
- | encoder | QNN_DLC | float | Snapdragon® X Elite | 18.754 ms | 2 - 2 MB | NPU
102
- | encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 12.7 ms | 2 - 382 MB | NPU
103
- | encoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 47.585 ms | 2 - 291 MB | NPU
104
- | encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 18.099 ms | 2 - 3 MB | NPU
105
- | encoder | QNN_DLC | float | Qualcomm® SA8775P | 20.841 ms | 2 - 290 MB | NPU
106
- | encoder | QNN_DLC | float | Qualcomm® QCS9075 | 22.164 ms | 2 - 12 MB | NPU
107
- | encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 28.494 ms | 0 - 357 MB | NPU
108
- | encoder | QNN_DLC | float | Qualcomm® SA7255P | 47.585 ms | 2 - 291 MB | NPU
109
- | encoder | QNN_DLC | float | Qualcomm® SA8295P | 25.762 ms | 2 - 290 MB | NPU
110
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 8.942 ms | 2 - 311 MB | NPU
111
- | encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 4.615 ms | 6 - 151 MB | NPU
112
- | encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 8.5 ms | 3 - 231 MB | NPU
113
- | encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 38.752 ms | 7 - 150 MB | NPU
114
- | encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 12.117 ms | 7 - 9 MB | NPU
115
- | encoder | TFLITE | float | Qualcomm® SA8775P | 14.627 ms | 7 - 145 MB | NPU
116
- | encoder | TFLITE | float | Qualcomm® QCS9075 | 15.802 ms | 6 - 66 MB | NPU
117
- | encoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 22.081 ms | 7 - 345 MB | NPU
118
- | encoder | TFLITE | float | Qualcomm® SA7255P | 38.752 ms | 7 - 150 MB | NPU
119
- | encoder | TFLITE | float | Qualcomm® SA8295P | 20.762 ms | 7 - 271 MB | NPU
120
- | encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 5.848 ms | 7 - 151 MB | NPU
121
 
122
  ## License
123
  * The license for the original implementation of TrOCR can be found
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.2/trocr-onnx-float.zip)
31
+ | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.2/trocr-qnn_dlc-float.zip)
32
+ | TFLITE | float | Universal | QAIRT 2.43, TFLite 2.19.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.2/trocr-tflite-float.zip)
33
 
34
  For more device-specific assets and performance metrics, visit **[TrOCR on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/trocr)**.
35
 
 
60
  ## Performance Summary
61
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
62
  |---|---|---|---|---|---|---
63
+ | decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.142 ms | 0 - 224 MB | NPU
64
+ | decoder | ONNX | float | Snapdragon® X2 Elite | 1.153 ms | 68 - 68 MB | NPU
65
+ | decoder | ONNX | float | Snapdragon® X Elite | 2.348 ms | 67 - 67 MB | NPU
66
+ | decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.456 ms | 0 - 258 MB | NPU
67
+ | decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 2.138 ms | 1 - 4 MB | NPU
68
+ | decoder | ONNX | float | Qualcomm® QCS9075 | 2.714 ms | 7 - 16 MB | NPU
69
+ | decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.248 ms | 0 - 252 MB | NPU
70
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.117 ms | 1 - 212 MB | NPU
71
+ | decoder | QNN_DLC | float | Snapdragon® X2 Elite | 1.6 ms | 7 - 7 MB | NPU
72
+ | decoder | QNN_DLC | float | Snapdragon® X Elite | 2.141 ms | 7 - 7 MB | NPU
73
+ | decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 1.403 ms | 0 - 232 MB | NPU
74
+ | decoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 4.216 ms | 7 - 143 MB | NPU
75
+ | decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 1.952 ms | 1 - 3 MB | NPU
76
+ | decoder | QNN_DLC | float | Qualcomm® SA8775P | 2.833 ms | 7 - 144 MB | NPU
77
+ | decoder | QNN_DLC | float | Qualcomm® QCS9075 | 2.549 ms | 7 - 16 MB | NPU
78
+ | decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 2.869 ms | 1 - 215 MB | NPU
79
+ | decoder | QNN_DLC | float | Qualcomm® SA7255P | 4.216 ms | 7 - 143 MB | NPU
80
+ | decoder | QNN_DLC | float | Qualcomm® SA8295P | 2.934 ms | 7 - 130 MB | NPU
81
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.236 ms | 0 - 226 MB | NPU
82
+ | decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.097 ms | 0 - 224 MB | NPU
83
+ | decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 1.36 ms | 0 - 247 MB | NPU
84
+ | decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 4.235 ms | 0 - 155 MB | NPU
85
+ | decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 1.939 ms | 0 - 3 MB | NPU
86
+ | decoder | TFLITE | float | Qualcomm® SA8775P | 2.799 ms | 0 - 151 MB | NPU
87
+ | decoder | TFLITE | float | Qualcomm® QCS9075 | 2.514 ms | 0 - 83 MB | NPU
88
+ | decoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 2.575 ms | 0 - 225 MB | NPU
89
+ | decoder | TFLITE | float | Qualcomm® SA7255P | 4.235 ms | 0 - 155 MB | NPU
90
+ | decoder | TFLITE | float | Qualcomm® SA8295P | 3.039 ms | 0 - 134 MB | NPU
91
+ | decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.164 ms | 0 - 231 MB | NPU
92
+ | encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 4.389 ms | 1 - 178 MB | NPU
93
+ | encoder | ONNX | float | Snapdragon® X2 Elite | 4.863 ms | 48 - 48 MB | NPU
94
+ | encoder | ONNX | float | Snapdragon® X Elite | 12.577 ms | 47 - 47 MB | NPU
95
+ | encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 8.29 ms | 16 - 269 MB | NPU
96
+ | encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 11.99 ms | 0 - 60 MB | NPU
97
+ | encoder | ONNX | float | Qualcomm® QCS9075 | 15.758 ms | 15 - 19 MB | NPU
98
+ | encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 5.752 ms | 16 - 190 MB | NPU
99
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 4.662 ms | 2 - 156 MB | NPU
100
+ | encoder | QNN_DLC | float | Snapdragon® X2 Elite | 5.659 ms | 2 - 2 MB | NPU
101
+ | encoder | QNN_DLC | float | Snapdragon® X Elite | 12.47 ms | 2 - 2 MB | NPU
102
+ | encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 8.248 ms | 0 - 231 MB | NPU
103
+ | encoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 38.122 ms | 2 - 149 MB | NPU
104
+ | encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 11.819 ms | 2 - 3 MB | NPU
105
+ | encoder | QNN_DLC | float | Qualcomm® SA8775P | 14.225 ms | 2 - 149 MB | NPU
106
+ | encoder | QNN_DLC | float | Qualcomm® QCS9075 | 16.741 ms | 2 - 12 MB | NPU
107
+ | encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 21.927 ms | 0 - 345 MB | NPU
108
+ | encoder | QNN_DLC | float | Qualcomm® SA7255P | 38.122 ms | 2 - 149 MB | NPU
109
+ | encoder | QNN_DLC | float | Qualcomm® SA8295P | 20.266 ms | 2 - 273 MB | NPU
110
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 5.765 ms | 2 - 155 MB | NPU
111
+ | encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 4.067 ms | 0 - 145 MB | NPU
112
+ | encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 7.719 ms | 6 - 227 MB | NPU
113
+ | encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 36.775 ms | 7 - 145 MB | NPU
114
+ | encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 10.703 ms | 7 - 9 MB | NPU
115
+ | encoder | TFLITE | float | Qualcomm® SA8775P | 13.375 ms | 7 - 146 MB | NPU
116
+ | encoder | TFLITE | float | Qualcomm® QCS9075 | 13.963 ms | 6 - 65 MB | NPU
117
+ | encoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 19.604 ms | 7 - 340 MB | NPU
118
+ | encoder | TFLITE | float | Qualcomm® SA7255P | 36.775 ms | 7 - 145 MB | NPU
119
+ | encoder | TFLITE | float | Qualcomm® SA8295P | 19.123 ms | 7 - 269 MB | NPU
120
+ | encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 5.219 ms | 5 - 153 MB | NPU
121
 
122
  ## License
123
  * The license for the original implementation of TrOCR can be found
release_assets.json CHANGED
@@ -1 +1 @@
1
- {"version":"0.50.1","precisions":{"float":{"universal_assets":{"tflite":{"tool_versions":{"qairt":"2.43.0.260127150333_193827","tflite":"2.17.0"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.1/trocr-tflite-float.zip"},"qnn_dlc":{"tool_versions":{"qairt":"2.43.0.260127150333_193827"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.1/trocr-qnn_dlc-float.zip"},"onnx":{"tool_versions":{"qairt":"2.42.0.251225135753_193295","onnx_runtime":"1.24.1"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.1/trocr-onnx-float.zip"}}}}}
 
1
+ {"version":"0.50.2","precisions":{"float":{"universal_assets":{"onnx":{"tool_versions":{"qairt":"2.42.0.251225135753_193295","onnx_runtime":"1.24.3"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.2/trocr-onnx-float.zip"},"qnn_dlc":{"tool_versions":{"qairt":"2.43.0.260127150333_193827"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.2/trocr-qnn_dlc-float.zip"},"tflite":{"tool_versions":{"qairt":"2.43.0.260127150333_193827","tflite":"2.19.1"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.50.2/trocr-tflite-float.zip"}}}}}