Hugging Face's logo

qualcomm
/
TrOCR

Image-to-Text
PyTorch
android
Model card Files
xet
 Community
3
qaihm-bot commited on
Commit
42b8039
·
verified ·
1 Parent(s): f3a5202

v0.52.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.52.0 for changelog.

Files changed (2) hide show
  1. README.md +61 -61
  2. release_assets.json +4 -4
README.md CHANGED
@@ -27,9 +27,9 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.51.0/trocr-onnx-float.zip)
31
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.51.0/trocr-qnn_dlc-float.zip)
32
- | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.51.0/trocr-tflite-float.zip)
33
 
34
  For more device-specific assets and performance metrics, visit **[TrOCR on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/trocr)**.
35
 
@@ -60,64 +60,64 @@ See our repository for [TrOCR on GitHub](https://github.com/qualcomm/ai-hub-mode
60
  ## Performance Summary
61
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
62
  |---|---|---|---|---|---|---
63
- | decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.169 ms | 1 - 225 MB | NPU
64
- | decoder | ONNX | float | Snapdragon® X2 Elite | 1.162 ms | 68 - 68 MB | NPU
65
- | decoder | ONNX | float | Snapdragon® X Elite | 2.277 ms | 67 - 67 MB | NPU
66
- | decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.472 ms | 0 - 268 MB | NPU
67
- | decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 2.132 ms | 0 - 87 MB | NPU
68
- | decoder | ONNX | float | Qualcomm® QCS9075 | 2.715 ms | 7 - 16 MB | NPU
69
- | decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.245 ms | 0 - 215 MB | NPU
70
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.132 ms | 1 - 173 MB | NPU
71
- | decoder | QNN_DLC | float | Snapdragon® X2 Elite | 1.667 ms | 7 - 7 MB | NPU
72
- | decoder | QNN_DLC | float | Snapdragon® X Elite | 2.177 ms | 7 - 7 MB | NPU
73
- | decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 1.41 ms | 0 - 278 MB | NPU
74
- | decoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 4.178 ms | 1 - 102 MB | NPU
75
- | decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 2.003 ms | 2 - 184 MB | NPU
76
- | decoder | QNN_DLC | float | Qualcomm® SA8775P | 2.94 ms | 0 - 102 MB | NPU
77
- | decoder | QNN_DLC | float | Qualcomm® QCS9075 | 2.557 ms | 7 - 15 MB | NPU
78
- | decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 2.62 ms | 2 - 215 MB | NPU
79
- | decoder | QNN_DLC | float | Qualcomm® SA7255P | 4.178 ms | 1 - 102 MB | NPU
80
- | decoder | QNN_DLC | float | Qualcomm® SA8295P | 2.661 ms | 0 - 44 MB | NPU
81
- | decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.262 ms | 0 - 189 MB | NPU
82
- | decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.124 ms | 0 - 175 MB | NPU
83
- | decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 1.389 ms | 0 - 280 MB | NPU
84
- | decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 4.222 ms | 0 - 103 MB | NPU
85
- | decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 1.989 ms | 0 - 2 MB | NPU
86
- | decoder | TFLITE | float | Qualcomm® SA8775P | 2.865 ms | 0 - 102 MB | NPU
87
- | decoder | TFLITE | float | Qualcomm® QCS9075 | 2.575 ms | 0 - 83 MB | NPU
88
- | decoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 2.431 ms | 0 - 217 MB | NPU
89
- | decoder | TFLITE | float | Qualcomm® SA7255P | 4.222 ms | 0 - 103 MB | NPU
90
- | decoder | TFLITE | float | Qualcomm® SA8295P | 2.67 ms | 0 - 37 MB | NPU
91
- | decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.254 ms | 0 - 191 MB | NPU
92
- | encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.282 ms | 16 - 326 MB | NPU
93
- | encoder | ONNX | float | Snapdragon® X2 Elite | 7.5 ms | 48 - 48 MB | NPU
94
- | encoder | ONNX | float | Snapdragon® X Elite | 18.697 ms | 48 - 48 MB | NPU
95
- | encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 12.55 ms | 16 - 410 MB | NPU
96
- | encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 18.134 ms | 0 - 57 MB | NPU
97
- | encoder | ONNX | float | Qualcomm® QCS9075 | 21.863 ms | 15 - 19 MB | NPU
98
- | encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 8.973 ms | 16 - 329 MB | NPU
99
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.228 ms | 2 - 294 MB | NPU
100
- | encoder | QNN_DLC | float | Snapdragon® X2 Elite | 7.921 ms | 2 - 2 MB | NPU
101
- | encoder | QNN_DLC | float | Snapdragon® X Elite | 19.081 ms | 2 - 2 MB | NPU
102
- | encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 12.807 ms | 0 - 348 MB | NPU
103
- | encoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 47.865 ms | 2 - 265 MB | NPU
104
- | encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 18.433 ms | 2 - 4 MB | NPU
105
- | encoder | QNN_DLC | float | Qualcomm® SA8775P | 20.558 ms | 2 - 264 MB | NPU
106
- | encoder | QNN_DLC | float | Qualcomm® QCS9075 | 22.582 ms | 2 - 12 MB | NPU
107
- | encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 28.071 ms | 1 - 331 MB | NPU
108
- | encoder | QNN_DLC | float | Qualcomm® SA7255P | 47.865 ms | 2 - 265 MB | NPU
109
- | encoder | QNN_DLC | float | Qualcomm® SA8295P | 25.905 ms | 2 - 266 MB | NPU
110
- | encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 9.008 ms | 2 - 302 MB | NPU
111
- | encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 4.425 ms | 6 - 155 MB | NPU
112
- | encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 8.405 ms | 6 - 228 MB | NPU
113
- | encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 38.155 ms | 7 - 173 MB | NPU
114
- | encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 11.945 ms | 7 - 9 MB | NPU
115
- | encoder | TFLITE | float | Qualcomm® SA8775P | 14.542 ms | 7 - 175 MB | NPU
116
- | encoder | TFLITE | float | Qualcomm® QCS9075 | 15.179 ms | 6 - 66 MB | NPU
117
- | encoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 20.852 ms | 7 - 343 MB | NPU
118
- | encoder | TFLITE | float | Qualcomm® SA7255P | 38.155 ms | 7 - 173 MB | NPU
119
- | encoder | TFLITE | float | Qualcomm® SA8295P | 20.577 ms | 7 - 289 MB | NPU
120
- | encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 5.663 ms | 5 - 153 MB | NPU
121
 
122
  ## License
123
  * The license for the original implementation of TrOCR can be found
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.52.0/trocr-onnx-float.zip)
31
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.52.0/trocr-qnn_dlc-float.zip)
32
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.52.0/trocr-tflite-float.zip)
33
 
34
  For more device-specific assets and performance metrics, visit **[TrOCR on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/trocr)**.
35
 
 
60
  ## Performance Summary
61
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
62
  |---|---|---|---|---|---|---
63
+ | decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.155 ms | 0 - 225 MB | NPU
64
+ | decoder | ONNX | float | Snapdragon® X2 Elite | 1.176 ms | 68 - 68 MB | NPU
65
+ | decoder | ONNX | float | Snapdragon® X Elite | 2.299 ms | 67 - 67 MB | NPU
66
+ | decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 1.457 ms | 0 - 249 MB | NPU
67
+ | decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 2.127 ms | 0 - 76 MB | NPU
68
+ | decoder | ONNX | float | Qualcomm® QCS9075 | 2.702 ms | 7 - 16 MB | NPU
69
+ | decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.242 ms | 0 - 252 MB | NPU
70
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.142 ms | 1 - 174 MB | NPU
71
+ | decoder | QNN_DLC | float | Snapdragon® X2 Elite | 1.53 ms | 7 - 7 MB | NPU
72
+ | decoder | QNN_DLC | float | Snapdragon® X Elite | 2.17 ms | 7 - 7 MB | NPU
73
+ | decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 1.421 ms | 0 - 281 MB | NPU
74
+ | decoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 4.184 ms | 1 - 102 MB | NPU
75
+ | decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 2.047 ms | 1 - 3 MB | NPU
76
+ | decoder | QNN_DLC | float | Qualcomm® SA8775P | 2.895 ms | 0 - 102 MB | NPU
77
+ | decoder | QNN_DLC | float | Qualcomm® QCS9075 | 2.57 ms | 7 - 15 MB | NPU
78
+ | decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 2.635 ms | 2 - 216 MB | NPU
79
+ | decoder | QNN_DLC | float | Qualcomm® SA7255P | 4.184 ms | 1 - 102 MB | NPU
80
+ | decoder | QNN_DLC | float | Qualcomm® SA8295P | 2.704 ms | 7 - 49 MB | NPU
81
+ | decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.279 ms | 0 - 188 MB | NPU
82
+ | decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 1.118 ms | 0 - 175 MB | NPU
83
+ | decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 1.632 ms | 0 - 281 MB | NPU
84
+ | decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 4.232 ms | 0 - 103 MB | NPU
85
+ | decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 1.986 ms | 0 - 2 MB | NPU
86
+ | decoder | TFLITE | float | Qualcomm® SA8775P | 2.864 ms | 0 - 102 MB | NPU
87
+ | decoder | TFLITE | float | Qualcomm® QCS9075 | 2.537 ms | 0 - 83 MB | NPU
88
+ | decoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 2.444 ms | 0 - 215 MB | NPU
89
+ | decoder | TFLITE | float | Qualcomm® SA7255P | 4.232 ms | 0 - 103 MB | NPU
90
+ | decoder | TFLITE | float | Qualcomm® SA8295P | 2.664 ms | 0 - 43 MB | NPU
91
+ | decoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 1.229 ms | 0 - 192 MB | NPU
92
+ | encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.262 ms | 16 - 326 MB | NPU
93
+ | encoder | ONNX | float | Snapdragon® X2 Elite | 7.526 ms | 48 - 48 MB | NPU
94
+ | encoder | ONNX | float | Snapdragon® X Elite | 18.696 ms | 48 - 48 MB | NPU
95
+ | encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 12.569 ms | 16 - 404 MB | NPU
96
+ | encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 18.211 ms | 0 - 61 MB | NPU
97
+ | encoder | ONNX | float | Qualcomm® QCS9075 | 22.075 ms | 15 - 19 MB | NPU
98
+ | encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 9.014 ms | 16 - 333 MB | NPU
99
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 7.232 ms | 2 - 295 MB | NPU
100
+ | encoder | QNN_DLC | float | Snapdragon® X2 Elite | 7.863 ms | 2 - 2 MB | NPU
101
+ | encoder | QNN_DLC | float | Snapdragon® X Elite | 19.138 ms | 2 - 2 MB | NPU
102
+ | encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 12.783 ms | 2 - 349 MB | NPU
103
+ | encoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 47.835 ms | 2 - 264 MB | NPU
104
+ | encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 18.529 ms | 2 - 3 MB | NPU
105
+ | encoder | QNN_DLC | float | Qualcomm® SA8775P | 20.574 ms | 2 - 264 MB | NPU
106
+ | encoder | QNN_DLC | float | Qualcomm® QCS9075 | 22.215 ms | 2 - 12 MB | NPU
107
+ | encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 28.134 ms | 0 - 331 MB | NPU
108
+ | encoder | QNN_DLC | float | Qualcomm® SA7255P | 47.835 ms | 2 - 264 MB | NPU
109
+ | encoder | QNN_DLC | float | Qualcomm® SA8295P | 25.875 ms | 2 - 266 MB | NPU
110
+ | encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 8.987 ms | 2 - 304 MB | NPU
111
+ | encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 4.428 ms | 6 - 152 MB | NPU
112
+ | encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 8.411 ms | 6 - 228 MB | NPU
113
+ | encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 38.056 ms | 7 - 172 MB | NPU
114
+ | encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 12.005 ms | 7 - 9 MB | NPU
115
+ | encoder | TFLITE | float | Qualcomm® SA8775P | 14.566 ms | 7 - 175 MB | NPU
116
+ | encoder | TFLITE | float | Qualcomm® QCS9075 | 15.148 ms | 6 - 66 MB | NPU
117
+ | encoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 21.069 ms | 7 - 341 MB | NPU
118
+ | encoder | TFLITE | float | Qualcomm® SA7255P | 38.056 ms | 7 - 172 MB | NPU
119
+ | encoder | TFLITE | float | Qualcomm® SA8295P | 20.649 ms | 7 - 288 MB | NPU
120
+ | encoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 5.657 ms | 5 - 154 MB | NPU
121
 
122
  ## License
123
  * The license for the original implementation of TrOCR can be found
release_assets.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "version": "0.51.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
@@ -8,20 +8,20 @@
8
  "qairt": "2.45.0.260326154327",
9
  "litert": "1.4.2"
10
  },
11
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.51.0/trocr-tflite-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.51.0/trocr-qnn_dlc-float.zip"
18
  },
19
  "onnx": {
20
  "tool_versions": {
21
  "qairt": "2.42.0.251225135753_193295",
22
  "onnx_runtime": "1.24.3"
23
  },
24
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.51.0/trocr-onnx-float.zip"
25
  }
26
  }
27
  }
 
1
  {
2
+ "version": "0.52.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
 
8
  "qairt": "2.45.0.260326154327",
9
  "litert": "1.4.2"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.52.0/trocr-tflite-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.52.0/trocr-qnn_dlc-float.zip"
18
  },
19
  "onnx": {
20
  "tool_versions": {
21
  "qairt": "2.42.0.251225135753_193295",
22
  "onnx_runtime": "1.24.3"
23
  },
24
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/trocr/releases/v0.52.0/trocr-onnx-float.zip"
25
  }
26
  }
27
  }