Hugging Face's logo

qualcomm
/
TrOCR

Image-to-Text
PyTorch
LiteRT
android
Model card Files
xet
Community
3
qaihm-bot commited on
Commit
328befd
·
verified ·
1 Parent(s): 04c5fcb

v0.42.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

Files changed (5) hide show
  1. README.md +64 -64
  2. TrOCR_TrOCRDecoder_float.dlc +2 -2
  3. TrOCR_TrOCRDecoder_float.onnx.zip +2 -2
  4. TrOCR_TrOCREncoder_float.dlc +2 -2
  5. TrOCR_TrOCREncoder_float.onnx.zip +2 -2
README.md CHANGED
@@ -37,66 +37,66 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | TrOCRDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.312 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
41
- | TrOCRDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.076 ms | 5 - 73 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
42
- | TrOCRDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.444 ms | 0 - 134 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
43
- | TrOCRDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.807 ms | 5 - 131 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
44
- | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.096 ms | 0 - 214 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
45
- | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.018 ms | 1 - 26 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
46
- | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 2.463 ms | 0 - 176 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
47
- | TrOCRDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.954 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
48
- | TrOCRDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.829 ms | 5 - 72 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
49
- | TrOCRDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.312 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
50
- | TrOCRDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.076 ms | 5 - 73 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
51
- | TrOCRDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.085 ms | 0 - 224 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
52
- | TrOCRDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.006 ms | 2 - 25 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
53
- | TrOCRDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 3.082 ms | 0 - 64 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
54
- | TrOCRDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.872 ms | 0 - 58 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
55
- | TrOCRDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.169 ms | 0 - 381 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
56
- | TrOCRDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.04 ms | 1 - 21 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
57
- | TrOCRDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.954 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
58
- | TrOCRDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.829 ms | 5 - 72 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
59
- | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.504 ms | 0 - 142 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
60
- | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.587 ms | 0 - 146 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
61
- | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.768 ms | 0 - 146 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
62
- | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.215 ms | 0 - 77 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
63
- | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.156 ms | 0 - 153 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
64
- | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 1.476 ms | 0 - 154 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
65
- | TrOCRDecoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.158 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
66
- | TrOCRDecoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.129 ms | 1 - 138 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
67
- | TrOCRDecoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 1.357 ms | 3 - 144 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
68
- | TrOCRDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.194 ms | 654 - 654 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
69
- | TrOCRDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 2.274 ms | 67 - 67 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
70
- | TrOCREncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 41.818 ms | 7 - 114 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
71
- | TrOCREncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 46.598 ms | 0 - 138 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
72
- | TrOCREncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 22.611 ms | 6 - 123 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
73
- | TrOCREncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 28.219 ms | 2 - 135 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
74
- | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 13.232 ms | 7 - 20 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
75
- | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 17.438 ms | 2 - 24 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
76
- | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 17.86 ms | 0 - 131 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
77
- | TrOCREncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 16.001 ms | 7 - 113 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
78
- | TrOCREncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 19.767 ms | 2 - 141 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
79
- | TrOCREncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 41.818 ms | 7 - 114 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
80
- | TrOCREncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 46.598 ms | 0 - 138 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
81
- | TrOCREncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 13.31 ms | 7 - 29 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
82
- | TrOCREncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 17.519 ms | 2 - 24 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
83
- | TrOCREncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 24.233 ms | 7 - 122 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
84
- | TrOCREncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 25.777 ms | 2 - 130 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
85
- | TrOCREncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 13.18 ms | 7 - 20 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
86
- | TrOCREncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 17.353 ms | 2 - 22 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
87
- | TrOCREncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 16.001 ms | 7 - 113 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
88
- | TrOCREncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 19.767 ms | 2 - 141 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
89
- | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 9.413 ms | 5 - 119 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
90
- | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 11.726 ms | 2 - 147 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
91
- | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 11.608 ms | 15 - 185 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
92
- | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 6.357 ms | 6 - 117 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
93
- | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 8.382 ms | 2 - 151 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
94
- | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 10.011 ms | 15 - 165 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
95
- | TrOCREncoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 5.471 ms | 0 - 110 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
96
- | TrOCREncoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 6.952 ms | 2 - 128 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
97
- | TrOCREncoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 7.249 ms | 15 - 144 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
98
- | TrOCREncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 18.104 ms | 214 - 214 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
99
- | TrOCREncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 18.126 ms | 49 - 49 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
100
 
101
 
102
 
@@ -111,9 +111,9 @@ pip install "qai-hub-models[trocr]"
111
  ```
112
 
113
 
114
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
115
 
116
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
117
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
118
 
119
  With this API token, you can configure your client to run models on the cloud
@@ -121,7 +121,7 @@ hosted devices.
121
  ```bash
122
  qai-hub configure --api_token API_TOKEN
123
  ```
124
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
125
 
126
 
127
 
@@ -232,7 +232,7 @@ With the output of the model, you can compute like PSNR, relative errors or
232
  spot check the output with expected output.
233
 
234
  **Note**: This on-device profiling and inference requires access to Qualcomm®
235
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
236
 
237
 
238
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | TrOCRDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.374 ms | 0 - 75 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
41
+ | TrOCRDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.125 ms | 5 - 74 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
42
+ | TrOCRDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.424 ms | 0 - 132 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
43
+ | TrOCRDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.846 ms | 5 - 134 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
44
+ | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.996 ms | 0 - 382 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
45
+ | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.967 ms | 1 - 20 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
46
+ | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 2.616 ms | 0 - 174 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
47
+ | TrOCRDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.828 ms | 0 - 74 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
48
+ | TrOCRDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 8.658 ms | 5 - 74 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
49
+ | TrOCRDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.374 ms | 0 - 75 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
50
+ | TrOCRDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.125 ms | 5 - 74 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
51
+ | TrOCRDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.047 ms | 0 - 223 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
52
+ | TrOCRDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.983 ms | 2 - 23 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
53
+ | TrOCRDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.885 ms | 0 - 65 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
54
+ | TrOCRDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.815 ms | 0 - 59 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
55
+ | TrOCRDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.001 ms | 0 - 214 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
56
+ | TrOCRDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.005 ms | 2 - 21 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
57
+ | TrOCRDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.828 ms | 0 - 74 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
58
+ | TrOCRDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 8.658 ms | 5 - 74 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
59
+ | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.434 ms | 0 - 145 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
60
+ | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.419 ms | 0 - 143 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
61
+ | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.734 ms | 0 - 149 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
62
+ | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.286 ms | 0 - 79 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
63
+ | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.245 ms | 0 - 155 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
64
+ | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 1.853 ms | 0 - 154 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
65
+ | TrOCRDecoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 1.16 ms | 0 - 73 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
66
+ | TrOCRDecoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 1.106 ms | 3 - 142 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
67
+ | TrOCRDecoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 1.4 ms | 3 - 143 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
68
+ | TrOCRDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.118 ms | 654 - 654 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
69
+ | TrOCRDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 2.233 ms | 68 - 68 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
70
+ | TrOCREncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 41.885 ms | 7 - 116 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
71
+ | TrOCREncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 45.923 ms | 2 - 123 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
72
+ | TrOCREncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 22.706 ms | 7 - 127 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
73
+ | TrOCREncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 28.73 ms | 2 - 134 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
74
+ | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 13.282 ms | 6 - 25 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
75
+ | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 16.8 ms | 2 - 24 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
76
+ | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 17.835 ms | 0 - 137 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
77
+ | TrOCREncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 16.032 ms | 7 - 115 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
78
+ | TrOCREncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 19.786 ms | 2 - 127 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
79
+ | TrOCREncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 41.885 ms | 7 - 116 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
80
+ | TrOCREncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 45.923 ms | 2 - 123 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
81
+ | TrOCREncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 13.269 ms | 7 - 22 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
82
+ | TrOCREncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 16.832 ms | 1 - 21 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
83
+ | TrOCREncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 24.334 ms | 7 - 124 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
84
+ | TrOCREncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 25.832 ms | 2 - 130 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
85
+ | TrOCREncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 13.284 ms | 7 - 22 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
86
+ | TrOCREncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 16.759 ms | 2 - 17 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
87
+ | TrOCREncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 16.032 ms | 7 - 115 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
88
+ | TrOCREncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 19.786 ms | 2 - 127 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
89
+ | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 9.448 ms | 6 - 119 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
90
+ | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 11.472 ms | 2 - 136 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
91
+ | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 11.6 ms | 15 - 184 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
92
+ | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 6.36 ms | 6 - 118 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
93
+ | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 9.285 ms | 2 - 153 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
94
+ | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 9.978 ms | 15 - 165 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
95
+ | TrOCREncoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 5.489 ms | 0 - 111 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
96
+ | TrOCREncoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 6.947 ms | 2 - 129 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
97
+ | TrOCREncoder | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 7.281 ms | 15 - 145 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
98
+ | TrOCREncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 17.518 ms | 203 - 203 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
99
+ | TrOCREncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 18.147 ms | 49 - 49 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
100
 
101
 
102
 
 
111
  ```
112
 
113
 
114
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
115
 
116
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
117
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
118
 
119
  With this API token, you can configure your client to run models on the cloud
 
121
  ```bash
122
  qai-hub configure --api_token API_TOKEN
123
  ```
124
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
125
 
126
 
127
 
 
232
  spot check the output with expected output.
233
 
234
  **Note**: This on-device profiling and inference requires access to Qualcomm®
235
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
236
 
237
 
238
 
TrOCR_TrOCRDecoder_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4a252e215b32d475fb288babaf4170233e6c231acef328fe667730ebbeb9020
3
- size 153570028
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:87888a84145b5e4f1769e60673d11bd18f6c64ea429944a467b47a7038aad3d1
3
+ size 153570124
TrOCR_TrOCRDecoder_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ddc9c740d71b17aa7ca5d3e573efcac4600412f71033318624a198c582a2806d
3
- size 95898884
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:633dde8e4133c17744bc9776fe00af54bf3e48e6c300fd6f2bc4f20c2fc4e3f5
3
+ size 95898887
TrOCR_TrOCREncoder_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:89b3108b4a9d0dbc06f3fb1258a1e2da49e7bd987926ebb2bae9300c59deb568
3
- size 92366804
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eddb0494a27d556f6980d35895731dcc2bdd1d10041bb2b8e063764e790b5660
3
+ size 92366908
TrOCR_TrOCREncoder_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0344fcca1b13cbfd959f5503709a0792ff06bc36b1a8f6cd9a5429243c92b09e
3
- size 57594164
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d56ae2aa48232fb4adebdc572325c0c6bd8b05b742b22a073988a34976da910
3
+ size 57594148