Hugging Face's logo

qualcomm
/
TrOCR

Image-to-Text
PyTorch
LiteRT
android
Model card Files
xet
Community
3
qaihm-bot commited on
Commit
32c3acd
·
verified ·
1 Parent(s): ceacabb

v0.38.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.38.0 for changelog.

Files changed (11) hide show
  1. README.md +55 -61
  2. TrOCR_TrOCRDecoder_float.dlc +2 -2
  3. TrOCR_TrOCRDecoder_float.onnx.zip +2 -2
  4. TrOCR_TrOCREncoder_float.dlc +2 -2
  5. TrOCR_TrOCREncoder_float.onnx.zip +2 -2
  6. precompiled/qualcomm-snapdragon-x-elite/TrOCR_TrOCRDecoder_float.bin +0 -3
  7. precompiled/qualcomm-snapdragon-x-elite/TrOCR_TrOCRDecoder_float.onnx.zip +0 -3
  8. precompiled/qualcomm-snapdragon-x-elite/TrOCR_TrOCREncoder_float.bin +0 -3
  9. precompiled/qualcomm-snapdragon-x-elite/TrOCR_TrOCREncoder_float.onnx.zip +0 -3
  10. precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml +0 -3
  11. tool-versions.yaml +2 -2
README.md CHANGED
@@ -37,66 +37,60 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | TrOCRDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.222 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
41
- | TrOCRDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.002 ms | 5 - 67 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
42
- | TrOCRDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.632 ms | 0 - 132 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
43
- | TrOCRDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 3.018 ms | 4 - 132 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
44
- | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.066 ms | 0 - 214 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
45
- | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.01 ms | 1 - 27 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
46
- | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 2.69 ms | 0 - 179 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
47
- | TrOCRDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.886 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
48
- | TrOCRDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.813 ms | 5 - 67 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
49
- | TrOCRDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.222 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
50
- | TrOCRDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.002 ms | 5 - 67 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
51
- | TrOCRDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.081 ms | 0 - 215 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
52
- | TrOCRDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.011 ms | 2 - 28 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
53
- | TrOCRDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 3.157 ms | 0 - 64 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
54
- | TrOCRDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.877 ms | 0 - 59 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
55
- | TrOCRDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.06 ms | 0 - 224 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
56
- | TrOCRDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.032 ms | 2 - 26 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
57
- | TrOCRDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.886 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
58
- | TrOCRDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.813 ms | 5 - 67 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
59
- | TrOCRDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 2.114 ms | 0 - 244 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
60
- | TrOCRDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 2.014 ms | 1 - 27 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
61
- | TrOCRDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 2.677 ms | 0 - 179 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
62
- | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.541 ms | 0 - 148 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
63
- | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.443 ms | 0 - 139 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
64
- | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.829 ms | 0 - 139 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
65
- | TrOCRDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 1.399 ms | 0 - 73 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
66
- | TrOCRDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 1.269 ms | 2 - 152 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
67
- | TrOCRDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 1.66 ms | 1 - 150 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
68
- | TrOCRDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.219 ms | 626 - 626 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
69
- | TrOCRDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 2.471 ms | 68 - 68 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
70
- | TrOCREncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 48.039 ms | 7 - 115 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
71
- | TrOCREncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 46.257 ms | 2 - 139 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
72
- | TrOCREncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 25.412 ms | 7 - 128 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
73
- | TrOCREncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 28.129 ms | 1 - 130 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
74
- | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 17.742 ms | 7 - 23 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
75
- | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 17.229 ms | 2 - 28 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
76
- | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 19.204 ms | 0 - 135 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
77
- | TrOCREncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 20.329 ms | 3 - 111 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
78
- | TrOCREncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 19.824 ms | 2 - 137 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
79
- | TrOCREncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 48.039 ms | 7 - 115 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
80
- | TrOCREncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 46.257 ms | 2 - 139 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
81
- | TrOCREncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 17.733 ms | 7 - 26 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
82
- | TrOCREncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 17.299 ms | 2 - 21 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
83
- | TrOCREncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 28.15 ms | 7 - 119 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
84
- | TrOCREncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 25.233 ms | 2 - 126 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
85
- | TrOCREncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 17.794 ms | 7 - 24 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
86
- | TrOCREncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 17.31 ms | 2 - 24 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
87
- | TrOCREncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 20.329 ms | 3 - 111 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
88
- | TrOCREncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 19.824 ms | 2 - 137 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
89
- | TrOCREncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 17.804 ms | 7 - 25 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
90
- | TrOCREncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 17.254 ms | 2 - 25 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
91
- | TrOCREncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 19.718 ms | 0 - 134 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
92
- | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 12.3 ms | 6 - 117 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
93
- | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 11.66 ms | 2 - 143 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
94
- | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 14.315 ms | 15 - 159 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
95
- | TrOCREncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 10.719 ms | 6 - 118 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
96
- | TrOCREncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 9.067 ms | 2 - 157 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
97
- | TrOCREncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 13.236 ms | 14 - 152 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
98
- | TrOCREncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 18.037 ms | 190 - 190 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
99
- | TrOCREncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 19.153 ms | 49 - 49 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
100
 
101
 
102
 
@@ -178,7 +172,7 @@ from qai_hub_models.models.trocr import Model
178
  torch_model = Model.from_pretrained()
179
 
180
  # Device
181
- device = hub.Device("Samsung Galaxy S24")
182
 
183
  # Trace model
184
  input_shape = torch_model.get_input_spec()
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | TrOCRDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 4.273 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
41
+ | TrOCRDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 4.019 ms | 5 - 67 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
42
+ | TrOCRDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 2.484 ms | 0 - 135 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
43
+ | TrOCRDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.97 ms | 5 - 132 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
44
+ | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 2.06 ms | 0 - 224 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
45
+ | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 2.022 ms | 1 - 30 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
46
+ | TrOCRDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 2.419 ms | 0 - 176 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
47
+ | TrOCRDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.916 ms | 0 - 73 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
48
+ | TrOCRDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.809 ms | 5 - 67 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
49
+ | TrOCRDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 4.273 ms | 0 - 72 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
50
+ | TrOCRDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 4.019 ms | 5 - 67 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
51
+ | TrOCRDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 2.09 ms | 0 - 225 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
52
+ | TrOCRDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 2.019 ms | 1 - 26 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
53
+ | TrOCRDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 3.048 ms | 0 - 65 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
54
+ | TrOCRDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.988 ms | 0 - 58 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
55
+ | TrOCRDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 2.068 ms | 0 - 224 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
56
+ | TrOCRDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 2.016 ms | 1 - 26 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
57
+ | TrOCRDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.916 ms | 0 - 73 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
58
+ | TrOCRDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.809 ms | 5 - 67 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
59
+ | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.512 ms | 0 - 147 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
60
+ | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.471 ms | 0 - 140 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
61
+ | TrOCRDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.751 ms | 0 - 145 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
62
+ | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 1.22 ms | 0 - 77 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
63
+ | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 1.155 ms | 0 - 151 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
64
+ | TrOCRDecoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 1.444 ms | 0 - 154 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
65
+ | TrOCRDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.203 ms | 648 - 648 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
66
+ | TrOCRDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 2.245 ms | 67 - 67 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
67
+ | TrOCREncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 48.055 ms | 7 - 117 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
68
+ | TrOCREncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 46.683 ms | 2 - 139 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
69
+ | TrOCREncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 25.097 ms | 7 - 129 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
70
+ | TrOCREncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 28.361 ms | 1 - 135 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
71
+ | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 17.725 ms | 7 - 21 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
72
+ | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 17.497 ms | 2 - 21 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
73
+ | TrOCREncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 17.82 ms | 0 - 131 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
74
+ | TrOCREncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 20.346 ms | 7 - 116 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
75
+ | TrOCREncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 19.696 ms | 2 - 140 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
76
+ | TrOCREncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 48.055 ms | 7 - 117 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
77
+ | TrOCREncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 46.683 ms | 2 - 139 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
78
+ | TrOCREncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 17.902 ms | 7 - 24 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
79
+ | TrOCREncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 17.548 ms | 2 - 20 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
80
+ | TrOCREncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 28.338 ms | 6 - 118 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
81
+ | TrOCREncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 25.793 ms | 2 - 134 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
82
+ | TrOCREncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 17.932 ms | 7 - 19 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
83
+ | TrOCREncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 17.317 ms | 2 - 19 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
84
+ | TrOCREncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 20.346 ms | 7 - 116 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
85
+ | TrOCREncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 19.696 ms | 2 - 140 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
86
+ | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 12.244 ms | 7 - 120 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
87
+ | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 11.717 ms | 2 - 143 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
88
+ | TrOCREncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 11.609 ms | 15 - 185 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
89
+ | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 8.87 ms | 7 - 119 MB | NPU | [TrOCR.tflite](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.tflite) |
90
+ | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 8.413 ms | 2 - 156 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
91
+ | TrOCREncoder | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 10.026 ms | 15 - 204 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
92
+ | TrOCREncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 18.18 ms | 190 - 190 MB | NPU | [TrOCR.dlc](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.dlc) |
93
+ | TrOCREncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 18.055 ms | 48 - 48 MB | NPU | [TrOCR.onnx.zip](https://huggingface.co/qualcomm/TrOCR/blob/main/TrOCR.onnx.zip) |
 
 
 
 
 
 
94
 
95
 
96
 
 
172
  torch_model = Model.from_pretrained()
173
 
174
  # Device
175
+ device = hub.Device("Samsung Galaxy S25")
176
 
177
  # Trace model
178
  input_shape = torch_model.get_input_spec()
TrOCR_TrOCRDecoder_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce66c562ac0a86eb51293c9e32faaeecf1930e89269bc4f399ddb0da0e05eb54
3
- size 153560668
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:230eafa8093a9f9fa0d3f4becd3fc1ee8ab75ebb2a3871064e9865be61266327
3
+ size 153560748
TrOCR_TrOCRDecoder_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4a4fad933d970c700206d200e763a6aba2ede2ccf2bd043214005df04692e014
3
- size 95898802
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba5ef29b30be3a7379cbdbe19152ff28d1e94d297dde19a89856e6fc5d8b033c
3
+ size 95898884
TrOCR_TrOCREncoder_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c2c476043b513b430add83c93b7bb877e49e038f04414adda2a627dbe78a61cc
3
- size 92359156
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d160c9b79d083fd1cc5bf22b844a3f263732befe482a569fcf70e0c86c07855b
3
+ size 92359244
TrOCR_TrOCREncoder_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a76d3eb8adaf3e6676e9df8d707ba41edeea2dbfc646ece58d03c894926ad7dc
3
- size 57593908
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bef954e681b00a254f32d3e47e2647f18049048116cb0b7409b0ec9d09b75f5
3
+ size 57594164
precompiled/qualcomm-snapdragon-x-elite/TrOCR_TrOCRDecoder_float.bin DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:60895e96a60534e3ebb52cdb66fc146517482ce49eebca3e60e7a5f85f848e3f
3
- size 77312000
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/TrOCR_TrOCRDecoder_float.onnx.zip DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:bf31e4ff4496ec8ab6676c87149df0e19b30346bedd6623bfdcdfba3404c1b20
3
- size 71198367
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/TrOCR_TrOCREncoder_float.bin DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:ef07a92eec2929dc4a1e358862696cab258f1a38d01cd22b01f63fc004eab219
3
- size 51875840
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/TrOCR_TrOCREncoder_float.onnx.zip DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:648779d147825381cca4f58241ad639ec5959a29dc2da2f736abf28b624878ea
3
- size 44041772
 
 
 
 
precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml DELETED
@@ -1,3 +0,0 @@
1
- tool_versions:
2
- precompiled_qnn_onnx:
3
- qairt: 2.36.4.250725200057_123280
 
 
 
 
tool-versions.yaml CHANGED
@@ -1,4 +1,4 @@
1
  tool_versions:
2
  onnx:
3
- qairt: 2.36.4.250725200057_123280
4
- onnx_runtime: 1.22.0
 
1
  tool_versions:
2
  onnx:
3
+ qairt: 2.37.1.250807093845_124904
4
+ onnx_runtime: 1.22.2