qaihm-bot commited on
Commit
e7cf7d5
·
verified ·
1 Parent(s): de970bc

See https://github.com/quic/ai-hub-models/releases/v0.33.1 for changelog.

README.md CHANGED
@@ -35,31 +35,31 @@ More details on model performance across various devices, can be found
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
- | Beit | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 43.911 ms | 0 - 315 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
39
  | Beit | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 44.762 ms | 0 - 326 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
40
- | Beit | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 18.095 ms | 0 - 325 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
41
  | Beit | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 26.778 ms | 0 - 310 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
42
- | Beit | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 12.54 ms | 0 - 18 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
43
  | Beit | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 14.594 ms | 0 - 34 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
44
- | Beit | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 15.613 ms | 0 - 315 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
45
  | Beit | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 17.202 ms | 0 - 327 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
46
- | Beit | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 43.911 ms | 0 - 315 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
47
  | Beit | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 44.762 ms | 0 - 326 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
48
- | Beit | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 12.557 ms | 0 - 21 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
49
  | Beit | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 14.563 ms | 0 - 32 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
50
- | Beit | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 20.385 ms | 0 - 307 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
51
  | Beit | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 21.8 ms | 1 - 315 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
52
- | Beit | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 12.555 ms | 0 - 18 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
53
  | Beit | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 14.634 ms | 0 - 33 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
54
- | Beit | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 15.613 ms | 0 - 315 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
55
  | Beit | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 17.202 ms | 0 - 327 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
56
- | Beit | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 12.564 ms | 0 - 16 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
57
  | Beit | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 14.571 ms | 0 - 33 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
58
  | Beit | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 14.592 ms | 0 - 213 MB | NPU | [Beit.onnx](https://huggingface.co/qualcomm/Beit/blob/main/Beit.onnx) |
59
- | Beit | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 8.614 ms | 0 - 340 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
60
  | Beit | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 9.93 ms | 0 - 344 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
61
  | Beit | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 10.271 ms | 1 - 353 MB | NPU | [Beit.onnx](https://huggingface.co/qualcomm/Beit/blob/main/Beit.onnx) |
62
- | Beit | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 7.951 ms | 0 - 322 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
63
  | Beit | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 9.398 ms | 1 - 320 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
64
  | Beit | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 7.91 ms | 0 - 325 MB | NPU | [Beit.onnx](https://huggingface.co/qualcomm/Beit/blob/main/Beit.onnx) |
65
  | Beit | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 18.125 ms | 1107 - 1107 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
@@ -127,7 +127,7 @@ Profiling Results
127
  Beit
128
  Device : cs_8275 (ANDROID 14)
129
  Runtime : TFLITE
130
- Estimated inference time (ms) : 43.9
131
  Estimated peak memory usage (MB): [0, 315]
132
  Total # Ops : 569
133
  Compute Unit(s) : npu (569 ops) gpu (0 ops) cpu (0 ops)
 
35
 
36
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
+ | Beit | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 43.998 ms | 0 - 315 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
39
  | Beit | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 44.762 ms | 0 - 326 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
40
+ | Beit | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 18.295 ms | 0 - 323 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
41
  | Beit | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 26.778 ms | 0 - 310 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
42
+ | Beit | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 12.561 ms | 0 - 16 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
43
  | Beit | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 14.594 ms | 0 - 34 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
44
+ | Beit | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 15.61 ms | 0 - 316 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
45
  | Beit | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 17.202 ms | 0 - 327 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
46
+ | Beit | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 43.998 ms | 0 - 315 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
47
  | Beit | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 44.762 ms | 0 - 326 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
48
+ | Beit | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 12.546 ms | 0 - 20 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
49
  | Beit | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 14.563 ms | 0 - 32 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
50
+ | Beit | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 20.42 ms | 0 - 308 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
51
  | Beit | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 21.8 ms | 1 - 315 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
52
+ | Beit | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 12.635 ms | 0 - 24 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
53
  | Beit | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 14.634 ms | 0 - 33 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
54
+ | Beit | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 15.61 ms | 0 - 316 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
55
  | Beit | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 17.202 ms | 0 - 327 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
56
+ | Beit | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 12.171 ms | 0 - 15 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
57
  | Beit | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 14.571 ms | 0 - 33 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
58
  | Beit | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 14.592 ms | 0 - 213 MB | NPU | [Beit.onnx](https://huggingface.co/qualcomm/Beit/blob/main/Beit.onnx) |
59
+ | Beit | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 8.649 ms | 0 - 337 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
60
  | Beit | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 9.93 ms | 0 - 344 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
61
  | Beit | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 10.271 ms | 1 - 353 MB | NPU | [Beit.onnx](https://huggingface.co/qualcomm/Beit/blob/main/Beit.onnx) |
62
+ | Beit | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 7.972 ms | 0 - 322 MB | NPU | [Beit.tflite](https://huggingface.co/qualcomm/Beit/blob/main/Beit.tflite) |
63
  | Beit | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 9.398 ms | 1 - 320 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
64
  | Beit | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 7.91 ms | 0 - 325 MB | NPU | [Beit.onnx](https://huggingface.co/qualcomm/Beit/blob/main/Beit.onnx) |
65
  | Beit | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 18.125 ms | 1107 - 1107 MB | NPU | [Beit.dlc](https://huggingface.co/qualcomm/Beit/blob/main/Beit.dlc) |
 
127
  Beit
128
  Device : cs_8275 (ANDROID 14)
129
  Runtime : TFLITE
130
+ Estimated inference time (ms) : 44.0
131
  Estimated peak memory usage (MB): [0, 315]
132
  Total # Ops : 569
133
  Compute Unit(s) : npu (569 ops) gpu (0 ops) cpu (0 ops)
precompiled/qualcomm-snapdragon-x-elite/Beit.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:49cb09e1ddad122c108ef0bc4821b339fb227ebae1a7440a75e69013b5088d54
3
  size 194583440
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:032c1a031b385087533f32a2cde1c17d2bfee10359a4450d6a7c5d61bb604b75
3
  size 194583440
precompiled/qualcomm-snapdragon-x-elite/Beit.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b5f776efdf97f23beb2d15ef6a89aad5ab6cab5c25ab59e5af587b7d1831b4d7
3
- size 165023546
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2343b302f85a65d7ba6ee851089aabfc47d962c9d69fb75560955679f0ae9e3
3
+ size 165023590
precompiled/qualcomm-snapdragon-x-elite/sdk_versions.yml DELETED
@@ -1,5 +0,0 @@
1
- sdk_versions:
2
- qnn_context_binary:
3
- qairt: 2.34.2.250528164111_119506
4
- precompiled_qnn_onnx:
5
- qairt: 2.33.2.250410134701_117956