qaihm-bot commited on
Commit
11623e9
·
verified ·
1 Parent(s): b986e34

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

README.md CHANGED
@@ -37,82 +37,58 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | SINet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.637 ms | 0 - 21 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
41
- | SINet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.49 ms | 1 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
42
- | SINet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.822 ms | 0 - 31 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
43
- | SINet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.328 ms | 1 - 35 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
44
- | SINet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.633 ms | 0 - 9 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
45
- | SINet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.587 ms | 1 - 11 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
46
- | SINet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.646 ms | 0 - 9 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
47
- | SINet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.107 ms | 0 - 20 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
48
- | SINet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.001 ms | 1 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
49
- | SINet | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.637 ms | 0 - 21 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
50
- | SINet | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.49 ms | 1 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
51
- | SINet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.623 ms | 0 - 8 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
52
- | SINet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.586 ms | 0 - 5 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
53
- | SINet | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.372 ms | 0 - 27 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
54
- | SINet | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.384 ms | 1 - 30 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
55
- | SINet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.631 ms | 0 - 4 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
56
- | SINet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.581 ms | 2 - 9 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
57
- | SINet | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.107 ms | 0 - 20 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
58
- | SINet | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.001 ms | 1 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
59
- | SINet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.077 ms | 0 - 30 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
60
- | SINet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.048 ms | 1 - 31 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
61
- | SINet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.058 ms | 0 - 34 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
62
- | SINet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.812 ms | 0 - 22 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
63
- | SINet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.78 ms | 1 - 30 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
64
- | SINet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.829 ms | 0 - 25 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
65
- | SINet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.678 ms | 0 - 23 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
66
- | SINet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.641 ms | 1 - 29 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
67
- | SINet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.755 ms | 1 - 25 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
68
- | SINet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.821 ms | 0 - 0 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
69
- | SINet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.62 ms | 2 - 2 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
70
- | SINet | w8a16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.482 ms | 0 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
71
- | SINet | w8a16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.362 ms | 0 - 33 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
72
- | SINet | w8a16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.808 ms | 0 - 8 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
73
- | SINet | w8a16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 2.135 ms | 0 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
74
- | SINet | w8a16 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.482 ms | 0 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
75
- | SINet | w8a16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.805 ms | 0 - 8 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
76
- | SINet | w8a16 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.886 ms | 0 - 30 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
77
- | SINet | w8a16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.811 ms | 0 - 10 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
78
- | SINet | w8a16 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 2.135 ms | 0 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
79
- | SINet | w8a16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.222 ms | 0 - 33 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
80
- | SINet | w8a16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.908 ms | 0 - 34 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
81
- | SINet | w8a16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.727 ms | 0 - 30 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
82
- | SINet | w8a16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 2.023 ms | 0 - 0 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a16.dlc) |
83
- | SINet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 2.249 ms | 0 - 21 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
84
- | SINet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 2.63 ms | 0 - 23 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
85
- | SINet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.23 ms | 0 - 32 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
86
- | SINet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1.441 ms | 0 - 31 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
87
- | SINet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.128 ms | 0 - 12 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
88
- | SINet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.297 ms | 0 - 12 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
89
- | SINet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 5.281 ms | 4 - 16 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
90
- | SINet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 5.898 ms | 0 - 21 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
91
- | SINet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.584 ms | 0 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
92
- | SINet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 19.606 ms | 0 - 25 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
93
- | SINet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 12.275 ms | 7 - 19 MB | CPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
94
- | SINet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 10.56 ms | 7 - 10 MB | CPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
95
- | SINet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 2.249 ms | 0 - 21 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
96
- | SINet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 2.63 ms | 0 - 23 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
97
- | SINet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.127 ms | 0 - 5 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
98
- | SINet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.301 ms | 0 - 12 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
99
- | SINet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 1.722 ms | 0 - 28 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
100
- | SINet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 1.952 ms | 0 - 28 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
101
- | SINet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.126 ms | 0 - 12 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
102
- | SINet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.302 ms | 0 - 7 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
103
- | SINet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 5.898 ms | 0 - 21 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
104
- | SINet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.584 ms | 0 - 22 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
105
- | SINet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.776 ms | 0 - 38 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
106
- | SINet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 0.888 ms | 0 - 34 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
107
- | SINet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.537 ms | 0 - 25 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
108
- | SINet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.595 ms | 0 - 29 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
109
- | SINet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.656 ms | 0 - 29 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
110
- | SINet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.903 ms | 0 - 21 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
111
- | SINet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.498 ms | 0 - 24 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
112
- | SINet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.531 ms | 0 - 26 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
113
- | SINet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.791 ms | 0 - 25 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
114
- | SINet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.515 ms | 0 - 0 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.dlc) |
115
- | SINet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.777 ms | 6 - 6 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
116
 
117
 
118
 
@@ -126,9 +102,9 @@ pip install qai-hub-models
126
  ```
127
 
128
 
129
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
130
 
131
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
132
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
133
 
134
  With this API token, you can configure your client to run models on the cloud
@@ -136,7 +112,7 @@ hosted devices.
136
  ```bash
137
  qai-hub configure --api_token API_TOKEN
138
  ```
139
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
140
 
141
 
142
 
@@ -247,7 +223,7 @@ With the output of the model, you can compute like PSNR, relative errors or
247
  spot check the output with expected output.
248
 
249
  **Note**: This on-device profiling and inference requires access to Qualcomm®
250
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
251
 
252
 
253
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | SINet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 3.678 ms | 0 - 22 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
41
+ | SINet | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 3.469 ms | 1 - 24 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
42
+ | SINet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.799 ms | 0 - 33 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
43
+ | SINet | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 2.332 ms | 1 - 33 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
44
+ | SINet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.64 ms | 0 - 8 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
45
+ | SINet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 1.603 ms | 1 - 8 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
46
+ | SINet | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 1.631 ms | 0 - 9 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
47
+ | SINet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 2.123 ms | 0 - 22 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
48
+ | SINet | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 1.98 ms | 1 - 23 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
49
+ | SINet | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 3.678 ms | 0 - 22 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
50
+ | SINet | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 3.469 ms | 1 - 24 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
51
+ | SINet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.637 ms | 0 - 7 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
52
+ | SINet | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 1.605 ms | 1 - 11 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
53
+ | SINet | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 2.428 ms | 0 - 28 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
54
+ | SINet | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 2.425 ms | 1 - 32 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
55
+ | SINet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.636 ms | 0 - 9 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
56
+ | SINet | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 1.602 ms | 0 - 11 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
57
+ | SINet | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 2.123 ms | 0 - 22 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
58
+ | SINet | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 1.98 ms | 1 - 23 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
59
+ | SINet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 1.088 ms | 0 - 35 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
60
+ | SINet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 1.069 ms | 1 - 36 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
61
+ | SINet | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 1.056 ms | 0 - 33 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
62
+ | SINet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.814 ms | 0 - 25 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
63
+ | SINet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 0.784 ms | 1 - 31 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
64
+ | SINet | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 0.827 ms | 0 - 24 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
65
+ | SINet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.68 ms | 0 - 24 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet.tflite) |
66
+ | SINet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 0.646 ms | 1 - 26 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
67
+ | SINet | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 0.741 ms | 1 - 25 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
68
+ | SINet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 1.842 ms | 3 - 3 MB | NPU | [SINet.dlc](https://huggingface.co/qualcomm/SINet/blob/main/SINet.dlc) |
69
+ | SINet | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 1.642 ms | 2 - 2 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet.onnx.zip) |
70
+ | SINet | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 2.271 ms | 0 - 22 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
71
+ | SINet | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 1.259 ms | 0 - 32 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
72
+ | SINet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 1.126 ms | 0 - 11 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
73
+ | SINet | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 4.76 ms | 4 - 11 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
74
+ | SINet | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 1.426 ms | 0 - 23 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
75
+ | SINet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | TFLITE | 30.624 ms | 0 - 26 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
76
+ | SINet | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 12.562 ms | 7 - 19 MB | CPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
77
+ | SINet | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 10.209 ms | 7 - 10 MB | CPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
78
+ | SINet | w8a8 | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 2.271 ms | 0 - 22 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
79
+ | SINet | w8a8 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 1.128 ms | 0 - 12 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
80
+ | SINet | w8a8 | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 1.714 ms | 0 - 29 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
81
+ | SINet | w8a8 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 1.127 ms | 0 - 12 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
82
+ | SINet | w8a8 | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 1.426 ms | 0 - 23 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
83
+ | SINet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 0.778 ms | 0 - 29 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
84
+ | SINet | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 3.615 ms | 0 - 26 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
85
+ | SINet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 0.59 ms | 0 - 27 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
86
+ | SINet | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 2.936 ms | 0 - 21 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
87
+ | SINet | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | TFLITE | 5.61 ms | 0 - 25 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
88
+ | SINet | w8a8 | Snapdragon 7 Gen 4 QRD | Snapdragon® 7 Gen 4 Mobile | ONNX | 11.007 ms | 7 - 24 MB | CPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
89
+ | SINet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 0.497 ms | 0 - 24 MB | NPU | [SINet.tflite](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.tflite) |
90
+ | SINet | w8a8 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 2.799 ms | 2 - 26 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
91
+ | SINet | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 6.26 ms | 6 - 6 MB | NPU | [SINet.onnx.zip](https://huggingface.co/qualcomm/SINet/blob/main/SINet_w8a8.onnx.zip) |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
92
 
93
 
94
 
 
102
  ```
103
 
104
 
105
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
106
 
107
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
108
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
109
 
110
  With this API token, you can configure your client to run models on the cloud
 
112
  ```bash
113
  qai-hub configure --api_token API_TOKEN
114
  ```
115
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
116
 
117
 
118
 
 
223
  spot check the output with expected output.
224
 
225
  **Note**: This on-device profiling and inference requires access to Qualcomm®
226
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
227
 
228
 
229
 
SINet_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:41a15799bfb738f56aa763811d36a8c5cb2cdf0e13dd47fc9dc5bd60d7a5944b
3
- size 547556
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1441970481ae4d017333747dab0b7b2b70cd966ab15e0c432a0fe1f4aed16051
3
+ size 547652
SINet_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5836910054f342b2b94ac8f59d3b5cb27d27a0c1496328481ead4a4fdfda1ef7
3
  size 344641
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79d1f57266bcb977de1b7acdaaff519546cdbcb1a9bb04442c5c96d90541494f
3
  size 344641
SINet_w8a16.dlc DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:e1a28460d165555821de962b7d95750d952ebee4ba6d81d44bb6db13ebb7b3da
3
- size 474028
 
 
 
 
SINet_w8a8.dlc DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:122555f3be911f7d8c5dff72f90dd84e61a07a5e21d30448bbd85ca23fd814e5
3
- size 471820
 
 
 
 
SINet_w8a8.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9a9599127e333dc6da0a6dc12b11cb2e812dc79083e63786ff7b4d1de6d9152b
3
- size 333503
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6c843b35219676324fbe073fcb4b2fc2a53cb1f06d3bcc04f50a0d853523b040
3
+ size 333447