qaihm-bot commited on
Commit
1ff8ecf
·
verified ·
1 Parent(s): 29d87f8

See https://github.com/qualcomm/ai-hub-models/releases/v0.49.1 for changelog.

Files changed (1) hide show
  1. README.md +109 -111
README.md CHANGED
@@ -28,11 +28,11 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-onnx-float.zip)
32
- | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-onnx-w8a8.zip)
33
- | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-qnn_dlc-float.zip)
34
- | QNN_DLC | w8a8 | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-qnn_dlc-w8a8.zip)
35
- | TFLITE | w8a8 | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-tflite-w8a8.zip)
36
 
37
  For more device-specific assets and performance metrics, visit **[Segment-Anything-Model-2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/sam2)**.
38
 
@@ -63,112 +63,110 @@ See our repository for [Segment-Anything-Model-2 on GitHub](https://github.com/q
63
  ## Performance Summary
64
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
65
  |---|---|---|---|---|---|---
66
- | SAM2Decoder | ONNX | float | Snapdragon® X2 Elite | 3.276 ms | 15 - 15 MB | NPU
67
- | SAM2Decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 4.71 ms | 16 - 333 MB | NPU
68
- | SAM2Decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 6.772 ms | 16 - 25 MB | NPU
69
- | SAM2Decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.472 ms | 1 - 232 MB | NPU
70
- | SAM2Decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.146 ms | 17 - 242 MB | NPU
71
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 5.431 ms | 4 - 4 MB | NPU
72
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® X Elite | 12.473 ms | 4 - 4 MB | NPU
73
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.18 ms | 4 - 268 MB | NPU
74
- | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCS6490 | 130.615 ms | 51 - 60 MB | CPU
75
- | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.935 ms | 2 - 9 MB | NPU
76
- | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCM6690 | 58.195 ms | 48 - 69 MB | CPU
77
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.758 ms | 2 - 240 MB | NPU
78
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 50.849 ms | 50 - 67 MB | CPU
79
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.289 ms | 4 - 264 MB | NPU
80
- | SAM2Decoder | QNN_DLC | float | Snapdragon® X2 Elite | 3.049 ms | 16 - 16 MB | NPU
81
- | SAM2Decoder | QNN_DLC | float | Snapdragon® X Elite | 5.448 ms | 16 - 16 MB | NPU
82
- | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 3.652 ms | 3 - 232 MB | NPU
83
- | SAM2Decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5.241 ms | 16 - 55 MB | NPU
84
- | SAM2Decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.865 ms | 4 - 225 MB | NPU
85
- | SAM2Decoder | QNN_DLC | float | Qualcomm® SA8295P | 7.997 ms | 0 - 214 MB | NPU
86
- | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.913 ms | 4 - 213 MB | NPU
87
- | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.525 ms | 4 - 201 MB | NPU
88
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.287 ms | 4 - 4 MB | NPU
89
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 2.226 ms | 4 - 4 MB | NPU
90
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.294 ms | 0 - 102 MB | NPU
91
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.868 ms | 4 - 82 MB | NPU
92
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.916 ms | 4 - 6 MB | NPU
93
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 2.543 ms | 4 - 84 MB | NPU
94
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 9.886 ms | 4 - 265 MB | NPU
95
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 2.703 ms | 0 - 102 MB | NPU
96
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.868 ms | 4 - 82 MB | NPU
97
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.961 ms | 4 - 81 MB | NPU
98
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 1.03 ms | 1 - 83 MB | NPU
99
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 2.605 ms | 4 - 209 MB | NPU
100
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.902 ms | 1 - 106 MB | NPU
101
- | SAM2Decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 3.754 ms | 0 - 239 MB | NPU
102
- | SAM2Decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 12.854 ms | 0 - 210 MB | NPU
103
- | SAM2Decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.319 ms | 0 - 7 MB | NPU
104
- | SAM2Decoder | TFLITE | float | Qualcomm® SA8775P | 6.761 ms | 0 - 210 MB | NPU
105
- | SAM2Decoder | TFLITE | float | Qualcomm® SA7255P | 12.854 ms | 0 - 210 MB | NPU
106
- | SAM2Decoder | TFLITE | float | Qualcomm® SA8295P | 7.998 ms | 0 - 221 MB | NPU
107
- | SAM2Decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.526 ms | 0 - 206 MB | NPU
108
- | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.253 ms | 0 - 260 MB | NPU
109
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 20.902 ms | 0 - 210 MB | NPU
110
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 12.179 ms | 0 - 22 MB | NPU
111
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA8775P | 13.809 ms | 0 - 213 MB | NPU
112
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 46.634 ms | 14 - 208 MB | NPU
113
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 15.662 ms | 0 - 241 MB | NPU
114
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA7255P | 20.902 ms | 0 - 210 MB | NPU
115
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 14.232 ms | 0 - 222 MB | NPU
116
- | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.926 ms | 0 - 226 MB | NPU
117
- | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 15.913 ms | 8 - 204 MB | NPU
118
- | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.416 ms | 0 - 239 MB | NPU
119
- | SAM2Encoder | ONNX | float | Snapdragon® X2 Elite | 99.568 ms | 71 - 71 MB | NPU
120
- | SAM2Encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 145.472 ms | 45 - 3853 MB | NPU
121
- | SAM2Encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 196.682 ms | 0 - 88 MB | NPU
122
- | SAM2Encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 111.964 ms | 33 - 1668 MB | NPU
123
- | SAM2Encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 92.277 ms | 44 - 2275 MB | NPU
124
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 42.391 ms | 51 - 51 MB | NPU
125
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® X Elite | 89.486 ms | 47 - 47 MB | NPU
126
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 60.75 ms | 11 - 1996 MB | NPU
127
- | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCS6490 | 2191.807 ms | 766 - 790 MB | CPU
128
- | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 88.469 ms | 0 - 59 MB | NPU
129
- | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCM6690 | 1332.829 ms | 659 - 673 MB | CPU
130
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 59.235 ms | 9 - 1792 MB | NPU
131
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1257.884 ms | 648 - 663 MB | CPU
132
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 39.538 ms | 12 - 1882 MB | NPU
133
- | SAM2Encoder | QNN_DLC | float | Snapdragon® X2 Elite | 96.624 ms | 12 - 12 MB | NPU
134
- | SAM2Encoder | QNN_DLC | float | Snapdragon® X Elite | 201.908 ms | 12 - 12 MB | NPU
135
- | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 146.731 ms | 12 - 2001 MB | NPU
136
- | SAM2Encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 204.181 ms | 12 - 25 MB | NPU
137
- | SAM2Encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 397.56 ms | 13 - 1952 MB | NPU
138
- | SAM2Encoder | QNN_DLC | float | Qualcomm® SA8295P | 303.317 ms | 0 - 1619 MB | NPU
139
- | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 113.902 ms | 12 - 1673 MB | NPU
140
- | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 89.4 ms | 6 - 1645 MB | NPU
141
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 81.192 ms | 3 - 3 MB | NPU
142
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 85.347 ms | 3 - 3 MB | NPU
143
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 57.192 ms | 3 - 2046 MB | NPU
144
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 149.071 ms | 3 - 1666 MB | NPU
145
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 82.989 ms | 3 - 7 MB | NPU
146
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 85.343 ms | 3 - 1666 MB | NPU
147
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 1626.356 ms | 3 - 1891 MB | NPU
148
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 141.404 ms | 3 - 2022 MB | NPU
149
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 149.071 ms | 3 - 1666 MB | NPU
150
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 95.021 ms | 3 - 1670 MB | NPU
151
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 42.151 ms | 3 - 1652 MB | NPU
152
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 110.451 ms | 3 - 1790 MB | NPU
153
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 83.639 ms | 3 - 1690 MB | NPU
154
- | SAM2Encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 146.865 ms | 15 - 2040 MB | NPU
155
- | SAM2Encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 457.938 ms | 16 - 1692 MB | NPU
156
- | SAM2Encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 203.986 ms | 0 - 4 MB | NPU
157
- | SAM2Encoder | TFLITE | float | Qualcomm® SA8775P | 910.158 ms | 5 - 1681 MB | NPU
158
- | SAM2Encoder | TFLITE | float | Qualcomm® SA7255P | 457.938 ms | 16 - 1692 MB | NPU
159
- | SAM2Encoder | TFLITE | float | Qualcomm® SA8295P | 295.729 ms | 16 - 1660 MB | NPU
160
- | SAM2Encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 95.65 ms | 16 - 2353 MB | NPU
161
- | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 61.048 ms | 14 - 1996 MB | NPU
162
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 150.292 ms | 4 - 1740 MB | NPU
163
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 88.305 ms | 4 - 8 MB | NPU
164
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 88.47 ms | 4 - 1739 MB | NPU
165
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 2324.338 ms | 1 - 253 MB | CPU
166
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 149.64 ms | 4 - 2047 MB | NPU
167
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 150.292 ms | 4 - 1740 MB | NPU
168
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 101.399 ms | 4 - 1759 MB | NPU
169
- | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 58.304 ms | 4 - 1784 MB | NPU
170
- | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1270.122 ms | 64 - 316 MB | CPU
171
- | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 39.36 ms | 4 - 1862 MB | NPU
172
 
173
  ## License
174
  * The license for the original implementation of Segment-Anything-Model-2 can be found
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.49.1/sam2-onnx-float.zip)
32
+ | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.49.1/sam2-onnx-w8a8.zip)
33
+ | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.49.1/sam2-qnn_dlc-float.zip)
34
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.49.1/sam2-qnn_dlc-w8a8.zip)
35
+ | TFLITE | w8a8 | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.49.1/sam2-tflite-w8a8.zip)
36
 
37
  For more device-specific assets and performance metrics, visit **[Segment-Anything-Model-2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/sam2)**.
38
 
 
63
  ## Performance Summary
64
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
65
  |---|---|---|---|---|---|---
66
+ | SAM2Decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.147 ms | 17 - 241 MB | NPU
67
+ | SAM2Decoder | ONNX | float | Snapdragon® X2 Elite | 3.323 ms | 15 - 15 MB | NPU
68
+ | SAM2Decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 4.735 ms | 17 - 337 MB | NPU
69
+ | SAM2Decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 6.782 ms | 16 - 24 MB | NPU
70
+ | SAM2Decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.479 ms | 2 - 238 MB | NPU
71
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.305 ms | 4 - 263 MB | NPU
72
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 5.396 ms | 4 - 4 MB | NPU
73
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® X Elite | 12.506 ms | 4 - 4 MB | NPU
74
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.209 ms | 4 - 277 MB | NPU
75
+ | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCS6490 | 135.35 ms | 47 - 57 MB | CPU
76
+ | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.987 ms | 2 - 9 MB | NPU
77
+ | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCM6690 | 56.923 ms | 48 - 69 MB | CPU
78
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.792 ms | 2 - 240 MB | NPU
79
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 51.131 ms | 49 - 66 MB | CPU
80
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.537 ms | 4 - 201 MB | NPU
81
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® X2 Elite | 3.077 ms | 16 - 16 MB | NPU
82
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 3.606 ms | 4 - 230 MB | NPU
83
+ | SAM2Decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5.288 ms | 16 - 18 MB | NPU
84
+ | SAM2Decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.838 ms | 4 - 225 MB | NPU
85
+ | SAM2Decoder | QNN_DLC | float | Qualcomm® SA8295P | 8.032 ms | 0 - 214 MB | NPU
86
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.886 ms | 4 - 214 MB | NPU
87
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.907 ms | 1 - 105 MB | NPU
88
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.323 ms | 4 - 4 MB | NPU
89
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 2.256 ms | 4 - 4 MB | NPU
90
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.292 ms | 0 - 102 MB | NPU
91
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.896 ms | 4 - 82 MB | NPU
92
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.92 ms | 4 - 6 MB | NPU
93
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 2.55 ms | 4 - 85 MB | NPU
94
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 9.934 ms | 4 - 265 MB | NPU
95
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 2.713 ms | 4 - 109 MB | NPU
96
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.896 ms | 4 - 82 MB | NPU
97
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 3.006 ms | 4 - 81 MB | NPU
98
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 1.019 ms | 1 - 78 MB | NPU
99
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 2.592 ms | 4 - 204 MB | NPU
100
+ | SAM2Decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.534 ms | 0 - 205 MB | NPU
101
+ | SAM2Decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 3.716 ms | 0 - 242 MB | NPU
102
+ | SAM2Decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 12.815 ms | 0 - 210 MB | NPU
103
+ | SAM2Decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.316 ms | 0 - 18 MB | NPU
104
+ | SAM2Decoder | TFLITE | float | Qualcomm® SA8775P | 6.748 ms | 0 - 211 MB | NPU
105
+ | SAM2Decoder | TFLITE | float | Qualcomm® SA7255P | 12.815 ms | 0 - 210 MB | NPU
106
+ | SAM2Decoder | TFLITE | float | Qualcomm® SA8295P | 8.004 ms | 0 - 223 MB | NPU
107
+ | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.435 ms | 0 - 240 MB | NPU
108
+ | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.2 ms | 0 - 257 MB | NPU
109
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 20.893 ms | 0 - 212 MB | NPU
110
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 12.179 ms | 0 - 47 MB | NPU
111
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA8775P | 13.8 ms | 0 - 213 MB | NPU
112
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 49.732 ms | 14 - 207 MB | NPU
113
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 15.647 ms | 0 - 240 MB | NPU
114
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA7255P | 20.893 ms | 0 - 212 MB | NPU
115
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 14.142 ms | 0 - 223 MB | NPU
116
+ | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.876 ms | 0 - 225 MB | NPU
117
+ | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 16.291 ms | 14 - 210 MB | NPU
118
+ | SAM2Encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 97.348 ms | 44 - 2275 MB | NPU
119
+ | SAM2Encoder | ONNX | float | Snapdragon® X2 Elite | 99.905 ms | 71 - 71 MB | NPU
120
+ | SAM2Encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 144.746 ms | 45 - 3849 MB | NPU
121
+ | SAM2Encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 196.22 ms | 0 - 87 MB | NPU
122
+ | SAM2Encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 113.929 ms | 33 - 1667 MB | NPU
123
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 40.345 ms | 11 - 1876 MB | NPU
124
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 42.196 ms | 51 - 51 MB | NPU
125
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® X Elite | 89.208 ms | 47 - 47 MB | NPU
126
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 62.035 ms | 12 - 2009 MB | NPU
127
+ | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCS6490 | 2166.168 ms | 765 - 789 MB | CPU
128
+ | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 88.54 ms | 0 - 59 MB | NPU
129
+ | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCM6690 | 1338.001 ms | 656 - 670 MB | CPU
130
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 57.69 ms | 11 - 1823 MB | NPU
131
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1257.464 ms | 662 - 677 MB | CPU
132
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 89.382 ms | 12 - 1648 MB | NPU
133
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® X2 Elite | 97.583 ms | 12 - 12 MB | NPU
134
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 146.055 ms | 0 - 1990 MB | NPU
135
+ | SAM2Encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 204.085 ms | 12 - 15 MB | NPU
136
+ | SAM2Encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 395.799 ms | 13 - 1950 MB | NPU
137
+ | SAM2Encoder | QNN_DLC | float | Qualcomm® SA8295P | 303.512 ms | 1 - 1619 MB | NPU
138
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 113.004 ms | 12 - 1675 MB | NPU
139
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 83.205 ms | 3 - 1685 MB | NPU
140
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 81.413 ms | 3 - 3 MB | NPU
141
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 85.457 ms | 3 - 3 MB | NPU
142
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 56.816 ms | 3 - 2047 MB | NPU
143
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 149.217 ms | 3 - 1666 MB | NPU
144
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 82.232 ms | 3 - 6 MB | NPU
145
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 85.262 ms | 3 - 1666 MB | NPU
146
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 1678.878 ms | 3 - 1890 MB | NPU
147
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 142.822 ms | 3 - 2022 MB | NPU
148
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 149.217 ms | 3 - 1666 MB | NPU
149
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 95.058 ms | 3 - 1669 MB | NPU
150
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 42.611 ms | 3 - 1656 MB | NPU
151
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 113.321 ms | 3 - 1793 MB | NPU
152
+ | SAM2Encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 100.758 ms | 15 - 2351 MB | NPU
153
+ | SAM2Encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 148.286 ms | 15 - 2047 MB | NPU
154
+ | SAM2Encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 458.243 ms | 16 - 1692 MB | NPU
155
+ | SAM2Encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 204.544 ms | 16 - 20 MB | NPU
156
+ | SAM2Encoder | TFLITE | float | Qualcomm® SA8775P | 217.798 ms | 16 - 1692 MB | NPU
157
+ | SAM2Encoder | TFLITE | float | Qualcomm® SA7255P | 458.243 ms | 16 - 1692 MB | NPU
158
+ | SAM2Encoder | TFLITE | float | Qualcomm® SA8295P | 296.088 ms | 16 - 1660 MB | NPU
159
+ | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 39.555 ms | 3 - 1860 MB | NPU
160
+ | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 60.723 ms | 2 - 1984 MB | NPU
161
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 150.504 ms | 4 - 1740 MB | NPU
162
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 88.866 ms | 4 - 8 MB | NPU
163
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 88.452 ms | 4 - 1738 MB | NPU
164
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 2502.605 ms | 109 - 384 MB | CPU
165
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 149.919 ms | 4 - 2044 MB | NPU
166
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 150.504 ms | 4 - 1740 MB | NPU
167
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 101.466 ms | 4 - 1760 MB | NPU
168
+ | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 60.506 ms | 3 - 1775 MB | NPU
169
+ | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1239.584 ms | 64 - 317 MB | CPU
 
 
170
 
171
  ## License
172
  * The license for the original implementation of Segment-Anything-Model-2 can be found