Hugging Face's logo

qualcomm
/
Segment-Anything-Model-2

Image Segmentation
PyTorch
foundation
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
29d87f8
·
verified ·
1 Parent(s): f236d6f

v0.48.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.48.0 for changelog.

Files changed (1) hide show
  1. README.md +113 -99
README.md CHANGED
@@ -15,7 +15,7 @@ pipeline_tag: image-segmentation
15
  SAM 2, the successor to Meta's Segment Anything Model (SAM), is a cutting-edge tool designed for comprehensive object segmentation in both images and videos. It excels in handling complex visual data through a unified, promptable model architecture that supports real-time processing and zero-shot generalization.
16
 
17
  This is based on the implementation of Segment-Anything-Model-2 found [here](https://github.com/facebookresearch/sam2).
18
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/sam2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
@@ -28,25 +28,25 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.47.0/sam2-onnx-float.zip)
32
- | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.47.0/sam2-onnx-w8a8.zip)
33
- | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.47.0/sam2-qnn_dlc-float.zip)
34
- | QNN_DLC | w8a8 | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.47.0/sam2-qnn_dlc-w8a8.zip)
35
- | TFLITE | w8a8 | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.47.0/sam2-tflite-w8a8.zip)
36
 
37
  For more device-specific assets and performance metrics, visit **[Segment-Anything-Model-2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/sam2)**.
38
 
39
 
40
  ### Option 2: Export with Custom Configurations
41
 
42
- Use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/sam2) Python library to compile and export the model with your own:
43
  - Custom weights (e.g., fine-tuned checkpoints)
44
  - Custom input shapes
45
  - Target device and runtime configurations
46
 
47
  This option is ideal if you need to customize the model beyond the default configuration provided here.
48
 
49
- See our repository for [Segment-Anything-Model-2 on GitHub](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/sam2) for usage instructions.
50
 
51
  ## Model Details
52
 
@@ -63,98 +63,112 @@ See our repository for [Segment-Anything-Model-2 on GitHub](https://github.com/q
63
  ## Performance Summary
64
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
65
  |---|---|---|---|---|---|---
66
- | SAM2Decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 4.742 ms | 16 - 332 MB | NPU
67
- | SAM2Decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 6.749 ms | 16 - 23 MB | NPU
68
- | SAM2Decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.451 ms | 1 - 232 MB | NPU
69
- | SAM2Decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.16 ms | 17 - 241 MB | NPU
70
- | SAM2Decoder | ONNX | float | Snapdragon® X2 Elite | 3.242 ms | 15 - 15 MB | NPU
71
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® X Elite | 12.498 ms | 4 - 4 MB | NPU
72
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.214 ms | 4 - 276 MB | NPU
73
- | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCS6490 | 132.622 ms | 47 - 57 MB | CPU
74
- | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 12.448 ms | 2 - 11 MB | NPU
75
- | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCM6690 | 58.086 ms | 49 - 69 MB | CPU
76
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.697 ms | 2 - 240 MB | NPU
77
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 51.096 ms | 41 - 58 MB | CPU
78
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.27 ms | 4 - 264 MB | NPU
79
- | SAM2Decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 5.395 ms | 4 - 4 MB | NPU
80
- | SAM2Decoder | QNN_DLC | float | Snapdragon® X Elite | 5.439 ms | 16 - 16 MB | NPU
81
- | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 3.556 ms | 4 - 230 MB | NPU
82
- | SAM2Decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5.271 ms | 16 - 18 MB | NPU
83
- | SAM2Decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.877 ms | 4 - 229 MB | NPU
84
- | SAM2Decoder | QNN_DLC | float | Qualcomm® SA8295P | 7.958 ms | 0 - 214 MB | NPU
85
- | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.923 ms | 4 - 215 MB | NPU
86
- | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.538 ms | 4 - 202 MB | NPU
87
- | SAM2Decoder | QNN_DLC | float | Snapdragon® X2 Elite | 2.999 ms | 16 - 16 MB | NPU
88
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 2.247 ms | 4 - 4 MB | NPU
89
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.288 ms | 0 - 105 MB | NPU
90
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.877 ms | 4 - 82 MB | NPU
91
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.905 ms | 4 - 37 MB | NPU
92
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 2.56 ms | 4 - 85 MB | NPU
93
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 9.313 ms | 4 - 265 MB | NPU
94
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 2.723 ms | 0 - 100 MB | NPU
95
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.877 ms | 4 - 82 MB | NPU
96
- | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.96 ms | 4 - 81 MB | NPU
97
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 1.035 ms | 1 - 83 MB | NPU
98
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 2.585 ms | 4 - 204 MB | NPU
99
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.901 ms | 1 - 105 MB | NPU
100
- | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.317 ms | 4 - 4 MB | NPU
101
- | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.268 ms | 0 - 257 MB | NPU
102
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 20.931 ms | 0 - 211 MB | NPU
103
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 12.615 ms | 0 - 22 MB | NPU
104
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA8775P | 51.668 ms | 0 - 213 MB | NPU
105
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 50.592 ms | 12 - 205 MB | NPU
106
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 15.831 ms | 0 - 240 MB | NPU
107
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA7255P | 20.931 ms | 0 - 211 MB | NPU
108
- | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 14.202 ms | 0 - 223 MB | NPU
109
- | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.812 ms | 0 - 234 MB | NPU
110
- | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 16.551 ms | 10 - 206 MB | NPU
111
- | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.426 ms | 0 - 239 MB | NPU
112
- | SAM2Encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 144.522 ms | 45 - 3849 MB | NPU
113
- | SAM2Encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 198.49 ms | 0 - 88 MB | NPU
114
- | SAM2Encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 112.516 ms | 33 - 1665 MB | NPU
115
- | SAM2Encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 97.137 ms | 45 - 2288 MB | NPU
116
- | SAM2Encoder | ONNX | float | Snapdragon® X2 Elite | 99.796 ms | 71 - 71 MB | NPU
117
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® X Elite | 88.875 ms | 47 - 47 MB | NPU
118
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 61.169 ms | 7 - 1993 MB | NPU
119
- | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCS6490 | 2388.433 ms | 767 - 789 MB | CPU
120
- | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 88.623 ms | 0 - 69 MB | NPU
121
- | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCM6690 | 1344.194 ms | 662 - 676 MB | CPU
122
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 58.353 ms | 10 - 1793 MB | NPU
123
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1255.793 ms | 658 - 672 MB | CPU
124
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 39.583 ms | 13 - 1884 MB | NPU
125
- | SAM2Encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 42.311 ms | 51 - 51 MB | NPU
126
- | SAM2Encoder | QNN_DLC | float | Snapdragon® X Elite | 202.655 ms | 12 - 12 MB | NPU
127
- | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 145.347 ms | 12 - 2000 MB | NPU
128
- | SAM2Encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 204.489 ms | 12 - 15 MB | NPU
129
- | SAM2Encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 394.742 ms | 12 - 1950 MB | NPU
130
- | SAM2Encoder | QNN_DLC | float | Qualcomm® SA8295P | 303.689 ms | 0 - 1619 MB | NPU
131
- | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 115.423 ms | 12 - 1675 MB | NPU
132
- | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 95.461 ms | 12 - 1652 MB | NPU
133
- | SAM2Encoder | QNN_DLC | float | Snapdragon® X2 Elite | 98.218 ms | 12 - 12 MB | NPU
 
 
 
 
 
 
 
 
134
  | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 85.347 ms | 3 - 3 MB | NPU
135
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 58.758 ms | 3 - 2046 MB | NPU
136
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 149.579 ms | 3 - 1666 MB | NPU
137
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 83.146 ms | 3 - 6 MB | NPU
138
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 85.704 ms | 3 - 1666 MB | NPU
139
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 1678.346 ms | 3 - 1891 MB | NPU
140
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 144.778 ms | 3 - 2019 MB | NPU
141
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 149.579 ms | 3 - 1666 MB | NPU
142
- | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 95.073 ms | 3 - 1670 MB | NPU
143
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 43.012 ms | 3 - 1652 MB | NPU
144
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 113.562 ms | 3 - 1790 MB | NPU
145
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 80.046 ms | 3 - 1689 MB | NPU
146
- | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 81.915 ms | 3 - 3 MB | NPU
147
- | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 61.739 ms | 4 - 1983 MB | NPU
148
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 150.783 ms | 4 - 1741 MB | NPU
149
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 89.601 ms | 4 - 7 MB | NPU
150
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 88.434 ms | 4 - 1740 MB | NPU
151
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 2458.538 ms | 6 - 257 MB | CPU
152
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 149.431 ms | 4 - 2044 MB | NPU
153
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 150.783 ms | 4 - 1741 MB | NPU
154
- | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 101.316 ms | 4 - 1758 MB | NPU
155
- | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 56.9 ms | 2 - 1783 MB | NPU
156
- | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1278.97 ms | 50 - 317 MB | CPU
157
- | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 39.288 ms | 4 - 1861 MB | NPU
 
 
 
 
 
 
158
 
159
  ## License
160
  * The license for the original implementation of Segment-Anything-Model-2 can be found
 
15
  SAM 2, the successor to Meta's Segment Anything Model (SAM), is a cutting-edge tool designed for comprehensive object segmentation in both images and videos. It excels in handling complex visual data through a unified, promptable model architecture that supports real-time processing and zero-shot generalization.
16
 
17
  This is based on the implementation of Segment-Anything-Model-2 found [here](https://github.com/facebookresearch/sam2).
18
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/sam2) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
19
 
20
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
21
 
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-onnx-float.zip)
32
+ | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-onnx-w8a8.zip)
33
+ | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-qnn_dlc-float.zip)
34
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-qnn_dlc-w8a8.zip)
35
+ | TFLITE | w8a8 | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/sam2/releases/v0.48.0/sam2-tflite-w8a8.zip)
36
 
37
  For more device-specific assets and performance metrics, visit **[Segment-Anything-Model-2 on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/sam2)**.
38
 
39
 
40
  ### Option 2: Export with Custom Configurations
41
 
42
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/sam2) Python library to compile and export the model with your own:
43
  - Custom weights (e.g., fine-tuned checkpoints)
44
  - Custom input shapes
45
  - Target device and runtime configurations
46
 
47
  This option is ideal if you need to customize the model beyond the default configuration provided here.
48
 
49
+ See our repository for [Segment-Anything-Model-2 on GitHub](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/sam2) for usage instructions.
50
 
51
  ## Model Details
52
 
 
63
  ## Performance Summary
64
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
65
  |---|---|---|---|---|---|---
66
+ | SAM2Decoder | ONNX | float | Snapdragon® X2 Elite | 3.276 ms | 15 - 15 MB | NPU
67
+ | SAM2Decoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 4.71 ms | 16 - 333 MB | NPU
68
+ | SAM2Decoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 6.772 ms | 16 - 25 MB | NPU
69
+ | SAM2Decoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.472 ms | 1 - 232 MB | NPU
70
+ | SAM2Decoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.146 ms | 17 - 242 MB | NPU
71
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® X2 Elite | 5.431 ms | 4 - 4 MB | NPU
72
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® X Elite | 12.473 ms | 4 - 4 MB | NPU
73
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.18 ms | 4 - 268 MB | NPU
74
+ | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCS6490 | 130.615 ms | 51 - 60 MB | CPU
75
+ | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 11.935 ms | 2 - 9 MB | NPU
76
+ | SAM2Decoder | ONNX | w8a8 | Qualcomm® QCM6690 | 58.195 ms | 48 - 69 MB | CPU
77
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.758 ms | 2 - 240 MB | NPU
78
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 50.849 ms | 50 - 67 MB | CPU
79
+ | SAM2Decoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.289 ms | 4 - 264 MB | NPU
80
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® X2 Elite | 3.049 ms | 16 - 16 MB | NPU
81
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® X Elite | 5.448 ms | 16 - 16 MB | NPU
82
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 3.652 ms | 3 - 232 MB | NPU
83
+ | SAM2Decoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5.241 ms | 16 - 55 MB | NPU
84
+ | SAM2Decoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.865 ms | 4 - 225 MB | NPU
85
+ | SAM2Decoder | QNN_DLC | float | Qualcomm® SA8295P | 7.997 ms | 0 - 214 MB | NPU
86
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.913 ms | 4 - 213 MB | NPU
87
+ | SAM2Decoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.525 ms | 4 - 201 MB | NPU
88
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 1.287 ms | 4 - 4 MB | NPU
89
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 2.226 ms | 4 - 4 MB | NPU
90
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 1.294 ms | 0 - 102 MB | NPU
91
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 3.868 ms | 4 - 82 MB | NPU
92
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 1.916 ms | 4 - 6 MB | NPU
93
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 2.543 ms | 4 - 84 MB | NPU
94
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 9.886 ms | 4 - 265 MB | NPU
95
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 2.703 ms | 0 - 102 MB | NPU
96
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 3.868 ms | 4 - 82 MB | NPU
97
+ | SAM2Decoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 2.961 ms | 4 - 81 MB | NPU
98
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 1.03 ms | 1 - 83 MB | NPU
99
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 2.605 ms | 4 - 209 MB | NPU
100
+ | SAM2Decoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 0.902 ms | 1 - 106 MB | NPU
101
+ | SAM2Decoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 3.754 ms | 0 - 239 MB | NPU
102
+ | SAM2Decoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 12.854 ms | 0 - 210 MB | NPU
103
+ | SAM2Decoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.319 ms | 0 - 7 MB | NPU
104
+ | SAM2Decoder | TFLITE | float | Qualcomm® SA8775P | 6.761 ms | 0 - 210 MB | NPU
105
+ | SAM2Decoder | TFLITE | float | Qualcomm® SA7255P | 12.854 ms | 0 - 210 MB | NPU
106
+ | SAM2Decoder | TFLITE | float | Qualcomm® SA8295P | 7.998 ms | 0 - 221 MB | NPU
107
+ | SAM2Decoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.526 ms | 0 - 206 MB | NPU
108
+ | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 9.253 ms | 0 - 260 MB | NPU
109
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 20.902 ms | 0 - 210 MB | NPU
110
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 12.179 ms | 0 - 22 MB | NPU
111
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA8775P | 13.809 ms | 0 - 213 MB | NPU
112
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 46.634 ms | 14 - 208 MB | NPU
113
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 15.662 ms | 0 - 241 MB | NPU
114
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA7255P | 20.902 ms | 0 - 210 MB | NPU
115
+ | SAM2Decoder | TFLITE | w8a8 | Qualcomm® SA8295P | 14.232 ms | 0 - 222 MB | NPU
116
+ | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 6.926 ms | 0 - 226 MB | NPU
117
+ | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 15.913 ms | 8 - 204 MB | NPU
118
+ | SAM2Decoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 5.416 ms | 0 - 239 MB | NPU
119
+ | SAM2Encoder | ONNX | float | Snapdragon® X2 Elite | 99.568 ms | 71 - 71 MB | NPU
120
+ | SAM2Encoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 145.472 ms | 45 - 3853 MB | NPU
121
+ | SAM2Encoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 196.682 ms | 0 - 88 MB | NPU
122
+ | SAM2Encoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 111.964 ms | 33 - 1668 MB | NPU
123
+ | SAM2Encoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 92.277 ms | 44 - 2275 MB | NPU
124
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® X2 Elite | 42.391 ms | 51 - 51 MB | NPU
125
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® X Elite | 89.486 ms | 47 - 47 MB | NPU
126
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 60.75 ms | 11 - 1996 MB | NPU
127
+ | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCS6490 | 2191.807 ms | 766 - 790 MB | CPU
128
+ | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 88.469 ms | 0 - 59 MB | NPU
129
+ | SAM2Encoder | ONNX | w8a8 | Qualcomm® QCM6690 | 1332.829 ms | 659 - 673 MB | CPU
130
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 59.235 ms | 9 - 1792 MB | NPU
131
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1257.884 ms | 648 - 663 MB | CPU
132
+ | SAM2Encoder | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 39.538 ms | 12 - 1882 MB | NPU
133
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® X2 Elite | 96.624 ms | 12 - 12 MB | NPU
134
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® X Elite | 201.908 ms | 12 - 12 MB | NPU
135
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 146.731 ms | 12 - 2001 MB | NPU
136
+ | SAM2Encoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 204.181 ms | 12 - 25 MB | NPU
137
+ | SAM2Encoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 397.56 ms | 13 - 1952 MB | NPU
138
+ | SAM2Encoder | QNN_DLC | float | Qualcomm® SA8295P | 303.317 ms | 0 - 1619 MB | NPU
139
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 113.902 ms | 12 - 1673 MB | NPU
140
+ | SAM2Encoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 89.4 ms | 6 - 1645 MB | NPU
141
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 81.192 ms | 3 - 3 MB | NPU
142
  | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® X Elite | 85.347 ms | 3 - 3 MB | NPU
143
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 57.192 ms | 3 - 2046 MB | NPU
144
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 149.071 ms | 3 - 1666 MB | NPU
145
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 82.989 ms | 3 - 7 MB | NPU
146
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA8775P | 85.343 ms | 3 - 1666 MB | NPU
147
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCM6690 | 1626.356 ms | 3 - 1891 MB | NPU
148
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 141.404 ms | 3 - 2022 MB | NPU
149
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA7255P | 149.071 ms | 3 - 1666 MB | NPU
150
+ | SAM2Encoder | QNN_DLC | w8a8 | Qualcomm® SA8295P | 95.021 ms | 3 - 1670 MB | NPU
151
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 42.151 ms | 3 - 1652 MB | NPU
152
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 110.451 ms | 3 - 1790 MB | NPU
153
+ | SAM2Encoder | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 83.639 ms | 3 - 1690 MB | NPU
154
+ | SAM2Encoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 146.865 ms | 15 - 2040 MB | NPU
155
+ | SAM2Encoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 457.938 ms | 16 - 1692 MB | NPU
156
+ | SAM2Encoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 203.986 ms | 0 - 4 MB | NPU
157
+ | SAM2Encoder | TFLITE | float | Qualcomm® SA8775P | 910.158 ms | 5 - 1681 MB | NPU
158
+ | SAM2Encoder | TFLITE | float | Qualcomm® SA7255P | 457.938 ms | 16 - 1692 MB | NPU
159
+ | SAM2Encoder | TFLITE | float | Qualcomm® SA8295P | 295.729 ms | 16 - 1660 MB | NPU
160
+ | SAM2Encoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 95.65 ms | 16 - 2353 MB | NPU
161
+ | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 61.048 ms | 14 - 1996 MB | NPU
162
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 150.292 ms | 4 - 1740 MB | NPU
163
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 88.305 ms | 4 - 8 MB | NPU
164
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA8775P | 88.47 ms | 4 - 1739 MB | NPU
165
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCM6690 | 2324.338 ms | 1 - 253 MB | CPU
166
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 149.64 ms | 4 - 2047 MB | NPU
167
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA7255P | 150.292 ms | 4 - 1740 MB | NPU
168
+ | SAM2Encoder | TFLITE | w8a8 | Qualcomm® SA8295P | 101.399 ms | 4 - 1759 MB | NPU
169
+ | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 58.304 ms | 4 - 1784 MB | NPU
170
+ | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 1270.122 ms | 64 - 316 MB | CPU
171
+ | SAM2Encoder | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 39.36 ms | 4 - 1862 MB | NPU
172
 
173
  ## License
174
  * The license for the original implementation of Segment-Anything-Model-2 can be found