Hugging Face's logo

qualcomm
/
MobileSam

Image Segmentation
PyTorch
LiteRT
foundation
android
Model card Files
xet
Community
qaihm-bot commited on
Commit
4e0112a
·
verified ·
1 Parent(s): e838068

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +74 -74
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  library_name: pytorch
3
- license: apache-2.0
4
  tags:
5
  - foundation
6
  - android
@@ -11,7 +11,7 @@ pipeline_tag: image-segmentation
11
  ![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/web-assets/model_demo.png)
12
 
13
  # MobileSam: Optimized for Mobile Deployment
14
- ## FASTER SEGMENT ANYTHING: TOWARDS LIGHTWEIGHT SAM FOR MOBILE APPLICATIONS
15
 
16
 
17
  Transformer based encoder-decoder where prompts specify what to segment in an image thereby allowing segmentation without the need for additional training. The image encoder generates embeddings and the lightweight decoder operates on the embeddings for point and mask based image segmentation.
@@ -26,73 +26,73 @@ More details on model performance across various devices, can be found
26
 
27
  ### Model Details
28
 
29
- - **Model Type:** Semantic segmentation
30
  - **Model Stats:**
31
  - Model checkpoint: vit_t
32
  - Input resolution: 720p (720x1280)
33
  - Number of parameters (MobileSamDecoder): 3.876M
34
  - Model size (MobileSamDecoder): 19.6 MB
35
 
36
- | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
- | SAMEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 439.913 ms | 34 - 60 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
39
- | SAMEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 334.816 ms | 12 - 89 MB | FP16 | NPU | [MobileSam.so](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.so) |
40
- | SAMEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 417.54 ms | 65 - 122 MB | FP16 | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.onnx) |
41
- | SAMEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 335.191 ms | 33 - 158 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
42
- | SAMEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 247.716 ms | 191 - 694 MB | FP16 | NPU | [MobileSam.so](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.so) |
43
- | SAMEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 313.436 ms | 95 - 218 MB | FP16 | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.onnx) |
44
- | SAMEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 237.753 ms | 33 - 166 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
45
- | SAMEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 235.822 ms | 12 - 519 MB | FP16 | NPU | Use Export Script |
46
- | SAMEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 271.979 ms | 78 - 213 MB | FP16 | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.onnx) |
47
- | SAMEncoder | SA7255P ADP | SA7255P | TFLITE | 1302.15 ms | 33 - 166 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
48
- | SAMEncoder | SA7255P ADP | SA7255P | QNN | 991.612 ms | 12 - 21 MB | FP16 | NPU | Use Export Script |
49
- | SAMEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 415.155 ms | 33 - 59 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
50
- | SAMEncoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 266.684 ms | 12 - 15 MB | FP16 | NPU | Use Export Script |
51
- | SAMEncoder | SA8295P ADP | SA8295P | TFLITE | 585.405 ms | 33 - 168 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
52
- | SAMEncoder | SA8295P ADP | SA8295P | QNN | 424.958 ms | 0 - 18 MB | FP16 | NPU | Use Export Script |
53
- | SAMEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 432.024 ms | 33 - 58 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
54
- | SAMEncoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 268.519 ms | 12 - 15 MB | FP16 | NPU | Use Export Script |
55
- | SAMEncoder | SA8775P ADP | SA8775P | TFLITE | 494.361 ms | 33 - 165 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
56
- | SAMEncoder | SA8775P ADP | SA8775P | QNN | 330.266 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
57
- | SAMEncoder | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 1302.15 ms | 33 - 166 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
58
- | SAMEncoder | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 991.612 ms | 12 - 21 MB | FP16 | NPU | Use Export Script |
59
- | SAMEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 420.702 ms | 33 - 60 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
60
- | SAMEncoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 270.321 ms | 12 - 15 MB | FP16 | NPU | Use Export Script |
61
- | SAMEncoder | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 494.361 ms | 33 - 165 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
62
- | SAMEncoder | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 330.266 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
63
- | SAMEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 597.124 ms | 33 - 171 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.tflite) |
64
- | SAMEncoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 503.439 ms | 12 - 572 MB | FP16 | NPU | Use Export Script |
65
- | SAMEncoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 275.036 ms | 12 - 12 MB | FP16 | NPU | Use Export Script |
66
- | SAMEncoder | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 448.994 ms | 130 - 130 MB | FP16 | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMEncoder.onnx) |
67
- | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 7.38 ms | 0 - 29 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
68
- | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 6.435 ms | 4 - 21 MB | FP16 | NPU | [MobileSam.so](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.so) |
69
- | SAMDecoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 8.887 ms | 1 - 62 MB | FP16 | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.onnx) |
70
- | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 5.151 ms | 0 - 46 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
71
- | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 4.55 ms | 4 - 48 MB | FP16 | NPU | [MobileSam.so](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.so) |
72
- | SAMDecoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 6.067 ms | 6 - 75 MB | FP16 | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.onnx) |
73
- | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 5.041 ms | 0 - 44 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
74
- | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 4.357 ms | 4 - 42 MB | FP16 | NPU | Use Export Script |
75
- | SAMDecoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 4.566 ms | 4 - 62 MB | FP16 | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.onnx) |
76
- | SAMDecoder | SA7255P ADP | SA7255P | TFLITE | 53.054 ms | 0 - 40 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
77
- | SAMDecoder | SA7255P ADP | SA7255P | QNN | 48.542 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
78
- | SAMDecoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 7.371 ms | 0 - 26 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
79
- | SAMDecoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 6.184 ms | 4 - 6 MB | FP16 | NPU | Use Export Script |
80
- | SAMDecoder | SA8295P ADP | SA8295P | TFLITE | 9.906 ms | 0 - 36 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
81
- | SAMDecoder | SA8295P ADP | SA8295P | QNN | 7.432 ms | 0 - 17 MB | FP16 | NPU | Use Export Script |
82
- | SAMDecoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 7.351 ms | 0 - 25 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
83
- | SAMDecoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 6.18 ms | 4 - 7 MB | FP16 | NPU | Use Export Script |
84
- | SAMDecoder | SA8775P ADP | SA8775P | TFLITE | 10.347 ms | 0 - 40 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
85
- | SAMDecoder | SA8775P ADP | SA8775P | QNN | 8.85 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
86
- | SAMDecoder | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 53.054 ms | 0 - 40 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
87
- | SAMDecoder | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 48.542 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
88
- | SAMDecoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 7.346 ms | 0 - 26 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
89
- | SAMDecoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 6.298 ms | 4 - 6 MB | FP16 | NPU | Use Export Script |
90
- | SAMDecoder | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 10.347 ms | 0 - 40 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
91
- | SAMDecoder | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 8.85 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
92
- | SAMDecoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 8.763 ms | 0 - 42 MB | FP16 | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.tflite) |
93
- | SAMDecoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 8.018 ms | 4 - 42 MB | FP16 | NPU | Use Export Script |
94
- | SAMDecoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 6.736 ms | 4 - 4 MB | FP16 | NPU | Use Export Script |
95
- | SAMDecoder | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.021 ms | 12 - 12 MB | FP16 | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/SAMDecoder.onnx) |
96
 
97
 
98
 
@@ -154,21 +154,21 @@ python -m qai_hub_models.models.mobilesam.export
154
  Profiling Results
155
  ------------------------------------------------------------
156
  SAMEncoder
157
- Device : Samsung Galaxy S23 (13)
158
- Runtime : TFLITE
159
- Estimated inference time (ms) : 439.9
160
- Estimated peak memory usage (MB): [34, 60]
161
- Total # Ops : 592
162
- Compute Unit(s) : NPU (532 ops) CPU (60 ops)
163
 
164
  ------------------------------------------------------------
165
  SAMDecoder
166
- Device : Samsung Galaxy S23 (13)
167
- Runtime : TFLITE
168
- Estimated inference time (ms) : 7.4
169
- Estimated peak memory usage (MB): [0, 29]
170
- Total # Ops : 845
171
- Compute Unit(s) : NPU (845 ops)
172
  ```
173
 
174
 
 
1
  ---
2
  library_name: pytorch
3
+ license: other
4
  tags:
5
  - foundation
6
  - android
 
11
  ![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/web-assets/model_demo.png)
12
 
13
  # MobileSam: Optimized for Mobile Deployment
14
+ ## Faster Segment Anything: Towards lightweight SAM for mobile applications
15
 
16
 
17
  Transformer based encoder-decoder where prompts specify what to segment in an image thereby allowing segmentation without the need for additional training. The image encoder generates embeddings and the lightweight decoder operates on the embeddings for point and mask based image segmentation.
 
26
 
27
  ### Model Details
28
 
29
+ - **Model Type:** Model_use_case.semantic_segmentation
30
  - **Model Stats:**
31
  - Model checkpoint: vit_t
32
  - Input resolution: 720p (720x1280)
33
  - Number of parameters (MobileSamDecoder): 3.876M
34
  - Model size (MobileSamDecoder): 19.6 MB
35
 
36
+ | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
37
  |---|---|---|---|---|---|---|---|---|
38
+ | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 778.225 ms | 33 - 165 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
39
+ | SAMEncoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 501.051 ms | 4 - 14 MB | NPU | Use Export Script |
40
+ | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 657.898 ms | 33 - 175 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
41
+ | SAMEncoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 479.564 ms | 12 - 592 MB | NPU | Use Export Script |
42
+ | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 409.044 ms | 33 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
43
+ | SAMEncoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 265.351 ms | 12 - 15 MB | NPU | Use Export Script |
44
+ | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 420.56 ms | 31 - 164 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
45
+ | SAMEncoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 274.861 ms | 1 - 15 MB | NPU | Use Export Script |
46
+ | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 778.225 ms | 33 - 165 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
47
+ | SAMEncoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 501.051 ms | 4 - 14 MB | NPU | Use Export Script |
48
+ | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 433.345 ms | 33 - 58 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
49
+ | SAMEncoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 268.807 ms | 14 - 15 MB | NPU | Use Export Script |
50
+ | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 585.898 ms | 33 - 168 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
51
+ | SAMEncoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 425.029 ms | 0 - 18 MB | NPU | Use Export Script |
52
+ | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 421.955 ms | 33 - 59 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
53
+ | SAMEncoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 268.324 ms | 15 - 17 MB | NPU | Use Export Script |
54
+ | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 420.56 ms | 31 - 164 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
55
+ | SAMEncoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 274.861 ms | 1 - 15 MB | NPU | Use Export Script |
56
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 417.766 ms | 33 - 60 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
57
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 269.765 ms | 12 - 87 MB | NPU | Use Export Script |
58
+ | SAMEncoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 388.846 ms | 93 - 149 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
59
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 336.863 ms | 33 - 156 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
60
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 201.573 ms | 12 - 618 MB | NPU | Use Export Script |
61
+ | SAMEncoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 295.691 ms | 94 - 209 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
62
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 274.65 ms | 33 - 166 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
63
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 174.753 ms | 12 - 596 MB | NPU | Use Export Script |
64
+ | SAMEncoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 255.159 ms | 74 - 204 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
65
+ | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 276.054 ms | 12 - 12 MB | NPU | Use Export Script |
66
+ | SAMEncoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 431.108 ms | 131 - 131 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
67
+ | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 16.756 ms | 0 - 40 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
68
+ | SAMDecoder | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 13.95 ms | 4 - 14 MB | NPU | Use Export Script |
69
+ | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 8.824 ms | 0 - 44 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
70
+ | SAMDecoder | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 8.649 ms | 4 - 50 MB | NPU | Use Export Script |
71
+ | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 7.359 ms | 0 - 26 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
72
+ | SAMDecoder | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 6.178 ms | 4 - 7 MB | NPU | Use Export Script |
73
+ | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 8.639 ms | 0 - 41 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
74
+ | SAMDecoder | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 7.319 ms | 3 - 17 MB | NPU | Use Export Script |
75
+ | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 16.756 ms | 0 - 40 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
76
+ | SAMDecoder | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 13.95 ms | 4 - 14 MB | NPU | Use Export Script |
77
+ | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 7.358 ms | 0 - 28 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
78
+ | SAMDecoder | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 6.289 ms | 4 - 6 MB | NPU | Use Export Script |
79
+ | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 9.889 ms | 0 - 36 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
80
+ | SAMDecoder | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 7.431 ms | 0 - 18 MB | NPU | Use Export Script |
81
+ | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 7.342 ms | 0 - 28 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
82
+ | SAMDecoder | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 6.196 ms | 6 - 8 MB | NPU | Use Export Script |
83
+ | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 8.639 ms | 0 - 41 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
84
+ | SAMDecoder | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 7.319 ms | 3 - 17 MB | NPU | Use Export Script |
85
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 7.44 ms | 0 - 31 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
86
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 6.139 ms | 4 - 21 MB | NPU | Use Export Script |
87
+ | SAMDecoder | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 8.985 ms | 1 - 61 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
88
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 5.251 ms | 0 - 49 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
89
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 4.201 ms | 4 - 50 MB | NPU | Use Export Script |
90
+ | SAMDecoder | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 5.977 ms | 4 - 71 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
91
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 5.027 ms | 0 - 42 MB | NPU | [MobileSam.tflite](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.tflite) |
92
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 3.132 ms | 4 - 45 MB | NPU | Use Export Script |
93
+ | SAMDecoder | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 5.397 ms | 0 - 58 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
94
+ | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 6.674 ms | 4 - 4 MB | NPU | Use Export Script |
95
+ | SAMDecoder | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 10.051 ms | 11 - 11 MB | NPU | [MobileSam.onnx](https://huggingface.co/qualcomm/MobileSam/blob/main/MobileSam.onnx) |
96
 
97
 
98
 
 
154
  Profiling Results
155
  ------------------------------------------------------------
156
  SAMEncoder
157
+ Device : cs_8275 (ANDROID 14)
158
+ Runtime : TFLITE
159
+ Estimated inference time (ms) : 778.2
160
+ Estimated peak memory usage (MB): [33, 165]
161
+ Total # Ops : 592
162
+ Compute Unit(s) : npu (532 ops) gpu (0 ops) cpu (60 ops)
163
 
164
  ------------------------------------------------------------
165
  SAMDecoder
166
+ Device : cs_8275 (ANDROID 14)
167
+ Runtime : TFLITE
168
+ Estimated inference time (ms) : 16.8
169
+ Estimated peak memory usage (MB): [0, 40]
170
+ Total # Ops : 845
171
+ Compute Unit(s) : npu (845 ops) gpu (0 ops) cpu (0 ops)
172
  ```
173
 
174