Hugging Face's logo

qualcomm
/
MobileSam

Image Segmentation
PyTorch
foundation
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
94c0c53
·
verified ·
1 Parent(s): a97c3d0

v0.47.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.47.0 for changelog.

Files changed (1) hide show
  1. README.md +55 -49
README.md CHANGED
@@ -28,9 +28,9 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | ONNX | float | Universal | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.46.0/mobilesam-onnx-float.zip)
32
- | QNN_DLC | float | Universal | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.46.0/mobilesam-qnn_dlc-float.zip)
33
- | TFLITE | float | Universal | QAIRT 2.42, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.46.0/mobilesam-tflite-float.zip)
34
 
35
  For more device-specific assets and performance metrics, visit **[MobileSam on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/mobilesam)**.
36
 
@@ -61,52 +61,58 @@ See our repository for [MobileSam on GitHub](https://github.com/quic/ai-hub-mode
61
  ## Performance Summary
62
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
63
  |---|---|---|---|---|---|---
64
- | MobileSAMDecoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.734 ms | 5 - 218 MB | NPU
65
- | MobileSAMDecoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 8.389 ms | 4 - 230 MB | NPU
66
- | MobileSAMDecoder | ONNX | float | Qualcomm® QCS9075 | 10.04 ms | 4 - 7 MB | NPU
67
- | MobileSAMDecoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 4.263 ms | 2 - 180 MB | NPU
68
- | MobileSAMDecoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.481 ms | 0 - 186 MB | NPU
69
- | MobileSAMDecoder | QNN_DLC | float | Snapdragon® X Elite | 5.137 ms | 4 - 4 MB | NPU
70
- | MobileSAMDecoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 3.319 ms | 4 - 230 MB | NPU
71
- | MobileSAMDecoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 11.595 ms | 2 - 199 MB | NPU
72
- | MobileSAMDecoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 4.692 ms | 4 - 6 MB | NPU
73
- | MobileSAMDecoder | QNN_DLC | float | Qualcomm® SA8775P | 5.737 ms | 1 - 200 MB | NPU
74
- | MobileSAMDecoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.499 ms | 0 - 222 MB | NPU
75
- | MobileSAMDecoder | QNN_DLC | float | Qualcomm® SA7255P | 11.595 ms | 2 - 199 MB | NPU
76
- | MobileSAMDecoder | QNN_DLC | float | Qualcomm® SA8295P | 7.157 ms | 0 - 193 MB | NPU
77
- | MobileSAMDecoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.538 ms | 0 - 198 MB | NPU
78
- | MobileSAMDecoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.182 ms | 4 - 203 MB | NPU
79
- | MobileSAMDecoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 3.854 ms | 0 - 237 MB | NPU
80
- | MobileSAMDecoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 12.771 ms | 0 - 208 MB | NPU
81
- | MobileSAMDecoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.561 ms | 0 - 18 MB | NPU
82
- | MobileSAMDecoder | TFLITE | float | Qualcomm® SA8775P | 6.547 ms | 0 - 209 MB | NPU
83
- | MobileSAMDecoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 9.544 ms | 0 - 225 MB | NPU
84
- | MobileSAMDecoder | TFLITE | float | Qualcomm® SA7255P | 12.771 ms | 0 - 208 MB | NPU
85
- | MobileSAMDecoder | TFLITE | float | Qualcomm® SA8295P | 8.152 ms | 0 - 205 MB | NPU
86
- | MobileSAMDecoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.935 ms | 0 - 209 MB | NPU
87
- | MobileSAMEncoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 254.846 ms | 128 - 866 MB | NPU
88
- | MobileSAMEncoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 341.905 ms | 114 - 116 MB | NPU
89
- | MobileSAMEncoder | ONNX | float | Qualcomm® QCS9075 | 414.464 ms | 68 - 71 MB | NPU
90
- | MobileSAMEncoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 185.472 ms | 117 - 762 MB | NPU
91
- | MobileSAMEncoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 152.087 ms | 130 - 692 MB | NPU
92
- | MobileSAMEncoder | QNN_DLC | float | Snapdragon® X Elite | 99.194 ms | 12 - 12 MB | NPU
93
- | MobileSAMEncoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 65.564 ms | 11 - 1629 MB | NPU
94
- | MobileSAMEncoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 209.778 ms | 0 - 1209 MB | NPU
95
- | MobileSAMEncoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 96.271 ms | 12 - 16 MB | NPU
96
- | MobileSAMEncoder | QNN_DLC | float | Qualcomm® SA8775P | 102.588 ms | 0 - 1614 MB | NPU
97
- | MobileSAMEncoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 467.917 ms | 12 - 1732 MB | NPU
98
- | MobileSAMEncoder | QNN_DLC | float | Qualcomm® SA7255P | 209.778 ms | 0 - 1209 MB | NPU
99
- | MobileSAMEncoder | QNN_DLC | float | Qualcomm® SA8295P | 474.029 ms | 0 - 1248 MB | NPU
100
- | MobileSAMEncoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 49.974 ms | 12 - 1214 MB | NPU
101
- | MobileSAMEncoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 44.853 ms | 11 - 1322 MB | NPU
102
- | MobileSAMEncoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 127.122 ms | 4 - 1521 MB | NPU
103
- | MobileSAMEncoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 292.444 ms | 4 - 1275 MB | NPU
104
- | MobileSAMEncoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 176.108 ms | 0 - 3 MB | NPU
105
- | MobileSAMEncoder | TFLITE | float | Qualcomm® SA8775P | 180.445 ms | 4 - 1275 MB | NPU
106
- | MobileSAMEncoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 588.02 ms | 0 - 3179 MB | NPU
107
- | MobileSAMEncoder | TFLITE | float | Qualcomm® SA7255P | 292.444 ms | 4 - 1275 MB | NPU
108
- | MobileSAMEncoder | TFLITE | float | Qualcomm® SA8295P | 504.031 ms | 4 - 1899 MB | NPU
109
- | MobileSAMEncoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 96.546 ms | 3 - 1271 MB | NPU
 
 
 
 
 
 
110
 
111
  ## License
112
  * The license for the original implementation of MobileSam can be found
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.47.0/mobilesam-onnx-float.zip)
32
+ | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.47.0/mobilesam-qnn_dlc-float.zip)
33
+ | TFLITE | float | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mobilesam/releases/v0.47.0/mobilesam-tflite-float.zip)
34
 
35
  For more device-specific assets and performance metrics, visit **[MobileSam on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/mobilesam)**.
36
 
 
61
  ## Performance Summary
62
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
63
  |---|---|---|---|---|---|---
64
+ | MobileSAMDecoder | ONNX | float | Snapdragon® X Elite | 7.515 ms | 11 - 11 MB | NPU
65
+ | MobileSAMDecoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 4.916 ms | 5 - 263 MB | NPU
66
+ | MobileSAMDecoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 7.013 ms | 0 - 15 MB | NPU
67
+ | MobileSAMDecoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.65 ms | 4 - 226 MB | NPU
68
+ | MobileSAMDecoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.89 ms | 0 - 232 MB | NPU
69
+ | MobileSAMDecoder | ONNX | float | Snapdragon® X2 Elite | 2.951 ms | 11 - 11 MB | NPU
70
+ | MobileSAMDecoder | QNN_DLC | float | Snapdragon® X Elite | 5.286 ms | 4 - 4 MB | NPU
71
+ | MobileSAMDecoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 3.36 ms | 4 - 232 MB | NPU
72
+ | MobileSAMDecoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 11.687 ms | 1 - 198 MB | NPU
73
+ | MobileSAMDecoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 4.86 ms | 4 - 36 MB | NPU
74
+ | MobileSAMDecoder | QNN_DLC | float | Qualcomm® SA8775P | 5.887 ms | 0 - 200 MB | NPU
75
+ | MobileSAMDecoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 8.484 ms | 0 - 220 MB | NPU
76
+ | MobileSAMDecoder | QNN_DLC | float | Qualcomm® SA7255P | 11.687 ms | 1 - 198 MB | NPU
77
+ | MobileSAMDecoder | QNN_DLC | float | Qualcomm® SA8295P | 7.197 ms | 0 - 193 MB | NPU
78
+ | MobileSAMDecoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.595 ms | 0 - 198 MB | NPU
79
+ | MobileSAMDecoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.154 ms | 3 - 202 MB | NPU
80
+ | MobileSAMDecoder | QNN_DLC | float | Snapdragon® X2 Elite | 2.662 ms | 4 - 4 MB | NPU
81
+ | MobileSAMDecoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 3.875 ms | 0 - 235 MB | NPU
82
+ | MobileSAMDecoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 13.024 ms | 0 - 203 MB | NPU
83
+ | MobileSAMDecoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.6 ms | 0 - 26 MB | NPU
84
+ | MobileSAMDecoder | TFLITE | float | Qualcomm® SA8775P | 6.7 ms | 0 - 204 MB | NPU
85
+ | MobileSAMDecoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 9.491 ms | 0 - 225 MB | NPU
86
+ | MobileSAMDecoder | TFLITE | float | Qualcomm® SA7255P | 13.024 ms | 0 - 203 MB | NPU
87
+ | MobileSAMDecoder | TFLITE | float | Qualcomm® SA8295P | 8.115 ms | 0 - 201 MB | NPU
88
+ | MobileSAMDecoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.955 ms | 0 - 205 MB | NPU
89
+ | MobileSAMDecoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.353 ms | 0 - 206 MB | NPU
90
+ | MobileSAMEncoder | ONNX | float | Snapdragon® X Elite | 172.158 ms | 12 - 12 MB | NPU
91
+ | MobileSAMEncoder | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 125.387 ms | 20 - 3042 MB | NPU
92
+ | MobileSAMEncoder | ONNX | float | Qualcomm® QCS8550 (Proxy) | 175.157 ms | 12 - 31 MB | NPU
93
+ | MobileSAMEncoder | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 102.261 ms | 9 - 1390 MB | NPU
94
+ | MobileSAMEncoder | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 83.472 ms | 20 - 1524 MB | NPU
95
+ | MobileSAMEncoder | ONNX | float | Snapdragon® X2 Elite | 94.261 ms | 14 - 14 MB | NPU
96
+ | MobileSAMEncoder | QNN_DLC | float | Snapdragon® X Elite | 100.191 ms | 12 - 12 MB | NPU
97
+ | MobileSAMEncoder | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 66.146 ms | 12 - 1636 MB | NPU
98
+ | MobileSAMEncoder | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 209.193 ms | 0 - 1209 MB | NPU
99
+ | MobileSAMEncoder | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 96.518 ms | 13 - 15 MB | NPU
100
+ | MobileSAMEncoder | QNN_DLC | float | Qualcomm® SA8775P | 103.049 ms | 0 - 1209 MB | NPU
101
+ | MobileSAMEncoder | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 470.295 ms | 13 - 1732 MB | NPU
102
+ | MobileSAMEncoder | QNN_DLC | float | Qualcomm® SA7255P | 209.193 ms | 0 - 1209 MB | NPU
103
+ | MobileSAMEncoder | QNN_DLC | float | Qualcomm® SA8295P | 474.267 ms | 0 - 1248 MB | NPU
104
+ | MobileSAMEncoder | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 49.845 ms | 12 - 1217 MB | NPU
105
+ | MobileSAMEncoder | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 48.339 ms | 10 - 1323 MB | NPU
106
+ | MobileSAMEncoder | QNN_DLC | float | Snapdragon® X2 Elite | 51.495 ms | 12 - 12 MB | NPU
107
+ | MobileSAMEncoder | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 127.145 ms | 2 - 1509 MB | NPU
108
+ | MobileSAMEncoder | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 295.631 ms | 4 - 1269 MB | NPU
109
+ | MobileSAMEncoder | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 175.109 ms | 4 - 8 MB | NPU
110
+ | MobileSAMEncoder | TFLITE | float | Qualcomm® SA8775P | 180.289 ms | 4 - 1269 MB | NPU
111
+ | MobileSAMEncoder | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 584.211 ms | 0 - 3174 MB | NPU
112
+ | MobileSAMEncoder | TFLITE | float | Qualcomm® SA7255P | 295.631 ms | 4 - 1269 MB | NPU
113
+ | MobileSAMEncoder | TFLITE | float | Qualcomm® SA8295P | 502.945 ms | 4 - 1893 MB | NPU
114
+ | MobileSAMEncoder | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 95.905 ms | 3 - 1261 MB | NPU
115
+ | MobileSAMEncoder | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 78.087 ms | 4 - 1349 MB | NPU
116
 
117
  ## License
118
  * The license for the original implementation of MobileSam can be found