Hugging Face's logo

qualcomm
/
Track-Anything

PyTorch
android
video-object-tracking
Model card Files
xet
 Community
qaihm-bot commited on
Commit
0563be2
·
verified ·
1 Parent(s): 0519aed

v0.50.2

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.50.2 for changelog.

Files changed (2) hide show
  1. README.md +70 -66
  2. release_assets.json +1 -1
README.md CHANGED
@@ -27,8 +27,8 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/track_anything/releases/v0.50.1/track_anything-onnx-float.zip)
31
- | TFLITE | float | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/track_anything/releases/v0.50.1/track_anything-tflite-float.zip)
32
 
33
  For more device-specific assets and performance metrics, visit **[Track-Anything on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/track_anything)**.
34
 
@@ -63,70 +63,74 @@ See our repository for [Track-Anything on GitHub](https://github.com/qualcomm/ai
63
  ## Performance Summary
64
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
65
  |---|---|---|---|---|---|---
66
- | encode_key_with_shrinkage | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.384 ms | 1 - 177 MB | NPU
67
- | encode_key_with_shrinkage | ONNX | float | Snapdragon® X2 Elite | 2.813 ms | 18 - 18 MB | NPU
68
- | encode_key_with_shrinkage | ONNX | float | Snapdragon® X Elite | 5.608 ms | 19 - 19 MB | NPU
69
- | encode_key_with_shrinkage | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 3.664 ms | 0 - 202 MB | NPU
70
- | encode_key_with_shrinkage | ONNX | float | Qualcomm® QCS8550 (Proxy) | 5.166 ms | 0 - 21 MB | NPU
71
- | encode_key_with_shrinkage | ONNX | float | Qualcomm® QCS9075 | 9.464 ms | 10 - 13 MB | NPU
72
- | encode_key_with_shrinkage | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.948 ms | 1 - 166 MB | NPU
73
- | encode_key_with_shrinkage | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.441 ms | 0 - 191 MB | NPU
74
- | encode_key_with_shrinkage | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 4.085 ms | 1 - 213 MB | NPU
75
- | encode_key_with_shrinkage | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 31.167 ms | 3 - 180 MB | NPU
76
- | encode_key_with_shrinkage | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.935 ms | 3 - 6 MB | NPU
77
- | encode_key_with_shrinkage | TFLITE | float | Qualcomm® SA8775P | 9.553 ms | 0 - 178 MB | NPU
78
- | encode_key_with_shrinkage | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 11.742 ms | 3 - 197 MB | NPU
79
- | encode_key_with_shrinkage | TFLITE | float | Qualcomm® SA7255P | 31.167 ms | 3 - 180 MB | NPU
80
- | encode_key_with_shrinkage | TFLITE | float | Qualcomm® SA8295P | 10.378 ms | 3 - 165 MB | NPU
81
- | encode_key_with_shrinkage | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.289 ms | 0 - 180 MB | NPU
82
- | encode_key_without_shrinkage | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.494 ms | 1 - 216 MB | NPU
83
- | encode_key_without_shrinkage | ONNX | float | Snapdragon® X2 Elite | 3.947 ms | 65 - 65 MB | NPU
84
- | encode_key_without_shrinkage | ONNX | float | Snapdragon® X Elite | 6.955 ms | 66 - 66 MB | NPU
85
- | encode_key_without_shrinkage | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.056 ms | 63 - 271 MB | NPU
86
- | encode_key_without_shrinkage | ONNX | float | Qualcomm® QCS8550 (Proxy) | 6.835 ms | 58 - 77 MB | NPU
87
- | encode_key_without_shrinkage | ONNX | float | Qualcomm® QCS9075 | 11.477 ms | 62 - 64 MB | NPU
88
- | encode_key_without_shrinkage | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 4.361 ms | 61 - 253 MB | NPU
89
- | encode_key_without_shrinkage | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.559 ms | 0 - 226 MB | NPU
90
- | encode_key_without_shrinkage | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 5.373 ms | 19 - 241 MB | NPU
91
- | encode_key_without_shrinkage | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 33.113 ms | 9 - 193 MB | NPU
92
- | encode_key_without_shrinkage | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 7.509 ms | 20 - 23 MB | NPU
93
- | encode_key_without_shrinkage | TFLITE | float | Qualcomm® SA8775P | 11.353 ms | 20 - 206 MB | NPU
94
- | encode_key_without_shrinkage | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 14.098 ms | 20 - 222 MB | NPU
95
- | encode_key_without_shrinkage | TFLITE | float | Qualcomm® SA7255P | 33.113 ms | 9 - 193 MB | NPU
96
- | encode_key_without_shrinkage | TFLITE | float | Qualcomm® SA8295P | 12.71 ms | 20 - 186 MB | NPU
97
- | encode_key_without_shrinkage | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 4.413 ms | 18 - 209 MB | NPU
98
- | encode_value | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 6.596 ms | 0 - 166 MB | NPU
99
- | encode_value | ONNX | float | Snapdragon® X2 Elite | 6.023 ms | 39 - 39 MB | NPU
100
- | encode_value | ONNX | float | Snapdragon® X Elite | 12.457 ms | 38 - 38 MB | NPU
101
- | encode_value | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 9.879 ms | 12 - 220 MB | NPU
102
- | encode_value | ONNX | float | Qualcomm® QCS8550 (Proxy) | 15.632 ms | 0 - 45 MB | NPU
103
- | encode_value | ONNX | float | Qualcomm® QCS9075 | 18.755 ms | 6 - 14 MB | NPU
104
- | encode_value | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 8.398 ms | 7 - 175 MB | NPU
105
- | encode_value | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 6.27 ms | 1 - 209 MB | NPU
106
- | encode_value | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 8.318 ms | 3 - 293 MB | NPU
107
- | encode_value | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 51.385 ms | 3 - 225 MB | NPU
108
- | encode_value | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 11.877 ms | 3 - 6 MB | NPU
109
- | encode_value | TFLITE | float | Qualcomm® SA8775P | 17.446 ms | 3 - 220 MB | NPU
110
- | encode_value | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 22.471 ms | 3 - 286 MB | NPU
111
- | encode_value | TFLITE | float | Qualcomm® SA7255P | 51.385 ms | 3 - 225 MB | NPU
112
- | encode_value | TFLITE | float | Qualcomm® SA8295P | 19.759 ms | 3 - 233 MB | NPU
113
- | encode_value | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 7.187 ms | 2 - 203 MB | NPU
114
- | segment | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 10.468 ms | 8 - 221 MB | NPU
115
- | segment | ONNX | float | Snapdragon® X2 Elite | 11.788 ms | 38 - 38 MB | NPU
116
- | segment | ONNX | float | Snapdragon® X Elite | 23.51 ms | 37 - 37 MB | NPU
117
- | segment | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 17.508 ms | 0 - 241 MB | NPU
118
- | segment | ONNX | float | Qualcomm® QCS8550 (Proxy) | 23.222 ms | 0 - 45 MB | NPU
119
- | segment | ONNX | float | Qualcomm® QCS9075 | 39.325 ms | 21 - 45 MB | NPU
120
- | segment | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 13.838 ms | 5 - 221 MB | NPU
121
- | segment | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 10.8 ms | 0 - 227 MB | NPU
122
- | segment | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 17.715 ms | 0 - 288 MB | NPU
123
- | segment | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 103.692 ms | 2 - 197 MB | NPU
124
- | segment | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 23.394 ms | 2 - 4 MB | NPU
125
- | segment | TFLITE | float | Qualcomm® SA8775P | 33.678 ms | 2 - 202 MB | NPU
126
- | segment | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 54.382 ms | 2 - 286 MB | NPU
127
- | segment | TFLITE | float | Qualcomm® SA7255P | 103.692 ms | 2 - 197 MB | NPU
128
- | segment | TFLITE | float | Qualcomm® SA8295P | 38.758 ms | 2 - 210 MB | NPU
129
- | segment | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 13.3 ms | 1 - 206 MB | NPU
 
 
 
 
130
 
131
  ## License
132
  * The license for the original implementation of Track-Anything can be found
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/track_anything/releases/v0.50.2/track_anything-onnx-float.zip)
31
+ | TFLITE | float | Universal | QAIRT 2.43, TFLite 2.19.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/track_anything/releases/v0.50.2/track_anything-tflite-float.zip)
32
 
33
  For more device-specific assets and performance metrics, visit **[Track-Anything on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/track_anything)**.
34
 
 
63
  ## Performance Summary
64
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
65
  |---|---|---|---|---|---|---
66
+ | encode_key_with_shrinkage | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.38 ms | 0 - 176 MB | NPU
67
+ | encode_key_with_shrinkage | ONNX | float | Snapdragon® X2 Elite | 2.821 ms | 18 - 18 MB | NPU
68
+ | encode_key_with_shrinkage | ONNX | float | Snapdragon® X Elite | 5.593 ms | 19 - 19 MB | NPU
69
+ | encode_key_with_shrinkage | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 3.673 ms | 0 - 202 MB | NPU
70
+ | encode_key_with_shrinkage | ONNX | float | Qualcomm® QCS8550 (Proxy) | 5.163 ms | 0 - 22 MB | NPU
71
+ | encode_key_with_shrinkage | ONNX | float | Qualcomm® QCS9075 | 9.48 ms | 10 - 13 MB | NPU
72
+ | encode_key_with_shrinkage | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 2.95 ms | 0 - 165 MB | NPU
73
+ | encode_key_with_shrinkage | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 2.441 ms | 0 - 190 MB | NPU
74
+ | encode_key_with_shrinkage | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 4.078 ms | 3 - 216 MB | NPU
75
+ | encode_key_with_shrinkage | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 31.185 ms | 3 - 181 MB | NPU
76
+ | encode_key_with_shrinkage | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5.934 ms | 0 - 152 MB | NPU
77
+ | encode_key_with_shrinkage | TFLITE | float | Qualcomm® SA8775P | 9.551 ms | 3 - 182 MB | NPU
78
+ | encode_key_with_shrinkage | TFLITE | float | Qualcomm® QCS9075 | 11.381 ms | 2 - 29 MB | NPU
79
+ | encode_key_with_shrinkage | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 11.725 ms | 3 - 200 MB | NPU
80
+ | encode_key_with_shrinkage | TFLITE | float | Qualcomm® SA7255P | 31.185 ms | 3 - 181 MB | NPU
81
+ | encode_key_with_shrinkage | TFLITE | float | Qualcomm® SA8295P | 10.381 ms | 3 - 165 MB | NPU
82
+ | encode_key_with_shrinkage | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 3.281 ms | 0 - 180 MB | NPU
83
+ | encode_key_without_shrinkage | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.494 ms | 0 - 216 MB | NPU
84
+ | encode_key_without_shrinkage | ONNX | float | Snapdragon® X2 Elite | 3.944 ms | 64 - 64 MB | NPU
85
+ | encode_key_without_shrinkage | ONNX | float | Snapdragon® X Elite | 6.919 ms | 66 - 66 MB | NPU
86
+ | encode_key_without_shrinkage | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 5.031 ms | 61 - 272 MB | NPU
87
+ | encode_key_without_shrinkage | ONNX | float | Qualcomm® QCS8550 (Proxy) | 6.785 ms | 25 - 60 MB | NPU
88
+ | encode_key_without_shrinkage | ONNX | float | Qualcomm® QCS9075 | 11.513 ms | 62 - 65 MB | NPU
89
+ | encode_key_without_shrinkage | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 4.365 ms | 62 - 254 MB | NPU
90
+ | encode_key_without_shrinkage | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 3.567 ms | 0 - 227 MB | NPU
91
+ | encode_key_without_shrinkage | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 5.315 ms | 18 - 242 MB | NPU
92
+ | encode_key_without_shrinkage | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 33.109 ms | 20 - 205 MB | NPU
93
+ | encode_key_without_shrinkage | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 7.54 ms | 8 - 16 MB | NPU
94
+ | encode_key_without_shrinkage | TFLITE | float | Qualcomm® SA8775P | 11.419 ms | 0 - 186 MB | NPU
95
+ | encode_key_without_shrinkage | TFLITE | float | Qualcomm® QCS9075 | 12.925 ms | 20 - 63 MB | NPU
96
+ | encode_key_without_shrinkage | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 14.096 ms | 20 - 223 MB | NPU
97
+ | encode_key_without_shrinkage | TFLITE | float | Qualcomm® SA7255P | 33.109 ms | 20 - 205 MB | NPU
98
+ | encode_key_without_shrinkage | TFLITE | float | Qualcomm® SA8295P | 12.764 ms | 20 - 186 MB | NPU
99
+ | encode_key_without_shrinkage | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 4.39 ms | 18 - 205 MB | NPU
100
+ | encode_value | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 6.611 ms | 13 - 179 MB | NPU
101
+ | encode_value | ONNX | float | Snapdragon® X2 Elite | 6.029 ms | 39 - 39 MB | NPU
102
+ | encode_value | ONNX | float | Snapdragon® X Elite | 12.469 ms | 38 - 38 MB | NPU
103
+ | encode_value | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 9.887 ms | 14 - 222 MB | NPU
104
+ | encode_value | ONNX | float | Qualcomm® QCS8550 (Proxy) | 15.782 ms | 0 - 45 MB | NPU
105
+ | encode_value | ONNX | float | Qualcomm® QCS9075 | 18.37 ms | 6 - 14 MB | NPU
106
+ | encode_value | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 8.416 ms | 7 - 176 MB | NPU
107
+ | encode_value | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 6.288 ms | 0 - 206 MB | NPU
108
+ | encode_value | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 8.258 ms | 3 - 285 MB | NPU
109
+ | encode_value | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 51.415 ms | 3 - 218 MB | NPU
110
+ | encode_value | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 11.784 ms | 3 - 5 MB | NPU
111
+ | encode_value | TFLITE | float | Qualcomm® SA8775P | 16.955 ms | 3 - 223 MB | NPU
112
+ | encode_value | TFLITE | float | Qualcomm® QCS9075 | 18.88 ms | 0 - 54 MB | NPU
113
+ | encode_value | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 22.685 ms | 3 - 282 MB | NPU
114
+ | encode_value | TFLITE | float | Qualcomm® SA7255P | 51.415 ms | 3 - 218 MB | NPU
115
+ | encode_value | TFLITE | float | Qualcomm® SA8295P | 19.58 ms | 0 - 219 MB | NPU
116
+ | encode_value | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 7.166 ms | 3 - 203 MB | NPU
117
+ | segment | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 10.467 ms | 25 - 244 MB | NPU
118
+ | segment | ONNX | float | Snapdragon® X2 Elite | 11.785 ms | 38 - 38 MB | NPU
119
+ | segment | ONNX | float | Snapdragon® X Elite | 23.511 ms | 37 - 37 MB | NPU
120
+ | segment | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 17.397 ms | 25 - 268 MB | NPU
121
+ | segment | ONNX | float | Qualcomm® QCS8550 (Proxy) | 23.232 ms | 0 - 45 MB | NPU
122
+ | segment | ONNX | float | Qualcomm® QCS9075 | 39.003 ms | 21 - 45 MB | NPU
123
+ | segment | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 13.581 ms | 5 - 216 MB | NPU
124
+ | segment | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 10.8 ms | 2 - 226 MB | NPU
125
+ | segment | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 17.419 ms | 0 - 285 MB | NPU
126
+ | segment | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 104.113 ms | 0 - 196 MB | NPU
127
+ | segment | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 23.293 ms | 2 - 4 MB | NPU
128
+ | segment | TFLITE | float | Qualcomm® SA8775P | 33.621 ms | 2 - 195 MB | NPU
129
+ | segment | TFLITE | float | Qualcomm® QCS9075 | 38.161 ms | 0 - 83 MB | NPU
130
+ | segment | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 53.173 ms | 2 - 280 MB | NPU
131
+ | segment | TFLITE | float | Qualcomm® SA7255P | 104.113 ms | 0 - 196 MB | NPU
132
+ | segment | TFLITE | float | Qualcomm® SA8295P | 38.918 ms | 2 - 204 MB | NPU
133
+ | segment | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 13.174 ms | 0 - 208 MB | NPU
134
 
135
  ## License
136
  * The license for the original implementation of Track-Anything can be found
release_assets.json CHANGED
@@ -1 +1 @@
1
- {"version":"0.50.1","precisions":{"float":{"universal_assets":{"tflite":{"tool_versions":{"qairt":"2.43.0.260127150333_193827","tflite":"2.17.0"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/track_anything/releases/v0.50.1/track_anything-tflite-float.zip"},"onnx":{"tool_versions":{"qairt":"2.42.0.251225135753_193295","onnx_runtime":"1.24.1"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/track_anything/releases/v0.50.1/track_anything-onnx-float.zip"}}}}}
 
1
+ {"version":"0.50.2","precisions":{"float":{"universal_assets":{"onnx":{"tool_versions":{"qairt":"2.42.0.251225135753_193295","onnx_runtime":"1.24.3"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/track_anything/releases/v0.50.2/track_anything-onnx-float.zip"},"tflite":{"tool_versions":{"qairt":"2.43.0.260127150333_193827","tflite":"2.19.1"},"download_url":"https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/track_anything/releases/v0.50.2/track_anything-tflite-float.zip"}}}}}