Hugging Face's logo

qualcomm
/
Video-MAE

Video Classification
PyTorch
backbone
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
f2e0458
·
verified ·
1 Parent(s): 0723843

v0.55.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.55.0 for changelog.

Files changed (2) hide show
  1. README.md +39 -70
  2. release_assets.json +3 -27
README.md CHANGED
@@ -28,11 +28,8 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-onnx-float.zip)
32
- | ONNX | w8a16 | Universal | QAIRT 2.42, ONNX Runtime 1.24.3 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-onnx-w8a16.zip)
33
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-qnn_dlc-float.zip)
34
- | QNN_DLC | w8a16 | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-qnn_dlc-w8a16.zip)
35
- | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-tflite-float.zip)
36
 
37
  For more device-specific assets and performance metrics, visit **[Video-MAE on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/video_mae)**.
38
 
@@ -61,71 +58,43 @@ See our repository for [Video-MAE on GitHub](https://github.com/qualcomm/ai-hub-
61
  ## Performance Summary
62
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
63
  |---|---|---|---|---|---|---
64
- | Video-MAE | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 448.715 ms | 9 - 997 MB | NPU
65
- | Video-MAE | ONNX | float | Snapdragon® 8 Elite Mobile | 380.738 ms | 3 - 915 MB | NPU
66
- | Video-MAE | ONNX | float | Snapdragon® X2 Elite | 438.207 ms | 186 - 186 MB | NPU
67
- | Video-MAE | ONNX | float | Snapdragon® X Elite | 665.106 ms | 187 - 187 MB | NPU
68
- | Video-MAE | ONNX | float | Snapdragon® X Elite | 665.106 ms | 187 - 187 MB | NPU
69
- | Video-MAE | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 401.658 ms | 20 - 1209 MB | NPU
70
- | Video-MAE | ONNX | float | Qualcomm® QCS8550 (Proxy) | 632.18 ms | 0 - 220 MB | NPU
71
- | Video-MAE | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 380.738 ms | 3 - 915 MB | NPU
72
- | Video-MAE | ONNX | float | Qualcomm® QCS9075 | 686.02 ms | 9 - 21 MB | NPU
73
- | Video-MAE | ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 318.12 ms | 5 - 1026 MB | NPU
74
- | Video-MAE | ONNX | w8a16 | Snapdragon® 8 Elite Mobile | 268.796 ms | 1 - 970 MB | NPU
75
- | Video-MAE | ONNX | w8a16 | Snapdragon® X2 Elite | 315.424 ms | 99 - 99 MB | NPU
76
- | Video-MAE | ONNX | w8a16 | Snapdragon® X Elite | 460.275 ms | 99 - 99 MB | NPU
77
- | Video-MAE | ONNX | w8a16 | Snapdragon® X Elite | 460.275 ms | 99 - 99 MB | NPU
78
- | Video-MAE | ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 420.106 ms | 5 - 1368 MB | NPU
79
- | Video-MAE | ONNX | w8a16 | Qualcomm® QCS6490 | 9558.694 ms | 475 - 491 MB | CPU
80
- | Video-MAE | ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 444.439 ms | 0 - 112 MB | NPU
81
- | Video-MAE | ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 268.796 ms | 1 - 970 MB | NPU
82
- | Video-MAE | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4610.601 ms | 481 - 494 MB | CPU
83
- | Video-MAE | ONNX | w8a16 | Qualcomm® QCM6690 | 4761.175 ms | 439 - 450 MB | CPU
84
- | Video-MAE | ONNX | w8a16 | Qualcomm® QCS9075 | 573.657 ms | 0 - 7 MB | NPU
85
- | Video-MAE | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 4610.601 ms | 481 - 494 MB | CPU
86
- | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 328.336 ms | 9 - 722 MB | NPU
87
- | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 260.663 ms | 9 - 750 MB | NPU
88
- | Video-MAE | QNN_DLC | float | Snapdragon® X2 Elite | 325.614 ms | 9 - 9 MB | NPU
89
- | Video-MAE | QNN_DLC | float | Snapdragon® X Elite | 460.016 ms | 9 - 9 MB | NPU
90
- | Video-MAE | QNN_DLC | float | Snapdragon® X Elite | 460.016 ms | 9 - 9 MB | NPU
91
- | Video-MAE | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 342.56 ms | 9 - 909 MB | NPU
92
- | Video-MAE | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 439.644 ms | 9 - 12 MB | NPU
93
- | Video-MAE | QNN_DLC | float | Qualcomm® SA8775P | 455.92 ms | 0 - 660 MB | NPU
94
- | Video-MAE | QNN_DLC | float | Qualcomm® SA8775P | 455.92 ms | 0 - 660 MB | NPU
95
- | Video-MAE | QNN_DLC | float | Qualcomm® SA8775P | 455.92 ms | 0 - 660 MB | NPU
96
- | Video-MAE | QNN_DLC | float | Qualcomm® SA7255P | 1119.868 ms | 1 - 775 MB | NPU
97
- | Video-MAE | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 546.284 ms | 9 - 851 MB | NPU
98
- | Video-MAE | QNN_DLC | float | Qualcomm® SA8295P | 559.384 ms | 0 - 597 MB | NPU
99
- | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 260.663 ms | 9 - 750 MB | NPU
100
- | Video-MAE | QNN_DLC | float | Qualcomm® QCS9075 | 487.863 ms | 9 - 20 MB | NPU
101
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 295.405 ms | 5 - 804 MB | NPU
102
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® 8 Elite Mobile | 239.901 ms | 5 - 791 MB | NPU
103
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 294.308 ms | 5 - 5 MB | NPU
104
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® X Elite | 454.012 ms | 5 - 5 MB | NPU
105
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® X Elite | 454.012 ms | 5 - 5 MB | NPU
106
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® 8 Gen 3 Mobile | 299.494 ms | 5 - 957 MB | NPU
107
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 432.84 ms | 5 - 7 MB | NPU
108
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® SA8775P | 442.06 ms | 0 - 807 MB | NPU
109
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® SA8775P | 442.06 ms | 0 - 807 MB | NPU
110
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® SA8775P | 442.06 ms | 0 - 807 MB | NPU
111
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® SA7255P | 946.416 ms | 4 - 834 MB | NPU
112
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 239.901 ms | 5 - 791 MB | NPU
113
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 706.569 ms | 5 - 1068 MB | NPU
114
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCM6690 | 2441.618 ms | 5 - 1310 MB | NPU
115
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 415.294 ms | 4 - 10 MB | NPU
116
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® 7 Gen 4 Mobile | 706.569 ms | 5 - 1068 MB | NPU
117
- | Video-MAE | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 53.713 ms | 0 - 717 MB | NPU
118
- | Video-MAE | TFLITE | float | Snapdragon® 8 Elite Mobile | 64.725 ms | 0 - 711 MB | NPU
119
- | Video-MAE | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 92.991 ms | 0 - 965 MB | NPU
120
- | Video-MAE | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 125.384 ms | 0 - 4 MB | NPU
121
- | Video-MAE | TFLITE | float | Qualcomm® SA8775P | 148.248 ms | 0 - 712 MB | NPU
122
- | Video-MAE | TFLITE | float | Qualcomm® SA8775P | 148.248 ms | 0 - 712 MB | NPU
123
- | Video-MAE | TFLITE | float | Qualcomm® SA8775P | 148.248 ms | 0 - 712 MB | NPU
124
- | Video-MAE | TFLITE | float | Qualcomm® SA7255P | 416.588 ms | 0 - 724 MB | NPU
125
- | Video-MAE | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 265.013 ms | 0 - 897 MB | NPU
126
- | Video-MAE | TFLITE | float | Qualcomm® SA8295P | 202.193 ms | 0 - 656 MB | NPU
127
- | Video-MAE | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 64.725 ms | 0 - 711 MB | NPU
128
- | Video-MAE | TFLITE | float | Qualcomm® QCS9075 | 158.52 ms | 0 - 206 MB | NPU
129
 
130
  ## License
131
  * The license for the original implementation of Video-MAE can be found
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.55.0/video_mae-qnn_dlc-float.zip)
32
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.55.0/video_mae-tflite-float.zip)
 
 
 
33
 
34
  For more device-specific assets and performance metrics, visit **[Video-MAE on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/video_mae)**.
35
 
 
58
  ## Performance Summary
59
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
60
  |---|---|---|---|---|---|---
61
+ | Video-MAE | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 1550.109 ms | 36 - 6032 MB | NPU
62
+ | Video-MAE | ONNX | float | Snapdragon® X2 Elite | 1576.313 ms | 167 - 167 MB | NPU
63
+ | Video-MAE | ONNX | float | Snapdragon® X Elite | 2824.893 ms | 223 - 223 MB | NPU
64
+ | Video-MAE | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 2137.595 ms | 46 - 7352 MB | NPU
65
+ | Video-MAE | ONNX | float | Qualcomm® QCS8550 (Proxy) | 2812.342 ms | 1 - 213 MB | NPU
66
+ | Video-MAE | ONNX | float | Qualcomm® QCS9075 | 3180.348 ms | 46 - 137 MB | NPU
67
+ | Video-MAE | ONNX | float | Qualcomm® QCS7181 | 2824.893 ms | 223 - 223 MB | NPU
68
+ | Video-MAE | ONNX | w8a16 | Qualcomm® QCS6490 | 42154.434 ms | 1762 - 1793 MB | CPU
69
+ | Video-MAE | ONNX | w8a16 | Qualcomm® QCM6690 | 20812.448 ms | 1748 - 1764 MB | CPU
70
+ | Video-MAE | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 20549.937 ms | 1759 - 1775 MB | CPU
71
+ | Video-MAE | ONNX | w8a16 | Qualcomm® QCS7790 | 20549.937 ms | 1759 - 1775 MB | CPU
72
+ | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 4074.811 ms | 46 - 6292 MB | NPU
73
+ | Video-MAE | QNN_DLC | float | Snapdragon® X2 Elite | 1966.905 ms | 46 - 46 MB | NPU
74
+ | Video-MAE | QNN_DLC | float | Snapdragon® X Elite | 3242.474 ms | 46 - 46 MB | NPU
75
+ | Video-MAE | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5145.857 ms | 46 - 49 MB | NPU
76
+ | Video-MAE | QNN_DLC | float | Qualcomm® SA8775P | 5350.041 ms | 36 - 6131 MB | NPU
77
+ | Video-MAE | QNN_DLC | float | Qualcomm® SA8650P | 5350.041 ms | 36 - 6131 MB | NPU
78
+ | Video-MAE | QNN_DLC | float | Qualcomm® SA8255P | 5350.041 ms | 36 - 6131 MB | NPU
79
+ | Video-MAE | QNN_DLC | float | Qualcomm® SA8295P | 3810.902 ms | 46 - 5748 MB | NPU
80
+ | Video-MAE | QNN_DLC | float | Qualcomm® QCS9075 | 5459.304 ms | 46 - 94 MB | NPU
81
+ | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 3547.885 ms | 3 - 6106 MB | NPU
82
+ | Video-MAE | QNN_DLC | float | Qualcomm® QCS8750 | 3547.885 ms | 3 - 6106 MB | NPU
83
+ | Video-MAE | QNN_DLC | float | Qualcomm® QCS7181 | 3242.474 ms | 46 - 46 MB | NPU
84
+ | Video-MAE | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 1555.447 ms | 23 - 23 MB | NPU
85
+ | Video-MAE | QNN_DLC | w8a16 | Snapdragon® X Elite | 2614.79 ms | 23 - 23 MB | NPU
86
+ | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 2591.251 ms | 24 - 27 MB | NPU
87
+ | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 2586.174 ms | 25 - 50 MB | NPU
88
+ | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 2614.79 ms | 23 - 23 MB | NPU
89
+ | Video-MAE | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 4081.091 ms | 1 - 6059 MB | NPU
90
+ | Video-MAE | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5141.837 ms | 1 - 4 MB | NPU
91
+ | Video-MAE | TFLITE | float | Qualcomm® SA8775P | 5322.183 ms | 2 - 5971 MB | NPU
92
+ | Video-MAE | TFLITE | float | Qualcomm® SA8650P | 5322.183 ms | 2 - 5971 MB | NPU
93
+ | Video-MAE | TFLITE | float | Qualcomm® SA8255P | 5322.183 ms | 2 - 5971 MB | NPU
94
+ | Video-MAE | TFLITE | float | Qualcomm® SA8295P | 3731.947 ms | 1 - 5602 MB | NPU
95
+ | Video-MAE | TFLITE | float | Qualcomm® QCS9075 | 5386.723 ms | 0 - 280 MB | NPU
96
+ | Video-MAE | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 3542.999 ms | 1 - 5952 MB | NPU
97
+ | Video-MAE | TFLITE | float | Qualcomm® QCS8750 | 3542.999 ms | 1 - 5952 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
98
 
99
  ## License
100
  * The license for the original implementation of Video-MAE can be found
release_assets.json CHANGED
@@ -1,23 +1,6 @@
1
  {
2
- "version": "0.54.0",
3
  "precisions": {
4
- "w8a16": {
5
- "universal_assets": {
6
- "qnn_dlc": {
7
- "tool_versions": {
8
- "qairt": "2.45.0.260326154327"
9
- },
10
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-qnn_dlc-w8a16.zip"
11
- },
12
- "onnx": {
13
- "tool_versions": {
14
- "qairt": "2.42.0.251225135753_193295",
15
- "onnx_runtime": "1.24.3"
16
- },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-onnx-w8a16.zip"
18
- }
19
- }
20
- },
21
  "float": {
22
  "universal_assets": {
23
  "tflite": {
@@ -25,20 +8,13 @@
25
  "qairt": "2.45.0.260326154327",
26
  "litert": "1.4.3"
27
  },
28
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-tflite-float.zip"
29
  },
30
  "qnn_dlc": {
31
  "tool_versions": {
32
  "qairt": "2.45.0.260326154327"
33
  },
34
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-qnn_dlc-float.zip"
35
- },
36
- "onnx": {
37
- "tool_versions": {
38
- "qairt": "2.42.0.251225135753_193295",
39
- "onnx_runtime": "1.24.3"
40
- },
41
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.54.0/video_mae-onnx-float.zip"
42
  }
43
  }
44
  }
 
1
  {
2
+ "version": "0.55.0",
3
  "precisions": {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
4
  "float": {
5
  "universal_assets": {
6
  "tflite": {
 
8
  "qairt": "2.45.0.260326154327",
9
  "litert": "1.4.3"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.55.0/video_mae-tflite-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.55.0/video_mae-qnn_dlc-float.zip"
 
 
 
 
 
 
 
18
  }
19
  }
20
  }