Hugging Face's logo

qualcomm
/
Video-MAE

Video Classification
PyTorch
backbone
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
311a6f6
·
verified ·
1 Parent(s): f2e0458

v0.56.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.56.0 for changelog.

Files changed (2) hide show
  1. README.md +29 -39
  2. release_assets.json +11 -4
README.md CHANGED
@@ -28,8 +28,9 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.55.0/video_mae-qnn_dlc-float.zip)
32
- | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.55.0/video_mae-tflite-float.zip)
 
33
 
34
  For more device-specific assets and performance metrics, visit **[Video-MAE on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/video_mae)**.
35
 
@@ -58,43 +59,32 @@ See our repository for [Video-MAE on GitHub](https://github.com/qualcomm/ai-hub-
58
  ## Performance Summary
59
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
60
  |---|---|---|---|---|---|---
61
- | Video-MAE | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 1550.109 ms | 36 - 6032 MB | NPU
62
- | Video-MAE | ONNX | float | Snapdragon® X2 Elite | 1576.313 ms | 167 - 167 MB | NPU
63
- | Video-MAE | ONNX | float | Snapdragon® X Elite | 2824.893 ms | 223 - 223 MB | NPU
64
- | Video-MAE | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 2137.595 ms | 46 - 7352 MB | NPU
65
- | Video-MAE | ONNX | float | Qualcomm® QCS8550 (Proxy) | 2812.342 ms | 1 - 213 MB | NPU
66
- | Video-MAE | ONNX | float | Qualcomm® QCS9075 | 3180.348 ms | 46 - 137 MB | NPU
67
- | Video-MAE | ONNX | float | Qualcomm® QCS7181 | 2824.893 ms | 223 - 223 MB | NPU
68
- | Video-MAE | ONNX | w8a16 | Qualcomm® QCS6490 | 42154.434 ms | 1762 - 1793 MB | CPU
69
- | Video-MAE | ONNX | w8a16 | Qualcomm® QCM6690 | 20812.448 ms | 1748 - 1764 MB | CPU
70
- | Video-MAE | ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 20549.937 ms | 1759 - 1775 MB | CPU
71
- | Video-MAE | ONNX | w8a16 | Qualcomm® QCS7790 | 20549.937 ms | 1759 - 1775 MB | CPU
72
- | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 4074.811 ms | 46 - 6292 MB | NPU
73
- | Video-MAE | QNN_DLC | float | Snapdragon® X2 Elite | 1966.905 ms | 46 - 46 MB | NPU
74
- | Video-MAE | QNN_DLC | float | Snapdragon® X Elite | 3242.474 ms | 46 - 46 MB | NPU
75
- | Video-MAE | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5145.857 ms | 46 - 49 MB | NPU
76
- | Video-MAE | QNN_DLC | float | Qualcomm® SA8775P | 5350.041 ms | 36 - 6131 MB | NPU
77
- | Video-MAE | QNN_DLC | float | Qualcomm® SA8650P | 5350.041 ms | 36 - 6131 MB | NPU
78
- | Video-MAE | QNN_DLC | float | Qualcomm® SA8255P | 5350.041 ms | 36 - 6131 MB | NPU
79
- | Video-MAE | QNN_DLC | float | Qualcomm® SA8295P | 3810.902 ms | 46 - 5748 MB | NPU
80
- | Video-MAE | QNN_DLC | float | Qualcomm® QCS9075 | 5459.304 ms | 46 - 94 MB | NPU
81
- | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 3547.885 ms | 3 - 6106 MB | NPU
82
- | Video-MAE | QNN_DLC | float | Qualcomm® QCS8750 | 3547.885 ms | 3 - 6106 MB | NPU
83
- | Video-MAE | QNN_DLC | float | Qualcomm® QCS7181 | 3242.474 ms | 46 - 46 MB | NPU
84
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® X2 Elite | 1555.447 ms | 23 - 23 MB | NPU
85
- | Video-MAE | QNN_DLC | w8a16 | Snapdragon® X Elite | 2614.79 ms | 23 - 23 MB | NPU
86
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCS8550 (Proxy) | 2591.251 ms | 24 - 27 MB | NPU
87
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCS9075 | 2586.174 ms | 25 - 50 MB | NPU
88
- | Video-MAE | QNN_DLC | w8a16 | Qualcomm® QCS7181 | 2614.79 ms | 23 - 23 MB | NPU
89
- | Video-MAE | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 4081.091 ms | 1 - 6059 MB | NPU
90
- | Video-MAE | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5141.837 ms | 1 - 4 MB | NPU
91
- | Video-MAE | TFLITE | float | Qualcomm® SA8775P | 5322.183 ms | 2 - 5971 MB | NPU
92
- | Video-MAE | TFLITE | float | Qualcomm® SA8650P | 5322.183 ms | 2 - 5971 MB | NPU
93
- | Video-MAE | TFLITE | float | Qualcomm® SA8255P | 5322.183 ms | 2 - 5971 MB | NPU
94
- | Video-MAE | TFLITE | float | Qualcomm® SA8295P | 3731.947 ms | 1 - 5602 MB | NPU
95
- | Video-MAE | TFLITE | float | Qualcomm® QCS9075 | 5386.723 ms | 0 - 280 MB | NPU
96
- | Video-MAE | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 3542.999 ms | 1 - 5952 MB | NPU
97
- | Video-MAE | TFLITE | float | Qualcomm® QCS8750 | 3542.999 ms | 1 - 5952 MB | NPU
98
 
99
  ## License
100
  * The license for the original implementation of Video-MAE can be found
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | ONNX | float | Universal | QAIRT 2.45, ONNX Runtime 1.25.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.56.0/video_mae-onnx-float.zip)
32
+ | QNN_DLC | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.56.0/video_mae-qnn_dlc-float.zip)
33
+ | TFLITE | float | Universal | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.56.0/video_mae-tflite-float.zip)
34
 
35
  For more device-specific assets and performance metrics, visit **[Video-MAE on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/video_mae)**.
36
 
 
59
  ## Performance Summary
60
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
61
  |---|---|---|---|---|---|---
62
+ | Video-MAE | ONNX | float | Snapdragon® X2 Elite | 1573.648 ms | 167 - 167 MB | NPU
63
+ | Video-MAE | ONNX | float | Snapdragon® X Elite | 2876.574 ms | 193 - 193 MB | NPU
64
+ | Video-MAE | ONNX | float | Qualcomm® QCS8550 (Proxy) | 2818.888 ms | 1 - 213 MB | NPU
65
+ | Video-MAE | ONNX | float | Snapdragon® 8 Elite Mobile | 1649.301 ms | 4 - 5496 MB | NPU
66
+ | Video-MAE | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 1516.515 ms | 1 - 5696 MB | NPU
67
+ | Video-MAE | ONNX | float | Qualcomm® QCS9075 | 5020.553 ms | 46 - 137 MB | NPU
68
+ | Video-MAE | ONNX | float | Qualcomm® QCS8750 | 1649.301 ms | 4 - 5496 MB | NPU
69
+ | Video-MAE | ONNX | float | Qualcomm® QCS7181 | 2876.574 ms | 193 - 193 MB | NPU
70
+ | Video-MAE | QNN_DLC | float | Snapdragon® X2 Elite | 1968.594 ms | 46 - 46 MB | NPU
71
+ | Video-MAE | QNN_DLC | float | Snapdragon® X Elite | 3275.201 ms | 46 - 46 MB | NPU
72
+ | Video-MAE | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 5135.131 ms | 46 - 50 MB | NPU
73
+ | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite Mobile | 3552.984 ms | 1 - 6093 MB | NPU
74
+ | Video-MAE | QNN_DLC | float | Qualcomm® SA8295P | 3812.661 ms | 36 - 5739 MB | NPU
75
+ | Video-MAE | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 4070.911 ms | 3 - 6272 MB | NPU
76
+ | Video-MAE | QNN_DLC | float | Qualcomm® QCS9075 | 5458.899 ms | 46 - 94 MB | NPU
77
+ | Video-MAE | QNN_DLC | float | Qualcomm® QCS8750 | 3552.984 ms | 1 - 6093 MB | NPU
78
+ | Video-MAE | QNN_DLC | float | Qualcomm® QCS7181 | 3275.201 ms | 46 - 46 MB | NPU
79
+ | Video-MAE | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 5157.258 ms | 1 - 5 MB | NPU
80
+ | Video-MAE | TFLITE | float | Qualcomm® SA8775P | 14234.218 ms | 188 - 197 MB | CPU
81
+ | Video-MAE | TFLITE | float | Qualcomm® SA8650P | 14234.218 ms | 188 - 197 MB | CPU
82
+ | Video-MAE | TFLITE | float | Qualcomm® SA8255P | 14234.218 ms | 188 - 197 MB | CPU
83
+ | Video-MAE | TFLITE | float | Snapdragon® 8 Elite Mobile | 3536.957 ms | 1 - 5953 MB | NPU
84
+ | Video-MAE | TFLITE | float | Qualcomm® SA8295P | 3741.683 ms | 1 - 5603 MB | NPU
85
+ | Video-MAE | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 4086.474 ms | 1 - 6105 MB | NPU
86
+ | Video-MAE | TFLITE | float | Qualcomm® QCS9075 | 5389.455 ms | 0 - 280 MB | NPU
87
+ | Video-MAE | TFLITE | float | Qualcomm® QCS8750 | 3536.957 ms | 1 - 5953 MB | NPU
 
 
 
 
 
 
 
 
 
 
 
88
 
89
  ## License
90
  * The license for the original implementation of Video-MAE can be found
release_assets.json CHANGED
@@ -1,20 +1,27 @@
1
  {
2
- "version": "0.55.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
6
  "tflite": {
7
  "tool_versions": {
8
  "qairt": "2.45.0.260326154327",
9
- "litert": "1.4.3"
10
  },
11
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.55.0/video_mae-tflite-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.55.0/video_mae-qnn_dlc-float.zip"
 
 
 
 
 
 
 
18
  }
19
  }
20
  }
 
1
  {
2
+ "version": "0.56.0",
3
  "precisions": {
4
  "float": {
5
  "universal_assets": {
6
  "tflite": {
7
  "tool_versions": {
8
  "qairt": "2.45.0.260326154327",
9
+ "litert": "1.4.4"
10
  },
11
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.56.0/video_mae-tflite-float.zip"
12
  },
13
  "qnn_dlc": {
14
  "tool_versions": {
15
  "qairt": "2.45.0.260326154327"
16
  },
17
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.56.0/video_mae-qnn_dlc-float.zip"
18
+ },
19
+ "onnx": {
20
+ "tool_versions": {
21
+ "qairt": "2.45.0.260326154327",
22
+ "onnx_runtime": "1.25.0"
23
+ },
24
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/video_mae/releases/v0.56.0/video_mae-onnx-float.zip"
25
  }
26
  }
27
  }