Hugging Face's logo

qualcomm
/
Video-MAE

Video Classification
PyTorch
LiteRT
backbone
android
Model card Files
xet
Community
qaihm-bot commited on
Commit
4f4ffd1
·
verified ·
1 Parent(s): eb2cd54

v0.42.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.42.0 for changelog.

Files changed (4) hide show
  1. README.md +34 -34
  2. Video-MAE_float.dlc +2 -2
  3. Video-MAE_float.onnx.zip +2 -2
  4. Video-MAE_float.tflite +2 -2
README.md CHANGED
@@ -36,36 +36,36 @@ More details on model performance across various devices, can be found
36
 
37
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
- | Video-MAE | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 443.885 ms | 0 - 522 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
40
- | Video-MAE | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1086.824 ms | 1 - 456 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
41
- | Video-MAE | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 222.095 ms | 0 - 488 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
42
- | Video-MAE | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 1403.041 ms | 9 - 433 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
43
- | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 148.896 ms | 0 - 43 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
44
- | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 481.106 ms | 9 - 94 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
45
- | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 581.083 ms | 9 - 49 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
46
- | Video-MAE | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 171.652 ms | 0 - 522 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
47
- | Video-MAE | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 501.972 ms | 1 - 527 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
48
- | Video-MAE | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 443.885 ms | 0 - 522 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
49
- | Video-MAE | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1086.824 ms | 1 - 456 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
50
- | Video-MAE | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 149.939 ms | 0 - 43 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
51
- | Video-MAE | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 482.538 ms | 9 - 51 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
52
- | Video-MAE | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 240.355 ms | 0 - 480 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
53
- | Video-MAE | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 775.671 ms | 5 - 425 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
54
- | Video-MAE | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 150.384 ms | 0 - 45 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
55
- | Video-MAE | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 482.378 ms | 9 - 75 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
56
- | Video-MAE | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 171.652 ms | 0 - 522 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
57
- | Video-MAE | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 501.972 ms | 1 - 527 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
58
- | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 109.848 ms | 0 - 522 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
59
- | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 370.125 ms | 9 - 569 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
60
- | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 420.948 ms | 9 - 588 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
61
- | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 81.336 ms | 0 - 487 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
62
- | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 302.122 ms | 0 - 455 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
63
- | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 442.123 ms | 0 - 580 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
64
- | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 68.374 ms | 0 - 475 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
65
- | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 330.433 ms | 9 - 520 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
66
- | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 513.483 ms | 9 - 594 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
67
- | Video-MAE | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 499.534 ms | 609 - 609 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
68
- | Video-MAE | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 581.321 ms | 187 - 187 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
69
 
70
 
71
 
@@ -80,9 +80,9 @@ pip install "qai-hub-models[video-mae]"
80
  ```
81
 
82
 
83
- ## Configure Qualcomm® AI Hub to run this model on a cloud-hosted device
84
 
85
- Sign-in to [Qualcomm® AI Hub](https://app.aihub.qualcomm.com/) with your
86
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
87
 
88
  With this API token, you can configure your client to run models on the cloud
@@ -90,7 +90,7 @@ hosted devices.
90
  ```bash
91
  qai-hub configure --api_token API_TOKEN
92
  ```
93
- Navigate to [docs](https://app.aihub.qualcomm.com/docs/) for more information.
94
 
95
 
96
 
@@ -201,7 +201,7 @@ With the output of the model, you can compute like PSNR, relative errors or
201
  spot check the output with expected output.
202
 
203
  **Note**: This on-device profiling and inference requires access to Qualcomm®
204
- AI Hub. [Sign up for access](https://myaccount.qualcomm.com/signup).
205
 
206
 
207
 
 
36
 
37
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
38
  |---|---|---|---|---|---|---|---|---|
39
+ | Video-MAE | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 437.342 ms | 0 - 545 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
40
+ | Video-MAE | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 1060.781 ms | 122 - 600 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
41
+ | Video-MAE | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 217.717 ms | 0 - 503 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
42
+ | Video-MAE | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 577.79 ms | 9 - 461 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
43
+ | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 146.075 ms | 0 - 44 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
44
+ | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 496.217 ms | 9 - 56 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
45
+ | Video-MAE | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 574.235 ms | 0 - 249 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
46
+ | Video-MAE | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 168.385 ms | 0 - 542 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
47
+ | Video-MAE | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 500.63 ms | 3 - 521 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
48
+ | Video-MAE | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 437.342 ms | 0 - 545 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
49
+ | Video-MAE | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 1060.781 ms | 122 - 600 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
50
+ | Video-MAE | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 146.314 ms | 0 - 46 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
51
+ | Video-MAE | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 496.403 ms | 9 - 99 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
52
+ | Video-MAE | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 236.063 ms | 0 - 498 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
53
+ | Video-MAE | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 669.842 ms | 0 - 496 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
54
+ | Video-MAE | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 146.461 ms | 0 - 42 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
55
+ | Video-MAE | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 496.501 ms | 9 - 83 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
56
+ | Video-MAE | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 168.385 ms | 0 - 542 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
57
+ | Video-MAE | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 500.63 ms | 3 - 521 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
58
+ | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 107.737 ms | 0 - 536 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
59
+ | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 349.414 ms | 9 - 483 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
60
+ | Video-MAE | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 416.616 ms | 0 - 610 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
61
+ | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 80.773 ms | 0 - 528 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
62
+ | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 258.66 ms | 9 - 498 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
63
+ | Video-MAE | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 439.431 ms | 0 - 602 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
64
+ | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 65.034 ms | 0 - 511 MB | NPU | [Video-MAE.tflite](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.tflite) |
65
+ | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 270.293 ms | 9 - 528 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
66
+ | Video-MAE | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 596.427 ms | 0 - 622 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
67
+ | Video-MAE | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 514.913 ms | 720 - 720 MB | NPU | [Video-MAE.dlc](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.dlc) |
68
+ | Video-MAE | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 599.474 ms | 187 - 187 MB | NPU | [Video-MAE.onnx.zip](https://huggingface.co/qualcomm/Video-MAE/blob/main/Video-MAE.onnx.zip) |
69
 
70
 
71
 
 
80
  ```
81
 
82
 
83
+ ## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
84
 
85
+ Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
86
  Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
87
 
88
  With this API token, you can configure your client to run models on the cloud
 
90
  ```bash
91
  qai-hub configure --api_token API_TOKEN
92
  ```
93
+ Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
94
 
95
 
96
 
 
201
  spot check the output with expected output.
202
 
203
  **Note**: This on-device profiling and inference requires access to Qualcomm®
204
+ AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
205
 
206
 
207
 
Video-MAE_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c5fa07b3f0632023acf045de3aa1a819c08d5f09dbf28421577b221a5ac7477c
3
- size 351323076
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8d753640ee5a218bc1aa0beea7f4bd34a893499f0cf6a19e5add10ef3141761
3
+ size 351314884
Video-MAE_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e8579cad8867c483bac6259305a41b53f6b48930289d703d6eb2a77935dae1cd
3
- size 221433387
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a01c0ae8a3f41eaf17ddd5785ba6a70e34d7d648a1679a78f16f9df3c5236f74
3
+ size 221427591
Video-MAE_float.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:22e637d40b39300903017e57f0b7b908ba48b7fe4bc781dd709094e7bbdf6797
3
- size 351055308
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:01fa1f2460a83492c9e305febb4c572b09acc1c60881c014d9bffce0573a32fd
3
+ size 351051840