Hugging Face's logo

qualcomm
/
Mask2Former

Image Segmentation
PyTorch
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
2e96b7c
·
verified ·
1 Parent(s): 6b3343c

v0.60.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.60.0 for changelog.

Files changed (2) hide show
  1. README.md +55 -51
  2. release_assets.json +35 -20
README.md CHANGED
@@ -14,7 +14,7 @@ pipeline_tag: image-segmentation
14
  Mask2Former is a machine learning model that predicts masks and classes of objects in an image.
15
 
16
  This is based on the implementation of Mask2Former found [here](https://github.com/huggingface/transformers/tree/main/src/transformers/models/mask2former).
17
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/mask2former) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
18
 
19
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
20
 
@@ -27,80 +27,84 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® X2 Elite | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_x2_elite.zip)
31
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip)
32
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip)
33
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 1 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen1.zip)
34
- | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip)
35
- | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip)
36
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
37
- | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip)
38
- | QNN_CONTEXT_BINARY | float | Snapdragon® X2 Elite | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_x2_elite.zip)
39
- | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip)
40
- | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip)
41
- | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 1 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8gen1.zip)
42
- | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip)
43
- | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_sa8775p.zip)
44
- | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-9075 | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_qcs9075.zip)
45
- | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_sa7255p.zip)
46
- | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_sa8295p.zip)
47
- | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
48
- | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip)
 
 
49
 
50
  For more device-specific assets and performance metrics, visit **[Mask2Former on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/mask2former)**.
51
 
52
 
53
  ### Option 2: Export with Custom Configurations
54
 
55
- Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/mask2former) Python library to compile and export the model with your own:
56
  - Custom weights (e.g., fine-tuned checkpoints)
57
  - Custom input shapes
58
  - Target device and runtime configurations
59
 
60
  This option is ideal if you need to customize the model beyond the default configuration provided here.
61
 
62
- See our repository for [Mask2Former on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.59.0/src/qai_hub_models/models/mask2former) for usage instructions.
63
 
64
  ## Model Details
65
 
66
  **Model Type:** Model_use_case.semantic_segmentation
67
 
68
  **Model Stats:**
69
- - Model checkpoint: facebook/mask2former-swin-tiny-coco-panoptic
70
  - Input resolution: 384x384
 
71
  - Number of output classes: 100
72
 
73
  ## Performance Summary
74
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
75
  |---|---|---|---|---|---|---
76
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® X2 Elite | 67.94 ms | 9 - 9 MB | NPU
77
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | 142.293 ms | 109 - 109 MB | NPU
78
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | 104.618 ms | 9 - 22 MB | NPU
79
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 1 Mobile | 234.001 ms | 9 - 23 MB | NPU
80
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 142.039 ms | 0 - 112 MB | NPU
81
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® QCS8450 | 234.001 ms | 9 - 23 MB | NPU
82
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 201.948 ms | 7 - 12 MB | NPU
83
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 142.293 ms | 109 - 109 MB | NPU
84
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 89.094 ms | 10 - 20 MB | NPU
85
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Mobile | 89.094 ms | 10 - 20 MB | NPU
86
- | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 70.678 ms | 9 - 21 MB | NPU
87
- | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® X2 Elite | 68.148 ms | 2 - 2 MB | NPU
88
- | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | 142.765 ms | 2 - 2 MB | NPU
89
- | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | 104.6 ms | 4 - 11 MB | NPU
90
- | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 1 Mobile | 233.681 ms | 1 - 10 MB | NPU
91
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8275 | 289.752 ms | 2 - 11 MB | NPU
92
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 141.664 ms | 2 - 4 MB | NPU
93
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | 147.41 ms | 2 - 11 MB | NPU
94
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA8650P | 147.41 ms | 2 - 11 MB | NPU
95
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA8255P | 147.41 ms | 2 - 11 MB | NPU
96
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® QCS8450 | 233.681 ms | 1 - 10 MB | NPU
97
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-9075 | 146.388 ms | 4 - 10 MB | NPU
98
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-X7181 | 142.765 ms | 2 - 2 MB | NPU
99
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ Q-8750 | 88.976 ms | 2 - 14 MB | NPU
100
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | 289.752 ms | 2 - 11 MB | NPU
101
- | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | 182.756 ms | 2 - 7 MB | NPU
102
- | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Mobile | 88.976 ms | 2 - 14 MB | NPU
103
- | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | 70.882 ms | 2 - 12 MB | NPU
 
 
104
 
105
  ## License
106
  * The license for the original implementation of Mask2Former can be found
 
14
  Mask2Former is a machine learning model that predicts masks and classes of objects in an image.
15
 
16
  This is based on the implementation of Mask2Former found [here](https://github.com/huggingface/transformers/tree/main/src/transformers/models/mask2former).
17
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/mask2former) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
18
 
19
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
20
 
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® X2 Elite | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_x2_elite.zip)
31
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip)
32
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip)
33
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 1 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen1.zip)
34
+ | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs8275.zip)
35
+ | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip)
36
+ | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip)
37
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
38
+ | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.45, ONNX Runtime 1.27.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip)
39
+ | QNN_CONTEXT_BINARY | float | Snapdragon® X2 Elite | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_x2_elite.zip)
40
+ | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip)
41
+ | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip)
42
+ | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 1 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8gen1.zip)
43
+ | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-8275 | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_qcs8275.zip)
44
+ | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip)
45
+ | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_sa8775p.zip)
46
+ | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-9075 | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_qcs9075.zip)
47
+ | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_sa7255p.zip)
48
+ | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_sa8295p.zip)
49
+ | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
50
+ | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.45 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip)
51
 
52
  For more device-specific assets and performance metrics, visit **[Mask2Former on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/mask2former)**.
53
 
54
 
55
  ### Option 2: Export with Custom Configurations
56
 
57
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/mask2former) Python library to compile and export the model with your own:
58
  - Custom weights (e.g., fine-tuned checkpoints)
59
  - Custom input shapes
60
  - Target device and runtime configurations
61
 
62
  This option is ideal if you need to customize the model beyond the default configuration provided here.
63
 
64
+ See our repository for [Mask2Former on GitHub](https://github.com/qualcomm/ai-hub-models/blob/v0.60.0/src/qai_hub_models/models/mask2former) for usage instructions.
65
 
66
  ## Model Details
67
 
68
  **Model Type:** Model_use_case.semantic_segmentation
69
 
70
  **Model Stats:**
 
71
  - Input resolution: 384x384
72
+ - Model checkpoint: facebook/mask2former-swin-tiny-coco-panoptic
73
  - Number of output classes: 100
74
 
75
  ## Performance Summary
76
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
77
  |---|---|---|---|---|---|---
78
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® X2 Elite | 67.209 ms | 10 - 10 MB | NPU
79
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | 141.858 ms | 109 - 109 MB | NPU
80
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | 103.853 ms | 9 - 21 MB | NPU
81
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 1 Mobile | 233.331 ms | 9 - 24 MB | NPU
82
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-8275 | 139.254 ms | 7 - 13 MB | NPU
83
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 142.002 ms | 9 - 11 MB | NPU
84
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® QCS8450 | 233.331 ms | 9 - 24 MB | NPU
85
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-9075 | 146.798 ms | 7 - 12 MB | NPU
86
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ IQ-X7181 | 141.858 ms | 109 - 109 MB | NPU
87
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Qualcomm® Dragonwing™ Q-8750 | 80.356 ms | 10 - 23 MB | NPU
88
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Mobile | 80.356 ms | 10 - 23 MB | NPU
89
+ | Mask2Former | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 70.077 ms | 9 - 17 MB | NPU
90
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® X2 Elite | 67.483 ms | 2 - 2 MB | NPU
91
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | 142.611 ms | 2 - 2 MB | NPU
92
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | 103.633 ms | 2 - 10 MB | NPU
93
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 1 Mobile | 233.965 ms | 2 - 11 MB | NPU
94
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-8275 | 139.092 ms | 2 - 9 MB | NPU
95
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-8275 | 289.704 ms | 2 - 11 MB | NPU
96
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ QCS8550 (Proxy) | 141.574 ms | 2 - 4 MB | NPU
97
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | 147.041 ms | 2 - 11 MB | NPU
98
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA8650P | 147.041 ms | 2 - 11 MB | NPU
99
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA8255P | 147.041 ms | 2 - 11 MB | NPU
100
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® QCS8450 | 233.965 ms | 2 - 11 MB | NPU
101
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-9075 | 146.345 ms | 2 - 9 MB | NPU
102
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ IQ-X7181 | 142.611 ms | 2 - 2 MB | NPU
103
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® Dragonwing™ Q-8750 | 80.206 ms | 2 - 12 MB | NPU
104
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | 289.704 ms | 2 - 11 MB | NPU
105
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | 181.745 ms | 0 - 5 MB | NPU
106
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Mobile | 80.206 ms | 2 - 12 MB | NPU
107
+ | Mask2Former | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | 70.05 ms | 2 - 11 MB | NPU
108
 
109
  ## License
110
  * The license for the original implementation of Mask2Former can be found
release_assets.json CHANGED
@@ -1,21 +1,36 @@
1
  {
2
- "version": "0.59.0",
3
  "precisions": {
4
  "float": {
5
  "chipset_assets": {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6
  "qualcomm-qcs8550-proxy": {
7
  "precompiled_qnn_onnx": {
8
  "tool_versions": {
9
  "qairt": "2.45.0.260326154327",
10
  "onnx_runtime": "1.27.1"
11
  },
12
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip"
13
  },
14
  "qnn_context_binary": {
15
  "tool_versions": {
16
  "qairt": "2.45.0.260326154327"
17
  },
18
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip"
19
  }
20
  },
21
  "qualcomm-qcs9075": {
@@ -24,13 +39,13 @@
24
  "qairt": "2.45.0.260326154327",
25
  "onnx_runtime": "1.27.1"
26
  },
27
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip"
28
  },
29
  "qnn_context_binary": {
30
  "tool_versions": {
31
  "qairt": "2.45.0.260326154327"
32
  },
33
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_qcs9075.zip"
34
  }
35
  },
36
  "qualcomm-sa7255p": {
@@ -38,7 +53,7 @@
38
  "tool_versions": {
39
  "qairt": "2.45.0.260326154327"
40
  },
41
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_sa7255p.zip"
42
  }
43
  },
44
  "qualcomm-sa8295p": {
@@ -46,7 +61,7 @@
46
  "tool_versions": {
47
  "qairt": "2.45.0.260326154327"
48
  },
49
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_sa8295p.zip"
50
  }
51
  },
52
  "qualcomm-sa8775p": {
@@ -54,7 +69,7 @@
54
  "tool_versions": {
55
  "qairt": "2.45.0.260326154327"
56
  },
57
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_sa8775p.zip"
58
  }
59
  },
60
  "qualcomm-snapdragon-8-elite-for-galaxy": {
@@ -63,13 +78,13 @@
63
  "qairt": "2.45.0.260326154327",
64
  "onnx_runtime": "1.27.1"
65
  },
66
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip"
67
  },
68
  "qnn_context_binary": {
69
  "tool_versions": {
70
  "qairt": "2.45.0.260326154327"
71
  },
72
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip"
73
  }
74
  },
75
  "qualcomm-snapdragon-8-elite-gen5-for-galaxy": {
@@ -78,13 +93,13 @@
78
  "qairt": "2.45.0.260326154327",
79
  "onnx_runtime": "1.27.1"
80
  },
81
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip"
82
  },
83
  "qnn_context_binary": {
84
  "tool_versions": {
85
  "qairt": "2.45.0.260326154327"
86
  },
87
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip"
88
  }
89
  },
90
  "qualcomm-snapdragon-8gen1": {
@@ -93,13 +108,13 @@
93
  "qairt": "2.45.0.260326154327",
94
  "onnx_runtime": "1.27.1"
95
  },
96
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen1.zip"
97
  },
98
  "qnn_context_binary": {
99
  "tool_versions": {
100
  "qairt": "2.45.0.260326154327"
101
  },
102
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8gen1.zip"
103
  }
104
  },
105
  "qualcomm-snapdragon-8gen3": {
@@ -108,13 +123,13 @@
108
  "qairt": "2.45.0.260326154327",
109
  "onnx_runtime": "1.27.1"
110
  },
111
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip"
112
  },
113
  "qnn_context_binary": {
114
  "tool_versions": {
115
  "qairt": "2.45.0.260326154327"
116
  },
117
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip"
118
  }
119
  },
120
  "qualcomm-snapdragon-x-elite": {
@@ -123,13 +138,13 @@
123
  "qairt": "2.45.0.260326154327",
124
  "onnx_runtime": "1.27.1"
125
  },
126
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip"
127
  },
128
  "qnn_context_binary": {
129
  "tool_versions": {
130
  "qairt": "2.45.0.260326154327"
131
  },
132
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip"
133
  }
134
  },
135
  "qualcomm-snapdragon-x2-elite": {
@@ -138,13 +153,13 @@
138
  "qairt": "2.45.0.260326154327",
139
  "onnx_runtime": "1.27.1"
140
  },
141
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_x2_elite.zip"
142
  },
143
  "qnn_context_binary": {
144
  "tool_versions": {
145
  "qairt": "2.45.0.260326154327"
146
  },
147
- "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.59.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_x2_elite.zip"
148
  }
149
  }
150
  }
 
1
  {
2
+ "version": "0.60.0",
3
  "precisions": {
4
  "float": {
5
  "chipset_assets": {
6
+ "qualcomm-qcs8275": {
7
+ "precompiled_qnn_onnx": {
8
+ "tool_versions": {
9
+ "qairt": "2.45.0.260326154327",
10
+ "onnx_runtime": "1.27.1"
11
+ },
12
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs8275.zip"
13
+ },
14
+ "qnn_context_binary": {
15
+ "tool_versions": {
16
+ "qairt": "2.45.0.260326154327"
17
+ },
18
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_qcs8275.zip"
19
+ }
20
+ },
21
  "qualcomm-qcs8550-proxy": {
22
  "precompiled_qnn_onnx": {
23
  "tool_versions": {
24
  "qairt": "2.45.0.260326154327",
25
  "onnx_runtime": "1.27.1"
26
  },
27
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip"
28
  },
29
  "qnn_context_binary": {
30
  "tool_versions": {
31
  "qairt": "2.45.0.260326154327"
32
  },
33
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip"
34
  }
35
  },
36
  "qualcomm-qcs9075": {
 
39
  "qairt": "2.45.0.260326154327",
40
  "onnx_runtime": "1.27.1"
41
  },
42
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip"
43
  },
44
  "qnn_context_binary": {
45
  "tool_versions": {
46
  "qairt": "2.45.0.260326154327"
47
  },
48
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_qcs9075.zip"
49
  }
50
  },
51
  "qualcomm-sa7255p": {
 
53
  "tool_versions": {
54
  "qairt": "2.45.0.260326154327"
55
  },
56
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_sa7255p.zip"
57
  }
58
  },
59
  "qualcomm-sa8295p": {
 
61
  "tool_versions": {
62
  "qairt": "2.45.0.260326154327"
63
  },
64
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_sa8295p.zip"
65
  }
66
  },
67
  "qualcomm-sa8775p": {
 
69
  "tool_versions": {
70
  "qairt": "2.45.0.260326154327"
71
  },
72
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_sa8775p.zip"
73
  }
74
  },
75
  "qualcomm-snapdragon-8-elite-for-galaxy": {
 
78
  "qairt": "2.45.0.260326154327",
79
  "onnx_runtime": "1.27.1"
80
  },
81
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip"
82
  },
83
  "qnn_context_binary": {
84
  "tool_versions": {
85
  "qairt": "2.45.0.260326154327"
86
  },
87
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip"
88
  }
89
  },
90
  "qualcomm-snapdragon-8-elite-gen5-for-galaxy": {
 
93
  "qairt": "2.45.0.260326154327",
94
  "onnx_runtime": "1.27.1"
95
  },
96
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip"
97
  },
98
  "qnn_context_binary": {
99
  "tool_versions": {
100
  "qairt": "2.45.0.260326154327"
101
  },
102
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5_for_galaxy.zip"
103
  }
104
  },
105
  "qualcomm-snapdragon-8gen1": {
 
108
  "qairt": "2.45.0.260326154327",
109
  "onnx_runtime": "1.27.1"
110
  },
111
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen1.zip"
112
  },
113
  "qnn_context_binary": {
114
  "tool_versions": {
115
  "qairt": "2.45.0.260326154327"
116
  },
117
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8gen1.zip"
118
  }
119
  },
120
  "qualcomm-snapdragon-8gen3": {
 
123
  "qairt": "2.45.0.260326154327",
124
  "onnx_runtime": "1.27.1"
125
  },
126
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip"
127
  },
128
  "qnn_context_binary": {
129
  "tool_versions": {
130
  "qairt": "2.45.0.260326154327"
131
  },
132
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip"
133
  }
134
  },
135
  "qualcomm-snapdragon-x-elite": {
 
138
  "qairt": "2.45.0.260326154327",
139
  "onnx_runtime": "1.27.1"
140
  },
141
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip"
142
  },
143
  "qnn_context_binary": {
144
  "tool_versions": {
145
  "qairt": "2.45.0.260326154327"
146
  },
147
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip"
148
  }
149
  },
150
  "qualcomm-snapdragon-x2-elite": {
 
153
  "qairt": "2.45.0.260326154327",
154
  "onnx_runtime": "1.27.1"
155
  },
156
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-precompiled_qnn_onnx-float-qualcomm_snapdragon_x2_elite.zip"
157
  },
158
  "qnn_context_binary": {
159
  "tool_versions": {
160
  "qairt": "2.45.0.260326154327"
161
  },
162
+ "download_url": "https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/mask2former/releases/v0.60.0/mask2former-qnn_context_binary-float-qualcomm_snapdragon_x2_elite.zip"
163
  }
164
  }
165
  }