Hugging Face's logo

qualcomm
/
PSPNet

Image Segmentation
PyTorch
bu_auto
android
Model card Files
xet
 Community
qaihm-bot commited on
Commit
60d342b
·
verified ·
1 Parent(s): 2adb6a3

v0.48.0

Browse files

See https://github.com/qualcomm/ai-hub-models/releases/v0.48.0 for changelog.

Files changed (1) hide show
  1. README.md +57 -57
README.md CHANGED
@@ -14,7 +14,7 @@ pipeline_tag: image-segmentation
14
 
15
  PSPNet (Pyramid Scene Parsing Network) is a semantic segmentation model that captures global context information by applying pyramid pooling modules. It is designed to improve scene understanding by aggregating contextual features at multiple scales.
16
 
17
- This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/pspnet) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
18
 
19
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
20
 
@@ -27,26 +27,26 @@ Below are pre-exported model assets ready for deployment.
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
- | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.47.0/pspnet-onnx-float.zip)
31
- | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.47.0/pspnet-onnx-w8a8.zip)
32
- | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.47.0/pspnet-qnn_dlc-float.zip)
33
- | QNN_DLC | w8a8 | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.47.0/pspnet-qnn_dlc-w8a8.zip)
34
- | TFLITE | float | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.47.0/pspnet-tflite-float.zip)
35
- | TFLITE | w8a8 | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.47.0/pspnet-tflite-w8a8.zip)
36
 
37
  For more device-specific assets and performance metrics, visit **[PSPNet on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/pspnet)**.
38
 
39
 
40
  ### Option 2: Export with Custom Configurations
41
 
42
- Use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/pspnet) Python library to compile and export the model with your own:
43
  - Custom weights (e.g., fine-tuned checkpoints)
44
  - Custom input shapes
45
  - Target device and runtime configurations
46
 
47
  This option is ideal if you need to customize the model beyond the default configuration provided here.
48
 
49
- See our repository for [PSPNet on GitHub](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/pspnet) for usage instructions.
50
 
51
  ## Model Details
52
 
@@ -61,54 +61,54 @@ See our repository for [PSPNet on GitHub](https://github.com/quic/ai-hub-models/
61
  ## Performance Summary
62
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
63
  |---|---|---|---|---|---|---
64
- | PSPNet | ONNX | float | Snapdragon® X Elite | 693.468 ms | 529 - 529 MB | NPU
65
- | PSPNet | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 511.447 ms | 0 - 925 MB | NPU
66
- | PSPNet | ONNX | float | Qualcomm® QCS8550 (Proxy) | 607.007 ms | 1 - 163 MB | NPU
67
- | PSPNet | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 332.552 ms | 246 - 1003 MB | NPU
68
- | PSPNet | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 322.712 ms | 239 - 1006 MB | NPU
69
- | PSPNet | ONNX | float | Snapdragon® X2 Elite | 427.934 ms | 266 - 266 MB | NPU
70
- | PSPNet | ONNX | w8a8 | Snapdragon® X Elite | 28.578 ms | 133 - 133 MB | NPU
71
- | PSPNet | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 22.041 ms | 69 - 489 MB | NPU
72
- | PSPNet | ONNX | w8a8 | Qualcomm® QCS6490 | 3300.144 ms | 196 - 274 MB | CPU
73
- | PSPNet | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 30.431 ms | 64 - 148 MB | NPU
74
- | PSPNet | ONNX | w8a8 | Qualcomm® QCS9075 | 34.296 ms | 70 - 74 MB | NPU
75
- | PSPNet | ONNX | w8a8 | Qualcomm® QCM6690 | 3080.851 ms | 83 - 93 MB | CPU
76
- | PSPNet | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 19.115 ms | 69 - 338 MB | NPU
77
- | PSPNet | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 2608.347 ms | 50 - 62 MB | CPU
78
- | PSPNet | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 16.83 ms | 71 - 341 MB | NPU
79
- | PSPNet | ONNX | w8a8 | Snapdragon® X2 Elite | 15.152 ms | 131 - 131 MB | NPU
80
- | PSPNet | QNN_DLC | float | Snapdragon® X Elite | 546.735 ms | 3 - 3 MB | NPU
81
- | PSPNet | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 625.995 ms | 3 - 878 MB | NPU
82
- | PSPNet | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 1865.874 ms | 3 - 722 MB | NPU
83
- | PSPNet | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 604.157 ms | 3 - 5 MB | NPU
84
- | PSPNet | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 1703.062 ms | 0 - 434 MB | NPU
85
- | PSPNet | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 300.352 ms | 0 - 717 MB | NPU
86
- | PSPNet | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 267.159 ms | 3 - 735 MB | NPU
87
- | PSPNet | QNN_DLC | float | Snapdragon® X2 Elite | 228.493 ms | 3 - 3 MB | NPU
88
- | PSPNet | QNN_DLC | w8a8 | Snapdragon® X Elite | 25.987 ms | 1 - 1 MB | NPU
89
- | PSPNet | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 20.557 ms | 0 - 364 MB | NPU
90
- | PSPNet | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 63.815 ms | 1 - 262 MB | NPU
91
- | PSPNet | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 27.447 ms | 0 - 19 MB | NPU
92
- | PSPNet | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 31.726 ms | 1 - 35 MB | NPU
93
- | PSPNet | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 37.2 ms | 1 - 357 MB | NPU
94
- | PSPNet | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 18.188 ms | 1 - 233 MB | NPU
95
- | PSPNet | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 92.24 ms | 1 - 458 MB | NPU
96
- | PSPNet | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 16.19 ms | 1 - 237 MB | NPU
97
- | PSPNet | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 14.508 ms | 1 - 1 MB | NPU
98
- | PSPNet | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 529.045 ms | 0 - 1040 MB | NPU
99
- | PSPNet | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 1684.21 ms | 114 - 948 MB | NPU
100
- | PSPNet | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 612.52 ms | 128 - 131 MB | NPU
101
- | PSPNet | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 1561.811 ms | 41 - 616 MB | NPU
102
- | PSPNet | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 980.781 ms | 126 - 878 MB | NPU
103
- | PSPNet | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 329.855 ms | 128 - 966 MB | NPU
104
- | PSPNet | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 21.554 ms | 28 - 416 MB | NPU
105
- | PSPNet | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 66.698 ms | 32 - 303 MB | NPU
106
- | PSPNet | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 29.027 ms | 32 - 34 MB | NPU
107
- | PSPNet | TFLITE | w8a8 | Qualcomm® QCS9075 | 32.058 ms | 32 - 131 MB | NPU
108
- | PSPNet | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 40.822 ms | 32 - 415 MB | NPU
109
- | PSPNet | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 19.445 ms | 30 - 283 MB | NPU
110
- | PSPNet | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 94.282 ms | 0 - 410 MB | NPU
111
- | PSPNet | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 15.312 ms | 32 - 282 MB | NPU
112
 
113
  ## License
114
  * The license for the original implementation of PSPNet can be found
 
14
 
15
  PSPNet (Pyramid Scene Parsing Network) is a semantic segmentation model that captures global context information by applying pyramid pooling modules. It is designed to improve scene understanding by aggregating contextual features at multiple scales.
16
 
17
+ This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/pspnet) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
18
 
19
  Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
20
 
 
27
 
28
  | Runtime | Precision | Chipset | SDK Versions | Download |
29
  |---|---|---|---|---|
30
+ | ONNX | float | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.48.0/pspnet-onnx-float.zip)
31
+ | ONNX | w8a8 | Universal | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.48.0/pspnet-onnx-w8a8.zip)
32
+ | QNN_DLC | float | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.48.0/pspnet-qnn_dlc-float.zip)
33
+ | QNN_DLC | w8a8 | Universal | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.48.0/pspnet-qnn_dlc-w8a8.zip)
34
+ | TFLITE | float | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.48.0/pspnet-tflite-float.zip)
35
+ | TFLITE | w8a8 | Universal | QAIRT 2.43, TFLite 2.17.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/pspnet/releases/v0.48.0/pspnet-tflite-w8a8.zip)
36
 
37
  For more device-specific assets and performance metrics, visit **[PSPNet on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/pspnet)**.
38
 
39
 
40
  ### Option 2: Export with Custom Configurations
41
 
42
+ Use the [Qualcomm® AI Hub Models](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/pspnet) Python library to compile and export the model with your own:
43
  - Custom weights (e.g., fine-tuned checkpoints)
44
  - Custom input shapes
45
  - Target device and runtime configurations
46
 
47
  This option is ideal if you need to customize the model beyond the default configuration provided here.
48
 
49
+ See our repository for [PSPNet on GitHub](https://github.com/qualcomm/ai-hub-models/blob/main/qai_hub_models/models/pspnet) for usage instructions.
50
 
51
  ## Model Details
52
 
 
61
  ## Performance Summary
62
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
63
  |---|---|---|---|---|---|---
64
+ | PSPNet | ONNX | float | Snapdragon® X2 Elite | 428.799 ms | 266 - 266 MB | NPU
65
+ | PSPNet | ONNX | float | Snapdragon® X Elite | 695.154 ms | 529 - 529 MB | NPU
66
+ | PSPNet | ONNX | float | Snapdragon® 8 Gen 3 Mobile | 513.442 ms | 147 - 1066 MB | NPU
67
+ | PSPNet | ONNX | float | Qualcomm® QCS8550 (Proxy) | 606.249 ms | 188 - 190 MB | NPU
68
+ | PSPNet | ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 334.904 ms | 248 - 1006 MB | NPU
69
+ | PSPNet | ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 324.487 ms | 224 - 992 MB | NPU
70
+ | PSPNet | ONNX | w8a8 | Snapdragon® X2 Elite | 15.299 ms | 131 - 131 MB | NPU
71
+ | PSPNet | ONNX | w8a8 | Snapdragon® X Elite | 28.506 ms | 133 - 133 MB | NPU
72
+ | PSPNet | ONNX | w8a8 | Snapdragon® 8 Gen 3 Mobile | 22.095 ms | 71 - 492 MB | NPU
73
+ | PSPNet | ONNX | w8a8 | Qualcomm® QCS6490 | 3343.057 ms | 204 - 285 MB | CPU
74
+ | PSPNet | ONNX | w8a8 | Qualcomm® QCS8550 (Proxy) | 30.252 ms | 32 - 115 MB | NPU
75
+ | PSPNet | ONNX | w8a8 | Qualcomm® QCS9075 | 34.05 ms | 70 - 73 MB | NPU
76
+ | PSPNet | ONNX | w8a8 | Qualcomm® QCM6690 | 3145.346 ms | 63 - 74 MB | CPU
77
+ | PSPNet | ONNX | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 19.001 ms | 71 - 342 MB | NPU
78
+ | PSPNet | ONNX | w8a8 | Snapdragon® 7 Gen 4 Mobile | 2605.807 ms | 91 - 103 MB | CPU
79
+ | PSPNet | ONNX | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 16.968 ms | 71 - 340 MB | NPU
80
+ | PSPNet | QNN_DLC | float | Snapdragon® X2 Elite | 230.422 ms | 3 - 3 MB | NPU
81
+ | PSPNet | QNN_DLC | float | Snapdragon® X Elite | 544.385 ms | 3 - 3 MB | NPU
82
+ | PSPNet | QNN_DLC | float | Snapdragon® 8 Gen 3 Mobile | 621.548 ms | 0 - 873 MB | NPU
83
+ | PSPNet | QNN_DLC | float | Qualcomm® QCS8275 (Proxy) | 1865.275 ms | 2 - 722 MB | NPU
84
+ | PSPNet | QNN_DLC | float | Qualcomm® QCS8550 (Proxy) | 609.258 ms | 3 - 5 MB | NPU
85
+ | PSPNet | QNN_DLC | float | Qualcomm® QCS8450 (Proxy) | 1698.164 ms | 0 - 429 MB | NPU
86
+ | PSPNet | QNN_DLC | float | Snapdragon® 8 Elite For Galaxy Mobile | 303.534 ms | 141 - 860 MB | NPU
87
+ | PSPNet | QNN_DLC | float | Snapdragon® 8 Elite Gen 5 Mobile | 270.855 ms | 1 - 734 MB | NPU
88
+ | PSPNet | QNN_DLC | w8a8 | Snapdragon® X2 Elite | 14.594 ms | 1 - 1 MB | NPU
89
+ | PSPNet | QNN_DLC | w8a8 | Snapdragon® X Elite | 26.084 ms | 1 - 1 MB | NPU
90
+ | PSPNet | QNN_DLC | w8a8 | Snapdragon® 8 Gen 3 Mobile | 21.318 ms | 1 - 362 MB | NPU
91
+ | PSPNet | QNN_DLC | w8a8 | Qualcomm® QCS8275 (Proxy) | 63.872 ms | 1 - 263 MB | NPU
92
+ | PSPNet | QNN_DLC | w8a8 | Qualcomm® QCS8550 (Proxy) | 27.353 ms | 1 - 3 MB | NPU
93
+ | PSPNet | QNN_DLC | w8a8 | Qualcomm® QCS9075 | 32.019 ms | 1 - 35 MB | NPU
94
+ | PSPNet | QNN_DLC | w8a8 | Qualcomm® QCS8450 (Proxy) | 38.613 ms | 1 - 360 MB | NPU
95
+ | PSPNet | QNN_DLC | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 18.41 ms | 1 - 233 MB | NPU
96
+ | PSPNet | QNN_DLC | w8a8 | Snapdragon® 7 Gen 4 Mobile | 91.51 ms | 1 - 430 MB | NPU
97
+ | PSPNet | QNN_DLC | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 15.938 ms | 1 - 238 MB | NPU
98
+ | PSPNet | TFLITE | float | Snapdragon® 8 Gen 3 Mobile | 530.504 ms | 120 - 1170 MB | NPU
99
+ | PSPNet | TFLITE | float | Qualcomm® QCS8275 (Proxy) | 1684.384 ms | 121 - 956 MB | NPU
100
+ | PSPNet | TFLITE | float | Qualcomm® QCS8550 (Proxy) | 617.858 ms | 121 - 124 MB | NPU
101
+ | PSPNet | TFLITE | float | Qualcomm® QCS8450 (Proxy) | 1564.358 ms | 44 - 617 MB | NPU
102
+ | PSPNet | TFLITE | float | Snapdragon® 8 Elite For Galaxy Mobile | 971.866 ms | 38 - 795 MB | NPU
103
+ | PSPNet | TFLITE | float | Snapdragon® 8 Elite Gen 5 Mobile | 328.449 ms | 128 - 965 MB | NPU
104
+ | PSPNet | TFLITE | w8a8 | Snapdragon® 8 Gen 3 Mobile | 21.514 ms | 50 - 437 MB | NPU
105
+ | PSPNet | TFLITE | w8a8 | Qualcomm® QCS8275 (Proxy) | 66.574 ms | 32 - 304 MB | NPU
106
+ | PSPNet | TFLITE | w8a8 | Qualcomm® QCS8550 (Proxy) | 30.01 ms | 32 - 34 MB | NPU
107
+ | PSPNet | TFLITE | w8a8 | Qualcomm® QCS9075 | 32.442 ms | 32 - 131 MB | NPU
108
+ | PSPNet | TFLITE | w8a8 | Qualcomm® QCS8450 (Proxy) | 40.322 ms | 18 - 403 MB | NPU
109
+ | PSPNet | TFLITE | w8a8 | Snapdragon® 8 Elite For Galaxy Mobile | 18.543 ms | 32 - 285 MB | NPU
110
+ | PSPNet | TFLITE | w8a8 | Snapdragon® 7 Gen 4 Mobile | 95.006 ms | 32 - 445 MB | NPU
111
+ | PSPNet | TFLITE | w8a8 | Snapdragon® 8 Elite Gen 5 Mobile | 15.312 ms | 32 - 283 MB | NPU
112
 
113
  ## License
114
  * The license for the original implementation of PSPNet can be found