Robotics
PyTorch
android
OverlapTransformer / README.md
qaihm-bot's picture
v0.67.0
5a950b3 verified
|
Raw History Blame Contribute Delete
12 kB
metadata
library_name: pytorch
license: gpl-3.0
tags:
  - android
pipeline_tag: robotics

OverlapTransformer: Optimized for Qualcomm Devices

OverlapTransformer is a lightweight LiDAR place-recognition network. It projects a point cloud into a spherical range image and produces a yaw-angle-invariant 256-d global descriptor for nearest-neighbor loop-closure retrieval.

This is based on the implementation of OverlapTransformer found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for OverlapTransformer on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.robotics

Model Stats:

  • Number of parameters: 19.4M
  • Model size (float): 74.2 MB
  • Model size (w8a8): 18.7 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
OverlapTransformer ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.239 ms 0 - 157 MB NPU
OverlapTransformer ONNX float Snapdragon® 8 Elite For Galaxy Mobile 3.688 ms 0 - 158 MB NPU
OverlapTransformer ONNX float Snapdragon® X2 Elite 3.064 ms 1 - 1 MB NPU
OverlapTransformer ONNX float Snapdragon® X Elite 5.588 ms 37 - 37 MB NPU
OverlapTransformer ONNX float Snapdragon® 8 Gen 1 Mobile 6.826 ms 0 - 183 MB NPU
OverlapTransformer ONNX float Qualcomm® Dragonwing™ IQ-8275 5.843 ms 0 - 4 MB NPU
OverlapTransformer ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.64 ms 0 - 47 MB NPU
OverlapTransformer ONNX float Qualcomm® QCS8450 6.826 ms 0 - 183 MB NPU
OverlapTransformer ONNX float Qualcomm® Dragonwing™ IQ-9075 6.138 ms 0 - 4 MB NPU
OverlapTransformer ONNX float Qualcomm® Dragonwing™ IQ-X7181 5.588 ms 37 - 37 MB NPU
OverlapTransformer ONNX float Qualcomm® Dragonwing™ Q-8750 3.688 ms 0 - 158 MB NPU
OverlapTransformer ONNX float Snapdragon® 8 Elite Extreme Gen 6 Mobile 1.955 ms 0 - 155 MB NPU
OverlapTransformer ONNX float Snapdragon® 8 Elite Gen 6 Mobile 3.338 ms 0 - 161 MB NPU
OverlapTransformer ONNX w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 2.299 ms 0 - 215 MB NPU
OverlapTransformer ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 2.758 ms 0 - 194 MB NPU
OverlapTransformer ONNX w8a8 Snapdragon® X2 Elite 2.286 ms 1 - 1 MB NPU
OverlapTransformer ONNX w8a8 Snapdragon® X Elite 5.558 ms 19 - 19 MB NPU
OverlapTransformer ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 6.007 ms 0 - 214 MB NPU
OverlapTransformer ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 729.833 ms 10 - 13 MB NPU
OverlapTransformer ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 4.648 ms 0 - 4 MB NPU
OverlapTransformer ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.362 ms 0 - 22 MB NPU
OverlapTransformer ONNX w8a8 Qualcomm® QCS8450 6.007 ms 0 - 214 MB NPU
OverlapTransformer ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 5.558 ms 19 - 19 MB NPU
OverlapTransformer ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 1217.457 ms 5 - 202 MB NPU
OverlapTransformer ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 234.789 ms 10 - 197 MB NPU
OverlapTransformer ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 2.758 ms 0 - 194 MB NPU
OverlapTransformer ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 234.789 ms 10 - 197 MB NPU
OverlapTransformer ONNX w8a8 Snapdragon® 8 Elite Extreme Gen 6 Mobile 1.898 ms 0 - 131 MB NPU
OverlapTransformer ONNX w8a8 Snapdragon® 8 Elite Gen 6 Mobile 2.804 ms 0 - 219 MB NPU
OverlapTransformer QNN_DLC float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.223 ms 0 - 158 MB NPU
OverlapTransformer QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 3.711 ms 0 - 156 MB NPU
OverlapTransformer QNN_DLC float Snapdragon® X2 Elite 3.434 ms 0 - 0 MB NPU
OverlapTransformer QNN_DLC float Snapdragon® X Elite 5.845 ms 0 - 0 MB NPU
OverlapTransformer QNN_DLC float Snapdragon® 8 Gen 1 Mobile 6.812 ms 0 - 183 MB NPU
OverlapTransformer QNN_DLC float Qualcomm® Dragonwing™ IQ-8275 5.852 ms 0 - 4 MB NPU
OverlapTransformer QNN_DLC float Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.626 ms 0 - 2 MB NPU
OverlapTransformer QNN_DLC float Qualcomm® QCS8450 6.812 ms 0 - 183 MB NPU
OverlapTransformer QNN_DLC float Qualcomm® Dragonwing™ IQ-9075 6.136 ms 0 - 3 MB NPU
OverlapTransformer QNN_DLC float Qualcomm® Dragonwing™ IQ-X7181 5.845 ms 0 - 0 MB NPU
OverlapTransformer QNN_DLC float Qualcomm® Dragonwing™ Q-8750 3.711 ms 0 - 156 MB NPU
OverlapTransformer QNN_DLC float Qualcomm® SA7255P 12.988 ms 0 - 156 MB NPU
OverlapTransformer QNN_DLC float Qualcomm® SA8295P 7.328 ms 0 - 161 MB NPU
OverlapTransformer QNN_DLC float Snapdragon® 8 Elite Extreme Gen 6 Mobile 1.957 ms 0 - 155 MB NPU
OverlapTransformer QNN_DLC float Snapdragon® 8 Elite Gen 6 Mobile 3.343 ms 0 - 157 MB NPU
OverlapTransformer QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 2.297 ms 0 - 212 MB NPU
OverlapTransformer QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 2.782 ms 0 - 188 MB NPU
OverlapTransformer QNN_DLC w8a8 Snapdragon® X2 Elite 2.573 ms 0 - 0 MB NPU
OverlapTransformer QNN_DLC w8a8 Snapdragon® X Elite 5.759 ms 0 - 0 MB NPU
OverlapTransformer QNN_DLC w8a8 Snapdragon® 8 Gen 1 Mobile 5.951 ms 0 - 210 MB NPU
OverlapTransformer QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-8275 4.651 ms 0 - 3 MB NPU
OverlapTransformer QNN_DLC w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.365 ms 0 - 2 MB NPU
OverlapTransformer QNN_DLC w8a8 Qualcomm® QCS8450 5.951 ms 0 - 210 MB NPU
OverlapTransformer QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-9075 5.445 ms 0 - 2 MB NPU
OverlapTransformer QNN_DLC w8a8 Qualcomm® Dragonwing™ IQ-X7181 5.759 ms 0 - 0 MB NPU
OverlapTransformer QNN_DLC w8a8 Qualcomm® Dragonwing™ Q-8750 2.782 ms 0 - 188 MB NPU
OverlapTransformer QNN_DLC w8a8 Qualcomm® SA7255P 9.778 ms 0 - 188 MB NPU
OverlapTransformer QNN_DLC w8a8 Qualcomm® SA8295P 6.623 ms 0 - 189 MB NPU
OverlapTransformer QNN_DLC w8a8 Snapdragon® 8 Elite Extreme Gen 6 Mobile 1.898 ms 0 - 128 MB NPU
OverlapTransformer QNN_DLC w8a8 Snapdragon® 8 Elite Gen 6 Mobile 2.798 ms 0 - 215 MB NPU
OverlapTransformer TFLITE float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 3.535 ms 0 - 161 MB NPU
OverlapTransformer TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 3.994 ms 0 - 164 MB NPU
OverlapTransformer TFLITE float Snapdragon® 8 Gen 1 Mobile 7.447 ms 0 - 190 MB NPU
OverlapTransformer TFLITE float Qualcomm® Dragonwing™ IQ-8275 6.387 ms 0 - 40 MB NPU
OverlapTransformer TFLITE float Qualcomm® Dragonwing™ QCS8550 (Proxy) 6.205 ms 0 - 3 MB NPU
OverlapTransformer TFLITE float Qualcomm® SA8775P 24.77 ms 0 - 26 MB GPU
OverlapTransformer TFLITE float Qualcomm® SA8650P 24.77 ms 0 - 26 MB GPU
OverlapTransformer TFLITE float Qualcomm® SA8255P 24.77 ms 0 - 26 MB GPU
OverlapTransformer TFLITE float Qualcomm® QCS8450 7.447 ms 0 - 190 MB NPU
OverlapTransformer TFLITE float Qualcomm® Dragonwing™ IQ-9075 6.782 ms 0 - 39 MB NPU
OverlapTransformer TFLITE float Qualcomm® Dragonwing™ Q-8750 3.994 ms 0 - 164 MB NPU
OverlapTransformer TFLITE float Qualcomm® SA8295P 8.184 ms 0 - 168 MB NPU
OverlapTransformer TFLITE float Snapdragon® 8 Elite Extreme Gen 6 Mobile 2.031 ms 0 - 159 MB NPU
OverlapTransformer TFLITE float Snapdragon® 8 Elite Gen 6 Mobile 3.69 ms 0 - 162 MB NPU
OverlapTransformer TFLITE w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 2.458 ms 0 - 208 MB NPU
OverlapTransformer TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 2.989 ms 0 - 186 MB NPU
OverlapTransformer TFLITE w8a8 Snapdragon® 8 Gen 1 Mobile 6.302 ms 0 - 220 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® Dragonwing™ QCS6490 734.971 ms 7 - 44 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® Dragonwing™ IQ-8275 5.006 ms 0 - 22 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 5.731 ms 0 - 2 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® SA8775P 23.206 ms 0 - 28 MB GPU
OverlapTransformer TFLITE w8a8 Qualcomm® SA8650P 23.206 ms 0 - 28 MB GPU
OverlapTransformer TFLITE w8a8 Qualcomm® SA8255P 23.206 ms 0 - 28 MB GPU
OverlapTransformer TFLITE w8a8 Qualcomm® QCS8450 6.302 ms 0 - 220 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® Dragonwing™ IQ-9075 5.838 ms 0 - 21 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® Dragonwing™ Q-6690 1254.272 ms 7 - 191 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® Dragonwing™ Q-7790 236.266 ms 7 - 181 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® Dragonwing™ Q-8750 2.989 ms 0 - 186 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® SA7255P 10.279 ms 0 - 194 MB NPU
OverlapTransformer TFLITE w8a8 Qualcomm® SA8295P 7.07 ms 0 - 198 MB NPU
OverlapTransformer TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 236.266 ms 7 - 181 MB NPU
OverlapTransformer TFLITE w8a8 Snapdragon® 8 Elite Extreme Gen 6 Mobile 1.935 ms 0 - 100 MB NPU
OverlapTransformer TFLITE w8a8 Snapdragon® 8 Elite Gen 6 Mobile 2.92 ms 0 - 201 MB NPU

License

  • The license for the original implementation of OverlapTransformer can be found here.

References

Community