Detectron2-Detection: Optimized for Qualcomm Devices

Detectron2-Detection is a machine learning model that can detect objects (trained on COCO dataset).

This is based on the implementation of Detectron2-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
ONNX float Universal QAIRT 2.42, ONNX Runtime 1.24.3 Download
ONNX w8a16 Universal QAIRT 2.42, ONNX Runtime 1.24.3 Download
ONNX w8a8 Universal QAIRT 2.42, ONNX Runtime 1.24.3 Download
QNN_DLC float Universal QAIRT 2.43 Download
QNN_DLC w8a16 Universal QAIRT 2.43 Download
QNN_DLC w8a8 Universal QAIRT 2.43 Download
TFLITE float Universal QAIRT 2.43, TFLite 2.19.1 Download
TFLITE w8a8 Universal QAIRT 2.43, TFLite 2.19.1 Download

For more device-specific assets and performance metrics, visit Detectron2-Detection on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for Detectron2-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: faster_rcnn_R_50_C4_1x
  • Input resolution: 800x800
  • Number of parameters: 33.8M
  • Model size (float): 129 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
proposal_generator ONNX float Snapdragon® 8 Elite Gen 5 Mobile 17.513 ms 33 - 491 MB NPU
proposal_generator ONNX float Snapdragon® X2 Elite 17.713 ms 65 - 65 MB NPU
proposal_generator ONNX float Snapdragon® X Elite 37.007 ms 66 - 66 MB NPU
proposal_generator ONNX float Snapdragon® 8 Gen 3 Mobile 27.796 ms 31 - 571 MB NPU
proposal_generator ONNX float Qualcomm® QCS8550 (Proxy) 37.624 ms 11 - 46 MB NPU
proposal_generator ONNX float Qualcomm® QCS9075 63.237 ms 7 - 17 MB NPU
proposal_generator ONNX float Snapdragon® 8 Elite For Galaxy Mobile 21.576 ms 25 - 470 MB NPU
proposal_generator ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 8.559 ms 18 - 519 MB NPU
proposal_generator ONNX w8a16 Snapdragon® X2 Elite 9.311 ms 35 - 35 MB NPU
proposal_generator ONNX w8a16 Snapdragon® X Elite 19.966 ms 33 - 33 MB NPU
proposal_generator ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 13.593 ms 17 - 562 MB NPU
proposal_generator ONNX w8a16 Qualcomm® QCS6490 3048.181 ms 187 - 204 MB CPU
proposal_generator ONNX w8a16 Qualcomm® QCS8550 (Proxy) 19.408 ms 0 - 25 MB NPU
proposal_generator ONNX w8a16 Qualcomm® QCS9075 27.333 ms 15 - 18 MB NPU
proposal_generator ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 10.402 ms 13 - 533 MB NPU
proposal_generator ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 1408.977 ms 190 - 198 MB CPU
proposal_generator ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 4.772 ms 0 - 422 MB NPU
proposal_generator ONNX w8a8 Snapdragon® X2 Elite 4.967 ms 19 - 19 MB NPU
proposal_generator ONNX w8a8 Snapdragon® X Elite 11.727 ms 19 - 19 MB NPU
proposal_generator ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 8.558 ms 10 - 483 MB NPU
proposal_generator ONNX w8a8 Qualcomm® QCS6490 442.203 ms 151 - 178 MB CPU
proposal_generator ONNX w8a8 Qualcomm® QCS8550 (Proxy) 12.11 ms 0 - 27 MB NPU
proposal_generator ONNX w8a8 Qualcomm® QCS9075 15.963 ms 8 - 11 MB NPU
proposal_generator ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 6.22 ms 5 - 428 MB NPU
proposal_generator ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 359.865 ms 130 - 138 MB CPU
proposal_generator QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 23.871 ms 1 - 474 MB NPU
proposal_generator QNN_DLC float Snapdragon® X2 Elite 23.918 ms 7 - 7 MB NPU
proposal_generator QNN_DLC float Snapdragon® X Elite 57.868 ms 7 - 7 MB NPU
proposal_generator QNN_DLC float Snapdragon® 8 Gen 3 Mobile 40.942 ms 7 - 566 MB NPU
proposal_generator QNN_DLC float Qualcomm® QCS8550 (Proxy) 57.384 ms 7 - 9 MB NPU
proposal_generator QNN_DLC float Qualcomm® SA8775P 70.821 ms 1 - 460 MB NPU
proposal_generator QNN_DLC float Qualcomm® QCS9075 84.492 ms 7 - 27 MB NPU
proposal_generator QNN_DLC float Qualcomm® QCS8450 (Proxy) 90.368 ms 7 - 501 MB NPU
proposal_generator QNN_DLC float Qualcomm® SA8295P 81.115 ms 0 - 424 MB NPU
proposal_generator QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 29.688 ms 0 - 468 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 23.153 ms 4 - 479 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® X2 Elite 24.906 ms 4 - 4 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® X Elite 45.282 ms 4 - 4 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 28.418 ms 4 - 598 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS6490 162.881 ms 4 - 14 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS8275 (Proxy) 83.185 ms 0 - 495 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 43.636 ms 4 - 6 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® SA8775P 43.856 ms 1 - 496 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS9075 77.844 ms 0 - 11 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCM6690 412.754 ms 6 - 563 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® QCS8450 (Proxy) 59.164 ms 4 - 579 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® SA7255P 83.185 ms 0 - 495 MB NPU
proposal_generator QNN_DLC w8a16 Qualcomm® SA8295P 59.583 ms 0 - 495 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 25.528 ms 4 - 430 MB NPU
proposal_generator QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 56.398 ms 4 - 507 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 21.223 ms 4 - 424 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® X2 Elite 21.679 ms 2 - 2 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® X Elite 40.407 ms 2 - 2 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 26.525 ms 2 - 498 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS6490 66.214 ms 1 - 7 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS8275 (Proxy) 70.179 ms 2 - 427 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 39.39 ms 2 - 5 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® SA8775P 39.502 ms 2 - 429 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS9075 45.002 ms 1 - 7 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCM6690 177.385 ms 2 - 418 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 46.654 ms 2 - 486 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® SA7255P 70.179 ms 2 - 427 MB NPU
proposal_generator QNN_DLC w8a8 Qualcomm® SA8295P 45.919 ms 2 - 429 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 22.848 ms 2 - 416 MB NPU
proposal_generator QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 29.893 ms 2 - 437 MB NPU
proposal_generator TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 17.758 ms 10 - 481 MB NPU
proposal_generator TFLITE float Snapdragon® 8 Gen 3 Mobile 30.318 ms 9 - 568 MB NPU
proposal_generator TFLITE float Qualcomm® SA8295P 62.246 ms 10 - 442 MB NPU
proposal_generator TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 24.028 ms 9 - 474 MB NPU
proposal_generator TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 7.264 ms 1 - 434 MB NPU
proposal_generator TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 12.114 ms 1 - 482 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® QCS8275 (Proxy) 30.343 ms 3 - 415 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 16.334 ms 3 - 6 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® SA8775P 17.177 ms 3 - 414 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® QCS9075 20.373 ms 1 - 30 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 20.789 ms 0 - 469 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® SA7255P 30.343 ms 3 - 415 MB NPU
proposal_generator TFLITE w8a8 Qualcomm® SA8295P 21.713 ms 3 - 415 MB NPU
proposal_generator TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 9.026 ms 1 - 421 MB NPU
proposal_generator TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 23.987 ms 2 - 443 MB NPU
roi_head ONNX float Snapdragon® 8 Elite Gen 5 Mobile 28.735 ms 10 - 1327 MB NPU
roi_head ONNX float Snapdragon® X2 Elite 31.436 ms 32 - 32 MB NPU
roi_head ONNX float Snapdragon® X Elite 67.946 ms 29 - 29 MB NPU
roi_head ONNX float Snapdragon® 8 Gen 3 Mobile 48.731 ms 10 - 1526 MB NPU
roi_head ONNX float Qualcomm® QCS8550 (Proxy) 65.221 ms 0 - 33 MB NPU
roi_head ONNX float Qualcomm® QCS9075 116.768 ms 10 - 22 MB NPU
roi_head ONNX float Snapdragon® 8 Elite For Galaxy Mobile 42.948 ms 0 - 1241 MB NPU
roi_head ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 15.688 ms 0 - 474 MB NPU
roi_head ONNX w8a16 Snapdragon® X2 Elite 17.224 ms 14 - 14 MB NPU
roi_head ONNX w8a16 Snapdragon® X Elite 34.229 ms 12 - 12 MB NPU
roi_head ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 24.759 ms 5 - 487 MB NPU
roi_head ONNX w8a16 Qualcomm® QCS6490 8742.415 ms 3030 - 3043 MB CPU
roi_head ONNX w8a16 Qualcomm® QCS8550 (Proxy) 33.89 ms 0 - 18 MB NPU
roi_head ONNX w8a16 Qualcomm® QCS9075 45.082 ms 5 - 8 MB NPU
roi_head ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 20.904 ms 0 - 465 MB NPU
roi_head ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 3797.191 ms 2951 - 2958 MB CPU
roi_head ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 8.122 ms 0 - 319 MB NPU
roi_head ONNX w8a8 Snapdragon® X2 Elite 8.81 ms 15 - 15 MB NPU
roi_head ONNX w8a8 Snapdragon® X Elite 19.197 ms 14 - 14 MB NPU
roi_head ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 13.661 ms 2 - 362 MB NPU
roi_head ONNX w8a8 Qualcomm® QCS6490 1739.926 ms 2531 - 2540 MB CPU
roi_head ONNX w8a8 Qualcomm® QCS8550 (Proxy) 18.587 ms 0 - 20 MB NPU
roi_head ONNX w8a8 Qualcomm® QCS9075 73.813 ms 2 - 5 MB NPU
roi_head ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 9.493 ms 0 - 322 MB NPU
roi_head ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 972.162 ms 2527 - 2534 MB CPU
roi_head QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 29.161 ms 10 - 1652 MB NPU
roi_head QNN_DLC float Snapdragon® X2 Elite 32.181 ms 10 - 10 MB NPU
roi_head QNN_DLC float Snapdragon® X Elite 64.438 ms 10 - 10 MB NPU
roi_head QNN_DLC float Snapdragon® 8 Gen 3 Mobile 48.279 ms 10 - 2299 MB NPU
roi_head QNN_DLC float Qualcomm® QCS8550 (Proxy) 64.541 ms 10 - 13 MB NPU
roi_head QNN_DLC float Qualcomm® SA8775P 96.709 ms 1 - 1564 MB NPU
roi_head QNN_DLC float Qualcomm® QCS9075 116.173 ms 10 - 21 MB NPU
roi_head QNN_DLC float Qualcomm® QCS8450 (Proxy) 115.872 ms 5 - 445 MB NPU
roi_head QNN_DLC float Qualcomm® SA8295P 88.551 ms 0 - 393 MB NPU
roi_head QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 42.833 ms 10 - 1574 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 13.888 ms 5 - 426 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® X2 Elite 16.093 ms 5 - 5 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® X Elite 33.456 ms 5 - 5 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 24.365 ms 5 - 437 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS6490 148.158 ms 1 - 7 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS8275 (Proxy) 98.913 ms 5 - 371 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 32.66 ms 5 - 7 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® SA8775P 32.62 ms 2 - 369 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS9075 44.511 ms 3 - 9 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCM6690 627.789 ms 5 - 578 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® QCS8450 (Proxy) 60.961 ms 5 - 433 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® SA7255P 98.913 ms 5 - 371 MB NPU
roi_head QNN_DLC w8a16 Qualcomm® SA8295P 51.4 ms 2 - 370 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 19.387 ms 5 - 425 MB NPU
roi_head QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 56.52 ms 5 - 464 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 8.15 ms 2 - 319 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® X2 Elite 9.399 ms 2 - 2 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® X Elite 19.17 ms 2 - 2 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 13.589 ms 2 - 358 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS6490 83.886 ms 1 - 5 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS8275 (Proxy) 51.739 ms 2 - 305 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 18.707 ms 3 - 158 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® SA8775P 18.785 ms 0 - 303 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS9075 78.598 ms 1 - 5 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCM6690 335.582 ms 2 - 401 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 38.834 ms 2 - 353 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® SA7255P 51.739 ms 2 - 305 MB NPU
roi_head QNN_DLC w8a8 Qualcomm® SA8295P 28.505 ms 0 - 303 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 9.895 ms 0 - 319 MB NPU
roi_head QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 31.027 ms 2 - 337 MB NPU
roi_head TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 1993.741 ms 0 - 2905 MB NPU
roi_head TFLITE float Snapdragon® 8 Gen 3 Mobile 2470.634 ms 0 - 3267 MB NPU
roi_head TFLITE float Qualcomm® SA8295P 1405.987 ms 0 - 1578 MB CPU
roi_head TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 2187.956 ms 0 - 2721 MB NPU
roi_head TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 167.788 ms 0 - 1511 MB NPU
roi_head TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 252.545 ms 0 - 1531 MB NPU
roi_head TFLITE w8a8 Qualcomm® QCS8275 (Proxy) 476.816 ms 0 - 1312 MB NPU
roi_head TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 345.304 ms 0 - 3 MB NPU
roi_head TFLITE w8a8 Qualcomm® SA8775P 345.962 ms 0 - 1312 MB NPU
roi_head TFLITE w8a8 Qualcomm® QCS9075 362.397 ms 0 - 33 MB NPU
roi_head TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 863.085 ms 3 - 862 MB NPU
roi_head TFLITE w8a8 Qualcomm® SA7255P 476.816 ms 0 - 1312 MB NPU
roi_head TFLITE w8a8 Qualcomm® SA8295P 364.212 ms 0 - 746 MB NPU
roi_head TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 188.389 ms 0 - 1331 MB NPU
roi_head TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 1830.363 ms 1119 - 2378 MB NPU

License

  • The license for the original implementation of Detectron2-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support