InternImage: Optimized for Qualcomm Devices

InternImage employs DCNv3 as its core operator to equips the model with dynamic and effective receptive fields required for downstream tasks like object detection and segmentation, while enabling adaptive spatial aggregation.

This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

There are two ways to deploy this model on your device:

Option 1: Download Pre-Exported Models

Below are pre-exported model assets ready for deployment.

Runtime Precision Chipset SDK Versions Download
PRECOMPILED_QNN_ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX float Snapdragon® 8 Elite For Galaxy Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX float Snapdragon® X2 Elite QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX float Snapdragon® X Elite QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX float Snapdragon® 8 Gen 3 Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX float Snapdragon® 8 Gen 1 Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX float Qualcomm® Dragonwing™ IQ-8275 QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX float Qualcomm® Dragonwing™ IQ-9075 QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Snapdragon® X2 Elite QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Snapdragon® X Elite QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 8 Gen 3 Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 8 Gen 1 Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 QAIRT 2.50, ONNX Runtime 1.27.1 Download
PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 7 Gen 4 Mobile QAIRT 2.50, ONNX Runtime 1.27.1 Download
QNN_CONTEXT_BINARY float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Snapdragon® 8 Elite For Galaxy Mobile QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Snapdragon® X2 Elite QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Snapdragon® X Elite QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Snapdragon® 8 Gen 3 Mobile QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Snapdragon® 8 Gen 1 Mobile QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Qualcomm® Dragonwing™ IQ-8275 QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Qualcomm® Dragonwing™ QCS8550 (Proxy) QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Qualcomm® SA8775P QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Qualcomm® Dragonwing™ IQ-9075 QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Qualcomm® SA7255P QAIRT 2.50 Download
QNN_CONTEXT_BINARY float Qualcomm® SA8295P QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Snapdragon® 8 Elite For Galaxy Mobile QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Snapdragon® X2 Elite QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Snapdragon® X Elite QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Snapdragon® 8 Gen 3 Mobile QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Snapdragon® 8 Gen 1 Mobile QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ QCS6490 QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ IQ-8275 QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Qualcomm® SA8775P QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ Q-6690 QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ IQ-9075 QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Qualcomm® SA7255P QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Qualcomm® SA8295P QAIRT 2.50 Download
QNN_CONTEXT_BINARY w8a8 Snapdragon® 7 Gen 4 Mobile QAIRT 2.50 Download

For more device-specific assets and performance metrics, visit InternImage on Qualcomm® AI Hub.

Option 2: Export with Custom Configurations

Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

This option is ideal if you need to customize the model beyond the default configuration provided here.

See our repository for InternImage on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.image_classification

Model Stats:

  • Input resolution: 1x3x224x224
  • Model checkpoint: internimage_t_1k_224
  • Model size (float): 117 MB
  • Number of parameters: 30.6M

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
InternImage PRECOMPILED_QNN_ONNX float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 23.389 ms 1 - 8 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Snapdragon® 8 Elite For Galaxy Mobile 26.543 ms 1 - 12 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Snapdragon® X2 Elite 23.292 ms 2 - 2 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Snapdragon® X Elite 50.692 ms 70 - 70 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Snapdragon® 8 Gen 3 Mobile 34.271 ms 1 - 8 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Snapdragon® 8 Gen 1 Mobile 64.08 ms 1 - 15 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Qualcomm® Dragonwing™ IQ-8275 46.299 ms 0 - 5 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Qualcomm® Dragonwing™ QCS8550 (Proxy) 48.433 ms 0 - 81 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Qualcomm® QCS8450 64.08 ms 1 - 15 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Qualcomm® Dragonwing™ IQ-9075 50.909 ms 0 - 4 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Qualcomm® Dragonwing™ IQ-X7181 50.692 ms 70 - 70 MB NPU
InternImage PRECOMPILED_QNN_ONNX float Qualcomm® Dragonwing™ Q-8750 26.543 ms 1 - 12 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 13.843 ms 0 - 7 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 18.013 ms 0 - 11 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Snapdragon® X2 Elite 14.115 ms 1 - 1 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Snapdragon® X Elite 38.423 ms 40 - 40 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 25.627 ms 0 - 8 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 8 Gen 1 Mobile 39.991 ms 0 - 15 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ QCS6490 70.282 ms 0 - 3 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ IQ-8275 33.407 ms 0 - 4 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 36.367 ms 0 - 41 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® QCS8450 39.991 ms 0 - 15 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ IQ-9075 37.064 ms 0 - 3 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ IQ-X7181 38.423 ms 40 - 40 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ Q-6690 111.692 ms 2 - 9 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ Q-7790 36.5 ms 0 - 6 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Qualcomm® Dragonwing™ Q-8750 18.013 ms 0 - 11 MB NPU
InternImage PRECOMPILED_QNN_ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 36.5 ms 0 - 6 MB NPU
InternImage QNN_CONTEXT_BINARY float Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 23.377 ms 1 - 8 MB NPU
InternImage QNN_CONTEXT_BINARY float Snapdragon® 8 Elite For Galaxy Mobile 26.539 ms 1 - 13 MB NPU
InternImage QNN_CONTEXT_BINARY float Snapdragon® X2 Elite 23.544 ms 1 - 1 MB NPU
InternImage QNN_CONTEXT_BINARY float Snapdragon® X Elite 50.828 ms 1 - 1 MB NPU
InternImage QNN_CONTEXT_BINARY float Snapdragon® 8 Gen 3 Mobile 34.092 ms 1 - 8 MB NPU
InternImage QNN_CONTEXT_BINARY float Snapdragon® 8 Gen 1 Mobile 63.953 ms 0 - 10 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® Dragonwing™ IQ-8275 46.52 ms 1 - 4 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® Dragonwing™ QCS8550 (Proxy) 48.265 ms 1 - 2 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® SA8650P 51.171 ms 1 - 10 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® SA8255P 51.171 ms 1 - 10 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® QCS8450 63.953 ms 0 - 10 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® Dragonwing™ IQ-9075 50.907 ms 1 - 3 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® Dragonwing™ IQ-X7181 50.828 ms 1 - 1 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® Dragonwing™ Q-8750 26.539 ms 1 - 13 MB NPU
InternImage QNN_CONTEXT_BINARY float Qualcomm® SA8295P 55.242 ms 0 - 5 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Snapdragon® 8 Elite Gen 5 For Galaxy Mobile 13.765 ms 0 - 8 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Snapdragon® 8 Elite For Galaxy Mobile 17.99 ms 0 - 12 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Snapdragon® X2 Elite 14.446 ms 1 - 1 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Snapdragon® X Elite 38.5 ms 1 - 1 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Snapdragon® 8 Gen 3 Mobile 25.245 ms 1 - 8 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Snapdragon® 8 Gen 1 Mobile 39.756 ms 0 - 10 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ QCS6490 70.277 ms 0 - 3 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ IQ-8275 33.351 ms 0 - 3 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ QCS8550 (Proxy) 36.493 ms 1 - 2 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® SA8650P 44.467 ms 0 - 10 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® SA8255P 44.467 ms 0 - 10 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® QCS8450 39.756 ms 0 - 10 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ IQ-9075 37.024 ms 0 - 3 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ IQ-X7181 38.5 ms 1 - 1 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ Q-6690 111.542 ms 0 - 7 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ Q-7790 36.307 ms 0 - 7 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® Dragonwing™ Q-8750 17.99 ms 0 - 12 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Qualcomm® SA8295P 39.82 ms 0 - 5 MB NPU
InternImage QNN_CONTEXT_BINARY w8a8 Snapdragon® 7 Gen 4 Mobile 36.307 ms 0 - 7 MB NPU

License

  • The license for the original implementation of InternImage can be found here.

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support