v0.46.1

See https://github.com/quic/ai-hub-models/releases/v0.46.1 for changelog.

README.md

@@ -9,252 +9,129 @@ pipeline_tag: other
 
 ![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/web-assets/model_demo.png)
 
-# GKT: Optimized for Mobile Deployment
-## Construct a bird’s eye view from sensors mounted on a vehicle
-
+# GKT: Optimized for Qualcomm Devices
 
 Geometry-guided Kernel Transformer is a machine learning model for generating a birds eye view represenation from the sensors(cameras) mounted on a vehicle.
 
-This model is an implementation of GKT found [here](https://github.com/hustvl/GKT/ https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf).
-
-
-This repository provides scripts to run GKT on Qualcomm® devices.
-More details on model performance across various devices, can be found
-[here](https://aihub.qualcomm.com/models/gkt).
-
-
-
-### Model Details
-
-- **Model Type:** Model_use_case.driver_assistance
-- **Model Stats:**
-  - Model checkpoint: map_segmentation_gkt_7x1_conv_setting2.ckpt
-  - Input resolution: 1 x 6 x 3 x 224 x 480
-  - Number of parameters: 1.18M
-  - Model size: 4.66 MB
-
-| Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
-|---|---|---|---|---|---|---|---|---|
-| GKT | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_CONTEXT_BINARY | 178.364 ms | 4 - 13 MB | NPU | Use Export Script |
-| GKT | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_CONTEXT_BINARY | 204.304 ms | 7 - 25 MB | NPU | Use Export Script |
-| GKT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_CONTEXT_BINARY | 105.774 ms | 8 - 10 MB | NPU | Use Export Script |
-| GKT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | PRECOMPILED_QNN_ONNX | 80.205 ms | 7 - 12 MB | NPU | Use Export Script |
-| GKT | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_CONTEXT_BINARY | 107.699 ms | 0 - 9 MB | NPU | Use Export Script |
-| GKT | float | SA7255P ADP | Qualcomm® SA7255P | QNN_CONTEXT_BINARY | 178.364 ms | 4 - 13 MB | NPU | Use Export Script |
-| GKT | float | SA8295P ADP | Qualcomm® SA8295P | QNN_CONTEXT_BINARY | 139.075 ms | 0 - 17 MB | NPU | Use Export Script |
-| GKT | float | SA8775P ADP | Qualcomm® SA8775P | QNN_CONTEXT_BINARY | 107.699 ms | 0 - 9 MB | NPU | Use Export Script |
-| GKT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_CONTEXT_BINARY | 76.659 ms | 8 - 28 MB | NPU | Use Export Script |
-| GKT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | PRECOMPILED_QNN_ONNX | 55.17 ms | 8 - 26 MB | NPU | Use Export Script |
-| GKT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_CONTEXT_BINARY | 67.44 ms | 7 - 20 MB | NPU | Use Export Script |
-| GKT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | PRECOMPILED_QNN_ONNX | 50.897 ms | 1 - 11 MB | NPU | Use Export Script |
-| GKT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen 5 Mobile | QNN_CONTEXT_BINARY | 56.469 ms | 7 - 18 MB | NPU | Use Export Script |
-| GKT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen 5 Mobile | PRECOMPILED_QNN_ONNX | 40.318 ms | 8 - 18 MB | NPU | Use Export Script |
-| GKT | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_CONTEXT_BINARY | 99.942 ms | 7 - 7 MB | NPU | Use Export Script |
-| GKT | float | Snapdragon X Elite CRD | Snapdragon® X Elite | PRECOMPILED_QNN_ONNX | 77.464 ms | 7 - 7 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_CONTEXT_BINARY | 192.276 ms | 4 - 13 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_CONTEXT_BINARY | 145.984 ms | 4 - 24 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_CONTEXT_BINARY | 130.987 ms | 4 - 6 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | PRECOMPILED_QNN_ONNX | 128.848 ms | 4 - 6 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_CONTEXT_BINARY | 130.062 ms | 1 - 11 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | SA7255P ADP | Qualcomm® SA7255P | QNN_CONTEXT_BINARY | 192.276 ms | 4 - 13 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | SA8295P ADP | Qualcomm® SA8295P | QNN_CONTEXT_BINARY | 153.875 ms | 0 - 17 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | SA8775P ADP | Qualcomm® SA8775P | QNN_CONTEXT_BINARY | 130.062 ms | 1 - 11 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_CONTEXT_BINARY | 93.949 ms | 4 - 22 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | PRECOMPILED_QNN_ONNX | 97.679 ms | 4 - 23 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_CONTEXT_BINARY | 82.23 ms | 4 - 20 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | PRECOMPILED_QNN_ONNX | 83.95 ms | 0 - 14 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen 5 Mobile | QNN_CONTEXT_BINARY | 74.446 ms | 4 - 15 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen 5 Mobile | PRECOMPILED_QNN_ONNX | 70.609 ms | 4 - 14 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_CONTEXT_BINARY | 130.182 ms | 4 - 4 MB | NPU | Use Export Script |
-| GKT | w8a16_mixed_fp16 | Snapdragon X Elite CRD | Snapdragon® X Elite | PRECOMPILED_QNN_ONNX | 129.483 ms | 7 - 7 MB | NPU | Use Export Script |
-
-
-
-
-## Installation
-
-
-Install the package via pip:
-```bash
-# NOTE: 3.10 <= PYTHON_VERSION < 3.14 is supported.
-pip install nuscenes-devkit==1.2.0 --no-deps
-pip install "qai-hub-models[gkt]"
-```
-
-
-## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device
-
-Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your
-Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`.
-
-With this API token, you can configure your client to run models on the cloud
-hosted devices.
-```bash
-qai-hub configure --api_token API_TOKEN
-```
-Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information.
-
-
-
-## Demo off target
-
-The package contains a simple end-to-end demo that downloads pre-trained
-weights and runs this model on a sample input.
-
-```bash
-python -m qai_hub_models.models.gkt.demo
-```
-
-The above demo runs a reference implementation of pre-processing, model
-inference, and post processing.
-
-**NOTE**: If you want running in a Jupyter Notebook or Google Colab like
-environment, please add the following to your cell (instead of the above).
-```
-%run -m qai_hub_models.models.gkt.demo
-```
-
-
-### Run model on a cloud-hosted device
-
-In addition to the demo, you can also run the model on a cloud-hosted Qualcomm®
-device. This script does the following:
-* Performance check on-device on a cloud-hosted device
-* Downloads compiled assets that can be deployed on-device for Android.
-* Accuracy check between PyTorch and on-device outputs.
-
-```bash
-python -m qai_hub_models.models.gkt.export
-```
-
-
-
-## How does this work?
-
-This [export script](https://aihub.qualcomm.com/models/gkt/qai_hub_models/models/GKT/export.py)
-leverages [Qualcomm® AI Hub](https://aihub.qualcomm.com/) to optimize, validate, and deploy this model
-on-device. Lets go through each step below in detail:
-
-Step 1: **Compile model for on-device deployment**
-
-To compile a PyTorch model for on-device deployment, we first trace the model
-in memory using the `jit.trace` and then call the `submit_compile_job` API.
-
-```python
-import torch
-
-import qai_hub as hub
-from qai_hub_models.models.gkt import Model
-
-# Load the model
-torch_model = Model.from_pretrained()
-
-# Device
-device = hub.Device("Samsung Galaxy S25")
-
-# Trace model
-input_shape = torch_model.get_input_spec()
-sample_inputs = torch_model.sample_inputs()
-
-pt_model = torch.jit.trace(torch_model, [torch.tensor(data[0]) for _, data in sample_inputs.items()])
-
-# Compile model on a specific device
-compile_job = hub.submit_compile_job(
-    model=pt_model,
-    device=device,
-    input_specs=torch_model.get_input_spec(),
-)
-
-# Get target model to run on-device
-target_model = compile_job.get_target_model()
-
-```
-
-
-Step 2: **Performance profiling on cloud-hosted device**
-
-After compiling models from step 1. Models can be profiled model on-device using the
-`target_model`. Note that this scripts runs the model on a device automatically
-provisioned in the cloud.  Once the job is submitted, you can navigate to a
-provided job URL to view a variety of on-device performance metrics.
-```python
-profile_job = hub.submit_profile_job(
-    model=target_model,
-    device=device,
-)
-        
-```
-
-Step 3: **Verify on-device accuracy**
-
-To verify the accuracy of the model on-device, you can run on-device inference
-on sample input data on the same cloud hosted device.
-```python
-input_data = torch_model.sample_inputs()
-inference_job = hub.submit_inference_job(
-    model=target_model,
-    device=device,
-    inputs=input_data,
-)
-    on_device_output = inference_job.download_output_data()
-
-```
-With the output of the model, you can compute like PSNR, relative errors or
-spot check the output with expected output.
-
-**Note**: This on-device profiling and inference requires access to Qualcomm®
-AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup).
-
-
-
-## Run demo on a cloud-hosted device
-
-You can also run the demo on-device.
-
-```bash
-python -m qai_hub_models.models.gkt.demo --eval-mode on-device
-```
-
-**NOTE**: If you want running in a Jupyter Notebook or Google Colab like
-environment, please add the following to your cell (instead of the above).
-```
-%run -m qai_hub_models.models.gkt.demo -- --eval-mode on-device
-```
-
-
-## Deploying compiled model to Android
-
-
-The models can be deployed using multiple runtimes:
-- TensorFlow Lite (`.tflite` export): [This
-  tutorial](https://www.tensorflow.org/lite/android/quickstart) provides a
-  guide to deploy the .tflite model in an Android application.
-
-
-- QNN (`.so` export ): This [sample
-  app](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/sample_app.html)
-provides instructions on how to use the `.so` shared library  in an Android application.
-
-
-## View on Qualcomm® AI Hub
-Get more details on GKT's performance across various devices [here](https://aihub.qualcomm.com/models/gkt).
-Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
-
+This is based on the implementation of GKT found [here](https://github.com/hustvl/GKT/ https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf).
+This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/gkt) library to export with custom configurations. More details on model performance across various devices, can be found [here](#performance-summary).
+
+Qualcomm AI Hub Models uses [Qualcomm AI Hub Workbench](https://workbench.aihub.qualcomm.com) to compile, profile, and evaluate this model. [Sign up](https://myaccount.qualcomm.com/signup) to run these models on a hosted Qualcomm® device.
+
+## Getting Started
+There are two ways to deploy this model on your device:
+
+### Option 1: Download Pre-Exported Models
+
+Below are pre-exported model assets ready for deployment.
+
+| Runtime | Precision | Chipset | SDK Versions | Download |
+|---|---|---|---|---|
+| PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-float-qualcomm_snapdragon_x_elite.zip)
+| PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-float-qualcomm_snapdragon_8gen3.zip)
+| PRECOMPILED_QNN_ONNX | float | Qualcomm® QCS8550 (Proxy) | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-float-qualcomm_qcs8550_proxy.zip)
+| PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
+| PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-float-qualcomm_snapdragon_8_elite_gen5.zip)
+| PRECOMPILED_QNN_ONNX | float | Qualcomm® QCS9075 | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-float-qualcomm_qcs9075.zip)
+| PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Snapdragon® X Elite | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-w8a16_mixed_fp16-qualcomm_snapdragon_x_elite.zip)
+| PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-w8a16_mixed_fp16-qualcomm_snapdragon_8gen3.zip)
+| PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-w8a16_mixed_fp16-qualcomm_qcs8550_proxy.zip)
+| PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-w8a16_mixed_fp16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
+| PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-w8a16_mixed_fp16-qualcomm_snapdragon_8_elite_gen5.zip)
+| PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Qualcomm® QCS9075 | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-precompiled_qnn_onnx-w8a16_mixed_fp16-qualcomm_qcs9075.zip)
+| QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_snapdragon_x_elite.zip)
+| QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_snapdragon_8gen3.zip)
+| QNN_CONTEXT_BINARY | float | Qualcomm® QCS8275 (Proxy) | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_qcs8275_proxy.zip)
+| QNN_CONTEXT_BINARY | float | Qualcomm® QCS8550 (Proxy) | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_qcs8550_proxy.zip)
+| QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_sa8775p.zip)
+| QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_snapdragon_8_elite_for_galaxy.zip)
+| QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_snapdragon_8_elite_gen5.zip)
+| QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_sa7255p.zip)
+| QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_sa8295p.zip)
+| QNN_CONTEXT_BINARY | float | Qualcomm® QCS9075 | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_qcs9075.zip)
+| QNN_CONTEXT_BINARY | float | Qualcomm® QCS8450 (Proxy) | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-float-qualcomm_qcs8450_proxy.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Snapdragon® X Elite | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_snapdragon_x_elite.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_snapdragon_8gen3.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® QCS8275 (Proxy) | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_qcs8275_proxy.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_qcs8550_proxy.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® SA8775P | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_sa8775p.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_snapdragon_8_elite_gen5.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® SA7255P | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_sa7255p.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® SA8295P | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_sa8295p.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® QCS9075 | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_qcs9075.zip)
+| QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® QCS8450 (Proxy) | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/releases/v0.46.1/gkt-qnn_context_binary-w8a16_mixed_fp16-qualcomm_qcs8450_proxy.zip)
+
+For more device-specific assets and performance metrics, visit **[GKT on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/gkt)**.
+
+
+### Option 2: Export with Custom Configurations
+
+Use the [Qualcomm® AI Hub Models](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/gkt) Python library to compile and export the model with your own:
+- Custom weights (e.g., fine-tuned checkpoints)
+- Custom input shapes
+- Target device and runtime configurations
+
+This option is ideal if you need to customize the model beyond the default configuration provided here.
+
+See our repository for [GKT on GitHub](https://github.com/quic/ai-hub-models/blob/main/qai_hub_models/models/gkt) for usage instructions.
+
+## Model Details
+
+**Model Type:** Model_use_case.driver_assistance
+
+**Model Stats:**
+- Model checkpoint: map_segmentation_gkt_7x1_conv_setting2.ckpt
+- Input resolution: 1 x 6 x 3 x 224 x 480
+- Number of parameters: 1.18M
+- Model size: 4.66 MB
+
+## Performance Summary
+| Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
+|---|---|---|---|---|---|---
+| GKT | PRECOMPILED_QNN_ONNX | float | Snapdragon® X Elite | 77.549 ms | 7 - 7 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Gen 3 Mobile | 56.522 ms | 8 - 15 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | float | Qualcomm® QCS8550 (Proxy) | 81.44 ms | 8 - 19 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | float | Qualcomm® QCS9075 | 83.044 ms | 7 - 10 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite For Galaxy Mobile | 51.556 ms | 2 - 10 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | float | Snapdragon® 8 Elite Gen 5 Mobile | 38.135 ms | 8 - 18 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Snapdragon® X Elite | 130.45 ms | 7 - 7 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Gen 3 Mobile | 95.525 ms | 6 - 14 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Qualcomm® QCS8550 (Proxy) | 129.902 ms | 1 - 10 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Qualcomm® QCS9075 | 132.041 ms | 4 - 6 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Elite For Galaxy Mobile | 83.007 ms | 0 - 12 MB | NPU
+| GKT | PRECOMPILED_QNN_ONNX | w8a16_mixed_fp16 | Snapdragon® 8 Elite Gen 5 Mobile | 71.133 ms | 4 - 15 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Snapdragon® X Elite | 105.686 ms | 7 - 7 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Gen 3 Mobile | 77.938 ms | 8 - 15 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Qualcomm® QCS8275 (Proxy) | 188.21 ms | 0 - 8 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Qualcomm® QCS8550 (Proxy) | 110.633 ms | 8 - 9 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Qualcomm® SA8775P | 110.755 ms | 0 - 6 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Qualcomm® QCS9075 | 109.963 ms | 7 - 17 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Qualcomm® QCS8450 (Proxy) | 204.587 ms | 8 - 16 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Qualcomm® SA7255P | 188.21 ms | 0 - 8 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Qualcomm® SA8295P | 140.428 ms | 0 - 6 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite For Galaxy Mobile | 71.057 ms | 0 - 9 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | float | Snapdragon® 8 Elite Gen 5 Mobile | 57.265 ms | 7 - 17 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Snapdragon® X Elite | 128.698 ms | 4 - 4 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Snapdragon® 8 Gen 3 Mobile | 94.5 ms | 4 - 11 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® QCS8275 (Proxy) | 192.408 ms | 1 - 8 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® QCS8550 (Proxy) | 127.219 ms | 5 - 6 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® SA8775P | 129.389 ms | 0 - 6 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® QCS9075 | 129.942 ms | 2 - 7 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® QCS8450 (Proxy) | 138.637 ms | 4 - 13 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® SA7255P | 192.408 ms | 1 - 8 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Qualcomm® SA8295P | 153.11 ms | 0 - 6 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Snapdragon® 8 Elite For Galaxy Mobile | 80.584 ms | 0 - 13 MB | NPU
+| GKT | QNN_CONTEXT_BINARY | w8a16_mixed_fp16 | Snapdragon® 8 Elite Gen 5 Mobile | 69.942 ms | 4 - 13 MB | NPU
 
 ## License
 * The license for the original implementation of GKT can be found
   [here](https://github.com/hustvl/GKT/blob/main/LICENSE).
 
-
-
 ## References
 * [Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformer](https://arxiv.org/abs/2206.04584)
 * [Source Model Implementation](https://github.com/hustvl/GKT/ https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
 
-
-
 ## Community
 * Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI.
 * For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com).
-
-

precompiled/qualcomm-qcs8275-proxy/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:a23264b2987532a0f8a5f6124c44acbb405535c93cca01b3de51a9bf6ce67bce
-size 8822784

precompiled/qualcomm-qcs8275-proxy/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:86dfc9c105d2655b4744520b2805daabc6b24441dab4ad9d644b56cd534637ab
-size 10567680

precompiled/qualcomm-qcs8275-proxy/tool-versions.yaml

@@ -1,3 +0,0 @@
-tool_versions:
-  qnn_context_binary:
-    qairt: 2.41.0.251128145156_191518-auto

precompiled/qualcomm-qcs8450-proxy/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:a6c7002c964f76d57599d6bde1335cfd77a9f34a5d7fce54ce4124e3cd67d04f
-size 11218944

precompiled/qualcomm-qcs8450-proxy/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:aa8cc124c23cd1b8e2431795ffbe8ed8d6e7d13facb7538d63225fb705d3067e
-size 11288576

precompiled/qualcomm-qcs8450-proxy/tool-versions.yaml

@@ -1,3 +0,0 @@
-tool_versions:
-  qnn_context_binary:
-    qairt: 2.41.0.251128145156_191518

precompiled/qualcomm-qcs8550-proxy/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:a7ea4beed9d28a74d5931075d75e953693a7835738e23f0589e6e8d77fd99256
-size 8835072

precompiled/qualcomm-qcs8550-proxy/GKT_float.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:4423431a40704893fdac27afdfed2a0ffceca31e4493496ae4348dd621391c34
-size 4331438

precompiled/qualcomm-qcs8550-proxy/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9b313d4f6daf9bf9d1de2031d984aad9853bbaf89c1839923bfb8baf3a57785e
-size 10567680

precompiled/qualcomm-qcs8550-proxy/GKT_w8a16_mixed_fp16.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:f6086b4995c563c3d9c4c873abcb3e86d483f03434f4b995ae31df627a0b2bc8
-size 4742431

precompiled/qualcomm-qcs8550-proxy/tool-versions.yaml

@@ -1,4 +0,0 @@
-tool_versions:
-  precompiled_qnn_onnx:
-    qairt: 2.37.1.250807093845_124904
-    onnx_runtime: 1.23.0

precompiled/qualcomm-qcs9075-proxy/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:ba0215705f8b6a70bd2794e5215fa97b2c7b83c8f03b6a4a01225565c3292362
-size 8843264

precompiled/qualcomm-qcs9075-proxy/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:7801a6ef1d010d84ab3ba1cee81731e09c1a8abb4a793a0da3c8ec53b77df1b4
-size 10567680

precompiled/qualcomm-qcs9075-proxy/tool-versions.yaml

@@ -1,3 +0,0 @@
-tool_versions:
-  qnn_context_binary:
-    qairt: 2.41.0.251128145156_191518-auto

precompiled/qualcomm-sa7255p/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:a23264b2987532a0f8a5f6124c44acbb405535c93cca01b3de51a9bf6ce67bce
-size 8822784

precompiled/qualcomm-sa7255p/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:86dfc9c105d2655b4744520b2805daabc6b24441dab4ad9d644b56cd534637ab
-size 10567680

precompiled/qualcomm-sa7255p/tool-versions.yaml

@@ -1,3 +0,0 @@
-tool_versions:
-  qnn_context_binary:
-    qairt: 2.41.0.251128145156_191518-auto

precompiled/qualcomm-sa8295p/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9adcd404f6921ce90b3568014a7fe0dc406ec98cc2b1d01caa9ca4a963845b73
-size 10940416

precompiled/qualcomm-sa8295p/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:c952e89aca30300a2fbe4f53017de1afb1984fbf4d50c509731eca5d495b393e
-size 11272192

precompiled/qualcomm-sa8295p/tool-versions.yaml

@@ -1,3 +0,0 @@
-tool_versions:
-  qnn_context_binary:
-    qairt: 2.41.0.251128145156_191518-auto

precompiled/qualcomm-sa8775p/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:ba0215705f8b6a70bd2794e5215fa97b2c7b83c8f03b6a4a01225565c3292362
-size 8843264

precompiled/qualcomm-sa8775p/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:7801a6ef1d010d84ab3ba1cee81731e09c1a8abb4a793a0da3c8ec53b77df1b4
-size 10567680

precompiled/qualcomm-sa8775p/tool-versions.yaml

@@ -1,3 +0,0 @@
-tool_versions:
-  qnn_context_binary:
-    qairt: 2.41.0.251128145156_191518-auto

precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:8608c1408ca54a89afaf8d334733c6b6c6e97e556336c195665e494908829e38
-size 8847360

precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_float.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:5a036708c5412752aeb0edf0daca95a5e7a3a85859e90e5deea860065d30377f
-size 4312150

precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:88210b7d1b6407c5a052a0db93b0980dbacaba838e8c11d9f4d26074bb1e6b74
-size 10489856

precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_w8a16_mixed_fp16.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9d40dc38632b9c2b2eca19e94d04909de7aea104755f93f9ead980d39e2053bb
-size 4673764

precompiled/qualcomm-snapdragon-8-elite-for-galaxy/tool-versions.yaml

@@ -1,4 +0,0 @@
-tool_versions:
-  precompiled_qnn_onnx:
-    qairt: 2.37.1.250807093845_124904
-    onnx_runtime: 1.23.0

precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:55b3fafcb1fc9a5c80bc1fcccf40f66e2d36bc9a3a69945e97b70af3c228adfe
-size 9072640

precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_float.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:0b5af48b5c64bebb60b594453fbf58f99836fc2e4cbb02c19512ed369bd06036
-size 4542113

precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:284b06819972a8147a76cbb613136c628c7197711dc6f1c575709297912a0ac3
-size 10776576

precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_w8a16_mixed_fp16.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:9339dcb42a89ac41e30ac667941c681ef9b2bd63d8ccc9b821cd045806ef7090
-size 4780048

precompiled/qualcomm-snapdragon-8-elite-gen5/tool-versions.yaml

@@ -1,4 +0,0 @@
-tool_versions:
-  precompiled_qnn_onnx:
-    qairt: 2.37.1.250807093845_124904
-    onnx_runtime: 1.23.0

precompiled/qualcomm-snapdragon-8gen3/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:57828124c057b9522b41e37d27bf050955caca05238aa6853a0ba7b270b10d1c
-size 8835072

precompiled/qualcomm-snapdragon-8gen3/GKT_float.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:a0ba5820875fbba89c7d7339cb8b21e3d7feb5483e90b206a5b43b99e538e0cf
-size 4326975

precompiled/qualcomm-snapdragon-8gen3/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:5d3696f1f90a1e8b6c560e63328dfa8585e08d5525b0311d98b46a3684a1e80a
-size 10567680

precompiled/qualcomm-snapdragon-8gen3/GKT_w8a16_mixed_fp16.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:57e862369a95364e6c6b52eef0e463307b204191c2643cf8761a3479307e3f00
-size 4742446

precompiled/qualcomm-snapdragon-8gen3/tool-versions.yaml

@@ -1,4 +0,0 @@
-tool_versions:
-  precompiled_qnn_onnx:
-    qairt: 2.37.1.250807093845_124904
-    onnx_runtime: 1.23.0

precompiled/qualcomm-snapdragon-x-elite/GKT_float.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:95b556e32207ae8e4dd7d4ff659f1c0bdbfd3fb50127fb63c7dbb63161f5a902
-size 8835072

precompiled/qualcomm-snapdragon-x-elite/GKT_float.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:91331b01f108629c61ed0eb1eae1bb6824c5a623b6409649fe0e54cdea7755ba
-size 4332971

precompiled/qualcomm-snapdragon-x-elite/GKT_w8a16_mixed_fp16.bin

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:dd637a6ec60c0ed8f02c57da9dfd297a886f246a4b7b7360251980061a62b3cb
-size 10567680

precompiled/qualcomm-snapdragon-x-elite/GKT_w8a16_mixed_fp16.onnx.zip

@@ -1,3 +0,0 @@
-version https://git-lfs.github.com/spec/v1
-oid sha256:8e7849d0954eedeb18be0de9552977a67f0f55466d984cd74b2b79edf278d4f3
-size 4742494

precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml

@@ -1,4 +0,0 @@
-tool_versions:
-  precompiled_qnn_onnx:
-    qairt: 2.37.1.250807093845_124904
-    onnx_runtime: 1.23.0