diff --git a/LICENSE b/LICENSE new file mode 100644 index 0000000000000000000000000000000000000000..24487ad65127153730bae6860c596efeb81de4ad --- /dev/null +++ b/LICENSE @@ -0,0 +1 @@ +The license of the original trained model can be found at https://github.com/hustvl/GKT/blob/main/LICENSE. diff --git a/README.md b/README.md new file mode 100644 index 0000000000000000000000000000000000000000..b675d2f51d47378fc38350aa5dd520bfd733ee4d --- /dev/null +++ b/README.md @@ -0,0 +1,264 @@ +--- +library_name: pytorch +license: other +tags: +- android +pipeline_tag: other + +--- + +![](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/gkt/web-assets/model_demo.png) + +# GKT: Optimized for Mobile Deployment +## Construct a bird’s eye view from sensors mounted on a vehicle + + +Geometry-guided Kernel Transformer is a machine learning model for generating a birds eye view represenation from the sensors(cameras) mounted on a vehicle. + +This model is an implementation of GKT found [here](https://github.com/hustvl/GKT/ https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf). + + +This repository provides scripts to run GKT on Qualcomm® devices. +More details on model performance across various devices, can be found +[here](https://aihub.qualcomm.com/models/gkt). + + + +### Model Details + +- **Model Type:** Model_use_case.driver_assistance +- **Model Stats:** + - Model checkpoint: map_segmentation_gkt_7x1_conv_setting2.ckpt + - Input resolution: 1 x 6 x 3 x 224 x 480 + - Number of parameters: 1.18M + - Model size: 4.66 MB + +| Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model +|---|---|---|---|---|---|---|---|---| +| GKT | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_CONTEXT_BINARY | 178.364 ms | 4 - 13 MB | NPU | Use Export Script | +| GKT | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_CONTEXT_BINARY | 204.304 ms | 7 - 25 MB | NPU | Use Export Script | +| GKT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_CONTEXT_BINARY | 105.774 ms | 8 - 10 MB | NPU | Use Export Script | +| GKT | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | PRECOMPILED_QNN_ONNX | 80.205 ms | 7 - 12 MB | NPU | Use Export Script | +| GKT | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_CONTEXT_BINARY | 107.699 ms | 0 - 9 MB | NPU | Use Export Script | +| GKT | float | SA7255P ADP | Qualcomm® SA7255P | QNN_CONTEXT_BINARY | 178.364 ms | 4 - 13 MB | NPU | Use Export Script | +| GKT | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_CONTEXT_BINARY | 106.111 ms | 8 - 10 MB | NPU | Use Export Script | +| GKT | float | SA8295P ADP | Qualcomm® SA8295P | QNN_CONTEXT_BINARY | 139.075 ms | 0 - 17 MB | NPU | Use Export Script | +| GKT | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_CONTEXT_BINARY | 105.282 ms | 8 - 10 MB | NPU | Use Export Script | +| GKT | float | SA8775P ADP | Qualcomm® SA8775P | QNN_CONTEXT_BINARY | 107.699 ms | 0 - 9 MB | NPU | Use Export Script | +| GKT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_CONTEXT_BINARY | 76.659 ms | 8 - 28 MB | NPU | Use Export Script | +| GKT | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | PRECOMPILED_QNN_ONNX | 55.17 ms | 8 - 26 MB | NPU | Use Export Script | +| GKT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_CONTEXT_BINARY | 67.44 ms | 7 - 20 MB | NPU | Use Export Script | +| GKT | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | PRECOMPILED_QNN_ONNX | 50.897 ms | 1 - 11 MB | NPU | Use Export Script | +| GKT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_CONTEXT_BINARY | 56.469 ms | 7 - 18 MB | NPU | Use Export Script | +| GKT | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | PRECOMPILED_QNN_ONNX | 40.318 ms | 8 - 18 MB | NPU | Use Export Script | +| GKT | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_CONTEXT_BINARY | 99.942 ms | 7 - 7 MB | NPU | Use Export Script | +| GKT | float | Snapdragon X Elite CRD | Snapdragon® X Elite | PRECOMPILED_QNN_ONNX | 77.464 ms | 7 - 7 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_CONTEXT_BINARY | 192.276 ms | 4 - 13 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_CONTEXT_BINARY | 145.984 ms | 4 - 24 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_CONTEXT_BINARY | 130.987 ms | 4 - 6 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | PRECOMPILED_QNN_ONNX | 128.848 ms | 4 - 6 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_CONTEXT_BINARY | 130.062 ms | 1 - 11 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | SA7255P ADP | Qualcomm® SA7255P | QNN_CONTEXT_BINARY | 192.276 ms | 4 - 13 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_CONTEXT_BINARY | 129.938 ms | 4 - 6 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | SA8295P ADP | Qualcomm® SA8295P | QNN_CONTEXT_BINARY | 153.875 ms | 0 - 17 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_CONTEXT_BINARY | 130.476 ms | 4 - 7 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | SA8775P ADP | Qualcomm® SA8775P | QNN_CONTEXT_BINARY | 130.062 ms | 1 - 11 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_CONTEXT_BINARY | 93.949 ms | 4 - 22 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | PRECOMPILED_QNN_ONNX | 97.679 ms | 4 - 23 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_CONTEXT_BINARY | 82.23 ms | 4 - 20 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | PRECOMPILED_QNN_ONNX | 83.95 ms | 0 - 14 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_CONTEXT_BINARY | 74.446 ms | 4 - 15 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | PRECOMPILED_QNN_ONNX | 70.609 ms | 4 - 14 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_CONTEXT_BINARY | 130.182 ms | 4 - 4 MB | NPU | Use Export Script | +| GKT | w8a16_mixed_fp16 | Snapdragon X Elite CRD | Snapdragon® X Elite | PRECOMPILED_QNN_ONNX | 129.483 ms | 7 - 7 MB | NPU | Use Export Script | + + + + +## Installation + + +Install the package via pip: +```bash +# NOTE: 3.10 <= PYTHON_VERSION < 3.14 is supported. +pip install nuscenes-devkit==1.2.0 --no-deps +pip install "qai-hub-models[gkt]" +``` + + +## Configure Qualcomm® AI Hub Workbench to run this model on a cloud-hosted device + +Sign-in to [Qualcomm® AI Hub Workbench](https://workbench.aihub.qualcomm.com/) with your +Qualcomm® ID. Once signed in navigate to `Account -> Settings -> API Token`. + +With this API token, you can configure your client to run models on the cloud +hosted devices. +```bash +qai-hub configure --api_token API_TOKEN +``` +Navigate to [docs](https://workbench.aihub.qualcomm.com/docs/) for more information. + + + +## Demo off target + +The package contains a simple end-to-end demo that downloads pre-trained +weights and runs this model on a sample input. + +```bash +python -m qai_hub_models.models.gkt.demo +``` + +The above demo runs a reference implementation of pre-processing, model +inference, and post processing. + +**NOTE**: If you want running in a Jupyter Notebook or Google Colab like +environment, please add the following to your cell (instead of the above). +``` +%run -m qai_hub_models.models.gkt.demo +``` + + +### Run model on a cloud-hosted device + +In addition to the demo, you can also run the model on a cloud-hosted Qualcomm® +device. This script does the following: +* Performance check on-device on a cloud-hosted device +* Downloads compiled assets that can be deployed on-device for Android. +* Accuracy check between PyTorch and on-device outputs. + +```bash +python -m qai_hub_models.models.gkt.export +``` + + + +## How does this work? + +This [export script](https://aihub.qualcomm.com/models/gkt/qai_hub_models/models/GKT/export.py) +leverages [Qualcomm® AI Hub](https://aihub.qualcomm.com/) to optimize, validate, and deploy this model +on-device. Lets go through each step below in detail: + +Step 1: **Compile model for on-device deployment** + +To compile a PyTorch model for on-device deployment, we first trace the model +in memory using the `jit.trace` and then call the `submit_compile_job` API. + +```python +import torch + +import qai_hub as hub +from qai_hub_models.models.gkt import Model + +# Load the model +torch_model = Model.from_pretrained() + +# Device +device = hub.Device("Samsung Galaxy S25") + +# Trace model +input_shape = torch_model.get_input_spec() +sample_inputs = torch_model.sample_inputs() + +pt_model = torch.jit.trace(torch_model, [torch.tensor(data[0]) for _, data in sample_inputs.items()]) + +# Compile model on a specific device +compile_job = hub.submit_compile_job( + model=pt_model, + device=device, + input_specs=torch_model.get_input_spec(), +) + +# Get target model to run on-device +target_model = compile_job.get_target_model() + +``` + + +Step 2: **Performance profiling on cloud-hosted device** + +After compiling models from step 1. Models can be profiled model on-device using the +`target_model`. Note that this scripts runs the model on a device automatically +provisioned in the cloud. Once the job is submitted, you can navigate to a +provided job URL to view a variety of on-device performance metrics. +```python +profile_job = hub.submit_profile_job( + model=target_model, + device=device, +) + +``` + +Step 3: **Verify on-device accuracy** + +To verify the accuracy of the model on-device, you can run on-device inference +on sample input data on the same cloud hosted device. +```python +input_data = torch_model.sample_inputs() +inference_job = hub.submit_inference_job( + model=target_model, + device=device, + inputs=input_data, +) + on_device_output = inference_job.download_output_data() + +``` +With the output of the model, you can compute like PSNR, relative errors or +spot check the output with expected output. + +**Note**: This on-device profiling and inference requires access to Qualcomm® +AI Hub Workbench. [Sign up for access](https://myaccount.qualcomm.com/signup). + + + +## Run demo on a cloud-hosted device + +You can also run the demo on-device. + +```bash +python -m qai_hub_models.models.gkt.demo --eval-mode on-device +``` + +**NOTE**: If you want running in a Jupyter Notebook or Google Colab like +environment, please add the following to your cell (instead of the above). +``` +%run -m qai_hub_models.models.gkt.demo -- --eval-mode on-device +``` + + +## Deploying compiled model to Android + + +The models can be deployed using multiple runtimes: +- TensorFlow Lite (`.tflite` export): [This + tutorial](https://www.tensorflow.org/lite/android/quickstart) provides a + guide to deploy the .tflite model in an Android application. + + +- QNN (`.so` export ): This [sample + app](https://docs.qualcomm.com/bundle/publicresource/topics/80-63442-50/sample_app.html) +provides instructions on how to use the `.so` shared library in an Android application. + + +## View on Qualcomm® AI Hub +Get more details on GKT's performance across various devices [here](https://aihub.qualcomm.com/models/gkt). +Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/) + + +## License +* The license for the original implementation of GKT can be found + [here](https://github.com/hustvl/GKT/blob/main/LICENSE). + + + +## References +* [Efficient and Robust 2D-to-BEV Representation Learning via Geometry-guided Kernel Transformer](https://arxiv.org/abs/2206.04584) +* [Source Model Implementation](https://github.com/hustvl/GKT/ https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf) + + + +## Community +* Join [our AI Hub Slack community](https://aihub.qualcomm.com/community/slack) to collaborate, post questions and learn more about on-device AI. +* For questions or feedback please [reach out to us](mailto:ai-hub-support@qti.qualcomm.com). + + diff --git a/precompiled/qualcomm-qcs8275-proxy/GKT_float.bin b/precompiled/qualcomm-qcs8275-proxy/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..a9e3abc8f31dab92e6d74290fd7814b1526d41bc --- /dev/null +++ b/precompiled/qualcomm-qcs8275-proxy/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a23264b2987532a0f8a5f6124c44acbb405535c93cca01b3de51a9bf6ce67bce +size 8822784 diff --git a/precompiled/qualcomm-qcs8275-proxy/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-qcs8275-proxy/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..0b4ff250efbfed3dc658f8f378d7cd49a3891677 --- /dev/null +++ b/precompiled/qualcomm-qcs8275-proxy/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:86dfc9c105d2655b4744520b2805daabc6b24441dab4ad9d644b56cd534637ab +size 10567680 diff --git a/precompiled/qualcomm-qcs8275-proxy/tool-versions.yaml b/precompiled/qualcomm-qcs8275-proxy/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..e47c5de04aa0a4337b0bdc894a0beb3da86b57c6 --- /dev/null +++ b/precompiled/qualcomm-qcs8275-proxy/tool-versions.yaml @@ -0,0 +1,3 @@ +tool_versions: + qnn_context_binary: + qairt: 2.41.0.251128145156_191518-auto diff --git a/precompiled/qualcomm-qcs8450-proxy/GKT_float.bin b/precompiled/qualcomm-qcs8450-proxy/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..94830792c15735ec9a811013565c7eadff6dc1f5 --- /dev/null +++ b/precompiled/qualcomm-qcs8450-proxy/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a6c7002c964f76d57599d6bde1335cfd77a9f34a5d7fce54ce4124e3cd67d04f +size 11218944 diff --git a/precompiled/qualcomm-qcs8450-proxy/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-qcs8450-proxy/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..00a4930eada6be39d0f42029fd187342313b382a --- /dev/null +++ b/precompiled/qualcomm-qcs8450-proxy/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:aa8cc124c23cd1b8e2431795ffbe8ed8d6e7d13facb7538d63225fb705d3067e +size 11288576 diff --git a/precompiled/qualcomm-qcs8450-proxy/tool-versions.yaml b/precompiled/qualcomm-qcs8450-proxy/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..24628b680cbadb36fea7576eefde7ca39cedf3d5 --- /dev/null +++ b/precompiled/qualcomm-qcs8450-proxy/tool-versions.yaml @@ -0,0 +1,3 @@ +tool_versions: + qnn_context_binary: + qairt: 2.41.0.251128145156_191518 diff --git a/precompiled/qualcomm-qcs8550-proxy/GKT_float.bin b/precompiled/qualcomm-qcs8550-proxy/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..bfbce2f0f6677bc1cc0520a8f802c6804634a13f --- /dev/null +++ b/precompiled/qualcomm-qcs8550-proxy/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a7ea4beed9d28a74d5931075d75e953693a7835738e23f0589e6e8d77fd99256 +size 8835072 diff --git a/precompiled/qualcomm-qcs8550-proxy/GKT_float.onnx.zip b/precompiled/qualcomm-qcs8550-proxy/GKT_float.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..43ee84f9085f9170369324720d2876ce88de57ed --- /dev/null +++ b/precompiled/qualcomm-qcs8550-proxy/GKT_float.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4423431a40704893fdac27afdfed2a0ffceca31e4493496ae4348dd621391c34 +size 4331438 diff --git a/precompiled/qualcomm-qcs8550-proxy/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-qcs8550-proxy/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..fde14d99ca5a2e8cdb25da7593c0ab742841b5e6 --- /dev/null +++ b/precompiled/qualcomm-qcs8550-proxy/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9b313d4f6daf9bf9d1de2031d984aad9853bbaf89c1839923bfb8baf3a57785e +size 10567680 diff --git a/precompiled/qualcomm-qcs8550-proxy/GKT_w8a16_mixed_fp16.onnx.zip b/precompiled/qualcomm-qcs8550-proxy/GKT_w8a16_mixed_fp16.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..2d65b5ba37ee447daf84557cf084c8e2f63523fb --- /dev/null +++ b/precompiled/qualcomm-qcs8550-proxy/GKT_w8a16_mixed_fp16.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:f6086b4995c563c3d9c4c873abcb3e86d483f03434f4b995ae31df627a0b2bc8 +size 4742431 diff --git a/precompiled/qualcomm-qcs8550-proxy/tool-versions.yaml b/precompiled/qualcomm-qcs8550-proxy/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..2651df2a5778b3f91e7ee070551106ab67282c06 --- /dev/null +++ b/precompiled/qualcomm-qcs8550-proxy/tool-versions.yaml @@ -0,0 +1,4 @@ +tool_versions: + precompiled_qnn_onnx: + qairt: 2.37.1.250807093845_124904 + onnx_runtime: 1.23.0 diff --git a/precompiled/qualcomm-qcs9075-proxy/GKT_float.bin b/precompiled/qualcomm-qcs9075-proxy/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..a59aed43b23d53ec86753d3faeef895233216dfd --- /dev/null +++ b/precompiled/qualcomm-qcs9075-proxy/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ba0215705f8b6a70bd2794e5215fa97b2c7b83c8f03b6a4a01225565c3292362 +size 8843264 diff --git a/precompiled/qualcomm-qcs9075-proxy/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-qcs9075-proxy/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..06e4c1a86c83f7c2c32fa68d99d84e27c60f3fc9 --- /dev/null +++ b/precompiled/qualcomm-qcs9075-proxy/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7801a6ef1d010d84ab3ba1cee81731e09c1a8abb4a793a0da3c8ec53b77df1b4 +size 10567680 diff --git a/precompiled/qualcomm-qcs9075-proxy/tool-versions.yaml b/precompiled/qualcomm-qcs9075-proxy/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..e47c5de04aa0a4337b0bdc894a0beb3da86b57c6 --- /dev/null +++ b/precompiled/qualcomm-qcs9075-proxy/tool-versions.yaml @@ -0,0 +1,3 @@ +tool_versions: + qnn_context_binary: + qairt: 2.41.0.251128145156_191518-auto diff --git a/precompiled/qualcomm-sa7255p/GKT_float.bin b/precompiled/qualcomm-sa7255p/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..a9e3abc8f31dab92e6d74290fd7814b1526d41bc --- /dev/null +++ b/precompiled/qualcomm-sa7255p/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a23264b2987532a0f8a5f6124c44acbb405535c93cca01b3de51a9bf6ce67bce +size 8822784 diff --git a/precompiled/qualcomm-sa7255p/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-sa7255p/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..0b4ff250efbfed3dc658f8f378d7cd49a3891677 --- /dev/null +++ b/precompiled/qualcomm-sa7255p/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:86dfc9c105d2655b4744520b2805daabc6b24441dab4ad9d644b56cd534637ab +size 10567680 diff --git a/precompiled/qualcomm-sa7255p/tool-versions.yaml b/precompiled/qualcomm-sa7255p/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..e47c5de04aa0a4337b0bdc894a0beb3da86b57c6 --- /dev/null +++ b/precompiled/qualcomm-sa7255p/tool-versions.yaml @@ -0,0 +1,3 @@ +tool_versions: + qnn_context_binary: + qairt: 2.41.0.251128145156_191518-auto diff --git a/precompiled/qualcomm-sa8255p-proxy/GKT_float.bin b/precompiled/qualcomm-sa8255p-proxy/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..2db15998586623186d79c8d637e67588f39d2d27 --- /dev/null +++ b/precompiled/qualcomm-sa8255p-proxy/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:4aa6ce7708ae13f733084495ecc53f818725e22d546f51d3e3f5c14255685838 +size 8835072 diff --git a/precompiled/qualcomm-sa8255p-proxy/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-sa8255p-proxy/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..12c2e7844ad1e6145dc632d935614d66fefda4ff --- /dev/null +++ b/precompiled/qualcomm-sa8255p-proxy/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:1b34e66eac0822ebd4eda20182eb51073c3218fa9568fabad18539991409e25a +size 10567680 diff --git a/precompiled/qualcomm-sa8255p-proxy/tool-versions.yaml b/precompiled/qualcomm-sa8255p-proxy/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..24628b680cbadb36fea7576eefde7ca39cedf3d5 --- /dev/null +++ b/precompiled/qualcomm-sa8255p-proxy/tool-versions.yaml @@ -0,0 +1,3 @@ +tool_versions: + qnn_context_binary: + qairt: 2.41.0.251128145156_191518 diff --git a/precompiled/qualcomm-sa8295p/GKT_float.bin b/precompiled/qualcomm-sa8295p/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..cac795a8c355044cdf0338071299a694c4df9883 --- /dev/null +++ b/precompiled/qualcomm-sa8295p/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9adcd404f6921ce90b3568014a7fe0dc406ec98cc2b1d01caa9ca4a963845b73 +size 10940416 diff --git a/precompiled/qualcomm-sa8295p/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-sa8295p/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..46cb4da5f7c6ee7b233b07fd5de7b9f7d9ee2307 --- /dev/null +++ b/precompiled/qualcomm-sa8295p/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:c952e89aca30300a2fbe4f53017de1afb1984fbf4d50c509731eca5d495b393e +size 11272192 diff --git a/precompiled/qualcomm-sa8295p/tool-versions.yaml b/precompiled/qualcomm-sa8295p/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..e47c5de04aa0a4337b0bdc894a0beb3da86b57c6 --- /dev/null +++ b/precompiled/qualcomm-sa8295p/tool-versions.yaml @@ -0,0 +1,3 @@ +tool_versions: + qnn_context_binary: + qairt: 2.41.0.251128145156_191518-auto diff --git a/precompiled/qualcomm-sa8650p-proxy/GKT_float.bin b/precompiled/qualcomm-sa8650p-proxy/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..5a8bf2eb4e48dd757ce82a004cf7344b8ef9b80f --- /dev/null +++ b/precompiled/qualcomm-sa8650p-proxy/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3a40e0a6e29ad7866a3b320382b88314c2a79efa2a8659d3842d76e71f9bcd36 +size 8835072 diff --git a/precompiled/qualcomm-sa8650p-proxy/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-sa8650p-proxy/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..0e66fb8392b770f7d9c114180b229d9fb6a6af75 --- /dev/null +++ b/precompiled/qualcomm-sa8650p-proxy/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:e6538a06aceff771213b90e6686b511de881e56140ddad27397e67fc2e325555 +size 10567680 diff --git a/precompiled/qualcomm-sa8650p-proxy/tool-versions.yaml b/precompiled/qualcomm-sa8650p-proxy/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..24628b680cbadb36fea7576eefde7ca39cedf3d5 --- /dev/null +++ b/precompiled/qualcomm-sa8650p-proxy/tool-versions.yaml @@ -0,0 +1,3 @@ +tool_versions: + qnn_context_binary: + qairt: 2.41.0.251128145156_191518 diff --git a/precompiled/qualcomm-sa8775p/GKT_float.bin b/precompiled/qualcomm-sa8775p/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..a59aed43b23d53ec86753d3faeef895233216dfd --- /dev/null +++ b/precompiled/qualcomm-sa8775p/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ba0215705f8b6a70bd2794e5215fa97b2c7b83c8f03b6a4a01225565c3292362 +size 8843264 diff --git a/precompiled/qualcomm-sa8775p/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-sa8775p/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..06e4c1a86c83f7c2c32fa68d99d84e27c60f3fc9 --- /dev/null +++ b/precompiled/qualcomm-sa8775p/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7801a6ef1d010d84ab3ba1cee81731e09c1a8abb4a793a0da3c8ec53b77df1b4 +size 10567680 diff --git a/precompiled/qualcomm-sa8775p/tool-versions.yaml b/precompiled/qualcomm-sa8775p/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..e47c5de04aa0a4337b0bdc894a0beb3da86b57c6 --- /dev/null +++ b/precompiled/qualcomm-sa8775p/tool-versions.yaml @@ -0,0 +1,3 @@ +tool_versions: + qnn_context_binary: + qairt: 2.41.0.251128145156_191518-auto diff --git a/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_float.bin b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..f418d1eb90a4bcc679b18ce7a2aa1b4b9472c20a --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8608c1408ca54a89afaf8d334733c6b6c6e97e556336c195665e494908829e38 +size 8847360 diff --git a/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_float.onnx.zip b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_float.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..9e28143993af5a905af910cabfeef4db4a0a1b2e --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_float.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5a036708c5412752aeb0edf0daca95a5e7a3a85859e90e5deea860065d30377f +size 4312150 diff --git a/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..1f08d08aa1978c6f7e495f28faa8f228cab5720b --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:88210b7d1b6407c5a052a0db93b0980dbacaba838e8c11d9f4d26074bb1e6b74 +size 10489856 diff --git a/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_w8a16_mixed_fp16.onnx.zip b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_w8a16_mixed_fp16.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..48cb3f08f4d8edef43cac23bc435899679b701fc --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/GKT_w8a16_mixed_fp16.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9d40dc38632b9c2b2eca19e94d04909de7aea104755f93f9ead980d39e2053bb +size 4673764 diff --git a/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/tool-versions.yaml b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..2651df2a5778b3f91e7ee070551106ab67282c06 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-for-galaxy/tool-versions.yaml @@ -0,0 +1,4 @@ +tool_versions: + precompiled_qnn_onnx: + qairt: 2.37.1.250807093845_124904 + onnx_runtime: 1.23.0 diff --git a/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_float.bin b/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..c9b03ff469d313eb73b9b206b63719a5dee9a951 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:55b3fafcb1fc9a5c80bc1fcccf40f66e2d36bc9a3a69945e97b70af3c228adfe +size 9072640 diff --git a/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_float.onnx.zip b/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_float.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..0398514e55e577df3b65f7eb99939be6ff5e086a --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_float.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0b5af48b5c64bebb60b594453fbf58f99836fc2e4cbb02c19512ed369bd06036 +size 4542113 diff --git a/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..c4e25bf3c5f8ea6c9c270570f365fd3a93c122c5 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:284b06819972a8147a76cbb613136c628c7197711dc6f1c575709297912a0ac3 +size 10776576 diff --git a/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_w8a16_mixed_fp16.onnx.zip b/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_w8a16_mixed_fp16.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..87c60d4e0f88b5d563dc0d9836f57d5cc94d83e6 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-gen5/GKT_w8a16_mixed_fp16.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9339dcb42a89ac41e30ac667941c681ef9b2bd63d8ccc9b821cd045806ef7090 +size 4780048 diff --git a/precompiled/qualcomm-snapdragon-8-elite-gen5/tool-versions.yaml b/precompiled/qualcomm-snapdragon-8-elite-gen5/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..2651df2a5778b3f91e7ee070551106ab67282c06 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8-elite-gen5/tool-versions.yaml @@ -0,0 +1,4 @@ +tool_versions: + precompiled_qnn_onnx: + qairt: 2.37.1.250807093845_124904 + onnx_runtime: 1.23.0 diff --git a/precompiled/qualcomm-snapdragon-8gen3/GKT_float.bin b/precompiled/qualcomm-snapdragon-8gen3/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..19613e6cc10ad5a89b65d9fbcf21d5d8135224a1 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8gen3/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:57828124c057b9522b41e37d27bf050955caca05238aa6853a0ba7b270b10d1c +size 8835072 diff --git a/precompiled/qualcomm-snapdragon-8gen3/GKT_float.onnx.zip b/precompiled/qualcomm-snapdragon-8gen3/GKT_float.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..f1638ad1eca259de750353012f53620ed86132e6 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8gen3/GKT_float.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:a0ba5820875fbba89c7d7339cb8b21e3d7feb5483e90b206a5b43b99e538e0cf +size 4326975 diff --git a/precompiled/qualcomm-snapdragon-8gen3/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-snapdragon-8gen3/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..89686271232b3cdfeec6812d8f918a1553866b29 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8gen3/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:5d3696f1f90a1e8b6c560e63328dfa8585e08d5525b0311d98b46a3684a1e80a +size 10567680 diff --git a/precompiled/qualcomm-snapdragon-8gen3/GKT_w8a16_mixed_fp16.onnx.zip b/precompiled/qualcomm-snapdragon-8gen3/GKT_w8a16_mixed_fp16.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..1cca4916c1f0610b16b1af38dea265debb259061 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8gen3/GKT_w8a16_mixed_fp16.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:57e862369a95364e6c6b52eef0e463307b204191c2643cf8761a3479307e3f00 +size 4742446 diff --git a/precompiled/qualcomm-snapdragon-8gen3/tool-versions.yaml b/precompiled/qualcomm-snapdragon-8gen3/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..2651df2a5778b3f91e7ee070551106ab67282c06 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-8gen3/tool-versions.yaml @@ -0,0 +1,4 @@ +tool_versions: + precompiled_qnn_onnx: + qairt: 2.37.1.250807093845_124904 + onnx_runtime: 1.23.0 diff --git a/precompiled/qualcomm-snapdragon-x-elite/GKT_float.bin b/precompiled/qualcomm-snapdragon-x-elite/GKT_float.bin new file mode 100644 index 0000000000000000000000000000000000000000..ae3fe641e2344a78427ee8e3797ad41d4c086dfe --- /dev/null +++ b/precompiled/qualcomm-snapdragon-x-elite/GKT_float.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:95b556e32207ae8e4dd7d4ff659f1c0bdbfd3fb50127fb63c7dbb63161f5a902 +size 8835072 diff --git a/precompiled/qualcomm-snapdragon-x-elite/GKT_float.onnx.zip b/precompiled/qualcomm-snapdragon-x-elite/GKT_float.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..9fa1127144930a14c8b6c6413f9917b66bdf3efa --- /dev/null +++ b/precompiled/qualcomm-snapdragon-x-elite/GKT_float.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:91331b01f108629c61ed0eb1eae1bb6824c5a623b6409649fe0e54cdea7755ba +size 4332971 diff --git a/precompiled/qualcomm-snapdragon-x-elite/GKT_w8a16_mixed_fp16.bin b/precompiled/qualcomm-snapdragon-x-elite/GKT_w8a16_mixed_fp16.bin new file mode 100644 index 0000000000000000000000000000000000000000..dc734add03fa2f1ee7bdc284b7a612867643fd74 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-x-elite/GKT_w8a16_mixed_fp16.bin @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:dd637a6ec60c0ed8f02c57da9dfd297a886f246a4b7b7360251980061a62b3cb +size 10567680 diff --git a/precompiled/qualcomm-snapdragon-x-elite/GKT_w8a16_mixed_fp16.onnx.zip b/precompiled/qualcomm-snapdragon-x-elite/GKT_w8a16_mixed_fp16.onnx.zip new file mode 100644 index 0000000000000000000000000000000000000000..024010c907f1800c1b706e80bc05faa35f199ae9 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-x-elite/GKT_w8a16_mixed_fp16.onnx.zip @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:8e7849d0954eedeb18be0de9552977a67f0f55466d984cd74b2b79edf278d4f3 +size 4742494 diff --git a/precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml b/precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml new file mode 100644 index 0000000000000000000000000000000000000000..2651df2a5778b3f91e7ee070551106ab67282c06 --- /dev/null +++ b/precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml @@ -0,0 +1,4 @@ +tool_versions: + precompiled_qnn_onnx: + qairt: 2.37.1.250807093845_124904 + onnx_runtime: 1.23.0