v0.34.0

See https://github.com/quic/ai-hub-models/releases/v0.34.0 for changelog.

README.md

@@ -23,6 +23,7 @@ More details on model performance across various devices, can be found
 [here](https://aihub.qualcomm.com/models/nomic_embed_text).
 
 
+
 ### Model Details
 
 - **Model Type:** Model_use_case.text_generation
@@ -34,31 +35,31 @@ More details on model performance across various devices, can be found
 
 | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
 |---|---|---|---|---|---|---|---|---|
-| Nomic-Embed-Text | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 34.133 ms | 0 - 424 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 186.656 ms | 0 - 424 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 28.718 ms | 0 - 367 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 12.109 ms | 0 - 409 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 12.239 ms | 0 - 410 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 10.755 ms | 0 - 374 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 10.288 ms | 0 - 29 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 9.849 ms | 3 - 34 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 7.625 ms | 0 - 28 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 12.437 ms | 0 - 424 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 12.405 ms | 0 - 424 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 9.863 ms | 0 - 367 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 34.133 ms | 0 - 424 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 186.656 ms | 0 - 424 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 28.718 ms | 0 - 367 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 10.335 ms | 0 - 31 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 10.253 ms | 0 - 24 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 7.667 ms | 0 - 30 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 13.945 ms | 0 - 397 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 14.01 ms | 0 - 397 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 10.791 ms | 0 - 359 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 10.39 ms | 0 - 30 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 10.225 ms | 0 - 20 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 7.745 ms | 0 - 26 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 12.437 ms | 0 - 424 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 12.405 ms | 0 - 424 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 9.863 ms | 0 - 367 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
-| Nomic-Embed-Text | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 10.265 ms | 0 - 24 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 10.36 ms | 0 - 29 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN_DLC | 7.65 ms | 0 - 25 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
 | Nomic-Embed-Text | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 8.007 ms | 0 - 22 MB | NPU | [Nomic-Embed-Text.onnx](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.onnx) |
-| Nomic-Embed-Text | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 7.335 ms | 0 - 434 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 7.333 ms | 0 - 433 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 5.416 ms | 0 - 374 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
 | Nomic-Embed-Text | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 5.547 ms | 0 - 377 MB | NPU | [Nomic-Embed-Text.onnx](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.onnx) |
-| Nomic-Embed-Text | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 6.118 ms | 0 - 420 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
+| Nomic-Embed-Text | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 7.39 ms | 0 - 417 MB | NPU | [Nomic-Embed-Text.tflite](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.tflite) |
 | Nomic-Embed-Text | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN_DLC | 5.189 ms | 0 - 367 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
 | Nomic-Embed-Text | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 5.472 ms | 0 - 369 MB | NPU | [Nomic-Embed-Text.onnx](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.onnx) |
 | Nomic-Embed-Text | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 9.347 ms | 1580 - 1580 MB | NPU | [Nomic-Embed-Text.dlc](https://huggingface.co/qualcomm/Nomic-Embed-Text/blob/main/Nomic-Embed-Text.dlc) |
@@ -120,17 +121,7 @@ device. This script does the following:
 ```bash
 python -m qai_hub_models.models.nomic_embed_text.export
 ```
-```
-Profiling Results
-------------------------------------------------------------
-Nomic-Embed-Text
-Device                          : cs_8275 (ANDROID 14)                 
-Runtime                         : TFLITE                               
-Estimated inference time (ms)   : 34.1                                 
-Estimated peak memory usage (MB): [0, 424]                             
-Total # Ops                     : 906                                  
-Compute Unit(s)                 : npu (906 ops) gpu (0 ops) cpu (0 ops)
-```
+
 
 
 ## How does this work?

precompiled/qualcomm-snapdragon-x-elite/Nomic-Embed-Text.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ff6eee01a7aec9a14bb0fbd0c82ea09e32fb5e968879cba2fccd625ce91e6078
+oid sha256:d99b37fff9a34d0a09cb6f5d658af97aa66c63c31b27c933e1c6ad6882a998c7
 size 274790144

precompiled/qualcomm-snapdragon-x-elite/Nomic-Embed-Text.onnx.zip

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cb90905f5f53adb953efbc3b514ac6cd39b1849a217e11b4db23f217e64b95ce
-size 253746367
+oid sha256:f31020c935ca654f043d8d06907d09154e21659a27ec7f00617f22bbf47495a2
+size 253746202

precompiled/qualcomm-snapdragon-x-elite/sdk_versions.yml

@@ -0,0 +1,5 @@
+sdk_versions:
+  qnn_context_binary:
+    qairt: 2.34.2.250528164111_119506
+  precompiled_qnn_onnx:
+    qairt: 2.33.2.250410134701_117956