Hugging Face's logo

qualcomm
/
OpenAI-Clip

Image Classification
PyTorch
foundation
android
Model card Files
xet
Community
1
qaihm-bot commited on
Commit
3c516ed
·
verified ·
1 Parent(s): 2c0ac67

v0.44.0

Browse files

See https://github.com/quic/ai-hub-models/releases/v0.44.0 for changelog.

Files changed (6) hide show
  1. DEPLOYMENT_MODEL_LICENSE.pdf +0 -3
  2. LICENSE +0 -1
  3. OpenAI-Clip_float.dlc +1 -1
  4. OpenAI-Clip_float.onnx.zip +2 -2
  5. OpenAI-Clip_float.tflite +2 -2
  6. README.md +30 -31
DEPLOYMENT_MODEL_LICENSE.pdf DELETED
@@ -1,3 +0,0 @@
1
- version https://git-lfs.github.com/spec/v1
2
- oid sha256:4409f93b0e82531303b3e10f52f1fdfb56467a25f05b7441c6bbd8bb8a64b42c
3
- size 109629
 
 
 
 
LICENSE CHANGED
@@ -1,2 +1 @@
1
  The license of the original trained model can be found at https://github.com/openai/CLIP/blob/main/LICENSE.
2
- The license for the deployable model files (.tflite, .onnx, .dlc, .bin, etc.) can be found in DEPLOYMENT_MODEL_LICENSE.pdf.
 
1
  The license of the original trained model can be found at https://github.com/openai/CLIP/blob/main/LICENSE.
 
OpenAI-Clip_float.dlc CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a52b5abf0c42577f00a211765080e7c6c912559b652c91c1603e3844c69b6dd8
3
  size 599439284
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9d43080f00ad5214d7268b1a90ea2313a02f33e99082fd5e156b09217fc0bbb
3
  size 599439284
OpenAI-Clip_float.onnx.zip CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf27899fb4177678d5ee5139764d603ec35a8103062c8e0567e44d9c29b31f51
3
- size 406345249
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbd9cf0f9a317b3400283b9dab145a843e4a7ba4bf7396c3a273d0073ccf49ef
3
+ size 406345322
OpenAI-Clip_float.tflite CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:718f7b614a1c158e548b7a8955649c566378e406c6652b457bc936a5abf9e0b7
3
- size 598745464
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4cc191e297a62574c8f713be4324796c79da5a6ea859c1754e962a84d0e5959a
3
+ size 598745484
README.md CHANGED
@@ -37,36 +37,36 @@ More details on model performance across various devices, can be found
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
- | OpenAI-Clip | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 62.211 ms | 0 - 496 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
41
- | OpenAI-Clip | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 59.213 ms | 0 - 569 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
42
- | OpenAI-Clip | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 24.631 ms | 0 - 501 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
43
- | OpenAI-Clip | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 25.432 ms | 1 - 529 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
44
- | OpenAI-Clip | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 21.793 ms | 0 - 29 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
45
- | OpenAI-Clip | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 20.388 ms | 0 - 33 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
46
- | OpenAI-Clip | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 22.304 ms | 1 - 29 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
47
- | OpenAI-Clip | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 24.882 ms | 0 - 495 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
48
- | OpenAI-Clip | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 23.581 ms | 1 - 569 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
49
- | OpenAI-Clip | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 62.211 ms | 0 - 496 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
50
- | OpenAI-Clip | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 59.213 ms | 0 - 569 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
51
- | OpenAI-Clip | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 21.77 ms | 0 - 32 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
52
- | OpenAI-Clip | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 20.779 ms | 0 - 40 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
53
- | OpenAI-Clip | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 28.133 ms | 0 - 487 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
54
- | OpenAI-Clip | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 26.371 ms | 0 - 557 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
55
- | OpenAI-Clip | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 21.492 ms | 0 - 29 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
56
- | OpenAI-Clip | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 20.74 ms | 0 - 59 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
57
- | OpenAI-Clip | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 24.882 ms | 0 - 495 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
58
- | OpenAI-Clip | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 23.581 ms | 1 - 569 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
59
- | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 14.896 ms | 0 - 501 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
60
- | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 14.638 ms | 1 - 575 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
61
- | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 15.333 ms | 0 - 570 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
62
- | OpenAI-Clip | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 11.95 ms | 0 - 495 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
63
- | OpenAI-Clip | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 11.635 ms | 1 - 551 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
64
- | OpenAI-Clip | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 12.001 ms | 0 - 552 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
65
- | OpenAI-Clip | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 9.293 ms | 4 - 497 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
66
- | OpenAI-Clip | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 9.324 ms | 0 - 496 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
67
- | OpenAI-Clip | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 10.063 ms | 0 - 497 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
68
- | OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 21.697 ms | 1528 - 1528 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
69
- | OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 22.538 ms | 294 - 294 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
70
 
71
 
72
 
@@ -228,7 +228,6 @@ Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
228
  ## License
229
  * The license for the original implementation of OpenAI-Clip can be found
230
  [here](https://github.com/openai/CLIP/blob/main/LICENSE).
231
- * The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
232
 
233
 
234
 
 
37
 
38
  | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
39
  |---|---|---|---|---|---|---|---|---|
40
+ | OpenAI-Clip | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 55.909 ms | 0 - 764 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
41
+ | OpenAI-Clip | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 59.966 ms | 1 - 767 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
42
+ | OpenAI-Clip | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 24.443 ms | 0 - 748 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
43
+ | OpenAI-Clip | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 25.861 ms | 0 - 752 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
44
+ | OpenAI-Clip | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 18.45 ms | 0 - 3 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
45
+ | OpenAI-Clip | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 20.95 ms | 1 - 3 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
46
+ | OpenAI-Clip | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 22.179 ms | 0 - 322 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
47
+ | OpenAI-Clip | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 21.813 ms | 0 - 764 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
48
+ | OpenAI-Clip | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN_DLC | 23.858 ms | 1 - 767 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
49
+ | OpenAI-Clip | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 55.909 ms | 0 - 764 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
50
+ | OpenAI-Clip | float | SA7255P ADP | Qualcomm® SA7255P | QNN_DLC | 59.966 ms | 1 - 767 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
51
+ | OpenAI-Clip | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 18.516 ms | 0 - 4 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
52
+ | OpenAI-Clip | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN_DLC | 20.713 ms | 1 - 3 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
53
+ | OpenAI-Clip | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 24.923 ms | 0 - 751 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
54
+ | OpenAI-Clip | float | SA8295P ADP | Qualcomm® SA8295P | QNN_DLC | 26.378 ms | 1 - 753 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
55
+ | OpenAI-Clip | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 18.541 ms | 0 - 4 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
56
+ | OpenAI-Clip | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN_DLC | 21.159 ms | 1 - 3 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
57
+ | OpenAI-Clip | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 21.813 ms | 0 - 764 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
58
+ | OpenAI-Clip | float | SA8775P ADP | Qualcomm® SA8775P | QNN_DLC | 23.858 ms | 1 - 767 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
59
+ | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 13.364 ms | 0 - 820 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
60
+ | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 15.095 ms | 0 - 821 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
61
+ | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 15.584 ms | 1 - 799 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
62
+ | OpenAI-Clip | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 10.192 ms | 0 - 729 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
63
+ | OpenAI-Clip | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 11.404 ms | 0 - 731 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
64
+ | OpenAI-Clip | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 12.271 ms | 1 - 712 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
65
+ | OpenAI-Clip | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | TFLITE | 7.878 ms | 0 - 680 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
66
+ | OpenAI-Clip | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | QNN_DLC | 9.308 ms | 1 - 679 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
67
+ | OpenAI-Clip | float | Snapdragon 8 Elite Gen 5 QRD | Snapdragon® 8 Elite Gen5 Mobile | ONNX | 10.064 ms | 1 - 661 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
68
+ | OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 21.992 ms | 1 - 1 MB | NPU | [OpenAI-Clip.dlc](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.dlc) |
69
+ | OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 22.565 ms | 294 - 294 MB | NPU | [OpenAI-Clip.onnx.zip](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx.zip) |
70
 
71
 
72
 
 
228
  ## License
229
  * The license for the original implementation of OpenAI-Clip can be found
230
  [here](https://github.com/openai/CLIP/blob/main/LICENSE).
 
231
 
232
 
233