Hugging Face's logo

qualcomm
/
OpenAI-Clip

Image Classification
PyTorch
LiteRT
foundation
android
Model card Files
xet
Community
1
qaihm-bot commited on
Commit
bf34dc2
·
verified ·
1 Parent(s): d753c59

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +38 -38
README.md CHANGED
@@ -1,6 +1,6 @@
1
  ---
2
  library_name: pytorch
3
- license: mit
4
  tags:
5
  - foundation
6
  - android
@@ -26,7 +26,7 @@ More details on model performance across various devices, can be found
26
 
27
  ### Model Details
28
 
29
- - **Model Type:** Image classification
30
  - **Model Stats:**
31
  - Model checkpoint: ViT-B/16
32
  - Image input resolution: 224x224
@@ -36,37 +36,37 @@ More details on model performance across various devices, can be found
36
  - Number of parameters (CLIPImageEncoder): 115M
37
  - Model size (CLIPImageEncoder): 437 MB
38
 
39
- | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 24.855 ms | 0 - 23 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
42
- | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 19.238 ms | 0 - 22 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.so) |
43
- | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 25.697 ms | 0 - 104 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
44
- | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 18.007 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
45
- | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 13.619 ms | 1 - 391 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.so) |
46
- | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 18.132 ms | 1 - 473 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
47
- | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 14.586 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
48
- | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 11.09 ms | 0 - 388 MB | FP16 | NPU | Use Export Script |
49
- | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 17.609 ms | 1 - 443 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
50
- | OpenAI-Clip | SA7255P ADP | SA7255P | TFLITE | 368.401 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
51
- | OpenAI-Clip | SA7255P ADP | SA7255P | QNN | 306.68 ms | 1 - 9 MB | FP16 | NPU | Use Export Script |
52
- | OpenAI-Clip | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 24.877 ms | 0 - 20 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
53
- | OpenAI-Clip | SA8255 (Proxy) | SA8255P Proxy | QNN | 20.983 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
54
- | OpenAI-Clip | SA8295P ADP | SA8295P | TFLITE | 30.504 ms | 0 - 336 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
55
- | OpenAI-Clip | SA8295P ADP | SA8295P | QNN | 24.978 ms | 1 - 17 MB | FP16 | NPU | Use Export Script |
56
- | OpenAI-Clip | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 24.962 ms | 0 - 23 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
57
- | OpenAI-Clip | SA8650 (Proxy) | SA8650P Proxy | QNN | 21.068 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
58
- | OpenAI-Clip | SA8775P ADP | SA8775P | TFLITE | 34.905 ms | 0 - 382 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
59
- | OpenAI-Clip | SA8775P ADP | SA8775P | QNN | 28.903 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
60
- | OpenAI-Clip | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 368.401 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
61
- | OpenAI-Clip | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 306.68 ms | 1 - 9 MB | FP16 | NPU | Use Export Script |
62
- | OpenAI-Clip | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 24.987 ms | 0 - 24 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
63
- | OpenAI-Clip | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 21.05 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
64
- | OpenAI-Clip | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 34.905 ms | 0 - 382 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
65
- | OpenAI-Clip | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 28.903 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
66
- | OpenAI-Clip | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 26.982 ms | 0 - 351 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
67
- | OpenAI-Clip | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 22.097 ms | 1 - 394 MB | FP16 | NPU | Use Export Script |
68
- | OpenAI-Clip | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 21.709 ms | 1 - 1 MB | FP16 | NPU | Use Export Script |
69
- | OpenAI-Clip | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 26.59 ms | 293 - 293 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
70
 
71
 
72
 
@@ -128,12 +128,12 @@ python -m qai_hub_models.models.openai_clip.export
128
  Profiling Results
129
  ------------------------------------------------------------
130
  OpenAI-Clip
131
- Device : Samsung Galaxy S23 (13)
132
- Runtime : TFLITE
133
- Estimated inference time (ms) : 24.9
134
- Estimated peak memory usage (MB): [0, 23]
135
- Total # Ops : 1320
136
- Compute Unit(s) : NPU (1318 ops) CPU (2 ops)
137
  ```
138
 
139
 
 
1
  ---
2
  library_name: pytorch
3
+ license: other
4
  tags:
5
  - foundation
6
  - android
 
26
 
27
  ### Model Details
28
 
29
+ - **Model Type:** Model_use_case.image_classification
30
  - **Model Stats:**
31
  - Model checkpoint: ViT-B/16
32
  - Image input resolution: 224x224
 
36
  - Number of parameters (CLIPImageEncoder): 115M
37
  - Model size (CLIPImageEncoder): 437 MB
38
 
39
+ | Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | OpenAI-Clip | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 73.001 ms | 0 - 382 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
42
+ | OpenAI-Clip | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN | 60.418 ms | 1 - 10 MB | NPU | Use Export Script |
43
+ | OpenAI-Clip | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 27.171 ms | 0 - 348 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
44
+ | OpenAI-Clip | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN | 25.229 ms | 0 - 412 MB | NPU | Use Export Script |
45
+ | OpenAI-Clip | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 24.431 ms | 0 - 22 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
46
+ | OpenAI-Clip | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN | 21.041 ms | 0 - 6 MB | NPU | Use Export Script |
47
+ | OpenAI-Clip | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 29.608 ms | 0 - 382 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
48
+ | OpenAI-Clip | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | QNN | 23.811 ms | 0 - 10 MB | NPU | Use Export Script |
49
+ | OpenAI-Clip | float | SA7255P ADP | Qualcomm® SA7255P | TFLITE | 73.001 ms | 0 - 382 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
50
+ | OpenAI-Clip | float | SA7255P ADP | Qualcomm® SA7255P | QNN | 60.418 ms | 1 - 10 MB | NPU | Use Export Script |
51
+ | OpenAI-Clip | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | TFLITE | 24.918 ms | 0 - 23 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
52
+ | OpenAI-Clip | float | SA8255 (Proxy) | Qualcomm® SA8255P (Proxy) | QNN | 21.166 ms | 1 - 3 MB | NPU | Use Export Script |
53
+ | OpenAI-Clip | float | SA8295P ADP | Qualcomm® SA8295P | TFLITE | 30.503 ms | 0 - 335 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
54
+ | OpenAI-Clip | float | SA8295P ADP | Qualcomm® SA8295P | QNN | 24.99 ms | 1 - 17 MB | NPU | Use Export Script |
55
+ | OpenAI-Clip | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | TFLITE | 24.778 ms | 0 - 21 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
56
+ | OpenAI-Clip | float | SA8650 (Proxy) | Qualcomm® SA8650P (Proxy) | QNN | 21.121 ms | 1 - 3 MB | NPU | Use Export Script |
57
+ | OpenAI-Clip | float | SA8775P ADP | Qualcomm® SA8775P | TFLITE | 29.608 ms | 0 - 382 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
58
+ | OpenAI-Clip | float | SA8775P ADP | Qualcomm® SA8775P | QNN | 23.811 ms | 0 - 10 MB | NPU | Use Export Script |
59
+ | OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | TFLITE | 25.052 ms | 3 - 25 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
60
+ | OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | QNN | 20.911 ms | 0 - 48 MB | NPU | Use Export Script |
61
+ | OpenAI-Clip | float | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 25.568 ms | 0 - 82 MB | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
62
+ | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 18.04 ms | 0 - 386 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
63
+ | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN | 15.142 ms | 1 - 418 MB | NPU | Use Export Script |
64
+ | OpenAI-Clip | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 18.17 ms | 1 - 474 MB | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
65
+ | OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 16.987 ms | 0 - 383 MB | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
66
+ | OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | QNN | 11.801 ms | 1 - 390 MB | NPU | Use Export Script |
67
+ | OpenAI-Clip | float | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 15.236 ms | 1 - 443 MB | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
68
+ | OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 21.703 ms | 1 - 1 MB | NPU | Use Export Script |
69
+ | OpenAI-Clip | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 26.65 ms | 293 - 293 MB | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
70
 
71
 
72
 
 
128
  Profiling Results
129
  ------------------------------------------------------------
130
  OpenAI-Clip
131
+ Device : cs_8275 (ANDROID 14)
132
+ Runtime : TFLITE
133
+ Estimated inference time (ms) : 73.0
134
+ Estimated peak memory usage (MB): [0, 382]
135
+ Total # Ops : 1320
136
+ Compute Unit(s) : npu (1318 ops) gpu (0 ops) cpu (2 ops)
137
  ```
138
 
139