Hugging Face's logo

qualcomm
/
OpenAI-Clip

Image Classification
PyTorch
LiteRT
foundation
android
Model card Files
xet
Community
1
qaihm-bot commited on
Commit
7aee874
·
verified ·
1 Parent(s): 7d16472

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +46 -46
README.md CHANGED
@@ -38,48 +38,48 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | CLIPImageEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 34.591 ms | 0 - 57 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
42
- | CLIPImageEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 26.472 ms | 0 - 55 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.so) |
43
- | CLIPImageEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 27.035 ms | 0 - 264 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
44
- | CLIPImageEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 20.808 ms | 1 - 170 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.so) |
45
- | CLIPImageEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 24.249 ms | 0 - 266 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
46
- | CLIPImageEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 18.669 ms | 0 - 171 MB | FP16 | NPU | Use Export Script |
47
- | CLIPImageEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 33.984 ms | 0 - 55 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
48
- | CLIPImageEncoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 19.984 ms | 1 - 2 MB | FP16 | NPU | Use Export Script |
49
- | CLIPImageEncoder | SA7255P ADP | SA7255P | TFLITE | 327.04 ms | 0 - 264 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
50
- | CLIPImageEncoder | SA7255P ADP | SA7255P | QNN | 265.55 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
51
- | CLIPImageEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 34.335 ms | 0 - 54 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
52
- | CLIPImageEncoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 20.528 ms | 1 - 2 MB | FP16 | NPU | Use Export Script |
53
- | CLIPImageEncoder | SA8295P ADP | SA8295P | TFLITE | 40.114 ms | 0 - 200 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
54
- | CLIPImageEncoder | SA8295P ADP | SA8295P | QNN | 30.939 ms | 1 - 7 MB | FP16 | NPU | Use Export Script |
55
- | CLIPImageEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 34.062 ms | 0 - 58 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
56
- | CLIPImageEncoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 20.836 ms | 1 - 2 MB | FP16 | NPU | Use Export Script |
57
- | CLIPImageEncoder | SA8775P ADP | SA8775P | TFLITE | 42.508 ms | 0 - 264 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
58
- | CLIPImageEncoder | SA8775P ADP | SA8775P | QNN | 29.748 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
59
- | CLIPImageEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 34.902 ms | 0 - 201 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
60
- | CLIPImageEncoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 28.971 ms | 0 - 169 MB | FP16 | NPU | Use Export Script |
61
- | CLIPImageEncoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 22.167 ms | 1 - 1 MB | FP16 | NPU | Use Export Script |
62
- | CLIPTextEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 5.809 ms | 0 - 24 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
63
- | CLIPTextEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 4.636 ms | 0 - 18 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.so) |
64
- | CLIPTextEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 3.991 ms | 0 - 83 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
65
- | CLIPTextEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 3.281 ms | 0 - 68 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.so) |
66
- | CLIPTextEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 3.351 ms | 0 - 83 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
67
- | CLIPTextEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 3.197 ms | 0 - 68 MB | FP16 | NPU | Use Export Script |
68
- | CLIPTextEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 5.613 ms | 0 - 23 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
69
- | CLIPTextEncoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 4.743 ms | 0 - 1 MB | FP16 | NPU | Use Export Script |
70
- | CLIPTextEncoder | SA7255P ADP | SA7255P | TFLITE | 61.341 ms | 0 - 82 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
71
- | CLIPTextEncoder | SA7255P ADP | SA7255P | QNN | 51.576 ms | 0 - 11 MB | FP16 | NPU | Use Export Script |
72
- | CLIPTextEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 5.729 ms | 0 - 23 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
73
- | CLIPTextEncoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 4.772 ms | 0 - 1 MB | FP16 | NPU | Use Export Script |
74
- | CLIPTextEncoder | SA8295P ADP | SA8295P | TFLITE | 7.632 ms | 0 - 68 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
75
- | CLIPTextEncoder | SA8295P ADP | SA8295P | QNN | 6.53 ms | 0 - 6 MB | FP16 | NPU | Use Export Script |
76
- | CLIPTextEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 5.678 ms | 0 - 19 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
77
- | CLIPTextEncoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 4.872 ms | 0 - 1 MB | FP16 | NPU | Use Export Script |
78
- | CLIPTextEncoder | SA8775P ADP | SA8775P | TFLITE | 8.137 ms | 0 - 81 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
79
- | CLIPTextEncoder | SA8775P ADP | SA8775P | QNN | 6.947 ms | 0 - 6 MB | FP16 | NPU | Use Export Script |
80
- | CLIPTextEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 6.349 ms | 0 - 74 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
81
- | CLIPTextEncoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 5.399 ms | 0 - 71 MB | FP16 | NPU | Use Export Script |
82
- | CLIPTextEncoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 5.08 ms | 0 - 0 MB | FP16 | NPU | Use Export Script |
83
 
84
 
85
 
@@ -144,8 +144,8 @@ Profiling Results
144
  CLIPImageEncoder
145
  Device : Samsung Galaxy S23 (13)
146
  Runtime : TFLITE
147
- Estimated inference time (ms) : 34.6
148
- Estimated peak memory usage (MB): [0, 57]
149
  Total # Ops : 659
150
  Compute Unit(s) : NPU (659 ops)
151
 
@@ -153,8 +153,8 @@ Compute Unit(s) : NPU (659 ops)
153
  CLIPTextEncoder
154
  Device : Samsung Galaxy S23 (13)
155
  Runtime : TFLITE
156
- Estimated inference time (ms) : 5.8
157
- Estimated peak memory usage (MB): [0, 24]
158
  Total # Ops : 660
159
  Compute Unit(s) : NPU (658 ops) CPU (2 ops)
160
  ```
 
38
 
39
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | CLIPImageEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 34.121 ms | 0 - 60 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
42
+ | CLIPImageEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 26.557 ms | 0 - 55 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.so) |
43
+ | CLIPImageEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 26.78 ms | 0 - 264 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
44
+ | CLIPImageEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 20.731 ms | 1 - 173 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.so) |
45
+ | CLIPImageEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 21.048 ms | 0 - 266 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
46
+ | CLIPImageEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 19.261 ms | 0 - 173 MB | FP16 | NPU | Use Export Script |
47
+ | CLIPImageEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 35.227 ms | 0 - 52 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
48
+ | CLIPImageEncoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 20.812 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
49
+ | CLIPImageEncoder | SA7255P ADP | SA7255P | TFLITE | 326.848 ms | 0 - 264 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
50
+ | CLIPImageEncoder | SA7255P ADP | SA7255P | QNN | 264.864 ms | 1 - 10 MB | FP16 | NPU | Use Export Script |
51
+ | CLIPImageEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 34.551 ms | 0 - 58 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
52
+ | CLIPImageEncoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 20.55 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
53
+ | CLIPImageEncoder | SA8295P ADP | SA8295P | TFLITE | 40.235 ms | 0 - 202 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
54
+ | CLIPImageEncoder | SA8295P ADP | SA8295P | QNN | 30.857 ms | 1 - 15 MB | FP16 | NPU | Use Export Script |
55
+ | CLIPImageEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 34.106 ms | 1 - 54 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
56
+ | CLIPImageEncoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 20.571 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
57
+ | CLIPImageEncoder | SA8775P ADP | SA8775P | TFLITE | 42.417 ms | 0 - 264 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
58
+ | CLIPImageEncoder | SA8775P ADP | SA8775P | QNN | 29.812 ms | 1 - 10 MB | FP16 | NPU | Use Export Script |
59
+ | CLIPImageEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 35.648 ms | 0 - 205 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPImageEncoder.tflite) |
60
+ | CLIPImageEncoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 30.197 ms | 0 - 167 MB | FP16 | NPU | Use Export Script |
61
+ | CLIPImageEncoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 22.181 ms | 1 - 1 MB | FP16 | NPU | Use Export Script |
62
+ | CLIPTextEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 5.602 ms | 0 - 16 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
63
+ | CLIPTextEncoder | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 4.696 ms | 0 - 21 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.so) |
64
+ | CLIPTextEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 3.979 ms | 0 - 87 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
65
+ | CLIPTextEncoder | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 3.316 ms | 0 - 72 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.so) |
66
+ | CLIPTextEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 3.951 ms | 0 - 84 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
67
+ | CLIPTextEncoder | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 3.201 ms | 0 - 70 MB | FP16 | NPU | Use Export Script |
68
+ | CLIPTextEncoder | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 5.628 ms | 0 - 18 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
69
+ | CLIPTextEncoder | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 4.834 ms | 0 - 2 MB | FP16 | NPU | Use Export Script |
70
+ | CLIPTextEncoder | SA7255P ADP | SA7255P | TFLITE | 61.367 ms | 0 - 81 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
71
+ | CLIPTextEncoder | SA7255P ADP | SA7255P | QNN | 51.616 ms | 0 - 9 MB | FP16 | NPU | Use Export Script |
72
+ | CLIPTextEncoder | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 5.737 ms | 0 - 17 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
73
+ | CLIPTextEncoder | SA8255 (Proxy) | SA8255P Proxy | QNN | 4.793 ms | 0 - 3 MB | FP16 | NPU | Use Export Script |
74
+ | CLIPTextEncoder | SA8295P ADP | SA8295P | TFLITE | 7.595 ms | 0 - 69 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
75
+ | CLIPTextEncoder | SA8295P ADP | SA8295P | QNN | 6.506 ms | 0 - 14 MB | FP16 | NPU | Use Export Script |
76
+ | CLIPTextEncoder | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 5.63 ms | 0 - 19 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
77
+ | CLIPTextEncoder | SA8650 (Proxy) | SA8650P Proxy | QNN | 4.833 ms | 0 - 3 MB | FP16 | NPU | Use Export Script |
78
+ | CLIPTextEncoder | SA8775P ADP | SA8775P | TFLITE | 8.185 ms | 0 - 81 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
79
+ | CLIPTextEncoder | SA8775P ADP | SA8775P | QNN | 6.934 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
80
+ | CLIPTextEncoder | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 6.428 ms | 0 - 74 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/CLIPTextEncoder.tflite) |
81
+ | CLIPTextEncoder | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 5.405 ms | 0 - 73 MB | FP16 | NPU | Use Export Script |
82
+ | CLIPTextEncoder | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 5.099 ms | 0 - 0 MB | FP16 | NPU | Use Export Script |
83
 
84
 
85
 
 
144
  CLIPImageEncoder
145
  Device : Samsung Galaxy S23 (13)
146
  Runtime : TFLITE
147
+ Estimated inference time (ms) : 34.1
148
+ Estimated peak memory usage (MB): [0, 60]
149
  Total # Ops : 659
150
  Compute Unit(s) : NPU (659 ops)
151
 
 
153
  CLIPTextEncoder
154
  Device : Samsung Galaxy S23 (13)
155
  Runtime : TFLITE
156
+ Estimated inference time (ms) : 5.6
157
+ Estimated peak memory usage (MB): [0, 16]
158
  Total # Ops : 660
159
  Compute Unit(s) : NPU (658 ops) CPU (2 ops)
160
  ```