qaihm-bot commited on
Commit
91dd387
·
verified ·
1 Parent(s): 5872ef0

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +30 -30
README.md CHANGED
@@ -38,35 +38,35 @@ More details on model performance across various devices, can be found
38
 
39
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
- | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 25.076 ms | 0 - 23 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
42
- | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 21.005 ms | 1 - 3 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.so) |
43
- | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 25.599 ms | 0 - 214 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
44
- | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 17.736 ms | 0 - 386 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
45
- | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 14.891 ms | 1 - 20 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.so) |
46
- | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 18.187 ms | 1 - 476 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
47
- | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 14.708 ms | 0 - 382 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
48
- | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 11.195 ms | 0 - 386 MB | FP16 | NPU | Use Export Script |
49
- | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 17.476 ms | 1 - 442 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
50
- | OpenAI-Clip | SA7255P ADP | SA7255P | TFLITE | 368.416 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
51
- | OpenAI-Clip | SA7255P ADP | SA7255P | QNN | 306.652 ms | 1 - 9 MB | FP16 | NPU | Use Export Script |
52
- | OpenAI-Clip | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 25.143 ms | 0 - 30 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
53
- | OpenAI-Clip | SA8255 (Proxy) | SA8255P Proxy | QNN | 21.087 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
54
- | OpenAI-Clip | SA8295P ADP | SA8295P | TFLITE | 30.487 ms | 0 - 336 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
55
- | OpenAI-Clip | SA8295P ADP | SA8295P | QNN | 24.931 ms | 1 - 17 MB | FP16 | NPU | Use Export Script |
56
- | OpenAI-Clip | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 25.129 ms | 0 - 22 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
57
- | OpenAI-Clip | SA8650 (Proxy) | SA8650P Proxy | QNN | 21.0 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
58
- | OpenAI-Clip | SA8775P ADP | SA8775P | TFLITE | 35.055 ms | 0 - 382 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
59
- | OpenAI-Clip | SA8775P ADP | SA8775P | QNN | 28.917 ms | 1 - 10 MB | FP16 | NPU | Use Export Script |
60
- | OpenAI-Clip | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 368.416 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
61
- | OpenAI-Clip | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 306.652 ms | 1 - 9 MB | FP16 | NPU | Use Export Script |
62
- | OpenAI-Clip | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 24.93 ms | 0 - 21 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
63
- | OpenAI-Clip | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 21.023 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
64
- | OpenAI-Clip | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 35.055 ms | 0 - 382 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
65
- | OpenAI-Clip | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 28.917 ms | 1 - 10 MB | FP16 | NPU | Use Export Script |
66
- | OpenAI-Clip | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 26.982 ms | 0 - 349 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
67
- | OpenAI-Clip | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 22.296 ms | 1 - 397 MB | FP16 | NPU | Use Export Script |
68
- | OpenAI-Clip | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 21.774 ms | 1 - 1 MB | FP16 | NPU | Use Export Script |
69
- | OpenAI-Clip | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 26.6 ms | 293 - 293 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
70
 
71
 
72
 
@@ -130,7 +130,7 @@ Profiling Results
130
  OpenAI-Clip
131
  Device : Samsung Galaxy S23 (13)
132
  Runtime : TFLITE
133
- Estimated inference time (ms) : 25.1
134
  Estimated peak memory usage (MB): [0, 23]
135
  Total # Ops : 1320
136
  Compute Unit(s) : NPU (1318 ops) CPU (2 ops)
 
38
 
39
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
40
  |---|---|---|---|---|---|---|---|---|
41
+ | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 24.855 ms | 0 - 23 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
42
+ | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 19.238 ms | 0 - 22 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.so) |
43
+ | OpenAI-Clip | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 25.697 ms | 0 - 104 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
44
+ | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 18.007 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
45
+ | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 13.619 ms | 1 - 391 MB | FP16 | NPU | [OpenAI-Clip.so](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.so) |
46
+ | OpenAI-Clip | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 18.132 ms | 1 - 473 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
47
+ | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 14.586 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
48
+ | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 11.09 ms | 0 - 388 MB | FP16 | NPU | Use Export Script |
49
+ | OpenAI-Clip | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 17.609 ms | 1 - 443 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
50
+ | OpenAI-Clip | SA7255P ADP | SA7255P | TFLITE | 368.401 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
51
+ | OpenAI-Clip | SA7255P ADP | SA7255P | QNN | 306.68 ms | 1 - 9 MB | FP16 | NPU | Use Export Script |
52
+ | OpenAI-Clip | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 24.877 ms | 0 - 20 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
53
+ | OpenAI-Clip | SA8255 (Proxy) | SA8255P Proxy | QNN | 20.983 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
54
+ | OpenAI-Clip | SA8295P ADP | SA8295P | TFLITE | 30.504 ms | 0 - 336 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
55
+ | OpenAI-Clip | SA8295P ADP | SA8295P | QNN | 24.978 ms | 1 - 17 MB | FP16 | NPU | Use Export Script |
56
+ | OpenAI-Clip | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 24.962 ms | 0 - 23 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
57
+ | OpenAI-Clip | SA8650 (Proxy) | SA8650P Proxy | QNN | 21.068 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
58
+ | OpenAI-Clip | SA8775P ADP | SA8775P | TFLITE | 34.905 ms | 0 - 382 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
59
+ | OpenAI-Clip | SA8775P ADP | SA8775P | QNN | 28.903 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
60
+ | OpenAI-Clip | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 368.401 ms | 0 - 383 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
61
+ | OpenAI-Clip | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 306.68 ms | 1 - 9 MB | FP16 | NPU | Use Export Script |
62
+ | OpenAI-Clip | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 24.987 ms | 0 - 24 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
63
+ | OpenAI-Clip | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 21.05 ms | 1 - 3 MB | FP16 | NPU | Use Export Script |
64
+ | OpenAI-Clip | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 34.905 ms | 0 - 382 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
65
+ | OpenAI-Clip | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 28.903 ms | 1 - 11 MB | FP16 | NPU | Use Export Script |
66
+ | OpenAI-Clip | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 26.982 ms | 0 - 351 MB | FP16 | NPU | [OpenAI-Clip.tflite](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.tflite) |
67
+ | OpenAI-Clip | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 22.097 ms | 1 - 394 MB | FP16 | NPU | Use Export Script |
68
+ | OpenAI-Clip | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 21.709 ms | 1 - 1 MB | FP16 | NPU | Use Export Script |
69
+ | OpenAI-Clip | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 26.59 ms | 293 - 293 MB | FP16 | NPU | [OpenAI-Clip.onnx](https://huggingface.co/qualcomm/OpenAI-Clip/blob/main/OpenAI-Clip.onnx) |
70
 
71
 
72
 
 
130
  OpenAI-Clip
131
  Device : Samsung Galaxy S23 (13)
132
  Runtime : TFLITE
133
+ Estimated inference time (ms) : 24.9
134
  Estimated peak memory usage (MB): [0, 23]
135
  Total # Ops : 1320
136
  Compute Unit(s) : NPU (1318 ops) CPU (2 ops)