qaihm-bot commited on
Commit
cd14970
·
verified ·
1 Parent(s): 6ab82ed

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +22 -34
README.md CHANGED
@@ -34,35 +34,23 @@ More details on model performance across various devices, can be found
34
 
35
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
36
  |---|---|---|---|---|---|---|---|---|
37
- | DETR-ResNet50-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 48.855 ms | 0 - 29 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
38
- | DETR-ResNet50-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 46.294 ms | 5 - 7 MB | FP16 | NPU | [DETR-ResNet50-DC5.so](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.so) |
39
- | DETR-ResNet50-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 58.625 ms | 1 - 233 MB | FP16 | NPU | [DETR-ResNet50-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.onnx) |
40
- | DETR-ResNet50-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 37.476 ms | 0 - 167 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
41
- | DETR-ResNet50-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 34.69 ms | 5 - 25 MB | FP16 | NPU | [DETR-ResNet50-DC5.so](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.so) |
42
- | DETR-ResNet50-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 43.427 ms | 4 - 185 MB | FP16 | NPU | [DETR-ResNet50-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.onnx) |
43
- | DETR-ResNet50-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 34.231 ms | 0 - 166 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
44
- | DETR-ResNet50-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 30.152 ms | 5 - 136 MB | FP16 | NPU | Use Export Script |
45
- | DETR-ResNet50-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 37.739 ms | 13 - 162 MB | FP16 | NPU | [DETR-ResNet50-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.onnx) |
46
- | DETR-ResNet50-DC5 | SA7255P ADP | SA7255P | TFLITE | 1004.87 ms | 0 - 163 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
47
- | DETR-ResNet50-DC5 | SA7255P ADP | SA7255P | QNN | 1002.401 ms | 5 - 14 MB | FP16 | NPU | Use Export Script |
48
- | DETR-ResNet50-DC5 | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 48.61 ms | 0 - 28 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
49
- | DETR-ResNet50-DC5 | SA8255 (Proxy) | SA8255P Proxy | QNN | 47.519 ms | 5 - 8 MB | FP16 | NPU | Use Export Script |
50
- | DETR-ResNet50-DC5 | SA8295P ADP | SA8295P | TFLITE | 65.537 ms | 0 - 136 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
51
- | DETR-ResNet50-DC5 | SA8295P ADP | SA8295P | QNN | 62.388 ms | 0 - 18 MB | FP16 | NPU | Use Export Script |
52
- | DETR-ResNet50-DC5 | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 48.661 ms | 0 - 28 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
53
- | DETR-ResNet50-DC5 | SA8650 (Proxy) | SA8650P Proxy | QNN | 47.683 ms | 5 - 16 MB | FP16 | NPU | Use Export Script |
54
- | DETR-ResNet50-DC5 | SA8775P ADP | SA8775P | TFLITE | 73.878 ms | 0 - 163 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
55
- | DETR-ResNet50-DC5 | SA8775P ADP | SA8775P | QNN | 70.162 ms | 2 - 11 MB | FP16 | NPU | Use Export Script |
56
- | DETR-ResNet50-DC5 | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 1004.87 ms | 0 - 163 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
57
- | DETR-ResNet50-DC5 | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 1002.401 ms | 5 - 14 MB | FP16 | NPU | Use Export Script |
58
- | DETR-ResNet50-DC5 | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 48.586 ms | 0 - 28 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
59
- | DETR-ResNet50-DC5 | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 46.166 ms | 5 - 7 MB | FP16 | NPU | Use Export Script |
60
- | DETR-ResNet50-DC5 | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 73.878 ms | 0 - 163 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
61
- | DETR-ResNet50-DC5 | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 70.162 ms | 2 - 11 MB | FP16 | NPU | Use Export Script |
62
- | DETR-ResNet50-DC5 | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 59.9 ms | 0 - 146 MB | FP16 | NPU | [DETR-ResNet50-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.tflite) |
63
- | DETR-ResNet50-DC5 | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 60.529 ms | 5 - 116 MB | FP16 | NPU | Use Export Script |
64
- | DETR-ResNet50-DC5 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 46.66 ms | 5 - 5 MB | FP16 | NPU | Use Export Script |
65
- | DETR-ResNet50-DC5 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 61.165 ms | 80 - 80 MB | FP16 | NPU | [DETR-ResNet50-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.onnx) |
66
 
67
 
68
 
@@ -125,11 +113,11 @@ Profiling Results
125
  ------------------------------------------------------------
126
  DETR-ResNet50-DC5
127
  Device : Samsung Galaxy S23 (13)
128
- Runtime : TFLITE
129
- Estimated inference time (ms) : 48.9
130
- Estimated peak memory usage (MB): [0, 29]
131
- Total # Ops : 805
132
- Compute Unit(s) : NPU (805 ops)
133
  ```
134
 
135
 
 
34
 
35
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
36
  |---|---|---|---|---|---|---|---|---|
37
+ | DETR-ResNet50-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 50.847 ms | 5 - 33 MB | FP16 | NPU | [DETR-ResNet50-DC5.so](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.so) |
38
+ | DETR-ResNet50-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 59.187 ms | 1 - 252 MB | FP16 | NPU | [DETR-ResNet50-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.onnx) |
39
+ | DETR-ResNet50-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 38.627 ms | 5 - 135 MB | FP16 | NPU | [DETR-ResNet50-DC5.so](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.so) |
40
+ | DETR-ResNet50-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 43.477 ms | 5 - 185 MB | FP16 | NPU | [DETR-ResNet50-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.onnx) |
41
+ | DETR-ResNet50-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 30.104 ms | 5 - 137 MB | FP16 | NPU | Use Export Script |
42
+ | DETR-ResNet50-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 36.906 ms | 5 - 154 MB | FP16 | NPU | [DETR-ResNet50-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.onnx) |
43
+ | DETR-ResNet50-DC5 | SA7255P ADP | SA7255P | QNN | 1002.622 ms | 0 - 9 MB | FP16 | NPU | Use Export Script |
44
+ | DETR-ResNet50-DC5 | SA8255 (Proxy) | SA8255P Proxy | QNN | 47.159 ms | 5 - 7 MB | FP16 | NPU | Use Export Script |
45
+ | DETR-ResNet50-DC5 | SA8295P ADP | SA8295P | QNN | 62.399 ms | 1 - 19 MB | FP16 | NPU | Use Export Script |
46
+ | DETR-ResNet50-DC5 | SA8650 (Proxy) | SA8650P Proxy | QNN | 46.978 ms | 5 - 7 MB | FP16 | NPU | Use Export Script |
47
+ | DETR-ResNet50-DC5 | SA8775P ADP | SA8775P | QNN | 70.138 ms | 2 - 12 MB | FP16 | NPU | Use Export Script |
48
+ | DETR-ResNet50-DC5 | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 1002.622 ms | 0 - 9 MB | FP16 | NPU | Use Export Script |
49
+ | DETR-ResNet50-DC5 | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 46.225 ms | 5 - 7 MB | FP16 | NPU | Use Export Script |
50
+ | DETR-ResNet50-DC5 | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 70.138 ms | 2 - 12 MB | FP16 | NPU | Use Export Script |
51
+ | DETR-ResNet50-DC5 | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 61.004 ms | 5 - 116 MB | FP16 | NPU | Use Export Script |
52
+ | DETR-ResNet50-DC5 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 46.521 ms | 5 - 5 MB | FP16 | NPU | Use Export Script |
53
+ | DETR-ResNet50-DC5 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 61.192 ms | 80 - 80 MB | FP16 | NPU | [DETR-ResNet50-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet50-DC5/blob/main/DETR-ResNet50-DC5.onnx) |
 
 
 
 
 
 
 
 
 
 
 
 
54
 
55
 
56
 
 
113
  ------------------------------------------------------------
114
  DETR-ResNet50-DC5
115
  Device : Samsung Galaxy S23 (13)
116
+ Runtime : QNN
117
+ Estimated inference time (ms) : 50.8
118
+ Estimated peak memory usage (MB): [5, 33]
119
+ Total # Ops : 827
120
+ Compute Unit(s) : NPU (827 ops)
121
  ```
122
 
123