qaihm-bot commited on
Commit
75506fd
·
verified ·
1 Parent(s): 5d6bf48

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +22 -34
README.md CHANGED
@@ -34,35 +34,23 @@ More details on model performance across various devices, can be found
34
 
35
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
36
  |---|---|---|---|---|---|---|---|---|
37
- | DETR-ResNet101-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | TFLITE | 55.766 ms | 0 - 35 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
38
- | DETR-ResNet101-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 54.139 ms | 5 - 7 MB | FP16 | NPU | [DETR-ResNet101-DC5.so](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.so) |
39
- | DETR-ResNet101-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 65.505 ms | 1 - 333 MB | FP16 | NPU | [DETR-ResNet101-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.onnx) |
40
- | DETR-ResNet101-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | TFLITE | 41.701 ms | 0 - 218 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
41
- | DETR-ResNet101-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 40.024 ms | 5 - 23 MB | FP16 | NPU | [DETR-ResNet101-DC5.so](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.so) |
42
- | DETR-ResNet101-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 48.381 ms | 5 - 204 MB | FP16 | NPU | [DETR-ResNet101-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.onnx) |
43
- | DETR-ResNet101-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | TFLITE | 38.966 ms | 0 - 205 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
44
- | DETR-ResNet101-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 40.257 ms | 13 - 166 MB | FP16 | NPU | Use Export Script |
45
- | DETR-ResNet101-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 42.698 ms | 5 - 174 MB | FP16 | NPU | [DETR-ResNet101-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.onnx) |
46
- | DETR-ResNet101-DC5 | SA7255P ADP | SA7255P | TFLITE | 1373.215 ms | 0 - 203 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
47
- | DETR-ResNet101-DC5 | SA7255P ADP | SA7255P | QNN | 1370.327 ms | 5 - 14 MB | FP16 | NPU | Use Export Script |
48
- | DETR-ResNet101-DC5 | SA8255 (Proxy) | SA8255P Proxy | TFLITE | 56.061 ms | 0 - 36 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
49
- | DETR-ResNet101-DC5 | SA8255 (Proxy) | SA8255P Proxy | QNN | 54.025 ms | 7 - 8 MB | FP16 | NPU | Use Export Script |
50
- | DETR-ResNet101-DC5 | SA8295P ADP | SA8295P | TFLITE | 78.316 ms | 0 - 165 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
51
- | DETR-ResNet101-DC5 | SA8295P ADP | SA8295P | QNN | 75.583 ms | 0 - 17 MB | FP16 | NPU | Use Export Script |
52
- | DETR-ResNet101-DC5 | SA8650 (Proxy) | SA8650P Proxy | TFLITE | 55.64 ms | 0 - 34 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
53
- | DETR-ResNet101-DC5 | SA8650 (Proxy) | SA8650P Proxy | QNN | 53.491 ms | 5 - 7 MB | FP16 | NPU | Use Export Script |
54
- | DETR-ResNet101-DC5 | SA8775P ADP | SA8775P | TFLITE | 88.567 ms | 0 - 202 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
55
- | DETR-ResNet101-DC5 | SA8775P ADP | SA8775P | QNN | 85.08 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
56
- | DETR-ResNet101-DC5 | QCS8275 (Proxy) | QCS8275 Proxy | TFLITE | 1373.215 ms | 0 - 203 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
57
- | DETR-ResNet101-DC5 | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 1370.327 ms | 5 - 14 MB | FP16 | NPU | Use Export Script |
58
- | DETR-ResNet101-DC5 | QCS8550 (Proxy) | QCS8550 Proxy | TFLITE | 55.62 ms | 0 - 34 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
59
- | DETR-ResNet101-DC5 | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 54.051 ms | 5 - 7 MB | FP16 | NPU | Use Export Script |
60
- | DETR-ResNet101-DC5 | QCS9075 (Proxy) | QCS9075 Proxy | TFLITE | 88.567 ms | 0 - 202 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
61
- | DETR-ResNet101-DC5 | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 85.08 ms | 0 - 10 MB | FP16 | NPU | Use Export Script |
62
- | DETR-ResNet101-DC5 | QCS8450 (Proxy) | QCS8450 Proxy | TFLITE | 70.205 ms | 0 - 176 MB | FP16 | NPU | [DETR-ResNet101-DC5.tflite](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.tflite) |
63
- | DETR-ResNet101-DC5 | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 73.158 ms | 5 - 112 MB | FP16 | NPU | Use Export Script |
64
- | DETR-ResNet101-DC5 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 53.233 ms | 5 - 5 MB | FP16 | NPU | Use Export Script |
65
- | DETR-ResNet101-DC5 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 67.327 ms | 117 - 117 MB | FP16 | NPU | [DETR-ResNet101-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.onnx) |
66
 
67
 
68
 
@@ -125,11 +113,11 @@ Profiling Results
125
  ------------------------------------------------------------
126
  DETR-ResNet101-DC5
127
  Device : Samsung Galaxy S23 (13)
128
- Runtime : TFLITE
129
- Estimated inference time (ms) : 55.8
130
- Estimated peak memory usage (MB): [0, 35]
131
- Total # Ops : 873
132
- Compute Unit(s) : NPU (873 ops)
133
  ```
134
 
135
 
 
34
 
35
  | Model | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
36
  |---|---|---|---|---|---|---|---|---|
37
+ | DETR-ResNet101-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | QNN | 58.185 ms | 5 - 40 MB | FP16 | NPU | [DETR-ResNet101-DC5.so](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.so) |
38
+ | DETR-ResNet101-DC5 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 | ONNX | 65.786 ms | 1 - 333 MB | FP16 | NPU | [DETR-ResNet101-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.onnx) |
39
+ | DETR-ResNet101-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | QNN | 43.108 ms | 0 - 152 MB | FP16 | NPU | [DETR-ResNet101-DC5.so](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.so) |
40
+ | DETR-ResNet101-DC5 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 | ONNX | 48.258 ms | 5 - 205 MB | FP16 | NPU | [DETR-ResNet101-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.onnx) |
41
+ | DETR-ResNet101-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | QNN | 40.182 ms | 5 - 157 MB | FP16 | NPU | Use Export Script |
42
+ | DETR-ResNet101-DC5 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite | ONNX | 37.042 ms | 5 - 173 MB | FP16 | NPU | [DETR-ResNet101-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.onnx) |
43
+ | DETR-ResNet101-DC5 | SA7255P ADP | SA7255P | QNN | 1370.229 ms | 2 - 11 MB | FP16 | NPU | Use Export Script |
44
+ | DETR-ResNet101-DC5 | SA8255 (Proxy) | SA8255P Proxy | QNN | 54.318 ms | 5 - 8 MB | FP16 | NPU | Use Export Script |
45
+ | DETR-ResNet101-DC5 | SA8295P ADP | SA8295P | QNN | 75.619 ms | 0 - 17 MB | FP16 | NPU | Use Export Script |
46
+ | DETR-ResNet101-DC5 | SA8650 (Proxy) | SA8650P Proxy | QNN | 54.242 ms | 5 - 7 MB | FP16 | NPU | Use Export Script |
47
+ | DETR-ResNet101-DC5 | SA8775P ADP | SA8775P | QNN | 85.077 ms | 2 - 12 MB | FP16 | NPU | Use Export Script |
48
+ | DETR-ResNet101-DC5 | QCS8275 (Proxy) | QCS8275 Proxy | QNN | 1370.229 ms | 2 - 11 MB | FP16 | NPU | Use Export Script |
49
+ | DETR-ResNet101-DC5 | QCS8550 (Proxy) | QCS8550 Proxy | QNN | 53.279 ms | 5 - 8 MB | FP16 | NPU | Use Export Script |
50
+ | DETR-ResNet101-DC5 | QCS9075 (Proxy) | QCS9075 Proxy | QNN | 85.077 ms | 2 - 12 MB | FP16 | NPU | Use Export Script |
51
+ | DETR-ResNet101-DC5 | QCS8450 (Proxy) | QCS8450 Proxy | QNN | 72.525 ms | 5 - 114 MB | FP16 | NPU | Use Export Script |
52
+ | DETR-ResNet101-DC5 | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN | 53.346 ms | 5 - 5 MB | FP16 | NPU | Use Export Script |
53
+ | DETR-ResNet101-DC5 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 67.335 ms | 117 - 117 MB | FP16 | NPU | [DETR-ResNet101-DC5.onnx](https://huggingface.co/qualcomm/DETR-ResNet101-DC5/blob/main/DETR-ResNet101-DC5.onnx) |
 
 
 
 
 
 
 
 
 
 
 
 
54
 
55
 
56
 
 
113
  ------------------------------------------------------------
114
  DETR-ResNet101-DC5
115
  Device : Samsung Galaxy S23 (13)
116
+ Runtime : QNN
117
+ Estimated inference time (ms) : 58.2
118
+ Estimated peak memory usage (MB): [5, 40]
119
+ Total # Ops : 946
120
+ Compute Unit(s) : NPU (946 ops)
121
  ```
122
 
123