Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -35,8 +35,8 @@ More details on model performance across various devices, can be found
|
|
| 35 |
|
| 36 |
| Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
|
| 37 |
| ---|---|---|---|---|---|---|---|
|
| 38 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 48.
|
| 39 |
-
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite |
|
| 40 |
|
| 41 |
|
| 42 |
|
|
@@ -98,17 +98,17 @@ python -m qai_hub_models.models.sam.export
|
|
| 98 |
```
|
| 99 |
Profile Job summary of SAMDecoder
|
| 100 |
--------------------------------------------------
|
| 101 |
-
Device:
|
| 102 |
-
Estimated Inference Time:
|
| 103 |
-
Estimated Peak Memory Range: 3.
|
| 104 |
-
Compute Units: NPU (
|
| 105 |
|
| 106 |
Profile Job summary of SAMEncoder
|
| 107 |
--------------------------------------------------
|
| 108 |
Device: QCS8550 (Proxy) (12)
|
| 109 |
-
Estimated Inference Time:
|
| 110 |
-
Estimated Peak Memory Range:
|
| 111 |
-
Compute Units: GPU (37),CPU (
|
| 112 |
|
| 113 |
|
| 114 |
```
|
|
@@ -133,7 +133,6 @@ from qai_hub_models.models.sam import Model
|
|
| 133 |
|
| 134 |
# Load the model
|
| 135 |
torch_model = Model.from_pretrained()
|
| 136 |
-
torch_model.eval()
|
| 137 |
|
| 138 |
# Device
|
| 139 |
device = hub.Device("Samsung Galaxy S23")
|
|
|
|
| 35 |
|
| 36 |
| Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Precision | Primary Compute Unit | Target Model
|
| 37 |
| ---|---|---|---|---|---|---|---|
|
| 38 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 48.549 ms | 4 - 13 MB | FP16 | NPU | [SAMDecoder.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMDecoder.tflite)
|
| 39 |
+
| Samsung Galaxy S23 Ultra (Android 13) | Snapdragon® 8 Gen 2 | TFLite | 11689.749 ms | 2538 - 2547 MB | FP32 | CPU | [SAMEncoder.tflite](https://huggingface.co/qualcomm/Segment-Anything-Model/blob/main/SAMEncoder.tflite)
|
| 40 |
|
| 41 |
|
| 42 |
|
|
|
|
| 98 |
```
|
| 99 |
Profile Job summary of SAMDecoder
|
| 100 |
--------------------------------------------------
|
| 101 |
+
Device: SA8775 (Proxy) (13)
|
| 102 |
+
Estimated Inference Time: 47.98 ms
|
| 103 |
+
Estimated Peak Memory Range: 3.85-6.72 MB
|
| 104 |
+
Compute Units: NPU (341) | Total (341)
|
| 105 |
|
| 106 |
Profile Job summary of SAMEncoder
|
| 107 |
--------------------------------------------------
|
| 108 |
Device: QCS8550 (Proxy) (12)
|
| 109 |
+
Estimated Inference Time: 11668.45 ms
|
| 110 |
+
Estimated Peak Memory Range: 2593.73-2598.27 MB
|
| 111 |
+
Compute Units: GPU (37),CPU (783) | Total (820)
|
| 112 |
|
| 113 |
|
| 114 |
```
|
|
|
|
| 133 |
|
| 134 |
# Load the model
|
| 135 |
torch_model = Model.from_pretrained()
|
|
|
|
| 136 |
|
| 137 |
# Device
|
| 138 |
device = hub.Device("Samsung Galaxy S23")
|