Image Classification
LiteRT
LiteRT
ram
ram-plus
recognize-anything
image-tagging
multi-label
open-vocabulary
swin
on-device
gpu
Instructions to use litert-community/RAM-Plus-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use litert-community/RAM-Plus-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Card: correct the GPU node counts — the previous figures added the XNNPACK fallback partition to the GPU delegate partition
Browse files
README.md
CHANGED
|
@@ -116,10 +116,10 @@ Measured on a **Pixel 8a** (Tensor G3, Android 16) with the standard TFLite [`be
|
|
| 116 |
|
| 117 |
| Runtime | Backend | Graph on GPU | Latency |
|
| 118 |
|---|---|---|---|
|
| 119 |
-
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) — `ram_taghead_fp16.tflite` | GPU (OpenCL) |
|
| 120 |
-
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) — `ram_reweight_fp16.tflite` | GPU (OpenCL) |
|
| 121 |
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) — `ram_swin_s012_fp16.tflite` | GPU (OpenCL) | 105 / 2129 | did not run |
|
| 122 |
-
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) — `ram_stage3_tail_fp16.tflite` | GPU (OpenCL) |
|
| 123 |
| TFLite `benchmark_model` — `ram_taghead_fp16.tflite` | CPU (XNNPACK, 4 threads) | — | 1550.1 ms |
|
| 124 |
| TFLite `benchmark_model` — `ram_reweight_fp16.tflite` | CPU (XNNPACK, 4 threads) | — | 312.8 ms |
|
| 125 |
| TFLite `benchmark_model` — `ram_swin_s012_fp16.tflite` | CPU (XNNPACK, 4 threads) | — | 2786.9 ms |
|
|
@@ -129,5 +129,5 @@ Measured on a **Pixel 8a** (Tensor G3, Android 16) with the standard TFLite [`be
|
|
| 129 |
|
| 130 |
On this delegate the CPU is the faster choice for `ram_taghead_fp16.tflite` (1550.1 ms on CPU against 3499.7 ms on GPU), `ram_reweight_fp16.tflite` (312.8 ms on CPU against 612.0 ms on GPU), `ram_stage3_tail_fp16.tflite` (217.0 ms on CPU against 523.5 ms on GPU) — worth knowing before you reach for the GPU on a mid-range phone.
|
| 131 |
|
| 132 |
-
Note that the GPU does not take the whole graph here (
|
| 133 |
|
|
|
|
| 116 |
|
| 117 |
| Runtime | Backend | Graph on GPU | Latency |
|
| 118 |
|---|---|---|---|
|
| 119 |
+
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) — `ram_taghead_fp16.tflite` | GPU (OpenCL) | 30 / 139 | 3499.7 ms |
|
| 120 |
+
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) — `ram_reweight_fp16.tflite` | GPU (OpenCL) | 9 / 18 | 612.0 ms |
|
| 121 |
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) — `ram_swin_s012_fp16.tflite` | GPU (OpenCL) | 105 / 2129 | did not run |
|
| 122 |
+
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) — `ram_stage3_tail_fp16.tflite` | GPU (OpenCL) | 41 / 178 | 523.5 ms |
|
| 123 |
| TFLite `benchmark_model` — `ram_taghead_fp16.tflite` | CPU (XNNPACK, 4 threads) | — | 1550.1 ms |
|
| 124 |
| TFLite `benchmark_model` — `ram_reweight_fp16.tflite` | CPU (XNNPACK, 4 threads) | — | 312.8 ms |
|
| 125 |
| TFLite `benchmark_model` — `ram_swin_s012_fp16.tflite` | CPU (XNNPACK, 4 threads) | — | 2786.9 ms |
|
|
|
|
| 129 |
|
| 130 |
On this delegate the CPU is the faster choice for `ram_taghead_fp16.tflite` (1550.1 ms on CPU against 3499.7 ms on GPU), `ram_reweight_fp16.tflite` (312.8 ms on CPU against 612.0 ms on GPU), `ram_stage3_tail_fp16.tflite` (217.0 ms on CPU against 523.5 ms on GPU) — worth knowing before you reach for the GPU on a mid-range phone.
|
| 131 |
|
| 132 |
+
Note that the GPU does not take the whole graph here (30 / 139 in `ram_taghead_fp16.tflite`, 9 / 18 in `ram_reweight_fp16.tflite`, 105 / 2129 in `ram_swin_s012_fp16.tflite`, 41 / 178 in `ram_stage3_tail_fp16.tflite`); the remainder runs on the CPU and the split costs a per-partition round trip.
|
| 133 |
|