Image Segmentation
LiteRT
LiteRT
android
on-device
gpu
portrait-matting
image-matting
background-removal
modnet
real-time
Instructions to use litert-community/MODNet-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use litert-community/MODNet-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Card: add a measured Performance table (Pixel 8a, benchmark_model GPU+CPU), naming the runtime for each row
Browse files
README.md
CHANGED
|
@@ -84,6 +84,18 @@ alpha = it.get_tensor(out[0]["index"])[0, 0] # [512,512] in [0,1]
|
|
| 84 |
Converted with **litert-torch** (`build_modnet.py`): loads the trained MODNet weights,
|
| 85 |
applies the two patches (SE 1×1-conv, SafeInstanceNorm), and exports.
|
| 86 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 87 |
## License
|
| 88 |
|
| 89 |
Apache-2.0 (MODNet / ZHKKKe/MODNet).
|
|
|
|
| 84 |
Converted with **litert-torch** (`build_modnet.py`): loads the trained MODNet weights,
|
| 85 |
applies the two patches (SE 1×1-conv, SafeInstanceNorm), and exports.
|
| 86 |
|
| 87 |
+
## Performance
|
| 88 |
+
|
| 89 |
+
Measured on a **Pixel 8a** (Tensor G3, Android 16) with the standard TFLite [`benchmark_model`](https://ai.google.dev/edge/litert/models/measurement) tool — 10 warm-up runs then 50 timed runs, reported as the tool's mean.
|
| 90 |
+
|
| 91 |
+
| Runtime | Backend | Graph on GPU | Latency |
|
| 92 |
+
|---|---|---|---|
|
| 93 |
+
| LiteRT `CompiledModel` (`LITERT_CL`) | GPU | — | ~79 ms |
|
| 94 |
+
| TFLite `benchmark_model` (`TfLiteGpuDelegateV2`) | GPU (OpenCL) | 551 / 551 | 59.6 ms |
|
| 95 |
+
| TFLite `benchmark_model` | CPU (XNNPACK, 4 threads) | — | 418.9 ms |
|
| 96 |
+
|
| 97 |
+
**The two GPU rows are different runtimes, not a contradiction.** The `LITERT_CL` figure is the one recorded when this model shipped, taken through LiteRT's own `CompiledModel` accelerator — the path the Kotlin sample app and the LiteRT API use. The `TfLiteGpuDelegateV2` figure is the classic TFLite OpenCL delegate, measured with a tool anyone can download and re-run. They agree on how much of the graph the GPU takes; they disagree on speed, and the classic delegate is the slower of the two here. Read the `TfLiteGpuDelegateV2` row as a reproducible floor, not as this model's speed on LiteRT.
|
| 98 |
+
|
| 99 |
## License
|
| 100 |
|
| 101 |
Apache-2.0 (MODNet / ZHKKKe/MODNet).
|