Image Segmentation
LiteRT
LiteRT
android
ios
on-device
open-vocabulary
object-detection
instance-segmentation
segment-anything
Instructions to use mlboydaisuke/SAM3-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use mlboydaisuke/SAM3-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
card: device-verified numbers (iPhone 17 Pro re-prompt 1.3 s; tracker per-frame)
Browse files
README.md
CHANGED
|
@@ -28,8 +28,9 @@ match's box, score, and 288Γ288 instance mask. No server, no cloud.
|
|
| 28 |
- **ViT-L/14 trunk @1008Β²** + tri-neck β **CLIP-L text encoder** β **text-conditioned DETR
|
| 29 |
head** (200 queries, presence token) β ~830 M params.
|
| 30 |
- Verified on a **Pixel 8a** (vision GPU 9.2 s / text CPU 0.5 s / head GPU 1.4 s; re-prompt
|
| 31 |
-
1.9 s; kept-set equal to PyTorch fp32, mask IoU β₯ 0.98) and on
|
| 32 |
-
|
|
|
|
| 33 |
- Every graph re-authoring is **exact** (corr 1.0 vs PyTorch) β no approximations.
|
| 34 |
|
| 35 |

|
|
@@ -112,6 +113,9 @@ keep = np.where(prob > 0.5)[0] # boxes y[200
|
|
| 112 |
recondition, memory bank + temporal pos-enc) is ported and verified against the official
|
| 113 |
model (ids identical, mask IoU β₯ 0.992) β the executable spec and the Kotlin/Swift ports
|
| 114 |
live in the **LiteRT-Models** zoo sample (`sam3/`), together with all conversion scripts.
|
|
|
|
|
|
|
|
|
|
| 115 |
|
| 116 |
## Conversion notes
|
| 117 |
|
|
|
|
| 28 |
- **ViT-L/14 trunk @1008Β²** + tri-neck β **CLIP-L text encoder** β **text-conditioned DETR
|
| 29 |
head** (200 queries, presence token) β ~830 M params.
|
| 30 |
- Verified on a **Pixel 8a** (vision GPU 9.2 s / text CPU 0.5 s / head GPU 1.4 s; re-prompt
|
| 31 |
+
1.9 s; kept-set equal to PyTorch fp32, mask IoU β₯ 0.98) and on an **iPhone 17 Pro**
|
| 32 |
+
(first prompt β 5.7 s; **re-prompt on the same photo β 1.3 s** β vision features are
|
| 33 |
+
cached per image, so changing the phrase is nearly instant).
|
| 34 |
- Every graph re-authoring is **exact** (corr 1.0 vs PyTorch) β no approximations.
|
| 35 |
|
| 36 |

|
|
|
|
| 113 |
recondition, memory bank + temporal pos-enc) is ported and verified against the official
|
| 114 |
model (ids identical, mask IoU β₯ 0.992) β the executable spec and the Kotlin/Swift ports
|
| 115 |
live in the **LiteRT-Models** zoo sample (`sam3/`), together with all conversion scripts.
|
| 116 |
+
A 48-frame clip tracks end-to-end on an iPhone 17 Pro at β16.6 s/frame (vision 7.3 s,
|
| 117 |
+
memory attention 6.4 s, head 2.7 s on CPU, decoders <0.2 s) and at β2 s/frame on an
|
| 118 |
+
M4 Max β offline processing rather than real time.
|
| 119 |
|
| 120 |
## Conversion notes
|
| 121 |
|