mlboydaisuke commited on
Commit
c2635a8
Β·
verified Β·
1 Parent(s): 82ad263

card: device-verified numbers (iPhone 17 Pro re-prompt 1.3 s; tracker per-frame)

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -28,8 +28,9 @@ match's box, score, and 288Γ—288 instance mask. No server, no cloud.
28
  - **ViT-L/14 trunk @1008Β²** + tri-neck β†’ **CLIP-L text encoder** β†’ **text-conditioned DETR
29
  head** (200 queries, presence token) β€” ~830 M params.
30
  - Verified on a **Pixel 8a** (vision GPU 9.2 s / text CPU 0.5 s / head GPU 1.4 s; re-prompt
31
- 1.9 s; kept-set equal to PyTorch fp32, mask IoU β‰₯ 0.98) and on **Apple Metal** (exact with
32
- `enforce_f32`).
 
33
  - Every graph re-authoring is **exact** (corr 1.0 vs PyTorch) β€” no approximations.
34
 
35
  ![SAM 3 on-device: "car"](assets/street_car.png)
@@ -112,6 +113,9 @@ keep = np.where(prob > 0.5)[0] # boxes y[200
112
  recondition, memory bank + temporal pos-enc) is ported and verified against the official
113
  model (ids identical, mask IoU β‰₯ 0.992) β€” the executable spec and the Kotlin/Swift ports
114
  live in the **LiteRT-Models** zoo sample (`sam3/`), together with all conversion scripts.
 
 
 
115
 
116
  ## Conversion notes
117
 
 
28
  - **ViT-L/14 trunk @1008Β²** + tri-neck β†’ **CLIP-L text encoder** β†’ **text-conditioned DETR
29
  head** (200 queries, presence token) β€” ~830 M params.
30
  - Verified on a **Pixel 8a** (vision GPU 9.2 s / text CPU 0.5 s / head GPU 1.4 s; re-prompt
31
+ 1.9 s; kept-set equal to PyTorch fp32, mask IoU β‰₯ 0.98) and on an **iPhone 17 Pro**
32
+ (first prompt β‰ˆ 5.7 s; **re-prompt on the same photo β‰ˆ 1.3 s** β€” vision features are
33
+ cached per image, so changing the phrase is nearly instant).
34
  - Every graph re-authoring is **exact** (corr 1.0 vs PyTorch) β€” no approximations.
35
 
36
  ![SAM 3 on-device: "car"](assets/street_car.png)
 
113
  recondition, memory bank + temporal pos-enc) is ported and verified against the official
114
  model (ids identical, mask IoU β‰₯ 0.992) β€” the executable spec and the Kotlin/Swift ports
115
  live in the **LiteRT-Models** zoo sample (`sam3/`), together with all conversion scripts.
116
+ A 48-frame clip tracks end-to-end on an iPhone 17 Pro at β‰ˆ16.6 s/frame (vision 7.3 s,
117
+ memory attention 6.4 s, head 2.7 s on CPU, decoders <0.2 s) and at β‰ˆ2 s/frame on an
118
+ M4 Max β€” offline processing rather than real time.
119
 
120
  ## Conversion notes
121