Replace SurgMotion-ONNX with 5D tubelet export (README.md)
Browse files
models/SurgMotion-ONNX/README.md
CHANGED
|
@@ -5,15 +5,15 @@ Compliance-facing ONNX distribution for the SurgMotion ViT-S doctor-demo encoder
|
|
| 5 |
## Model
|
| 6 |
|
| 7 |
- **Product name:** SurgMotion-ONNX
|
| 8 |
-
- **Architecture:** SurgMotion ViT-S/16 video backbone (`tubelet_size=2`, SDS
|
| 9 |
- **Checkpoint source:** `/home/chen_chuxi/NSJepa_jinlin/ckpts/SurgMotion-vits.pt`
|
| 10 |
- **Intended use:** Offline/online surgical phase feature extraction in the SurgMotion Agent demo
|
| 11 |
-
- **Input:** `pixel_values` float32 `[batch, 3, 224, 224]` with ImageNet normalization
|
| 12 |
- **Primary output used by SurgMotion:** `last_hidden_state` → drop CLS token → mean pool → 384-d clip feature
|
| 13 |
|
| 14 |
## Provenance
|
| 15 |
|
| 16 |
-
Exported from SurgMotion ViT-S encoder weights in the bundled pretraining checkpoint. External ONNX I/O
|
| 17 |
|
| 18 |
## Files
|
| 19 |
|
|
|
|
| 5 |
## Model
|
| 6 |
|
| 7 |
- **Product name:** SurgMotion-ONNX
|
| 8 |
+
- **Architecture:** SurgMotion ViT-S/16 video backbone (`tubelet_size=2`, SDS prev+current frame pair)
|
| 9 |
- **Checkpoint source:** `/home/chen_chuxi/NSJepa_jinlin/ckpts/SurgMotion-vits.pt`
|
| 10 |
- **Intended use:** Offline/online surgical phase feature extraction in the SurgMotion Agent demo
|
| 11 |
+
- **Input:** `pixel_values` float32 `[batch, 3, 2, 224, 224]` with ImageNet normalization (time dim: prev, current)
|
| 12 |
- **Primary output used by SurgMotion:** `last_hidden_state` → drop CLS token → mean pool → 384-d clip feature
|
| 13 |
|
| 14 |
## Provenance
|
| 15 |
|
| 16 |
+
Exported from SurgMotion ViT-S encoder weights in the bundled pretraining checkpoint. External ONNX I/O expects a 2-frame tubelet (`pixel_values` shape [B,3,2,224,224]) with the selected sample frame and its immediate previous frame.
|
| 17 |
|
| 18 |
## Files
|
| 19 |
|