CAIR-HKISI commited on
Commit
b2e6900
·
verified ·
1 Parent(s): b5c7f65

Replace SurgMotion-ONNX with 5D tubelet export (README.md)

Browse files
Files changed (1) hide show
  1. models/SurgMotion-ONNX/README.md +3 -3
models/SurgMotion-ONNX/README.md CHANGED
@@ -5,15 +5,15 @@ Compliance-facing ONNX distribution for the SurgMotion ViT-S doctor-demo encoder
5
  ## Model
6
 
7
  - **Product name:** SurgMotion-ONNX
8
- - **Architecture:** SurgMotion ViT-S/16 video backbone (`tubelet_size=2`, SDS single-frame input duplicated internally)
9
  - **Checkpoint source:** `/home/chen_chuxi/NSJepa_jinlin/ckpts/SurgMotion-vits.pt`
10
  - **Intended use:** Offline/online surgical phase feature extraction in the SurgMotion Agent demo
11
- - **Input:** `pixel_values` float32 `[batch, 3, 224, 224]` with ImageNet normalization
12
  - **Primary output used by SurgMotion:** `last_hidden_state` → drop CLS token → mean pool → 384-d clip feature
13
 
14
  ## Provenance
15
 
16
- Exported from SurgMotion ViT-S encoder weights in the bundled pretraining checkpoint. External ONNX I/O matches the doctor-demo bundle (`pixel_values` single RGB frame). Internally the exporter duplicates the frame once to satisfy `tubelet_size=2` while keeping the SDS/ONNX runtime contract unchanged.
17
 
18
  ## Files
19
 
 
5
  ## Model
6
 
7
  - **Product name:** SurgMotion-ONNX
8
+ - **Architecture:** SurgMotion ViT-S/16 video backbone (`tubelet_size=2`, SDS prev+current frame pair)
9
  - **Checkpoint source:** `/home/chen_chuxi/NSJepa_jinlin/ckpts/SurgMotion-vits.pt`
10
  - **Intended use:** Offline/online surgical phase feature extraction in the SurgMotion Agent demo
11
+ - **Input:** `pixel_values` float32 `[batch, 3, 2, 224, 224]` with ImageNet normalization (time dim: prev, current)
12
  - **Primary output used by SurgMotion:** `last_hidden_state` → drop CLS token → mean pool → 384-d clip feature
13
 
14
  ## Provenance
15
 
16
+ Exported from SurgMotion ViT-S encoder weights in the bundled pretraining checkpoint. External ONNX I/O expects a 2-frame tubelet (`pixel_values` shape [B,3,2,224,224]) with the selected sample frame and its immediate previous frame.
17
 
18
  ## Files
19