| --- |
| license: mit |
| tags: |
| - object-permanence |
| - object-centric-learning |
| - slot-attention |
| --- |
| |
| # iSEE checkpoints |
|
|
| Every checkpoint the iSEE paper's tables and figures read: 35 files, 2.15 GB. Code, configs and the converted release weights: [insait-institute/iSEE](https://github.com/insait-institute/iSEE). |
|
|
| RandSF.Q and Loci-Looped were trained by us with their authors' code. Each folder also holds the config of the run that produced its checkpoint (`settings.yaml`, `args.json`, `cfg.json`, `config.py`). |
|
|
| `checkpoints.tsv` lists, for every file: md5, size, its original cluster path and the paper tables and figures that use it. |
|
|
| ## LA-CATER, static camera |
|
|
| | file | what | size (MB) | |
| | --- | --- | --- | |
| | `lacater_static/isee/encoder_step100000.ckpt` | iSEE encoder | 122.9 | |
| | `lacater_static/isee/walker_s0_step2000.pt` | iSEE walker, seed 0 | 1.4 | |
| | `lacater_static/isee/walker_s1_step2000.pt` | iSEE walker, seed 1 | 1.4 | |
| | `lacater_static/isee/walker_s2_step2000.pt` | iSEE walker, seed 2 | 1.4 | |
| | `lacater_static/isee_fig1a/walker_vis_s0_step2000.pt` | visibility walker, seed 0 (Fig. 1a only) | 1.4 | |
| | `lacater_static/isee_fig1a/walker_vis_s1_step2000.pt` | visibility walker, seed 1 (Fig. 1a only) | 1.4 | |
| | `lacater_static/isee_fig1a/walker_vis_s2_step2000.pt` | visibility walker, seed 2 (Fig. 1a only) | 1.4 | |
| | `lacater_static/slotcontrast/step100000.ckpt` | SlotContrast baseline | 125.7 | |
| | `lacater_static/ablations/isee_dino/step100000.ckpt` | ablation (tab:ablation): iSEE on stock DINOv2 | 125.0 | |
| | `lacater_static/ablations/isee_noapp/step100000.ckpt` | ablation (tab:sga): trained without sg(a) | 122.9 | |
| | `lacater_static/ablations/isee_ssall/step100000.ckpt` | ablation (tab:ssc-scope): slot-slot contrast on the whole slot | 122.9 | |
| | `lacater_static/ablations/pre4_twostream/step100000.ckpt` | earlier two-stream encoder behind the case counts of tab:cases | 122.9 | |
| | `lacater_static/randsfq/0042.pth` | RandSF.Q, trained by us | 139.7 | |
| | `lacater_static/loci_looped/net_900000.pt` | Loci-Looped, trained by us, step 900k | 33.5 | |
|
|
| ## LA-CATER, moving camera |
|
|
| | file | what | size (MB) | |
| | --- | --- | --- | |
| | `lacater_moving/isee/encoder_step100000.ckpt` | iSEE encoder | 122.9 | |
| | `lacater_moving/isee/walker_s0_step2000.pt` | iSEE walker, seed 0 | 1.4 | |
| | `lacater_moving/isee/walker_s1_step2000.pt` | iSEE walker, seed 1 | 1.4 | |
| | `lacater_moving/isee/walker_s2_step2000.pt` | iSEE walker, seed 2 | 1.4 | |
| | `lacater_moving/slotcontrast/step100000.ckpt` | SlotContrast baseline | 125.7 | |
| | `lacater_moving/randsfq/0042.pth` | RandSF.Q, trained by us | 139.7 | |
| | `lacater_moving/loci_looped/net_170000.pt` | Loci-Looped, trained by us, step 170k | 44.1 | |
|
|
| ## KITTI tracking |
|
|
| | file | what | size (MB) | |
| | --- | --- | --- | |
| | `kitti/isee/encoder_step22500.ckpt` | iSEE encoder, step 22.5k (tables) | 122.8 | |
| | `kitti/isee/encoder_step100000.ckpt` | iSEE encoder, step 100k (qualitative figure) | 122.8 | |
| | `kitti/isee/walker_seed0/walker_sd.pt` | iSEE walker trained on pseudo-occlusions | 0.4 | |
| | `kitti/isee/walker_seed0/ema_step800.pt` | iSEE walker, EMA weights at step 800 | 0.4 | |
| | `kitti/slotcontrast/step22500.ckpt` | SlotContrast baseline, step 22.5k (tables) | 125.3 | |
| | `kitti/slotcontrast/step100000.ckpt` | SlotContrast baseline, step 100k (qualitative figure) | 125.3 | |
|
|
| ## MOVi-C |
|
|
| | file | what | size (MB) | |
| | --- | --- | --- | |
| | `movi_c/isee/encoder_best.ckpt` | iSEE encoder (discovery tables) | 36.5 | |
| | `movi_c/isee/encoder_best.live.ckpt` | iSEE encoder, live copy read by the dynamics pipeline | 98.5 | |
| | `movi_c/slotcontrast/best.ckpt` | SlotContrast baseline (discovery tables) | 36.8 | |
| | `movi_c/slotcontrast/best.live.ckpt` | SlotContrast, live copy read by the dynamics pipeline | 100.6 | |
| | `movi_c/dynamics/ocvp_act_isee_step30000.pt` | dynamics on iSEE slots (dynamics table) | 4.4 | |
| | `movi_c/dynamics/ocvp_act_slotcontrast_step30000.pt` | dynamics on SlotContrast slots (dynamics table) | 4.4 | |
| | `movi_c/dynamics/dynloc_isee_step30000.pt` | dynamics with position stream, iSEE (dynamics figure) | 4.4 | |
| | `movi_c/dynamics/dynloc_slotcontrast_step30000.pt` | dynamics with position stream, SlotContrast | 4.4 | |
|
|
