Official cross-session (Table 1) U-Net results: 3 folds x 3 seeds
Browse files- crosssession_official/results_crosssession/ALLSETUPS_SUMMARY.md +64 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed123.json +12 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed42.json +12 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed777.json +12 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed123.json +12 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed42.json +12 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed777.json +12 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed123.json +12 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed42.json +12 -0
- crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed777.json +12 -0
crosssession_official/results_crosssession/ALLSETUPS_SUMMARY.md
ADDED
|
@@ -0,0 +1,64 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# DLoc vs MobileNetV2-UNet — All Setups, Official Protocol
|
| 2 |
+
|
| 3 |
+
Both models run under identical data splits + meters metric across every runnable paper setup (Fig 10b, Table 1 folds, Fig 13b). Median / P90 / P99 in meters, mean +/- std across seeds.
|
| 4 |
+
|
| 5 |
+
|
| 6 |
+
## Fig 10b: in-distribution (Jul28) (`rw_to_rw`)
|
| 7 |
+
|
| 8 |
+
U-Net seeds: none | Baseline seeds: none
|
| 9 |
+
|
| 10 |
+
| Model | Median (m) | P90 (m) | P99 (m) |
|
| 11 |
+
|-------|-----------|---------|---------|
|
| 12 |
+
| MobileNetV2-UNet (ours) | -- | -- | -- |
|
| 13 |
+
| DLoc baseline (reproduced) | -- | -- | -- |
|
| 14 |
+
| DLoc baseline (paper, ref) | 0.64 | 1.60 | -- |
|
| 15 |
+
|
| 16 |
+
## Table 1: test Aug16_1 (furniture) (`rw_to_rw_env2`)
|
| 17 |
+
|
| 18 |
+
U-Net seeds: [42, 123, 777] | Baseline seeds: none
|
| 19 |
+
|
| 20 |
+
| Model | Median (m) | P90 (m) | P99 (m) |
|
| 21 |
+
|-------|-----------|---------|---------|
|
| 22 |
+
| MobileNetV2-UNet (ours) | 0.852 +/- 0.036 | 1.839 +/- 0.055 | 5.197 +/- 0.180 |
|
| 23 |
+
| DLoc baseline (reproduced) | -- | -- | -- |
|
| 24 |
+
| DLoc baseline (paper, ref) | 0.71 | 1.71 | -- |
|
| 25 |
+
|
| 26 |
+
## Table 1: test Aug16_3 (diff furniture) (`rw_to_rw_env3`)
|
| 27 |
+
|
| 28 |
+
U-Net seeds: [42, 123, 777] | Baseline seeds: none
|
| 29 |
+
|
| 30 |
+
| Model | Median (m) | P90 (m) | P99 (m) |
|
| 31 |
+
|-------|-----------|---------|---------|
|
| 32 |
+
| MobileNetV2-UNet (ours) | 0.822 +/- 0.032 | 2.793 +/- 0.114 | 9.457 +/- 0.445 |
|
| 33 |
+
| DLoc baseline (reproduced) | -- | -- | -- |
|
| 34 |
+
| DLoc baseline (paper, ref) | 0.82 | 2.52 | -- |
|
| 35 |
+
|
| 36 |
+
## Table 1: test Aug16_4_ref (reflector) (`rw_to_rw_env4`)
|
| 37 |
+
|
| 38 |
+
U-Net seeds: [42, 123, 777] | Baseline seeds: none
|
| 39 |
+
|
| 40 |
+
| Model | Median (m) | P90 (m) | P99 (m) |
|
| 41 |
+
|-------|-----------|---------|---------|
|
| 42 |
+
| MobileNetV2-UNet (ours) | 1.116 +/- 0.013 | 2.489 +/- 0.025 | 6.834 +/- 0.246 |
|
| 43 |
+
| DLoc baseline (reproduced) | -- | -- | -- |
|
| 44 |
+
| DLoc baseline (paper, ref) | 1.05 | 2.77 | -- |
|
| 45 |
+
|
| 46 |
+
## Fig 13b: across space (disjoint) (`data_segment`)
|
| 47 |
+
|
| 48 |
+
U-Net seeds: none | Baseline seeds: none
|
| 49 |
+
|
| 50 |
+
| Model | Median (m) | P90 (m) | P99 (m) |
|
| 51 |
+
|-------|-----------|---------|---------|
|
| 52 |
+
| MobileNetV2-UNet (ours) | -- | -- | -- |
|
| 53 |
+
| DLoc baseline (reproduced) | -- | -- | -- |
|
| 54 |
+
| DLoc baseline (paper, ref) | -- | -- | -- |
|
| 55 |
+
|
| 56 |
+
## Summary — Median (m), mean +/- std across seeds
|
| 57 |
+
|
| 58 |
+
| Fold | U-Net (ours) | Baseline (repro) | DLoc (paper) |
|
| 59 |
+
|------|--------------|------------------|--------------|
|
| 60 |
+
| Fig 10b: in-distribution (Jul28) | -- | -- | 0.64 |
|
| 61 |
+
| Table 1: test Aug16_1 (furniture) | 0.852 +/- 0.036 | -- | 0.71 |
|
| 62 |
+
| Table 1: test Aug16_3 (diff furniture) | 0.822 +/- 0.032 | -- | 0.82 |
|
| 63 |
+
| Table 1: test Aug16_4_ref (reflector) | 1.116 +/- 0.013 | -- | 1.05 |
|
| 64 |
+
| Fig 13b: across space (disjoint) | -- | -- | -- |
|
crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed123.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env2",
|
| 4 |
+
"seed": 123,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 0.806225774829855,
|
| 8 |
+
"best_p90": 1.8439088914585777,
|
| 9 |
+
"best_p99": 5.021951811795889,
|
| 10 |
+
"best_epoch": 53,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env2_seed123_2026-06-17-11-27-27"
|
| 12 |
+
}
|
crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed42.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env2",
|
| 4 |
+
"seed": 42,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 0.8544003745317532,
|
| 8 |
+
"best_p90": 1.7691806012954134,
|
| 9 |
+
"best_p99": 5.4451813560247935,
|
| 10 |
+
"best_epoch": 58,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env2_seed42_2026-06-17-05-41-52"
|
| 12 |
+
}
|
crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed777.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env2",
|
| 4 |
+
"seed": 777,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 0.894427190999916,
|
| 8 |
+
"best_p90": 1.9026297590440449,
|
| 9 |
+
"best_p99": 5.1244511901275835,
|
| 10 |
+
"best_epoch": 40,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env2_seed777_2026-06-17-16-36-49"
|
| 12 |
+
}
|
crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed123.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env3",
|
| 4 |
+
"seed": 123,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 0.7810249675906655,
|
| 8 |
+
"best_p90": 2.9154759474226504,
|
| 9 |
+
"best_p99": 9.986394092413022,
|
| 10 |
+
"best_epoch": 40,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env3_seed123_2026-06-17-12-55-12"
|
| 12 |
+
}
|
crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed42.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env3",
|
| 4 |
+
"seed": 42,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 0.8246211251235323,
|
| 8 |
+
"best_p90": 2.6400757564888173,
|
| 9 |
+
"best_p99": 8.896480723091088,
|
| 10 |
+
"best_epoch": 67,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env3_seed42_2026-06-17-07-09-47"
|
| 12 |
+
}
|
crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed777.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env3",
|
| 4 |
+
"seed": 777,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 0.8602325267042628,
|
| 8 |
+
"best_p90": 2.823118842698621,
|
| 9 |
+
"best_p99": 9.487353688259615,
|
| 10 |
+
"best_epoch": 72,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env3_seed777_2026-06-17-18-07-59"
|
| 12 |
+
}
|
crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed123.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env4",
|
| 4 |
+
"seed": 123,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 1.1,
|
| 8 |
+
"best_p90": 2.5238858928247927,
|
| 9 |
+
"best_p99": 7.100915416139971,
|
| 10 |
+
"best_epoch": 58,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env4_seed123_2026-06-17-14-25-08"
|
| 12 |
+
}
|
crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed42.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env4",
|
| 4 |
+
"seed": 42,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 1.1313708498984762,
|
| 8 |
+
"best_p90": 2.4738633753705965,
|
| 9 |
+
"best_p99": 6.508473575021384,
|
| 10 |
+
"best_epoch": 52,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env4_seed42_2026-06-17-09-21-36"
|
| 12 |
+
}
|
crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed777.json
ADDED
|
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": "unet",
|
| 3 |
+
"env": "rw_to_rw_env4",
|
| 4 |
+
"seed": 777,
|
| 5 |
+
"epochs": 120,
|
| 6 |
+
"n_params": 2409217,
|
| 7 |
+
"best_median": 1.118033988749895,
|
| 8 |
+
"best_p90": 2.4698178070456938,
|
| 9 |
+
"best_p99": 6.894042308015492,
|
| 10 |
+
"best_epoch": 63,
|
| 11 |
+
"run_dir": "./runs/unet_rw_to_rw_env4_seed777_2026-06-17-19-35-53"
|
| 12 |
+
}
|