JustAGeek commited on
Commit
295fbd7
·
verified ·
1 Parent(s): 0d58bf7

Official cross-session (Table 1) U-Net results: 3 folds x 3 seeds

Browse files
crosssession_official/results_crosssession/ALLSETUPS_SUMMARY.md ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # DLoc vs MobileNetV2-UNet — All Setups, Official Protocol
2
+
3
+ Both models run under identical data splits + meters metric across every runnable paper setup (Fig 10b, Table 1 folds, Fig 13b). Median / P90 / P99 in meters, mean +/- std across seeds.
4
+
5
+
6
+ ## Fig 10b: in-distribution (Jul28) (`rw_to_rw`)
7
+
8
+ U-Net seeds: none | Baseline seeds: none
9
+
10
+ | Model | Median (m) | P90 (m) | P99 (m) |
11
+ |-------|-----------|---------|---------|
12
+ | MobileNetV2-UNet (ours) | -- | -- | -- |
13
+ | DLoc baseline (reproduced) | -- | -- | -- |
14
+ | DLoc baseline (paper, ref) | 0.64 | 1.60 | -- |
15
+
16
+ ## Table 1: test Aug16_1 (furniture) (`rw_to_rw_env2`)
17
+
18
+ U-Net seeds: [42, 123, 777] | Baseline seeds: none
19
+
20
+ | Model | Median (m) | P90 (m) | P99 (m) |
21
+ |-------|-----------|---------|---------|
22
+ | MobileNetV2-UNet (ours) | 0.852 +/- 0.036 | 1.839 +/- 0.055 | 5.197 +/- 0.180 |
23
+ | DLoc baseline (reproduced) | -- | -- | -- |
24
+ | DLoc baseline (paper, ref) | 0.71 | 1.71 | -- |
25
+
26
+ ## Table 1: test Aug16_3 (diff furniture) (`rw_to_rw_env3`)
27
+
28
+ U-Net seeds: [42, 123, 777] | Baseline seeds: none
29
+
30
+ | Model | Median (m) | P90 (m) | P99 (m) |
31
+ |-------|-----------|---------|---------|
32
+ | MobileNetV2-UNet (ours) | 0.822 +/- 0.032 | 2.793 +/- 0.114 | 9.457 +/- 0.445 |
33
+ | DLoc baseline (reproduced) | -- | -- | -- |
34
+ | DLoc baseline (paper, ref) | 0.82 | 2.52 | -- |
35
+
36
+ ## Table 1: test Aug16_4_ref (reflector) (`rw_to_rw_env4`)
37
+
38
+ U-Net seeds: [42, 123, 777] | Baseline seeds: none
39
+
40
+ | Model | Median (m) | P90 (m) | P99 (m) |
41
+ |-------|-----------|---------|---------|
42
+ | MobileNetV2-UNet (ours) | 1.116 +/- 0.013 | 2.489 +/- 0.025 | 6.834 +/- 0.246 |
43
+ | DLoc baseline (reproduced) | -- | -- | -- |
44
+ | DLoc baseline (paper, ref) | 1.05 | 2.77 | -- |
45
+
46
+ ## Fig 13b: across space (disjoint) (`data_segment`)
47
+
48
+ U-Net seeds: none | Baseline seeds: none
49
+
50
+ | Model | Median (m) | P90 (m) | P99 (m) |
51
+ |-------|-----------|---------|---------|
52
+ | MobileNetV2-UNet (ours) | -- | -- | -- |
53
+ | DLoc baseline (reproduced) | -- | -- | -- |
54
+ | DLoc baseline (paper, ref) | -- | -- | -- |
55
+
56
+ ## Summary — Median (m), mean +/- std across seeds
57
+
58
+ | Fold | U-Net (ours) | Baseline (repro) | DLoc (paper) |
59
+ |------|--------------|------------------|--------------|
60
+ | Fig 10b: in-distribution (Jul28) | -- | -- | 0.64 |
61
+ | Table 1: test Aug16_1 (furniture) | 0.852 +/- 0.036 | -- | 0.71 |
62
+ | Table 1: test Aug16_3 (diff furniture) | 0.822 +/- 0.032 | -- | 0.82 |
63
+ | Table 1: test Aug16_4_ref (reflector) | 1.116 +/- 0.013 | -- | 1.05 |
64
+ | Fig 13b: across space (disjoint) | -- | -- | -- |
crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed123.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env2",
4
+ "seed": 123,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 0.806225774829855,
8
+ "best_p90": 1.8439088914585777,
9
+ "best_p99": 5.021951811795889,
10
+ "best_epoch": 53,
11
+ "run_dir": "./runs/unet_rw_to_rw_env2_seed123_2026-06-17-11-27-27"
12
+ }
crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed42.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env2",
4
+ "seed": 42,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 0.8544003745317532,
8
+ "best_p90": 1.7691806012954134,
9
+ "best_p99": 5.4451813560247935,
10
+ "best_epoch": 58,
11
+ "run_dir": "./runs/unet_rw_to_rw_env2_seed42_2026-06-17-05-41-52"
12
+ }
crosssession_official/results_crosssession/unet_rw_to_rw_env2_seed777.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env2",
4
+ "seed": 777,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 0.894427190999916,
8
+ "best_p90": 1.9026297590440449,
9
+ "best_p99": 5.1244511901275835,
10
+ "best_epoch": 40,
11
+ "run_dir": "./runs/unet_rw_to_rw_env2_seed777_2026-06-17-16-36-49"
12
+ }
crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed123.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env3",
4
+ "seed": 123,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 0.7810249675906655,
8
+ "best_p90": 2.9154759474226504,
9
+ "best_p99": 9.986394092413022,
10
+ "best_epoch": 40,
11
+ "run_dir": "./runs/unet_rw_to_rw_env3_seed123_2026-06-17-12-55-12"
12
+ }
crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed42.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env3",
4
+ "seed": 42,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 0.8246211251235323,
8
+ "best_p90": 2.6400757564888173,
9
+ "best_p99": 8.896480723091088,
10
+ "best_epoch": 67,
11
+ "run_dir": "./runs/unet_rw_to_rw_env3_seed42_2026-06-17-07-09-47"
12
+ }
crosssession_official/results_crosssession/unet_rw_to_rw_env3_seed777.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env3",
4
+ "seed": 777,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 0.8602325267042628,
8
+ "best_p90": 2.823118842698621,
9
+ "best_p99": 9.487353688259615,
10
+ "best_epoch": 72,
11
+ "run_dir": "./runs/unet_rw_to_rw_env3_seed777_2026-06-17-18-07-59"
12
+ }
crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed123.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env4",
4
+ "seed": 123,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 1.1,
8
+ "best_p90": 2.5238858928247927,
9
+ "best_p99": 7.100915416139971,
10
+ "best_epoch": 58,
11
+ "run_dir": "./runs/unet_rw_to_rw_env4_seed123_2026-06-17-14-25-08"
12
+ }
crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed42.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env4",
4
+ "seed": 42,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 1.1313708498984762,
8
+ "best_p90": 2.4738633753705965,
9
+ "best_p99": 6.508473575021384,
10
+ "best_epoch": 52,
11
+ "run_dir": "./runs/unet_rw_to_rw_env4_seed42_2026-06-17-09-21-36"
12
+ }
crosssession_official/results_crosssession/unet_rw_to_rw_env4_seed777.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "unet",
3
+ "env": "rw_to_rw_env4",
4
+ "seed": 777,
5
+ "epochs": 120,
6
+ "n_params": 2409217,
7
+ "best_median": 1.118033988749895,
8
+ "best_p90": 2.4698178070456938,
9
+ "best_p99": 6.894042308015492,
10
+ "best_epoch": 63,
11
+ "run_dir": "./runs/unet_rw_to_rw_env4_seed777_2026-06-17-19-35-53"
12
+ }