Upload raw results and tables

README.md

@@ -1,3 +1,18 @@
----
-license: apache-2.0
----
+# Results Organized for Paper
+
+This folder contains only the selected ckpt3500 ours outputs plus baseline method outputs. No ckpt8000 outputs are included.
+
+## Structure
+
+- `raw/{dataset}/{method}/`: moved raw prediction outputs for each method.
+- `raw/{dataset}/ours_ckpt3500/`: moved ours output generated from ckpt3500.
+- `raw/{dataset}/_eval_set/`: baseline eval RGB/GT/mask when available.
+- `raw/{dataset}/_eval_set_ours_ckpt3500/`: ckpt3500 eval RGB/GT/mask when available.
+- `tables/mean_angular_error_table.md`: paper-readable result table.
+- `tables/all_methods_five_datasets_ckpt3500_only.csv`: long table with all parsed metrics.
+- `manifests/moved_files_manifest.csv`: original source and new destination for every moved/copied item.
+
+Toy has qualitative outputs but no standard GT metric row in the current eval outputs, so its quantitative cells are `NA`.
+
+
+StableNormal on NYUv2 uses the replacement full run from `outputs/normal_eval/2026-06-17/09-32-53`, with 654/654 samples and 19.4753 deg mean angular error.

raw/raw_20260617_131337.tar.zst

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:42763ffcb58a42c68dc932b455550cc9fa62e0c70610846785605bcd8f2a1328
+size 20181257352

tables/all_methods_five_datasets_ckpt3500_only.csv

@@ -0,0 +1,42 @@
+dataset,method,angle_deg,acc_11_25,acc_22_5,acc_30,loss_l1,loss_angular_rad,samples,missing,inference_mean_seconds,inference_images_per_second,source
+nyuv2,marigold,18.58452826246209,0.5027600551417114,0.7205612994844396,0.7986632863042551,0.15438748211443243,0.32436120298204074,654.0,0.0,3.268911034490241,0.30591227153293926,outputs/results/raw/nyuv2/metrics_summary.json
+nyuv2,geowizard,20.666064953585284,0.4247810189421388,0.6940544021603529,0.7824683056329733,0.17299330683385195,0.36069087356055546,654.0,0.0,45.907227193550504,0.02178306251832369,outputs/results/raw/nyuv2/metrics_summary.json
+nyuv2,lotusg,19.061550802411652,0.49490405434588775,0.7172348086440236,0.7942645560710802,0.15833742517852636,0.3326868180652642,654.0,0.0,0.13012982388496946,7.68463346944946,outputs/results/raw/nyuv2/metrics_summary.json
+nyuv2,dsine,20.01292750448991,0.4644726937243698,0.6952426881053761,0.7796806558191959,0.1666385470020844,0.3492914747891076,654.0,0.0,0.07068643976367486,14.146984956991584,outputs/results/raw/nyuv2/metrics_summary.json
+nyuv2,metric3dv2,15.348512776401066,0.5574477525934896,0.7868209297595039,0.8609639635873497,0.12953221309781987,0.2678820805265269,654.0,0.0,0.8954020673255308,1.1168167200985941,outputs/results/raw/nyuv2/metrics_summary.json
+nyuv2,omnidata_v2,18.3597656812872,0.48924079038407825,0.729320357379928,0.8111291539596126,0.15331671336830938,0.32043835689350736,654.0,0.0,0.013907967934481777,71.90122990726185,outputs/results/raw/nyuv2/metrics_summary.json
+nyuv2,marigold_e2eft,22.07232310502172,0.4035694798560021,0.6585615762261623,0.7498336505452428,0.18452200751512424,0.3852347086328979,654.0,0.0,0.6504729053871393,1.537343049523076,outputs/results/raw/nyuv2/metrics_summary.json
+nyuv2,lotusd,19.076053202334528,0.4843353581720171,0.7160680109481199,0.7958266720039036,0.15893879704838135,0.3329399319006762,654.0,0.0,0.1299480014990457,7.695385757874419,outputs/results/raw/nyuv2/metrics_summary.json
+nyuv2,ours_ckpt3500,22.75464242970178,0.41326634905981724,0.6694361918380866,0.7532411317030588,0.18733753612555495,0.3971434273395334,654.0,0.0,5.159256822075296,0.1938263657899769,outputs/results/raw/nyuv2/ours_ckpt3500_metrics_summary.json
+scannet,marigold,14.958384364446005,0.6573262078563372,0.8031820711493493,0.8513863586386045,0.12433991208672523,0.26107305531700453,300.0,0.0,3.244237702400734,0.30823881963396227,outputs/results/raw/scannet/metrics_summary.json
+scannet,geowizard,17.71413840611776,0.5444977834820748,0.7704333117604256,0.8338464705149332,0.1485107957695921,0.30917003626624745,300.0,0.0,44.08965976539006,0.02268105504377219,outputs/results/raw/scannet/metrics_summary.json
+scannet,stablenormal,16.65259712378184,0.5684280876535922,0.8094581136107445,0.8594433997074763,0.13960172659407058,0.2906426445394754,300.0,0.0,0.7053715085958441,1.4176926453843615,outputs/results/raw/scannet/metrics_summary.json
+scannet,lotusg,15.900683099428813,0.6266329192292566,0.7937845328450203,0.8460690708955129,0.1325202148904403,0.27751927010715005,300.0,0.0,0.1298570760190487,7.7007740406330285,outputs/results/raw/scannet/metrics_summary.json
+scannet,dsine,19.340352260271708,0.5406415491007889,0.7300025354636213,0.792833924566706,0.16027910480896632,0.33755282203356424,300.0,0.0,0.07064001531153917,14.156282322275322,outputs/results/raw/scannet/metrics_summary.json
+scannet,metric3dv2,11.865828572909038,0.7184244457880656,0.8535474862655004,0.8973622459173203,0.0996453467880686,0.2070977743466695,300.0,0.0,0.8980777753653626,1.1134893073076801,outputs/results/raw/scannet/metrics_summary.json
+scannet,omnidata_v2,16.628642269770303,0.604828676879406,0.7888364061713219,0.8410157519578934,0.13814898817489543,0.2902245543152094,300.0,0.0,0.014054945791761081,71.14933168836507,outputs/results/raw/scannet/metrics_summary.json
+scannet,marigold_e2eft,19.812602481842042,0.5450777317870719,0.7201025206161042,0.7827787012606859,0.16444371378670136,0.3457951418807109,300.0,0.0,0.6449860889501869,1.5504210356345085,outputs/results/raw/scannet/metrics_summary.json
+scannet,lotusd,15.648602720896402,0.6185728922113776,0.7976143910487493,0.8523118204871813,0.13104197673499585,0.27311963791648547,300.0,0.0,0.12942985116193692,7.726192922441394,outputs/results/raw/scannet/metrics_summary.json
+scannet,ours_ckpt3500,21.15351497332255,0.472137817904974,0.7176970982054869,0.7862526492526134,0.17510594243804614,0.36919848029812175,300.0,0.0,5.158457460614542,0.1938564013826077,outputs/results/raw/scannet/ours_ckpt3500_metrics_summary.json
+sintel,marigold,27.25862446763462,0.3008647812005216,0.5536016353539058,0.6660674752429464,0.22931137087901957,0.47575274205073376,1064.0,0.0,1.8452059703150807,0.5419449189345749,outputs/results/raw/sintel/metrics_summary.json
+sintel,geowizard,39.86823763345417,0.12582174016607406,0.3228279580887323,0.44622399917054445,0.33004163587956054,0.695832002851972,1064.0,0.0,22.651801170960866,0.04414659975392946,outputs/results/raw/sintel/metrics_summary.json
+sintel,stablenormal,36.43757434805533,0.16687030701712474,0.37142475519007195,0.49480195491595713,0.3057537865930034,0.6359556361584735,1064.0,0.0,0.5947038326668028,1.6815092573319166,outputs/results/raw/sintel/metrics_summary.json
+sintel,lotusg,34.04158913909941,0.18925124772122354,0.4083295836029364,0.5334804043159785,0.2857058291652597,0.5941378069775445,1064.0,0.0,0.08275395381488466,12.08401476788573,outputs/results/raw/sintel/metrics_summary.json
+sintel,dsine,35.368954830599904,0.20383518218514474,0.4053847872112927,0.5149618213212019,0.2952006139365354,0.6173047069320106,1064.0,0.0,0.07293157675863712,13.711481973157426,outputs/results/raw/sintel/metrics_summary.json
+sintel,metric3dv2,31.49674706261857,0.23885918669297562,0.4622560241942371,0.5817016453125087,0.2638038019264551,0.5497219335791984,1064.0,0.0,0.9181986285079466,1.0890889715496295,outputs/results/raw/sintel/metrics_summary.json
+sintel,omnidata_v2,40.34621301808752,0.13860217344409576,0.3245551296738694,0.4324435300764425,0.33614457528898145,0.7041742523529924,1064.0,0.0,0.014194746173680165,70.44860033173369,outputs/results/raw/sintel/metrics_summary.json
+sintel,marigold_e2eft,35.19123664834446,0.16787083009327936,0.3793849095884234,0.5050673439951712,0.2967470489946523,0.6142029396181268,1064.0,0.0,0.658227509362413,1.5192315510614898,outputs/results/raw/sintel/metrics_summary.json
+sintel,lotusd,32.66230036083021,0.21022046841567213,0.43619233612111186,0.5613034465105126,0.2743843650599395,0.5700646766874575,1064.0,0.0,0.08330731526493354,12.003747771967019,outputs/results/raw/sintel/metrics_summary.json
+sintel,ours_ckpt3500,37.86511148187451,0.18697244788632078,0.388444603980988,0.5040681346746764,0.30882592700925987,0.6608708623824711,1064.0,0.0,4.962301159391698,0.20151940962055287,outputs/results/raw/sintel/ours_ckpt3500_metrics_summary.json
+ibims,marigold,15.255460634231568,0.7044577249884605,0.8080010706186295,0.8417761164903641,0.12441495429724454,0.2662580160796642,100.0,0.0,3.245460949972272,0.30812264125641187,outputs/results/raw/ibims/metrics_summary.json
+ibims,geowizard,18.88338906288147,0.6269234290719032,0.7670875322818757,0.8071010109782218,0.1532399447262287,0.3295773002505302,100.0,0.0,47.30736948221922,0.021138355629261026,outputs/results/raw/ibims/metrics_summary.json
+ibims,stablenormal,16.31115813732147,0.6945799669623375,0.8093989783525467,0.843150110244751,0.13165979847311973,0.2846834161877632,100.0,0.0,0.7088600442633033,1.410715709106259,outputs/results/raw/ibims/metrics_summary.json
+ibims,lotusg,15.961844491958619,0.6898827120661736,0.8017385137081147,0.8376468545198441,0.13020306009799243,0.2785867364704609,100.0,0.0,0.13075819002091885,7.647704513499452,outputs/results/raw/ibims/metrics_summary.json
+ibims,dsine,16.056823396682738,0.6880610525608063,0.8004009896516799,0.8354057955741883,0.1301181611418724,0.2802444367110729,100.0,0.0,0.0710568190254271,14.073244675393621,outputs/results/raw/ibims/metrics_summary.json
+ibims,metric3dv2,14.79437020778656,0.7056935846805572,0.809135876595974,0.8456175822019577,0.1202071949839592,0.25821046717464924,100.0,0.0,0.9496911973915995,1.0529738537606514,outputs/results/raw/ibims/metrics_summary.json
+ibims,omnidata_v2,17.501583137512206,0.6540007331967354,0.7779407998919488,0.8144333165884018,0.1418020785599947,0.305460246950388,100.0,0.0,0.014484387163072824,69.03985572475216,outputs/results/raw/ibims/metrics_summary.json
+ibims,marigold_e2eft,15.671838912963867,0.6933930590748787,0.81470616877079,0.8486287194490433,0.12752267874777318,0.2735251879692078,100.0,0.0,0.6480082283318043,1.5431902810468061,outputs/results/raw/ibims/metrics_summary.json
+ibims,lotusd,15.93819655418396,0.6872143658995629,0.8043399298191071,0.8397479671239853,0.13011716414242983,0.2781740044057369,100.0,0.0,0.13594401898235084,7.355969078197009,outputs/results/raw/ibims/metrics_summary.json
+ibims,ours_ckpt3500,17.555685510635374,0.6427510130405426,0.7962065315246583,0.834283401966095,0.14187194228172303,0.30640450805425645,100.0,0.0,5.156294812697917,0.19393770843695654,outputs/results/raw/ibims/ours_ckpt3500_metrics_summary.json
+toy,ours_ckpt3500,,,,,,,,,,,outputs/results/raw/toy/ours_ckpt3500_metrics_summary.json
+nyuv2,stablenormal,19.47533589838477,0.47799486072238434,0.7232717998804302,0.8008827627252001,0.16204253834777652,0.339908731708286,654.0,0.0,0.7189952718441457,1.3908297302638826,outputs/results/raw/nyuv2/stablenormal_metrics_summary.json

tables/mean_angular_error_table.csv

@@ -0,0 +1,11 @@
+method,nyuv2_angle_deg,nyuv2_acc_11_25,scannet_angle_deg,scannet_acc_11_25,sintel_angle_deg,sintel_acc_11_25,ibims_angle_deg,ibims_acc_11_25,toy_angle_deg,toy_acc_11_25
+ours_ckpt3500,22.75464242970178,0.41326634905981724,21.15351497332255,0.472137817904974,37.86511148187451,0.18697244788632078,17.555685510635374,0.6427510130405426,,
+dsine,20.01292750448991,0.4644726937243698,19.340352260271708,0.5406415491007889,35.368954830599904,0.20383518218514474,16.056823396682738,0.6880610525608063,,
+geowizard,20.666064953585284,0.4247810189421388,17.71413840611776,0.5444977834820748,39.86823763345417,0.12582174016607406,18.88338906288147,0.6269234290719032,,
+lotusd,19.076053202334528,0.4843353581720171,15.648602720896402,0.6185728922113776,32.66230036083021,0.21022046841567213,15.93819655418396,0.6872143658995629,,
+lotusg,19.061550802411652,0.49490405434588775,15.900683099428813,0.6266329192292566,34.04158913909941,0.18925124772122354,15.961844491958619,0.6898827120661736,,
+marigold,18.58452826246209,0.5027600551417114,14.958384364446005,0.6573262078563372,27.25862446763462,0.3008647812005216,15.255460634231568,0.7044577249884605,,
+marigold_e2eft,22.07232310502172,0.4035694798560021,19.812602481842042,0.5450777317870719,35.19123664834446,0.16787083009327936,15.671838912963867,0.6933930590748787,,
+metric3dv2,15.348512776401066,0.5574477525934896,11.865828572909038,0.7184244457880656,31.49674706261857,0.23885918669297562,14.79437020778656,0.7056935846805572,,
+omnidata_v2,18.3597656812872,0.48924079038407825,16.628642269770303,0.604828676879406,40.34621301808752,0.13860217344409576,17.501583137512206,0.6540007331967354,,
+stablenormal,19.47533589838477,0.47799486072238434,16.65259712378184,0.5684280876535922,36.43757434805533,0.16687030701712474,16.31115813732147,0.6945799669623375,,

tables/mean_angular_error_table.md

@@ -0,0 +1,16 @@
+# Results Table (ckpt3500 only for ours)
+
+Each dataset has `angle_deg` (lower is better) and `acc_11_25` in percent (higher is better). Toy currently has qualitative outputs only, no standard GT metric row.
+
+| Method | NYUv2 angle | NYUv2 acc@11.25 | ScanNet angle | ScanNet acc@11.25 | Sintel angle | Sintel acc@11.25 | iBIMS angle | iBIMS acc@11.25 | Toy angle | Toy acc@11.25 |
+|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|---:|
+| ours_ckpt3500 | 22.75 | 41.3 | 21.15 | 47.2 | 37.87 | 18.7 | 17.56 | 64.3 | NA | NA |
+| dsine | 20.01 | 46.4 | 19.34 | 54.1 | 35.37 | 20.4 | 16.06 | 68.8 | NA | NA |
+| geowizard | 20.67 | 42.5 | 17.71 | 54.4 | 39.87 | 12.6 | 18.88 | 62.7 | NA | NA |
+| lotusd | 19.08 | 48.4 | 15.65 | 61.9 | 32.66 | 21.0 | 15.94 | 68.7 | NA | NA |
+| lotusg | 19.06 | 49.5 | 15.90 | 62.7 | 34.04 | 18.9 | 15.96 | 69.0 | NA | NA |
+| marigold | 18.58 | 50.3 | 14.96 | 65.7 | 27.26 | 30.1 | 15.26 | 70.4 | NA | NA |
+| marigold_e2eft | 22.07 | 40.4 | 19.81 | 54.5 | 35.19 | 16.8 | 15.67 | 69.3 | NA | NA |
+| metric3dv2 | 15.35 | 55.7 | 11.87 | 71.8 | 31.50 | 23.9 | 14.79 | 70.6 | NA | NA |
+| omnidata_v2 | 18.36 | 48.9 | 16.63 | 60.5 | 40.35 | 13.9 | 17.50 | 65.4 | NA | NA |
+| stablenormal | 19.48 | 47.8 | 16.65 | 56.8 | 36.44 | 16.7 | 16.31 | 69.5 | NA | NA |