Upload results/results_cross_session_tinycnn_distill.txt with huggingface_hub
Browse files
results/results_cross_session_tinycnn_distill.txt
ADDED
|
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
Device: cuda:0
|
| 2 |
+
Model: tinycnn, Weights: ./weights/tinycnn_distill_best.pth
|
| 3 |
+
Parameters: 46,673
|
| 4 |
+
|
| 5 |
+
================================================================================
|
| 6 |
+
CROSS-SESSION EVALUATION -- TINYCNN
|
| 7 |
+
================================================================================
|
| 8 |
+
Model trained on: Session 1 (Jul28) + Session 2 train (Jul28_2)
|
| 9 |
+
================================================================================
|
| 10 |
+
|
| 11 |
+
Session N Median P90 P99 Mean
|
| 12 |
+
--------------------------------------------------------------------------------
|
| 13 |
+
Loading ./data/dataset_fov_test_jacobs_July28_2.mat
|
| 14 |
+
Loading ./data/dataset_non_fov_test_jacobs_July28_2.mat
|
| 15 |
+
Session 2 test (in-distribution) 4260 3.706m 14.784m 25.101m 6.048m
|
| 16 |
+
Loading ./data/dataset_jacobs_Aug16_1.mat
|
| 17 |
+
Session 3 (Aug16_1, furniture) 11201 5.852m 14.658m 25.319m 7.046m
|
| 18 |
+
Loading ./data/dataset_jacobs_Aug16_3.mat
|
| 19 |
+
Session 4 (Aug16_3, diff furniture) 8754 5.903m 16.471m 26.809m 7.519m
|
| 20 |
+
Loading ./data/dataset_jacobs_Aug16_4_ref.mat
|
| 21 |
+
Session 5 (Aug16_4_ref, reflector) 5486 6.888m 16.602m 26.325m 8.154m
|
| 22 |
+
================================================================================
|
| 23 |
+
|
| 24 |
+
Degradation vs in-distribution (Session 2 test):
|
| 25 |
+
Session Median delta P90 delta
|
| 26 |
+
----------------------------------------------------------------------
|
| 27 |
+
Session 3 (Aug16_1, furniture) +2.146m -0.127m
|
| 28 |
+
Session 4 (Aug16_3, diff furniture) +2.197m +1.687m
|
| 29 |
+
Session 5 (Aug16_4_ref, reflector) +3.182m +1.818m
|
| 30 |
+
|
| 31 |
+
Results saved to cross_session_tinycnn.txt
|