guytevet's picture
added generated data for evaluation from /home/dcor/sigalraab/train_outputs/rl/from_guy/PrefixCompHor_DiffusionSteps_10_PredLen_40_new/in_paper/model000200000.DiMP_cfg5_crop16_len316_expT2mFinetune_planh40_switchProb0.0_recover2
de7106b
==================== Replication 0 ====================
Time: 2024-11-05 13:49:09.581422
---> [ground truth] Matching Score: 3.2408
---> [ground truth] R_precision: (top 1): 0.4616 (top 2): 0.6726 (top 3): 0.7746
---> [vald] Matching Score: 3.6497
---> [vald] R_precision: (top 1): 0.3775 (top 2): 0.5694 (top 3): 0.6932
Time: 2024-11-05 13:50:18.629628
---> [ground truth] FID: 0.0009
---> [vald] FID: 1.7655
Time: 2024-11-05 13:50:23.115390
---> [ground truth] Diversity: 9.4674
---> [vald] Diversity: 8.4915
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5319
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 1 ====================
Time: 2024-11-05 13:50:38.444461
---> [ground truth] Matching Score: 3.2475
---> [ground truth] R_precision: (top 1): 0.4554 (top 2): 0.6541 (top 3): 0.7616
---> [vald] Matching Score: 3.6461
---> [vald] R_precision: (top 1): 0.3835 (top 2): 0.5751 (top 3): 0.6932
Time: 2024-11-05 13:50:43.341127
---> [ground truth] FID: 0.0009
---> [vald] FID: 1.7590
Time: 2024-11-05 13:50:46.980017
---> [ground truth] Diversity: 9.2297
---> [vald] Diversity: 8.1831
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5319
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 2 ====================
Time: 2024-11-05 13:51:09.068401
---> [ground truth] Matching Score: 3.2372
---> [ground truth] R_precision: (top 1): 0.4571 (top 2): 0.6556 (top 3): 0.7711
---> [vald] Matching Score: 3.6476
---> [vald] R_precision: (top 1): 0.3842 (top 2): 0.5873 (top 3): 0.6937
Time: 2024-11-05 13:51:14.079459
---> [ground truth] FID: 0.0011
---> [vald] FID: 1.7559
Time: 2024-11-05 13:51:17.411108
---> [ground truth] Diversity: 9.1577
---> [vald] Diversity: 8.1927
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5319
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 3 ====================
Time: 2024-11-05 13:51:32.437372
---> [ground truth] Matching Score: 3.2366
---> [ground truth] R_precision: (top 1): 0.4461 (top 2): 0.6522 (top 3): 0.7659
---> [vald] Matching Score: 3.6450
---> [vald] R_precision: (top 1): 0.3863 (top 2): 0.5811 (top 3): 0.6937
Time: 2024-11-05 13:51:37.215213
---> [ground truth] FID: 0.0011
---> [vald] FID: 1.7433
Time: 2024-11-05 13:51:40.607993
---> [ground truth] Diversity: 9.2844
---> [vald] Diversity: 8.1852
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5319
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 4 ====================
Time: 2024-11-05 13:51:55.772595
---> [ground truth] Matching Score: 3.2224
---> [ground truth] R_precision: (top 1): 0.4606 (top 2): 0.6569 (top 3): 0.7696
---> [vald] Matching Score: 3.6482
---> [vald] R_precision: (top 1): 0.3920 (top 2): 0.5758 (top 3): 0.6912
Time: 2024-11-05 13:52:00.669021
---> [ground truth] FID: 0.0011
---> [vald] FID: 1.7599
Time: 2024-11-05 13:52:04.058226
---> [ground truth] Diversity: 9.4751
---> [vald] Diversity: 8.5149
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5319
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 5 ====================
Time: 2024-11-05 13:52:19.196994
---> [ground truth] Matching Score: 3.2579
---> [ground truth] R_precision: (top 1): 0.4470 (top 2): 0.6537 (top 3): 0.7662
---> [vald] Matching Score: 3.6471
---> [vald] R_precision: (top 1): 0.3934 (top 2): 0.5802 (top 3): 0.6946
Time: 2024-11-05 13:52:24.087716
---> [ground truth] FID: 0.0011
---> [vald] FID: 1.7495
Time: 2024-11-05 13:52:27.430214
---> [ground truth] Diversity: 9.1482
---> [vald] Diversity: 8.2369
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5319
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 6 ====================
Time: 2024-11-05 13:52:44.109197
---> [ground truth] Matching Score: 3.2352
---> [ground truth] R_precision: (top 1): 0.4543 (top 2): 0.6619 (top 3): 0.7666
---> [vald] Matching Score: 3.6486
---> [vald] R_precision: (top 1): 0.3869 (top 2): 0.5862 (top 3): 0.7020
Time: 2024-11-05 13:52:48.847839
---> [ground truth] FID: 0.0010
---> [vald] FID: 1.7386
Time: 2024-11-05 13:52:52.355412
---> [ground truth] Diversity: 8.9594
---> [vald] Diversity: 8.0372
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5321
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 7 ====================
Time: 2024-11-05 13:53:07.432712
---> [ground truth] Matching Score: 3.2408
---> [ground truth] R_precision: (top 1): 0.4558 (top 2): 0.6582 (top 3): 0.7623
---> [vald] Matching Score: 3.6473
---> [vald] R_precision: (top 1): 0.3826 (top 2): 0.5726 (top 3): 0.6857
Time: 2024-11-05 13:53:12.179500
---> [ground truth] FID: 0.0010
---> [vald] FID: 1.7559
Time: 2024-11-05 13:53:15.754204
---> [ground truth] Diversity: 9.4814
---> [vald] Diversity: 8.1759
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5321
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 8 ====================
Time: 2024-11-05 13:53:30.685254
---> [ground truth] Matching Score: 3.2359
---> [ground truth] R_precision: (top 1): 0.4631 (top 2): 0.6659 (top 3): 0.7690
---> [vald] Matching Score: 3.6496
---> [vald] R_precision: (top 1): 0.3773 (top 2): 0.5728 (top 3): 0.6886
Time: 2024-11-05 13:53:35.549796
---> [ground truth] FID: 0.0009
---> [vald] FID: 1.7628
Time: 2024-11-05 13:53:38.977393
---> [ground truth] Diversity: 9.2771
---> [vald] Diversity: 8.0750
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5319
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
==================== Replication 9 ====================
Time: 2024-11-05 13:53:54.791986
---> [ground truth] Matching Score: 3.2360
---> [ground truth] R_precision: (top 1): 0.4586 (top 2): 0.6614 (top 3): 0.7720
---> [vald] Matching Score: 3.6467
---> [vald] R_precision: (top 1): 0.3817 (top 2): 0.5839 (top 3): 0.6886
Time: 2024-11-05 13:53:59.808582
---> [ground truth] FID: 0.0010
---> [vald] FID: 1.7579
Time: 2024-11-05 13:54:03.312956
---> [ground truth] Diversity: 9.2610
---> [vald] Diversity: 8.1613
AUX METRICS:
---> [vald] skate_ratio: 0.0330
---> [vald] mean_penetration: 1731.5319
---> [vald] penetration: 0.0208
---> [vald] floating: 20.1037
---> [vald] skating: 0.0012
!!! DONE !!!
========== Matching Score Summary ==========
---> [ground truth] Mean: 3.2390 CInterval: 0.0054
---> [vald] Mean: 3.6476 CInterval: 0.0009
========== R_precision Summary ==========
---> [ground truth](top 1) Mean: 0.4560 CInt: 0.0034;(top 2) Mean: 0.6592 CInt: 0.0037;(top 3) Mean: 0.7679 CInt: 0.0024;
---> [vald](top 1) Mean: 0.3845 CInt: 0.0031;(top 2) Mean: 0.5784 CInt: 0.0036;(top 3) Mean: 0.6925 CInt: 0.0026;
========== FID Summary ==========
---> [ground truth] Mean: 0.0010 CInterval: 0.0000
---> [vald] Mean: 1.7548 CInterval: 0.0050
========== Diversity Summary ==========
---> [ground truth] Mean: 9.2741 CInterval: 0.0983
---> [vald] Mean: 8.2254 CInterval: 0.0927
========== MultiModality Summary ==========
========== skate_ratio Summary ==========
---> [vald] Mean: 0.0330 CInterval: 0.0000
========== mean_penetration Summary ==========
---> [vald] Mean: 1731.5319 CInterval: 0.0000
========== penetration Summary ==========
---> [vald] Mean: 0.0208 CInterval: 0.0000
========== floating Summary ==========
---> [vald] Mean: 20.1037 CInterval: 0.0000
========== skating Summary ==========
---> [vald] Mean: 0.0012 CInterval: 0.0000