diff --git "a/train_vq_hml_myself_medium.log" "b/train_vq_hml_myself_medium.log" new file mode 100644--- /dev/null +++ "b/train_vq_hml_myself_medium.log" @@ -0,0 +1,6458 @@ +nohup: ignoring input +Reading /scratch/ts1v23/workspace/motion-latent-diffusion-main/datasets/humanml3d/humanml_opt.txt +Loading dataset t2m ... +Pointer Pointing at 0 +Start training Epoch 1... +Train. Iter 1 : Commit. 0.00000 PPL. 297.17 Recons. 0.57196 +Start training Epoch 2... +Train. Iter 2 : Commit. 0.00000 PPL. 698.31 Recons. 0.34759 +Start training Epoch 3... +Train. Iter 3 : Commit. 0.00000 PPL. 928.85 Recons. 0.28007 +Start training Epoch 4... +Train. Iter 4 : Commit. 0.00000 PPL. 1062.17 Recons. 0.22705 +Start training Epoch 5... +Train. Iter 5 : Commit. 0.00000 PPL. 1160.77 Recons. 0.19238 +Start training Epoch 6... +Train. Iter 6 : Commit. 0.00000 PPL. 1263.31 Recons. 0.16723 +Start training Epoch 7... +Train. Iter 7 : Commit. 0.00000 PPL. 1347.22 Recons. 0.14948 +Start training Epoch 8... +Train. Iter 8 : Commit. 0.00000 PPL. 1349.50 Recons. 0.13576 +Start training Epoch 9... +Train. Iter 9 : Commit. 0.00000 PPL. 1340.55 Recons. 0.12401 +Start training Epoch 10... +Train. Iter 10 : Commit. 0.00000 PPL. 1317.70 Recons. 0.11488 +Check if save...? +----saved---- +Start training Epoch 11... +Train. Iter 11 : Commit. 0.00000 PPL. 1272.42 Recons. 0.10738 +Start training Epoch 12... +Train. Iter 12 : Commit. 0.00000 PPL. 1227.43 Recons. 0.10068 +Start training Epoch 13... +Train. Iter 13 : Commit. 0.00000 PPL. 1185.13 Recons. 0.09524 +Start training Epoch 14... +Train. Iter 14 : Commit. 0.00000 PPL. 1184.34 Recons. 0.09057 +Start training Epoch 15... +Train. Iter 15 : Commit. 0.00000 PPL. 1179.20 Recons. 0.08654 +Start training Epoch 16... +Train. Iter 16 : Commit. 0.00000 PPL. 1165.04 Recons. 0.08297 +Start training Epoch 17... +Train. Iter 17 : Commit. 0.00000 PPL. 1153.24 Recons. 0.08046 +Start training Epoch 18... +Train. Iter 18 : Commit. 0.00000 PPL. 1131.67 Recons. 0.07775 +Start training Epoch 19... +Train. Iter 19 : Commit. 0.00000 PPL. 1109.99 Recons. 0.07580 +Start training Epoch 20... +Train. Iter 20 : Commit. 0.00000 PPL. 1086.37 Recons. 0.07335 +Check if save...? +----saved---- +Start training Epoch 21... +Train. Iter 21 : Commit. 0.00000 PPL. 1067.70 Recons. 0.07142 +Start training Epoch 22... +Train. Iter 22 : Commit. 0.00000 PPL. 1055.65 Recons. 0.06935 +Start training Epoch 23... +Train. Iter 23 : Commit. 0.00000 PPL. 1035.18 Recons. 0.06788 +Start training Epoch 24... +Train. Iter 24 : Commit. 0.00000 PPL. 1025.95 Recons. 0.06601 +Start training Epoch 25... +Train. Iter 25 : Commit. 0.00000 PPL. 1015.92 Recons. 0.06479 +Start training Epoch 26... +Train. Iter 26 : Commit. 0.00001 PPL. 1005.56 Recons. 0.06319 +Start training Epoch 27... +Train. Iter 27 : Commit. 0.00001 PPL. 993.04 Recons. 0.06214 +Start training Epoch 28... +Train. Iter 28 : Commit. 0.00001 PPL. 981.02 Recons. 0.06088 +Start training Epoch 29... +Train. Iter 29 : Commit. 0.00001 PPL. 977.37 Recons. 0.05981 +Start training Epoch 30... +Train. Iter 30 : Commit. 0.00001 PPL. 966.87 Recons. 0.05868 +Check if save...? +----saved---- +Start training Epoch 31... +Train. Iter 31 : Commit. 0.00001 PPL. 961.21 Recons. 0.05774 +Start training Epoch 32... +Train. Iter 32 : Commit. 0.00001 PPL. 947.27 Recons. 0.05697 +Start training Epoch 33... +Train. Iter 33 : Commit. 0.00001 PPL. 941.48 Recons. 0.05611 +Start training Epoch 34... +Train. Iter 34 : Commit. 0.00001 PPL. 936.69 Recons. 0.05553 +Start training Epoch 35... +Train. Iter 35 : Commit. 0.00001 PPL. 940.83 Recons. 0.05464 +Start training Epoch 36... +Train. Iter 36 : Commit. 0.00001 PPL. 935.08 Recons. 0.05401 +Start training Epoch 37... +Train. Iter 37 : Commit. 0.00001 PPL. 929.88 Recons. 0.05350 +Start training Epoch 38... +Train. Iter 38 : Commit. 0.00001 PPL. 934.30 Recons. 0.05282 +Start training Epoch 39... +Train. Iter 39 : Commit. 0.00001 PPL. 929.96 Recons. 0.05224 +Start training Epoch 40... +Train. Iter 40 : Commit. 0.00001 PPL. 920.78 Recons. 0.05167 +Check if save...? +----saved---- +Start training Epoch 41... +Train. Iter 41 : Commit. 0.00001 PPL. 910.65 Recons. 0.05107 +Start training Epoch 42... +Train. Iter 42 : Commit. 0.00001 PPL. 908.44 Recons. 0.05042 +Start training Epoch 43... +Train. Iter 43 : Commit. 0.00001 PPL. 907.36 Recons. 0.05022 +Start training Epoch 44... +Train. Iter 44 : Commit. 0.00001 PPL. 906.95 Recons. 0.04957 +Start training Epoch 45... +Train. Iter 45 : Commit. 0.00001 PPL. 907.80 Recons. 0.04886 +Start training Epoch 46... +Train. Iter 46 : Commit. 0.00001 PPL. 910.50 Recons. 0.04876 +Start training Epoch 47... +Train. Iter 47 : Commit. 0.00001 PPL. 906.93 Recons. 0.04818 +Start training Epoch 48... +Train. Iter 48 : Commit. 0.00001 PPL. 900.19 Recons. 0.04777 +Start training Epoch 49... +Train. Iter 49 : Commit. 0.00001 PPL. 901.36 Recons. 0.04768 +Start training Epoch 50... +Train. Iter 50 : Commit. 0.00001 PPL. 901.82 Recons. 0.04700 +Check if save...? +----saved---- +Start training Epoch 51... +Train. Iter 51 : Commit. 0.00001 PPL. 900.52 Recons. 0.04660 +Start training Epoch 52... +Train. Iter 52 : Commit. 0.00001 PPL. 898.46 Recons. 0.04618 +Start training Epoch 53... +Train. Iter 53 : Commit. 0.00001 PPL. 899.98 Recons. 0.04612 +Start training Epoch 54... +Train. Iter 54 : Commit. 0.00001 PPL. 902.24 Recons. 0.04556 +Start training Epoch 55... +Train. Iter 55 : Commit. 0.00001 PPL. 905.01 Recons. 0.04526 +Start training Epoch 56... +Train. Iter 56 : Commit. 0.00001 PPL. 901.75 Recons. 0.04495 +Start training Epoch 57... +Train. Iter 57 : Commit. 0.00001 PPL. 904.15 Recons. 0.04460 +Start training Epoch 58... +Train. Iter 58 : Commit. 0.00001 PPL. 898.46 Recons. 0.04419 +Start training Epoch 59... +Train. Iter 59 : Commit. 0.00001 PPL. 896.95 Recons. 0.04413 +Start training Epoch 60... +Train. Iter 60 : Commit. 0.00001 PPL. 901.16 Recons. 0.04366 +Check if save...? +----saved---- +Start training Epoch 61... +Train. Iter 61 : Commit. 0.00001 PPL. 902.94 Recons. 0.04351 +Start training Epoch 62... +Train. Iter 62 : Commit. 0.00001 PPL. 886.36 Recons. 0.04310 +Start training Epoch 63... +Train. Iter 63 : Commit. 0.00001 PPL. 895.74 Recons. 0.04285 +Start training Epoch 64... +Train. Iter 64 : Commit. 0.00001 PPL. 896.11 Recons. 0.04253 +Start training Epoch 65... +Train. Iter 65 : Commit. 0.00001 PPL. 896.90 Recons. 0.04224 +Start training Epoch 66... +Train. Iter 66 : Commit. 0.00001 PPL. 890.95 Recons. 0.04202 +Start training Epoch 67... +Train. Iter 67 : Commit. 0.00001 PPL. 894.28 Recons. 0.04172 +Start training Epoch 68... +Train. Iter 68 : Commit. 0.00001 PPL. 898.59 Recons. 0.04145 +Start training Epoch 69... +Train. Iter 69 : Commit. 0.00001 PPL. 895.95 Recons. 0.04138 +Start training Epoch 70... +Train. Iter 70 : Commit. 0.00001 PPL. 895.45 Recons. 0.04111 +Check if save...? +----saved---- +Start training Epoch 71... +Train. Iter 71 : Commit. 0.00001 PPL. 900.01 Recons. 0.04081 +Start training Epoch 72... +Train. Iter 72 : Commit. 0.00001 PPL. 901.40 Recons. 0.04059 +Start training Epoch 73... +Train. Iter 73 : Commit. 0.00001 PPL. 891.82 Recons. 0.04029 +Start training Epoch 74... +Train. Iter 74 : Commit. 0.00001 PPL. 897.16 Recons. 0.04010 +Start training Epoch 75... +Train. Iter 75 : Commit. 0.00001 PPL. 903.72 Recons. 0.03969 +Start training Epoch 76... +Train. Iter 76 : Commit. 0.00001 PPL. 903.98 Recons. 0.03974 +Start training Epoch 77... +Train. Iter 77 : Commit. 0.00001 PPL. 896.33 Recons. 0.03945 +Start training Epoch 78... +Train. Iter 78 : Commit. 0.00001 PPL. 896.90 Recons. 0.03928 +Start training Epoch 79... +Train. Iter 79 : Commit. 0.00001 PPL. 894.09 Recons. 0.03910 +Start training Epoch 80... +Train. Iter 80 : Commit. 0.00001 PPL. 895.40 Recons. 0.03903 +Check if save...? +----saved---- +Start training Epoch 81... +Train. Iter 81 : Commit. 0.00001 PPL. 895.62 Recons. 0.03890 +Start training Epoch 82... +Train. Iter 82 : Commit. 0.00001 PPL. 898.98 Recons. 0.03847 +Start training Epoch 83... +Train. Iter 83 : Commit. 0.00001 PPL. 895.49 Recons. 0.03833 +Start training Epoch 84... +Train. Iter 84 : Commit. 0.00001 PPL. 896.72 Recons. 0.03818 +Start training Epoch 85... +Train. Iter 85 : Commit. 0.00001 PPL. 898.13 Recons. 0.03793 +Start training Epoch 86... +Train. Iter 86 : Commit. 0.00001 PPL. 900.57 Recons. 0.03772 +Start training Epoch 87... +Train. Iter 87 : Commit. 0.00001 PPL. 895.03 Recons. 0.03759 +Start training Epoch 88... +Train. Iter 88 : Commit. 0.00001 PPL. 898.79 Recons. 0.03752 +Start training Epoch 89... +Train. Iter 89 : Commit. 0.00001 PPL. 899.95 Recons. 0.03758 +Start training Epoch 90... +Train. Iter 90 : Commit. 0.00001 PPL. 911.62 Recons. 0.03712 +Check if save...? +----saved---- +Start training Epoch 91... +Train. Iter 91 : Commit. 0.00001 PPL. 910.69 Recons. 0.03700 +Start training Epoch 92... +Train. Iter 92 : Commit. 0.00001 PPL. 899.79 Recons. 0.03707 +Start training Epoch 93... +Train. Iter 93 : Commit. 0.00001 PPL. 904.43 Recons. 0.03668 +Start training Epoch 94... +Train. Iter 94 : Commit. 0.00001 PPL. 905.26 Recons. 0.03662 +Start training Epoch 95... +Train. Iter 95 : Commit. 0.00001 PPL. 904.01 Recons. 0.03654 +Start training Epoch 96... +Train. Iter 96 : Commit. 0.00001 PPL. 903.73 Recons. 0.03635 +Start training Epoch 97... +Train. Iter 97 : Commit. 0.00001 PPL. 902.17 Recons. 0.03610 +Start training Epoch 98... +Train. Iter 98 : Commit. 0.00001 PPL. 902.68 Recons. 0.03609 +Start training Epoch 99... +Train. Iter 99 : Commit. 0.00001 PPL. 903.31 Recons. 0.03592 +Start training Epoch 100... +Train. Iter 100 : Commit. 0.00001 PPL. 903.69 Recons. 0.03581 +Check if save...? +----saved---- +Start training Epoch 101... +Train. Iter 101 : Commit. 0.00001 PPL. 905.53 Recons. 0.03558 +Start training Epoch 102... +Train. Iter 102 : Commit. 0.00001 PPL. 906.02 Recons. 0.03562 +Start training Epoch 103... +Train. Iter 103 : Commit. 0.00001 PPL. 904.90 Recons. 0.03532 +Start training Epoch 104... +Train. Iter 104 : Commit. 0.00001 PPL. 904.49 Recons. 0.03521 +Start training Epoch 105... +Train. Iter 105 : Commit. 0.00001 PPL. 902.99 Recons. 0.03513 +Start training Epoch 106... +Train. Iter 106 : Commit. 0.00001 PPL. 906.00 Recons. 0.03506 +Start training Epoch 107... +Train. Iter 107 : Commit. 0.00001 PPL. 905.82 Recons. 0.03479 +Start training Epoch 108... +Train. Iter 108 : Commit. 0.00001 PPL. 906.49 Recons. 0.03476 +Start training Epoch 109... +Train. Iter 109 : Commit. 0.00001 PPL. 906.11 Recons. 0.03459 +Start training Epoch 110... +Train. Iter 110 : Commit. 0.00001 PPL. 906.96 Recons. 0.03459 +Check if save...? +----saved---- +Start training Epoch 111... +Train. Iter 111 : Commit. 0.00001 PPL. 905.24 Recons. 0.03442 +Start training Epoch 112... +Train. Iter 112 : Commit. 0.00001 PPL. 913.33 Recons. 0.03428 +Start training Epoch 113... +Train. Iter 113 : Commit. 0.00001 PPL. 904.89 Recons. 0.03420 +Start training Epoch 114... +Train. Iter 114 : Commit. 0.00001 PPL. 910.84 Recons. 0.03406 +Start training Epoch 115... +Train. Iter 115 : Commit. 0.00001 PPL. 903.12 Recons. 0.03390 +Start training Epoch 116... +Train. Iter 116 : Commit. 0.00001 PPL. 910.57 Recons. 0.03387 +Start training Epoch 117... +Train. Iter 117 : Commit. 0.00001 PPL. 915.66 Recons. 0.03360 +Start training Epoch 118... +Train. Iter 118 : Commit. 0.00001 PPL. 912.93 Recons. 0.03357 +Start training Epoch 119... +Train. Iter 119 : Commit. 0.00001 PPL. 911.03 Recons. 0.03354 +Start training Epoch 120... +Train. Iter 120 : Commit. 0.00001 PPL. 908.01 Recons. 0.03345 +Check if save...? +----saved---- +Start training Epoch 121... +Train. Iter 121 : Commit. 0.00001 PPL. 911.64 Recons. 0.03339 +Start training Epoch 122... +Train. Iter 122 : Commit. 0.00001 PPL. 912.04 Recons. 0.03321 +Start training Epoch 123... +Train. Iter 123 : Commit. 0.00001 PPL. 913.62 Recons. 0.03315 +Start training Epoch 124... +Train. Iter 124 : Commit. 0.00001 PPL. 918.13 Recons. 0.03320 +Start training Epoch 125... +Train. Iter 125 : Commit. 0.00001 PPL. 913.14 Recons. 0.03297 +Start training Epoch 126... +Train. Iter 126 : Commit. 0.00001 PPL. 916.05 Recons. 0.03279 +Start training Epoch 127... +Train. Iter 127 : Commit. 0.00001 PPL. 914.42 Recons. 0.03268 +Start training Epoch 128... +Train. Iter 128 : Commit. 0.00001 PPL. 911.99 Recons. 0.03272 +Start training Epoch 129... +Train. Iter 129 : Commit. 0.00001 PPL. 916.63 Recons. 0.03251 +Start training Epoch 130... +Train. Iter 130 : Commit. 0.00001 PPL. 915.73 Recons. 0.03249 +Check if save...? +----saved---- +Start training Epoch 131... +Train. Iter 131 : Commit. 0.00001 PPL. 914.31 Recons. 0.03230 +Start training Epoch 132... +Train. Iter 132 : Commit. 0.00001 PPL. 911.64 Recons. 0.03224 +Start training Epoch 133... +Train. Iter 133 : Commit. 0.00001 PPL. 917.18 Recons. 0.03225 +Start training Epoch 134... +Train. Iter 134 : Commit. 0.00001 PPL. 916.19 Recons. 0.03208 +Start training Epoch 135... +Train. Iter 135 : Commit. 0.00001 PPL. 919.10 Recons. 0.03204 +Start training Epoch 136... +Train. Iter 136 : Commit. 0.00001 PPL. 916.73 Recons. 0.03187 +Start training Epoch 137... +Train. Iter 137 : Commit. 0.00001 PPL. 915.45 Recons. 0.03186 +Start training Epoch 138... +Train. Iter 138 : Commit. 0.00001 PPL. 918.79 Recons. 0.03164 +Start training Epoch 139... +Train. Iter 139 : Commit. 0.00001 PPL. 912.95 Recons. 0.03208 +Start training Epoch 140... +Train. Iter 140 : Commit. 0.00001 PPL. 914.78 Recons. 0.03172 +Check if save...? +----saved---- +Start training Epoch 141... +Train. Iter 141 : Commit. 0.00001 PPL. 914.66 Recons. 0.03150 +Start training Epoch 142... +Train. Iter 142 : Commit. 0.00001 PPL. 915.88 Recons. 0.03137 +Start training Epoch 143... +Train. Iter 143 : Commit. 0.00001 PPL. 915.24 Recons. 0.03126 +Start training Epoch 144... +Train. Iter 144 : Commit. 0.00001 PPL. 919.27 Recons. 0.03115 +Start training Epoch 145... +Train. Iter 145 : Commit. 0.00001 PPL. 923.41 Recons. 0.03119 +Start training Epoch 146... +Train. Iter 146 : Commit. 0.00001 PPL. 921.13 Recons. 0.03102 +Start training Epoch 147... +Train. Iter 147 : Commit. 0.00001 PPL. 918.43 Recons. 0.03098 +Start training Epoch 148... +Train. Iter 148 : Commit. 0.00001 PPL. 919.10 Recons. 0.03083 +Start training Epoch 149... +Train. Iter 149 : Commit. 0.00001 PPL. 923.02 Recons. 0.03071 +Start training Epoch 150... +Train. Iter 150 : Commit. 0.00001 PPL. 919.78 Recons. 0.03071 +Check if save...? +----saved---- +Start training Epoch 151... +Train. Iter 151 : Commit. 0.00001 PPL. 920.88 Recons. 0.03073 +Start training Epoch 152... +Train. Iter 152 : Commit. 0.00001 PPL. 923.96 Recons. 0.03057 +Start training Epoch 153... +Train. Iter 153 : Commit. 0.00001 PPL. 922.87 Recons. 0.03070 +Start training Epoch 154... +Train. Iter 154 : Commit. 0.00001 PPL. 922.37 Recons. 0.03048 +Start training Epoch 155... +Train. Iter 155 : Commit. 0.00001 PPL. 922.86 Recons. 0.03040 +Start training Epoch 156... +Train. Iter 156 : Commit. 0.00001 PPL. 919.69 Recons. 0.03025 +Start training Epoch 157... +Train. Iter 157 : Commit. 0.00001 PPL. 922.01 Recons. 0.03019 +Start training Epoch 158... +Train. Iter 158 : Commit. 0.00001 PPL. 924.19 Recons. 0.03014 +Start training Epoch 159... +Train. Iter 159 : Commit. 0.00001 PPL. 924.55 Recons. 0.03004 +Start training Epoch 160... +Train. Iter 160 : Commit. 0.00001 PPL. 923.24 Recons. 0.02995 +Check if save...? +----saved---- +Start training Epoch 161... +Train. Iter 161 : Commit. 0.00001 PPL. 931.14 Recons. 0.02999 +Start training Epoch 162... +Train. Iter 162 : Commit. 0.00001 PPL. 928.73 Recons. 0.02989 +Start training Epoch 163... +Train. Iter 163 : Commit. 0.00001 PPL. 923.24 Recons. 0.02987 +Start training Epoch 164... +Train. Iter 164 : Commit. 0.00001 PPL. 929.10 Recons. 0.02970 +Start training Epoch 165... +Train. Iter 165 : Commit. 0.00001 PPL. 930.04 Recons. 0.02975 +Start training Epoch 166... +Train. Iter 166 : Commit. 0.00001 PPL. 931.77 Recons. 0.02958 +Start training Epoch 167... +Train. Iter 167 : Commit. 0.00001 PPL. 931.39 Recons. 0.02955 +Start training Epoch 168... +Train. Iter 168 : Commit. 0.00001 PPL. 934.30 Recons. 0.02945 +Start training Epoch 169... +Train. Iter 169 : Commit. 0.00001 PPL. 933.09 Recons. 0.02938 +Start training Epoch 170... +Train. Iter 170 : Commit. 0.00001 PPL. 931.91 Recons. 0.02946 +Check if save...? +----saved---- +Start training Epoch 171... +Train. Iter 171 : Commit. 0.00001 PPL. 933.71 Recons. 0.02932 +Start training Epoch 172... +Train. Iter 172 : Commit. 0.00001 PPL. 936.09 Recons. 0.02922 +Start training Epoch 173... +Train. Iter 173 : Commit. 0.00001 PPL. 931.90 Recons. 0.02934 +Start training Epoch 174... +Train. Iter 174 : Commit. 0.00001 PPL. 938.06 Recons. 0.02905 +Start training Epoch 175... +Train. Iter 175 : Commit. 0.00001 PPL. 936.53 Recons. 0.02904 +Start training Epoch 176... +Train. Iter 176 : Commit. 0.00001 PPL. 932.64 Recons. 0.02898 +Start training Epoch 177... +Train. Iter 177 : Commit. 0.00001 PPL. 931.96 Recons. 0.02888 +Start training Epoch 178... +Train. Iter 178 : Commit. 0.00001 PPL. 932.07 Recons. 0.02881 +Start training Epoch 179... +Train. Iter 179 : Commit. 0.00001 PPL. 933.81 Recons. 0.02885 +Start training Epoch 180... +Train. Iter 180 : Commit. 0.00001 PPL. 933.60 Recons. 0.02877 +Check if save...? +----saved---- +Start training Epoch 181... +Train. Iter 181 : Commit. 0.00001 PPL. 931.39 Recons. 0.02877 +Start training Epoch 182... +Train. Iter 182 : Commit. 0.00001 PPL. 933.21 Recons. 0.02868 +Start training Epoch 183... +Train. Iter 183 : Commit. 0.00001 PPL. 933.24 Recons. 0.02860 +Start training Epoch 184... +Train. Iter 184 : Commit. 0.00001 PPL. 936.42 Recons. 0.02853 +Start training Epoch 185... +Train. Iter 185 : Commit. 0.00001 PPL. 933.50 Recons. 0.02854 +Start training Epoch 186... +Train. Iter 186 : Commit. 0.00001 PPL. 960.41 Recons. 0.02852 +Start training Epoch 187... +Train. Iter 187 : Commit. 0.00001 PPL. 943.56 Recons. 0.02837 +Start training Epoch 188... +Train. Iter 188 : Commit. 0.00001 PPL. 937.82 Recons. 0.02839 +Start training Epoch 189... +Train. Iter 189 : Commit. 0.00001 PPL. 936.23 Recons. 0.02828 +Start training Epoch 190... +Train. Iter 190 : Commit. 0.00001 PPL. 927.11 Recons. 0.02843 +Check if save...? +----saved---- +Start training Epoch 191... +Train. Iter 191 : Commit. 0.00001 PPL. 931.75 Recons. 0.02822 +Start training Epoch 192... +Train. Iter 192 : Commit. 0.00001 PPL. 932.85 Recons. 0.02818 +Start training Epoch 193... +Train. Iter 193 : Commit. 0.00001 PPL. 935.65 Recons. 0.02816 +Start training Epoch 194... +Train. Iter 194 : Commit. 0.00001 PPL. 934.89 Recons. 0.02808 +Start training Epoch 195... +Train. Iter 195 : Commit. 0.00001 PPL. 949.49 Recons. 0.02798 +Start training Epoch 196... +Train. Iter 196 : Commit. 0.00001 PPL. 937.30 Recons. 0.02802 +Start training Epoch 197... +Train. Iter 197 : Commit. 0.00001 PPL. 934.90 Recons. 0.02792 +Start training Epoch 198... +Train. Iter 198 : Commit. 0.00001 PPL. 934.15 Recons. 0.02777 +Start training Epoch 199... +Train. Iter 199 : Commit. 0.00001 PPL. 932.24 Recons. 0.02806 +Start training Epoch 200... +Train. Iter 200 : Commit. 0.00001 PPL. 931.15 Recons. 0.02789 +Check if save...? +----saved---- +Start training Epoch 201... +Train. Iter 201 : Commit. 0.00001 PPL. 935.70 Recons. 0.02776 +Start training Epoch 202... +Train. Iter 202 : Commit. 0.00001 PPL. 934.94 Recons. 0.02766 +Start training Epoch 203... +Train. Iter 203 : Commit. 0.00001 PPL. 935.03 Recons. 0.02754 +Start training Epoch 204... +Train. Iter 204 : Commit. 0.00001 PPL. 933.89 Recons. 0.02756 +Start training Epoch 205... +Train. Iter 205 : Commit. 0.00001 PPL. 937.34 Recons. 0.02751 +Start training Epoch 206... +Train. Iter 206 : Commit. 0.00001 PPL. 934.38 Recons. 0.02755 +Start training Epoch 207... +Train. Iter 207 : Commit. 0.00001 PPL. 937.34 Recons. 0.02758 +Start training Epoch 208... +Train. Iter 208 : Commit. 0.00001 PPL. 937.23 Recons. 0.02746 +Start training Epoch 209... +Train. Iter 209 : Commit. 0.00001 PPL. 938.92 Recons. 0.02752 +Start training Epoch 210... +Train. Iter 210 : Commit. 0.00001 PPL. 935.81 Recons. 0.02766 +Check if save...? +----saved---- +Start training Epoch 211... +Train. Iter 211 : Commit. 0.00001 PPL. 941.45 Recons. 0.02723 +Start training Epoch 212... +Train. Iter 212 : Commit. 0.00001 PPL. 937.77 Recons. 0.02730 +Start training Epoch 213... +Train. Iter 213 : Commit. 0.00001 PPL. 935.24 Recons. 0.02726 +Start training Epoch 214... +Train. Iter 214 : Commit. 0.00001 PPL. 934.53 Recons. 0.02726 +Start training Epoch 215... +Train. Iter 215 : Commit. 0.00001 PPL. 934.87 Recons. 0.02705 +Start training Epoch 216... +Train. Iter 216 : Commit. 0.00001 PPL. 938.77 Recons. 0.02702 +Start training Epoch 217... +Train. Iter 217 : Commit. 0.00001 PPL. 942.71 Recons. 0.02697 +Start training Epoch 218... +Train. Iter 218 : Commit. 0.00001 PPL. 940.68 Recons. 0.02695 +Start training Epoch 219... +Train. Iter 219 : Commit. 0.00001 PPL. 932.06 Recons. 0.02702 +Start training Epoch 220... +Train. Iter 220 : Commit. 0.00001 PPL. 926.90 Recons. 0.02701 +Check if save...? +----saved---- +Start training Epoch 221... +Train. Iter 221 : Commit. 0.00001 PPL. 932.62 Recons. 0.02697 +Start training Epoch 222... +Train. Iter 222 : Commit. 0.00001 PPL. 926.86 Recons. 0.02686 +Start training Epoch 223... +Train. Iter 223 : Commit. 0.00001 PPL. 928.90 Recons. 0.02683 +Start training Epoch 224... +Train. Iter 224 : Commit. 0.00001 PPL. 930.00 Recons. 0.02678 +Start training Epoch 225... +Train. Iter 225 : Commit. 0.00001 PPL. 934.16 Recons. 0.02661 +Start training Epoch 226... +Train. Iter 226 : Commit. 0.00001 PPL. 929.27 Recons. 0.02663 +Start training Epoch 227... +Train. Iter 227 : Commit. 0.00001 PPL. 930.81 Recons. 0.02654 +Start training Epoch 228... +Train. Iter 228 : Commit. 0.00001 PPL. 934.69 Recons. 0.02655 +Start training Epoch 229... +Train. Iter 229 : Commit. 0.00001 PPL. 936.55 Recons. 0.02642 +Start training Epoch 230... +Train. Iter 230 : Commit. 0.00001 PPL. 931.09 Recons. 0.02640 +Check if save...? +----saved---- +Start training Epoch 231... +Train. Iter 231 : Commit. 0.00001 PPL. 931.12 Recons. 0.02643 +Start training Epoch 232... +Train. Iter 232 : Commit. 0.00001 PPL. 930.24 Recons. 0.02625 +Start training Epoch 233... +Train. Iter 233 : Commit. 0.00001 PPL. 931.71 Recons. 0.02629 +Start training Epoch 234... +Train. Iter 234 : Commit. 0.00001 PPL. 930.51 Recons. 0.02651 +Start training Epoch 235... +Train. Iter 235 : Commit. 0.00001 PPL. 929.88 Recons. 0.02625 +Start training Epoch 236... +Train. Iter 236 : Commit. 0.00001 PPL. 928.33 Recons. 0.02618 +Start training Epoch 237... +Train. Iter 237 : Commit. 0.00001 PPL. 925.01 Recons. 0.02620 +Start training Epoch 238... +Train. Iter 238 : Commit. 0.00001 PPL. 928.39 Recons. 0.02613 +Start training Epoch 239... +Train. Iter 239 : Commit. 0.00001 PPL. 930.40 Recons. 0.02618 +Start training Epoch 240... +Train. Iter 240 : Commit. 0.00001 PPL. 935.24 Recons. 0.02605 +Check if save...? +----saved---- +Start training Epoch 241... +Train. Iter 241 : Commit. 0.00001 PPL. 938.09 Recons. 0.02606 +Start training Epoch 242... +Train. Iter 242 : Commit. 0.00001 PPL. 935.80 Recons. 0.02594 +Start training Epoch 243... +Train. Iter 243 : Commit. 0.00001 PPL. 933.59 Recons. 0.02593 +Start training Epoch 244... +Train. Iter 244 : Commit. 0.00001 PPL. 934.42 Recons. 0.02598 +Start training Epoch 245... +Train. Iter 245 : Commit. 0.00001 PPL. 932.96 Recons. 0.02599 +Start training Epoch 246... +Train. Iter 246 : Commit. 0.00001 PPL. 936.67 Recons. 0.02599 +Start training Epoch 247... +Train. Iter 247 : Commit. 0.00001 PPL. 937.51 Recons. 0.02594 +Start training Epoch 248... +Train. Iter 248 : Commit. 0.00001 PPL. 941.91 Recons. 0.02585 +Start training Epoch 249... +Train. Iter 249 : Commit. 0.00001 PPL. 940.44 Recons. 0.02583 +Start training Epoch 250... +Train. Iter 250 : Commit. 0.00001 PPL. 937.14 Recons. 0.02570 +Check if save...? +----saved---- +Start training Epoch 251... +Train. Iter 251 : Commit. 0.00001 PPL. 938.17 Recons. 0.02588 +Start training Epoch 252... +Train. Iter 252 : Commit. 0.00001 PPL. 935.79 Recons. 0.02571 +Start training Epoch 253... +Train. Iter 253 : Commit. 0.00001 PPL. 939.35 Recons. 0.02564 +Start training Epoch 254... +Train. Iter 254 : Commit. 0.00001 PPL. 942.27 Recons. 0.02566 +Start training Epoch 255... +Train. Iter 255 : Commit. 0.00001 PPL. 942.40 Recons. 0.02559 +Start training Epoch 256... +Train. Iter 256 : Commit. 0.00001 PPL. 967.06 Recons. 0.02551 +Start training Epoch 257... +Train. Iter 257 : Commit. 0.00001 PPL. 973.68 Recons. 0.02551 +Start training Epoch 258... +Train. Iter 258 : Commit. 0.00001 PPL. 955.16 Recons. 0.02551 +Start training Epoch 259... +Train. Iter 259 : Commit. 0.00001 PPL. 945.99 Recons. 0.02548 +Start training Epoch 260... +Train. Iter 260 : Commit. 0.00001 PPL. 945.68 Recons. 0.02542 +Check if save...? +----saved---- +Start training Epoch 261... +Train. Iter 261 : Commit. 0.00001 PPL. 943.24 Recons. 0.02549 +Start training Epoch 262... +Train. Iter 262 : Commit. 0.00001 PPL. 946.50 Recons. 0.02554 +Start training Epoch 263... +Train. Iter 263 : Commit. 0.00001 PPL. 942.35 Recons. 0.02538 +Start training Epoch 264... +Train. Iter 264 : Commit. 0.00001 PPL. 944.83 Recons. 0.02534 +Start training Epoch 265... +Train. Iter 265 : Commit. 0.00001 PPL. 947.89 Recons. 0.02541 +Start training Epoch 266... +Train. Iter 266 : Commit. 0.00001 PPL. 947.83 Recons. 0.02532 +Start training Epoch 267... +Train. Iter 267 : Commit. 0.00001 PPL. 950.26 Recons. 0.02511 +Start training Epoch 268... +Train. Iter 268 : Commit. 0.00001 PPL. 949.45 Recons. 0.02525 +Start training Epoch 269... +Train. Iter 269 : Commit. 0.00001 PPL. 952.47 Recons. 0.02516 +Start training Epoch 270... +Train. Iter 270 : Commit. 0.00001 PPL. 949.46 Recons. 0.02525 +Check if save...? +----saved---- +Start training Epoch 271... +Train. Iter 271 : Commit. 0.00001 PPL. 948.73 Recons. 0.02507 +Start training Epoch 272... +Train. Iter 272 : Commit. 0.00001 PPL. 945.55 Recons. 0.02508 +Start training Epoch 273... +Train. Iter 273 : Commit. 0.00001 PPL. 943.46 Recons. 0.02504 +Start training Epoch 274... +Train. Iter 274 : Commit. 0.00001 PPL. 943.63 Recons. 0.02502 +Start training Epoch 275... +Train. Iter 275 : Commit. 0.00001 PPL. 941.26 Recons. 0.02504 +Start training Epoch 276... +Train. Iter 276 : Commit. 0.00001 PPL. 944.31 Recons. 0.02491 +Start training Epoch 277... +Train. Iter 277 : Commit. 0.00001 PPL. 944.22 Recons. 0.02500 +Start training Epoch 278... +Train. Iter 278 : Commit. 0.00001 PPL. 944.84 Recons. 0.02492 +Start training Epoch 279... +Train. Iter 279 : Commit. 0.00001 PPL. 941.29 Recons. 0.02485 +Start training Epoch 280... +Train. Iter 280 : Commit. 0.00001 PPL. 942.68 Recons. 0.02483 +Check if save...? +----saved---- +Start training Epoch 281... +Train. Iter 281 : Commit. 0.00001 PPL. 940.13 Recons. 0.02512 +Start training Epoch 282... +Train. Iter 282 : Commit. 0.00001 PPL. 940.40 Recons. 0.02484 +Start training Epoch 283... +Train. Iter 283 : Commit. 0.00001 PPL. 945.38 Recons. 0.02473 +Start training Epoch 284... +Train. Iter 284 : Commit. 0.00001 PPL. 945.44 Recons. 0.02481 +Start training Epoch 285... +Train. Iter 285 : Commit. 0.00001 PPL. 948.16 Recons. 0.02476 +Start training Epoch 286... +Train. Iter 286 : Commit. 0.00001 PPL. 946.85 Recons. 0.02467 +Start training Epoch 287... +Train. Iter 287 : Commit. 0.00001 PPL. 950.76 Recons. 0.02467 +Start training Epoch 288... +Train. Iter 288 : Commit. 0.00001 PPL. 946.94 Recons. 0.02456 +Start training Epoch 289... +Train. Iter 289 : Commit. 0.00001 PPL. 954.77 Recons. 0.02451 +Start training Epoch 290... +Train. Iter 290 : Commit. 0.00001 PPL. 951.43 Recons. 0.02451 +Check if save...? +----saved---- +Start training Epoch 291... +Train. Iter 291 : Commit. 0.00001 PPL. 958.23 Recons. 0.02455 +Start training Epoch 292... +Train. Iter 292 : Commit. 0.00001 PPL. 954.48 Recons. 0.02459 +Start training Epoch 293... +Train. Iter 293 : Commit. 0.00001 PPL. 957.04 Recons. 0.02449 +Start training Epoch 294... +Train. Iter 294 : Commit. 0.00001 PPL. 954.18 Recons. 0.02449 +Start training Epoch 295... +Train. Iter 295 : Commit. 0.00001 PPL. 958.79 Recons. 0.02449 +Start training Epoch 296... +Train. Iter 296 : Commit. 0.00001 PPL. 953.83 Recons. 0.02439 +Start training Epoch 297... +Train. Iter 297 : Commit. 0.00001 PPL. 957.11 Recons. 0.02436 +Start training Epoch 298... +Train. Iter 298 : Commit. 0.00001 PPL. 956.81 Recons. 0.02439 +Start training Epoch 299... +Train. Iter 299 : Commit. 0.00001 PPL. 960.76 Recons. 0.02439 +Start training Epoch 300... +Train. Iter 300 : Commit. 0.00001 PPL. 957.28 Recons. 0.02446 +Check if save...? +----saved---- +Start training Epoch 301... +Train. Iter 301 : Commit. 0.00001 PPL. 963.38 Recons. 0.02425 +Start training Epoch 302... +Train. Iter 302 : Commit. 0.00001 PPL. 960.92 Recons. 0.02423 +Start training Epoch 303... +Train. Iter 303 : Commit. 0.00001 PPL. 960.50 Recons. 0.02414 +Start training Epoch 304... +Train. Iter 304 : Commit. 0.00001 PPL. 960.85 Recons. 0.02414 +Start training Epoch 305... +Train. Iter 305 : Commit. 0.00001 PPL. 959.58 Recons. 0.02424 +Start training Epoch 306... +Train. Iter 306 : Commit. 0.00001 PPL. 958.26 Recons. 0.02408 +Start training Epoch 307... +Train. Iter 307 : Commit. 0.00001 PPL. 956.37 Recons. 0.02417 +Start training Epoch 308... +Train. Iter 308 : Commit. 0.00001 PPL. 959.67 Recons. 0.02405 +Start training Epoch 309... +Train. Iter 309 : Commit. 0.00001 PPL. 962.00 Recons. 0.02417 +Start training Epoch 310... +Train. Iter 310 : Commit. 0.00001 PPL. 965.54 Recons. 0.02394 +Check if save...? +----saved---- +Start training Epoch 311... +Train. Iter 311 : Commit. 0.00001 PPL. 966.84 Recons. 0.02399 +Start training Epoch 312... +Train. Iter 312 : Commit. 0.00001 PPL. 963.42 Recons. 0.02397 +Start training Epoch 313... +Train. Iter 313 : Commit. 0.00001 PPL. 967.58 Recons. 0.02389 +Start training Epoch 314... +Train. Iter 314 : Commit. 0.00001 PPL. 971.38 Recons. 0.02400 +Start training Epoch 315... +Train. Iter 315 : Commit. 0.00001 PPL. 963.10 Recons. 0.02406 +Start training Epoch 316... +Train. Iter 316 : Commit. 0.00001 PPL. 966.79 Recons. 0.02389 +Start training Epoch 317... +Train. Iter 317 : Commit. 0.00001 PPL. 969.66 Recons. 0.02385 +Start training Epoch 318... +Train. Iter 318 : Commit. 0.00001 PPL. 961.76 Recons. 0.02384 +Start training Epoch 319... +Train. Iter 319 : Commit. 0.00001 PPL. 958.37 Recons. 0.02388 +Start training Epoch 320... +Train. Iter 320 : Commit. 0.00001 PPL. 960.48 Recons. 0.02395 +Check if save...? +Start training Epoch 321... +Train. Iter 321 : Commit. 0.00001 PPL. 960.16 Recons. 0.02372 +Start training Epoch 322... +Train. Iter 322 : Commit. 0.00001 PPL. 957.35 Recons. 0.02374 +Start training Epoch 323... +Train. Iter 323 : Commit. 0.00001 PPL. 956.34 Recons. 0.02380 +Start training Epoch 324... +Train. Iter 324 : Commit. 0.00001 PPL. 960.51 Recons. 0.02369 +Start training Epoch 325... +Train. Iter 325 : Commit. 0.00001 PPL. 956.35 Recons. 0.02375 +Start training Epoch 326... +Train. Iter 326 : Commit. 0.00001 PPL. 958.40 Recons. 0.02366 +Start training Epoch 327... +Train. Iter 327 : Commit. 0.00001 PPL. 956.36 Recons. 0.02360 +Start training Epoch 328... +Train. Iter 328 : Commit. 0.00001 PPL. 956.08 Recons. 0.02397 +Start training Epoch 329... +Train. Iter 329 : Commit. 0.00001 PPL. 956.31 Recons. 0.02360 +Start training Epoch 330... +Train. Iter 330 : Commit. 0.00001 PPL. 957.33 Recons. 0.02360 +Check if save...? +----saved---- +Start training Epoch 331... +Train. Iter 331 : Commit. 0.00001 PPL. 955.60 Recons. 0.02354 +Start training Epoch 332... +Train. Iter 332 : Commit. 0.00001 PPL. 961.60 Recons. 0.02358 +Start training Epoch 333... +Train. Iter 333 : Commit. 0.00001 PPL. 956.98 Recons. 0.02360 +Start training Epoch 334... +Train. Iter 334 : Commit. 0.00001 PPL. 959.56 Recons. 0.02345 +Start training Epoch 335... +Train. Iter 335 : Commit. 0.00001 PPL. 954.89 Recons. 0.02356 +Start training Epoch 336... +Train. Iter 336 : Commit. 0.00001 PPL. 954.10 Recons. 0.02359 +Start training Epoch 337... +Train. Iter 337 : Commit. 0.00001 PPL. 954.02 Recons. 0.02333 +Start training Epoch 338... +Train. Iter 338 : Commit. 0.00001 PPL. 957.19 Recons. 0.02339 +Start training Epoch 339... +Train. Iter 339 : Commit. 0.00001 PPL. 955.77 Recons. 0.02346 +Start training Epoch 340... +Train. Iter 340 : Commit. 0.00001 PPL. 954.47 Recons. 0.02332 +Check if save...? +----saved---- +Start training Epoch 341... +Train. Iter 341 : Commit. 0.00001 PPL. 952.55 Recons. 0.02333 +Start training Epoch 342... +Train. Iter 342 : Commit. 0.00001 PPL. 951.00 Recons. 0.02337 +Start training Epoch 343... +Train. Iter 343 : Commit. 0.00001 PPL. 953.59 Recons. 0.02321 +Start training Epoch 344... +Train. Iter 344 : Commit. 0.00001 PPL. 955.96 Recons. 0.02322 +Start training Epoch 345... +Train. Iter 345 : Commit. 0.00001 PPL. 953.28 Recons. 0.02314 +Start training Epoch 346... +Train. Iter 346 : Commit. 0.00001 PPL. 950.65 Recons. 0.02331 +Start training Epoch 347... +Train. Iter 347 : Commit. 0.00001 PPL. 957.48 Recons. 0.02320 +Start training Epoch 348... +Train. Iter 348 : Commit. 0.00001 PPL. 956.80 Recons. 0.02320 +Start training Epoch 349... +Train. Iter 349 : Commit. 0.00001 PPL. 958.52 Recons. 0.02321 +Start training Epoch 350... +Train. Iter 350 : Commit. 0.00001 PPL. 955.95 Recons. 0.02311 +Check if save...? +----saved---- +Start training Epoch 351... +Train. Iter 351 : Commit. 0.00001 PPL. 955.33 Recons. 0.02308 +Start training Epoch 352... +Train. Iter 352 : Commit. 0.00001 PPL. 955.11 Recons. 0.02313 +Start training Epoch 353... +Train. Iter 353 : Commit. 0.00001 PPL. 956.22 Recons. 0.02313 +Start training Epoch 354... +Train. Iter 354 : Commit. 0.00001 PPL. 959.56 Recons. 0.02303 +Start training Epoch 355... +Train. Iter 355 : Commit. 0.00001 PPL. 958.98 Recons. 0.02307 +Start training Epoch 356... +Train. Iter 356 : Commit. 0.00001 PPL. 960.41 Recons. 0.02299 +Start training Epoch 357... +Train. Iter 357 : Commit. 0.00001 PPL. 961.03 Recons. 0.02309 +Start training Epoch 358... +Train. Iter 358 : Commit. 0.00001 PPL. 960.22 Recons. 0.02297 +Start training Epoch 359... +Train. Iter 359 : Commit. 0.00001 PPL. 960.06 Recons. 0.02303 +Start training Epoch 360... +Train. Iter 360 : Commit. 0.00001 PPL. 959.99 Recons. 0.02308 +Check if save...? +----saved---- +Start training Epoch 361... +Train. Iter 361 : Commit. 0.00001 PPL. 957.93 Recons. 0.02330 +Start training Epoch 362... +Train. Iter 362 : Commit. 0.00001 PPL. 960.85 Recons. 0.02291 +Start training Epoch 363... +Train. Iter 363 : Commit. 0.00001 PPL. 959.43 Recons. 0.02294 +Start training Epoch 364... +Train. Iter 364 : Commit. 0.00001 PPL. 966.01 Recons. 0.02297 +Start training Epoch 365... +Train. Iter 365 : Commit. 0.00001 PPL. 964.86 Recons. 0.02281 +Start training Epoch 366... +Train. Iter 366 : Commit. 0.00001 PPL. 963.64 Recons. 0.02296 +Start training Epoch 367... +Train. Iter 367 : Commit. 0.00001 PPL. 957.01 Recons. 0.02279 +Start training Epoch 368... +Train. Iter 368 : Commit. 0.00001 PPL. 958.46 Recons. 0.02268 +Start training Epoch 369... +Train. Iter 369 : Commit. 0.00001 PPL. 955.83 Recons. 0.02274 +Start training Epoch 370... +Train. Iter 370 : Commit. 0.00001 PPL. 962.95 Recons. 0.02274 +Check if save...? +----saved---- +Start training Epoch 371... +Train. Iter 371 : Commit. 0.00001 PPL. 970.34 Recons. 0.02270 +Start training Epoch 372... +Train. Iter 372 : Commit. 0.00001 PPL. 970.30 Recons. 0.02264 +Start training Epoch 373... +Train. Iter 373 : Commit. 0.00001 PPL. 966.30 Recons. 0.02274 +Start training Epoch 374... +Train. Iter 374 : Commit. 0.00001 PPL. 965.90 Recons. 0.02268 +Start training Epoch 375... +Train. Iter 375 : Commit. 0.00001 PPL. 965.89 Recons. 0.02273 +Start training Epoch 376... +Train. Iter 376 : Commit. 0.00001 PPL. 964.23 Recons. 0.02265 +Start training Epoch 377... +Train. Iter 377 : Commit. 0.00001 PPL. 969.44 Recons. 0.02262 +Start training Epoch 378... +Train. Iter 378 : Commit. 0.00001 PPL. 969.48 Recons. 0.02261 +Start training Epoch 379... +Train. Iter 379 : Commit. 0.00001 PPL. 970.38 Recons. 0.02253 +Start training Epoch 380... +Train. Iter 380 : Commit. 0.00001 PPL. 974.54 Recons. 0.02258 +Check if save...? +----saved---- +Start training Epoch 381... +Train. Iter 381 : Commit. 0.00001 PPL. 971.78 Recons. 0.02258 +Start training Epoch 382... +Train. Iter 382 : Commit. 0.00001 PPL. 967.83 Recons. 0.02244 +Start training Epoch 383... +Train. Iter 383 : Commit. 0.00001 PPL. 966.46 Recons. 0.02245 +Start training Epoch 384... +Train. Iter 384 : Commit. 0.00001 PPL. 965.33 Recons. 0.02247 +Start training Epoch 385... +Train. Iter 385 : Commit. 0.00001 PPL. 961.07 Recons. 0.02272 +Start training Epoch 386... +Train. Iter 386 : Commit. 0.00001 PPL. 960.10 Recons. 0.02262 +Start training Epoch 387... +Train. Iter 387 : Commit. 0.00001 PPL. 960.22 Recons. 0.02253 +Start training Epoch 388... +Train. Iter 388 : Commit. 0.00001 PPL. 962.84 Recons. 0.02241 +Start training Epoch 389... +Train. Iter 389 : Commit. 0.00001 PPL. 966.22 Recons. 0.02239 +Start training Epoch 390... +Train. Iter 390 : Commit. 0.00001 PPL. 963.87 Recons. 0.02237 +Check if save...? +----saved---- +Start training Epoch 391... +Train. Iter 391 : Commit. 0.00001 PPL. 964.45 Recons. 0.02250 +Start training Epoch 392... +Train. Iter 392 : Commit. 0.00001 PPL. 958.44 Recons. 0.02256 +Start training Epoch 393... +Train. Iter 393 : Commit. 0.00001 PPL. 964.43 Recons. 0.02236 +Start training Epoch 394... +Train. Iter 394 : Commit. 0.00001 PPL. 964.08 Recons. 0.02229 +Start training Epoch 395... +Train. Iter 395 : Commit. 0.00001 PPL. 964.40 Recons. 0.02238 +Start training Epoch 396... +Train. Iter 396 : Commit. 0.00001 PPL. 961.59 Recons. 0.02222 +Start training Epoch 397... +Train. Iter 397 : Commit. 0.00001 PPL. 963.00 Recons. 0.02226 +Start training Epoch 398... +Train. Iter 398 : Commit. 0.00001 PPL. 963.71 Recons. 0.02226 +Start training Epoch 399... +Train. Iter 399 : Commit. 0.00001 PPL. 966.22 Recons. 0.02221 +Start training Epoch 400... +Train. Iter 400 : Commit. 0.00001 PPL. 961.70 Recons. 0.02245 +Check if save...? +Start training Epoch 401... +Train. Iter 401 : Commit. 0.00001 PPL. 961.30 Recons. 0.02219 +Start training Epoch 402... +Train. Iter 402 : Commit. 0.00001 PPL. 963.30 Recons. 0.02212 +Start training Epoch 403... +Train. Iter 403 : Commit. 0.00001 PPL. 964.04 Recons. 0.02209 +Start training Epoch 404... +Train. Iter 404 : Commit. 0.00001 PPL. 959.17 Recons. 0.02217 +Start training Epoch 405... +Train. Iter 405 : Commit. 0.00001 PPL. 964.29 Recons. 0.02213 +Start training Epoch 406... +Train. Iter 406 : Commit. 0.00001 PPL. 961.04 Recons. 0.02218 +Start training Epoch 407... +Train. Iter 407 : Commit. 0.00001 PPL. 962.87 Recons. 0.02215 +Start training Epoch 408... +Train. Iter 408 : Commit. 0.00001 PPL. 964.97 Recons. 0.02208 +Start training Epoch 409... +Train. Iter 409 : Commit. 0.00001 PPL. 968.46 Recons. 0.02204 +Start training Epoch 410... +Train. Iter 410 : Commit. 0.00001 PPL. 968.29 Recons. 0.02209 +Check if save...? +----saved---- +Start training Epoch 411... +Train. Iter 411 : Commit. 0.00001 PPL. 965.65 Recons. 0.02205 +Start training Epoch 412... +Train. Iter 412 : Commit. 0.00001 PPL. 965.82 Recons. 0.02203 +Start training Epoch 413... +Train. Iter 413 : Commit. 0.00001 PPL. 964.57 Recons. 0.02214 +Start training Epoch 414... +Train. Iter 414 : Commit. 0.00001 PPL. 962.20 Recons. 0.02204 +Start training Epoch 415... +Train. Iter 415 : Commit. 0.00001 PPL. 960.50 Recons. 0.02197 +Start training Epoch 416... +Train. Iter 416 : Commit. 0.00001 PPL. 959.39 Recons. 0.02206 +Start training Epoch 417... +Train. Iter 417 : Commit. 0.00001 PPL. 962.29 Recons. 0.02190 +Start training Epoch 418... +Train. Iter 418 : Commit. 0.00001 PPL. 965.18 Recons. 0.02198 +Start training Epoch 419... +Train. Iter 419 : Commit. 0.00001 PPL. 965.74 Recons. 0.02191 +Start training Epoch 420... +Train. Iter 420 : Commit. 0.00001 PPL. 966.80 Recons. 0.02189 +Check if save...? +----saved---- +Start training Epoch 421... +Train. Iter 421 : Commit. 0.00001 PPL. 967.02 Recons. 0.02182 +Start training Epoch 422... +Train. Iter 422 : Commit. 0.00001 PPL. 963.77 Recons. 0.02182 +Start training Epoch 423... +Train. Iter 423 : Commit. 0.00001 PPL. 966.21 Recons. 0.02181 +Start training Epoch 424... +Train. Iter 424 : Commit. 0.00001 PPL. 963.80 Recons. 0.02187 +Start training Epoch 425... +Train. Iter 425 : Commit. 0.00001 PPL. 965.84 Recons. 0.02183 +Start training Epoch 426... +Train. Iter 426 : Commit. 0.00001 PPL. 964.13 Recons. 0.02181 +Start training Epoch 427... +Train. Iter 427 : Commit. 0.00001 PPL. 969.96 Recons. 0.02186 +Start training Epoch 428... +Train. Iter 428 : Commit. 0.00001 PPL. 963.77 Recons. 0.02183 +Start training Epoch 429... +Train. Iter 429 : Commit. 0.00001 PPL. 961.21 Recons. 0.02180 +Start training Epoch 430... +Train. Iter 430 : Commit. 0.00001 PPL. 967.90 Recons. 0.02172 +Check if save...? +----saved---- +Start training Epoch 431... +Train. Iter 431 : Commit. 0.00001 PPL. 971.15 Recons. 0.02176 +Start training Epoch 432... +Train. Iter 432 : Commit. 0.00001 PPL. 968.97 Recons. 0.02173 +Start training Epoch 433... +Train. Iter 433 : Commit. 0.00001 PPL. 969.39 Recons. 0.02168 +Start training Epoch 434... +Train. Iter 434 : Commit. 0.00001 PPL. 971.66 Recons. 0.02166 +Start training Epoch 435... +Train. Iter 435 : Commit. 0.00001 PPL. 967.67 Recons. 0.02177 +Start training Epoch 436... +Train. Iter 436 : Commit. 0.00001 PPL. 971.11 Recons. 0.02166 +Start training Epoch 437... +Train. Iter 437 : Commit. 0.00001 PPL. 968.20 Recons. 0.02203 +Start training Epoch 438... +Train. Iter 438 : Commit. 0.00001 PPL. 970.84 Recons. 0.02164 +Start training Epoch 439... +Train. Iter 439 : Commit. 0.00001 PPL. 969.86 Recons. 0.02167 +Start training Epoch 440... +Train. Iter 440 : Commit. 0.00001 PPL. 967.15 Recons. 0.02171 +Check if save...? +----saved---- +Start training Epoch 441... +Train. Iter 441 : Commit. 0.00001 PPL. 972.13 Recons. 0.02162 +Start training Epoch 442... +Train. Iter 442 : Commit. 0.00001 PPL. 974.58 Recons. 0.02157 +Start training Epoch 443... +Train. Iter 443 : Commit. 0.00001 PPL. 974.63 Recons. 0.02150 +Start training Epoch 444... +Train. Iter 444 : Commit. 0.00001 PPL. 971.82 Recons. 0.02159 +Start training Epoch 445... +Train. Iter 445 : Commit. 0.00001 PPL. 966.03 Recons. 0.02146 +Start training Epoch 446... +Train. Iter 446 : Commit. 0.00001 PPL. 959.74 Recons. 0.02187 +Start training Epoch 447... +Train. Iter 447 : Commit. 0.00001 PPL. 964.67 Recons. 0.02143 +Start training Epoch 448... +Train. Iter 448 : Commit. 0.00001 PPL. 960.43 Recons. 0.02151 +Start training Epoch 449... +Train. Iter 449 : Commit. 0.00001 PPL. 963.78 Recons. 0.02153 +Start training Epoch 450... +Train. Iter 450 : Commit. 0.00001 PPL. 975.67 Recons. 0.02144 +Check if save...? +----saved---- +Start training Epoch 451... +Train. Iter 451 : Commit. 0.00001 PPL. 970.93 Recons. 0.02144 +Start training Epoch 452... +Train. Iter 452 : Commit. 0.00001 PPL. 968.06 Recons. 0.02144 +Start training Epoch 453... +Train. Iter 453 : Commit. 0.00001 PPL. 966.38 Recons. 0.02138 +Start training Epoch 454... +Train. Iter 454 : Commit. 0.00001 PPL. 965.23 Recons. 0.02147 +Start training Epoch 455... +Train. Iter 455 : Commit. 0.00001 PPL. 967.92 Recons. 0.02141 +Start training Epoch 456... +Train. Iter 456 : Commit. 0.00001 PPL. 968.74 Recons. 0.02136 +Start training Epoch 457... +Train. Iter 457 : Commit. 0.00001 PPL. 966.86 Recons. 0.02138 +Start training Epoch 458... +Train. Iter 458 : Commit. 0.00001 PPL. 969.53 Recons. 0.02136 +Start training Epoch 459... +Train. Iter 459 : Commit. 0.00001 PPL. 969.09 Recons. 0.02130 +Start training Epoch 460... +Train. Iter 460 : Commit. 0.00001 PPL. 971.44 Recons. 0.02129 +Check if save...? +----saved---- +Start training Epoch 461... +Train. Iter 461 : Commit. 0.00001 PPL. 970.91 Recons. 0.02120 +Start training Epoch 462... +Train. Iter 462 : Commit. 0.00001 PPL. 970.77 Recons. 0.02119 +Start training Epoch 463... +Train. Iter 463 : Commit. 0.00001 PPL. 973.56 Recons. 0.02128 +Start training Epoch 464... +Train. Iter 464 : Commit. 0.00001 PPL. 974.83 Recons. 0.02120 +Start training Epoch 465... +Train. Iter 465 : Commit. 0.00001 PPL. 968.41 Recons. 0.02124 +Start training Epoch 466... +Train. Iter 466 : Commit. 0.00001 PPL. 969.26 Recons. 0.02123 +Start training Epoch 467... +Train. Iter 467 : Commit. 0.00001 PPL. 972.57 Recons. 0.02131 +Start training Epoch 468... +Train. Iter 468 : Commit. 0.00001 PPL. 971.09 Recons. 0.02130 +Start training Epoch 469... +Train. Iter 469 : Commit. 0.00001 PPL. 970.03 Recons. 0.02128 +Start training Epoch 470... +Train. Iter 470 : Commit. 0.00001 PPL. 973.96 Recons. 0.02124 +Check if save...? +----saved---- +Start training Epoch 471... +Train. Iter 471 : Commit. 0.00001 PPL. 973.55 Recons. 0.02117 +Start training Epoch 472... +Train. Iter 472 : Commit. 0.00001 PPL. 974.20 Recons. 0.02111 +Start training Epoch 473... +Train. Iter 473 : Commit. 0.00001 PPL. 969.02 Recons. 0.02110 +Start training Epoch 474... +Train. Iter 474 : Commit. 0.00001 PPL. 978.94 Recons. 0.02111 +Start training Epoch 475... +Train. Iter 475 : Commit. 0.00001 PPL. 975.23 Recons. 0.02107 +Start training Epoch 476... +Train. Iter 476 : Commit. 0.00001 PPL. 978.52 Recons. 0.02104 +Start training Epoch 477... +Train. Iter 477 : Commit. 0.00001 PPL. 977.38 Recons. 0.02113 +Start training Epoch 478... +Train. Iter 478 : Commit. 0.00001 PPL. 974.27 Recons. 0.02121 +Start training Epoch 479... +Train. Iter 479 : Commit. 0.00001 PPL. 972.58 Recons. 0.02108 +Start training Epoch 480... +Train. Iter 480 : Commit. 0.00001 PPL. 974.11 Recons. 0.02106 +Check if save...? +----saved---- +Start training Epoch 481... +Train. Iter 481 : Commit. 0.00001 PPL. 973.31 Recons. 0.02104 +Start training Epoch 482... +Train. Iter 482 : Commit. 0.00001 PPL. 977.51 Recons. 0.02099 +Start training Epoch 483... +Train. Iter 483 : Commit. 0.00001 PPL. 974.50 Recons. 0.02103 +Start training Epoch 484... +Train. Iter 484 : Commit. 0.00001 PPL. 973.76 Recons. 0.02093 +Start training Epoch 485... +Train. Iter 485 : Commit. 0.00001 PPL. 982.15 Recons. 0.02100 +Start training Epoch 486... +Train. Iter 486 : Commit. 0.00001 PPL. 980.42 Recons. 0.02108 +Start training Epoch 487... +Train. Iter 487 : Commit. 0.00001 PPL. 975.55 Recons. 0.02100 +Start training Epoch 488... +Train. Iter 488 : Commit. 0.00001 PPL. 979.65 Recons. 0.02101 +Start training Epoch 489... +Train. Iter 489 : Commit. 0.00001 PPL. 978.28 Recons. 0.02089 +Start training Epoch 490... +Train. Iter 490 : Commit. 0.00001 PPL. 977.83 Recons. 0.02115 +Check if save...? +Start training Epoch 491... +Train. Iter 491 : Commit. 0.00001 PPL. 984.27 Recons. 0.02098 +Start training Epoch 492... +Train. Iter 492 : Commit. 0.00001 PPL. 983.63 Recons. 0.02089 +Start training Epoch 493... +Train. Iter 493 : Commit. 0.00001 PPL. 982.99 Recons. 0.02090 +Start training Epoch 494... +Train. Iter 494 : Commit. 0.00001 PPL. 983.56 Recons. 0.02086 +Start training Epoch 495... +Train. Iter 495 : Commit. 0.00001 PPL. 979.34 Recons. 0.02093 +Start training Epoch 496... +Train. Iter 496 : Commit. 0.00001 PPL. 980.88 Recons. 0.02087 +Start training Epoch 497... +Train. Iter 497 : Commit. 0.00001 PPL. 979.46 Recons. 0.02083 +Start training Epoch 498... +Train. Iter 498 : Commit. 0.00001 PPL. 981.97 Recons. 0.02076 +Start training Epoch 499... +Train. Iter 499 : Commit. 0.00001 PPL. 982.58 Recons. 0.02082 +Start training Epoch 500... +Train. Iter 500 : Commit. 0.00001 PPL. 980.11 Recons. 0.02087 +Check if save...? +----saved---- +Start training Epoch 501... +Train. Iter 501 : Commit. 0.00001 PPL. 979.30 Recons. 0.02071 +Start training Epoch 502... +Train. Iter 502 : Commit. 0.00001 PPL. 975.67 Recons. 0.02080 +Start training Epoch 503... +Train. Iter 503 : Commit. 0.00001 PPL. 979.71 Recons. 0.02073 +Start training Epoch 504... +Train. Iter 504 : Commit. 0.00001 PPL. 982.81 Recons. 0.02079 +Start training Epoch 505... +Train. Iter 505 : Commit. 0.00001 PPL. 982.15 Recons. 0.02070 +Start training Epoch 506... +Train. Iter 506 : Commit. 0.00001 PPL. 979.16 Recons. 0.02100 +Start training Epoch 507... +Train. Iter 507 : Commit. 0.00001 PPL. 973.00 Recons. 0.02101 +Start training Epoch 508... +Train. Iter 508 : Commit. 0.00001 PPL. 985.36 Recons. 0.02081 +Start training Epoch 509... +Train. Iter 509 : Commit. 0.00001 PPL. 980.86 Recons. 0.02084 +Start training Epoch 510... +Train. Iter 510 : Commit. 0.00001 PPL. 976.09 Recons. 0.02080 +Check if save...? +----saved---- +Start training Epoch 511... +Train. Iter 511 : Commit. 0.00001 PPL. 973.39 Recons. 0.02073 +Start training Epoch 512... +Train. Iter 512 : Commit. 0.00001 PPL. 974.71 Recons. 0.02070 +Start training Epoch 513... +Train. Iter 513 : Commit. 0.00001 PPL. 976.16 Recons. 0.02069 +Start training Epoch 514... +Train. Iter 514 : Commit. 0.00001 PPL. 975.30 Recons. 0.02062 +Start training Epoch 515... +Train. Iter 515 : Commit. 0.00001 PPL. 976.52 Recons. 0.02061 +Start training Epoch 516... +Train. Iter 516 : Commit. 0.00001 PPL. 974.80 Recons. 0.02062 +Start training Epoch 517... +Train. Iter 517 : Commit. 0.00001 PPL. 976.61 Recons. 0.02058 +Start training Epoch 518... +Train. Iter 518 : Commit. 0.00001 PPL. 973.40 Recons. 0.02052 +Start training Epoch 519... +Train. Iter 519 : Commit. 0.00001 PPL. 971.00 Recons. 0.02054 +Start training Epoch 520... +Train. Iter 520 : Commit. 0.00001 PPL. 978.10 Recons. 0.02055 +Check if save...? +----saved---- +Start training Epoch 521... +Train. Iter 521 : Commit. 0.00001 PPL. 976.11 Recons. 0.02058 +Start training Epoch 522... +Train. Iter 522 : Commit. 0.00001 PPL. 974.26 Recons. 0.02052 +Start training Epoch 523... +Train. Iter 523 : Commit. 0.00001 PPL. 976.77 Recons. 0.02069 +Start training Epoch 524... +Train. Iter 524 : Commit. 0.00001 PPL. 975.77 Recons. 0.02041 +Start training Epoch 525... +Train. Iter 525 : Commit. 0.00001 PPL. 975.98 Recons. 0.02041 +Start training Epoch 526... +Train. Iter 526 : Commit. 0.00001 PPL. 980.63 Recons. 0.02049 +Start training Epoch 527... +Train. Iter 527 : Commit. 0.00001 PPL. 982.25 Recons. 0.02075 +Start training Epoch 528... +Train. Iter 528 : Commit. 0.00001 PPL. 979.07 Recons. 0.02049 +Start training Epoch 529... +Train. Iter 529 : Commit. 0.00001 PPL. 979.09 Recons. 0.02048 +Start training Epoch 530... +Train. Iter 530 : Commit. 0.00001 PPL. 979.64 Recons. 0.02056 +Check if save...? +Start training Epoch 531... +Train. Iter 531 : Commit. 0.00001 PPL. 986.51 Recons. 0.02053 +Start training Epoch 532... +Train. Iter 532 : Commit. 0.00001 PPL. 984.33 Recons. 0.02050 +Start training Epoch 533... +Train. Iter 533 : Commit. 0.00001 PPL. 981.70 Recons. 0.02041 +Start training Epoch 534... +Train. Iter 534 : Commit. 0.00001 PPL. 984.46 Recons. 0.02048 +Start training Epoch 535... +Train. Iter 535 : Commit. 0.00001 PPL. 981.12 Recons. 0.02047 +Start training Epoch 536... +Train. Iter 536 : Commit. 0.00001 PPL. 988.93 Recons. 0.02047 +Start training Epoch 537... +Train. Iter 537 : Commit. 0.00001 PPL. 984.69 Recons. 0.02050 +Start training Epoch 538... +Train. Iter 538 : Commit. 0.00001 PPL. 984.69 Recons. 0.02038 +Start training Epoch 539... +Train. Iter 539 : Commit. 0.00001 PPL. 987.97 Recons. 0.02054 +Start training Epoch 540... +Train. Iter 540 : Commit. 0.00001 PPL. 984.56 Recons. 0.02034 +Check if save...? +----saved---- +Start training Epoch 541... +Train. Iter 541 : Commit. 0.00001 PPL. 987.29 Recons. 0.02036 +Start training Epoch 542... +Train. Iter 542 : Commit. 0.00001 PPL. 987.04 Recons. 0.02032 +Start training Epoch 543... +Train. Iter 543 : Commit. 0.00001 PPL. 983.89 Recons. 0.02033 +Start training Epoch 544... +Train. Iter 544 : Commit. 0.00001 PPL. 982.25 Recons. 0.02036 +Start training Epoch 545... +Train. Iter 545 : Commit. 0.00001 PPL. 985.64 Recons. 0.02031 +Start training Epoch 546... +Train. Iter 546 : Commit. 0.00001 PPL. 983.97 Recons. 0.02031 +Start training Epoch 547... +Train. Iter 547 : Commit. 0.00001 PPL. 976.32 Recons. 0.02028 +Start training Epoch 548... +Train. Iter 548 : Commit. 0.00001 PPL. 982.06 Recons. 0.02025 +Start training Epoch 549... +Train. Iter 549 : Commit. 0.00001 PPL. 979.03 Recons. 0.02025 +Start training Epoch 550... +Train. Iter 550 : Commit. 0.00001 PPL. 977.14 Recons. 0.02029 +Check if save...? +----saved---- +Start training Epoch 551... +Train. Iter 551 : Commit. 0.00001 PPL. 982.65 Recons. 0.02026 +Start training Epoch 552... +Train. Iter 552 : Commit. 0.00001 PPL. 989.23 Recons. 0.02026 +Start training Epoch 553... +Train. Iter 553 : Commit. 0.00001 PPL. 982.79 Recons. 0.02023 +Start training Epoch 554... +Train. Iter 554 : Commit. 0.00001 PPL. 995.15 Recons. 0.02043 +Start training Epoch 555... +Train. Iter 555 : Commit. 0.00001 PPL. 988.22 Recons. 0.02027 +Start training Epoch 556... +Train. Iter 556 : Commit. 0.00001 PPL. 990.63 Recons. 0.02040 +Start training Epoch 557... +Train. Iter 557 : Commit. 0.00001 PPL. 987.81 Recons. 0.02018 +Start training Epoch 558... +Train. Iter 558 : Commit. 0.00001 PPL. 988.01 Recons. 0.02024 +Start training Epoch 559... +Train. Iter 559 : Commit. 0.00001 PPL. 985.14 Recons. 0.02024 +Start training Epoch 560... +Train. Iter 560 : Commit. 0.00001 PPL. 982.80 Recons. 0.02016 +Check if save...? +----saved---- +Start training Epoch 561... +Train. Iter 561 : Commit. 0.00001 PPL. 984.24 Recons. 0.02011 +Start training Epoch 562... +Train. Iter 562 : Commit. 0.00001 PPL. 998.50 Recons. 0.02016 +Start training Epoch 563... +Train. Iter 563 : Commit. 0.00001 PPL. 994.15 Recons. 0.02016 +Start training Epoch 564... +Train. Iter 564 : Commit. 0.00001 PPL. 986.05 Recons. 0.02017 +Start training Epoch 565... +Train. Iter 565 : Commit. 0.00001 PPL. 984.50 Recons. 0.02026 +Start training Epoch 566... +Train. Iter 566 : Commit. 0.00001 PPL. 982.29 Recons. 0.02045 +Start training Epoch 567... +Train. Iter 567 : Commit. 0.00001 PPL. 983.40 Recons. 0.02013 +Start training Epoch 568... +Train. Iter 568 : Commit. 0.00001 PPL. 985.42 Recons. 0.02014 +Start training Epoch 569... +Train. Iter 569 : Commit. 0.00001 PPL. 983.06 Recons. 0.02027 +Start training Epoch 570... +Train. Iter 570 : Commit. 0.00001 PPL. 983.16 Recons. 0.02010 +Check if save...? +----saved---- +Start training Epoch 571... +Train. Iter 571 : Commit. 0.00001 PPL. 983.98 Recons. 0.02010 +Start training Epoch 572... +Train. Iter 572 : Commit. 0.00001 PPL. 984.70 Recons. 0.02009 +Start training Epoch 573... +Train. Iter 573 : Commit. 0.00001 PPL. 991.89 Recons. 0.02002 +Start training Epoch 574... +Train. Iter 574 : Commit. 0.00001 PPL. 985.72 Recons. 0.02000 +Start training Epoch 575... +Train. Iter 575 : Commit. 0.00001 PPL. 986.55 Recons. 0.02001 +Start training Epoch 576... +Train. Iter 576 : Commit. 0.00001 PPL. 984.05 Recons. 0.01997 +Start training Epoch 577... +Train. Iter 577 : Commit. 0.00001 PPL. 986.54 Recons. 0.01999 +Start training Epoch 578... +Train. Iter 578 : Commit. 0.00001 PPL. 984.25 Recons. 0.02018 +Start training Epoch 579... +Train. Iter 579 : Commit. 0.00001 PPL. 987.18 Recons. 0.01997 +Start training Epoch 580... +Train. Iter 580 : Commit. 0.00001 PPL. 989.19 Recons. 0.02019 +Check if save...? +Start training Epoch 581... +Train. Iter 581 : Commit. 0.00001 PPL. 988.71 Recons. 0.02004 +Start training Epoch 582... +Train. Iter 582 : Commit. 0.00001 PPL. 989.80 Recons. 0.02005 +Start training Epoch 583... +Train. Iter 583 : Commit. 0.00001 PPL. 991.54 Recons. 0.01997 +Start training Epoch 584... +Train. Iter 584 : Commit. 0.00001 PPL. 984.58 Recons. 0.02008 +Start training Epoch 585... +Train. Iter 585 : Commit. 0.00001 PPL. 986.54 Recons. 0.01992 +Start training Epoch 586... +Train. Iter 586 : Commit. 0.00001 PPL. 984.35 Recons. 0.01994 +Start training Epoch 587... +Train. Iter 587 : Commit. 0.00001 PPL. 982.77 Recons. 0.02026 +Start training Epoch 588... +Train. Iter 588 : Commit. 0.00001 PPL. 988.23 Recons. 0.01989 +Start training Epoch 589... +Train. Iter 589 : Commit. 0.00001 PPL. 985.51 Recons. 0.01996 +Start training Epoch 590... +Train. Iter 590 : Commit. 0.00001 PPL. 987.31 Recons. 0.01992 +Check if save...? +----saved---- +Start training Epoch 591... +Train. Iter 591 : Commit. 0.00001 PPL. 983.06 Recons. 0.01989 +Start training Epoch 592... +Train. Iter 592 : Commit. 0.00001 PPL. 984.06 Recons. 0.01986 +Start training Epoch 593... +Train. Iter 593 : Commit. 0.00001 PPL. 986.21 Recons. 0.01989 +Start training Epoch 594... +Train. Iter 594 : Commit. 0.00001 PPL. 986.54 Recons. 0.01987 +Start training Epoch 595... +Train. Iter 595 : Commit. 0.00001 PPL. 983.71 Recons. 0.01985 +Start training Epoch 596... +Train. Iter 596 : Commit. 0.00001 PPL. 981.59 Recons. 0.01977 +Start training Epoch 597... +Train. Iter 597 : Commit. 0.00001 PPL. 985.78 Recons. 0.01984 +Start training Epoch 598... +Train. Iter 598 : Commit. 0.00001 PPL. 977.75 Recons. 0.01986 +Start training Epoch 599... +Train. Iter 599 : Commit. 0.00001 PPL. 979.62 Recons. 0.01987 +Start training Epoch 600... +Train. Iter 600 : Commit. 0.00001 PPL. 982.37 Recons. 0.01977 +Check if save...? +----saved---- +Start training Epoch 601... +Train. Iter 601 : Commit. 0.00001 PPL. 976.06 Recons. 0.01977 +Start training Epoch 602... +Train. Iter 602 : Commit. 0.00001 PPL. 979.80 Recons. 0.01976 +Start training Epoch 603... +Train. Iter 603 : Commit. 0.00001 PPL. 980.52 Recons. 0.01972 +Start training Epoch 604... +Train. Iter 604 : Commit. 0.00001 PPL. 980.29 Recons. 0.01982 +Start training Epoch 605... +Train. Iter 605 : Commit. 0.00001 PPL. 986.08 Recons. 0.01975 +Start training Epoch 606... +Train. Iter 606 : Commit. 0.00001 PPL. 980.71 Recons. 0.01973 +Start training Epoch 607... +Train. Iter 607 : Commit. 0.00001 PPL. 982.65 Recons. 0.01969 +Start training Epoch 608... +Train. Iter 608 : Commit. 0.00001 PPL. 982.91 Recons. 0.01973 +Start training Epoch 609... +Train. Iter 609 : Commit. 0.00001 PPL. 982.02 Recons. 0.01971 +Start training Epoch 610... +Train. Iter 610 : Commit. 0.00001 PPL. 983.57 Recons. 0.01976 +Check if save...? +----saved---- +Start training Epoch 611... +Train. Iter 611 : Commit. 0.00001 PPL. 979.83 Recons. 0.01969 +Start training Epoch 612... +Train. Iter 612 : Commit. 0.00001 PPL. 979.76 Recons. 0.01968 +Start training Epoch 613... +Train. Iter 613 : Commit. 0.00001 PPL. 981.17 Recons. 0.01969 +Start training Epoch 614... +Train. Iter 614 : Commit. 0.00001 PPL. 983.83 Recons. 0.01969 +Start training Epoch 615... +Train. Iter 615 : Commit. 0.00001 PPL. 983.75 Recons. 0.01968 +Start training Epoch 616... +Train. Iter 616 : Commit. 0.00001 PPL. 983.37 Recons. 0.01959 +Start training Epoch 617... +Train. Iter 617 : Commit. 0.00001 PPL. 983.63 Recons. 0.01964 +Start training Epoch 618... +Train. Iter 618 : Commit. 0.00001 PPL. 981.50 Recons. 0.01958 +Start training Epoch 619... +Train. Iter 619 : Commit. 0.00001 PPL. 982.84 Recons. 0.01960 +Start training Epoch 620... +Train. Iter 620 : Commit. 0.00001 PPL. 982.83 Recons. 0.01959 +Check if save...? +----saved---- +Start training Epoch 621... +Train. Iter 621 : Commit. 0.00001 PPL. 982.24 Recons. 0.01971 +Start training Epoch 622... +Train. Iter 622 : Commit. 0.00001 PPL. 981.84 Recons. 0.01961 +Start training Epoch 623... +Train. Iter 623 : Commit. 0.00001 PPL. 986.25 Recons. 0.01964 +Start training Epoch 624... +Train. Iter 624 : Commit. 0.00001 PPL. 982.74 Recons. 0.01965 +Start training Epoch 625... +Train. Iter 625 : Commit. 0.00001 PPL. 980.70 Recons. 0.01963 +Start training Epoch 626... +Train. Iter 626 : Commit. 0.00001 PPL. 986.19 Recons. 0.01957 +Start training Epoch 627... +Train. Iter 627 : Commit. 0.00001 PPL. 979.10 Recons. 0.01964 +Start training Epoch 628... +Train. Iter 628 : Commit. 0.00001 PPL. 981.64 Recons. 0.01953 +Start training Epoch 629... +Train. Iter 629 : Commit. 0.00001 PPL. 980.13 Recons. 0.01960 +Start training Epoch 630... +Train. Iter 630 : Commit. 0.00001 PPL. 981.98 Recons. 0.01960 +Check if save...? +Start training Epoch 631... +Train. Iter 631 : Commit. 0.00001 PPL. 979.98 Recons. 0.01954 +Start training Epoch 632... +Train. Iter 632 : Commit. 0.00001 PPL. 977.33 Recons. 0.01947 +Start training Epoch 633... +Train. Iter 633 : Commit. 0.00001 PPL. 986.93 Recons. 0.01968 +Start training Epoch 634... +Train. Iter 634 : Commit. 0.00001 PPL. 982.20 Recons. 0.01948 +Start training Epoch 635... +Train. Iter 635 : Commit. 0.00001 PPL. 981.97 Recons. 0.01952 +Start training Epoch 636... +Train. Iter 636 : Commit. 0.00001 PPL. 980.62 Recons. 0.01951 +Start training Epoch 637... +Train. Iter 637 : Commit. 0.00001 PPL. 982.19 Recons. 0.01950 +Start training Epoch 638... +Train. Iter 638 : Commit. 0.00001 PPL. 978.99 Recons. 0.01954 +Start training Epoch 639... +Train. Iter 639 : Commit. 0.00001 PPL. 981.28 Recons. 0.01943 +Start training Epoch 640... +Train. Iter 640 : Commit. 0.00001 PPL. 979.52 Recons. 0.01947 +Check if save...? +----saved---- +Start training Epoch 641... +Train. Iter 641 : Commit. 0.00001 PPL. 975.98 Recons. 0.01946 +Start training Epoch 642... +Train. Iter 642 : Commit. 0.00001 PPL. 976.71 Recons. 0.01945 +Start training Epoch 643... +Train. Iter 643 : Commit. 0.00001 PPL. 975.65 Recons. 0.01964 +Start training Epoch 644... +Train. Iter 644 : Commit. 0.00001 PPL. 984.51 Recons. 0.01954 +Start training Epoch 645... +Train. Iter 645 : Commit. 0.00001 PPL. 977.97 Recons. 0.01963 +Start training Epoch 646... +Train. Iter 646 : Commit. 0.00001 PPL. 977.73 Recons. 0.01954 +Start training Epoch 647... +Train. Iter 647 : Commit. 0.00001 PPL. 979.76 Recons. 0.01955 +Start training Epoch 648... +Train. Iter 648 : Commit. 0.00001 PPL. 980.53 Recons. 0.01945 +Start training Epoch 649... +Train. Iter 649 : Commit. 0.00001 PPL. 980.93 Recons. 0.01939 +Start training Epoch 650... +Train. Iter 650 : Commit. 0.00001 PPL. 983.44 Recons. 0.01942 +Check if save...? +----saved---- +Start training Epoch 651... +Train. Iter 651 : Commit. 0.00001 PPL. 982.85 Recons. 0.01935 +Start training Epoch 652... +Train. Iter 652 : Commit. 0.00001 PPL. 988.53 Recons. 0.01942 +Start training Epoch 653... +Train. Iter 653 : Commit. 0.00001 PPL. 988.00 Recons. 0.01933 +Start training Epoch 654... +Train. Iter 654 : Commit. 0.00001 PPL. 986.88 Recons. 0.01941 +Start training Epoch 655... +Train. Iter 655 : Commit. 0.00001 PPL. 997.71 Recons. 0.01940 +Start training Epoch 656... +Train. Iter 656 : Commit. 0.00001 PPL. 1003.19 Recons. 0.01938 +Start training Epoch 657... +Train. Iter 657 : Commit. 0.00001 PPL. 997.66 Recons. 0.01945 +Start training Epoch 658... +Train. Iter 658 : Commit. 0.00001 PPL. 996.52 Recons. 0.01935 +Start training Epoch 659... +Train. Iter 659 : Commit. 0.00001 PPL. 996.73 Recons. 0.01957 +Start training Epoch 660... +Train. Iter 660 : Commit. 0.00001 PPL. 999.07 Recons. 0.01936 +Check if save...? +----saved---- +Start training Epoch 661... +Train. Iter 661 : Commit. 0.00001 PPL. 993.93 Recons. 0.01940 +Start training Epoch 662... +Train. Iter 662 : Commit. 0.00001 PPL. 987.60 Recons. 0.01937 +Start training Epoch 663... +Train. Iter 663 : Commit. 0.00001 PPL. 987.93 Recons. 0.01939 +Start training Epoch 664... +Train. Iter 664 : Commit. 0.00001 PPL. 987.55 Recons. 0.01929 +Start training Epoch 665... +Train. Iter 665 : Commit. 0.00001 PPL. 987.64 Recons. 0.01930 +Start training Epoch 666... +Train. Iter 666 : Commit. 0.00001 PPL. 985.95 Recons. 0.01929 +Start training Epoch 667... +Train. Iter 667 : Commit. 0.00001 PPL. 982.93 Recons. 0.01929 +Start training Epoch 668... +Train. Iter 668 : Commit. 0.00001 PPL. 983.87 Recons. 0.01924 +Start training Epoch 669... +Train. Iter 669 : Commit. 0.00001 PPL. 981.98 Recons. 0.01932 +Start training Epoch 670... +Train. Iter 670 : Commit. 0.00001 PPL. 984.10 Recons. 0.01926 +Check if save...? +----saved---- +Start training Epoch 671... +Train. Iter 671 : Commit. 0.00001 PPL. 985.09 Recons. 0.01923 +Start training Epoch 672... +Train. Iter 672 : Commit. 0.00001 PPL. 993.46 Recons. 0.01928 +Start training Epoch 673... +Train. Iter 673 : Commit. 0.00001 PPL. 989.83 Recons. 0.01926 +Start training Epoch 674... +Train. Iter 674 : Commit. 0.00001 PPL. 997.45 Recons. 0.01929 +Start training Epoch 675... +Train. Iter 675 : Commit. 0.00001 PPL. 995.15 Recons. 0.01923 +Start training Epoch 676... +Train. Iter 676 : Commit. 0.00001 PPL. 992.38 Recons. 0.01917 +Start training Epoch 677... +Train. Iter 677 : Commit. 0.00001 PPL. 992.06 Recons. 0.01916 +Start training Epoch 678... +Train. Iter 678 : Commit. 0.00001 PPL. 989.61 Recons. 0.01915 +Start training Epoch 679... +Train. Iter 679 : Commit. 0.00001 PPL. 996.39 Recons. 0.01918 +Start training Epoch 680... +Train. Iter 680 : Commit. 0.00001 PPL. 992.49 Recons. 0.01921 +Check if save...? +----saved---- +Start training Epoch 681... +Train. Iter 681 : Commit. 0.00001 PPL. 992.65 Recons. 0.01933 +Start training Epoch 682... +Train. Iter 682 : Commit. 0.00001 PPL. 994.16 Recons. 0.01921 +Start training Epoch 683... +Train. Iter 683 : Commit. 0.00001 PPL. 993.42 Recons. 0.01918 +Start training Epoch 684... +Train. Iter 684 : Commit. 0.00001 PPL. 994.96 Recons. 0.01911 +Start training Epoch 685... +Train. Iter 685 : Commit. 0.00001 PPL. 990.21 Recons. 0.01919 +Start training Epoch 686... +Train. Iter 686 : Commit. 0.00001 PPL. 990.81 Recons. 0.01917 +Start training Epoch 687... +Train. Iter 687 : Commit. 0.00001 PPL. 989.70 Recons. 0.01910 +Start training Epoch 688... +Train. Iter 688 : Commit. 0.00001 PPL. 991.33 Recons. 0.01928 +Start training Epoch 689... +Train. Iter 689 : Commit. 0.00001 PPL. 996.66 Recons. 0.01910 +Start training Epoch 690... +Train. Iter 690 : Commit. 0.00001 PPL. 993.02 Recons. 0.01931 +Check if save...? +Start training Epoch 691... +Train. Iter 691 : Commit. 0.00001 PPL. 996.58 Recons. 0.01910 +Start training Epoch 692... +Train. Iter 692 : Commit. 0.00001 PPL. 993.85 Recons. 0.01914 +Start training Epoch 693... +Train. Iter 693 : Commit. 0.00001 PPL. 992.04 Recons. 0.01913 +Start training Epoch 694... +Train. Iter 694 : Commit. 0.00001 PPL. 991.92 Recons. 0.01904 +Start training Epoch 695... +Train. Iter 695 : Commit. 0.00001 PPL. 1000.61 Recons. 0.01915 +Start training Epoch 696... +Train. Iter 696 : Commit. 0.00001 PPL. 995.16 Recons. 0.01915 +Start training Epoch 697... +Train. Iter 697 : Commit. 0.00001 PPL. 996.48 Recons. 0.01910 +Start training Epoch 698... +Train. Iter 698 : Commit. 0.00001 PPL. 991.29 Recons. 0.01905 +Start training Epoch 699... +Train. Iter 699 : Commit. 0.00001 PPL. 991.68 Recons. 0.01906 +Start training Epoch 700... +Train. Iter 700 : Commit. 0.00001 PPL. 990.13 Recons. 0.01911 +Check if save...? +----saved---- +Start training Epoch 701... +Train. Iter 701 : Commit. 0.00001 PPL. 991.84 Recons. 0.01908 +Start training Epoch 702... +Train. Iter 702 : Commit. 0.00001 PPL. 988.69 Recons. 0.01906 +Start training Epoch 703... +Train. Iter 703 : Commit. 0.00001 PPL. 990.51 Recons. 0.01908 +Start training Epoch 704... +Train. Iter 704 : Commit. 0.00001 PPL. 991.20 Recons. 0.01903 +Start training Epoch 705... +Train. Iter 705 : Commit. 0.00001 PPL. 992.53 Recons. 0.01901 +Start training Epoch 706... +Train. Iter 706 : Commit. 0.00001 PPL. 993.83 Recons. 0.01901 +Start training Epoch 707... +Train. Iter 707 : Commit. 0.00001 PPL. 998.43 Recons. 0.01903 +Start training Epoch 708... +Train. Iter 708 : Commit. 0.00001 PPL. 1003.44 Recons. 0.01904 +Start training Epoch 709... +Train. Iter 709 : Commit. 0.00001 PPL. 998.47 Recons. 0.01899 +Start training Epoch 710... +Train. Iter 710 : Commit. 0.00001 PPL. 1003.53 Recons. 0.01895 +Check if save...? +----saved---- +Start training Epoch 711... +Train. Iter 711 : Commit. 0.00001 PPL. 1001.03 Recons. 0.01897 +Start training Epoch 712... +Train. Iter 712 : Commit. 0.00001 PPL. 995.64 Recons. 0.01893 +Start training Epoch 713... +Train. Iter 713 : Commit. 0.00001 PPL. 995.42 Recons. 0.01902 +Start training Epoch 714... +Train. Iter 714 : Commit. 0.00001 PPL. 995.98 Recons. 0.01893 +Start training Epoch 715... +Train. Iter 715 : Commit. 0.00001 PPL. 997.44 Recons. 0.01892 +Start training Epoch 716... +Train. Iter 716 : Commit. 0.00001 PPL. 993.22 Recons. 0.01890 +Start training Epoch 717... +Train. Iter 717 : Commit. 0.00001 PPL. 994.21 Recons. 0.01893 +Start training Epoch 718... +Train. Iter 718 : Commit. 0.00001 PPL. 997.77 Recons. 0.01897 +Start training Epoch 719... +Train. Iter 719 : Commit. 0.00001 PPL. 997.26 Recons. 0.01899 +Start training Epoch 720... +Train. Iter 720 : Commit. 0.00001 PPL. 992.45 Recons. 0.01895 +Check if save...? +Start training Epoch 721... +Train. Iter 721 : Commit. 0.00001 PPL. 993.72 Recons. 0.01895 +Start training Epoch 722... +Train. Iter 722 : Commit. 0.00001 PPL. 991.72 Recons. 0.01904 +Start training Epoch 723... +Train. Iter 723 : Commit. 0.00001 PPL. 994.50 Recons. 0.01888 +Start training Epoch 724... +Train. Iter 724 : Commit. 0.00001 PPL. 1000.42 Recons. 0.01915 +Start training Epoch 725... +Train. Iter 725 : Commit. 0.00001 PPL. 1001.08 Recons. 0.01888 +Start training Epoch 726... +Train. Iter 726 : Commit. 0.00001 PPL. 995.66 Recons. 0.01890 +Start training Epoch 727... +Train. Iter 727 : Commit. 0.00001 PPL. 996.20 Recons. 0.01896 +Start training Epoch 728... +Train. Iter 728 : Commit. 0.00001 PPL. 995.91 Recons. 0.01892 +Start training Epoch 729... +Train. Iter 729 : Commit. 0.00001 PPL. 993.10 Recons. 0.01882 +Start training Epoch 730... +Train. Iter 730 : Commit. 0.00001 PPL. 995.63 Recons. 0.01885 +Check if save...? +----saved---- +Start training Epoch 731... +Train. Iter 731 : Commit. 0.00001 PPL. 994.98 Recons. 0.01886 +Start training Epoch 732... +Train. Iter 732 : Commit. 0.00001 PPL. 994.68 Recons. 0.01881 +Start training Epoch 733... +Train. Iter 733 : Commit. 0.00001 PPL. 992.10 Recons. 0.01884 +Start training Epoch 734... +Train. Iter 734 : Commit. 0.00001 PPL. 992.93 Recons. 0.01886 +Start training Epoch 735... +Train. Iter 735 : Commit. 0.00001 PPL. 992.42 Recons. 0.01925 +Start training Epoch 736... +Train. Iter 736 : Commit. 0.00001 PPL. 995.37 Recons. 0.01887 +Start training Epoch 737... +Train. Iter 737 : Commit. 0.00001 PPL. 995.25 Recons. 0.01884 +Start training Epoch 738... +Train. Iter 738 : Commit. 0.00001 PPL. 1000.18 Recons. 0.01885 +Start training Epoch 739... +Train. Iter 739 : Commit. 0.00001 PPL. 1001.65 Recons. 0.01887 +Start training Epoch 740... +Train. Iter 740 : Commit. 0.00001 PPL. 997.27 Recons. 0.01889 +Check if save...? +Start training Epoch 741... +Train. Iter 741 : Commit. 0.00001 PPL. 995.92 Recons. 0.01887 +Start training Epoch 742... +Train. Iter 742 : Commit. 0.00001 PPL. 1003.16 Recons. 0.01889 +Start training Epoch 743... +Train. Iter 743 : Commit. 0.00001 PPL. 1002.82 Recons. 0.01885 +Start training Epoch 744... +Train. Iter 744 : Commit. 0.00001 PPL. 996.27 Recons. 0.01883 +Start training Epoch 745... +Train. Iter 745 : Commit. 0.00001 PPL. 993.43 Recons. 0.01878 +Start training Epoch 746... +Train. Iter 746 : Commit. 0.00001 PPL. 991.07 Recons. 0.01883 +Start training Epoch 747... +Train. Iter 747 : Commit. 0.00001 PPL. 992.06 Recons. 0.01882 +Start training Epoch 748... +Train. Iter 748 : Commit. 0.00001 PPL. 994.48 Recons. 0.01868 +Start training Epoch 749... +Train. Iter 749 : Commit. 0.00001 PPL. 994.27 Recons. 0.01880 +Start training Epoch 750... +Train. Iter 750 : Commit. 0.00001 PPL. 999.06 Recons. 0.01879 +Check if save...? +----saved---- +Start training Epoch 751... +Train. Iter 751 : Commit. 0.00001 PPL. 1002.30 Recons. 0.01876 +Start training Epoch 752... +Train. Iter 752 : Commit. 0.00001 PPL. 1001.40 Recons. 0.01880 +Start training Epoch 753... +Train. Iter 753 : Commit. 0.00001 PPL. 996.95 Recons. 0.01877 +Start training Epoch 754... +Train. Iter 754 : Commit. 0.00001 PPL. 999.28 Recons. 0.01870 +Start training Epoch 755... +Train. Iter 755 : Commit. 0.00001 PPL. 998.73 Recons. 0.01865 +Start training Epoch 756... +Train. Iter 756 : Commit. 0.00001 PPL. 996.27 Recons. 0.01872 +Start training Epoch 757... +Train. Iter 757 : Commit. 0.00001 PPL. 1000.71 Recons. 0.01861 +Start training Epoch 758... +Train. Iter 758 : Commit. 0.00001 PPL. 998.41 Recons. 0.01869 +Start training Epoch 759... +Train. Iter 759 : Commit. 0.00001 PPL. 995.25 Recons. 0.01866 +Start training Epoch 760... +Train. Iter 760 : Commit. 0.00001 PPL. 1003.33 Recons. 0.01864 +Check if save...? +----saved---- +Start training Epoch 761... +Train. Iter 761 : Commit. 0.00001 PPL. 1003.27 Recons. 0.01864 +Start training Epoch 762... +Train. Iter 762 : Commit. 0.00001 PPL. 1001.66 Recons. 0.01879 +Start training Epoch 763... +Train. Iter 763 : Commit. 0.00001 PPL. 997.38 Recons. 0.01862 +Start training Epoch 764... +Train. Iter 764 : Commit. 0.00001 PPL. 998.41 Recons. 0.01865 +Start training Epoch 765... +Train. Iter 765 : Commit. 0.00001 PPL. 999.88 Recons. 0.01855 +Start training Epoch 766... +Train. Iter 766 : Commit. 0.00001 PPL. 998.19 Recons. 0.01863 +Start training Epoch 767... +Train. Iter 767 : Commit. 0.00001 PPL. 996.35 Recons. 0.01880 +Start training Epoch 768... +Train. Iter 768 : Commit. 0.00001 PPL. 996.49 Recons. 0.01867 +Start training Epoch 769... +Train. Iter 769 : Commit. 0.00001 PPL. 995.25 Recons. 0.01862 +Start training Epoch 770... +Train. Iter 770 : Commit. 0.00001 PPL. 990.01 Recons. 0.01864 +Check if save...? +Start training Epoch 771... +Train. Iter 771 : Commit. 0.00001 PPL. 994.50 Recons. 0.01868 +Start training Epoch 772... +Train. Iter 772 : Commit. 0.00001 PPL. 994.16 Recons. 0.01865 +Start training Epoch 773... +Train. Iter 773 : Commit. 0.00001 PPL. 990.45 Recons. 0.01861 +Start training Epoch 774... +Train. Iter 774 : Commit. 0.00001 PPL. 991.33 Recons. 0.01855 +Start training Epoch 775... +Train. Iter 775 : Commit. 0.00001 PPL. 987.40 Recons. 0.01863 +Start training Epoch 776... +Train. Iter 776 : Commit. 0.00001 PPL. 991.89 Recons. 0.01862 +Start training Epoch 777... +Train. Iter 777 : Commit. 0.00001 PPL. 995.99 Recons. 0.01854 +Start training Epoch 778... +Train. Iter 778 : Commit. 0.00001 PPL. 990.89 Recons. 0.01858 +Start training Epoch 779... +Train. Iter 779 : Commit. 0.00001 PPL. 992.42 Recons. 0.01854 +Start training Epoch 780... +Train. Iter 780 : Commit. 0.00001 PPL. 994.49 Recons. 0.01853 +Check if save...? +----saved---- +Start training Epoch 781... +Train. Iter 781 : Commit. 0.00001 PPL. 989.25 Recons. 0.01855 +Start training Epoch 782... +Train. Iter 782 : Commit. 0.00001 PPL. 989.83 Recons. 0.01853 +Start training Epoch 783... +Train. Iter 783 : Commit. 0.00001 PPL. 987.94 Recons. 0.01851 +Start training Epoch 784... +Train. Iter 784 : Commit. 0.00001 PPL. 984.53 Recons. 0.01854 +Start training Epoch 785... +Train. Iter 785 : Commit. 0.00001 PPL. 987.74 Recons. 0.01855 +Start training Epoch 786... +Train. Iter 786 : Commit. 0.00001 PPL. 988.69 Recons. 0.01846 +Start training Epoch 787... +Train. Iter 787 : Commit. 0.00001 PPL. 986.95 Recons. 0.01865 +Start training Epoch 788... +Train. Iter 788 : Commit. 0.00001 PPL. 985.95 Recons. 0.01859 +Start training Epoch 789... +Train. Iter 789 : Commit. 0.00001 PPL. 985.25 Recons. 0.01882 +Start training Epoch 790... +Train. Iter 790 : Commit. 0.00001 PPL. 988.74 Recons. 0.01859 +Check if save...? +Start training Epoch 791... +Train. Iter 791 : Commit. 0.00001 PPL. 994.08 Recons. 0.01853 +Start training Epoch 792... +Train. Iter 792 : Commit. 0.00001 PPL. 991.77 Recons. 0.01856 +Start training Epoch 793... +Train. Iter 793 : Commit. 0.00001 PPL. 990.01 Recons. 0.01852 +Start training Epoch 794... +Train. Iter 794 : Commit. 0.00001 PPL. 989.49 Recons. 0.01849 +Start training Epoch 795... +Train. Iter 795 : Commit. 0.00001 PPL. 987.37 Recons. 0.01869 +Start training Epoch 796... +Train. Iter 796 : Commit. 0.00001 PPL. 994.10 Recons. 0.01844 +Start training Epoch 797... +Train. Iter 797 : Commit. 0.00001 PPL. 996.00 Recons. 0.01848 +Start training Epoch 798... +Train. Iter 798 : Commit. 0.00001 PPL. 991.16 Recons. 0.01848 +Start training Epoch 799... +Train. Iter 799 : Commit. 0.00001 PPL. 998.76 Recons. 0.01849 +Start training Epoch 800... +Train. Iter 800 : Commit. 0.00001 PPL. 997.18 Recons. 0.01839 +Check if save...? +----saved---- +Start training Epoch 801... +Train. Iter 801 : Commit. 0.00001 PPL. 995.72 Recons. 0.01848 +Start training Epoch 802... +Train. Iter 802 : Commit. 0.00001 PPL. 992.46 Recons. 0.01846 +Start training Epoch 803... +Train. Iter 803 : Commit. 0.00001 PPL. 992.17 Recons. 0.01839 +Start training Epoch 804... +Train. Iter 804 : Commit. 0.00001 PPL. 991.57 Recons. 0.01842 +Start training Epoch 805... +Train. Iter 805 : Commit. 0.00001 PPL. 990.17 Recons. 0.01848 +Start training Epoch 806... +Train. Iter 806 : Commit. 0.00001 PPL. 994.48 Recons. 0.01842 +Start training Epoch 807... +Train. Iter 807 : Commit. 0.00001 PPL. 995.47 Recons. 0.01842 +Start training Epoch 808... +Train. Iter 808 : Commit. 0.00001 PPL. 994.44 Recons. 0.01852 +Start training Epoch 809... +Train. Iter 809 : Commit. 0.00001 PPL. 996.88 Recons. 0.01837 +Start training Epoch 810... +Train. Iter 810 : Commit. 0.00001 PPL. 1004.24 Recons. 0.01843 +Check if save...? +Start training Epoch 811... +Train. Iter 811 : Commit. 0.00001 PPL. 997.97 Recons. 0.01838 +Start training Epoch 812... +Train. Iter 812 : Commit. 0.00001 PPL. 993.82 Recons. 0.01845 +Start training Epoch 813... +Train. Iter 813 : Commit. 0.00001 PPL. 992.50 Recons. 0.01851 +Start training Epoch 814... +Train. Iter 814 : Commit. 0.00001 PPL. 994.27 Recons. 0.01837 +Start training Epoch 815... +Train. Iter 815 : Commit. 0.00001 PPL. 995.88 Recons. 0.01842 +Start training Epoch 816... +Train. Iter 816 : Commit. 0.00001 PPL. 998.03 Recons. 0.01845 +Start training Epoch 817... +Train. Iter 817 : Commit. 0.00001 PPL. 997.96 Recons. 0.01838 +Start training Epoch 818... +Train. Iter 818 : Commit. 0.00001 PPL. 996.79 Recons. 0.01839 +Start training Epoch 819... +Train. Iter 819 : Commit. 0.00001 PPL. 998.39 Recons. 0.01835 +Start training Epoch 820... +Train. Iter 820 : Commit. 0.00001 PPL. 999.75 Recons. 0.01846 +Check if save...? +Start training Epoch 821... +Train. Iter 821 : Commit. 0.00001 PPL. 996.82 Recons. 0.01833 +Start training Epoch 822... +Train. Iter 822 : Commit. 0.00001 PPL. 997.55 Recons. 0.01838 +Start training Epoch 823... +Train. Iter 823 : Commit. 0.00001 PPL. 999.66 Recons. 0.01831 +Start training Epoch 824... +Train. Iter 824 : Commit. 0.00001 PPL. 999.11 Recons. 0.01836 +Start training Epoch 825... +Train. Iter 825 : Commit. 0.00001 PPL. 1001.89 Recons. 0.01835 +Start training Epoch 826... +Train. Iter 826 : Commit. 0.00001 PPL. 998.63 Recons. 0.01832 +Start training Epoch 827... +Train. Iter 827 : Commit. 0.00001 PPL. 991.71 Recons. 0.01833 +Start training Epoch 828... +Train. Iter 828 : Commit. 0.00001 PPL. 996.21 Recons. 0.01831 +Start training Epoch 829... +Train. Iter 829 : Commit. 0.00001 PPL. 996.47 Recons. 0.01831 +Start training Epoch 830... +Train. Iter 830 : Commit. 0.00001 PPL. 993.64 Recons. 0.01834 +Check if save...? +----saved---- +Start training Epoch 831... +Train. Iter 831 : Commit. 0.00001 PPL. 991.00 Recons. 0.01826 +Start training Epoch 832... +Train. Iter 832 : Commit. 0.00001 PPL. 993.73 Recons. 0.01838 +Start training Epoch 833... +Train. Iter 833 : Commit. 0.00001 PPL. 994.12 Recons. 0.01830 +Start training Epoch 834... +Train. Iter 834 : Commit. 0.00001 PPL. 1001.10 Recons. 0.01833 +Start training Epoch 835... +Train. Iter 835 : Commit. 0.00001 PPL. 1004.73 Recons. 0.01827 +Start training Epoch 836... +Train. Iter 836 : Commit. 0.00001 PPL. 999.09 Recons. 0.01825 +Start training Epoch 837... +Train. Iter 837 : Commit. 0.00001 PPL. 997.07 Recons. 0.01823 +Start training Epoch 838... +Train. Iter 838 : Commit. 0.00001 PPL. 994.33 Recons. 0.01825 +Start training Epoch 839... +Train. Iter 839 : Commit. 0.00001 PPL. 990.20 Recons. 0.01820 +Start training Epoch 840... +Train. Iter 840 : Commit. 0.00001 PPL. 993.97 Recons. 0.01825 +Check if save...? +----saved---- +Start training Epoch 841... +Train. Iter 841 : Commit. 0.00001 PPL. 994.28 Recons. 0.01832 +Start training Epoch 842... +Train. Iter 842 : Commit. 0.00001 PPL. 998.09 Recons. 0.01830 +Start training Epoch 843... +Train. Iter 843 : Commit. 0.00001 PPL. 1000.61 Recons. 0.01831 +Start training Epoch 844... +Train. Iter 844 : Commit. 0.00001 PPL. 995.47 Recons. 0.01833 +Start training Epoch 845... +Train. Iter 845 : Commit. 0.00001 PPL. 995.77 Recons. 0.01823 +Start training Epoch 846... +Train. Iter 846 : Commit. 0.00001 PPL. 996.73 Recons. 0.01828 +Start training Epoch 847... +Train. Iter 847 : Commit. 0.00001 PPL. 992.52 Recons. 0.01824 +Start training Epoch 848... +Train. Iter 848 : Commit. 0.00001 PPL. 1000.43 Recons. 0.01816 +Start training Epoch 849... +Train. Iter 849 : Commit. 0.00001 PPL. 998.34 Recons. 0.01825 +Start training Epoch 850... +Train. Iter 850 : Commit. 0.00001 PPL. 992.50 Recons. 0.01819 +Check if save...? +----saved---- +Start training Epoch 851... +Train. Iter 851 : Commit. 0.00001 PPL. 993.45 Recons. 0.01819 +Start training Epoch 852... +Train. Iter 852 : Commit. 0.00001 PPL. 990.87 Recons. 0.01819 +Start training Epoch 853... +Train. Iter 853 : Commit. 0.00001 PPL. 991.47 Recons. 0.01821 +Start training Epoch 854... +Train. Iter 854 : Commit. 0.00001 PPL. 989.69 Recons. 0.01818 +Start training Epoch 855... +Train. Iter 855 : Commit. 0.00001 PPL. 989.66 Recons. 0.01826 +Start training Epoch 856... +Train. Iter 856 : Commit. 0.00001 PPL. 992.01 Recons. 0.01819 +Start training Epoch 857... +Train. Iter 857 : Commit. 0.00001 PPL. 987.74 Recons. 0.01822 +Start training Epoch 858... +Train. Iter 858 : Commit. 0.00001 PPL. 986.19 Recons. 0.01829 +Start training Epoch 859... +Train. Iter 859 : Commit. 0.00001 PPL. 994.86 Recons. 0.01820 +Start training Epoch 860... +Train. Iter 860 : Commit. 0.00001 PPL. 990.02 Recons. 0.01818 +Check if save...? +----saved---- +Start training Epoch 861... +Train. Iter 861 : Commit. 0.00001 PPL. 994.36 Recons. 0.01817 +Start training Epoch 862... +Train. Iter 862 : Commit. 0.00001 PPL. 995.66 Recons. 0.01819 +Start training Epoch 863... +Train. Iter 863 : Commit. 0.00001 PPL. 992.44 Recons. 0.01809 +Start training Epoch 864... +Train. Iter 864 : Commit. 0.00001 PPL. 992.94 Recons. 0.01807 +Start training Epoch 865... +Train. Iter 865 : Commit. 0.00001 PPL. 990.25 Recons. 0.01818 +Start training Epoch 866... +Train. Iter 866 : Commit. 0.00001 PPL. 995.74 Recons. 0.01817 +Start training Epoch 867... +Train. Iter 867 : Commit. 0.00001 PPL. 989.27 Recons. 0.01811 +Start training Epoch 868... +Train. Iter 868 : Commit. 0.00001 PPL. 991.80 Recons. 0.01809 +Start training Epoch 869... +Train. Iter 869 : Commit. 0.00001 PPL. 990.30 Recons. 0.01813 +Start training Epoch 870... +Train. Iter 870 : Commit. 0.00001 PPL. 992.92 Recons. 0.01816 +Check if save...? +----saved---- +Start training Epoch 871... +Train. Iter 871 : Commit. 0.00001 PPL. 991.39 Recons. 0.01808 +Start training Epoch 872... +Train. Iter 872 : Commit. 0.00001 PPL. 991.01 Recons. 0.01806 +Start training Epoch 873... +Train. Iter 873 : Commit. 0.00001 PPL. 989.58 Recons. 0.01813 +Start training Epoch 874... +Train. Iter 874 : Commit. 0.00001 PPL. 995.91 Recons. 0.01811 +Start training Epoch 875... +Train. Iter 875 : Commit. 0.00001 PPL. 991.32 Recons. 0.01811 +Start training Epoch 876... +Train. Iter 876 : Commit. 0.00001 PPL. 988.23 Recons. 0.01810 +Start training Epoch 877... +Train. Iter 877 : Commit. 0.00001 PPL. 991.29 Recons. 0.01805 +Start training Epoch 878... +Train. Iter 878 : Commit. 0.00001 PPL. 993.06 Recons. 0.01802 +Start training Epoch 879... +Train. Iter 879 : Commit. 0.00001 PPL. 990.02 Recons. 0.01810 +Start training Epoch 880... +Train. Iter 880 : Commit. 0.00001 PPL. 993.80 Recons. 0.01802 +Check if save...? +----saved---- +Start training Epoch 881... +Train. Iter 881 : Commit. 0.00001 PPL. 992.56 Recons. 0.01804 +Start training Epoch 882... +Train. Iter 882 : Commit. 0.00001 PPL. 989.40 Recons. 0.01805 +Start training Epoch 883... +Train. Iter 883 : Commit. 0.00001 PPL. 989.32 Recons. 0.01804 +Start training Epoch 884... +Train. Iter 884 : Commit. 0.00001 PPL. 996.42 Recons. 0.01809 +Start training Epoch 885... +Train. Iter 885 : Commit. 0.00001 PPL. 994.52 Recons. 0.01804 +Start training Epoch 886... +Train. Iter 886 : Commit. 0.00001 PPL. 1002.53 Recons. 0.01821 +Start training Epoch 887... +Train. Iter 887 : Commit. 0.00001 PPL. 996.76 Recons. 0.01805 +Start training Epoch 888... +Train. Iter 888 : Commit. 0.00001 PPL. 994.24 Recons. 0.01796 +Start training Epoch 889... +Train. Iter 889 : Commit. 0.00001 PPL. 989.92 Recons. 0.01798 +Start training Epoch 890... +Train. Iter 890 : Commit. 0.00001 PPL. 997.57 Recons. 0.01804 +Check if save...? +Start training Epoch 891... +Train. Iter 891 : Commit. 0.00001 PPL. 992.93 Recons. 0.01798 +Start training Epoch 892... +Train. Iter 892 : Commit. 0.00001 PPL. 997.18 Recons. 0.01802 +Start training Epoch 893... +Train. Iter 893 : Commit. 0.00001 PPL. 996.54 Recons. 0.01797 +Start training Epoch 894... +Train. Iter 894 : Commit. 0.00001 PPL. 995.36 Recons. 0.01800 +Start training Epoch 895... +Train. Iter 895 : Commit. 0.00001 PPL. 995.09 Recons. 0.01799 +Start training Epoch 896... +Train. Iter 896 : Commit. 0.00001 PPL. 990.85 Recons. 0.01799 +Start training Epoch 897... +Train. Iter 897 : Commit. 0.00001 PPL. 995.33 Recons. 0.01798 +Start training Epoch 898... +Train. Iter 898 : Commit. 0.00001 PPL. 994.66 Recons. 0.01797 +Start training Epoch 899... +Train. Iter 899 : Commit. 0.00001 PPL. 992.08 Recons. 0.01805 +Start training Epoch 900... +Train. Iter 900 : Commit. 0.00001 PPL. 991.54 Recons. 0.01795 +Check if save...? +----saved---- +Start training Epoch 901... +Train. Iter 901 : Commit. 0.00001 PPL. 989.81 Recons. 0.01829 +Start training Epoch 902... +Train. Iter 902 : Commit. 0.00001 PPL. 992.43 Recons. 0.01796 +Start training Epoch 903... +Train. Iter 903 : Commit. 0.00001 PPL. 996.14 Recons. 0.01805 +Start training Epoch 904... +Train. Iter 904 : Commit. 0.00001 PPL. 1002.18 Recons. 0.01795 +Start training Epoch 905... +Train. Iter 905 : Commit. 0.00001 PPL. 996.25 Recons. 0.01796 +Start training Epoch 906... +Train. Iter 906 : Commit. 0.00001 PPL. 998.23 Recons. 0.01796 +Start training Epoch 907... +Train. Iter 907 : Commit. 0.00001 PPL. 995.80 Recons. 0.01788 +Start training Epoch 908... +Train. Iter 908 : Commit. 0.00001 PPL. 995.91 Recons. 0.01797 +Start training Epoch 909... +Train. Iter 909 : Commit. 0.00001 PPL. 992.75 Recons. 0.01792 +Start training Epoch 910... +Train. Iter 910 : Commit. 0.00001 PPL. 992.51 Recons. 0.01805 +Check if save...? +Start training Epoch 911... +Train. Iter 911 : Commit. 0.00001 PPL. 990.57 Recons. 0.01794 +Start training Epoch 912... +Train. Iter 912 : Commit. 0.00001 PPL. 989.16 Recons. 0.01811 +Start training Epoch 913... +Train. Iter 913 : Commit. 0.00001 PPL. 1002.22 Recons. 0.01811 +Start training Epoch 914... +Train. Iter 914 : Commit. 0.00001 PPL. 1003.47 Recons. 0.01797 +Start training Epoch 915... +Train. Iter 915 : Commit. 0.00001 PPL. 995.91 Recons. 0.01804 +Start training Epoch 916... +Train. Iter 916 : Commit. 0.00001 PPL. 996.17 Recons. 0.01798 +Start training Epoch 917... +Train. Iter 917 : Commit. 0.00001 PPL. 996.41 Recons. 0.01797 +Start training Epoch 918... +Train. Iter 918 : Commit. 0.00001 PPL. 1000.33 Recons. 0.01798 +Start training Epoch 919... +Train. Iter 919 : Commit. 0.00001 PPL. 997.79 Recons. 0.01796 +Start training Epoch 920... +Train. Iter 920 : Commit. 0.00001 PPL. 1002.30 Recons. 0.01783 +Check if save...? +----saved---- +Start training Epoch 921... +Train. Iter 921 : Commit. 0.00001 PPL. 1004.15 Recons. 0.01791 +Start training Epoch 922... +Train. Iter 922 : Commit. 0.00001 PPL. 998.34 Recons. 0.01789 +Start training Epoch 923... +Train. Iter 923 : Commit. 0.00001 PPL. 995.31 Recons. 0.01786 +Start training Epoch 924... +Train. Iter 924 : Commit. 0.00001 PPL. 1001.47 Recons. 0.01786 +Start training Epoch 925... +Train. Iter 925 : Commit. 0.00001 PPL. 997.96 Recons. 0.01787 +Start training Epoch 926... +Train. Iter 926 : Commit. 0.00001 PPL. 1003.91 Recons. 0.01787 +Start training Epoch 927... +Train. Iter 927 : Commit. 0.00001 PPL. 1002.94 Recons. 0.01790 +Start training Epoch 928... +Train. Iter 928 : Commit. 0.00001 PPL. 1006.34 Recons. 0.01785 +Start training Epoch 929... +Train. Iter 929 : Commit. 0.00001 PPL. 1001.79 Recons. 0.01799 +Start training Epoch 930... +Train. Iter 930 : Commit. 0.00001 PPL. 998.14 Recons. 0.01782 +Check if save...? +----saved---- +Start training Epoch 931... +Train. Iter 931 : Commit. 0.00001 PPL. 995.74 Recons. 0.01784 +Start training Epoch 932... +Train. Iter 932 : Commit. 0.00001 PPL. 993.32 Recons. 0.01789 +Start training Epoch 933... +Train. Iter 933 : Commit. 0.00001 PPL. 995.58 Recons. 0.01780 +Start training Epoch 934... +Train. Iter 934 : Commit. 0.00001 PPL. 995.34 Recons. 0.01782 +Start training Epoch 935... +Train. Iter 935 : Commit. 0.00001 PPL. 996.48 Recons. 0.01784 +Start training Epoch 936... +Train. Iter 936 : Commit. 0.00001 PPL. 995.64 Recons. 0.01786 +Start training Epoch 937... +Train. Iter 937 : Commit. 0.00001 PPL. 990.02 Recons. 0.01787 +Start training Epoch 938... +Train. Iter 938 : Commit. 0.00001 PPL. 994.03 Recons. 0.01789 +Start training Epoch 939... +Train. Iter 939 : Commit. 0.00001 PPL. 993.29 Recons. 0.01788 +Start training Epoch 940... +Train. Iter 940 : Commit. 0.00001 PPL. 990.11 Recons. 0.01791 +Check if save...? +Start training Epoch 941... +Train. Iter 941 : Commit. 0.00001 PPL. 989.65 Recons. 0.01784 +Start training Epoch 942... +Train. Iter 942 : Commit. 0.00001 PPL. 986.61 Recons. 0.01775 +Start training Epoch 943... +Train. Iter 943 : Commit. 0.00001 PPL. 986.03 Recons. 0.01777 +Start training Epoch 944... +Train. Iter 944 : Commit. 0.00001 PPL. 990.06 Recons. 0.01779 +Start training Epoch 945... +Train. Iter 945 : Commit. 0.00001 PPL. 991.33 Recons. 0.01776 +Start training Epoch 946... +Train. Iter 946 : Commit. 0.00001 PPL. 994.69 Recons. 0.01781 +Start training Epoch 947... +Train. Iter 947 : Commit. 0.00001 PPL. 994.79 Recons. 0.01773 +Start training Epoch 948... +Train. Iter 948 : Commit. 0.00001 PPL. 991.66 Recons. 0.01784 +Start training Epoch 949... +Train. Iter 949 : Commit. 0.00001 PPL. 991.95 Recons. 0.01776 +Start training Epoch 950... +Train. Iter 950 : Commit. 0.00001 PPL. 993.36 Recons. 0.01778 +Check if save...? +----saved---- +Start training Epoch 951... +Train. Iter 951 : Commit. 0.00001 PPL. 991.80 Recons. 0.01787 +Start training Epoch 952... +Train. Iter 952 : Commit. 0.00001 PPL. 994.75 Recons. 0.01777 +Start training Epoch 953... +Train. Iter 953 : Commit. 0.00001 PPL. 991.61 Recons. 0.01783 +Start training Epoch 954... +Train. Iter 954 : Commit. 0.00001 PPL. 991.26 Recons. 0.01789 +Start training Epoch 955... +Train. Iter 955 : Commit. 0.00001 PPL. 994.51 Recons. 0.01793 +Start training Epoch 956... +Train. Iter 956 : Commit. 0.00001 PPL. 994.29 Recons. 0.01793 +Start training Epoch 957... +Train. Iter 957 : Commit. 0.00001 PPL. 1000.84 Recons. 0.01782 +Start training Epoch 958... +Train. Iter 958 : Commit. 0.00001 PPL. 997.65 Recons. 0.01779 +Start training Epoch 959... +Train. Iter 959 : Commit. 0.00001 PPL. 995.15 Recons. 0.01781 +Start training Epoch 960... +Train. Iter 960 : Commit. 0.00001 PPL. 1001.13 Recons. 0.01774 +Check if save...? +----saved---- +Start training Epoch 961... +Train. Iter 961 : Commit. 0.00001 PPL. 995.64 Recons. 0.01784 +Start training Epoch 962... +Train. Iter 962 : Commit. 0.00001 PPL. 997.15 Recons. 0.01767 +Start training Epoch 963... +Train. Iter 963 : Commit. 0.00001 PPL. 993.81 Recons. 0.01771 +Start training Epoch 964... +Train. Iter 964 : Commit. 0.00001 PPL. 991.66 Recons. 0.01773 +Start training Epoch 965... +Train. Iter 965 : Commit. 0.00001 PPL. 991.77 Recons. 0.01786 +Start training Epoch 966... +Train. Iter 966 : Commit. 0.00001 PPL. 990.21 Recons. 0.01775 +Start training Epoch 967... +Train. Iter 967 : Commit. 0.00001 PPL. 992.81 Recons. 0.01777 +Start training Epoch 968... +Train. Iter 968 : Commit. 0.00001 PPL. 992.07 Recons. 0.01778 +Start training Epoch 969... +Train. Iter 969 : Commit. 0.00001 PPL. 1001.92 Recons. 0.01775 +Start training Epoch 970... +Train. Iter 970 : Commit. 0.00001 PPL. 997.95 Recons. 0.01775 +Check if save...? +Start training Epoch 971... +Train. Iter 971 : Commit. 0.00001 PPL. 996.81 Recons. 0.01769 +Start training Epoch 972... +Train. Iter 972 : Commit. 0.00001 PPL. 991.14 Recons. 0.01771 +Start training Epoch 973... +Train. Iter 973 : Commit. 0.00001 PPL. 994.07 Recons. 0.01769 +Start training Epoch 974... +Train. Iter 974 : Commit. 0.00001 PPL. 994.87 Recons. 0.01779 +Start training Epoch 975... +Train. Iter 975 : Commit. 0.00001 PPL. 997.00 Recons. 0.01767 +Start training Epoch 976... +Train. Iter 976 : Commit. 0.00001 PPL. 987.75 Recons. 0.01763 +Start training Epoch 977... +Train. Iter 977 : Commit. 0.00001 PPL. 991.65 Recons. 0.01773 +Start training Epoch 978... +Train. Iter 978 : Commit. 0.00001 PPL. 993.52 Recons. 0.01766 +Start training Epoch 979... +Train. Iter 979 : Commit. 0.00001 PPL. 992.34 Recons. 0.01767 +Start training Epoch 980... +Train. Iter 980 : Commit. 0.00001 PPL. 990.66 Recons. 0.01765 +Check if save...? +----saved---- +Start training Epoch 981... +Train. Iter 981 : Commit. 0.00001 PPL. 992.99 Recons. 0.01775 +Start training Epoch 982... +Train. Iter 982 : Commit. 0.00001 PPL. 1002.07 Recons. 0.01787 +Start training Epoch 983... +Train. Iter 983 : Commit. 0.00001 PPL. 1001.31 Recons. 0.01761 +Start training Epoch 984... +Train. Iter 984 : Commit. 0.00001 PPL. 998.73 Recons. 0.01774 +Start training Epoch 985... +Train. Iter 985 : Commit. 0.00001 PPL. 999.54 Recons. 0.01772 +Start training Epoch 986... +Train. Iter 986 : Commit. 0.00001 PPL. 995.00 Recons. 0.01763 +Start training Epoch 987... +Train. Iter 987 : Commit. 0.00001 PPL. 998.41 Recons. 0.01783 +Start training Epoch 988... +Train. Iter 988 : Commit. 0.00001 PPL. 1003.96 Recons. 0.01761 +Start training Epoch 989... +Train. Iter 989 : Commit. 0.00001 PPL. 992.44 Recons. 0.01760 +Start training Epoch 990... +Train. Iter 990 : Commit. 0.00001 PPL. 996.39 Recons. 0.01760 +Check if save...? +----saved---- +Start training Epoch 991... +Train. Iter 991 : Commit. 0.00001 PPL. 996.60 Recons. 0.01760 +Start training Epoch 992... +Train. Iter 992 : Commit. 0.00001 PPL. 994.84 Recons. 0.01765 +Start training Epoch 993... +Train. Iter 993 : Commit. 0.00001 PPL. 988.08 Recons. 0.01790 +Start training Epoch 994... +Train. Iter 994 : Commit. 0.00001 PPL. 989.62 Recons. 0.01763 +Start training Epoch 995... +Train. Iter 995 : Commit. 0.00001 PPL. 990.68 Recons. 0.01762 +Start training Epoch 996... +Train. Iter 996 : Commit. 0.00001 PPL. 986.29 Recons. 0.01785 +Start training Epoch 997... +Train. Iter 997 : Commit. 0.00001 PPL. 990.45 Recons. 0.01767 +Start training Epoch 998... +Train. Iter 998 : Commit. 0.00001 PPL. 992.45 Recons. 0.01765 +Start training Epoch 999... +Train. Iter 999 : Commit. 0.00001 PPL. 987.56 Recons. 0.01760 +Start training Epoch 1000... +Train. Iter 1000 : Commit. 0.00001 PPL. 984.29 Recons. 0.01764 +Check if save...? +Start training Epoch 1001... +Train. Iter 1001 : Commit. 0.00001 PPL. 987.76 Recons. 0.01757 +Start training Epoch 1002... +Train. Iter 1002 : Commit. 0.00001 PPL. 990.91 Recons. 0.01759 +Start training Epoch 1003... +Train. Iter 1003 : Commit. 0.00001 PPL. 991.26 Recons. 0.01755 +Start training Epoch 1004... +Train. Iter 1004 : Commit. 0.00001 PPL. 989.83 Recons. 0.01765 +Start training Epoch 1005... +Train. Iter 1005 : Commit. 0.00001 PPL. 998.65 Recons. 0.01778 +Start training Epoch 1006... +Train. Iter 1006 : Commit. 0.00001 PPL. 992.22 Recons. 0.01771 +Start training Epoch 1007... +Train. Iter 1007 : Commit. 0.00001 PPL. 996.08 Recons. 0.01782 +Start training Epoch 1008... +Train. Iter 1008 : Commit. 0.00001 PPL. 993.36 Recons. 0.01753 +Start training Epoch 1009... +Train. Iter 1009 : Commit. 0.00001 PPL. 989.58 Recons. 0.01757 +Start training Epoch 1010... +Train. Iter 1010 : Commit. 0.00001 PPL. 994.58 Recons. 0.01752 +Check if save...? +----saved---- +Start training Epoch 1011... +Train. Iter 1011 : Commit. 0.00001 PPL. 995.62 Recons. 0.01764 +Start training Epoch 1012... +Train. Iter 1012 : Commit. 0.00001 PPL. 996.87 Recons. 0.01750 +Start training Epoch 1013... +Train. Iter 1013 : Commit. 0.00001 PPL. 994.51 Recons. 0.01755 +Start training Epoch 1014... +Train. Iter 1014 : Commit. 0.00001 PPL. 996.06 Recons. 0.01752 +Start training Epoch 1015... +Train. Iter 1015 : Commit. 0.00001 PPL. 999.32 Recons. 0.01752 +Start training Epoch 1016... +Train. Iter 1016 : Commit. 0.00001 PPL. 995.94 Recons. 0.01750 +Start training Epoch 1017... +Train. Iter 1017 : Commit. 0.00001 PPL. 995.43 Recons. 0.01747 +Start training Epoch 1018... +Train. Iter 1018 : Commit. 0.00001 PPL. 996.40 Recons. 0.01746 +Start training Epoch 1019... +Train. Iter 1019 : Commit. 0.00001 PPL. 994.62 Recons. 0.01748 +Start training Epoch 1020... +Train. Iter 1020 : Commit. 0.00001 PPL. 992.75 Recons. 0.01772 +Check if save...? +Start training Epoch 1021... +Train. Iter 1021 : Commit. 0.00001 PPL. 996.54 Recons. 0.01750 +Start training Epoch 1022... +Train. Iter 1022 : Commit. 0.00001 PPL. 993.86 Recons. 0.01768 +Start training Epoch 1023... +Train. Iter 1023 : Commit. 0.00001 PPL. 991.34 Recons. 0.01745 +Start training Epoch 1024... +Train. Iter 1024 : Commit. 0.00001 PPL. 1000.99 Recons. 0.01750 +Start training Epoch 1025... +Train. Iter 1025 : Commit. 0.00001 PPL. 1001.72 Recons. 0.01745 +Start training Epoch 1026... +Train. Iter 1026 : Commit. 0.00001 PPL. 1000.24 Recons. 0.01753 +Start training Epoch 1027... +Train. Iter 1027 : Commit. 0.00001 PPL. 995.62 Recons. 0.01743 +Start training Epoch 1028... +Train. Iter 1028 : Commit. 0.00001 PPL. 994.40 Recons. 0.01760 +Start training Epoch 1029... +Train. Iter 1029 : Commit. 0.00001 PPL. 997.92 Recons. 0.01743 +Start training Epoch 1030... +Train. Iter 1030 : Commit. 0.00001 PPL. 1003.72 Recons. 0.01757 +Check if save...? +Start training Epoch 1031... +Train. Iter 1031 : Commit. 0.00001 PPL. 998.82 Recons. 0.01768 +Start training Epoch 1032... +Train. Iter 1032 : Commit. 0.00001 PPL. 997.04 Recons. 0.01748 +Start training Epoch 1033... +Train. Iter 1033 : Commit. 0.00001 PPL. 994.89 Recons. 0.01744 +Start training Epoch 1034... +Train. Iter 1034 : Commit. 0.00001 PPL. 998.95 Recons. 0.01750 +Start training Epoch 1035... +Train. Iter 1035 : Commit. 0.00001 PPL. 998.20 Recons. 0.01752 +Start training Epoch 1036... +Train. Iter 1036 : Commit. 0.00001 PPL. 994.29 Recons. 0.01744 +Start training Epoch 1037... +Train. Iter 1037 : Commit. 0.00001 PPL. 997.86 Recons. 0.01744 +Start training Epoch 1038... +Train. Iter 1038 : Commit. 0.00001 PPL. 996.65 Recons. 0.01741 +Start training Epoch 1039... +Train. Iter 1039 : Commit. 0.00001 PPL. 1004.17 Recons. 0.01739 +Start training Epoch 1040... +Train. Iter 1040 : Commit. 0.00001 PPL. 1001.56 Recons. 0.01742 +Check if save...? +----saved---- +Start training Epoch 1041... +Train. Iter 1041 : Commit. 0.00001 PPL. 1000.68 Recons. 0.01739 +Start training Epoch 1042... +Train. Iter 1042 : Commit. 0.00001 PPL. 996.73 Recons. 0.01743 +Start training Epoch 1043... +Train. Iter 1043 : Commit. 0.00001 PPL. 998.12 Recons. 0.01740 +Start training Epoch 1044... +Train. Iter 1044 : Commit. 0.00001 PPL. 998.33 Recons. 0.01737 +Start training Epoch 1045... +Train. Iter 1045 : Commit. 0.00001 PPL. 997.66 Recons. 0.01742 +Start training Epoch 1046... +Train. Iter 1046 : Commit. 0.00001 PPL. 996.60 Recons. 0.01744 +Start training Epoch 1047... +Train. Iter 1047 : Commit. 0.00001 PPL. 995.19 Recons. 0.01736 +Start training Epoch 1048... +Train. Iter 1048 : Commit. 0.00001 PPL. 995.93 Recons. 0.01745 +Start training Epoch 1049... +Train. Iter 1049 : Commit. 0.00001 PPL. 996.53 Recons. 0.01739 +Start training Epoch 1050... +Train. Iter 1050 : Commit. 0.00001 PPL. 992.18 Recons. 0.01737 +Check if save...? +----saved---- +Start training Epoch 1051... +Train. Iter 1051 : Commit. 0.00001 PPL. 990.41 Recons. 0.01739 +Start training Epoch 1052... +Train. Iter 1052 : Commit. 0.00001 PPL. 992.74 Recons. 0.01739 +Start training Epoch 1053... +Train. Iter 1053 : Commit. 0.00001 PPL. 993.51 Recons. 0.01733 +Start training Epoch 1054... +Train. Iter 1054 : Commit. 0.00001 PPL. 987.46 Recons. 0.01737 +Start training Epoch 1055... +Train. Iter 1055 : Commit. 0.00001 PPL. 986.95 Recons. 0.01735 +Start training Epoch 1056... +Train. Iter 1056 : Commit. 0.00001 PPL. 991.19 Recons. 0.01736 +Start training Epoch 1057... +Train. Iter 1057 : Commit. 0.00001 PPL. 995.49 Recons. 0.01748 +Start training Epoch 1058... +Train. Iter 1058 : Commit. 0.00001 PPL. 995.23 Recons. 0.01738 +Start training Epoch 1059... +Train. Iter 1059 : Commit. 0.00001 PPL. 995.15 Recons. 0.01737 +Start training Epoch 1060... +Train. Iter 1060 : Commit. 0.00001 PPL. 995.51 Recons. 0.01732 +Check if save...? +----saved---- +Start training Epoch 1061... +Train. Iter 1061 : Commit. 0.00001 PPL. 993.24 Recons. 0.01734 +Start training Epoch 1062... +Train. Iter 1062 : Commit. 0.00001 PPL. 993.27 Recons. 0.01750 +Start training Epoch 1063... +Train. Iter 1063 : Commit. 0.00001 PPL. 995.47 Recons. 0.01727 +Start training Epoch 1064... +Train. Iter 1064 : Commit. 0.00001 PPL. 992.78 Recons. 0.01732 +Start training Epoch 1065... +Train. Iter 1065 : Commit. 0.00001 PPL. 991.04 Recons. 0.01729 +Start training Epoch 1066... +Train. Iter 1066 : Commit. 0.00001 PPL. 993.99 Recons. 0.01729 +Start training Epoch 1067... +Train. Iter 1067 : Commit. 0.00001 PPL. 990.67 Recons. 0.01757 +Start training Epoch 1068... +Train. Iter 1068 : Commit. 0.00001 PPL. 997.57 Recons. 0.01734 +Start training Epoch 1069... +Train. Iter 1069 : Commit. 0.00001 PPL. 992.50 Recons. 0.01734 +Start training Epoch 1070... +Train. Iter 1070 : Commit. 0.00001 PPL. 991.47 Recons. 0.01735 +Check if save...? +Start training Epoch 1071... +Train. Iter 1071 : Commit. 0.00001 PPL. 990.75 Recons. 0.01733 +Start training Epoch 1072... +Train. Iter 1072 : Commit. 0.00001 PPL. 992.96 Recons. 0.01732 +Start training Epoch 1073... +Train. Iter 1073 : Commit. 0.00001 PPL. 994.31 Recons. 0.01738 +Start training Epoch 1074... +Train. Iter 1074 : Commit. 0.00001 PPL. 992.00 Recons. 0.01735 +Start training Epoch 1075... +Train. Iter 1075 : Commit. 0.00001 PPL. 992.32 Recons. 0.01729 +Start training Epoch 1076... +Train. Iter 1076 : Commit. 0.00001 PPL. 991.28 Recons. 0.01727 +Start training Epoch 1077... +Train. Iter 1077 : Commit. 0.00001 PPL. 986.93 Recons. 0.01734 +Start training Epoch 1078... +Train. Iter 1078 : Commit. 0.00001 PPL. 988.73 Recons. 0.01725 +Start training Epoch 1079... +Train. Iter 1079 : Commit. 0.00001 PPL. 989.44 Recons. 0.01726 +Start training Epoch 1080... +Train. Iter 1080 : Commit. 0.00001 PPL. 991.32 Recons. 0.01723 +Check if save...? +----saved---- +Start training Epoch 1081... +Train. Iter 1081 : Commit. 0.00001 PPL. 991.93 Recons. 0.01727 +Start training Epoch 1082... +Train. Iter 1082 : Commit. 0.00001 PPL. 996.91 Recons. 0.01731 +Start training Epoch 1083... +Train. Iter 1083 : Commit. 0.00001 PPL. 989.07 Recons. 0.01722 +Start training Epoch 1084... +Train. Iter 1084 : Commit. 0.00001 PPL. 988.39 Recons. 0.01723 +Start training Epoch 1085... +Train. Iter 1085 : Commit. 0.00001 PPL. 990.96 Recons. 0.01725 +Start training Epoch 1086... +Train. Iter 1086 : Commit. 0.00001 PPL. 990.30 Recons. 0.01732 +Start training Epoch 1087... +Train. Iter 1087 : Commit. 0.00001 PPL. 990.05 Recons. 0.01730 +Start training Epoch 1088... +Train. Iter 1088 : Commit. 0.00001 PPL. 989.29 Recons. 0.01726 +Start training Epoch 1089... +Train. Iter 1089 : Commit. 0.00001 PPL. 991.59 Recons. 0.01731 +Start training Epoch 1090... +Train. Iter 1090 : Commit. 0.00001 PPL. 992.87 Recons. 0.01722 +Check if save...? +----saved---- +Start training Epoch 1091... +Train. Iter 1091 : Commit. 0.00001 PPL. 990.88 Recons. 0.01726 +Start training Epoch 1092... +Train. Iter 1092 : Commit. 0.00001 PPL. 991.32 Recons. 0.01723 +Start training Epoch 1093... +Train. Iter 1093 : Commit. 0.00001 PPL. 991.59 Recons. 0.01722 +Start training Epoch 1094... +Train. Iter 1094 : Commit. 0.00001 PPL. 990.37 Recons. 0.01720 +Start training Epoch 1095... +Train. Iter 1095 : Commit. 0.00001 PPL. 992.51 Recons. 0.01728 +Start training Epoch 1096... +Train. Iter 1096 : Commit. 0.00001 PPL. 997.72 Recons. 0.01727 +Start training Epoch 1097... +Train. Iter 1097 : Commit. 0.00001 PPL. 1000.34 Recons. 0.01721 +Start training Epoch 1098... +Train. Iter 1098 : Commit. 0.00001 PPL. 996.71 Recons. 0.01720 +Start training Epoch 1099... +Train. Iter 1099 : Commit. 0.00001 PPL. 994.02 Recons. 0.01728 +Start training Epoch 1100... +Train. Iter 1100 : Commit. 0.00001 PPL. 992.21 Recons. 0.01723 +Check if save...? +Start training Epoch 1101... +Train. Iter 1101 : Commit. 0.00001 PPL. 992.55 Recons. 0.01719 +Start training Epoch 1102... +Train. Iter 1102 : Commit. 0.00001 PPL. 989.18 Recons. 0.01724 +Start training Epoch 1103... +Train. Iter 1103 : Commit. 0.00001 PPL. 993.45 Recons. 0.01723 +Start training Epoch 1104... +Train. Iter 1104 : Commit. 0.00001 PPL. 990.31 Recons. 0.01726 +Start training Epoch 1105... +Train. Iter 1105 : Commit. 0.00001 PPL. 995.42 Recons. 0.01732 +Start training Epoch 1106... +Train. Iter 1106 : Commit. 0.00001 PPL. 990.26 Recons. 0.01718 +Start training Epoch 1107... +Train. Iter 1107 : Commit. 0.00001 PPL. 990.20 Recons. 0.01720 +Start training Epoch 1108... +Train. Iter 1108 : Commit. 0.00001 PPL. 996.95 Recons. 0.01724 +Start training Epoch 1109... +Train. Iter 1109 : Commit. 0.00001 PPL. 995.73 Recons. 0.01724 +Start training Epoch 1110... +Train. Iter 1110 : Commit. 0.00001 PPL. 994.82 Recons. 0.01716 +Check if save...? +----saved---- +Start training Epoch 1111... +Train. Iter 1111 : Commit. 0.00001 PPL. 995.47 Recons. 0.01720 +Start training Epoch 1112... +Train. Iter 1112 : Commit. 0.00001 PPL. 999.62 Recons. 0.01714 +Start training Epoch 1113... +Train. Iter 1113 : Commit. 0.00001 PPL. 998.05 Recons. 0.01721 +Start training Epoch 1114... +Train. Iter 1114 : Commit. 0.00001 PPL. 995.11 Recons. 0.01714 +Start training Epoch 1115... +Train. Iter 1115 : Commit. 0.00001 PPL. 994.54 Recons. 0.01712 +Start training Epoch 1116... +Train. Iter 1116 : Commit. 0.00001 PPL. 997.29 Recons. 0.01720 +Start training Epoch 1117... +Train. Iter 1117 : Commit. 0.00001 PPL. 994.68 Recons. 0.01720 +Start training Epoch 1118... +Train. Iter 1118 : Commit. 0.00001 PPL. 996.47 Recons. 0.01710 +Start training Epoch 1119... +Train. Iter 1119 : Commit. 0.00001 PPL. 992.97 Recons. 0.01712 +Start training Epoch 1120... +Train. Iter 1120 : Commit. 0.00001 PPL. 991.11 Recons. 0.01720 +Check if save...? +Start training Epoch 1121... +Train. Iter 1121 : Commit. 0.00001 PPL. 991.61 Recons. 0.01717 +Start training Epoch 1122... +Train. Iter 1122 : Commit. 0.00001 PPL. 991.36 Recons. 0.01712 +Start training Epoch 1123... +Train. Iter 1123 : Commit. 0.00001 PPL. 991.14 Recons. 0.01717 +Start training Epoch 1124... +Train. Iter 1124 : Commit. 0.00001 PPL. 988.98 Recons. 0.01716 +Start training Epoch 1125... +Train. Iter 1125 : Commit. 0.00001 PPL. 990.97 Recons. 0.01716 +Start training Epoch 1126... +Train. Iter 1126 : Commit. 0.00001 PPL. 987.43 Recons. 0.01713 +Start training Epoch 1127... +Train. Iter 1127 : Commit. 0.00001 PPL. 985.12 Recons. 0.01713 +Start training Epoch 1128... +Train. Iter 1128 : Commit. 0.00001 PPL. 985.01 Recons. 0.01713 +Start training Epoch 1129... +Train. Iter 1129 : Commit. 0.00001 PPL. 981.92 Recons. 0.01714 +Start training Epoch 1130... +Train. Iter 1130 : Commit. 0.00001 PPL. 986.16 Recons. 0.01720 +Check if save...? +Start training Epoch 1131... +Train. Iter 1131 : Commit. 0.00001 PPL. 986.01 Recons. 0.01708 +Start training Epoch 1132... +Train. Iter 1132 : Commit. 0.00001 PPL. 983.30 Recons. 0.01711 +Start training Epoch 1133... +Train. Iter 1133 : Commit. 0.00001 PPL. 982.69 Recons. 0.01716 +Start training Epoch 1134... +Train. Iter 1134 : Commit. 0.00001 PPL. 981.17 Recons. 0.01710 +Start training Epoch 1135... +Train. Iter 1135 : Commit. 0.00001 PPL. 980.81 Recons. 0.01706 +Start training Epoch 1136... +Train. Iter 1136 : Commit. 0.00001 PPL. 981.17 Recons. 0.01712 +Start training Epoch 1137... +Train. Iter 1137 : Commit. 0.00001 PPL. 984.88 Recons. 0.01715 +Start training Epoch 1138... +Train. Iter 1138 : Commit. 0.00001 PPL. 984.90 Recons. 0.01706 +Start training Epoch 1139... +Train. Iter 1139 : Commit. 0.00001 PPL. 982.01 Recons. 0.01711 +Start training Epoch 1140... +Train. Iter 1140 : Commit. 0.00001 PPL. 982.03 Recons. 0.01706 +Check if save...? +----saved---- +Start training Epoch 1141... +Train. Iter 1141 : Commit. 0.00001 PPL. 984.63 Recons. 0.01718 +Start training Epoch 1142... +Train. Iter 1142 : Commit. 0.00001 PPL. 983.96 Recons. 0.01709 +Start training Epoch 1143... +Train. Iter 1143 : Commit. 0.00001 PPL. 987.96 Recons. 0.01727 +Start training Epoch 1144... +Train. Iter 1144 : Commit. 0.00001 PPL. 990.78 Recons. 0.01708 +Start training Epoch 1145... +Train. Iter 1145 : Commit. 0.00001 PPL. 987.11 Recons. 0.01710 +Start training Epoch 1146... +Train. Iter 1146 : Commit. 0.00001 PPL. 993.04 Recons. 0.01709 +Start training Epoch 1147... +Train. Iter 1147 : Commit. 0.00001 PPL. 993.32 Recons. 0.01709 +Start training Epoch 1148... +Train. Iter 1148 : Commit. 0.00001 PPL. 997.03 Recons. 0.01707 +Start training Epoch 1149... +Train. Iter 1149 : Commit. 0.00001 PPL. 1000.74 Recons. 0.01702 +Start training Epoch 1150... +Train. Iter 1150 : Commit. 0.00001 PPL. 997.74 Recons. 0.01706 +Check if save...? +Start training Epoch 1151... +Train. Iter 1151 : Commit. 0.00001 PPL. 995.35 Recons. 0.01699 +Start training Epoch 1152... +Train. Iter 1152 : Commit. 0.00001 PPL. 994.73 Recons. 0.01704 +Start training Epoch 1153... +Train. Iter 1153 : Commit. 0.00001 PPL. 998.27 Recons. 0.01701 +Start training Epoch 1154... +Train. Iter 1154 : Commit. 0.00001 PPL. 990.99 Recons. 0.01711 +Start training Epoch 1155... +Train. Iter 1155 : Commit. 0.00001 PPL. 989.09 Recons. 0.01703 +Start training Epoch 1156... +Train. Iter 1156 : Commit. 0.00001 PPL. 997.55 Recons. 0.01758 +Start training Epoch 1157... +Train. Iter 1157 : Commit. 0.00001 PPL. 997.59 Recons. 0.01703 +Start training Epoch 1158... +Train. Iter 1158 : Commit. 0.00001 PPL. 992.14 Recons. 0.01709 +Start training Epoch 1159... +Train. Iter 1159 : Commit. 0.00001 PPL. 992.80 Recons. 0.01709 +Start training Epoch 1160... +Train. Iter 1160 : Commit. 0.00001 PPL. 992.49 Recons. 0.01708 +Check if save...? +Start training Epoch 1161... +Train. Iter 1161 : Commit. 0.00001 PPL. 994.53 Recons. 0.01710 +Start training Epoch 1162... +Train. Iter 1162 : Commit. 0.00001 PPL. 990.06 Recons. 0.01701 +Start training Epoch 1163... +Train. Iter 1163 : Commit. 0.00001 PPL. 989.60 Recons. 0.01699 +Start training Epoch 1164... +Train. Iter 1164 : Commit. 0.00001 PPL. 987.46 Recons. 0.01699 +Start training Epoch 1165... +Train. Iter 1165 : Commit. 0.00001 PPL. 984.88 Recons. 0.01701 +Start training Epoch 1166... +Train. Iter 1166 : Commit. 0.00001 PPL. 985.45 Recons. 0.01699 +Start training Epoch 1167... +Train. Iter 1167 : Commit. 0.00001 PPL. 981.91 Recons. 0.01732 +Start training Epoch 1168... +Train. Iter 1168 : Commit. 0.00001 PPL. 985.64 Recons. 0.01700 +Start training Epoch 1169... +Train. Iter 1169 : Commit. 0.00001 PPL. 985.39 Recons. 0.01703 +Start training Epoch 1170... +Train. Iter 1170 : Commit. 0.00001 PPL. 987.97 Recons. 0.01698 +Check if save...? +----saved---- +Start training Epoch 1171... +Train. Iter 1171 : Commit. 0.00001 PPL. 986.02 Recons. 0.01698 +Start training Epoch 1172... +Train. Iter 1172 : Commit. 0.00001 PPL. 985.07 Recons. 0.01703 +Start training Epoch 1173... +Train. Iter 1173 : Commit. 0.00001 PPL. 985.70 Recons. 0.01693 +Start training Epoch 1174... +Train. Iter 1174 : Commit. 0.00001 PPL. 986.85 Recons. 0.01696 +Start training Epoch 1175... +Train. Iter 1175 : Commit. 0.00001 PPL. 985.09 Recons. 0.01694 +Start training Epoch 1176... +Train. Iter 1176 : Commit. 0.00001 PPL. 983.93 Recons. 0.01699 +Start training Epoch 1177... +Train. Iter 1177 : Commit. 0.00001 PPL. 989.91 Recons. 0.01693 +Start training Epoch 1178... +Train. Iter 1178 : Commit. 0.00001 PPL. 988.80 Recons. 0.01697 +Start training Epoch 1179... +Train. Iter 1179 : Commit. 0.00001 PPL. 988.38 Recons. 0.01698 +Start training Epoch 1180... +Train. Iter 1180 : Commit. 0.00001 PPL. 985.44 Recons. 0.01691 +Check if save...? +----saved---- +Start training Epoch 1181... +Train. Iter 1181 : Commit. 0.00001 PPL. 986.36 Recons. 0.01721 +Start training Epoch 1182... +Train. Iter 1182 : Commit. 0.00001 PPL. 988.74 Recons. 0.01700 +Start training Epoch 1183... +Train. Iter 1183 : Commit. 0.00001 PPL. 988.26 Recons. 0.01693 +Start training Epoch 1184... +Train. Iter 1184 : Commit. 0.00001 PPL. 982.93 Recons. 0.01697 +Start training Epoch 1185... +Train. Iter 1185 : Commit. 0.00001 PPL. 987.09 Recons. 0.01703 +Start training Epoch 1186... +Train. Iter 1186 : Commit. 0.00001 PPL. 987.34 Recons. 0.01721 +Start training Epoch 1187... +Train. Iter 1187 : Commit. 0.00001 PPL. 987.14 Recons. 0.01701 +Start training Epoch 1188... +Train. Iter 1188 : Commit. 0.00001 PPL. 984.80 Recons. 0.01697 +Start training Epoch 1189... +Train. Iter 1189 : Commit. 0.00001 PPL. 984.50 Recons. 0.01697 +Start training Epoch 1190... +Train. Iter 1190 : Commit. 0.00001 PPL. 983.96 Recons. 0.01699 +Check if save...? +Start training Epoch 1191... +Train. Iter 1191 : Commit. 0.00001 PPL. 984.75 Recons. 0.01702 +Start training Epoch 1192... +Train. Iter 1192 : Commit. 0.00001 PPL. 992.97 Recons. 0.01712 +Start training Epoch 1193... +Train. Iter 1193 : Commit. 0.00001 PPL. 987.13 Recons. 0.01689 +Start training Epoch 1194... +Train. Iter 1194 : Commit. 0.00001 PPL. 983.92 Recons. 0.01690 +Start training Epoch 1195... +Train. Iter 1195 : Commit. 0.00001 PPL. 981.76 Recons. 0.01696 +Start training Epoch 1196... +Train. Iter 1196 : Commit. 0.00001 PPL. 981.54 Recons. 0.01692 +Start training Epoch 1197... +Train. Iter 1197 : Commit. 0.00001 PPL. 983.70 Recons. 0.01691 +Start training Epoch 1198... +Train. Iter 1198 : Commit. 0.00001 PPL. 983.20 Recons. 0.01686 +Start training Epoch 1199... +Train. Iter 1199 : Commit. 0.00001 PPL. 981.45 Recons. 0.01693 +Start training Epoch 1200... +Train. Iter 1200 : Commit. 0.00001 PPL. 980.98 Recons. 0.01688 +Check if save...? +----saved---- +Start training Epoch 1201... +Train. Iter 1201 : Commit. 0.00001 PPL. 983.74 Recons. 0.01691 +Start training Epoch 1202... +Train. Iter 1202 : Commit. 0.00001 PPL. 981.90 Recons. 0.01686 +Start training Epoch 1203... +Train. Iter 1203 : Commit. 0.00001 PPL. 984.66 Recons. 0.01686 +Start training Epoch 1204... +Train. Iter 1204 : Commit. 0.00001 PPL. 981.19 Recons. 0.01684 +Start training Epoch 1205... +Train. Iter 1205 : Commit. 0.00001 PPL. 983.53 Recons. 0.01692 +Start training Epoch 1206... +Train. Iter 1206 : Commit. 0.00001 PPL. 981.93 Recons. 0.01716 +Start training Epoch 1207... +Train. Iter 1207 : Commit. 0.00001 PPL. 991.75 Recons. 0.01726 +Start training Epoch 1208... +Train. Iter 1208 : Commit. 0.00001 PPL. 986.77 Recons. 0.01691 +Start training Epoch 1209... +Train. Iter 1209 : Commit. 0.00001 PPL. 987.15 Recons. 0.01688 +Start training Epoch 1210... +Train. Iter 1210 : Commit. 0.00001 PPL. 990.39 Recons. 0.01690 +Check if save...? +Start training Epoch 1211... +Train. Iter 1211 : Commit. 0.00001 PPL. 991.22 Recons. 0.01690 +Start training Epoch 1212... +Train. Iter 1212 : Commit. 0.00001 PPL. 990.00 Recons. 0.01687 +Start training Epoch 1213... +Train. Iter 1213 : Commit. 0.00001 PPL. 989.01 Recons. 0.01687 +Start training Epoch 1214... +Train. Iter 1214 : Commit. 0.00001 PPL. 990.65 Recons. 0.01696 +Start training Epoch 1215... +Train. Iter 1215 : Commit. 0.00001 PPL. 988.05 Recons. 0.01683 +Start training Epoch 1216... +Train. Iter 1216 : Commit. 0.00001 PPL. 989.48 Recons. 0.01681 +Start training Epoch 1217... +Train. Iter 1217 : Commit. 0.00001 PPL. 991.58 Recons. 0.01682 +Start training Epoch 1218... +Train. Iter 1218 : Commit. 0.00001 PPL. 987.14 Recons. 0.01683 +Start training Epoch 1219... +Train. Iter 1219 : Commit. 0.00001 PPL. 980.50 Recons. 0.01690 +Start training Epoch 1220... +Train. Iter 1220 : Commit. 0.00001 PPL. 980.64 Recons. 0.01680 +Check if save...? +----saved---- +Start training Epoch 1221... +Train. Iter 1221 : Commit. 0.00001 PPL. 981.60 Recons. 0.01681 +Start training Epoch 1222... +Train. Iter 1222 : Commit. 0.00001 PPL. 986.75 Recons. 0.01685 +Start training Epoch 1223... +Train. Iter 1223 : Commit. 0.00001 PPL. 995.61 Recons. 0.01680 +Start training Epoch 1224... +Train. Iter 1224 : Commit. 0.00001 PPL. 985.49 Recons. 0.01683 +Start training Epoch 1225... +Train. Iter 1225 : Commit. 0.00001 PPL. 987.07 Recons. 0.01684 +Start training Epoch 1226... +Train. Iter 1226 : Commit. 0.00001 PPL. 987.33 Recons. 0.01677 +Start training Epoch 1227... +Train. Iter 1227 : Commit. 0.00001 PPL. 988.50 Recons. 0.01680 +Start training Epoch 1228... +Train. Iter 1228 : Commit. 0.00001 PPL. 986.49 Recons. 0.01681 +Start training Epoch 1229... +Train. Iter 1229 : Commit. 0.00001 PPL. 989.63 Recons. 0.01685 +Start training Epoch 1230... +Train. Iter 1230 : Commit. 0.00001 PPL. 990.37 Recons. 0.01677 +Check if save...? +----saved---- +Start training Epoch 1231... +Train. Iter 1231 : Commit. 0.00001 PPL. 989.69 Recons. 0.01680 +Start training Epoch 1232... +Train. Iter 1232 : Commit. 0.00001 PPL. 989.21 Recons. 0.01691 +Start training Epoch 1233... +Train. Iter 1233 : Commit. 0.00001 PPL. 983.99 Recons. 0.01685 +Start training Epoch 1234... +Train. Iter 1234 : Commit. 0.00001 PPL. 984.84 Recons. 0.01688 +Start training Epoch 1235... +Train. Iter 1235 : Commit. 0.00001 PPL. 983.84 Recons. 0.01682 +Start training Epoch 1236... +Train. Iter 1236 : Commit. 0.00001 PPL. 990.31 Recons. 0.01688 +Start training Epoch 1237... +Train. Iter 1237 : Commit. 0.00001 PPL. 985.10 Recons. 0.01685 +Start training Epoch 1238... +Train. Iter 1238 : Commit. 0.00001 PPL. 990.03 Recons. 0.01677 +Start training Epoch 1239... +Train. Iter 1239 : Commit. 0.00001 PPL. 987.60 Recons. 0.01678 +Start training Epoch 1240... +Train. Iter 1240 : Commit. 0.00001 PPL. 986.88 Recons. 0.01677 +Check if save...? +Start training Epoch 1241... +Train. Iter 1241 : Commit. 0.00001 PPL. 987.99 Recons. 0.01682 +Start training Epoch 1242... +Train. Iter 1242 : Commit. 0.00001 PPL. 985.20 Recons. 0.01676 +Start training Epoch 1243... +Train. Iter 1243 : Commit. 0.00001 PPL. 986.53 Recons. 0.01679 +Start training Epoch 1244... +Train. Iter 1244 : Commit. 0.00001 PPL. 986.63 Recons. 0.01679 +Start training Epoch 1245... +Train. Iter 1245 : Commit. 0.00001 PPL. 986.06 Recons. 0.01678 +Start training Epoch 1246... +Train. Iter 1246 : Commit. 0.00001 PPL. 980.66 Recons. 0.01678 +Start training Epoch 1247... +Train. Iter 1247 : Commit. 0.00001 PPL. 981.46 Recons. 0.01677 +Start training Epoch 1248... +Train. Iter 1248 : Commit. 0.00001 PPL. 981.74 Recons. 0.01682 +Start training Epoch 1249... +Train. Iter 1249 : Commit. 0.00001 PPL. 987.21 Recons. 0.01679 +Start training Epoch 1250... +Train. Iter 1250 : Commit. 0.00001 PPL. 984.06 Recons. 0.01683 +Check if save...? +Start training Epoch 1251... +Train. Iter 1251 : Commit. 0.00001 PPL. 980.98 Recons. 0.01678 +Start training Epoch 1252... +Train. Iter 1252 : Commit. 0.00001 PPL. 979.40 Recons. 0.01686 +Start training Epoch 1253... +Train. Iter 1253 : Commit. 0.00001 PPL. 979.79 Recons. 0.01714 +Start training Epoch 1254... +Train. Iter 1254 : Commit. 0.00001 PPL. 977.05 Recons. 0.01675 +Start training Epoch 1255... +Train. Iter 1255 : Commit. 0.00001 PPL. 981.26 Recons. 0.01677 +Start training Epoch 1256... +Train. Iter 1256 : Commit. 0.00001 PPL. 977.47 Recons. 0.01681 +Start training Epoch 1257... +Train. Iter 1257 : Commit. 0.00001 PPL. 979.75 Recons. 0.01681 +Start training Epoch 1258... +Train. Iter 1258 : Commit. 0.00001 PPL. 978.01 Recons. 0.01681 +Start training Epoch 1259... +Train. Iter 1259 : Commit. 0.00001 PPL. 981.71 Recons. 0.01677 +Start training Epoch 1260... +Train. Iter 1260 : Commit. 0.00001 PPL. 977.91 Recons. 0.01674 +Check if save...? +----saved---- +Start training Epoch 1261... +Train. Iter 1261 : Commit. 0.00001 PPL. 977.55 Recons. 0.01678 +Start training Epoch 1262... +Train. Iter 1262 : Commit. 0.00001 PPL. 982.15 Recons. 0.01682 +Start training Epoch 1263... +Train. Iter 1263 : Commit. 0.00001 PPL. 980.65 Recons. 0.01706 +Start training Epoch 1264... +Train. Iter 1264 : Commit. 0.00001 PPL. 977.37 Recons. 0.01675 +Start training Epoch 1265... +Train. Iter 1265 : Commit. 0.00001 PPL. 979.02 Recons. 0.01675 +Start training Epoch 1266... +Train. Iter 1266 : Commit. 0.00001 PPL. 981.76 Recons. 0.01689 +Start training Epoch 1267... +Train. Iter 1267 : Commit. 0.00001 PPL. 980.67 Recons. 0.01673 +Start training Epoch 1268... +Train. Iter 1268 : Commit. 0.00001 PPL. 980.54 Recons. 0.01675 +Start training Epoch 1269... +Train. Iter 1269 : Commit. 0.00001 PPL. 988.22 Recons. 0.01677 +Start training Epoch 1270... +Train. Iter 1270 : Commit. 0.00001 PPL. 984.82 Recons. 0.01675 +Check if save...? +Start training Epoch 1271... +Train. Iter 1271 : Commit. 0.00001 PPL. 985.03 Recons. 0.01667 +Start training Epoch 1272... +Train. Iter 1272 : Commit. 0.00001 PPL. 982.79 Recons. 0.01677 +Start training Epoch 1273... +Train. Iter 1273 : Commit. 0.00001 PPL. 998.60 Recons. 0.01672 +Start training Epoch 1274... +Train. Iter 1274 : Commit. 0.00001 PPL. 989.62 Recons. 0.01669 +Start training Epoch 1275... +Train. Iter 1275 : Commit. 0.00001 PPL. 986.14 Recons. 0.01670 +Start training Epoch 1276... +Train. Iter 1276 : Commit. 0.00001 PPL. 984.38 Recons. 0.01662 +Start training Epoch 1277... +Train. Iter 1277 : Commit. 0.00001 PPL. 980.42 Recons. 0.01694 +Start training Epoch 1278... +Train. Iter 1278 : Commit. 0.00001 PPL. 984.28 Recons. 0.01670 +Start training Epoch 1279... +Train. Iter 1279 : Commit. 0.00001 PPL. 982.88 Recons. 0.01675 +Start training Epoch 1280... +Train. Iter 1280 : Commit. 0.00001 PPL. 983.06 Recons. 0.01668 +Check if save...? +----saved---- +Start training Epoch 1281... +Train. Iter 1281 : Commit. 0.00001 PPL. 980.42 Recons. 0.01671 +Start training Epoch 1282... +Train. Iter 1282 : Commit. 0.00001 PPL. 980.79 Recons. 0.01666 +Start training Epoch 1283... +Train. Iter 1283 : Commit. 0.00001 PPL. 985.56 Recons. 0.01669 +Start training Epoch 1284... +Train. Iter 1284 : Commit. 0.00001 PPL. 982.13 Recons. 0.01664 +Start training Epoch 1285... +Train. Iter 1285 : Commit. 0.00001 PPL. 987.18 Recons. 0.01673 +Start training Epoch 1286... +Train. Iter 1286 : Commit. 0.00001 PPL. 985.46 Recons. 0.01666 +Start training Epoch 1287... +Train. Iter 1287 : Commit. 0.00001 PPL. 991.06 Recons. 0.01667 +Start training Epoch 1288... +Train. Iter 1288 : Commit. 0.00001 PPL. 984.20 Recons. 0.01666 +Start training Epoch 1289... +Train. Iter 1289 : Commit. 0.00001 PPL. 988.76 Recons. 0.01667 +Start training Epoch 1290... +Train. Iter 1290 : Commit. 0.00001 PPL. 982.62 Recons. 0.01662 +Check if save...? +----saved---- +Start training Epoch 1291... +Train. Iter 1291 : Commit. 0.00001 PPL. 984.12 Recons. 0.01666 +Start training Epoch 1292... +Train. Iter 1292 : Commit. 0.00001 PPL. 982.97 Recons. 0.01663 +Start training Epoch 1293... +Train. Iter 1293 : Commit. 0.00001 PPL. 984.33 Recons. 0.01672 +Start training Epoch 1294... +Train. Iter 1294 : Commit. 0.00001 PPL. 980.11 Recons. 0.01662 +Start training Epoch 1295... +Train. Iter 1295 : Commit. 0.00001 PPL. 981.18 Recons. 0.01670 +Start training Epoch 1296... +Train. Iter 1296 : Commit. 0.00001 PPL. 984.60 Recons. 0.01695 +Start training Epoch 1297... +Train. Iter 1297 : Commit. 0.00001 PPL. 983.72 Recons. 0.01687 +Start training Epoch 1298... +Train. Iter 1298 : Commit. 0.00001 PPL. 989.55 Recons. 0.01690 +Start training Epoch 1299... +Train. Iter 1299 : Commit. 0.00001 PPL. 986.95 Recons. 0.01667 +Start training Epoch 1300... +Train. Iter 1300 : Commit. 0.00001 PPL. 985.72 Recons. 0.01683 +Check if save...? +Start training Epoch 1301... +Train. Iter 1301 : Commit. 0.00001 PPL. 985.64 Recons. 0.01677 +Start training Epoch 1302... +Train. Iter 1302 : Commit. 0.00001 PPL. 986.11 Recons. 0.01674 +Start training Epoch 1303... +Train. Iter 1303 : Commit. 0.00001 PPL. 985.52 Recons. 0.01674 +Start training Epoch 1304... +Train. Iter 1304 : Commit. 0.00001 PPL. 981.43 Recons. 0.01672 +Start training Epoch 1305... +Train. Iter 1305 : Commit. 0.00001 PPL. 987.52 Recons. 0.01668 +Start training Epoch 1306... +Train. Iter 1306 : Commit. 0.00001 PPL. 984.08 Recons. 0.01665 +Start training Epoch 1307... +Train. Iter 1307 : Commit. 0.00001 PPL. 983.48 Recons. 0.01662 +Start training Epoch 1308... +Train. Iter 1308 : Commit. 0.00001 PPL. 980.37 Recons. 0.01660 +Start training Epoch 1309... +Train. Iter 1309 : Commit. 0.00001 PPL. 977.36 Recons. 0.01674 +Start training Epoch 1310... +Train. Iter 1310 : Commit. 0.00001 PPL. 977.36 Recons. 0.01665 +Check if save...? +Start training Epoch 1311... +Train. Iter 1311 : Commit. 0.00001 PPL. 978.67 Recons. 0.01683 +Start training Epoch 1312... +Train. Iter 1312 : Commit. 0.00001 PPL. 981.04 Recons. 0.01660 +Start training Epoch 1313... +Train. Iter 1313 : Commit. 0.00001 PPL. 982.97 Recons. 0.01677 +Start training Epoch 1314... +Train. Iter 1314 : Commit. 0.00001 PPL. 984.92 Recons. 0.01668 +Start training Epoch 1315... +Train. Iter 1315 : Commit. 0.00001 PPL. 982.06 Recons. 0.01657 +Start training Epoch 1316... +Train. Iter 1316 : Commit. 0.00001 PPL. 983.22 Recons. 0.01663 +Start training Epoch 1317... +Train. Iter 1317 : Commit. 0.00001 PPL. 978.92 Recons. 0.01664 +Start training Epoch 1318... +Train. Iter 1318 : Commit. 0.00001 PPL. 976.18 Recons. 0.01663 +Start training Epoch 1319... +Train. Iter 1319 : Commit. 0.00001 PPL. 979.78 Recons. 0.01661 +Start training Epoch 1320... +Train. Iter 1320 : Commit. 0.00001 PPL. 979.00 Recons. 0.01662 +Check if save...? +Start training Epoch 1321... +Train. Iter 1321 : Commit. 0.00001 PPL. 975.47 Recons. 0.01667 +Start training Epoch 1322... +Train. Iter 1322 : Commit. 0.00001 PPL. 979.76 Recons. 0.01658 +Start training Epoch 1323... +Train. Iter 1323 : Commit. 0.00001 PPL. 981.67 Recons. 0.01655 +Start training Epoch 1324... +Train. Iter 1324 : Commit. 0.00001 PPL. 983.58 Recons. 0.01662 +Start training Epoch 1325... +Train. Iter 1325 : Commit. 0.00001 PPL. 987.76 Recons. 0.01656 +Start training Epoch 1326... +Train. Iter 1326 : Commit. 0.00001 PPL. 979.99 Recons. 0.01660 +Start training Epoch 1327... +Train. Iter 1327 : Commit. 0.00001 PPL. 980.92 Recons. 0.01663 +Start training Epoch 1328... +Train. Iter 1328 : Commit. 0.00001 PPL. 982.67 Recons. 0.01660 +Start training Epoch 1329... +Train. Iter 1329 : Commit. 0.00001 PPL. 982.09 Recons. 0.01658 +Start training Epoch 1330... +Train. Iter 1330 : Commit. 0.00001 PPL. 980.68 Recons. 0.01656 +Check if save...? +----saved---- +Start training Epoch 1331... +Train. Iter 1331 : Commit. 0.00001 PPL. 978.88 Recons. 0.01654 +Start training Epoch 1332... +Train. Iter 1332 : Commit. 0.00001 PPL. 978.25 Recons. 0.01659 +Start training Epoch 1333... +Train. Iter 1333 : Commit. 0.00001 PPL. 979.51 Recons. 0.01692 +Start training Epoch 1334... +Train. Iter 1334 : Commit. 0.00001 PPL. 978.49 Recons. 0.01661 +Start training Epoch 1335... +Train. Iter 1335 : Commit. 0.00001 PPL. 974.57 Recons. 0.01668 +Start training Epoch 1336... +Train. Iter 1336 : Commit. 0.00001 PPL. 976.47 Recons. 0.01667 +Start training Epoch 1337... +Train. Iter 1337 : Commit. 0.00001 PPL. 976.82 Recons. 0.01661 +Start training Epoch 1338... +Train. Iter 1338 : Commit. 0.00001 PPL. 978.94 Recons. 0.01662 +Start training Epoch 1339... +Train. Iter 1339 : Commit. 0.00001 PPL. 983.27 Recons. 0.01654 +Start training Epoch 1340... +Train. Iter 1340 : Commit. 0.00001 PPL. 983.77 Recons. 0.01663 +Check if save...? +Start training Epoch 1341... +Train. Iter 1341 : Commit. 0.00001 PPL. 994.42 Recons. 0.01654 +Start training Epoch 1342... +Train. Iter 1342 : Commit. 0.00001 PPL. 988.83 Recons. 0.01653 +Start training Epoch 1343... +Train. Iter 1343 : Commit. 0.00001 PPL. 986.06 Recons. 0.01676 +Start training Epoch 1344... +Train. Iter 1344 : Commit. 0.00001 PPL. 991.98 Recons. 0.01650 +Start training Epoch 1345... +Train. Iter 1345 : Commit. 0.00001 PPL. 988.55 Recons. 0.01656 +Start training Epoch 1346... +Train. Iter 1346 : Commit. 0.00001 PPL. 986.71 Recons. 0.01656 +Start training Epoch 1347... +Train. Iter 1347 : Commit. 0.00001 PPL. 986.54 Recons. 0.01650 +Start training Epoch 1348... +Train. Iter 1348 : Commit. 0.00001 PPL. 987.28 Recons. 0.01652 +Start training Epoch 1349... +Train. Iter 1349 : Commit. 0.00001 PPL. 988.33 Recons. 0.01666 +Start training Epoch 1350... +Train. Iter 1350 : Commit. 0.00001 PPL. 994.57 Recons. 0.01650 +Check if save...? +----saved---- +Start training Epoch 1351... +Train. Iter 1351 : Commit. 0.00001 PPL. 989.42 Recons. 0.01653 +Start training Epoch 1352... +Train. Iter 1352 : Commit. 0.00001 PPL. 989.21 Recons. 0.01655 +Start training Epoch 1353... +Train. Iter 1353 : Commit. 0.00001 PPL. 988.18 Recons. 0.01656 +Start training Epoch 1354... +Train. Iter 1354 : Commit. 0.00001 PPL. 987.56 Recons. 0.01657 +Start training Epoch 1355... +Train. Iter 1355 : Commit. 0.00001 PPL. 987.37 Recons. 0.01661 +Start training Epoch 1356... +Train. Iter 1356 : Commit. 0.00001 PPL. 982.81 Recons. 0.01661 +Start training Epoch 1357... +Train. Iter 1357 : Commit. 0.00001 PPL. 982.42 Recons. 0.01655 +Start training Epoch 1358... +Train. Iter 1358 : Commit. 0.00001 PPL. 981.23 Recons. 0.01656 +Start training Epoch 1359... +Train. Iter 1359 : Commit. 0.00001 PPL. 981.54 Recons. 0.01660 +Start training Epoch 1360... +Train. Iter 1360 : Commit. 0.00001 PPL. 980.13 Recons. 0.01658 +Check if save...? +Start training Epoch 1361... +Train. Iter 1361 : Commit. 0.00001 PPL. 979.55 Recons. 0.01658 +Start training Epoch 1362... +Train. Iter 1362 : Commit. 0.00001 PPL. 977.95 Recons. 0.01650 +Start training Epoch 1363... +Train. Iter 1363 : Commit. 0.00001 PPL. 978.83 Recons. 0.01650 +Start training Epoch 1364... +Train. Iter 1364 : Commit. 0.00001 PPL. 976.02 Recons. 0.01651 +Start training Epoch 1365... +Train. Iter 1365 : Commit. 0.00001 PPL. 976.10 Recons. 0.01653 +Start training Epoch 1366... +Train. Iter 1366 : Commit. 0.00001 PPL. 975.51 Recons. 0.01652 +Start training Epoch 1367... +Train. Iter 1367 : Commit. 0.00001 PPL. 977.83 Recons. 0.01648 +Start training Epoch 1368... +Train. Iter 1368 : Commit. 0.00001 PPL. 978.26 Recons. 0.01643 +Start training Epoch 1369... +Train. Iter 1369 : Commit. 0.00001 PPL. 980.74 Recons. 0.01651 +Start training Epoch 1370... +Train. Iter 1370 : Commit. 0.00001 PPL. 980.10 Recons. 0.01658 +Check if save...? +Start training Epoch 1371... +Train. Iter 1371 : Commit. 0.00001 PPL. 987.12 Recons. 0.01657 +Start training Epoch 1372... +Train. Iter 1372 : Commit. 0.00001 PPL. 983.00 Recons. 0.01648 +Start training Epoch 1373... +Train. Iter 1373 : Commit. 0.00001 PPL. 980.76 Recons. 0.01651 +Start training Epoch 1374... +Train. Iter 1374 : Commit. 0.00001 PPL. 982.12 Recons. 0.01650 +Start training Epoch 1375... +Train. Iter 1375 : Commit. 0.00001 PPL. 980.45 Recons. 0.01642 +Start training Epoch 1376... +Train. Iter 1376 : Commit. 0.00001 PPL. 981.10 Recons. 0.01652 +Start training Epoch 1377... +Train. Iter 1377 : Commit. 0.00001 PPL. 980.15 Recons. 0.01644 +Start training Epoch 1378... +Train. Iter 1378 : Commit. 0.00001 PPL. 983.29 Recons. 0.01660 +Start training Epoch 1379... +Train. Iter 1379 : Commit. 0.00001 PPL. 984.15 Recons. 0.01646 +Start training Epoch 1380... +Train. Iter 1380 : Commit. 0.00001 PPL. 980.70 Recons. 0.01647 +Check if save...? +----saved---- +Start training Epoch 1381... +Train. Iter 1381 : Commit. 0.00001 PPL. 979.94 Recons. 0.01660 +Start training Epoch 1382... +Train. Iter 1382 : Commit. 0.00001 PPL. 980.17 Recons. 0.01652 +Start training Epoch 1383... +Train. Iter 1383 : Commit. 0.00001 PPL. 975.03 Recons. 0.01652 +Start training Epoch 1384... +Train. Iter 1384 : Commit. 0.00001 PPL. 981.42 Recons. 0.01652 +Start training Epoch 1385... +Train. Iter 1385 : Commit. 0.00001 PPL. 980.78 Recons. 0.01649 +Start training Epoch 1386... +Train. Iter 1386 : Commit. 0.00001 PPL. 982.87 Recons. 0.01651 +Start training Epoch 1387... +Train. Iter 1387 : Commit. 0.00001 PPL. 979.49 Recons. 0.01646 +Start training Epoch 1388... +Train. Iter 1388 : Commit. 0.00001 PPL. 980.23 Recons. 0.01643 +Start training Epoch 1389... +Train. Iter 1389 : Commit. 0.00001 PPL. 974.76 Recons. 0.01642 +Start training Epoch 1390... +Train. Iter 1390 : Commit. 0.00001 PPL. 977.15 Recons. 0.01643 +Check if save...? +----saved---- +Start training Epoch 1391... +Train. Iter 1391 : Commit. 0.00001 PPL. 975.23 Recons. 0.01642 +Start training Epoch 1392... +Train. Iter 1392 : Commit. 0.00001 PPL. 978.19 Recons. 0.01640 +Start training Epoch 1393... +Train. Iter 1393 : Commit. 0.00001 PPL. 975.03 Recons. 0.01637 +Start training Epoch 1394... +Train. Iter 1394 : Commit. 0.00001 PPL. 977.40 Recons. 0.01647 +Start training Epoch 1395... +Train. Iter 1395 : Commit. 0.00001 PPL. 973.37 Recons. 0.01645 +Start training Epoch 1396... +Train. Iter 1396 : Commit. 0.00001 PPL. 973.82 Recons. 0.01642 +Start training Epoch 1397... +Train. Iter 1397 : Commit. 0.00001 PPL. 971.86 Recons. 0.01654 +Start training Epoch 1398... +Train. Iter 1398 : Commit. 0.00001 PPL. 975.81 Recons. 0.01647 +Start training Epoch 1399... +Train. Iter 1399 : Commit. 0.00001 PPL. 974.79 Recons. 0.01645 +Start training Epoch 1400... +Train. Iter 1400 : Commit. 0.00001 PPL. 975.07 Recons. 0.01637 +Check if save...? +----saved---- +Start training Epoch 1401... +Train. Iter 1401 : Commit. 0.00001 PPL. 977.38 Recons. 0.01647 +Start training Epoch 1402... +Train. Iter 1402 : Commit. 0.00001 PPL. 975.50 Recons. 0.01647 +Start training Epoch 1403... +Train. Iter 1403 : Commit. 0.00001 PPL. 974.50 Recons. 0.01640 +Start training Epoch 1404... +Train. Iter 1404 : Commit. 0.00001 PPL. 974.14 Recons. 0.01650 +Start training Epoch 1405... +Train. Iter 1405 : Commit. 0.00001 PPL. 974.36 Recons. 0.01650 +Start training Epoch 1406... +Train. Iter 1406 : Commit. 0.00001 PPL. 977.36 Recons. 0.01655 +Start training Epoch 1407... +Train. Iter 1407 : Commit. 0.00001 PPL. 977.76 Recons. 0.01638 +Start training Epoch 1408... +Train. Iter 1408 : Commit. 0.00001 PPL. 978.14 Recons. 0.01657 +Start training Epoch 1409... +Train. Iter 1409 : Commit. 0.00001 PPL. 975.45 Recons. 0.01653 +Start training Epoch 1410... +Train. Iter 1410 : Commit. 0.00001 PPL. 980.31 Recons. 0.01647 +Check if save...? +Start training Epoch 1411... +Train. Iter 1411 : Commit. 0.00001 PPL. 984.87 Recons. 0.01658 +Start training Epoch 1412... +Train. Iter 1412 : Commit. 0.00001 PPL. 977.84 Recons. 0.01648 +Start training Epoch 1413... +Train. Iter 1413 : Commit. 0.00001 PPL. 977.74 Recons. 0.01646 +Start training Epoch 1414... +Train. Iter 1414 : Commit. 0.00001 PPL. 977.07 Recons. 0.01651 +Start training Epoch 1415... +Train. Iter 1415 : Commit. 0.00001 PPL. 974.04 Recons. 0.01643 +Start training Epoch 1416... +Train. Iter 1416 : Commit. 0.00001 PPL. 980.87 Recons. 0.01651 +Start training Epoch 1417... +Train. Iter 1417 : Commit. 0.00001 PPL. 977.67 Recons. 0.01642 +Start training Epoch 1418... +Train. Iter 1418 : Commit. 0.00001 PPL. 975.74 Recons. 0.01640 +Start training Epoch 1419... +Train. Iter 1419 : Commit. 0.00001 PPL. 974.02 Recons. 0.01650 +Start training Epoch 1420... +Train. Iter 1420 : Commit. 0.00001 PPL. 975.92 Recons. 0.01641 +Check if save...? +Start training Epoch 1421... +Train. Iter 1421 : Commit. 0.00001 PPL. 975.20 Recons. 0.01637 +Start training Epoch 1422... +Train. Iter 1422 : Commit. 0.00001 PPL. 977.62 Recons. 0.01637 +Start training Epoch 1423... +Train. Iter 1423 : Commit. 0.00001 PPL. 974.04 Recons. 0.01637 +Start training Epoch 1424... +Train. Iter 1424 : Commit. 0.00001 PPL. 979.84 Recons. 0.01641 +Start training Epoch 1425... +Train. Iter 1425 : Commit. 0.00001 PPL. 975.64 Recons. 0.01643 +Start training Epoch 1426... +Train. Iter 1426 : Commit. 0.00001 PPL. 974.36 Recons. 0.01633 +Start training Epoch 1427... +Train. Iter 1427 : Commit. 0.00001 PPL. 979.43 Recons. 0.01632 +Start training Epoch 1428... +Train. Iter 1428 : Commit. 0.00001 PPL. 979.12 Recons. 0.01633 +Start training Epoch 1429... +Train. Iter 1429 : Commit. 0.00001 PPL. 987.22 Recons. 0.01650 +Start training Epoch 1430... +Train. Iter 1430 : Commit. 0.00001 PPL. 979.69 Recons. 0.01643 +Check if save...? +Start training Epoch 1431... +Train. Iter 1431 : Commit. 0.00001 PPL. 983.72 Recons. 0.01639 +Start training Epoch 1432... +Train. Iter 1432 : Commit. 0.00001 PPL. 976.06 Recons. 0.01632 +Start training Epoch 1433... +Train. Iter 1433 : Commit. 0.00001 PPL. 978.47 Recons. 0.01637 +Start training Epoch 1434... +Train. Iter 1434 : Commit. 0.00001 PPL. 976.06 Recons. 0.01639 +Start training Epoch 1435... +Train. Iter 1435 : Commit. 0.00001 PPL. 974.08 Recons. 0.01633 +Start training Epoch 1436... +Train. Iter 1436 : Commit. 0.00001 PPL. 974.39 Recons. 0.01643 +Start training Epoch 1437... +Train. Iter 1437 : Commit. 0.00001 PPL. 977.54 Recons. 0.01637 +Start training Epoch 1438... +Train. Iter 1438 : Commit. 0.00001 PPL. 975.84 Recons. 0.01638 +Start training Epoch 1439... +Train. Iter 1439 : Commit. 0.00001 PPL. 972.70 Recons. 0.01639 +Start training Epoch 1440... +Train. Iter 1440 : Commit. 0.00001 PPL. 975.93 Recons. 0.01635 +Check if save...? +----saved---- +Start training Epoch 1441... +Train. Iter 1441 : Commit. 0.00001 PPL. 983.56 Recons. 0.01645 +Start training Epoch 1442... +Train. Iter 1442 : Commit. 0.00001 PPL. 981.88 Recons. 0.01635 +Start training Epoch 1443... +Train. Iter 1443 : Commit. 0.00001 PPL. 979.64 Recons. 0.01638 +Start training Epoch 1444... +Train. Iter 1444 : Commit. 0.00001 PPL. 979.51 Recons. 0.01634 +Start training Epoch 1445... +Train. Iter 1445 : Commit. 0.00001 PPL. 978.55 Recons. 0.01630 +Start training Epoch 1446... +Train. Iter 1446 : Commit. 0.00001 PPL. 981.58 Recons. 0.01638 +Start training Epoch 1447... +Train. Iter 1447 : Commit. 0.00001 PPL. 976.32 Recons. 0.01634 +Start training Epoch 1448... +Train. Iter 1448 : Commit. 0.00001 PPL. 978.21 Recons. 0.01634 +Start training Epoch 1449... +Train. Iter 1449 : Commit. 0.00001 PPL. 979.56 Recons. 0.01630 +Start training Epoch 1450... +Train. Iter 1450 : Commit. 0.00001 PPL. 978.85 Recons. 0.01632 +Check if save...? +----saved---- +Start training Epoch 1451... +Train. Iter 1451 : Commit. 0.00001 PPL. 978.70 Recons. 0.01627 +Start training Epoch 1452... +Train. Iter 1452 : Commit. 0.00001 PPL. 975.55 Recons. 0.01634 +Start training Epoch 1453... +Train. Iter 1453 : Commit. 0.00001 PPL. 974.16 Recons. 0.01632 +Start training Epoch 1454... +Train. Iter 1454 : Commit. 0.00001 PPL. 974.63 Recons. 0.01637 +Start training Epoch 1455... +Train. Iter 1455 : Commit. 0.00001 PPL. 971.56 Recons. 0.01630 +Start training Epoch 1456... +Train. Iter 1456 : Commit. 0.00001 PPL. 976.82 Recons. 0.01632 +Start training Epoch 1457... +Train. Iter 1457 : Commit. 0.00001 PPL. 975.51 Recons. 0.01628 +Start training Epoch 1458... +Train. Iter 1458 : Commit. 0.00001 PPL. 974.96 Recons. 0.01623 +Start training Epoch 1459... +Train. Iter 1459 : Commit. 0.00001 PPL. 971.00 Recons. 0.01632 +Start training Epoch 1460... +Train. Iter 1460 : Commit. 0.00001 PPL. 973.80 Recons. 0.01630 +Check if save...? +----saved---- +Start training Epoch 1461... +Train. Iter 1461 : Commit. 0.00001 PPL. 971.88 Recons. 0.01625 +Start training Epoch 1462... +Train. Iter 1462 : Commit. 0.00001 PPL. 977.25 Recons. 0.01631 +Start training Epoch 1463... +Train. Iter 1463 : Commit. 0.00001 PPL. 975.70 Recons. 0.01665 +Start training Epoch 1464... +Train. Iter 1464 : Commit. 0.00001 PPL. 976.26 Recons. 0.01637 +Start training Epoch 1465... +Train. Iter 1465 : Commit. 0.00001 PPL. 974.75 Recons. 0.01637 +Start training Epoch 1466... +Train. Iter 1466 : Commit. 0.00001 PPL. 976.94 Recons. 0.01636 +Start training Epoch 1467... +Train. Iter 1467 : Commit. 0.00001 PPL. 978.93 Recons. 0.01634 +Start training Epoch 1468... +Train. Iter 1468 : Commit. 0.00001 PPL. 973.59 Recons. 0.01638 +Start training Epoch 1469... +Train. Iter 1469 : Commit. 0.00001 PPL. 975.16 Recons. 0.01637 +Start training Epoch 1470... +Train. Iter 1470 : Commit. 0.00001 PPL. 972.80 Recons. 0.01624 +Check if save...? +----saved---- +Start training Epoch 1471... +Train. Iter 1471 : Commit. 0.00001 PPL. 973.02 Recons. 0.01640 +Start training Epoch 1472... +Train. Iter 1472 : Commit. 0.00001 PPL. 978.19 Recons. 0.01628 +Start training Epoch 1473... +Train. Iter 1473 : Commit. 0.00001 PPL. 973.39 Recons. 0.01624 +Start training Epoch 1474... +Train. Iter 1474 : Commit. 0.00001 PPL. 974.78 Recons. 0.01625 +Start training Epoch 1475... +Train. Iter 1475 : Commit. 0.00001 PPL. 973.31 Recons. 0.01628 +Start training Epoch 1476... +Train. Iter 1476 : Commit. 0.00001 PPL. 974.08 Recons. 0.01629 +Start training Epoch 1477... +Train. Iter 1477 : Commit. 0.00001 PPL. 973.00 Recons. 0.01623 +Start training Epoch 1478... +Train. Iter 1478 : Commit. 0.00001 PPL. 971.31 Recons. 0.01626 +Start training Epoch 1479... +Train. Iter 1479 : Commit. 0.00001 PPL. 971.31 Recons. 0.01624 +Start training Epoch 1480... +Train. Iter 1480 : Commit. 0.00001 PPL. 971.58 Recons. 0.01630 +Check if save...? +Start training Epoch 1481... +Train. Iter 1481 : Commit. 0.00001 PPL. 971.46 Recons. 0.01630 +Start training Epoch 1482... +Train. Iter 1482 : Commit. 0.00001 PPL. 974.70 Recons. 0.01629 +Start training Epoch 1483... +Train. Iter 1483 : Commit. 0.00001 PPL. 980.02 Recons. 0.01638 +Start training Epoch 1484... +Train. Iter 1484 : Commit. 0.00001 PPL. 977.98 Recons. 0.01635 +Start training Epoch 1485... +Train. Iter 1485 : Commit. 0.00001 PPL. 975.17 Recons. 0.01631 +Start training Epoch 1486... +Train. Iter 1486 : Commit. 0.00001 PPL. 974.90 Recons. 0.01630 +Start training Epoch 1487... +Train. Iter 1487 : Commit. 0.00001 PPL. 989.11 Recons. 0.01636 +Start training Epoch 1488... +Train. Iter 1488 : Commit. 0.00001 PPL. 983.70 Recons. 0.01622 +Start training Epoch 1489... +Train. Iter 1489 : Commit. 0.00001 PPL. 975.92 Recons. 0.01624 +Start training Epoch 1490... +Train. Iter 1490 : Commit. 0.00001 PPL. 974.59 Recons. 0.01655 +Check if save...? +Start training Epoch 1491... +Train. Iter 1491 : Commit. 0.00001 PPL. 976.54 Recons. 0.01623 +Start training Epoch 1492... +Train. Iter 1492 : Commit. 0.00001 PPL. 972.16 Recons. 0.01625 +Start training Epoch 1493... +Train. Iter 1493 : Commit. 0.00001 PPL. 976.99 Recons. 0.01629 +Start training Epoch 1494... +Train. Iter 1494 : Commit. 0.00001 PPL. 975.13 Recons. 0.01627 +Start training Epoch 1495... +Train. Iter 1495 : Commit. 0.00001 PPL. 974.96 Recons. 0.01649 +Start training Epoch 1496... +Train. Iter 1496 : Commit. 0.00001 PPL. 974.58 Recons. 0.01631 +Start training Epoch 1497... +Train. Iter 1497 : Commit. 0.00001 PPL. 968.00 Recons. 0.01624 +Start training Epoch 1498... +Train. Iter 1498 : Commit. 0.00001 PPL. 971.59 Recons. 0.01626 +Start training Epoch 1499... +Train. Iter 1499 : Commit. 0.00001 PPL. 972.55 Recons. 0.01623 +Start training Epoch 1500... +Train. Iter 1500 : Commit. 0.00001 PPL. 968.00 Recons. 0.01625 +Check if save...? +Start training Epoch 1501... +Train. Iter 1501 : Commit. 0.00001 PPL. 977.14 Recons. 0.01636 +Start training Epoch 1502... +Train. Iter 1502 : Commit. 0.00001 PPL. 972.15 Recons. 0.01619 +Start training Epoch 1503... +Train. Iter 1503 : Commit. 0.00001 PPL. 967.35 Recons. 0.01626 +Start training Epoch 1504... +Train. Iter 1504 : Commit. 0.00001 PPL. 972.62 Recons. 0.01627 +Start training Epoch 1505... +Train. Iter 1505 : Commit. 0.00001 PPL. 967.99 Recons. 0.01628 +Start training Epoch 1506... +Train. Iter 1506 : Commit. 0.00001 PPL. 972.45 Recons. 0.01630 +Start training Epoch 1507... +Train. Iter 1507 : Commit. 0.00001 PPL. 966.02 Recons. 0.01627 +Start training Epoch 1508... +Train. Iter 1508 : Commit. 0.00001 PPL. 972.36 Recons. 0.01636 +Start training Epoch 1509... +Train. Iter 1509 : Commit. 0.00001 PPL. 973.38 Recons. 0.01617 +Start training Epoch 1510... +Train. Iter 1510 : Commit. 0.00001 PPL. 967.86 Recons. 0.01619 +Check if save...? +----saved---- +Start training Epoch 1511... +Train. Iter 1511 : Commit. 0.00001 PPL. 965.72 Recons. 0.01628 +Start training Epoch 1512... +Train. Iter 1512 : Commit. 0.00001 PPL. 968.68 Recons. 0.01623 +Start training Epoch 1513... +Train. Iter 1513 : Commit. 0.00001 PPL. 971.48 Recons. 0.01628 +Start training Epoch 1514... +Train. Iter 1514 : Commit. 0.00001 PPL. 965.49 Recons. 0.01617 +Start training Epoch 1515... +Train. Iter 1515 : Commit. 0.00001 PPL. 964.59 Recons. 0.01638 +Start training Epoch 1516... +Train. Iter 1516 : Commit. 0.00001 PPL. 965.52 Recons. 0.01621 +Start training Epoch 1517... +Train. Iter 1517 : Commit. 0.00001 PPL. 972.32 Recons. 0.01631 +Start training Epoch 1518... +Train. Iter 1518 : Commit. 0.00001 PPL. 978.04 Recons. 0.01620 +Start training Epoch 1519... +Train. Iter 1519 : Commit. 0.00001 PPL. 971.14 Recons. 0.01616 +Start training Epoch 1520... +Train. Iter 1520 : Commit. 0.00001 PPL. 970.64 Recons. 0.01617 +Check if save...? +----saved---- +Start training Epoch 1521... +Train. Iter 1521 : Commit. 0.00001 PPL. 964.64 Recons. 0.01652 +Start training Epoch 1522... +Train. Iter 1522 : Commit. 0.00001 PPL. 971.33 Recons. 0.01626 +Start training Epoch 1523... +Train. Iter 1523 : Commit. 0.00001 PPL. 968.97 Recons. 0.01615 +Start training Epoch 1524... +Train. Iter 1524 : Commit. 0.00001 PPL. 965.46 Recons. 0.01619 +Start training Epoch 1525... +Train. Iter 1525 : Commit. 0.00001 PPL. 964.71 Recons. 0.01622 +Start training Epoch 1526... +Train. Iter 1526 : Commit. 0.00001 PPL. 967.80 Recons. 0.01614 +Start training Epoch 1527... +Train. Iter 1527 : Commit. 0.00001 PPL. 965.04 Recons. 0.01647 +Start training Epoch 1528... +Train. Iter 1528 : Commit. 0.00001 PPL. 966.72 Recons. 0.01625 +Start training Epoch 1529... +Train. Iter 1529 : Commit. 0.00001 PPL. 965.13 Recons. 0.01631 +Start training Epoch 1530... +Train. Iter 1530 : Commit. 0.00001 PPL. 965.12 Recons. 0.01617 +Check if save...? +Start training Epoch 1531... +Train. Iter 1531 : Commit. 0.00001 PPL. 963.80 Recons. 0.01617 +Start training Epoch 1532... +Train. Iter 1532 : Commit. 0.00001 PPL. 965.82 Recons. 0.01625 +Start training Epoch 1533... +Train. Iter 1533 : Commit. 0.00001 PPL. 971.13 Recons. 0.01623 +Start training Epoch 1534... +Train. Iter 1534 : Commit. 0.00001 PPL. 968.11 Recons. 0.01625 +Start training Epoch 1535... +Train. Iter 1535 : Commit. 0.00001 PPL. 968.36 Recons. 0.01623 +Start training Epoch 1536... +Train. Iter 1536 : Commit. 0.00001 PPL. 972.83 Recons. 0.01619 +Start training Epoch 1537... +Train. Iter 1537 : Commit. 0.00001 PPL. 969.79 Recons. 0.01622 +Start training Epoch 1538... +Train. Iter 1538 : Commit. 0.00001 PPL. 968.80 Recons. 0.01619 +Start training Epoch 1539... +Train. Iter 1539 : Commit. 0.00001 PPL. 966.84 Recons. 0.01610 +Start training Epoch 1540... +Train. Iter 1540 : Commit. 0.00001 PPL. 968.76 Recons. 0.01618 +Check if save...? +Start training Epoch 1541... +Train. Iter 1541 : Commit. 0.00001 PPL. 966.05 Recons. 0.01610 +Start training Epoch 1542... +Train. Iter 1542 : Commit. 0.00001 PPL. 964.79 Recons. 0.01611 +Start training Epoch 1543... +Train. Iter 1543 : Commit. 0.00001 PPL. 962.53 Recons. 0.01619 +Start training Epoch 1544... +Train. Iter 1544 : Commit. 0.00001 PPL. 966.84 Recons. 0.01635 +Start training Epoch 1545... +Train. Iter 1545 : Commit. 0.00001 PPL. 963.73 Recons. 0.01617 +Start training Epoch 1546... +Train. Iter 1546 : Commit. 0.00001 PPL. 958.90 Recons. 0.01612 +Start training Epoch 1547... +Train. Iter 1547 : Commit. 0.00001 PPL. 962.87 Recons. 0.01610 +Start training Epoch 1548... +Train. Iter 1548 : Commit. 0.00001 PPL. 960.66 Recons. 0.01616 +Start training Epoch 1549... +Train. Iter 1549 : Commit. 0.00001 PPL. 963.72 Recons. 0.01628 +Start training Epoch 1550... +Train. Iter 1550 : Commit. 0.00001 PPL. 960.79 Recons. 0.01608 +Check if save...? +----saved---- +Start training Epoch 1551... +Train. Iter 1551 : Commit. 0.00001 PPL. 961.25 Recons. 0.01610 +Start training Epoch 1552... +Train. Iter 1552 : Commit. 0.00001 PPL. 962.39 Recons. 0.01615 +Start training Epoch 1553... +Train. Iter 1553 : Commit. 0.00001 PPL. 961.29 Recons. 0.01621 +Start training Epoch 1554... +Train. Iter 1554 : Commit. 0.00001 PPL. 964.47 Recons. 0.01609 +Start training Epoch 1555... +Train. Iter 1555 : Commit. 0.00001 PPL. 963.50 Recons. 0.01609 +Start training Epoch 1556... +Train. Iter 1556 : Commit. 0.00001 PPL. 965.16 Recons. 0.01613 +Start training Epoch 1557... +Train. Iter 1557 : Commit. 0.00001 PPL. 973.55 Recons. 0.01609 +Start training Epoch 1558... +Train. Iter 1558 : Commit. 0.00001 PPL. 968.33 Recons. 0.01606 +Start training Epoch 1559... +Train. Iter 1559 : Commit. 0.00001 PPL. 971.59 Recons. 0.01632 +Start training Epoch 1560... +Train. Iter 1560 : Commit. 0.00001 PPL. 966.53 Recons. 0.01642 +Check if save...? +Start training Epoch 1561... +Train. Iter 1561 : Commit. 0.00001 PPL. 967.50 Recons. 0.01628 +Start training Epoch 1562... +Train. Iter 1562 : Commit. 0.00001 PPL. 967.52 Recons. 0.01622 +Start training Epoch 1563... +Train. Iter 1563 : Commit. 0.00001 PPL. 964.90 Recons. 0.01618 +Start training Epoch 1564... +Train. Iter 1564 : Commit. 0.00001 PPL. 967.39 Recons. 0.01620 +Start training Epoch 1565... +Train. Iter 1565 : Commit. 0.00001 PPL. 969.78 Recons. 0.01613 +Start training Epoch 1566... +Train. Iter 1566 : Commit. 0.00001 PPL. 965.86 Recons. 0.01609 +Start training Epoch 1567... +Train. Iter 1567 : Commit. 0.00001 PPL. 961.85 Recons. 0.01616 +Start training Epoch 1568... +Train. Iter 1568 : Commit. 0.00001 PPL. 963.32 Recons. 0.01607 +Start training Epoch 1569... +Train. Iter 1569 : Commit. 0.00001 PPL. 964.24 Recons. 0.01612 +Start training Epoch 1570... +Train. Iter 1570 : Commit. 0.00001 PPL. 972.22 Recons. 0.01610 +Check if save...? +Start training Epoch 1571... +Train. Iter 1571 : Commit. 0.00001 PPL. 970.60 Recons. 0.01612 +Start training Epoch 1572... +Train. Iter 1572 : Commit. 0.00001 PPL. 970.59 Recons. 0.01611 +Start training Epoch 1573... +Train. Iter 1573 : Commit. 0.00001 PPL. 969.23 Recons. 0.01602 +Start training Epoch 1574... +Train. Iter 1574 : Commit. 0.00001 PPL. 968.75 Recons. 0.01608 +Start training Epoch 1575... +Train. Iter 1575 : Commit. 0.00001 PPL. 965.51 Recons. 0.01608 +Start training Epoch 1576... +Train. Iter 1576 : Commit. 0.00001 PPL. 964.54 Recons. 0.01610 +Start training Epoch 1577... +Train. Iter 1577 : Commit. 0.00001 PPL. 962.07 Recons. 0.01605 +Start training Epoch 1578... +Train. Iter 1578 : Commit. 0.00001 PPL. 968.61 Recons. 0.01606 +Start training Epoch 1579... +Train. Iter 1579 : Commit. 0.00001 PPL. 965.80 Recons. 0.01614 +Start training Epoch 1580... +Train. Iter 1580 : Commit. 0.00001 PPL. 965.85 Recons. 0.01617 +Check if save...? +Start training Epoch 1581... +Train. Iter 1581 : Commit. 0.00001 PPL. 965.89 Recons. 0.01602 +Start training Epoch 1582... +Train. Iter 1582 : Commit. 0.00001 PPL. 965.53 Recons. 0.01602 +Start training Epoch 1583... +Train. Iter 1583 : Commit. 0.00001 PPL. 965.26 Recons. 0.01608 +Start training Epoch 1584... +Train. Iter 1584 : Commit. 0.00001 PPL. 965.47 Recons. 0.01607 +Start training Epoch 1585... +Train. Iter 1585 : Commit. 0.00001 PPL. 963.91 Recons. 0.01610 +Start training Epoch 1586... +Train. Iter 1586 : Commit. 0.00001 PPL. 963.45 Recons. 0.01605 +Start training Epoch 1587... +Train. Iter 1587 : Commit. 0.00001 PPL. 967.86 Recons. 0.01609 +Start training Epoch 1588... +Train. Iter 1588 : Commit. 0.00001 PPL. 968.23 Recons. 0.01614 +Start training Epoch 1589... +Train. Iter 1589 : Commit. 0.00001 PPL. 967.06 Recons. 0.01605 +Start training Epoch 1590... +Train. Iter 1590 : Commit. 0.00001 PPL. 969.24 Recons. 0.01609 +Check if save...? +Start training Epoch 1591... +Train. Iter 1591 : Commit. 0.00001 PPL. 966.06 Recons. 0.01609 +Start training Epoch 1592... +Train. Iter 1592 : Commit. 0.00001 PPL. 966.92 Recons. 0.01607 +Start training Epoch 1593... +Train. Iter 1593 : Commit. 0.00001 PPL. 975.67 Recons. 0.01608 +Start training Epoch 1594... +Train. Iter 1594 : Commit. 0.00001 PPL. 969.85 Recons. 0.01612 +Start training Epoch 1595... +Train. Iter 1595 : Commit. 0.00001 PPL. 966.85 Recons. 0.01600 +Start training Epoch 1596... +Train. Iter 1596 : Commit. 0.00001 PPL. 966.66 Recons. 0.01601 +Start training Epoch 1597... +Train. Iter 1597 : Commit. 0.00001 PPL. 965.96 Recons. 0.01603 +Start training Epoch 1598... +Train. Iter 1598 : Commit. 0.00001 PPL. 963.60 Recons. 0.01605 +Start training Epoch 1599... +Train. Iter 1599 : Commit. 0.00001 PPL. 963.72 Recons. 0.01611 +Start training Epoch 1600... +Train. Iter 1600 : Commit. 0.00001 PPL. 963.34 Recons. 0.01607 +Check if save...? +----saved---- +Start training Epoch 1601... +Train. Iter 1601 : Commit. 0.00001 PPL. 963.11 Recons. 0.01610 +Start training Epoch 1602... +Train. Iter 1602 : Commit. 0.00001 PPL. 961.83 Recons. 0.01612 +Start training Epoch 1603... +Train. Iter 1603 : Commit. 0.00001 PPL. 963.53 Recons. 0.01619 +Start training Epoch 1604... +Train. Iter 1604 : Commit. 0.00001 PPL. 962.56 Recons. 0.01593 +Start training Epoch 1605... +Train. Iter 1605 : Commit. 0.00001 PPL. 960.94 Recons. 0.01603 +Start training Epoch 1606... +Train. Iter 1606 : Commit. 0.00001 PPL. 961.46 Recons. 0.01608 +Start training Epoch 1607... +Train. Iter 1607 : Commit. 0.00001 PPL. 962.53 Recons. 0.01609 +Start training Epoch 1608... +Train. Iter 1608 : Commit. 0.00001 PPL. 960.74 Recons. 0.01606 +Start training Epoch 1609... +Train. Iter 1609 : Commit. 0.00001 PPL. 961.03 Recons. 0.01604 +Start training Epoch 1610... +Train. Iter 1610 : Commit. 0.00001 PPL. 960.90 Recons. 0.01604 +Check if save...? +----saved---- +Start training Epoch 1611... +Train. Iter 1611 : Commit. 0.00001 PPL. 958.86 Recons. 0.01601 +Start training Epoch 1612... +Train. Iter 1612 : Commit. 0.00001 PPL. 966.88 Recons. 0.01612 +Start training Epoch 1613... +Train. Iter 1613 : Commit. 0.00001 PPL. 963.55 Recons. 0.01611 +Start training Epoch 1614... +Train. Iter 1614 : Commit. 0.00001 PPL. 965.68 Recons. 0.01607 +Start training Epoch 1615... +Train. Iter 1615 : Commit. 0.00001 PPL. 970.16 Recons. 0.01600 +Start training Epoch 1616... +Train. Iter 1616 : Commit. 0.00001 PPL. 963.67 Recons. 0.01607 +Start training Epoch 1617... +Train. Iter 1617 : Commit. 0.00001 PPL. 963.60 Recons. 0.01599 +Start training Epoch 1618... +Train. Iter 1618 : Commit. 0.00001 PPL. 964.09 Recons. 0.01596 +Start training Epoch 1619... +Train. Iter 1619 : Commit. 0.00001 PPL. 963.05 Recons. 0.01609 +Start training Epoch 1620... +Train. Iter 1620 : Commit. 0.00001 PPL. 965.50 Recons. 0.01599 +Check if save...? +----saved---- +Start training Epoch 1621... +Train. Iter 1621 : Commit. 0.00001 PPL. 967.05 Recons. 0.01605 +Start training Epoch 1622... +Train. Iter 1622 : Commit. 0.00001 PPL. 966.17 Recons. 0.01604 +Start training Epoch 1623... +Train. Iter 1623 : Commit. 0.00001 PPL. 965.41 Recons. 0.01602 +Start training Epoch 1624... +Train. Iter 1624 : Commit. 0.00001 PPL. 964.08 Recons. 0.01601 +Start training Epoch 1625... +Train. Iter 1625 : Commit. 0.00001 PPL. 962.18 Recons. 0.01610 +Start training Epoch 1626... +Train. Iter 1626 : Commit. 0.00001 PPL. 961.45 Recons. 0.01597 +Start training Epoch 1627... +Train. Iter 1627 : Commit. 0.00001 PPL. 961.62 Recons. 0.01600 +Start training Epoch 1628... +Train. Iter 1628 : Commit. 0.00001 PPL. 957.13 Recons. 0.01605 +Start training Epoch 1629... +Train. Iter 1629 : Commit. 0.00001 PPL. 963.83 Recons. 0.01606 +Start training Epoch 1630... +Train. Iter 1630 : Commit. 0.00001 PPL. 965.71 Recons. 0.01624 +Check if save...? +Start training Epoch 1631... +Train. Iter 1631 : Commit. 0.00001 PPL. 965.22 Recons. 0.01606 +Start training Epoch 1632... +Train. Iter 1632 : Commit. 0.00001 PPL. 963.71 Recons. 0.01603 +Start training Epoch 1633... +Train. Iter 1633 : Commit. 0.00001 PPL. 961.95 Recons. 0.01604 +Start training Epoch 1634... +Train. Iter 1634 : Commit. 0.00001 PPL. 960.47 Recons. 0.01605 +Start training Epoch 1635... +Train. Iter 1635 : Commit. 0.00001 PPL. 960.42 Recons. 0.01604 +Start training Epoch 1636... +Train. Iter 1636 : Commit. 0.00001 PPL. 962.53 Recons. 0.01598 +Start training Epoch 1637... +Train. Iter 1637 : Commit. 0.00001 PPL. 962.27 Recons. 0.01593 +Start training Epoch 1638... +Train. Iter 1638 : Commit. 0.00001 PPL. 957.97 Recons. 0.01598 +Start training Epoch 1639... +Train. Iter 1639 : Commit. 0.00001 PPL. 960.09 Recons. 0.01600 +Start training Epoch 1640... +Train. Iter 1640 : Commit. 0.00001 PPL. 958.12 Recons. 0.01607 +Check if save...? +Start training Epoch 1641... +Train. Iter 1641 : Commit. 0.00001 PPL. 959.89 Recons. 0.01597 +Start training Epoch 1642... +Train. Iter 1642 : Commit. 0.00001 PPL. 961.90 Recons. 0.01605 +Start training Epoch 1643... +Train. Iter 1643 : Commit. 0.00001 PPL. 957.79 Recons. 0.01620 +Start training Epoch 1644... +Train. Iter 1644 : Commit. 0.00001 PPL. 957.85 Recons. 0.01599 +Start training Epoch 1645... +Train. Iter 1645 : Commit. 0.00001 PPL. 957.56 Recons. 0.01598 +Start training Epoch 1646... +Train. Iter 1646 : Commit. 0.00001 PPL. 958.13 Recons. 0.01603 +Start training Epoch 1647... +Train. Iter 1647 : Commit. 0.00001 PPL. 957.32 Recons. 0.01598 +Start training Epoch 1648... +Train. Iter 1648 : Commit. 0.00001 PPL. 956.26 Recons. 0.01596 +Start training Epoch 1649... +Train. Iter 1649 : Commit. 0.00001 PPL. 960.58 Recons. 0.01593 +Start training Epoch 1650... +Train. Iter 1650 : Commit. 0.00001 PPL. 961.69 Recons. 0.01600 +Check if save...? +Start training Epoch 1651... +Train. Iter 1651 : Commit. 0.00002 PPL. 963.15 Recons. 0.01589 +Start training Epoch 1652... +Train. Iter 1652 : Commit. 0.00001 PPL. 967.50 Recons. 0.01593 +Start training Epoch 1653... +Train. Iter 1653 : Commit. 0.00001 PPL. 962.57 Recons. 0.01597 +Start training Epoch 1654... +Train. Iter 1654 : Commit. 0.00001 PPL. 962.41 Recons. 0.01594 +Start training Epoch 1655... +Train. Iter 1655 : Commit. 0.00001 PPL. 958.09 Recons. 0.01593 +Start training Epoch 1656... +Train. Iter 1656 : Commit. 0.00001 PPL. 953.74 Recons. 0.01601 +Start training Epoch 1657... +Train. Iter 1657 : Commit. 0.00001 PPL. 963.57 Recons. 0.01599 +Start training Epoch 1658... +Train. Iter 1658 : Commit. 0.00001 PPL. 958.47 Recons. 0.01588 +Start training Epoch 1659... +Train. Iter 1659 : Commit. 0.00001 PPL. 961.19 Recons. 0.01600 +Start training Epoch 1660... +Train. Iter 1660 : Commit. 0.00001 PPL. 963.09 Recons. 0.01596 +Check if save...? +----saved---- +Start training Epoch 1661... +Train. Iter 1661 : Commit. 0.00001 PPL. 961.18 Recons. 0.01595 +Start training Epoch 1662... +Train. Iter 1662 : Commit. 0.00001 PPL. 958.48 Recons. 0.01598 +Start training Epoch 1663... +Train. Iter 1663 : Commit. 0.00001 PPL. 959.23 Recons. 0.01599 +Start training Epoch 1664... +Train. Iter 1664 : Commit. 0.00001 PPL. 958.01 Recons. 0.01587 +Start training Epoch 1665... +Train. Iter 1665 : Commit. 0.00002 PPL. 957.47 Recons. 0.01591 +Start training Epoch 1666... +Train. Iter 1666 : Commit. 0.00002 PPL. 955.89 Recons. 0.01592 +Start training Epoch 1667... +Train. Iter 1667 : Commit. 0.00002 PPL. 954.79 Recons. 0.01598 +Start training Epoch 1668... +Train. Iter 1668 : Commit. 0.00002 PPL. 954.76 Recons. 0.01593 +Start training Epoch 1669... +Train. Iter 1669 : Commit. 0.00002 PPL. 956.80 Recons. 0.01594 +Start training Epoch 1670... +Train. Iter 1670 : Commit. 0.00002 PPL. 963.84 Recons. 0.01594 +Check if save...? +----saved---- +Start training Epoch 1671... +Train. Iter 1671 : Commit. 0.00002 PPL. 965.95 Recons. 0.01588 +Start training Epoch 1672... +Train. Iter 1672 : Commit. 0.00002 PPL. 958.97 Recons. 0.01596 +Start training Epoch 1673... +Train. Iter 1673 : Commit. 0.00002 PPL. 956.98 Recons. 0.01588 +Start training Epoch 1674... +Train. Iter 1674 : Commit. 0.00002 PPL. 958.04 Recons. 0.01589 +Start training Epoch 1675... +Train. Iter 1675 : Commit. 0.00002 PPL. 959.75 Recons. 0.01589 +Start training Epoch 1676... +Train. Iter 1676 : Commit. 0.00002 PPL. 956.85 Recons. 0.01591 +Start training Epoch 1677... +Train. Iter 1677 : Commit. 0.00002 PPL. 958.56 Recons. 0.01594 +Start training Epoch 1678... +Train. Iter 1678 : Commit. 0.00002 PPL. 960.43 Recons. 0.01589 +Start training Epoch 1679... +Train. Iter 1679 : Commit. 0.00002 PPL. 960.06 Recons. 0.01595 +Start training Epoch 1680... +Train. Iter 1680 : Commit. 0.00002 PPL. 964.19 Recons. 0.01602 +Check if save...? +Start training Epoch 1681... +Train. Iter 1681 : Commit. 0.00002 PPL. 959.45 Recons. 0.01590 +Start training Epoch 1682... +Train. Iter 1682 : Commit. 0.00002 PPL. 956.71 Recons. 0.01591 +Start training Epoch 1683... +Train. Iter 1683 : Commit. 0.00002 PPL. 960.79 Recons. 0.01587 +Start training Epoch 1684... +Train. Iter 1684 : Commit. 0.00002 PPL. 962.78 Recons. 0.01588 +Start training Epoch 1685... +Train. Iter 1685 : Commit. 0.00002 PPL. 958.95 Recons. 0.01592 +Start training Epoch 1686... +Train. Iter 1686 : Commit. 0.00002 PPL. 958.69 Recons. 0.01594 +Start training Epoch 1687... +Train. Iter 1687 : Commit. 0.00002 PPL. 971.35 Recons. 0.01593 +Start training Epoch 1688... +Train. Iter 1688 : Commit. 0.00002 PPL. 963.96 Recons. 0.01588 +Start training Epoch 1689... +Train. Iter 1689 : Commit. 0.00002 PPL. 962.30 Recons. 0.01591 +Start training Epoch 1690... +Train. Iter 1690 : Commit. 0.00002 PPL. 962.28 Recons. 0.01617 +Check if save...? +Start training Epoch 1691... +Train. Iter 1691 : Commit. 0.00002 PPL. 960.73 Recons. 0.01612 +Start training Epoch 1692... +Train. Iter 1692 : Commit. 0.00002 PPL. 963.39 Recons. 0.01591 +Start training Epoch 1693... +Train. Iter 1693 : Commit. 0.00002 PPL. 962.53 Recons. 0.01591 +Start training Epoch 1694... +Train. Iter 1694 : Commit. 0.00002 PPL. 960.28 Recons. 0.01591 +Start training Epoch 1695... +Train. Iter 1695 : Commit. 0.00002 PPL. 959.24 Recons. 0.01583 +Start training Epoch 1696... +Train. Iter 1696 : Commit. 0.00002 PPL. 962.13 Recons. 0.01589 +Start training Epoch 1697... +Train. Iter 1697 : Commit. 0.00002 PPL. 960.31 Recons. 0.01592 +Start training Epoch 1698... +Train. Iter 1698 : Commit. 0.00002 PPL. 963.52 Recons. 0.01585 +Start training Epoch 1699... +Train. Iter 1699 : Commit. 0.00002 PPL. 959.18 Recons. 0.01585 +Start training Epoch 1700... +Train. Iter 1700 : Commit. 0.00002 PPL. 959.36 Recons. 0.01592 +Check if save...? +----saved---- +Start training Epoch 1701... +Train. Iter 1701 : Commit. 0.00002 PPL. 959.76 Recons. 0.01580 +Start training Epoch 1702... +Train. Iter 1702 : Commit. 0.00002 PPL. 967.44 Recons. 0.01587 +Start training Epoch 1703... +Train. Iter 1703 : Commit. 0.00002 PPL. 962.87 Recons. 0.01583 +Start training Epoch 1704... +Train. Iter 1704 : Commit. 0.00002 PPL. 965.91 Recons. 0.01584 +Start training Epoch 1705... +Train. Iter 1705 : Commit. 0.00002 PPL. 964.88 Recons. 0.01590 +Start training Epoch 1706... +Train. Iter 1706 : Commit. 0.00002 PPL. 963.83 Recons. 0.01581 +Start training Epoch 1707... +Train. Iter 1707 : Commit. 0.00002 PPL. 964.33 Recons. 0.01592 +Start training Epoch 1708... +Train. Iter 1708 : Commit. 0.00002 PPL. 968.90 Recons. 0.01593 +Start training Epoch 1709... +Train. Iter 1709 : Commit. 0.00002 PPL. 971.18 Recons. 0.01593 +Start training Epoch 1710... +Train. Iter 1710 : Commit. 0.00002 PPL. 966.79 Recons. 0.01585 +Check if save...? +----saved---- +Start training Epoch 1711... +Train. Iter 1711 : Commit. 0.00002 PPL. 960.94 Recons. 0.01586 +Start training Epoch 1712... +Train. Iter 1712 : Commit. 0.00002 PPL. 962.33 Recons. 0.01583 +Start training Epoch 1713... +Train. Iter 1713 : Commit. 0.00002 PPL. 959.93 Recons. 0.01589 +Start training Epoch 1714... +Train. Iter 1714 : Commit. 0.00002 PPL. 961.60 Recons. 0.01590 +Start training Epoch 1715... +Train. Iter 1715 : Commit. 0.00002 PPL. 957.67 Recons. 0.01588 +Start training Epoch 1716... +Train. Iter 1716 : Commit. 0.00002 PPL. 959.43 Recons. 0.01594 +Start training Epoch 1717... +Train. Iter 1717 : Commit. 0.00002 PPL. 957.97 Recons. 0.01585 +Start training Epoch 1718... +Train. Iter 1718 : Commit. 0.00002 PPL. 957.17 Recons. 0.01587 +Start training Epoch 1719... +Train. Iter 1719 : Commit. 0.00002 PPL. 954.55 Recons. 0.01590 +Start training Epoch 1720... +Train. Iter 1720 : Commit. 0.00002 PPL. 955.36 Recons. 0.01585 +Check if save...? +----saved---- +Start training Epoch 1721... +Train. Iter 1721 : Commit. 0.00002 PPL. 959.17 Recons. 0.01582 +Start training Epoch 1722... +Train. Iter 1722 : Commit. 0.00002 PPL. 957.47 Recons. 0.01579 +Start training Epoch 1723... +Train. Iter 1723 : Commit. 0.00002 PPL. 953.88 Recons. 0.01586 +Start training Epoch 1724... +Train. Iter 1724 : Commit. 0.00002 PPL. 955.57 Recons. 0.01582 +Start training Epoch 1725... +Train. Iter 1725 : Commit. 0.00002 PPL. 951.16 Recons. 0.01586 +Start training Epoch 1726... +Train. Iter 1726 : Commit. 0.00002 PPL. 957.03 Recons. 0.01592 +Start training Epoch 1727... +Train. Iter 1727 : Commit. 0.00002 PPL. 957.51 Recons. 0.01585 +Start training Epoch 1728... +Train. Iter 1728 : Commit. 0.00002 PPL. 959.48 Recons. 0.01585 +Start training Epoch 1729... +Train. Iter 1729 : Commit. 0.00002 PPL. 961.72 Recons. 0.01590 +Start training Epoch 1730... +Train. Iter 1730 : Commit. 0.00002 PPL. 975.27 Recons. 0.01589 +Check if save...? +Start training Epoch 1731... +Train. Iter 1731 : Commit. 0.00002 PPL. 965.41 Recons. 0.01586 +Start training Epoch 1732... +Train. Iter 1732 : Commit. 0.00002 PPL. 968.12 Recons. 0.01580 +Start training Epoch 1733... +Train. Iter 1733 : Commit. 0.00002 PPL. 964.07 Recons. 0.01582 +Start training Epoch 1734... +Train. Iter 1734 : Commit. 0.00002 PPL. 968.85 Recons. 0.01578 +Start training Epoch 1735... +Train. Iter 1735 : Commit. 0.00002 PPL. 962.21 Recons. 0.01581 +Start training Epoch 1736... +Train. Iter 1736 : Commit. 0.00002 PPL. 957.75 Recons. 0.01579 +Start training Epoch 1737... +Train. Iter 1737 : Commit. 0.00002 PPL. 960.56 Recons. 0.01601 +Start training Epoch 1738... +Train. Iter 1738 : Commit. 0.00002 PPL. 965.46 Recons. 0.01582 +Start training Epoch 1739... +Train. Iter 1739 : Commit. 0.00002 PPL. 964.41 Recons. 0.01580 +Start training Epoch 1740... +Train. Iter 1740 : Commit. 0.00002 PPL. 960.84 Recons. 0.01580 +Check if save...? +----saved---- +Start training Epoch 1741... +Train. Iter 1741 : Commit. 0.00002 PPL. 961.71 Recons. 0.01583 +Start training Epoch 1742... +Train. Iter 1742 : Commit. 0.00002 PPL. 965.98 Recons. 0.01598 +Start training Epoch 1743... +Train. Iter 1743 : Commit. 0.00002 PPL. 966.11 Recons. 0.01596 +Start training Epoch 1744... +Train. Iter 1744 : Commit. 0.00002 PPL. 957.53 Recons. 0.01593 +Start training Epoch 1745... +Train. Iter 1745 : Commit. 0.00002 PPL. 955.69 Recons. 0.01601 +Start training Epoch 1746... +Train. Iter 1746 : Commit. 0.00002 PPL. 954.94 Recons. 0.01580 +Start training Epoch 1747... +Train. Iter 1747 : Commit. 0.00002 PPL. 955.89 Recons. 0.01591 +Start training Epoch 1748... +Train. Iter 1748 : Commit. 0.00002 PPL. 956.13 Recons. 0.01579 +Start training Epoch 1749... +Train. Iter 1749 : Commit. 0.00002 PPL. 957.83 Recons. 0.01593 +Start training Epoch 1750... +Train. Iter 1750 : Commit. 0.00002 PPL. 960.02 Recons. 0.01582 +Check if save...? +Start training Epoch 1751... +Train. Iter 1751 : Commit. 0.00002 PPL. 956.82 Recons. 0.01590 +Start training Epoch 1752... +Train. Iter 1752 : Commit. 0.00002 PPL. 955.33 Recons. 0.01580 +Start training Epoch 1753... +Train. Iter 1753 : Commit. 0.00002 PPL. 961.31 Recons. 0.01580 +Start training Epoch 1754... +Train. Iter 1754 : Commit. 0.00002 PPL. 961.33 Recons. 0.01586 +Start training Epoch 1755... +Train. Iter 1755 : Commit. 0.00002 PPL. 961.64 Recons. 0.01586 +Start training Epoch 1756... +Train. Iter 1756 : Commit. 0.00002 PPL. 956.77 Recons. 0.01584 +Start training Epoch 1757... +Train. Iter 1757 : Commit. 0.00002 PPL. 957.74 Recons. 0.01579 +Start training Epoch 1758... +Train. Iter 1758 : Commit. 0.00002 PPL. 958.13 Recons. 0.01586 +Start training Epoch 1759... +Train. Iter 1759 : Commit. 0.00002 PPL. 957.79 Recons. 0.01577 +Start training Epoch 1760... +Train. Iter 1760 : Commit. 0.00002 PPL. 957.58 Recons. 0.01582 +Check if save...? +Start training Epoch 1761... +Train. Iter 1761 : Commit. 0.00002 PPL. 954.02 Recons. 0.01585 +Start training Epoch 1762... +Train. Iter 1762 : Commit. 0.00002 PPL. 953.09 Recons. 0.01570 +Start training Epoch 1763... +Train. Iter 1763 : Commit. 0.00002 PPL. 953.15 Recons. 0.01583 +Start training Epoch 1764... +Train. Iter 1764 : Commit. 0.00002 PPL. 962.70 Recons. 0.01577 +Start training Epoch 1765... +Train. Iter 1765 : Commit. 0.00002 PPL. 958.55 Recons. 0.01581 +Start training Epoch 1766... +Train. Iter 1766 : Commit. 0.00002 PPL. 961.30 Recons. 0.01585 +Start training Epoch 1767... +Train. Iter 1767 : Commit. 0.00002 PPL. 964.00 Recons. 0.01570 +Start training Epoch 1768... +Train. Iter 1768 : Commit. 0.00002 PPL. 962.29 Recons. 0.01576 +Start training Epoch 1769... +Train. Iter 1769 : Commit. 0.00002 PPL. 958.21 Recons. 0.01577 +Start training Epoch 1770... +Train. Iter 1770 : Commit. 0.00002 PPL. 955.45 Recons. 0.01572 +Check if save...? +----saved---- +Start training Epoch 1771... +Train. Iter 1771 : Commit. 0.00002 PPL. 953.07 Recons. 0.01573 +Start training Epoch 1772... +Train. Iter 1772 : Commit. 0.00002 PPL. 958.37 Recons. 0.01577 +Start training Epoch 1773... +Train. Iter 1773 : Commit. 0.00002 PPL. 957.20 Recons. 0.01566 +Start training Epoch 1774... +Train. Iter 1774 : Commit. 0.00002 PPL. 952.44 Recons. 0.01571 +Start training Epoch 1775... +Train. Iter 1775 : Commit. 0.00002 PPL. 951.11 Recons. 0.01573 +Start training Epoch 1776... +Train. Iter 1776 : Commit. 0.00002 PPL. 951.61 Recons. 0.01586 +Start training Epoch 1777... +Train. Iter 1777 : Commit. 0.00002 PPL. 952.28 Recons. 0.01573 +Start training Epoch 1778... +Train. Iter 1778 : Commit. 0.00002 PPL. 952.93 Recons. 0.01592 +Start training Epoch 1779... +Train. Iter 1779 : Commit. 0.00002 PPL. 956.34 Recons. 0.01577 +Start training Epoch 1780... +Train. Iter 1780 : Commit. 0.00002 PPL. 954.77 Recons. 0.01572 +Check if save...? +Start training Epoch 1781... +Train. Iter 1781 : Commit. 0.00002 PPL. 954.05 Recons. 0.01578 +Start training Epoch 1782... +Train. Iter 1782 : Commit. 0.00002 PPL. 950.66 Recons. 0.01577 +Start training Epoch 1783... +Train. Iter 1783 : Commit. 0.00002 PPL. 950.39 Recons. 0.01575 +Start training Epoch 1784... +Train. Iter 1784 : Commit. 0.00002 PPL. 953.12 Recons. 0.01577 +Start training Epoch 1785... +Train. Iter 1785 : Commit. 0.00002 PPL. 954.07 Recons. 0.01576 +Start training Epoch 1786... +Train. Iter 1786 : Commit. 0.00002 PPL. 953.41 Recons. 0.01567 +Start training Epoch 1787... +Train. Iter 1787 : Commit. 0.00002 PPL. 954.51 Recons. 0.01588 +Start training Epoch 1788... +Train. Iter 1788 : Commit. 0.00002 PPL. 948.50 Recons. 0.01571 +Start training Epoch 1789... +Train. Iter 1789 : Commit. 0.00002 PPL. 948.80 Recons. 0.01570 +Start training Epoch 1790... +Train. Iter 1790 : Commit. 0.00002 PPL. 952.27 Recons. 0.01574 +Check if save...? +Start training Epoch 1791... +Train. Iter 1791 : Commit. 0.00002 PPL. 958.03 Recons. 0.01575 +Start training Epoch 1792... +Train. Iter 1792 : Commit. 0.00002 PPL. 954.65 Recons. 0.01574 +Start training Epoch 1793... +Train. Iter 1793 : Commit. 0.00002 PPL. 954.23 Recons. 0.01573 +Start training Epoch 1794... +Train. Iter 1794 : Commit. 0.00002 PPL. 954.59 Recons. 0.01571 +Start training Epoch 1795... +Train. Iter 1795 : Commit. 0.00002 PPL. 952.09 Recons. 0.01575 +Start training Epoch 1796... +Train. Iter 1796 : Commit. 0.00002 PPL. 948.47 Recons. 0.01571 +Start training Epoch 1797... +Train. Iter 1797 : Commit. 0.00002 PPL. 949.38 Recons. 0.01568 +Start training Epoch 1798... +Train. Iter 1798 : Commit. 0.00002 PPL. 950.27 Recons. 0.01569 +Start training Epoch 1799... +Train. Iter 1799 : Commit. 0.00002 PPL. 954.77 Recons. 0.01580 +Start training Epoch 1800... +Train. Iter 1800 : Commit. 0.00002 PPL. 952.95 Recons. 0.01577 +Check if save...? +Start training Epoch 1801... +Train. Iter 1801 : Commit. 0.00002 PPL. 954.59 Recons. 0.01576 +Start training Epoch 1802... +Train. Iter 1802 : Commit. 0.00002 PPL. 954.30 Recons. 0.01568 +Start training Epoch 1803... +Train. Iter 1803 : Commit. 0.00002 PPL. 950.52 Recons. 0.01572 +Start training Epoch 1804... +Train. Iter 1804 : Commit. 0.00002 PPL. 953.20 Recons. 0.01574 +Start training Epoch 1805... +Train. Iter 1805 : Commit. 0.00002 PPL. 952.46 Recons. 0.01579 +Start training Epoch 1806... +Train. Iter 1806 : Commit. 0.00002 PPL. 952.03 Recons. 0.01571 +Start training Epoch 1807... +Train. Iter 1807 : Commit. 0.00002 PPL. 956.68 Recons. 0.01578 +Start training Epoch 1808... +Train. Iter 1808 : Commit. 0.00002 PPL. 956.93 Recons. 0.01568 +Start training Epoch 1809... +Train. Iter 1809 : Commit. 0.00002 PPL. 955.81 Recons. 0.01574 +Start training Epoch 1810... +Train. Iter 1810 : Commit. 0.00002 PPL. 960.56 Recons. 0.01579 +Check if save...? +Start training Epoch 1811... +Train. Iter 1811 : Commit. 0.00002 PPL. 957.52 Recons. 0.01567 +Start training Epoch 1812... +Train. Iter 1812 : Commit. 0.00002 PPL. 957.27 Recons. 0.01577 +Start training Epoch 1813... +Train. Iter 1813 : Commit. 0.00002 PPL. 955.79 Recons. 0.01567 +Start training Epoch 1814... +Train. Iter 1814 : Commit. 0.00002 PPL. 953.08 Recons. 0.01573 +Start training Epoch 1815... +Train. Iter 1815 : Commit. 0.00002 PPL. 954.38 Recons. 0.01573 +Start training Epoch 1816... +Train. Iter 1816 : Commit. 0.00002 PPL. 952.22 Recons. 0.01572 +Start training Epoch 1817... +Train. Iter 1817 : Commit. 0.00002 PPL. 952.92 Recons. 0.01569 +Start training Epoch 1818... +Train. Iter 1818 : Commit. 0.00002 PPL. 951.21 Recons. 0.01567 +Start training Epoch 1819... +Train. Iter 1819 : Commit. 0.00002 PPL. 953.84 Recons. 0.01576 +Start training Epoch 1820... +Train. Iter 1820 : Commit. 0.00002 PPL. 965.85 Recons. 0.01567 +Check if save...? +----saved---- +Start training Epoch 1821... +Train. Iter 1821 : Commit. 0.00002 PPL. 963.14 Recons. 0.01564 +Start training Epoch 1822... +Train. Iter 1822 : Commit. 0.00002 PPL. 959.79 Recons. 0.01565 +Start training Epoch 1823... +Train. Iter 1823 : Commit. 0.00002 PPL. 961.70 Recons. 0.01568 +Start training Epoch 1824... +Train. Iter 1824 : Commit. 0.00002 PPL. 964.99 Recons. 0.01565 +Start training Epoch 1825... +Train. Iter 1825 : Commit. 0.00002 PPL. 960.32 Recons. 0.01567 +Start training Epoch 1826... +Train. Iter 1826 : Commit. 0.00002 PPL. 963.02 Recons. 0.01573 +Start training Epoch 1827... +Train. Iter 1827 : Commit. 0.00002 PPL. 959.74 Recons. 0.01562 +Start training Epoch 1828... +Train. Iter 1828 : Commit. 0.00002 PPL. 958.09 Recons. 0.01567 +Start training Epoch 1829... +Train. Iter 1829 : Commit. 0.00002 PPL. 955.18 Recons. 0.01563 +Start training Epoch 1830... +Train. Iter 1830 : Commit. 0.00002 PPL. 957.34 Recons. 0.01563 +Check if save...? +----saved---- +Start training Epoch 1831... +Train. Iter 1831 : Commit. 0.00002 PPL. 957.75 Recons. 0.01567 +Start training Epoch 1832... +Train. Iter 1832 : Commit. 0.00002 PPL. 956.76 Recons. 0.01563 +Start training Epoch 1833... +Train. Iter 1833 : Commit. 0.00002 PPL. 955.99 Recons. 0.01564 +Start training Epoch 1834... +Train. Iter 1834 : Commit. 0.00002 PPL. 953.74 Recons. 0.01560 +Start training Epoch 1835... +Train. Iter 1835 : Commit. 0.00002 PPL. 957.09 Recons. 0.01570 +Start training Epoch 1836... +Train. Iter 1836 : Commit. 0.00002 PPL. 959.61 Recons. 0.01559 +Start training Epoch 1837... +Train. Iter 1837 : Commit. 0.00002 PPL. 953.68 Recons. 0.01609 +Start training Epoch 1838... +Train. Iter 1838 : Commit. 0.00002 PPL. 956.11 Recons. 0.01565 +Start training Epoch 1839... +Train. Iter 1839 : Commit. 0.00002 PPL. 954.89 Recons. 0.01563 +Start training Epoch 1840... +Train. Iter 1840 : Commit. 0.00002 PPL. 953.15 Recons. 0.01574 +Check if save...? +Start training Epoch 1841... +Train. Iter 1841 : Commit. 0.00002 PPL. 958.06 Recons. 0.01578 +Start training Epoch 1842... +Train. Iter 1842 : Commit. 0.00002 PPL. 955.63 Recons. 0.01584 +Start training Epoch 1843... +Train. Iter 1843 : Commit. 0.00002 PPL. 958.73 Recons. 0.01563 +Start training Epoch 1844... +Train. Iter 1844 : Commit. 0.00002 PPL. 956.16 Recons. 0.01567 +Start training Epoch 1845... +Train. Iter 1845 : Commit. 0.00002 PPL. 956.75 Recons. 0.01568 +Start training Epoch 1846... +Train. Iter 1846 : Commit. 0.00002 PPL. 954.22 Recons. 0.01567 +Start training Epoch 1847... +Train. Iter 1847 : Commit. 0.00002 PPL. 956.72 Recons. 0.01561 +Start training Epoch 1848... +Train. Iter 1848 : Commit. 0.00002 PPL. 957.19 Recons. 0.01564 +Start training Epoch 1849... +Train. Iter 1849 : Commit. 0.00002 PPL. 953.45 Recons. 0.01566 +Start training Epoch 1850... +Train. Iter 1850 : Commit. 0.00002 PPL. 951.74 Recons. 0.01566 +Check if save...? +Start training Epoch 1851... +Train. Iter 1851 : Commit. 0.00002 PPL. 956.09 Recons. 0.01564 +Start training Epoch 1852... +Train. Iter 1852 : Commit. 0.00002 PPL. 953.87 Recons. 0.01568 +Start training Epoch 1853... +Train. Iter 1853 : Commit. 0.00002 PPL. 955.20 Recons. 0.01580 +Start training Epoch 1854... +Train. Iter 1854 : Commit. 0.00002 PPL. 953.27 Recons. 0.01560 +Start training Epoch 1855... +Train. Iter 1855 : Commit. 0.00002 PPL. 956.51 Recons. 0.01565 +Start training Epoch 1856... +Train. Iter 1856 : Commit. 0.00002 PPL. 956.72 Recons. 0.01562 +Start training Epoch 1857... +Train. Iter 1857 : Commit. 0.00002 PPL. 951.28 Recons. 0.01559 +Start training Epoch 1858... +Train. Iter 1858 : Commit. 0.00002 PPL. 952.42 Recons. 0.01562 +Start training Epoch 1859... +Train. Iter 1859 : Commit. 0.00002 PPL. 951.50 Recons. 0.01573 +Start training Epoch 1860... +Train. Iter 1860 : Commit. 0.00002 PPL. 956.50 Recons. 0.01576 +Check if save...? +Start training Epoch 1861... +Train. Iter 1861 : Commit. 0.00002 PPL. 948.02 Recons. 0.01559 +Start training Epoch 1862... +Train. Iter 1862 : Commit. 0.00002 PPL. 948.83 Recons. 0.01568 +Start training Epoch 1863... +Train. Iter 1863 : Commit. 0.00002 PPL. 950.41 Recons. 0.01559 +Start training Epoch 1864... +Train. Iter 1864 : Commit. 0.00002 PPL. 949.33 Recons. 0.01556 +Start training Epoch 1865... +Train. Iter 1865 : Commit. 0.00002 PPL. 952.15 Recons. 0.01564 +Start training Epoch 1866... +Train. Iter 1866 : Commit. 0.00002 PPL. 952.05 Recons. 0.01564 +Start training Epoch 1867... +Train. Iter 1867 : Commit. 0.00002 PPL. 948.33 Recons. 0.01561 +Start training Epoch 1868... +Train. Iter 1868 : Commit. 0.00002 PPL. 964.51 Recons. 0.01562 +Start training Epoch 1869... +Train. Iter 1869 : Commit. 0.00002 PPL. 960.11 Recons. 0.01573 +Start training Epoch 1870... +Train. Iter 1870 : Commit. 0.00002 PPL. 954.75 Recons. 0.01557 +Check if save...? +----saved---- +Start training Epoch 1871... +Train. Iter 1871 : Commit. 0.00002 PPL. 957.12 Recons. 0.01559 +Start training Epoch 1872... +Train. Iter 1872 : Commit. 0.00002 PPL. 955.54 Recons. 0.01558 +Start training Epoch 1873... +Train. Iter 1873 : Commit. 0.00002 PPL. 951.64 Recons. 0.01557 +Start training Epoch 1874... +Train. Iter 1874 : Commit. 0.00002 PPL. 949.62 Recons. 0.01561 +Start training Epoch 1875... +Train. Iter 1875 : Commit. 0.00002 PPL. 950.51 Recons. 0.01558 +Start training Epoch 1876... +Train. Iter 1876 : Commit. 0.00002 PPL. 949.05 Recons. 0.01574 +Start training Epoch 1877... +Train. Iter 1877 : Commit. 0.00002 PPL. 953.26 Recons. 0.01557 +Start training Epoch 1878... +Train. Iter 1878 : Commit. 0.00002 PPL. 949.23 Recons. 0.01555 +Start training Epoch 1879... +Train. Iter 1879 : Commit. 0.00002 PPL. 948.11 Recons. 0.01565 +Start training Epoch 1880... +Train. Iter 1880 : Commit. 0.00002 PPL. 951.27 Recons. 0.01562 +Check if save...? +Start training Epoch 1881... +Train. Iter 1881 : Commit. 0.00002 PPL. 950.09 Recons. 0.01559 +Start training Epoch 1882... +Train. Iter 1882 : Commit. 0.00002 PPL. 955.09 Recons. 0.01561 +Start training Epoch 1883... +Train. Iter 1883 : Commit. 0.00002 PPL. 958.26 Recons. 0.01557 +Start training Epoch 1884... +Train. Iter 1884 : Commit. 0.00002 PPL. 960.10 Recons. 0.01564 +Start training Epoch 1885... +Train. Iter 1885 : Commit. 0.00002 PPL. 955.70 Recons. 0.01555 +Start training Epoch 1886... +Train. Iter 1886 : Commit. 0.00002 PPL. 954.17 Recons. 0.01571 +Start training Epoch 1887... +Train. Iter 1887 : Commit. 0.00002 PPL. 950.22 Recons. 0.01557 +Start training Epoch 1888... +Train. Iter 1888 : Commit. 0.00002 PPL. 950.41 Recons. 0.01552 +Start training Epoch 1889... +Train. Iter 1889 : Commit. 0.00002 PPL. 950.72 Recons. 0.01556 +Start training Epoch 1890... +Train. Iter 1890 : Commit. 0.00002 PPL. 957.66 Recons. 0.01564 +Check if save...? +Start training Epoch 1891... +Train. Iter 1891 : Commit. 0.00002 PPL. 956.37 Recons. 0.01553 +Start training Epoch 1892... +Train. Iter 1892 : Commit. 0.00002 PPL. 953.82 Recons. 0.01553 +Start training Epoch 1893... +Train. Iter 1893 : Commit. 0.00002 PPL. 953.56 Recons. 0.01555 +Start training Epoch 1894... +Train. Iter 1894 : Commit. 0.00002 PPL. 954.33 Recons. 0.01568 +Start training Epoch 1895... +Train. Iter 1895 : Commit. 0.00002 PPL. 955.11 Recons. 0.01568 +Start training Epoch 1896... +Train. Iter 1896 : Commit. 0.00002 PPL. 951.24 Recons. 0.01562 +Start training Epoch 1897... +Train. Iter 1897 : Commit. 0.00002 PPL. 957.44 Recons. 0.01556 +Start training Epoch 1898... +Train. Iter 1898 : Commit. 0.00002 PPL. 953.74 Recons. 0.01559 +Start training Epoch 1899... +Train. Iter 1899 : Commit. 0.00002 PPL. 952.86 Recons. 0.01558 +Start training Epoch 1900... +Train. Iter 1900 : Commit. 0.00002 PPL. 950.94 Recons. 0.01550 +Check if save...? +----saved---- +Start training Epoch 1901... +Train. Iter 1901 : Commit. 0.00002 PPL. 951.39 Recons. 0.01558 +Start training Epoch 1902... +Train. Iter 1902 : Commit. 0.00002 PPL. 958.71 Recons. 0.01563 +Start training Epoch 1903... +Train. Iter 1903 : Commit. 0.00002 PPL. 953.45 Recons. 0.01554 +Start training Epoch 1904... +Train. Iter 1904 : Commit. 0.00002 PPL. 952.22 Recons. 0.01559 +Start training Epoch 1905... +Train. Iter 1905 : Commit. 0.00002 PPL. 953.30 Recons. 0.01556 +Start training Epoch 1906... +Train. Iter 1906 : Commit. 0.00002 PPL. 953.16 Recons. 0.01562 +Start training Epoch 1907... +Train. Iter 1907 : Commit. 0.00002 PPL. 953.15 Recons. 0.01553 +Start training Epoch 1908... +Train. Iter 1908 : Commit. 0.00002 PPL. 956.33 Recons. 0.01569 +Start training Epoch 1909... +Train. Iter 1909 : Commit. 0.00002 PPL. 953.56 Recons. 0.01556 +Start training Epoch 1910... +Train. Iter 1910 : Commit. 0.00002 PPL. 953.21 Recons. 0.01557 +Check if save...? +Start training Epoch 1911... +Train. Iter 1911 : Commit. 0.00002 PPL. 953.50 Recons. 0.01559 +Start training Epoch 1912... +Train. Iter 1912 : Commit. 0.00002 PPL. 955.00 Recons. 0.01555 +Start training Epoch 1913... +Train. Iter 1913 : Commit. 0.00002 PPL. 954.00 Recons. 0.01553 +Start training Epoch 1914... +Train. Iter 1914 : Commit. 0.00002 PPL. 950.49 Recons. 0.01561 +Start training Epoch 1915... +Train. Iter 1915 : Commit. 0.00002 PPL. 948.27 Recons. 0.01557 +Start training Epoch 1916... +Train. Iter 1916 : Commit. 0.00002 PPL. 950.01 Recons. 0.01562 +Start training Epoch 1917... +Train. Iter 1917 : Commit. 0.00002 PPL. 951.58 Recons. 0.01553 +Start training Epoch 1918... +Train. Iter 1918 : Commit. 0.00002 PPL. 959.08 Recons. 0.01560 +Start training Epoch 1919... +Train. Iter 1919 : Commit. 0.00002 PPL. 958.15 Recons. 0.01562 +Start training Epoch 1920... +Train. Iter 1920 : Commit. 0.00002 PPL. 953.55 Recons. 0.01561 +Check if save...? +Start training Epoch 1921... +Train. Iter 1921 : Commit. 0.00002 PPL. 950.73 Recons. 0.01570 +Start training Epoch 1922... +Train. Iter 1922 : Commit. 0.00002 PPL. 948.71 Recons. 0.01553 +Start training Epoch 1923... +Train. Iter 1923 : Commit. 0.00002 PPL. 951.36 Recons. 0.01553 +Start training Epoch 1924... +Train. Iter 1924 : Commit. 0.00002 PPL. 952.42 Recons. 0.01556 +Start training Epoch 1925... +Train. Iter 1925 : Commit. 0.00002 PPL. 952.91 Recons. 0.01564 +Start training Epoch 1926... +Train. Iter 1926 : Commit. 0.00002 PPL. 948.45 Recons. 0.01553 +Start training Epoch 1927... +Train. Iter 1927 : Commit. 0.00002 PPL. 947.73 Recons. 0.01557 +Start training Epoch 1928... +Train. Iter 1928 : Commit. 0.00002 PPL. 952.14 Recons. 0.01556 +Start training Epoch 1929... +Train. Iter 1929 : Commit. 0.00002 PPL. 950.64 Recons. 0.01558 +Start training Epoch 1930... +Train. Iter 1930 : Commit. 0.00002 PPL. 949.44 Recons. 0.01548 +Check if save...? +----saved---- +Start training Epoch 1931... +Train. Iter 1931 : Commit. 0.00002 PPL. 946.33 Recons. 0.01552 +Start training Epoch 1932... +Train. Iter 1932 : Commit. 0.00002 PPL. 947.53 Recons. 0.01552 +Start training Epoch 1933... +Train. Iter 1933 : Commit. 0.00002 PPL. 945.83 Recons. 0.01553 +Start training Epoch 1934... +Train. Iter 1934 : Commit. 0.00002 PPL. 946.34 Recons. 0.01551 +Start training Epoch 1935... +Train. Iter 1935 : Commit. 0.00002 PPL. 946.28 Recons. 0.01553 +Start training Epoch 1936... +Train. Iter 1936 : Commit. 0.00002 PPL. 950.84 Recons. 0.01552 +Start training Epoch 1937... +Train. Iter 1937 : Commit. 0.00002 PPL. 952.46 Recons. 0.01555 +Start training Epoch 1938... +Train. Iter 1938 : Commit. 0.00002 PPL. 947.76 Recons. 0.01547 +Start training Epoch 1939... +Train. Iter 1939 : Commit. 0.00002 PPL. 951.45 Recons. 0.01561 +Start training Epoch 1940... +Train. Iter 1940 : Commit. 0.00002 PPL. 961.79 Recons. 0.01553 +Check if save...? +Start training Epoch 1941... +Train. Iter 1941 : Commit. 0.00002 PPL. 957.41 Recons. 0.01552 +Start training Epoch 1942... +Train. Iter 1942 : Commit. 0.00002 PPL. 955.13 Recons. 0.01547 +Start training Epoch 1943... +Train. Iter 1943 : Commit. 0.00002 PPL. 951.81 Recons. 0.01554 +Start training Epoch 1944... +Train. Iter 1944 : Commit. 0.00002 PPL. 953.15 Recons. 0.01551 +Start training Epoch 1945... +Train. Iter 1945 : Commit. 0.00002 PPL. 949.80 Recons. 0.01554 +Start training Epoch 1946... +Train. Iter 1946 : Commit. 0.00002 PPL. 950.43 Recons. 0.01555 +Start training Epoch 1947... +Train. Iter 1947 : Commit. 0.00002 PPL. 949.66 Recons. 0.01581 +Start training Epoch 1948... +Train. Iter 1948 : Commit. 0.00002 PPL. 952.38 Recons. 0.01550 +Start training Epoch 1949... +Train. Iter 1949 : Commit. 0.00002 PPL. 953.82 Recons. 0.01557 +Start training Epoch 1950... +Train. Iter 1950 : Commit. 0.00002 PPL. 959.80 Recons. 0.01562 +Check if save...? +Start training Epoch 1951... +Train. Iter 1951 : Commit. 0.00002 PPL. 964.89 Recons. 0.01570 +Start training Epoch 1952... +Train. Iter 1952 : Commit. 0.00002 PPL. 960.41 Recons. 0.01554 +Start training Epoch 1953... +Train. Iter 1953 : Commit. 0.00002 PPL. 957.52 Recons. 0.01548 +Start training Epoch 1954... +Train. Iter 1954 : Commit. 0.00002 PPL. 951.76 Recons. 0.01565 +Start training Epoch 1955... +Train. Iter 1955 : Commit. 0.00002 PPL. 951.97 Recons. 0.01552 +Start training Epoch 1956... +Train. Iter 1956 : Commit. 0.00002 PPL. 951.69 Recons. 0.01546 +Start training Epoch 1957... +Train. Iter 1957 : Commit. 0.00002 PPL. 953.29 Recons. 0.01554 +Start training Epoch 1958... +Train. Iter 1958 : Commit. 0.00002 PPL. 951.23 Recons. 0.01551 +Start training Epoch 1959... +Train. Iter 1959 : Commit. 0.00002 PPL. 957.17 Recons. 0.01557 +Start training Epoch 1960... +Train. Iter 1960 : Commit. 0.00002 PPL. 955.81 Recons. 0.01553 +Check if save...? +Start training Epoch 1961... +Train. Iter 1961 : Commit. 0.00002 PPL. 952.32 Recons. 0.01545 +Start training Epoch 1962... +Train. Iter 1962 : Commit. 0.00002 PPL. 950.58 Recons. 0.01543 +Start training Epoch 1963... +Train. Iter 1963 : Commit. 0.00002 PPL. 950.28 Recons. 0.01545 +Start training Epoch 1964... +Train. Iter 1964 : Commit. 0.00002 PPL. 948.30 Recons. 0.01544 +Start training Epoch 1965... +Train. Iter 1965 : Commit. 0.00002 PPL. 948.53 Recons. 0.01551 +Start training Epoch 1966... +Train. Iter 1966 : Commit. 0.00002 PPL. 949.29 Recons. 0.01545 +Start training Epoch 1967... +Train. Iter 1967 : Commit. 0.00002 PPL. 952.14 Recons. 0.01546 +Start training Epoch 1968... +Train. Iter 1968 : Commit. 0.00002 PPL. 954.50 Recons. 0.01548 +Start training Epoch 1969... +Train. Iter 1969 : Commit. 0.00002 PPL. 950.56 Recons. 0.01547 +Start training Epoch 1970... +Train. Iter 1970 : Commit. 0.00002 PPL. 947.43 Recons. 0.01550 +Check if save...? +Start training Epoch 1971... +Train. Iter 1971 : Commit. 0.00002 PPL. 949.25 Recons. 0.01546 +Start training Epoch 1972... +Train. Iter 1972 : Commit. 0.00002 PPL. 946.09 Recons. 0.01549 +Start training Epoch 1973... +Train. Iter 1973 : Commit. 0.00002 PPL. 949.48 Recons. 0.01548 +Start training Epoch 1974... +Train. Iter 1974 : Commit. 0.00002 PPL. 949.25 Recons. 0.01545 +Start training Epoch 1975... +Train. Iter 1975 : Commit. 0.00002 PPL. 945.52 Recons. 0.01550 +Start training Epoch 1976... +Train. Iter 1976 : Commit. 0.00002 PPL. 952.21 Recons. 0.01553 +Start training Epoch 1977... +Train. Iter 1977 : Commit. 0.00002 PPL. 949.17 Recons. 0.01550 +Start training Epoch 1978... +Train. Iter 1978 : Commit. 0.00002 PPL. 948.61 Recons. 0.01549 +Start training Epoch 1979... +Train. Iter 1979 : Commit. 0.00002 PPL. 945.98 Recons. 0.01543 +Start training Epoch 1980... +Train. Iter 1980 : Commit. 0.00002 PPL. 956.21 Recons. 0.01548 +Check if save...? +----saved---- +Start training Epoch 1981... +Train. Iter 1981 : Commit. 0.00002 PPL. 958.55 Recons. 0.01551 +Start training Epoch 1982... +Train. Iter 1982 : Commit. 0.00002 PPL. 955.06 Recons. 0.01546 +Start training Epoch 1983... +Train. Iter 1983 : Commit. 0.00002 PPL. 954.49 Recons. 0.01556 +Start training Epoch 1984... +Train. Iter 1984 : Commit. 0.00002 PPL. 951.98 Recons. 0.01535 +Start training Epoch 1985... +Train. Iter 1985 : Commit. 0.00002 PPL. 953.92 Recons. 0.01553 +Start training Epoch 1986... +Train. Iter 1986 : Commit. 0.00002 PPL. 952.90 Recons. 0.01547 +Start training Epoch 1987... +Train. Iter 1987 : Commit. 0.00002 PPL. 953.07 Recons. 0.01549 +Start training Epoch 1988... +Train. Iter 1988 : Commit. 0.00002 PPL. 952.76 Recons. 0.01538 +Start training Epoch 1989... +Train. Iter 1989 : Commit. 0.00002 PPL. 952.47 Recons. 0.01557 +Start training Epoch 1990... +Train. Iter 1990 : Commit. 0.00002 PPL. 952.50 Recons. 0.01536 +Check if save...? +----saved---- +Start training Epoch 1991... +Train. Iter 1991 : Commit. 0.00002 PPL. 951.07 Recons. 0.01543 +Start training Epoch 1992... +Train. Iter 1992 : Commit. 0.00002 PPL. 950.14 Recons. 0.01547 +Start training Epoch 1993... +Train. Iter 1993 : Commit. 0.00002 PPL. 950.31 Recons. 0.01548 +Start training Epoch 1994... +Train. Iter 1994 : Commit. 0.00002 PPL. 953.61 Recons. 0.01553 +Start training Epoch 1995... +Train. Iter 1995 : Commit. 0.00002 PPL. 949.91 Recons. 0.01546 +Start training Epoch 1996... +Train. Iter 1996 : Commit. 0.00002 PPL. 949.55 Recons. 0.01550 +Start training Epoch 1997... +Train. Iter 1997 : Commit. 0.00002 PPL. 947.69 Recons. 0.01542 +Start training Epoch 1998... +Train. Iter 1998 : Commit. 0.00002 PPL. 947.31 Recons. 0.01546 +Start training Epoch 1999... +Train. Iter 1999 : Commit. 0.00002 PPL. 946.46 Recons. 0.01543 +Start training Epoch 2000... +Train. Iter 2000 : Commit. 0.00002 PPL. 946.23 Recons. 0.01540 +Check if save...? +Start training Epoch 2001... +Train. Iter 2001 : Commit. 0.00002 PPL. 948.96 Recons. 0.01547 +Start training Epoch 2002... +Train. Iter 2002 : Commit. 0.00002 PPL. 951.18 Recons. 0.01556 +Start training Epoch 2003... +Train. Iter 2003 : Commit. 0.00002 PPL. 946.39 Recons. 0.01541 +Start training Epoch 2004... +Train. Iter 2004 : Commit. 0.00002 PPL. 947.25 Recons. 0.01540 +Start training Epoch 2005... +Train. Iter 2005 : Commit. 0.00002 PPL. 948.65 Recons. 0.01545 +Start training Epoch 2006... +Train. Iter 2006 : Commit. 0.00002 PPL. 949.96 Recons. 0.01536 +Start training Epoch 2007... +Train. Iter 2007 : Commit. 0.00002 PPL. 949.30 Recons. 0.01543 +Start training Epoch 2008... +Train. Iter 2008 : Commit. 0.00002 PPL. 949.29 Recons. 0.01544 +Start training Epoch 2009... +Train. Iter 2009 : Commit. 0.00002 PPL. 952.44 Recons. 0.01542 +Start training Epoch 2010... +Train. Iter 2010 : Commit. 0.00002 PPL. 950.23 Recons. 0.01536 +Check if save...? +----saved---- +Start training Epoch 2011... +Train. Iter 2011 : Commit. 0.00002 PPL. 946.98 Recons. 0.01542 +Start training Epoch 2012... +Train. Iter 2012 : Commit. 0.00002 PPL. 948.05 Recons. 0.01550 +Start training Epoch 2013... +Train. Iter 2013 : Commit. 0.00002 PPL. 946.48 Recons. 0.01536 +Start training Epoch 2014... +Train. Iter 2014 : Commit. 0.00002 PPL. 949.20 Recons. 0.01542 +Start training Epoch 2015... +Train. Iter 2015 : Commit. 0.00002 PPL. 948.77 Recons. 0.01541 +Start training Epoch 2016... +Train. Iter 2016 : Commit. 0.00002 PPL. 955.70 Recons. 0.01544 +Start training Epoch 2017... +Train. Iter 2017 : Commit. 0.00002 PPL. 958.05 Recons. 0.01549 +Start training Epoch 2018... +Train. Iter 2018 : Commit. 0.00002 PPL. 954.34 Recons. 0.01542 +Start training Epoch 2019... +Train. Iter 2019 : Commit. 0.00002 PPL. 948.94 Recons. 0.01539 +Start training Epoch 2020... +Train. Iter 2020 : Commit. 0.00002 PPL. 946.05 Recons. 0.01538 +Check if save...? +Start training Epoch 2021... +Train. Iter 2021 : Commit. 0.00002 PPL. 949.57 Recons. 0.01539 +Start training Epoch 2022... +Train. Iter 2022 : Commit. 0.00002 PPL. 946.50 Recons. 0.01542 +Start training Epoch 2023... +Train. Iter 2023 : Commit. 0.00002 PPL. 949.28 Recons. 0.01536 +Start training Epoch 2024... +Train. Iter 2024 : Commit. 0.00002 PPL. 952.33 Recons. 0.01537 +Start training Epoch 2025... +Train. Iter 2025 : Commit. 0.00002 PPL. 947.05 Recons. 0.01543 +Start training Epoch 2026... +Train. Iter 2026 : Commit. 0.00002 PPL. 947.01 Recons. 0.01545 +Start training Epoch 2027... +Train. Iter 2027 : Commit. 0.00002 PPL. 945.72 Recons. 0.01551 +Start training Epoch 2028... +Train. Iter 2028 : Commit. 0.00002 PPL. 948.79 Recons. 0.01559 +Start training Epoch 2029... +Train. Iter 2029 : Commit. 0.00002 PPL. 946.18 Recons. 0.01542 +Start training Epoch 2030... +Train. Iter 2030 : Commit. 0.00002 PPL. 945.43 Recons. 0.01551 +Check if save...? +Start training Epoch 2031... +Train. Iter 2031 : Commit. 0.00002 PPL. 943.56 Recons. 0.01533 +Start training Epoch 2032... +Train. Iter 2032 : Commit. 0.00002 PPL. 946.17 Recons. 0.01543 +Start training Epoch 2033... +Train. Iter 2033 : Commit. 0.00002 PPL. 945.44 Recons. 0.01540 +Start training Epoch 2034... +Train. Iter 2034 : Commit. 0.00002 PPL. 944.09 Recons. 0.01541 +Start training Epoch 2035... +Train. Iter 2035 : Commit. 0.00002 PPL. 940.74 Recons. 0.01545 +Start training Epoch 2036... +Train. Iter 2036 : Commit. 0.00002 PPL. 943.34 Recons. 0.01532 +Start training Epoch 2037... +Train. Iter 2037 : Commit. 0.00002 PPL. 941.44 Recons. 0.01544 +Start training Epoch 2038... +Train. Iter 2038 : Commit. 0.00002 PPL. 943.53 Recons. 0.01537 +Start training Epoch 2039... +Train. Iter 2039 : Commit. 0.00002 PPL. 943.43 Recons. 0.01535 +Start training Epoch 2040... +Train. Iter 2040 : Commit. 0.00002 PPL. 944.15 Recons. 0.01539 +Check if save...? +Start training Epoch 2041... +Train. Iter 2041 : Commit. 0.00002 PPL. 950.53 Recons. 0.01537 +Start training Epoch 2042... +Train. Iter 2042 : Commit. 0.00002 PPL. 952.13 Recons. 0.01531 +Start training Epoch 2043... +Train. Iter 2043 : Commit. 0.00002 PPL. 952.50 Recons. 0.01541 +Start training Epoch 2044... +Train. Iter 2044 : Commit. 0.00002 PPL. 947.42 Recons. 0.01551 +Start training Epoch 2045... +Train. Iter 2045 : Commit. 0.00002 PPL. 946.25 Recons. 0.01535 +Start training Epoch 2046... +Train. Iter 2046 : Commit. 0.00002 PPL. 943.20 Recons. 0.01540 +Start training Epoch 2047... +Train. Iter 2047 : Commit. 0.00002 PPL. 946.80 Recons. 0.01535 +Start training Epoch 2048... +Train. Iter 2048 : Commit. 0.00002 PPL. 945.70 Recons. 0.01556 +Start training Epoch 2049... +Train. Iter 2049 : Commit. 0.00002 PPL. 950.37 Recons. 0.01549 +Start training Epoch 2050... +Train. Iter 2050 : Commit. 0.00002 PPL. 946.48 Recons. 0.01533 +Check if save...? +----saved---- +Start training Epoch 2051... +Train. Iter 2051 : Commit. 0.00002 PPL. 945.64 Recons. 0.01545 +Start training Epoch 2052... +Train. Iter 2052 : Commit. 0.00002 PPL. 942.94 Recons. 0.01541 +Start training Epoch 2053... +Train. Iter 2053 : Commit. 0.00002 PPL. 944.84 Recons. 0.01538 +Start training Epoch 2054... +Train. Iter 2054 : Commit. 0.00002 PPL. 946.02 Recons. 0.01539 +Start training Epoch 2055... +Train. Iter 2055 : Commit. 0.00002 PPL. 948.46 Recons. 0.01531 +Start training Epoch 2056... +Train. Iter 2056 : Commit. 0.00002 PPL. 947.01 Recons. 0.01541 +Start training Epoch 2057... +Train. Iter 2057 : Commit. 0.00002 PPL. 946.72 Recons. 0.01537 +Start training Epoch 2058... +Train. Iter 2058 : Commit. 0.00002 PPL. 945.15 Recons. 0.01537 +Start training Epoch 2059... +Train. Iter 2059 : Commit. 0.00002 PPL. 946.24 Recons. 0.01536 +Start training Epoch 2060... +Train. Iter 2060 : Commit. 0.00002 PPL. 946.46 Recons. 0.01541 +Check if save...? +Start training Epoch 2061... +Train. Iter 2061 : Commit. 0.00002 PPL. 947.54 Recons. 0.01534 +Start training Epoch 2062... +Train. Iter 2062 : Commit. 0.00002 PPL. 946.78 Recons. 0.01539 +Start training Epoch 2063... +Train. Iter 2063 : Commit. 0.00002 PPL. 949.30 Recons. 0.01537 +Start training Epoch 2064... +Train. Iter 2064 : Commit. 0.00002 PPL. 949.64 Recons. 0.01541 +Start training Epoch 2065... +Train. Iter 2065 : Commit. 0.00002 PPL. 948.55 Recons. 0.01543 +Start training Epoch 2066... +Train. Iter 2066 : Commit. 0.00002 PPL. 955.84 Recons. 0.01529 +Start training Epoch 2067... +Train. Iter 2067 : Commit. 0.00002 PPL. 954.35 Recons. 0.01533 +Start training Epoch 2068... +Train. Iter 2068 : Commit. 0.00002 PPL. 950.23 Recons. 0.01531 +Start training Epoch 2069... +Train. Iter 2069 : Commit. 0.00002 PPL. 947.15 Recons. 0.01534 +Start training Epoch 2070... +Train. Iter 2070 : Commit. 0.00002 PPL. 950.33 Recons. 0.01535 +Check if save...? +Start training Epoch 2071... +Train. Iter 2071 : Commit. 0.00002 PPL. 949.97 Recons. 0.01534 +Start training Epoch 2072... +Train. Iter 2072 : Commit. 0.00002 PPL. 958.94 Recons. 0.01542 +Start training Epoch 2073... +Train. Iter 2073 : Commit. 0.00002 PPL. 957.13 Recons. 0.01533 +Start training Epoch 2074... +Train. Iter 2074 : Commit. 0.00002 PPL. 949.26 Recons. 0.01537 +Start training Epoch 2075... +Train. Iter 2075 : Commit. 0.00002 PPL. 948.17 Recons. 0.01535 +Start training Epoch 2076... +Train. Iter 2076 : Commit. 0.00002 PPL. 950.43 Recons. 0.01538 +Start training Epoch 2077... +Train. Iter 2077 : Commit. 0.00002 PPL. 952.93 Recons. 0.01531 +Start training Epoch 2078... +Train. Iter 2078 : Commit. 0.00002 PPL. 953.03 Recons. 0.01530 +Start training Epoch 2079... +Train. Iter 2079 : Commit. 0.00002 PPL. 949.39 Recons. 0.01535 +Start training Epoch 2080... +Train. Iter 2080 : Commit. 0.00002 PPL. 949.90 Recons. 0.01528 +Check if save...? +----saved---- +Start training Epoch 2081... +Train. Iter 2081 : Commit. 0.00002 PPL. 946.00 Recons. 0.01531 +Start training Epoch 2082... +Train. Iter 2082 : Commit. 0.00002 PPL. 944.32 Recons. 0.01532 +Start training Epoch 2083... +Train. Iter 2083 : Commit. 0.00002 PPL. 944.92 Recons. 0.01534 +Start training Epoch 2084... +Train. Iter 2084 : Commit. 0.00002 PPL. 944.64 Recons. 0.01530 +Start training Epoch 2085... +Train. Iter 2085 : Commit. 0.00002 PPL. 952.34 Recons. 0.01552 +Start training Epoch 2086... +Train. Iter 2086 : Commit. 0.00002 PPL. 949.60 Recons. 0.01531 +Start training Epoch 2087... +Train. Iter 2087 : Commit. 0.00002 PPL. 944.18 Recons. 0.01530 +Start training Epoch 2088... +Train. Iter 2088 : Commit. 0.00002 PPL. 942.63 Recons. 0.01532 +Start training Epoch 2089... +Train. Iter 2089 : Commit. 0.00002 PPL. 945.17 Recons. 0.01532 +Start training Epoch 2090... +Train. Iter 2090 : Commit. 0.00002 PPL. 943.69 Recons. 0.01528 +Check if save...? +----saved---- +Start training Epoch 2091... +Train. Iter 2091 : Commit. 0.00002 PPL. 944.67 Recons. 0.01528 +Start training Epoch 2092... +Train. Iter 2092 : Commit. 0.00002 PPL. 944.61 Recons. 0.01528 +Start training Epoch 2093... +Train. Iter 2093 : Commit. 0.00002 PPL. 942.55 Recons. 0.01531 +Start training Epoch 2094... +Train. Iter 2094 : Commit. 0.00002 PPL. 953.94 Recons. 0.01535 +Start training Epoch 2095... +Train. Iter 2095 : Commit. 0.00002 PPL. 959.94 Recons. 0.01528 +Start training Epoch 2096... +Train. Iter 2096 : Commit. 0.00002 PPL. 954.61 Recons. 0.01528 +Start training Epoch 2097... +Train. Iter 2097 : Commit. 0.00002 PPL. 953.95 Recons. 0.01535 +Start training Epoch 2098... +Train. Iter 2098 : Commit. 0.00002 PPL. 950.72 Recons. 0.01531 +Start training Epoch 2099... +Train. Iter 2099 : Commit. 0.00002 PPL. 948.00 Recons. 0.01536 +Start training Epoch 2100... +Train. Iter 2100 : Commit. 0.00002 PPL. 949.64 Recons. 0.01528 +Check if save...? +----saved---- +Start training Epoch 2101... +Train. Iter 2101 : Commit. 0.00002 PPL. 949.14 Recons. 0.01534 +Start training Epoch 2102... +Train. Iter 2102 : Commit. 0.00002 PPL. 950.30 Recons. 0.01525 +Start training Epoch 2103... +Train. Iter 2103 : Commit. 0.00002 PPL. 947.01 Recons. 0.01533 +Start training Epoch 2104... +Train. Iter 2104 : Commit. 0.00002 PPL. 949.10 Recons. 0.01525 +Start training Epoch 2105... +Train. Iter 2105 : Commit. 0.00002 PPL. 947.14 Recons. 0.01528 +Start training Epoch 2106... +Train. Iter 2106 : Commit. 0.00002 PPL. 946.04 Recons. 0.01526 +Start training Epoch 2107... +Train. Iter 2107 : Commit. 0.00002 PPL. 945.82 Recons. 0.01527 +Start training Epoch 2108... +Train. Iter 2108 : Commit. 0.00002 PPL. 944.91 Recons. 0.01526 +Start training Epoch 2109... +Train. Iter 2109 : Commit. 0.00002 PPL. 947.03 Recons. 0.01529 +Start training Epoch 2110... +Train. Iter 2110 : Commit. 0.00002 PPL. 946.29 Recons. 0.01529 +Check if save...? +Start training Epoch 2111... +Train. Iter 2111 : Commit. 0.00002 PPL. 950.94 Recons. 0.01541 +Start training Epoch 2112... +Train. Iter 2112 : Commit. 0.00002 PPL. 947.84 Recons. 0.01525 +Start training Epoch 2113... +Train. Iter 2113 : Commit. 0.00002 PPL. 944.28 Recons. 0.01527 +Start training Epoch 2114... +Train. Iter 2114 : Commit. 0.00002 PPL. 948.09 Recons. 0.01534 +Start training Epoch 2115... +Train. Iter 2115 : Commit. 0.00002 PPL. 947.17 Recons. 0.01530 +Start training Epoch 2116... +Train. Iter 2116 : Commit. 0.00002 PPL. 948.14 Recons. 0.01519 +Start training Epoch 2117... +Train. Iter 2117 : Commit. 0.00002 PPL. 947.73 Recons. 0.01522 +Start training Epoch 2118... +Train. Iter 2118 : Commit. 0.00002 PPL. 948.91 Recons. 0.01523 +Start training Epoch 2119... +Train. Iter 2119 : Commit. 0.00002 PPL. 948.91 Recons. 0.01533 +Start training Epoch 2120... +Train. Iter 2120 : Commit. 0.00002 PPL. 951.81 Recons. 0.01523 +Check if save...? +----saved---- +Start training Epoch 2121... +Train. Iter 2121 : Commit. 0.00002 PPL. 948.53 Recons. 0.01534 +Start training Epoch 2122... +Train. Iter 2122 : Commit. 0.00002 PPL. 947.97 Recons. 0.01524 +Start training Epoch 2123... +Train. Iter 2123 : Commit. 0.00002 PPL. 947.85 Recons. 0.01544 +Start training Epoch 2124... +Train. Iter 2124 : Commit. 0.00002 PPL. 947.96 Recons. 0.01542 +Start training Epoch 2125... +Train. Iter 2125 : Commit. 0.00002 PPL. 954.17 Recons. 0.01529 +Start training Epoch 2126... +Train. Iter 2126 : Commit. 0.00002 PPL. 953.95 Recons. 0.01527 +Start training Epoch 2127... +Train. Iter 2127 : Commit. 0.00002 PPL. 956.60 Recons. 0.01529 +Start training Epoch 2128... +Train. Iter 2128 : Commit. 0.00002 PPL. 957.70 Recons. 0.01529 +Start training Epoch 2129... +Train. Iter 2129 : Commit. 0.00002 PPL. 951.34 Recons. 0.01528 +Start training Epoch 2130... +Train. Iter 2130 : Commit. 0.00002 PPL. 950.58 Recons. 0.01537 +Check if save...? +Start training Epoch 2131... +Train. Iter 2131 : Commit. 0.00002 PPL. 956.22 Recons. 0.01525 +Start training Epoch 2132... +Train. Iter 2132 : Commit. 0.00002 PPL. 952.50 Recons. 0.01523 +Start training Epoch 2133... +Train. Iter 2133 : Commit. 0.00002 PPL. 949.68 Recons. 0.01522 +Start training Epoch 2134... +Train. Iter 2134 : Commit. 0.00002 PPL. 953.25 Recons. 0.01533 +Start training Epoch 2135... +Train. Iter 2135 : Commit. 0.00002 PPL. 953.63 Recons. 0.01528 +Start training Epoch 2136... +Train. Iter 2136 : Commit. 0.00002 PPL. 946.84 Recons. 0.01523 +Start training Epoch 2137... +Train. Iter 2137 : Commit. 0.00002 PPL. 949.50 Recons. 0.01527 +Start training Epoch 2138... +Train. Iter 2138 : Commit. 0.00002 PPL. 948.81 Recons. 0.01517 +Start training Epoch 2139... +Train. Iter 2139 : Commit. 0.00002 PPL. 948.56 Recons. 0.01532 +Start training Epoch 2140... +Train. Iter 2140 : Commit. 0.00002 PPL. 946.71 Recons. 0.01533 +Check if save...? +Start training Epoch 2141... +Train. Iter 2141 : Commit. 0.00002 PPL. 947.43 Recons. 0.01522 +Start training Epoch 2142... +Train. Iter 2142 : Commit. 0.00002 PPL. 946.76 Recons. 0.01526 +Start training Epoch 2143... +Train. Iter 2143 : Commit. 0.00002 PPL. 946.34 Recons. 0.01529 +Start training Epoch 2144... +Train. Iter 2144 : Commit. 0.00002 PPL. 945.04 Recons. 0.01520 +Start training Epoch 2145... +Train. Iter 2145 : Commit. 0.00002 PPL. 945.06 Recons. 0.01524 +Start training Epoch 2146... +Train. Iter 2146 : Commit. 0.00002 PPL. 946.41 Recons. 0.01524 +Start training Epoch 2147... +Train. Iter 2147 : Commit. 0.00002 PPL. 944.63 Recons. 0.01520 +Start training Epoch 2148... +Train. Iter 2148 : Commit. 0.00002 PPL. 943.82 Recons. 0.01521 +Start training Epoch 2149... +Train. Iter 2149 : Commit. 0.00002 PPL. 941.22 Recons. 0.01523 +Start training Epoch 2150... +Train. Iter 2150 : Commit. 0.00002 PPL. 945.69 Recons. 0.01515 +Check if save...? +----saved---- +Start training Epoch 2151... +Train. Iter 2151 : Commit. 0.00002 PPL. 945.92 Recons. 0.01522 +Start training Epoch 2152... +Train. Iter 2152 : Commit. 0.00002 PPL. 950.17 Recons. 0.01520 +Start training Epoch 2153... +Train. Iter 2153 : Commit. 0.00002 PPL. 948.72 Recons. 0.01524 +Start training Epoch 2154... +Train. Iter 2154 : Commit. 0.00002 PPL. 947.51 Recons. 0.01520 +Start training Epoch 2155... +Train. Iter 2155 : Commit. 0.00002 PPL. 952.14 Recons. 0.01543 +Start training Epoch 2156... +Train. Iter 2156 : Commit. 0.00002 PPL. 953.06 Recons. 0.01526 +Start training Epoch 2157... +Train. Iter 2157 : Commit. 0.00002 PPL. 946.98 Recons. 0.01539 +Start training Epoch 2158... +Train. Iter 2158 : Commit. 0.00002 PPL. 950.44 Recons. 0.01538 +Start training Epoch 2159... +Train. Iter 2159 : Commit. 0.00002 PPL. 950.17 Recons. 0.01532 +Start training Epoch 2160... +Train. Iter 2160 : Commit. 0.00002 PPL. 945.63 Recons. 0.01532 +Check if save...? +Start training Epoch 2161... +Train. Iter 2161 : Commit. 0.00002 PPL. 946.64 Recons. 0.01538 +Start training Epoch 2162... +Train. Iter 2162 : Commit. 0.00002 PPL. 945.99 Recons. 0.01552 +Start training Epoch 2163... +Train. Iter 2163 : Commit. 0.00002 PPL. 949.21 Recons. 0.01545 +Start training Epoch 2164... +Train. Iter 2164 : Commit. 0.00002 PPL. 949.73 Recons. 0.01535 +Start training Epoch 2165... +Train. Iter 2165 : Commit. 0.00002 PPL. 947.28 Recons. 0.01529 +Start training Epoch 2166... +Train. Iter 2166 : Commit. 0.00002 PPL. 947.63 Recons. 0.01529 +Start training Epoch 2167... +Train. Iter 2167 : Commit. 0.00002 PPL. 953.66 Recons. 0.01524 +Start training Epoch 2168... +Train. Iter 2168 : Commit. 0.00002 PPL. 951.19 Recons. 0.01523 +Start training Epoch 2169... +Train. Iter 2169 : Commit. 0.00002 PPL. 952.17 Recons. 0.01516 +Start training Epoch 2170... +Train. Iter 2170 : Commit. 0.00002 PPL. 952.45 Recons. 0.01525 +Check if save...? +Start training Epoch 2171... +Train. Iter 2171 : Commit. 0.00002 PPL. 950.97 Recons. 0.01515 +Start training Epoch 2172... +Train. Iter 2172 : Commit. 0.00002 PPL. 951.43 Recons. 0.01519 +Start training Epoch 2173... +Train. Iter 2173 : Commit. 0.00002 PPL. 951.44 Recons. 0.01523 +Start training Epoch 2174... +Train. Iter 2174 : Commit. 0.00002 PPL. 954.86 Recons. 0.01530 +Start training Epoch 2175... +Train. Iter 2175 : Commit. 0.00002 PPL. 955.34 Recons. 0.01524 +Start training Epoch 2176... +Train. Iter 2176 : Commit. 0.00002 PPL. 955.67 Recons. 0.01520 +Start training Epoch 2177... +Train. Iter 2177 : Commit. 0.00002 PPL. 955.74 Recons. 0.01521 +Start training Epoch 2178... +Train. Iter 2178 : Commit. 0.00002 PPL. 956.20 Recons. 0.01535 +Start training Epoch 2179... +Train. Iter 2179 : Commit. 0.00002 PPL. 953.73 Recons. 0.01537 +Start training Epoch 2180... +Train. Iter 2180 : Commit. 0.00002 PPL. 952.31 Recons. 0.01522 +Check if save...? +Start training Epoch 2181... +Train. Iter 2181 : Commit. 0.00002 PPL. 954.49 Recons. 0.01529 +Start training Epoch 2182... +Train. Iter 2182 : Commit. 0.00002 PPL. 956.17 Recons. 0.01526 +Start training Epoch 2183... +Train. Iter 2183 : Commit. 0.00002 PPL. 951.11 Recons. 0.01523 +Start training Epoch 2184... +Train. Iter 2184 : Commit. 0.00002 PPL. 952.61 Recons. 0.01521 +Start training Epoch 2185... +Train. Iter 2185 : Commit. 0.00002 PPL. 956.18 Recons. 0.01528 +Start training Epoch 2186... +Train. Iter 2186 : Commit. 0.00002 PPL. 951.75 Recons. 0.01519 +Start training Epoch 2187... +Train. Iter 2187 : Commit. 0.00002 PPL. 953.05 Recons. 0.01519 +Start training Epoch 2188... +Train. Iter 2188 : Commit. 0.00002 PPL. 951.66 Recons. 0.01524 +Start training Epoch 2189... +Train. Iter 2189 : Commit. 0.00002 PPL. 953.96 Recons. 0.01519 +Start training Epoch 2190... +Train. Iter 2190 : Commit. 0.00002 PPL. 954.14 Recons. 0.01522 +Check if save...? +Start training Epoch 2191... +Train. Iter 2191 : Commit. 0.00002 PPL. 952.64 Recons. 0.01521 +Start training Epoch 2192... +Train. Iter 2192 : Commit. 0.00002 PPL. 953.61 Recons. 0.01520 +Start training Epoch 2193... +Train. Iter 2193 : Commit. 0.00002 PPL. 951.77 Recons. 0.01516 +Start training Epoch 2194... +Train. Iter 2194 : Commit. 0.00002 PPL. 951.75 Recons. 0.01522 +Start training Epoch 2195... +Train. Iter 2195 : Commit. 0.00002 PPL. 948.77 Recons. 0.01523 +Start training Epoch 2196... +Train. Iter 2196 : Commit. 0.00002 PPL. 948.78 Recons. 0.01517 +Start training Epoch 2197... +Train. Iter 2197 : Commit. 0.00002 PPL. 955.04 Recons. 0.01521 +Start training Epoch 2198... +Train. Iter 2198 : Commit. 0.00002 PPL. 952.73 Recons. 0.01522 +Start training Epoch 2199... +Train. Iter 2199 : Commit. 0.00002 PPL. 953.18 Recons. 0.01521 +Start training Epoch 2200... +Train. Iter 2200 : Commit. 0.00002 PPL. 951.77 Recons. 0.01526 +Check if save...? +Start training Epoch 2201... +Train. Iter 2201 : Commit. 0.00002 PPL. 951.44 Recons. 0.01521 +Start training Epoch 2202... +Train. Iter 2202 : Commit. 0.00002 PPL. 952.78 Recons. 0.01524 +Start training Epoch 2203... +Train. Iter 2203 : Commit. 0.00002 PPL. 950.37 Recons. 0.01518 +Start training Epoch 2204... +Train. Iter 2204 : Commit. 0.00002 PPL. 950.85 Recons. 0.01523 +Start training Epoch 2205... +Train. Iter 2205 : Commit. 0.00002 PPL. 949.98 Recons. 0.01517 +Start training Epoch 2206... +Train. Iter 2206 : Commit. 0.00002 PPL. 950.63 Recons. 0.01536 +Start training Epoch 2207... +Train. Iter 2207 : Commit. 0.00002 PPL. 947.24 Recons. 0.01517 +Start training Epoch 2208... +Train. Iter 2208 : Commit. 0.00002 PPL. 950.05 Recons. 0.01517 +Start training Epoch 2209... +Train. Iter 2209 : Commit. 0.00002 PPL. 949.34 Recons. 0.01521 +Start training Epoch 2210... +Train. Iter 2210 : Commit. 0.00002 PPL. 949.22 Recons. 0.01517 +Check if save...? +Start training Epoch 2211... +Train. Iter 2211 : Commit. 0.00002 PPL. 949.86 Recons. 0.01521 +Start training Epoch 2212... +Train. Iter 2212 : Commit. 0.00002 PPL. 947.74 Recons. 0.01515 +Start training Epoch 2213... +Train. Iter 2213 : Commit. 0.00002 PPL. 950.29 Recons. 0.01515 +Start training Epoch 2214... +Train. Iter 2214 : Commit. 0.00002 PPL. 949.07 Recons. 0.01517 +Start training Epoch 2215... +Train. Iter 2215 : Commit. 0.00002 PPL. 949.23 Recons. 0.01517 +Start training Epoch 2216... +Train. Iter 2216 : Commit. 0.00002 PPL. 946.71 Recons. 0.01523 +Start training Epoch 2217... +Train. Iter 2217 : Commit. 0.00002 PPL. 950.83 Recons. 0.01520 +Start training Epoch 2218... +Train. Iter 2218 : Commit. 0.00002 PPL. 954.68 Recons. 0.01521 +Start training Epoch 2219... +Train. Iter 2219 : Commit. 0.00002 PPL. 951.43 Recons. 0.01517 +Start training Epoch 2220... +Train. Iter 2220 : Commit. 0.00002 PPL. 951.56 Recons. 0.01514 +Check if save...? +----saved---- +Start training Epoch 2221... +Train. Iter 2221 : Commit. 0.00002 PPL. 951.22 Recons. 0.01512 +Start training Epoch 2222... +Train. Iter 2222 : Commit. 0.00002 PPL. 949.60 Recons. 0.01525 +Start training Epoch 2223... +Train. Iter 2223 : Commit. 0.00002 PPL. 948.20 Recons. 0.01515 +Start training Epoch 2224... +Train. Iter 2224 : Commit. 0.00002 PPL. 950.27 Recons. 0.01515 +Start training Epoch 2225... +Train. Iter 2225 : Commit. 0.00002 PPL. 951.97 Recons. 0.01511 +Start training Epoch 2226... +Train. Iter 2226 : Commit. 0.00002 PPL. 950.12 Recons. 0.01526 +Start training Epoch 2227... +Train. Iter 2227 : Commit. 0.00002 PPL. 948.86 Recons. 0.01508 +Start training Epoch 2228... +Train. Iter 2228 : Commit. 0.00002 PPL. 949.71 Recons. 0.01512 +Start training Epoch 2229... +Train. Iter 2229 : Commit. 0.00002 PPL. 951.81 Recons. 0.01511 +Start training Epoch 2230... +Train. Iter 2230 : Commit. 0.00002 PPL. 950.66 Recons. 0.01513 +Check if save...? +----saved---- +Start training Epoch 2231... +Train. Iter 2231 : Commit. 0.00002 PPL. 951.04 Recons. 0.01520 +Start training Epoch 2232... +Train. Iter 2232 : Commit. 0.00002 PPL. 952.47 Recons. 0.01508 +Start training Epoch 2233... +Train. Iter 2233 : Commit. 0.00002 PPL. 952.74 Recons. 0.01511 +Start training Epoch 2234... +Train. Iter 2234 : Commit. 0.00002 PPL. 949.95 Recons. 0.01517 +Start training Epoch 2235... +Train. Iter 2235 : Commit. 0.00002 PPL. 952.42 Recons. 0.01511 +Start training Epoch 2236... +Train. Iter 2236 : Commit. 0.00002 PPL. 950.09 Recons. 0.01509 +Start training Epoch 2237... +Train. Iter 2237 : Commit. 0.00002 PPL. 953.18 Recons. 0.01511 +Start training Epoch 2238... +Train. Iter 2238 : Commit. 0.00002 PPL. 953.08 Recons. 0.01509 +Start training Epoch 2239... +Train. Iter 2239 : Commit. 0.00002 PPL. 952.69 Recons. 0.01511 +Start training Epoch 2240... +Train. Iter 2240 : Commit. 0.00002 PPL. 948.27 Recons. 0.01515 +Check if save...? +Start training Epoch 2241... +Train. Iter 2241 : Commit. 0.00002 PPL. 949.99 Recons. 0.01509 +Start training Epoch 2242... +Train. Iter 2242 : Commit. 0.00002 PPL. 951.10 Recons. 0.01518 +Start training Epoch 2243... +Train. Iter 2243 : Commit. 0.00002 PPL. 949.86 Recons. 0.01515 +Start training Epoch 2244... +Train. Iter 2244 : Commit. 0.00002 PPL. 949.81 Recons. 0.01512 +Start training Epoch 2245... +Train. Iter 2245 : Commit. 0.00002 PPL. 950.23 Recons. 0.01510 +Start training Epoch 2246... +Train. Iter 2246 : Commit. 0.00002 PPL. 954.41 Recons. 0.01516 +Start training Epoch 2247... +Train. Iter 2247 : Commit. 0.00002 PPL. 949.93 Recons. 0.01508 +Start training Epoch 2248... +Train. Iter 2248 : Commit. 0.00002 PPL. 951.04 Recons. 0.01515 +Start training Epoch 2249... +Train. Iter 2249 : Commit. 0.00002 PPL. 949.44 Recons. 0.01511 +Start training Epoch 2250... +Train. Iter 2250 : Commit. 0.00002 PPL. 950.65 Recons. 0.01506 +Check if save...? +----saved---- +Start training Epoch 2251... +Train. Iter 2251 : Commit. 0.00002 PPL. 952.33 Recons. 0.01512 +Start training Epoch 2252... +Train. Iter 2252 : Commit. 0.00002 PPL. 949.61 Recons. 0.01515 +Start training Epoch 2253... +Train. Iter 2253 : Commit. 0.00002 PPL. 950.03 Recons. 0.01509 +Start training Epoch 2254... +Train. Iter 2254 : Commit. 0.00002 PPL. 950.28 Recons. 0.01521 +Start training Epoch 2255... +Train. Iter 2255 : Commit. 0.00002 PPL. 950.14 Recons. 0.01512 +Start training Epoch 2256... +Train. Iter 2256 : Commit. 0.00002 PPL. 950.88 Recons. 0.01513 +Start training Epoch 2257... +Train. Iter 2257 : Commit. 0.00002 PPL. 953.78 Recons. 0.01509 +Start training Epoch 2258... +Train. Iter 2258 : Commit. 0.00002 PPL. 951.24 Recons. 0.01513 +Start training Epoch 2259... +Train. Iter 2259 : Commit. 0.00002 PPL. 955.48 Recons. 0.01521 +Start training Epoch 2260... +Train. Iter 2260 : Commit. 0.00002 PPL. 956.31 Recons. 0.01509 +Check if save...? +Start training Epoch 2261... +Train. Iter 2261 : Commit. 0.00002 PPL. 950.15 Recons. 0.01512 +Start training Epoch 2262... +Train. Iter 2262 : Commit. 0.00002 PPL. 954.14 Recons. 0.01514 +Start training Epoch 2263... +Train. Iter 2263 : Commit. 0.00002 PPL. 951.91 Recons. 0.01514 +Start training Epoch 2264... +Train. Iter 2264 : Commit. 0.00002 PPL. 948.87 Recons. 0.01507 +Start training Epoch 2265... +Train. Iter 2265 : Commit. 0.00002 PPL. 949.63 Recons. 0.01509 +Start training Epoch 2266... +Train. Iter 2266 : Commit. 0.00002 PPL. 950.30 Recons. 0.01509 +Start training Epoch 2267... +Train. Iter 2267 : Commit. 0.00002 PPL. 954.17 Recons. 0.01530 +Start training Epoch 2268... +Train. Iter 2268 : Commit. 0.00002 PPL. 953.57 Recons. 0.01517 +Start training Epoch 2269... +Train. Iter 2269 : Commit. 0.00002 PPL. 954.00 Recons. 0.01513 +Start training Epoch 2270... +Train. Iter 2270 : Commit. 0.00002 PPL. 952.10 Recons. 0.01526 +Check if save...? +Start training Epoch 2271... +Train. Iter 2271 : Commit. 0.00002 PPL. 957.68 Recons. 0.01526 +Start training Epoch 2272... +Train. Iter 2272 : Commit. 0.00002 PPL. 958.09 Recons. 0.01518 +Start training Epoch 2273... +Train. Iter 2273 : Commit. 0.00002 PPL. 957.54 Recons. 0.01507 +Start training Epoch 2274... +Train. Iter 2274 : Commit. 0.00002 PPL. 950.80 Recons. 0.01509 +Start training Epoch 2275... +Train. Iter 2275 : Commit. 0.00002 PPL. 950.00 Recons. 0.01506 +Start training Epoch 2276... +Train. Iter 2276 : Commit. 0.00002 PPL. 949.12 Recons. 0.01508 +Start training Epoch 2277... +Train. Iter 2277 : Commit. 0.00002 PPL. 947.03 Recons. 0.01512 +Start training Epoch 2278... +Train. Iter 2278 : Commit. 0.00002 PPL. 951.34 Recons. 0.01518 +Start training Epoch 2279... +Train. Iter 2279 : Commit. 0.00002 PPL. 948.15 Recons. 0.01511 +Start training Epoch 2280... +Train. Iter 2280 : Commit. 0.00002 PPL. 950.05 Recons. 0.01510 +Check if save...? +Start training Epoch 2281... +Train. Iter 2281 : Commit. 0.00002 PPL. 949.43 Recons. 0.01510 +Start training Epoch 2282... +Train. Iter 2282 : Commit. 0.00002 PPL. 949.98 Recons. 0.01504 +Start training Epoch 2283... +Train. Iter 2283 : Commit. 0.00002 PPL. 953.20 Recons. 0.01507 +Start training Epoch 2284... +Train. Iter 2284 : Commit. 0.00002 PPL. 954.11 Recons. 0.01507 +Start training Epoch 2285... +Train. Iter 2285 : Commit. 0.00002 PPL. 952.69 Recons. 0.01507 +Start training Epoch 2286... +Train. Iter 2286 : Commit. 0.00002 PPL. 949.71 Recons. 0.01504 +Start training Epoch 2287... +Train. Iter 2287 : Commit. 0.00002 PPL. 951.38 Recons. 0.01507 +Start training Epoch 2288... +Train. Iter 2288 : Commit. 0.00002 PPL. 946.78 Recons. 0.01506 +Start training Epoch 2289... +Train. Iter 2289 : Commit. 0.00002 PPL. 948.10 Recons. 0.01507 +Start training Epoch 2290... +Train. Iter 2290 : Commit. 0.00002 PPL. 947.67 Recons. 0.01506 +Check if save...? +Start training Epoch 2291... +Train. Iter 2291 : Commit. 0.00002 PPL. 945.97 Recons. 0.01507 +Start training Epoch 2292... +Train. Iter 2292 : Commit. 0.00002 PPL. 949.40 Recons. 0.01512 +Start training Epoch 2293... +Train. Iter 2293 : Commit. 0.00002 PPL. 948.82 Recons. 0.01508 +Start training Epoch 2294... +Train. Iter 2294 : Commit. 0.00002 PPL. 947.79 Recons. 0.01505 +Start training Epoch 2295... +Train. Iter 2295 : Commit. 0.00002 PPL. 949.04 Recons. 0.01517 +Start training Epoch 2296... +Train. Iter 2296 : Commit. 0.00002 PPL. 949.18 Recons. 0.01506 +Start training Epoch 2297... +Train. Iter 2297 : Commit. 0.00002 PPL. 951.37 Recons. 0.01520 +Start training Epoch 2298... +Train. Iter 2298 : Commit. 0.00002 PPL. 954.73 Recons. 0.01514 +Start training Epoch 2299... +Train. Iter 2299 : Commit. 0.00002 PPL. 952.77 Recons. 0.01516 +Start training Epoch 2300... +Train. Iter 2300 : Commit. 0.00002 PPL. 954.03 Recons. 0.01512 +Check if save...? +Start training Epoch 2301... +Train. Iter 2301 : Commit. 0.00002 PPL. 956.06 Recons. 0.01511 +Start training Epoch 2302... +Train. Iter 2302 : Commit. 0.00002 PPL. 949.94 Recons. 0.01508 +Start training Epoch 2303... +Train. Iter 2303 : Commit. 0.00002 PPL. 956.20 Recons. 0.01512 +Start training Epoch 2304... +Train. Iter 2304 : Commit. 0.00002 PPL. 951.47 Recons. 0.01508 +Start training Epoch 2305... +Train. Iter 2305 : Commit. 0.00002 PPL. 959.52 Recons. 0.01511 +Start training Epoch 2306... +Train. Iter 2306 : Commit. 0.00002 PPL. 951.05 Recons. 0.01506 +Start training Epoch 2307... +Train. Iter 2307 : Commit. 0.00002 PPL. 948.78 Recons. 0.01508 +Start training Epoch 2308... +Train. Iter 2308 : Commit. 0.00002 PPL. 949.43 Recons. 0.01505 +Start training Epoch 2309... +Train. Iter 2309 : Commit. 0.00002 PPL. 948.93 Recons. 0.01509 +Start training Epoch 2310... +Train. Iter 2310 : Commit. 0.00002 PPL. 946.20 Recons. 0.01503 +Check if save...? +----saved---- +Start training Epoch 2311... +Train. Iter 2311 : Commit. 0.00002 PPL. 947.49 Recons. 0.01527 +Start training Epoch 2312... +Train. Iter 2312 : Commit. 0.00002 PPL. 947.71 Recons. 0.01506 +Start training Epoch 2313... +Train. Iter 2313 : Commit. 0.00002 PPL. 949.52 Recons. 0.01509 +Start training Epoch 2314... +Train. Iter 2314 : Commit. 0.00002 PPL. 949.36 Recons. 0.01506 +Start training Epoch 2315... +Train. Iter 2315 : Commit. 0.00002 PPL. 947.30 Recons. 0.01508 +Start training Epoch 2316... +Train. Iter 2316 : Commit. 0.00002 PPL. 950.62 Recons. 0.01509 +Start training Epoch 2317... +Train. Iter 2317 : Commit. 0.00002 PPL. 948.71 Recons. 0.01506 +Start training Epoch 2318... +Train. Iter 2318 : Commit. 0.00002 PPL. 946.92 Recons. 0.01520 +Start training Epoch 2319... +Train. Iter 2319 : Commit. 0.00002 PPL. 951.58 Recons. 0.01511 +Start training Epoch 2320... +Train. Iter 2320 : Commit. 0.00002 PPL. 952.71 Recons. 0.01510 +Check if save...? +Start training Epoch 2321... +Train. Iter 2321 : Commit. 0.00002 PPL. 950.39 Recons. 0.01503 +Start training Epoch 2322... +Train. Iter 2322 : Commit. 0.00002 PPL. 954.17 Recons. 0.01511 +Start training Epoch 2323... +Train. Iter 2323 : Commit. 0.00002 PPL. 960.68 Recons. 0.01502 +Start training Epoch 2324... +Train. Iter 2324 : Commit. 0.00002 PPL. 953.78 Recons. 0.01507 +Start training Epoch 2325... +Train. Iter 2325 : Commit. 0.00002 PPL. 953.04 Recons. 0.01508 +Start training Epoch 2326... +Train. Iter 2326 : Commit. 0.00002 PPL. 952.70 Recons. 0.01502 +Start training Epoch 2327... +Train. Iter 2327 : Commit. 0.00002 PPL. 953.93 Recons. 0.01509 +Start training Epoch 2328... +Train. Iter 2328 : Commit. 0.00002 PPL. 952.75 Recons. 0.01511 +Start training Epoch 2329... +Train. Iter 2329 : Commit. 0.00002 PPL. 951.90 Recons. 0.01504 +Start training Epoch 2330... +Train. Iter 2330 : Commit. 0.00002 PPL. 949.81 Recons. 0.01509 +Check if save...? +Start training Epoch 2331... +Train. Iter 2331 : Commit. 0.00002 PPL. 947.15 Recons. 0.01510 +Start training Epoch 2332... +Train. Iter 2332 : Commit. 0.00002 PPL. 944.00 Recons. 0.01503 +Start training Epoch 2333... +Train. Iter 2333 : Commit. 0.00002 PPL. 943.82 Recons. 0.01510 +Start training Epoch 2334... +Train. Iter 2334 : Commit. 0.00002 PPL. 942.21 Recons. 0.01504 +Start training Epoch 2335... +Train. Iter 2335 : Commit. 0.00002 PPL. 945.34 Recons. 0.01509 +Start training Epoch 2336... +Train. Iter 2336 : Commit. 0.00002 PPL. 942.17 Recons. 0.01504 +Start training Epoch 2337... +Train. Iter 2337 : Commit. 0.00002 PPL. 945.05 Recons. 0.01508 +Start training Epoch 2338... +Train. Iter 2338 : Commit. 0.00002 PPL. 945.85 Recons. 0.01502 +Start training Epoch 2339... +Train. Iter 2339 : Commit. 0.00002 PPL. 950.44 Recons. 0.01504 +Start training Epoch 2340... +Train. Iter 2340 : Commit. 0.00002 PPL. 948.48 Recons. 0.01507 +Check if save...? +Start training Epoch 2341... +Train. Iter 2341 : Commit. 0.00002 PPL. 950.46 Recons. 0.01501 +Start training Epoch 2342... +Train. Iter 2342 : Commit. 0.00002 PPL. 946.21 Recons. 0.01510 +Start training Epoch 2343... +Train. Iter 2343 : Commit. 0.00002 PPL. 944.98 Recons. 0.01507 +Start training Epoch 2344... +Train. Iter 2344 : Commit. 0.00002 PPL. 949.59 Recons. 0.01507 +Start training Epoch 2345... +Train. Iter 2345 : Commit. 0.00002 PPL. 947.70 Recons. 0.01502 +Start training Epoch 2346... +Train. Iter 2346 : Commit. 0.00002 PPL. 947.66 Recons. 0.01506 +Start training Epoch 2347... +Train. Iter 2347 : Commit. 0.00002 PPL. 947.97 Recons. 0.01515 +Start training Epoch 2348... +Train. Iter 2348 : Commit. 0.00002 PPL. 948.36 Recons. 0.01521 +Start training Epoch 2349... +Train. Iter 2349 : Commit. 0.00002 PPL. 948.50 Recons. 0.01504 +Start training Epoch 2350... +Train. Iter 2350 : Commit. 0.00002 PPL. 946.40 Recons. 0.01507 +Check if save...? +Start training Epoch 2351... +Train. Iter 2351 : Commit. 0.00002 PPL. 945.67 Recons. 0.01502 +Start training Epoch 2352... +Train. Iter 2352 : Commit. 0.00002 PPL. 945.61 Recons. 0.01505 +Start training Epoch 2353... +Train. Iter 2353 : Commit. 0.00002 PPL. 947.07 Recons. 0.01498 +Start training Epoch 2354... +Train. Iter 2354 : Commit. 0.00002 PPL. 951.04 Recons. 0.01506 +Start training Epoch 2355... +Train. Iter 2355 : Commit. 0.00002 PPL. 946.80 Recons. 0.01505 +Start training Epoch 2356... +Train. Iter 2356 : Commit. 0.00002 PPL. 942.66 Recons. 0.01498 +Start training Epoch 2357... +Train. Iter 2357 : Commit. 0.00002 PPL. 948.91 Recons. 0.01518 +Start training Epoch 2358... +Train. Iter 2358 : Commit. 0.00002 PPL. 948.15 Recons. 0.01502 +Start training Epoch 2359... +Train. Iter 2359 : Commit. 0.00002 PPL. 947.32 Recons. 0.01505 +Start training Epoch 2360... +Train. Iter 2360 : Commit. 0.00002 PPL. 946.93 Recons. 0.01503 +Check if save...? +----saved---- +Start training Epoch 2361... +Train. Iter 2361 : Commit. 0.00002 PPL. 945.99 Recons. 0.01503 +Start training Epoch 2362... +Train. Iter 2362 : Commit. 0.00002 PPL. 943.30 Recons. 0.01504 +Start training Epoch 2363... +Train. Iter 2363 : Commit. 0.00002 PPL. 944.43 Recons. 0.01514 +Start training Epoch 2364... +Train. Iter 2364 : Commit. 0.00002 PPL. 944.33 Recons. 0.01498 +Start training Epoch 2365... +Train. Iter 2365 : Commit. 0.00002 PPL. 945.36 Recons. 0.01501 +Start training Epoch 2366... +Train. Iter 2366 : Commit. 0.00002 PPL. 944.43 Recons. 0.01501 +Start training Epoch 2367... +Train. Iter 2367 : Commit. 0.00002 PPL. 944.63 Recons. 0.01510 +Start training Epoch 2368... +Train. Iter 2368 : Commit. 0.00002 PPL. 944.45 Recons. 0.01503 +Start training Epoch 2369... +Train. Iter 2369 : Commit. 0.00002 PPL. 947.02 Recons. 0.01499 +Start training Epoch 2370... +Train. Iter 2370 : Commit. 0.00002 PPL. 947.08 Recons. 0.01503 +Check if save...? +Start training Epoch 2371... +Train. Iter 2371 : Commit. 0.00002 PPL. 949.72 Recons. 0.01493 +Start training Epoch 2372... +Train. Iter 2372 : Commit. 0.00002 PPL. 949.63 Recons. 0.01500 +Start training Epoch 2373... +Train. Iter 2373 : Commit. 0.00002 PPL. 948.61 Recons. 0.01496 +Start training Epoch 2374... +Train. Iter 2374 : Commit. 0.00002 PPL. 948.55 Recons. 0.01500 +Start training Epoch 2375... +Train. Iter 2375 : Commit. 0.00002 PPL. 947.54 Recons. 0.01507 +Start training Epoch 2376... +Train. Iter 2376 : Commit. 0.00002 PPL. 946.00 Recons. 0.01522 +Start training Epoch 2377... +Train. Iter 2377 : Commit. 0.00002 PPL. 943.61 Recons. 0.01502 +Start training Epoch 2378... +Train. Iter 2378 : Commit. 0.00002 PPL. 949.77 Recons. 0.01525 +Start training Epoch 2379... +Train. Iter 2379 : Commit. 0.00002 PPL. 950.93 Recons. 0.01498 +Start training Epoch 2380... +Train. Iter 2380 : Commit. 0.00002 PPL. 948.45 Recons. 0.01502 +Check if save...? +----saved---- +Start training Epoch 2381... +Train. Iter 2381 : Commit. 0.00002 PPL. 944.68 Recons. 0.01503 +Start training Epoch 2382... +Train. Iter 2382 : Commit. 0.00002 PPL. 945.46 Recons. 0.01508 +Start training Epoch 2383... +Train. Iter 2383 : Commit. 0.00002 PPL. 941.75 Recons. 0.01505 +Start training Epoch 2384... +Train. Iter 2384 : Commit. 0.00002 PPL. 942.19 Recons. 0.01497 +Start training Epoch 2385... +Train. Iter 2385 : Commit. 0.00002 PPL. 942.46 Recons. 0.01500 +Start training Epoch 2386... +Train. Iter 2386 : Commit. 0.00002 PPL. 944.40 Recons. 0.01502 +Start training Epoch 2387... +Train. Iter 2387 : Commit. 0.00002 PPL. 953.27 Recons. 0.01518 +Start training Epoch 2388... +Train. Iter 2388 : Commit. 0.00002 PPL. 950.76 Recons. 0.01494 +Start training Epoch 2389... +Train. Iter 2389 : Commit. 0.00002 PPL. 950.46 Recons. 0.01496 +Start training Epoch 2390... +Train. Iter 2390 : Commit. 0.00002 PPL. 947.68 Recons. 0.01503 +Check if save...? +Start training Epoch 2391... +Train. Iter 2391 : Commit. 0.00002 PPL. 953.03 Recons. 0.01511 +Start training Epoch 2392... +Train. Iter 2392 : Commit. 0.00002 PPL. 951.20 Recons. 0.01500 +Start training Epoch 2393... +Train. Iter 2393 : Commit. 0.00002 PPL. 953.13 Recons. 0.01507 +Start training Epoch 2394... +Train. Iter 2394 : Commit. 0.00002 PPL. 950.21 Recons. 0.01497 +Start training Epoch 2395... +Train. Iter 2395 : Commit. 0.00002 PPL. 948.11 Recons. 0.01494 +Start training Epoch 2396... +Train. Iter 2396 : Commit. 0.00002 PPL. 948.47 Recons. 0.01501 +Start training Epoch 2397... +Train. Iter 2397 : Commit. 0.00002 PPL. 945.95 Recons. 0.01499 +Start training Epoch 2398... +Train. Iter 2398 : Commit. 0.00002 PPL. 943.76 Recons. 0.01500 +Start training Epoch 2399... +Train. Iter 2399 : Commit. 0.00002 PPL. 942.53 Recons. 0.01495 +Start training Epoch 2400... +Train. Iter 2400 : Commit. 0.00002 PPL. 942.87 Recons. 0.01492 +Check if save...? +----saved---- +Start training Epoch 2401... +Train. Iter 2401 : Commit. 0.00002 PPL. 948.57 Recons. 0.01508 +Start training Epoch 2402... +Train. Iter 2402 : Commit. 0.00002 PPL. 946.46 Recons. 0.01501 +Start training Epoch 2403... +Train. Iter 2403 : Commit. 0.00002 PPL. 943.85 Recons. 0.01497 +Start training Epoch 2404... +Train. Iter 2404 : Commit. 0.00002 PPL. 948.15 Recons. 0.01498 +Start training Epoch 2405... +Train. Iter 2405 : Commit. 0.00002 PPL. 944.49 Recons. 0.01496 +Start training Epoch 2406... +Train. Iter 2406 : Commit. 0.00002 PPL. 947.22 Recons. 0.01496 +Start training Epoch 2407... +Train. Iter 2407 : Commit. 0.00002 PPL. 949.98 Recons. 0.01507 +Start training Epoch 2408... +Train. Iter 2408 : Commit. 0.00002 PPL. 951.07 Recons. 0.01513 +Start training Epoch 2409... +Train. Iter 2409 : Commit. 0.00002 PPL. 948.73 Recons. 0.01497 +Start training Epoch 2410... +Train. Iter 2410 : Commit. 0.00002 PPL. 951.67 Recons. 0.01500 +Check if save...? +Start training Epoch 2411... +Train. Iter 2411 : Commit. 0.00002 PPL. 949.98 Recons. 0.01503 +Start training Epoch 2412... +Train. Iter 2412 : Commit. 0.00002 PPL. 951.10 Recons. 0.01496 +Start training Epoch 2413... +Train. Iter 2413 : Commit. 0.00002 PPL. 951.63 Recons. 0.01502 +Start training Epoch 2414... +Train. Iter 2414 : Commit. 0.00002 PPL. 946.48 Recons. 0.01499 +Start training Epoch 2415... +Train. Iter 2415 : Commit. 0.00002 PPL. 959.45 Recons. 0.01495 +Start training Epoch 2416... +Train. Iter 2416 : Commit. 0.00002 PPL. 954.34 Recons. 0.01492 +Start training Epoch 2417... +Train. Iter 2417 : Commit. 0.00002 PPL. 953.50 Recons. 0.01505 +Start training Epoch 2418... +Train. Iter 2418 : Commit. 0.00002 PPL. 951.96 Recons. 0.01495 +Start training Epoch 2419... +Train. Iter 2419 : Commit. 0.00002 PPL. 952.43 Recons. 0.01498 +Start training Epoch 2420... +Train. Iter 2420 : Commit. 0.00002 PPL. 950.27 Recons. 0.01502 +Check if save...? +Start training Epoch 2421... +Train. Iter 2421 : Commit. 0.00002 PPL. 956.92 Recons. 0.01498 +Start training Epoch 2422... +Train. Iter 2422 : Commit. 0.00002 PPL. 946.83 Recons. 0.01503 +Start training Epoch 2423... +Train. Iter 2423 : Commit. 0.00002 PPL. 947.20 Recons. 0.01493 +Start training Epoch 2424... +Train. Iter 2424 : Commit. 0.00002 PPL. 952.49 Recons. 0.01504 +Start training Epoch 2425... +Train. Iter 2425 : Commit. 0.00002 PPL. 948.14 Recons. 0.01498 +Start training Epoch 2426... +Train. Iter 2426 : Commit. 0.00002 PPL. 952.10 Recons. 0.01492 +Start training Epoch 2427... +Train. Iter 2427 : Commit. 0.00002 PPL. 945.76 Recons. 0.01497 +Start training Epoch 2428... +Train. Iter 2428 : Commit. 0.00002 PPL. 943.54 Recons. 0.01504 +Start training Epoch 2429... +Train. Iter 2429 : Commit. 0.00002 PPL. 942.32 Recons. 0.01489 +Start training Epoch 2430... +Train. Iter 2430 : Commit. 0.00002 PPL. 940.02 Recons. 0.01498 +Check if save...? +Start training Epoch 2431... +Train. Iter 2431 : Commit. 0.00002 PPL. 942.64 Recons. 0.01497 +Start training Epoch 2432... +Train. Iter 2432 : Commit. 0.00002 PPL. 941.10 Recons. 0.01497 +Start training Epoch 2433... +Train. Iter 2433 : Commit. 0.00002 PPL. 940.85 Recons. 0.01493 +Start training Epoch 2434... +Train. Iter 2434 : Commit. 0.00002 PPL. 940.77 Recons. 0.01490 +Start training Epoch 2435... +Train. Iter 2435 : Commit. 0.00002 PPL. 946.33 Recons. 0.01500 +Start training Epoch 2436... +Train. Iter 2436 : Commit. 0.00002 PPL. 945.12 Recons. 0.01495 +Start training Epoch 2437... +Train. Iter 2437 : Commit. 0.00002 PPL. 945.77 Recons. 0.01498 +Start training Epoch 2438... +Train. Iter 2438 : Commit. 0.00002 PPL. 944.71 Recons. 0.01496 +Start training Epoch 2439... +Train. Iter 2439 : Commit. 0.00002 PPL. 943.24 Recons. 0.01500 +Start training Epoch 2440... +Train. Iter 2440 : Commit. 0.00002 PPL. 943.23 Recons. 0.01496 +Check if save...? +Start training Epoch 2441... +Train. Iter 2441 : Commit. 0.00002 PPL. 942.74 Recons. 0.01495 +Start training Epoch 2442... +Train. Iter 2442 : Commit. 0.00002 PPL. 940.86 Recons. 0.01528 +Start training Epoch 2443... +Train. Iter 2443 : Commit. 0.00002 PPL. 943.38 Recons. 0.01495 +Start training Epoch 2444... +Train. Iter 2444 : Commit. 0.00002 PPL. 945.97 Recons. 0.01501 +Start training Epoch 2445... +Train. Iter 2445 : Commit. 0.00002 PPL. 947.36 Recons. 0.01497 +Start training Epoch 2446... +Train. Iter 2446 : Commit. 0.00002 PPL. 948.49 Recons. 0.01497 +Start training Epoch 2447... +Train. Iter 2447 : Commit. 0.00002 PPL. 945.93 Recons. 0.01498 +Start training Epoch 2448... +Train. Iter 2448 : Commit. 0.00002 PPL. 950.99 Recons. 0.01502 +Start training Epoch 2449... +Train. Iter 2449 : Commit. 0.00002 PPL. 945.97 Recons. 0.01496 +Start training Epoch 2450... +Train. Iter 2450 : Commit. 0.00002 PPL. 941.72 Recons. 0.01495 +Check if save...? +Start training Epoch 2451... +Train. Iter 2451 : Commit. 0.00002 PPL. 941.47 Recons. 0.01494 +Start training Epoch 2452... +Train. Iter 2452 : Commit. 0.00002 PPL. 939.78 Recons. 0.01489 +Start training Epoch 2453... +Train. Iter 2453 : Commit. 0.00002 PPL. 938.06 Recons. 0.01490 +Start training Epoch 2454... +Train. Iter 2454 : Commit. 0.00002 PPL. 939.33 Recons. 0.01503 +Start training Epoch 2455... +Train. Iter 2455 : Commit. 0.00002 PPL. 937.17 Recons. 0.01495 +Start training Epoch 2456... +Train. Iter 2456 : Commit. 0.00002 PPL. 937.65 Recons. 0.01497 +Start training Epoch 2457... +Train. Iter 2457 : Commit. 0.00002 PPL. 940.11 Recons. 0.01502 +Start training Epoch 2458... +Train. Iter 2458 : Commit. 0.00002 PPL. 938.70 Recons. 0.01490 +Start training Epoch 2459... +Train. Iter 2459 : Commit. 0.00002 PPL. 937.33 Recons. 0.01490 +Start training Epoch 2460... +Train. Iter 2460 : Commit. 0.00002 PPL. 939.15 Recons. 0.01500 +Check if save...? +Start training Epoch 2461... +Train. Iter 2461 : Commit. 0.00002 PPL. 942.65 Recons. 0.01498 +Start training Epoch 2462... +Train. Iter 2462 : Commit. 0.00002 PPL. 939.96 Recons. 0.01494 +Start training Epoch 2463... +Train. Iter 2463 : Commit. 0.00002 PPL. 940.21 Recons. 0.01488 +Start training Epoch 2464... +Train. Iter 2464 : Commit. 0.00002 PPL. 941.81 Recons. 0.01490 +Start training Epoch 2465... +Train. Iter 2465 : Commit. 0.00002 PPL. 940.52 Recons. 0.01500 +Start training Epoch 2466... +Train. Iter 2466 : Commit. 0.00002 PPL. 940.49 Recons. 0.01494 +Start training Epoch 2467... +Train. Iter 2467 : Commit. 0.00002 PPL. 940.43 Recons. 0.01492 +Start training Epoch 2468... +Train. Iter 2468 : Commit. 0.00002 PPL. 940.96 Recons. 0.01504 +Start training Epoch 2469... +Train. Iter 2469 : Commit. 0.00002 PPL. 945.53 Recons. 0.01494 +Start training Epoch 2470... +Train. Iter 2470 : Commit. 0.00002 PPL. 946.23 Recons. 0.01492 +Check if save...? +Start training Epoch 2471... +Train. Iter 2471 : Commit. 0.00002 PPL. 941.54 Recons. 0.01491 +Start training Epoch 2472... +Train. Iter 2472 : Commit. 0.00002 PPL. 941.88 Recons. 0.01498 +Start training Epoch 2473... +Train. Iter 2473 : Commit. 0.00002 PPL. 941.40 Recons. 0.01495 +Start training Epoch 2474... +Train. Iter 2474 : Commit. 0.00002 PPL. 939.35 Recons. 0.01503 +Start training Epoch 2475... +Train. Iter 2475 : Commit. 0.00002 PPL. 938.62 Recons. 0.01490 +Start training Epoch 2476... +Train. Iter 2476 : Commit. 0.00002 PPL. 940.61 Recons. 0.01497 +Start training Epoch 2477... +Train. Iter 2477 : Commit. 0.00002 PPL. 940.73 Recons. 0.01489 +Start training Epoch 2478... +Train. Iter 2478 : Commit. 0.00002 PPL. 938.51 Recons. 0.01529 +Start training Epoch 2479... +Train. Iter 2479 : Commit. 0.00002 PPL. 941.59 Recons. 0.01493 +Start training Epoch 2480... +Train. Iter 2480 : Commit. 0.00002 PPL. 940.67 Recons. 0.01494 +Check if save...? +Start training Epoch 2481... +Train. Iter 2481 : Commit. 0.00002 PPL. 936.98 Recons. 0.01493 +Start training Epoch 2482... +Train. Iter 2482 : Commit. 0.00002 PPL. 950.79 Recons. 0.01491 +Start training Epoch 2483... +Train. Iter 2483 : Commit. 0.00002 PPL. 944.91 Recons. 0.01493 +Start training Epoch 2484... +Train. Iter 2484 : Commit. 0.00002 PPL. 952.77 Recons. 0.01494 +Start training Epoch 2485... +Train. Iter 2485 : Commit. 0.00002 PPL. 949.54 Recons. 0.01487 +Start training Epoch 2486... +Train. Iter 2486 : Commit. 0.00002 PPL. 949.53 Recons. 0.01489 +Start training Epoch 2487... +Train. Iter 2487 : Commit. 0.00002 PPL. 948.52 Recons. 0.01489 +Start training Epoch 2488... +Train. Iter 2488 : Commit. 0.00002 PPL. 948.13 Recons. 0.01496 +Start training Epoch 2489... +Train. Iter 2489 : Commit. 0.00002 PPL. 954.49 Recons. 0.01499 +Start training Epoch 2490... +Train. Iter 2490 : Commit. 0.00002 PPL. 945.31 Recons. 0.01482 +Check if save...? +----saved---- +Start training Epoch 2491... +Train. Iter 2491 : Commit. 0.00002 PPL. 948.63 Recons. 0.01493 +Start training Epoch 2492... +Train. Iter 2492 : Commit. 0.00002 PPL. 948.55 Recons. 0.01486 +Start training Epoch 2493... +Train. Iter 2493 : Commit. 0.00002 PPL. 944.84 Recons. 0.01489 +Start training Epoch 2494... +Train. Iter 2494 : Commit. 0.00002 PPL. 949.81 Recons. 0.01488 +Start training Epoch 2495... +Train. Iter 2495 : Commit. 0.00002 PPL. 947.91 Recons. 0.01495 +Start training Epoch 2496... +Train. Iter 2496 : Commit. 0.00002 PPL. 956.13 Recons. 0.01493 +Start training Epoch 2497... +Train. Iter 2497 : Commit. 0.00002 PPL. 950.56 Recons. 0.01490 +Start training Epoch 2498... +Train. Iter 2498 : Commit. 0.00002 PPL. 952.04 Recons. 0.01487 +Start training Epoch 2499... +Train. Iter 2499 : Commit. 0.00002 PPL. 948.25 Recons. 0.01490 +Start training Epoch 2500... +Train. Iter 2500 : Commit. 0.00002 PPL. 947.47 Recons. 0.01486 +Check if save...? +Start training Epoch 2501... +Train. Iter 2501 : Commit. 0.00002 PPL. 948.58 Recons. 0.01496 +Start training Epoch 2502... +Train. Iter 2502 : Commit. 0.00002 PPL. 946.29 Recons. 0.01495 +Start training Epoch 2503... +Train. Iter 2503 : Commit. 0.00002 PPL. 947.70 Recons. 0.01496 +Start training Epoch 2504... +Train. Iter 2504 : Commit. 0.00002 PPL. 945.06 Recons. 0.01488 +Start training Epoch 2505... +Train. Iter 2505 : Commit. 0.00002 PPL. 950.61 Recons. 0.01493 +Start training Epoch 2506... +Train. Iter 2506 : Commit. 0.00002 PPL. 947.76 Recons. 0.01495 +Start training Epoch 2507... +Train. Iter 2507 : Commit. 0.00002 PPL. 947.49 Recons. 0.01502 +Start training Epoch 2508... +Train. Iter 2508 : Commit. 0.00002 PPL. 945.79 Recons. 0.01499 +Start training Epoch 2509... +Train. Iter 2509 : Commit. 0.00002 PPL. 943.02 Recons. 0.01492 +Start training Epoch 2510... +Train. Iter 2510 : Commit. 0.00002 PPL. 939.85 Recons. 0.01488 +Check if save...? +Start training Epoch 2511... +Train. Iter 2511 : Commit. 0.00002 PPL. 942.63 Recons. 0.01490 +Start training Epoch 2512... +Train. Iter 2512 : Commit. 0.00002 PPL. 939.58 Recons. 0.01488 +Start training Epoch 2513... +Train. Iter 2513 : Commit. 0.00002 PPL. 942.01 Recons. 0.01489 +Start training Epoch 2514... +Train. Iter 2514 : Commit. 0.00002 PPL. 950.95 Recons. 0.01494 +Start training Epoch 2515... +Train. Iter 2515 : Commit. 0.00002 PPL. 944.75 Recons. 0.01485 +Start training Epoch 2516... +Train. Iter 2516 : Commit. 0.00002 PPL. 942.86 Recons. 0.01485 +Start training Epoch 2517... +Train. Iter 2517 : Commit. 0.00002 PPL. 946.13 Recons. 0.01492 +Start training Epoch 2518... +Train. Iter 2518 : Commit. 0.00002 PPL. 945.91 Recons. 0.01491 +Start training Epoch 2519... +Train. Iter 2519 : Commit. 0.00002 PPL. 948.30 Recons. 0.01493 +Start training Epoch 2520... +Train. Iter 2520 : Commit. 0.00002 PPL. 945.01 Recons. 0.01492 +Check if save...? +Start training Epoch 2521... +Train. Iter 2521 : Commit. 0.00002 PPL. 942.18 Recons. 0.01490 +Start training Epoch 2522... +Train. Iter 2522 : Commit. 0.00002 PPL. 943.77 Recons. 0.01484 +Start training Epoch 2523... +Train. Iter 2523 : Commit. 0.00002 PPL. 943.59 Recons. 0.01486 +Start training Epoch 2524... +Train. Iter 2524 : Commit. 0.00002 PPL. 942.13 Recons. 0.01485 +Start training Epoch 2525... +Train. Iter 2525 : Commit. 0.00002 PPL. 947.75 Recons. 0.01487 +Start training Epoch 2526... +Train. Iter 2526 : Commit. 0.00002 PPL. 942.08 Recons. 0.01483 +Start training Epoch 2527... +Train. Iter 2527 : Commit. 0.00002 PPL. 944.13 Recons. 0.01485 +Start training Epoch 2528... +Train. Iter 2528 : Commit. 0.00002 PPL. 943.14 Recons. 0.01489 +Start training Epoch 2529... +Train. Iter 2529 : Commit. 0.00002 PPL. 942.98 Recons. 0.01481 +Start training Epoch 2530... +Train. Iter 2530 : Commit. 0.00002 PPL. 945.55 Recons. 0.01480 +Check if save...? +----saved---- +Start training Epoch 2531... +Train. Iter 2531 : Commit. 0.00002 PPL. 943.63 Recons. 0.01483 +Start training Epoch 2532... +Train. Iter 2532 : Commit. 0.00002 PPL. 943.87 Recons. 0.01484 +Start training Epoch 2533... +Train. Iter 2533 : Commit. 0.00002 PPL. 947.56 Recons. 0.01492 +Start training Epoch 2534... +Train. Iter 2534 : Commit. 0.00002 PPL. 942.29 Recons. 0.01489 +Start training Epoch 2535... +Train. Iter 2535 : Commit. 0.00002 PPL. 940.61 Recons. 0.01483 +Start training Epoch 2536... +Train. Iter 2536 : Commit. 0.00002 PPL. 941.97 Recons. 0.01493 +Start training Epoch 2537... +Train. Iter 2537 : Commit. 0.00002 PPL. 940.54 Recons. 0.01488 +Start training Epoch 2538... +Train. Iter 2538 : Commit. 0.00002 PPL. 937.59 Recons. 0.01490 +Start training Epoch 2539... +Train. Iter 2539 : Commit. 0.00002 PPL. 942.48 Recons. 0.01488 +Start training Epoch 2540... +Train. Iter 2540 : Commit. 0.00002 PPL. 940.12 Recons. 0.01492 +Check if save...? +Start training Epoch 2541... +Train. Iter 2541 : Commit. 0.00002 PPL. 940.28 Recons. 0.01481 +Start training Epoch 2542... +Train. Iter 2542 : Commit. 0.00002 PPL. 941.31 Recons. 0.01486 +Start training Epoch 2543... +Train. Iter 2543 : Commit. 0.00002 PPL. 940.14 Recons. 0.01482 +Start training Epoch 2544... +Train. Iter 2544 : Commit. 0.00002 PPL. 941.27 Recons. 0.01485 +Start training Epoch 2545... +Train. Iter 2545 : Commit. 0.00002 PPL. 940.31 Recons. 0.01498 +Start training Epoch 2546... +Train. Iter 2546 : Commit. 0.00002 PPL. 940.67 Recons. 0.01501 +Start training Epoch 2547... +Train. Iter 2547 : Commit. 0.00002 PPL. 944.01 Recons. 0.01487 +Start training Epoch 2548... +Train. Iter 2548 : Commit. 0.00002 PPL. 939.31 Recons. 0.01505 +Start training Epoch 2549... +Train. Iter 2549 : Commit. 0.00002 PPL. 936.92 Recons. 0.01485 +Start training Epoch 2550... +Train. Iter 2550 : Commit. 0.00002 PPL. 936.08 Recons. 0.01491 +Check if save...? +Start training Epoch 2551... +Train. Iter 2551 : Commit. 0.00002 PPL. 938.25 Recons. 0.01486 +Start training Epoch 2552... +Train. Iter 2552 : Commit. 0.00002 PPL. 936.24 Recons. 0.01491 +Start training Epoch 2553... +Train. Iter 2553 : Commit. 0.00002 PPL. 941.17 Recons. 0.01485 +Start training Epoch 2554... +Train. Iter 2554 : Commit. 0.00002 PPL. 940.75 Recons. 0.01486 +Start training Epoch 2555... +Train. Iter 2555 : Commit. 0.00002 PPL. 942.28 Recons. 0.01477 +Start training Epoch 2556... +Train. Iter 2556 : Commit. 0.00002 PPL. 946.85 Recons. 0.01485 +Start training Epoch 2557... +Train. Iter 2557 : Commit. 0.00002 PPL. 945.52 Recons. 0.01481 +Start training Epoch 2558... +Train. Iter 2558 : Commit. 0.00002 PPL. 943.55 Recons. 0.01484 +Start training Epoch 2559... +Train. Iter 2559 : Commit. 0.00002 PPL. 943.44 Recons. 0.01490 +Start training Epoch 2560... +Train. Iter 2560 : Commit. 0.00002 PPL. 940.38 Recons. 0.01478 +Check if save...? +----saved---- +Start training Epoch 2561... +Train. Iter 2561 : Commit. 0.00002 PPL. 943.74 Recons. 0.01482 +Start training Epoch 2562... +Train. Iter 2562 : Commit. 0.00002 PPL. 940.72 Recons. 0.01484 +Start training Epoch 2563... +Train. Iter 2563 : Commit. 0.00002 PPL. 939.30 Recons. 0.01481 +Start training Epoch 2564... +Train. Iter 2564 : Commit. 0.00002 PPL. 940.91 Recons. 0.01492 +Start training Epoch 2565... +Train. Iter 2565 : Commit. 0.00002 PPL. 942.19 Recons. 0.01478 +Start training Epoch 2566... +Train. Iter 2566 : Commit. 0.00002 PPL. 944.09 Recons. 0.01487 +Start training Epoch 2567... +Train. Iter 2567 : Commit. 0.00002 PPL. 941.13 Recons. 0.01484 +Start training Epoch 2568... +Train. Iter 2568 : Commit. 0.00002 PPL. 940.75 Recons. 0.01484 +Start training Epoch 2569... +Train. Iter 2569 : Commit. 0.00002 PPL. 938.13 Recons. 0.01482 +Start training Epoch 2570... +Train. Iter 2570 : Commit. 0.00002 PPL. 935.79 Recons. 0.01481 +Check if save...? +Start training Epoch 2571... +Train. Iter 2571 : Commit. 0.00002 PPL. 938.74 Recons. 0.01483 +Start training Epoch 2572... +Train. Iter 2572 : Commit. 0.00002 PPL. 937.92 Recons. 0.01482 +Start training Epoch 2573... +Train. Iter 2573 : Commit. 0.00002 PPL. 938.41 Recons. 0.01479 +Start training Epoch 2574... +Train. Iter 2574 : Commit. 0.00002 PPL. 935.91 Recons. 0.01485 +Start training Epoch 2575... +Train. Iter 2575 : Commit. 0.00002 PPL. 942.17 Recons. 0.01483 +Start training Epoch 2576... +Train. Iter 2576 : Commit. 0.00002 PPL. 940.47 Recons. 0.01517 +Start training Epoch 2577... +Train. Iter 2577 : Commit. 0.00002 PPL. 937.82 Recons. 0.01484 +Start training Epoch 2578... +Train. Iter 2578 : Commit. 0.00002 PPL. 937.59 Recons. 0.01490 +Start training Epoch 2579... +Train. Iter 2579 : Commit. 0.00002 PPL. 939.84 Recons. 0.01488 +Start training Epoch 2580... +Train. Iter 2580 : Commit. 0.00002 PPL. 939.86 Recons. 0.01486 +Check if save...? +Start training Epoch 2581... +Train. Iter 2581 : Commit. 0.00002 PPL. 944.55 Recons. 0.01484 +Start training Epoch 2582... +Train. Iter 2582 : Commit. 0.00002 PPL. 941.41 Recons. 0.01482 +Start training Epoch 2583... +Train. Iter 2583 : Commit. 0.00002 PPL. 937.76 Recons. 0.01486 +Start training Epoch 2584... +Train. Iter 2584 : Commit. 0.00002 PPL. 941.23 Recons. 0.01481 +Start training Epoch 2585... +Train. Iter 2585 : Commit. 0.00002 PPL. 939.79 Recons. 0.01481 +Start training Epoch 2586... +Train. Iter 2586 : Commit. 0.00002 PPL. 939.47 Recons. 0.01485 +Start training Epoch 2587... +Train. Iter 2587 : Commit. 0.00002 PPL. 943.14 Recons. 0.01487 +Start training Epoch 2588... +Train. Iter 2588 : Commit. 0.00002 PPL. 941.53 Recons. 0.01479 +Start training Epoch 2589... +Train. Iter 2589 : Commit. 0.00002 PPL. 940.58 Recons. 0.01475 +Start training Epoch 2590... +Train. Iter 2590 : Commit. 0.00002 PPL. 939.12 Recons. 0.01500 +Check if save...? +Start training Epoch 2591... +Train. Iter 2591 : Commit. 0.00002 PPL. 952.29 Recons. 0.01484 +Start training Epoch 2592... +Train. Iter 2592 : Commit. 0.00002 PPL. 945.31 Recons. 0.01490 +Start training Epoch 2593... +Train. Iter 2593 : Commit. 0.00002 PPL. 943.56 Recons. 0.01476 +Start training Epoch 2594... +Train. Iter 2594 : Commit. 0.00002 PPL. 939.89 Recons. 0.01486 +Start training Epoch 2595... +Train. Iter 2595 : Commit. 0.00002 PPL. 938.13 Recons. 0.01479 +Start training Epoch 2596... +Train. Iter 2596 : Commit. 0.00002 PPL. 937.66 Recons. 0.01485 +Start training Epoch 2597... +Train. Iter 2597 : Commit. 0.00002 PPL. 937.62 Recons. 0.01481 +Start training Epoch 2598... +Train. Iter 2598 : Commit. 0.00002 PPL. 939.24 Recons. 0.01480 +Start training Epoch 2599... +Train. Iter 2599 : Commit. 0.00002 PPL. 943.59 Recons. 0.01481 +Start training Epoch 2600... +Train. Iter 2600 : Commit. 0.00002 PPL. 945.46 Recons. 0.01487 +Check if save...? +Start training Epoch 2601... +Train. Iter 2601 : Commit. 0.00002 PPL. 941.18 Recons. 0.01478 +Start training Epoch 2602... +Train. Iter 2602 : Commit. 0.00002 PPL. 943.02 Recons. 0.01482 +Start training Epoch 2603... +Train. Iter 2603 : Commit. 0.00002 PPL. 942.27 Recons. 0.01485 +Start training Epoch 2604... +Train. Iter 2604 : Commit. 0.00002 PPL. 944.17 Recons. 0.01473 +Start training Epoch 2605... +Train. Iter 2605 : Commit. 0.00002 PPL. 942.49 Recons. 0.01486 +Start training Epoch 2606... +Train. Iter 2606 : Commit. 0.00002 PPL. 945.26 Recons. 0.01481 +Start training Epoch 2607... +Train. Iter 2607 : Commit. 0.00002 PPL. 940.51 Recons. 0.01478 +Start training Epoch 2608... +Train. Iter 2608 : Commit. 0.00002 PPL. 938.76 Recons. 0.01484 +Start training Epoch 2609... +Train. Iter 2609 : Commit. 0.00002 PPL. 940.51 Recons. 0.01475 +Start training Epoch 2610... +Train. Iter 2610 : Commit. 0.00002 PPL. 939.78 Recons. 0.01481 +Check if save...? +Start training Epoch 2611... +Train. Iter 2611 : Commit. 0.00002 PPL. 934.78 Recons. 0.01501 +Start training Epoch 2612... +Train. Iter 2612 : Commit. 0.00002 PPL. 939.15 Recons. 0.01505 +Start training Epoch 2613... +Train. Iter 2613 : Commit. 0.00002 PPL. 936.10 Recons. 0.01493 +Start training Epoch 2614... +Train. Iter 2614 : Commit. 0.00002 PPL. 946.54 Recons. 0.01485 +Start training Epoch 2615... +Train. Iter 2615 : Commit. 0.00002 PPL. 939.89 Recons. 0.01486 +Start training Epoch 2616... +Train. Iter 2616 : Commit. 0.00002 PPL. 936.72 Recons. 0.01520 +Start training Epoch 2617... +Train. Iter 2617 : Commit. 0.00002 PPL. 940.34 Recons. 0.01491 +Start training Epoch 2618... +Train. Iter 2618 : Commit. 0.00002 PPL. 940.62 Recons. 0.01475 +Start training Epoch 2619... +Train. Iter 2619 : Commit. 0.00002 PPL. 942.86 Recons. 0.01482 +Start training Epoch 2620... +Train. Iter 2620 : Commit. 0.00002 PPL. 939.20 Recons. 0.01481 +Check if save...? +Start training Epoch 2621... +Train. Iter 2621 : Commit. 0.00002 PPL. 940.35 Recons. 0.01486 +Start training Epoch 2622... +Train. Iter 2622 : Commit. 0.00002 PPL. 952.24 Recons. 0.01480 +Start training Epoch 2623... +Train. Iter 2623 : Commit. 0.00002 PPL. 945.57 Recons. 0.01481 +Start training Epoch 2624... +Train. Iter 2624 : Commit. 0.00002 PPL. 944.57 Recons. 0.01478 +Start training Epoch 2625... +Train. Iter 2625 : Commit. 0.00002 PPL. 942.99 Recons. 0.01477 +Start training Epoch 2626... +Train. Iter 2626 : Commit. 0.00002 PPL. 942.95 Recons. 0.01472 +Start training Epoch 2627... +Train. Iter 2627 : Commit. 0.00002 PPL. 943.96 Recons. 0.01474 +Start training Epoch 2628... +Train. Iter 2628 : Commit. 0.00002 PPL. 940.07 Recons. 0.01479 +Start training Epoch 2629... +Train. Iter 2629 : Commit. 0.00002 PPL. 940.26 Recons. 0.01491 +Start training Epoch 2630... +Train. Iter 2630 : Commit. 0.00002 PPL. 937.52 Recons. 0.01483 +Check if save...? +Start training Epoch 2631... +Train. Iter 2631 : Commit. 0.00002 PPL. 938.28 Recons. 0.01472 +Start training Epoch 2632... +Train. Iter 2632 : Commit. 0.00002 PPL. 941.69 Recons. 0.01484 +Start training Epoch 2633... +Train. Iter 2633 : Commit. 0.00002 PPL. 937.32 Recons. 0.01479 +Start training Epoch 2634... +Train. Iter 2634 : Commit. 0.00002 PPL. 938.31 Recons. 0.01485 +Start training Epoch 2635... +Train. Iter 2635 : Commit. 0.00002 PPL. 939.64 Recons. 0.01477 +Start training Epoch 2636... +Train. Iter 2636 : Commit. 0.00002 PPL. 939.84 Recons. 0.01472 +Start training Epoch 2637... +Train. Iter 2637 : Commit. 0.00002 PPL. 938.43 Recons. 0.01473 +Start training Epoch 2638... +Train. Iter 2638 : Commit. 0.00002 PPL. 939.83 Recons. 0.01503 +Start training Epoch 2639... +Train. Iter 2639 : Commit. 0.00002 PPL. 945.93 Recons. 0.01481 +Start training Epoch 2640... +Train. Iter 2640 : Commit. 0.00002 PPL. 947.00 Recons. 0.01476 +Check if save...? +----saved---- +Start training Epoch 2641... +Train. Iter 2641 : Commit. 0.00002 PPL. 940.56 Recons. 0.01480 +Start training Epoch 2642... +Train. Iter 2642 : Commit. 0.00002 PPL. 942.99 Recons. 0.01485 +Start training Epoch 2643... +Train. Iter 2643 : Commit. 0.00002 PPL. 939.41 Recons. 0.01472 +Start training Epoch 2644... +Train. Iter 2644 : Commit. 0.00002 PPL. 940.17 Recons. 0.01483 +Start training Epoch 2645... +Train. Iter 2645 : Commit. 0.00002 PPL. 942.87 Recons. 0.01474 +Start training Epoch 2646... +Train. Iter 2646 : Commit. 0.00002 PPL. 940.58 Recons. 0.01474 +Start training Epoch 2647... +Train. Iter 2647 : Commit. 0.00002 PPL. 940.85 Recons. 0.01473 +Start training Epoch 2648... +Train. Iter 2648 : Commit. 0.00002 PPL. 943.95 Recons. 0.01475 +Start training Epoch 2649... +Train. Iter 2649 : Commit. 0.00002 PPL. 946.14 Recons. 0.01475 +Start training Epoch 2650... +Train. Iter 2650 : Commit. 0.00002 PPL. 945.59 Recons. 0.01473 +Check if save...? +----saved---- +Start training Epoch 2651... +Train. Iter 2651 : Commit. 0.00002 PPL. 941.33 Recons. 0.01471 +Start training Epoch 2652... +Train. Iter 2652 : Commit. 0.00002 PPL. 942.38 Recons. 0.01483 +Start training Epoch 2653... +Train. Iter 2653 : Commit. 0.00002 PPL. 941.67 Recons. 0.01474 +Start training Epoch 2654... +Train. Iter 2654 : Commit. 0.00002 PPL. 941.88 Recons. 0.01485 +Start training Epoch 2655... +Train. Iter 2655 : Commit. 0.00002 PPL. 940.82 Recons. 0.01475 +Start training Epoch 2656... +Train. Iter 2656 : Commit. 0.00002 PPL. 939.73 Recons. 0.01482 +Start training Epoch 2657... +Train. Iter 2657 : Commit. 0.00002 PPL. 944.67 Recons. 0.01473 +Start training Epoch 2658... +Train. Iter 2658 : Commit. 0.00002 PPL. 940.42 Recons. 0.01480 +Start training Epoch 2659... +Train. Iter 2659 : Commit. 0.00002 PPL. 941.76 Recons. 0.01474 +Start training Epoch 2660... +Train. Iter 2660 : Commit. 0.00002 PPL. 941.81 Recons. 0.01475 +Check if save...? +Start training Epoch 2661... +Train. Iter 2661 : Commit. 0.00002 PPL. 947.45 Recons. 0.01478 +Start training Epoch 2662... +Train. Iter 2662 : Commit. 0.00002 PPL. 945.81 Recons. 0.01479 +Start training Epoch 2663... +Train. Iter 2663 : Commit. 0.00002 PPL. 943.15 Recons. 0.01481 +Start training Epoch 2664... +Train. Iter 2664 : Commit. 0.00002 PPL. 942.61 Recons. 0.01474 +Start training Epoch 2665... +Train. Iter 2665 : Commit. 0.00002 PPL. 942.08 Recons. 0.01478 +Start training Epoch 2666... +Train. Iter 2666 : Commit. 0.00002 PPL. 940.46 Recons. 0.01473 +Start training Epoch 2667... +Train. Iter 2667 : Commit. 0.00002 PPL. 940.37 Recons. 0.01473 +Start training Epoch 2668... +Train. Iter 2668 : Commit. 0.00002 PPL. 939.68 Recons. 0.01472 +Start training Epoch 2669... +Train. Iter 2669 : Commit. 0.00002 PPL. 939.85 Recons. 0.01471 +Start training Epoch 2670... +Train. Iter 2670 : Commit. 0.00002 PPL. 936.51 Recons. 0.01473 +Check if save...? +Start training Epoch 2671... +Train. Iter 2671 : Commit. 0.00002 PPL. 938.95 Recons. 0.01473 +Start training Epoch 2672... +Train. Iter 2672 : Commit. 0.00002 PPL. 941.84 Recons. 0.01474 +Start training Epoch 2673... +Train. Iter 2673 : Commit. 0.00002 PPL. 943.79 Recons. 0.01473 +Start training Epoch 2674... +Train. Iter 2674 : Commit. 0.00002 PPL. 938.76 Recons. 0.01471 +Start training Epoch 2675... +Train. Iter 2675 : Commit. 0.00002 PPL. 939.93 Recons. 0.01485 +Start training Epoch 2676... +Train. Iter 2676 : Commit. 0.00002 PPL. 940.39 Recons. 0.01476 +Start training Epoch 2677... +Train. Iter 2677 : Commit. 0.00002 PPL. 941.43 Recons. 0.01488 +Start training Epoch 2678... +Train. Iter 2678 : Commit. 0.00002 PPL. 940.45 Recons. 0.01477 +Start training Epoch 2679... +Train. Iter 2679 : Commit. 0.00002 PPL. 939.56 Recons. 0.01476 +Start training Epoch 2680... +Train. Iter 2680 : Commit. 0.00002 PPL. 941.50 Recons. 0.01476 +Check if save...? +Start training Epoch 2681... +Train. Iter 2681 : Commit. 0.00002 PPL. 938.12 Recons. 0.01472 +Start training Epoch 2682... +Train. Iter 2682 : Commit. 0.00002 PPL. 937.91 Recons. 0.01470 +Start training Epoch 2683... +Train. Iter 2683 : Commit. 0.00002 PPL. 938.56 Recons. 0.01477 +Start training Epoch 2684... +Train. Iter 2684 : Commit. 0.00002 PPL. 938.34 Recons. 0.01476 +Start training Epoch 2685... +Train. Iter 2685 : Commit. 0.00002 PPL. 937.58 Recons. 0.01469 +Start training Epoch 2686... +Train. Iter 2686 : Commit. 0.00002 PPL. 941.35 Recons. 0.01492 +Start training Epoch 2687... +Train. Iter 2687 : Commit. 0.00002 PPL. 945.21 Recons. 0.01485 +Start training Epoch 2688... +Train. Iter 2688 : Commit. 0.00002 PPL. 938.97 Recons. 0.01474 +Start training Epoch 2689... +Train. Iter 2689 : Commit. 0.00002 PPL. 941.38 Recons. 0.01476 +Start training Epoch 2690... +Train. Iter 2690 : Commit. 0.00002 PPL. 942.20 Recons. 0.01476 +Check if save...? +Start training Epoch 2691... +Train. Iter 2691 : Commit. 0.00002 PPL. 939.50 Recons. 0.01474 +Start training Epoch 2692... +Train. Iter 2692 : Commit. 0.00002 PPL. 940.76 Recons. 0.01474 +Start training Epoch 2693... +Train. Iter 2693 : Commit. 0.00002 PPL. 940.64 Recons. 0.01465 +Start training Epoch 2694... +Train. Iter 2694 : Commit. 0.00002 PPL. 944.05 Recons. 0.01473 +Start training Epoch 2695... +Train. Iter 2695 : Commit. 0.00002 PPL. 944.66 Recons. 0.01470 +Start training Epoch 2696... +Train. Iter 2696 : Commit. 0.00002 PPL. 943.24 Recons. 0.01483 +Start training Epoch 2697... +Train. Iter 2697 : Commit. 0.00002 PPL. 942.13 Recons. 0.01474 +Start training Epoch 2698... +Train. Iter 2698 : Commit. 0.00002 PPL. 937.84 Recons. 0.01470 +Start training Epoch 2699... +Train. Iter 2699 : Commit. 0.00002 PPL. 944.61 Recons. 0.01480 +Start training Epoch 2700... +Train. Iter 2700 : Commit. 0.00002 PPL. 939.63 Recons. 0.01467 +Check if save...? +----saved---- +Start training Epoch 2701... +Train. Iter 2701 : Commit. 0.00002 PPL. 941.61 Recons. 0.01475 +Start training Epoch 2702... +Train. Iter 2702 : Commit. 0.00002 PPL. 937.47 Recons. 0.01466 +Start training Epoch 2703... +Train. Iter 2703 : Commit. 0.00002 PPL. 941.17 Recons. 0.01467 +Start training Epoch 2704... +Train. Iter 2704 : Commit. 0.00002 PPL. 938.10 Recons. 0.01474 +Start training Epoch 2705... +Train. Iter 2705 : Commit. 0.00002 PPL. 937.62 Recons. 0.01469 +Start training Epoch 2706... +Train. Iter 2706 : Commit. 0.00002 PPL. 936.53 Recons. 0.01463 +Start training Epoch 2707... +Train. Iter 2707 : Commit. 0.00002 PPL. 941.95 Recons. 0.01475 +Start training Epoch 2708... +Train. Iter 2708 : Commit. 0.00002 PPL. 939.56 Recons. 0.01466 +Start training Epoch 2709... +Train. Iter 2709 : Commit. 0.00002 PPL. 940.17 Recons. 0.01476 +Start training Epoch 2710... +Train. Iter 2710 : Commit. 0.00002 PPL. 939.84 Recons. 0.01477 +Check if save...? +Start training Epoch 2711... +Train. Iter 2711 : Commit. 0.00002 PPL. 938.56 Recons. 0.01472 +Start training Epoch 2712... +Train. Iter 2712 : Commit. 0.00002 PPL. 939.52 Recons. 0.01466 +Start training Epoch 2713... +Train. Iter 2713 : Commit. 0.00002 PPL. 938.89 Recons. 0.01475 +Start training Epoch 2714... +Train. Iter 2714 : Commit. 0.00002 PPL. 936.02 Recons. 0.01469 +Start training Epoch 2715... +Train. Iter 2715 : Commit. 0.00002 PPL. 936.24 Recons. 0.01477 +Start training Epoch 2716... +Train. Iter 2716 : Commit. 0.00002 PPL. 942.56 Recons. 0.01471 +Start training Epoch 2717... +Train. Iter 2717 : Commit. 0.00002 PPL. 939.15 Recons. 0.01474 +Start training Epoch 2718... +Train. Iter 2718 : Commit. 0.00002 PPL. 936.55 Recons. 0.01468 +Start training Epoch 2719... +Train. Iter 2719 : Commit. 0.00002 PPL. 935.14 Recons. 0.01472 +Start training Epoch 2720... +Train. Iter 2720 : Commit. 0.00002 PPL. 938.20 Recons. 0.01468 +Check if save...? +Start training Epoch 2721... +Train. Iter 2721 : Commit. 0.00002 PPL. 936.26 Recons. 0.01466 +Start training Epoch 2722... +Train. Iter 2722 : Commit. 0.00002 PPL. 937.29 Recons. 0.01470 +Start training Epoch 2723... +Train. Iter 2723 : Commit. 0.00002 PPL. 937.17 Recons. 0.01465 +Start training Epoch 2724... +Train. Iter 2724 : Commit. 0.00002 PPL. 944.31 Recons. 0.01468 +Start training Epoch 2725... +Train. Iter 2725 : Commit. 0.00002 PPL. 942.29 Recons. 0.01463 +Start training Epoch 2726... +Train. Iter 2726 : Commit. 0.00002 PPL. 940.33 Recons. 0.01468 +Start training Epoch 2727... +Train. Iter 2727 : Commit. 0.00002 PPL. 937.26 Recons. 0.01466 +Start training Epoch 2728... +Train. Iter 2728 : Commit. 0.00002 PPL. 941.60 Recons. 0.01467 +Start training Epoch 2729... +Train. Iter 2729 : Commit. 0.00002 PPL. 943.11 Recons. 0.01469 +Start training Epoch 2730... +Train. Iter 2730 : Commit. 0.00002 PPL. 948.99 Recons. 0.01473 +Check if save...? +Start training Epoch 2731... +Train. Iter 2731 : Commit. 0.00002 PPL. 955.67 Recons. 0.01469 +Start training Epoch 2732... +Train. Iter 2732 : Commit. 0.00002 PPL. 946.77 Recons. 0.01468 +Start training Epoch 2733... +Train. Iter 2733 : Commit. 0.00002 PPL. 944.78 Recons. 0.01471 +Start training Epoch 2734... +Train. Iter 2734 : Commit. 0.00002 PPL. 939.91 Recons. 0.01466 +Start training Epoch 2735... +Train. Iter 2735 : Commit. 0.00002 PPL. 941.13 Recons. 0.01467 +Start training Epoch 2736... +Train. Iter 2736 : Commit. 0.00002 PPL. 939.26 Recons. 0.01471 +Start training Epoch 2737... +Train. Iter 2737 : Commit. 0.00002 PPL. 939.08 Recons. 0.01473 +Start training Epoch 2738... +Train. Iter 2738 : Commit. 0.00002 PPL. 942.55 Recons. 0.01489 +Start training Epoch 2739... +Train. Iter 2739 : Commit. 0.00002 PPL. 939.59 Recons. 0.01464 +Start training Epoch 2740... +Train. Iter 2740 : Commit. 0.00002 PPL. 938.63 Recons. 0.01478 +Check if save...? +Start training Epoch 2741... +Train. Iter 2741 : Commit. 0.00002 PPL. 937.70 Recons. 0.01467 +Start training Epoch 2742... +Train. Iter 2742 : Commit. 0.00002 PPL. 936.19 Recons. 0.01464 +Start training Epoch 2743... +Train. Iter 2743 : Commit. 0.00002 PPL. 941.73 Recons. 0.01467 +Start training Epoch 2744... +Train. Iter 2744 : Commit. 0.00002 PPL. 941.96 Recons. 0.01469 +Start training Epoch 2745... +Train. Iter 2745 : Commit. 0.00002 PPL. 945.43 Recons. 0.01467 +Start training Epoch 2746... +Train. Iter 2746 : Commit. 0.00002 PPL. 942.74 Recons. 0.01464 +Start training Epoch 2747... +Train. Iter 2747 : Commit. 0.00002 PPL. 944.17 Recons. 0.01466 +Start training Epoch 2748... +Train. Iter 2748 : Commit. 0.00002 PPL. 941.06 Recons. 0.01470 +Start training Epoch 2749... +Train. Iter 2749 : Commit. 0.00002 PPL. 940.57 Recons. 0.01466 +Start training Epoch 2750... +Train. Iter 2750 : Commit. 0.00002 PPL. 941.38 Recons. 0.01471 +Check if save...? +Start training Epoch 2751... +Train. Iter 2751 : Commit. 0.00002 PPL. 950.26 Recons. 0.01470 +Start training Epoch 2752... +Train. Iter 2752 : Commit. 0.00002 PPL. 943.80 Recons. 0.01464 +Start training Epoch 2753... +Train. Iter 2753 : Commit. 0.00002 PPL. 940.12 Recons. 0.01475 +Start training Epoch 2754... +Train. Iter 2754 : Commit. 0.00002 PPL. 944.45 Recons. 0.01470 +Start training Epoch 2755... +Train. Iter 2755 : Commit. 0.00002 PPL. 941.38 Recons. 0.01464 +Start training Epoch 2756... +Train. Iter 2756 : Commit. 0.00002 PPL. 938.00 Recons. 0.01466 +Start training Epoch 2757... +Train. Iter 2757 : Commit. 0.00002 PPL. 940.94 Recons. 0.01466 +Start training Epoch 2758... +Train. Iter 2758 : Commit. 0.00002 PPL. 938.69 Recons. 0.01464 +Start training Epoch 2759... +Train. Iter 2759 : Commit. 0.00002 PPL. 939.39 Recons. 0.01467 +Start training Epoch 2760... +Train. Iter 2760 : Commit. 0.00002 PPL. 938.91 Recons. 0.01468 +Check if save...? +Start training Epoch 2761... +Train. Iter 2761 : Commit. 0.00002 PPL. 942.40 Recons. 0.01465 +Start training Epoch 2762... +Train. Iter 2762 : Commit. 0.00002 PPL. 941.46 Recons. 0.01468 +Start training Epoch 2763... +Train. Iter 2763 : Commit. 0.00002 PPL. 938.50 Recons. 0.01467 +Start training Epoch 2764... +Train. Iter 2764 : Commit. 0.00002 PPL. 938.11 Recons. 0.01468 +Start training Epoch 2765... +Train. Iter 2765 : Commit. 0.00002 PPL. 936.12 Recons. 0.01460 +Start training Epoch 2766... +Train. Iter 2766 : Commit. 0.00002 PPL. 935.50 Recons. 0.01467 +Start training Epoch 2767... +Train. Iter 2767 : Commit. 0.00002 PPL. 935.06 Recons. 0.01470 +Start training Epoch 2768... +Train. Iter 2768 : Commit. 0.00002 PPL. 935.65 Recons. 0.01459 +Start training Epoch 2769... +Train. Iter 2769 : Commit. 0.00002 PPL. 939.70 Recons. 0.01466 +Start training Epoch 2770... +Train. Iter 2770 : Commit. 0.00002 PPL. 937.86 Recons. 0.01462 +Check if save...? +----saved---- +Start training Epoch 2771... +Train. Iter 2771 : Commit. 0.00002 PPL. 935.52 Recons. 0.01466 +Start training Epoch 2772... +Train. Iter 2772 : Commit. 0.00002 PPL. 936.87 Recons. 0.01468 +Start training Epoch 2773... +Train. Iter 2773 : Commit. 0.00002 PPL. 935.04 Recons. 0.01470 +Start training Epoch 2774... +Train. Iter 2774 : Commit. 0.00002 PPL. 934.76 Recons. 0.01465 +Start training Epoch 2775... +Train. Iter 2775 : Commit. 0.00002 PPL. 935.49 Recons. 0.01466 +Start training Epoch 2776... +Train. Iter 2776 : Commit. 0.00002 PPL. 940.31 Recons. 0.01467 +Start training Epoch 2777... +Train. Iter 2777 : Commit. 0.00002 PPL. 936.06 Recons. 0.01465 +Start training Epoch 2778... +Train. Iter 2778 : Commit. 0.00002 PPL. 937.61 Recons. 0.01482 +Start training Epoch 2779... +Train. Iter 2779 : Commit. 0.00002 PPL. 937.16 Recons. 0.01459 +Start training Epoch 2780... +Train. Iter 2780 : Commit. 0.00002 PPL. 944.49 Recons. 0.01470 +Check if save...? +Start training Epoch 2781... +Train. Iter 2781 : Commit. 0.00002 PPL. 937.58 Recons. 0.01465 +Start training Epoch 2782... +Train. Iter 2782 : Commit. 0.00002 PPL. 936.81 Recons. 0.01466 +Start training Epoch 2783... +Train. Iter 2783 : Commit. 0.00002 PPL. 940.09 Recons. 0.01465 +Start training Epoch 2784... +Train. Iter 2784 : Commit. 0.00002 PPL. 937.52 Recons. 0.01466 +Start training Epoch 2785... +Train. Iter 2785 : Commit. 0.00002 PPL. 935.95 Recons. 0.01486 +Start training Epoch 2786... +Train. Iter 2786 : Commit. 0.00002 PPL. 935.88 Recons. 0.01480 +Start training Epoch 2787... +Train. Iter 2787 : Commit. 0.00002 PPL. 937.69 Recons. 0.01466 +Start training Epoch 2788... +Train. Iter 2788 : Commit. 0.00002 PPL. 937.12 Recons. 0.01473 +Start training Epoch 2789... +Train. Iter 2789 : Commit. 0.00002 PPL. 934.69 Recons. 0.01461 +Start training Epoch 2790... +Train. Iter 2790 : Commit. 0.00002 PPL. 934.39 Recons. 0.01470 +Check if save...? +Start training Epoch 2791... +Train. Iter 2791 : Commit. 0.00002 PPL. 943.38 Recons. 0.01463 +Start training Epoch 2792... +Train. Iter 2792 : Commit. 0.00002 PPL. 941.06 Recons. 0.01466 +Start training Epoch 2793... +Train. Iter 2793 : Commit. 0.00002 PPL. 938.05 Recons. 0.01465 +Start training Epoch 2794... +Train. Iter 2794 : Commit. 0.00002 PPL. 937.77 Recons. 0.01466 +Start training Epoch 2795... +Train. Iter 2795 : Commit. 0.00002 PPL. 940.99 Recons. 0.01462 +Start training Epoch 2796... +Train. Iter 2796 : Commit. 0.00002 PPL. 936.94 Recons. 0.01466 +Start training Epoch 2797... +Train. Iter 2797 : Commit. 0.00002 PPL. 941.10 Recons. 0.01461 +Start training Epoch 2798... +Train. Iter 2798 : Commit. 0.00002 PPL. 942.74 Recons. 0.01463 +Start training Epoch 2799... +Train. Iter 2799 : Commit. 0.00002 PPL. 941.91 Recons. 0.01461 +Start training Epoch 2800... +Train. Iter 2800 : Commit. 0.00002 PPL. 941.79 Recons. 0.01460 +Check if save...? +----saved---- +Start training Epoch 2801... +Train. Iter 2801 : Commit. 0.00002 PPL. 942.61 Recons. 0.01461 +Start training Epoch 2802... +Train. Iter 2802 : Commit. 0.00002 PPL. 942.12 Recons. 0.01462 +Start training Epoch 2803... +Train. Iter 2803 : Commit. 0.00002 PPL. 942.56 Recons. 0.01460 +Start training Epoch 2804... +Train. Iter 2804 : Commit. 0.00002 PPL. 950.36 Recons. 0.01471 +Start training Epoch 2805... +Train. Iter 2805 : Commit. 0.00002 PPL. 945.09 Recons. 0.01459 +Start training Epoch 2806... +Train. Iter 2806 : Commit. 0.00002 PPL. 941.36 Recons. 0.01464 +Start training Epoch 2807... +Train. Iter 2807 : Commit. 0.00002 PPL. 940.30 Recons. 0.01459 +Start training Epoch 2808... +Train. Iter 2808 : Commit. 0.00002 PPL. 941.88 Recons. 0.01461 +Start training Epoch 2809... +Train. Iter 2809 : Commit. 0.00002 PPL. 950.63 Recons. 0.01470 +Start training Epoch 2810... +Train. Iter 2810 : Commit. 0.00002 PPL. 943.02 Recons. 0.01457 +Check if save...? +----saved---- +Start training Epoch 2811... +Train. Iter 2811 : Commit. 0.00002 PPL. 939.80 Recons. 0.01466 +Start training Epoch 2812... +Train. Iter 2812 : Commit. 0.00002 PPL. 940.16 Recons. 0.01458 +Start training Epoch 2813... +Train. Iter 2813 : Commit. 0.00002 PPL. 941.77 Recons. 0.01460 +Start training Epoch 2814... +Train. Iter 2814 : Commit. 0.00002 PPL. 938.49 Recons. 0.01460 +Start training Epoch 2815... +Train. Iter 2815 : Commit. 0.00002 PPL. 942.42 Recons. 0.01473 +Start training Epoch 2816... +Train. Iter 2816 : Commit. 0.00002 PPL. 940.64 Recons. 0.01465 +Start training Epoch 2817... +Train. Iter 2817 : Commit. 0.00002 PPL. 937.60 Recons. 0.01464 +Start training Epoch 2818... +Train. Iter 2818 : Commit. 0.00002 PPL. 938.12 Recons. 0.01465 +Start training Epoch 2819... +Train. Iter 2819 : Commit. 0.00002 PPL. 940.28 Recons. 0.01460 +Start training Epoch 2820... +Train. Iter 2820 : Commit. 0.00002 PPL. 941.05 Recons. 0.01467 +Check if save...? +Start training Epoch 2821... +Train. Iter 2821 : Commit. 0.00002 PPL. 940.68 Recons. 0.01465 +Start training Epoch 2822... +Train. Iter 2822 : Commit. 0.00002 PPL. 945.31 Recons. 0.01465 +Start training Epoch 2823... +Train. Iter 2823 : Commit. 0.00002 PPL. 941.03 Recons. 0.01462 +Start training Epoch 2824... +Train. Iter 2824 : Commit. 0.00002 PPL. 938.05 Recons. 0.01457 +Start training Epoch 2825... +Train. Iter 2825 : Commit. 0.00002 PPL. 938.94 Recons. 0.01455 +Start training Epoch 2826... +Train. Iter 2826 : Commit. 0.00002 PPL. 942.60 Recons. 0.01463 +Start training Epoch 2827... +Train. Iter 2827 : Commit. 0.00002 PPL. 939.51 Recons. 0.01452 +Start training Epoch 2828... +Train. Iter 2828 : Commit. 0.00002 PPL. 937.59 Recons. 0.01454 +Start training Epoch 2829... +Train. Iter 2829 : Commit. 0.00002 PPL. 936.88 Recons. 0.01465 +Start training Epoch 2830... +Train. Iter 2830 : Commit. 0.00002 PPL. 938.34 Recons. 0.01459 +Check if save...? +Start training Epoch 2831... +Train. Iter 2831 : Commit. 0.00002 PPL. 940.11 Recons. 0.01454 +Start training Epoch 2832... +Train. Iter 2832 : Commit. 0.00002 PPL. 939.42 Recons. 0.01465 +Start training Epoch 2833... +Train. Iter 2833 : Commit. 0.00002 PPL. 946.93 Recons. 0.01485 +Start training Epoch 2834... +Train. Iter 2834 : Commit. 0.00002 PPL. 943.32 Recons. 0.01460 +Start training Epoch 2835... +Train. Iter 2835 : Commit. 0.00002 PPL. 944.57 Recons. 0.01464 +Start training Epoch 2836... +Train. Iter 2836 : Commit. 0.00002 PPL. 940.72 Recons. 0.01460 +Start training Epoch 2837... +Train. Iter 2837 : Commit. 0.00002 PPL. 938.15 Recons. 0.01454 +Start training Epoch 2838... +Train. Iter 2838 : Commit. 0.00002 PPL. 940.83 Recons. 0.01472 +Start training Epoch 2839... +Train. Iter 2839 : Commit. 0.00002 PPL. 945.84 Recons. 0.01456 +Start training Epoch 2840... +Train. Iter 2840 : Commit. 0.00002 PPL. 946.47 Recons. 0.01456 +Check if save...? +----saved---- +Start training Epoch 2841... +Train. Iter 2841 : Commit. 0.00002 PPL. 941.66 Recons. 0.01459 +Start training Epoch 2842... +Train. Iter 2842 : Commit. 0.00002 PPL. 943.35 Recons. 0.01474 +Start training Epoch 2843... +Train. Iter 2843 : Commit. 0.00002 PPL. 942.36 Recons. 0.01455 +Start training Epoch 2844... +Train. Iter 2844 : Commit. 0.00002 PPL. 941.67 Recons. 0.01462 +Start training Epoch 2845... +Train. Iter 2845 : Commit. 0.00002 PPL. 939.57 Recons. 0.01463 +Start training Epoch 2846... +Train. Iter 2846 : Commit. 0.00002 PPL. 941.22 Recons. 0.01449 +Start training Epoch 2847... +Train. Iter 2847 : Commit. 0.00002 PPL. 944.83 Recons. 0.01460 +Start training Epoch 2848... +Train. Iter 2848 : Commit. 0.00002 PPL. 943.11 Recons. 0.01462 +Start training Epoch 2849... +Train. Iter 2849 : Commit. 0.00002 PPL. 944.98 Recons. 0.01455 +Start training Epoch 2850... +Train. Iter 2850 : Commit. 0.00002 PPL. 943.09 Recons. 0.01454 +Check if save...? +----saved---- +Start training Epoch 2851... +Train. Iter 2851 : Commit. 0.00002 PPL. 942.48 Recons. 0.01460 +Start training Epoch 2852... +Train. Iter 2852 : Commit. 0.00002 PPL. 942.96 Recons. 0.01460 +Start training Epoch 2853... +Train. Iter 2853 : Commit. 0.00002 PPL. 945.00 Recons. 0.01469 +Start training Epoch 2854... +Train. Iter 2854 : Commit. 0.00002 PPL. 950.88 Recons. 0.01475 +Start training Epoch 2855... +Train. Iter 2855 : Commit. 0.00002 PPL. 947.86 Recons. 0.01465 +Start training Epoch 2856... +Train. Iter 2856 : Commit. 0.00002 PPL. 947.83 Recons. 0.01457 +Start training Epoch 2857... +Train. Iter 2857 : Commit. 0.00002 PPL. 944.87 Recons. 0.01458 +Start training Epoch 2858... +Train. Iter 2858 : Commit. 0.00002 PPL. 942.93 Recons. 0.01457 +Start training Epoch 2859... +Train. Iter 2859 : Commit. 0.00002 PPL. 944.56 Recons. 0.01458 +Start training Epoch 2860... +Train. Iter 2860 : Commit. 0.00002 PPL. 950.03 Recons. 0.01465 +Check if save...? +Start training Epoch 2861... +Train. Iter 2861 : Commit. 0.00002 PPL. 948.39 Recons. 0.01460 +Start training Epoch 2862... +Train. Iter 2862 : Commit. 0.00002 PPL. 946.28 Recons. 0.01476 +Start training Epoch 2863... +Train. Iter 2863 : Commit. 0.00002 PPL. 943.32 Recons. 0.01457 +Start training Epoch 2864... +Train. Iter 2864 : Commit. 0.00002 PPL. 940.89 Recons. 0.01463 +Start training Epoch 2865... +Train. Iter 2865 : Commit. 0.00002 PPL. 942.66 Recons. 0.01457 +Start training Epoch 2866... +Train. Iter 2866 : Commit. 0.00002 PPL. 941.41 Recons. 0.01460 +Start training Epoch 2867... +Train. Iter 2867 : Commit. 0.00002 PPL. 941.94 Recons. 0.01458 +Start training Epoch 2868... +Train. Iter 2868 : Commit. 0.00002 PPL. 942.98 Recons. 0.01465 +Start training Epoch 2869... +Train. Iter 2869 : Commit. 0.00002 PPL. 940.18 Recons. 0.01459 +Start training Epoch 2870... +Train. Iter 2870 : Commit. 0.00002 PPL. 940.33 Recons. 0.01480 +Check if save...? +Start training Epoch 2871... +Train. Iter 2871 : Commit. 0.00002 PPL. 939.73 Recons. 0.01458 +Start training Epoch 2872... +Train. Iter 2872 : Commit. 0.00002 PPL. 943.17 Recons. 0.01455 +Start training Epoch 2873... +Train. Iter 2873 : Commit. 0.00002 PPL. 942.38 Recons. 0.01458 +Start training Epoch 2874... +Train. Iter 2874 : Commit. 0.00002 PPL. 939.05 Recons. 0.01452 +Start training Epoch 2875... +Train. Iter 2875 : Commit. 0.00002 PPL. 938.75 Recons. 0.01461 +Start training Epoch 2876... +Train. Iter 2876 : Commit. 0.00002 PPL. 940.88 Recons. 0.01455 +Start training Epoch 2877... +Train. Iter 2877 : Commit. 0.00002 PPL. 939.92 Recons. 0.01456 +Start training Epoch 2878... +Train. Iter 2878 : Commit. 0.00002 PPL. 939.00 Recons. 0.01451 +Start training Epoch 2879... +Train. Iter 2879 : Commit. 0.00002 PPL. 936.65 Recons. 0.01459 +Start training Epoch 2880... +Train. Iter 2880 : Commit. 0.00002 PPL. 942.42 Recons. 0.01457 +Check if save...? +Start training Epoch 2881... +Train. Iter 2881 : Commit. 0.00002 PPL. 941.51 Recons. 0.01455 +Start training Epoch 2882... +Train. Iter 2882 : Commit. 0.00002 PPL. 944.92 Recons. 0.01467 +Start training Epoch 2883... +Train. Iter 2883 : Commit. 0.00002 PPL. 940.78 Recons. 0.01448 +Start training Epoch 2884... +Train. Iter 2884 : Commit. 0.00002 PPL. 938.46 Recons. 0.01455 +Start training Epoch 2885... +Train. Iter 2885 : Commit. 0.00002 PPL. 946.32 Recons. 0.01454 +Start training Epoch 2886... +Train. Iter 2886 : Commit. 0.00002 PPL. 945.42 Recons. 0.01452 +Start training Epoch 2887... +Train. Iter 2887 : Commit. 0.00002 PPL. 943.12 Recons. 0.01453 +Start training Epoch 2888... +Train. Iter 2888 : Commit. 0.00002 PPL. 942.42 Recons. 0.01453 +Start training Epoch 2889... +Train. Iter 2889 : Commit. 0.00002 PPL. 939.64 Recons. 0.01454 +Start training Epoch 2890... +Train. Iter 2890 : Commit. 0.00002 PPL. 939.25 Recons. 0.01453 +Check if save...? +----saved---- +Start training Epoch 2891... +Train. Iter 2891 : Commit. 0.00002 PPL. 941.18 Recons. 0.01453 +Start training Epoch 2892... +Train. Iter 2892 : Commit. 0.00002 PPL. 937.29 Recons. 0.01452 +Start training Epoch 2893... +Train. Iter 2893 : Commit. 0.00002 PPL. 943.09 Recons. 0.01454 +Start training Epoch 2894... +Train. Iter 2894 : Commit. 0.00002 PPL. 942.78 Recons. 0.01464 +Start training Epoch 2895... +Train. Iter 2895 : Commit. 0.00002 PPL. 941.62 Recons. 0.01449 +Start training Epoch 2896... +Train. Iter 2896 : Commit. 0.00002 PPL. 939.47 Recons. 0.01455 +Start training Epoch 2897... +Train. Iter 2897 : Commit. 0.00002 PPL. 938.15 Recons. 0.01456 +Start training Epoch 2898... +Train. Iter 2898 : Commit. 0.00002 PPL. 940.45 Recons. 0.01452 +Start training Epoch 2899... +Train. Iter 2899 : Commit. 0.00002 PPL. 936.16 Recons. 0.01473 +Start training Epoch 2900... +Train. Iter 2900 : Commit. 0.00002 PPL. 942.44 Recons. 0.01457 +Check if save...? +Start training Epoch 2901... +Train. Iter 2901 : Commit. 0.00002 PPL. 939.62 Recons. 0.01459 +Start training Epoch 2902... +Train. Iter 2902 : Commit. 0.00002 PPL. 942.93 Recons. 0.01463 +Start training Epoch 2903... +Train. Iter 2903 : Commit. 0.00002 PPL. 942.71 Recons. 0.01460 +Start training Epoch 2904... +Train. Iter 2904 : Commit. 0.00002 PPL. 941.25 Recons. 0.01457 +Start training Epoch 2905... +Train. Iter 2905 : Commit. 0.00002 PPL. 941.56 Recons. 0.01458 +Start training Epoch 2906... +Train. Iter 2906 : Commit. 0.00002 PPL. 943.53 Recons. 0.01457 +Start training Epoch 2907... +Train. Iter 2907 : Commit. 0.00002 PPL. 946.91 Recons. 0.01454 +Start training Epoch 2908... +Train. Iter 2908 : Commit. 0.00002 PPL. 943.88 Recons. 0.01465 +Start training Epoch 2909... +Train. Iter 2909 : Commit. 0.00002 PPL. 949.84 Recons. 0.01455 +Start training Epoch 2910... +Train. Iter 2910 : Commit. 0.00002 PPL. 948.55 Recons. 0.01455 +Check if save...? +Start training Epoch 2911... +Train. Iter 2911 : Commit. 0.00002 PPL. 948.00 Recons. 0.01457 +Start training Epoch 2912... +Train. Iter 2912 : Commit. 0.00002 PPL. 944.05 Recons. 0.01452 +Start training Epoch 2913... +Train. Iter 2913 : Commit. 0.00002 PPL. 942.47 Recons. 0.01457 +Start training Epoch 2914... +Train. Iter 2914 : Commit. 0.00002 PPL. 940.60 Recons. 0.01465 +Start training Epoch 2915... +Train. Iter 2915 : Commit. 0.00002 PPL. 938.93 Recons. 0.01456 +Start training Epoch 2916... +Train. Iter 2916 : Commit. 0.00002 PPL. 943.09 Recons. 0.01460 +Start training Epoch 2917... +Train. Iter 2917 : Commit. 0.00002 PPL. 940.34 Recons. 0.01457 +Start training Epoch 2918... +Train. Iter 2918 : Commit. 0.00002 PPL. 939.70 Recons. 0.01455 +Start training Epoch 2919... +Train. Iter 2919 : Commit. 0.00002 PPL. 944.93 Recons. 0.01455 +Start training Epoch 2920... +Train. Iter 2920 : Commit. 0.00002 PPL. 941.76 Recons. 0.01458 +Check if save...? +Start training Epoch 2921... +Train. Iter 2921 : Commit. 0.00002 PPL. 938.44 Recons. 0.01453 +Start training Epoch 2922... +Train. Iter 2922 : Commit. 0.00002 PPL. 939.45 Recons. 0.01475 +Start training Epoch 2923... +Train. Iter 2923 : Commit. 0.00002 PPL. 939.37 Recons. 0.01462 +Start training Epoch 2924... +Train. Iter 2924 : Commit. 0.00002 PPL. 941.35 Recons. 0.01470 +Start training Epoch 2925... +Train. Iter 2925 : Commit. 0.00002 PPL. 940.69 Recons. 0.01453 +Start training Epoch 2926... +Train. Iter 2926 : Commit. 0.00002 PPL. 939.49 Recons. 0.01459 +Start training Epoch 2927... +Train. Iter 2927 : Commit. 0.00002 PPL. 941.87 Recons. 0.01455 +Start training Epoch 2928... +Train. Iter 2928 : Commit. 0.00002 PPL. 940.48 Recons. 0.01454 +Start training Epoch 2929... +Train. Iter 2929 : Commit. 0.00002 PPL. 938.84 Recons. 0.01456 +Start training Epoch 2930... +Train. Iter 2930 : Commit. 0.00002 PPL. 938.91 Recons. 0.01454 +Check if save...? +Start training Epoch 2931... +Train. Iter 2931 : Commit. 0.00002 PPL. 942.14 Recons. 0.01456 +Start training Epoch 2932... +Train. Iter 2932 : Commit. 0.00002 PPL. 939.06 Recons. 0.01455 +Start training Epoch 2933... +Train. Iter 2933 : Commit. 0.00002 PPL. 936.97 Recons. 0.01454 +Start training Epoch 2934... +Train. Iter 2934 : Commit. 0.00002 PPL. 936.93 Recons. 0.01452 +Start training Epoch 2935... +Train. Iter 2935 : Commit. 0.00002 PPL. 935.91 Recons. 0.01452 +Start training Epoch 2936... +Train. Iter 2936 : Commit. 0.00002 PPL. 932.78 Recons. 0.01453 +Start training Epoch 2937... +Train. Iter 2937 : Commit. 0.00002 PPL. 934.91 Recons. 0.01447 +Start training Epoch 2938... +Train. Iter 2938 : Commit. 0.00002 PPL. 935.98 Recons. 0.01455 +Start training Epoch 2939... +Train. Iter 2939 : Commit. 0.00002 PPL. 934.25 Recons. 0.01459 +Start training Epoch 2940... +Train. Iter 2940 : Commit. 0.00002 PPL. 932.73 Recons. 0.01450 +Check if save...? +----saved---- +Start training Epoch 2941... +Train. Iter 2941 : Commit. 0.00002 PPL. 934.09 Recons. 0.01452 +Start training Epoch 2942... +Train. Iter 2942 : Commit. 0.00002 PPL. 936.07 Recons. 0.01466 +Start training Epoch 2943... +Train. Iter 2943 : Commit. 0.00002 PPL. 934.72 Recons. 0.01460 +Start training Epoch 2944... +Train. Iter 2944 : Commit. 0.00002 PPL. 934.86 Recons. 0.01453 +Start training Epoch 2945... +Train. Iter 2945 : Commit. 0.00002 PPL. 935.11 Recons. 0.01457 +Start training Epoch 2946... +Train. Iter 2946 : Commit. 0.00002 PPL. 935.52 Recons. 0.01460 +Start training Epoch 2947... +Train. Iter 2947 : Commit. 0.00002 PPL. 937.18 Recons. 0.01450 +Start training Epoch 2948... +Train. Iter 2948 : Commit. 0.00002 PPL. 936.59 Recons. 0.01450 +Start training Epoch 2949... +Train. Iter 2949 : Commit. 0.00002 PPL. 937.36 Recons. 0.01446 +Start training Epoch 2950... +Train. Iter 2950 : Commit. 0.00002 PPL. 942.28 Recons. 0.01452 +Check if save...? +Start training Epoch 2951... +Train. Iter 2951 : Commit. 0.00002 PPL. 941.58 Recons. 0.01458 +Start training Epoch 2952... +Train. Iter 2952 : Commit. 0.00002 PPL. 939.13 Recons. 0.01455 +Start training Epoch 2953... +Train. Iter 2953 : Commit. 0.00002 PPL. 938.22 Recons. 0.01477 +Start training Epoch 2954... +Train. Iter 2954 : Commit. 0.00002 PPL. 940.71 Recons. 0.01451 +Start training Epoch 2955... +Train. Iter 2955 : Commit. 0.00002 PPL. 940.21 Recons. 0.01456 +Start training Epoch 2956... +Train. Iter 2956 : Commit. 0.00002 PPL. 942.34 Recons. 0.01455 +Start training Epoch 2957... +Train. Iter 2957 : Commit. 0.00002 PPL. 939.80 Recons. 0.01456 +Start training Epoch 2958... +Train. Iter 2958 : Commit. 0.00002 PPL. 942.48 Recons. 0.01464 +Start training Epoch 2959... +Train. Iter 2959 : Commit. 0.00002 PPL. 942.15 Recons. 0.01452 +Start training Epoch 2960... +Train. Iter 2960 : Commit. 0.00002 PPL. 937.15 Recons. 0.01452 +Check if save...? +Start training Epoch 2961... +Train. Iter 2961 : Commit. 0.00002 PPL. 938.52 Recons. 0.01453 +Start training Epoch 2962... +Train. Iter 2962 : Commit. 0.00002 PPL. 936.26 Recons. 0.01456 +Start training Epoch 2963... +Train. Iter 2963 : Commit. 0.00002 PPL. 942.58 Recons. 0.01465 +Start training Epoch 2964... +Train. Iter 2964 : Commit. 0.00002 PPL. 936.83 Recons. 0.01444 +Start training Epoch 2965... +Train. Iter 2965 : Commit. 0.00002 PPL. 935.35 Recons. 0.01457 +Start training Epoch 2966... +Train. Iter 2966 : Commit. 0.00002 PPL. 931.99 Recons. 0.01455 +Start training Epoch 2967... +Train. Iter 2967 : Commit. 0.00002 PPL. 929.94 Recons. 0.01453 +Start training Epoch 2968... +Train. Iter 2968 : Commit. 0.00002 PPL. 934.23 Recons. 0.01455 +Start training Epoch 2969... +Train. Iter 2969 : Commit. 0.00002 PPL. 931.80 Recons. 0.01450 +Start training Epoch 2970... +Train. Iter 2970 : Commit. 0.00002 PPL. 933.27 Recons. 0.01454 +Check if save...? +Start training Epoch 2971... +Train. Iter 2971 : Commit. 0.00002 PPL. 936.35 Recons. 0.01463 +Start training Epoch 2972... +Train. Iter 2972 : Commit. 0.00002 PPL. 938.92 Recons. 0.01452 +Start training Epoch 2973... +Train. Iter 2973 : Commit. 0.00002 PPL. 942.61 Recons. 0.01472 +Start training Epoch 2974... +Train. Iter 2974 : Commit. 0.00002 PPL. 940.26 Recons. 0.01458 +Start training Epoch 2975... +Train. Iter 2975 : Commit. 0.00002 PPL. 936.29 Recons. 0.01449 +Start training Epoch 2976... +Train. Iter 2976 : Commit. 0.00002 PPL. 935.91 Recons. 0.01460 +Start training Epoch 2977... +Train. Iter 2977 : Commit. 0.00002 PPL. 935.43 Recons. 0.01459 +Start training Epoch 2978... +Train. Iter 2978 : Commit. 0.00002 PPL. 940.37 Recons. 0.01462 +Start training Epoch 2979... +Train. Iter 2979 : Commit. 0.00002 PPL. 940.74 Recons. 0.01456 +Start training Epoch 2980... +Train. Iter 2980 : Commit. 0.00002 PPL. 938.47 Recons. 0.01451 +Check if save...? +Start training Epoch 2981... +Train. Iter 2981 : Commit. 0.00002 PPL. 938.97 Recons. 0.01450 +Start training Epoch 2982... +Train. Iter 2982 : Commit. 0.00002 PPL. 937.29 Recons. 0.01446 +Start training Epoch 2983... +Train. Iter 2983 : Commit. 0.00002 PPL. 936.76 Recons. 0.01447 +Start training Epoch 2984... +Train. Iter 2984 : Commit. 0.00002 PPL. 936.63 Recons. 0.01445 +Start training Epoch 2985... +Train. Iter 2985 : Commit. 0.00002 PPL. 934.63 Recons. 0.01451 +Start training Epoch 2986... +Train. Iter 2986 : Commit. 0.00002 PPL. 935.58 Recons. 0.01444 +Start training Epoch 2987... +Train. Iter 2987 : Commit. 0.00002 PPL. 934.57 Recons. 0.01449 +Start training Epoch 2988... +Train. Iter 2988 : Commit. 0.00002 PPL. 933.58 Recons. 0.01452 +Start training Epoch 2989... +Train. Iter 2989 : Commit. 0.00002 PPL. 935.01 Recons. 0.01447 +Start training Epoch 2990... +Train. Iter 2990 : Commit. 0.00002 PPL. 932.96 Recons. 0.01450 +Check if save...? +Start training Epoch 2991... +Train. Iter 2991 : Commit. 0.00002 PPL. 933.97 Recons. 0.01446 +Start training Epoch 2992... +Train. Iter 2992 : Commit. 0.00002 PPL. 933.80 Recons. 0.01447 +Start training Epoch 2993... +Train. Iter 2993 : Commit. 0.00002 PPL. 942.63 Recons. 0.01449 +Start training Epoch 2994... +Train. Iter 2994 : Commit. 0.00002 PPL. 936.79 Recons. 0.01449 +Start training Epoch 2995... +Train. Iter 2995 : Commit. 0.00002 PPL. 936.78 Recons. 0.01475 +Start training Epoch 2996... +Train. Iter 2996 : Commit. 0.00002 PPL. 937.59 Recons. 0.01460 +Start training Epoch 2997... +Train. Iter 2997 : Commit. 0.00002 PPL. 936.91 Recons. 0.01454 +Start training Epoch 2998... +Train. Iter 2998 : Commit. 0.00002 PPL. 935.72 Recons. 0.01458 +Start training Epoch 2999... +Train. Iter 2999 : Commit. 0.00002 PPL. 932.13 Recons. 0.01454 +Start training Epoch 3000... +Train. Iter 3000 : Commit. 0.00002 PPL. 929.90 Recons. 0.01455 +Check if save...?