seg_token_idx: 32000

Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards:  50%|█████     | 1/2 [00:05<00:05,  5.93s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00,  3.56s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:07<00:00,  3.92s/it]
trainable params: 4194304 || all params: 7709437489 || trainable%: 0.05440479939015691
Trainable parameters: 288,763,621
Loaded /workspace/SimToken/checkpoints/simtoken_pretrained.pth  missing=1191  unexpected=0

Epoch 1/5:   0%|          | 0/1177 [00:00<?, ?it/s]
Epoch 1/5:   0%|          | 0/1177 [00:41<?, ?it/s, exist=0.8225, loss=0.8868, lr=8.50e-08]
Epoch 1/5:   0%|          | 1/1177 [00:41<13:32:27, 41.45s/it, exist=0.8225, loss=0.8868, lr=8.50e-08]
Epoch 1/5:   0%|          | 1/1177 [00:50<13:32:27, 41.45s/it, exist=0.8051, loss=0.8705, lr=1.70e-07]
Epoch 1/5:   0%|          | 2/1177 [00:50<7:13:34, 22.14s/it, exist=0.8051, loss=0.8705, lr=1.70e-07] 
Epoch 1/5:   0%|          | 2/1177 [00:55<7:13:34, 22.14s/it, exist=0.8167, loss=0.9200, lr=2.55e-07]
Epoch 1/5:   0%|          | 3/1177 [00:55<4:42:27, 14.44s/it, exist=0.8167, loss=0.9200, lr=2.55e-07]
Epoch 1/5:   0%|          | 3/1177 [00:58<4:42:27, 14.44s/it, exist=0.7949, loss=0.9035, lr=3.40e-07]
Epoch 1/5:   0%|          | 4/1177 [00:58<3:17:14, 10.09s/it, exist=0.7949, loss=0.9035, lr=3.40e-07]
Epoch 1/5:   0%|          | 4/1177 [01:01<3:17:14, 10.09s/it, exist=0.7848, loss=0.8956, lr=4.25e-07]
Epoch 1/5:   0%|          | 5/1177 [01:01<2:25:24,  7.44s/it, exist=0.7848, loss=0.8956, lr=4.25e-07]
Epoch 1/5:   0%|          | 5/1177 [01:03<2:25:24,  7.44s/it, exist=0.7922, loss=0.9087, lr=5.10e-07]
Epoch 1/5:   1%|          | 6/1177 [01:03<1:51:51,  5.73s/it, exist=0.7922, loss=0.9087, lr=5.10e-07]
Epoch 1/5:   1%|          | 6/1177 [01:06<1:51:51,  5.73s/it, exist=0.7872, loss=0.8929, lr=5.95e-07]
Epoch 1/5:   1%|          | 7/1177 [01:06<1:33:24,  4.79s/it, exist=0.7872, loss=0.8929, lr=5.95e-07]
Epoch 1/5:   1%|          | 7/1177 [01:09<1:33:24,  4.79s/it, exist=0.7881, loss=0.8907, lr=6.80e-07]
Epoch 1/5:   1%|          | 8/1177 [01:09<1:22:38,  4.24s/it, exist=0.7881, loss=0.8907, lr=6.80e-07]
Epoch 1/5:   1%|          | 8/1177 [01:12<1:22:38,  4.24s/it, exist=0.7892, loss=0.8897, lr=7.65e-07]
Epoch 1/5:   1%|          | 9/1177 [01:12<1:10:01,  3.60s/it, exist=0.7892, loss=0.8897, lr=7.65e-07]
Epoch 1/5:   1%|          | 9/1177 [01:14<1:10:01,  3.60s/it, exist=0.7868, loss=0.8854, lr=8.50e-07]
Epoch 1/5:   1%|          | 10/1177 [01:14<1:05:02,  3.34s/it, exist=0.7868, loss=0.8854, lr=8.50e-07]
Epoch 1/5:   1%|          | 10/1177 [01:18<1:05:02,  3.34s/it, exist=0.7908, loss=0.8905, lr=9.35e-07]
Epoch 1/5:   1%|          | 11/1177 [01:18<1:05:20,  3.36s/it, exist=0.7908, loss=0.8905, lr=9.35e-07]
Epoch 1/5:   1%|          | 11/1177 [01:20<1:05:20,  3.36s/it, exist=0.7814, loss=0.8817, lr=1.02e-06]
Epoch 1/5:   1%|          | 12/1177 [01:20<1:01:21,  3.16s/it, exist=0.7814, loss=0.8817, lr=1.02e-06]
Epoch 1/5:   1%|          | 12/1177 [01:23<1:01:21,  3.16s/it, exist=0.7782, loss=0.8788, lr=1.11e-06]
Epoch 1/5:   1%|          | 13/1177 [01:23<1:00:02,  3.09s/it, exist=0.7782, loss=0.8788, lr=1.11e-06]
Epoch 1/5:   1%|          | 13/1177 [01:27<1:00:02,  3.09s/it, exist=0.7783, loss=0.8793, lr=1.19e-06]
Epoch 1/5:   1%|          | 14/1177 [01:27<1:05:02,  3.36s/it, exist=0.7783, loss=0.8793, lr=1.19e-06]
Epoch 1/5:   1%|          | 14/1177 [01:31<1:05:02,  3.36s/it, exist=0.7785, loss=0.8809, lr=1.28e-06]
Epoch 1/5:   1%|▏         | 15/1177 [01:31<1:05:28,  3.38s/it, exist=0.7785, loss=0.8809, lr=1.28e-06]
Epoch 1/5:   1%|▏         | 15/1177 [01:34<1:05:28,  3.38s/it, exist=0.7807, loss=0.8846, lr=1.36e-06]
Epoch 1/5:   1%|▏         | 16/1177 [01:34<1:02:43,  3.24s/it, exist=0.7807, loss=0.8846, lr=1.36e-06]
Epoch 1/5:   1%|▏         | 16/1177 [01:36<1:02:43,  3.24s/it, exist=0.7758, loss=0.8775, lr=1.45e-06]
Epoch 1/5:   1%|▏         | 17/1177 [01:36<59:45,  3.09s/it, exist=0.7758, loss=0.8775, lr=1.45e-06]  
Epoch 1/5:   1%|▏         | 17/1177 [01:39<59:45,  3.09s/it, exist=0.7716, loss=0.8783, lr=1.53e-06]
Epoch 1/5:   2%|▏         | 18/1177 [01:39<56:44,  2.94s/it, exist=0.7716, loss=0.8783, lr=1.53e-06]
Epoch 1/5:   2%|▏         | 18/1177 [01:41<56:44,  2.94s/it, exist=0.7693, loss=0.8803, lr=1.62e-06]
Epoch 1/5:   2%|▏         | 19/1177 [01:41<51:42,  2.68s/it, exist=0.7693, loss=0.8803, lr=1.62e-06]
Epoch 1/5:   2%|▏         | 19/1177 [01:44<51:42,  2.68s/it, exist=0.7688, loss=0.8773, lr=1.70e-06]
Epoch 1/5:   2%|▏         | 20/1177 [01:44<53:34,  2.78s/it, exist=0.7688, loss=0.8773, lr=1.70e-06]
Epoch 1/5:   2%|▏         | 20/1177 [01:48<53:34,  2.78s/it, exist=0.7722, loss=0.8783, lr=1.79e-06]
Epoch 1/5:   2%|▏         | 21/1177 [01:48<1:00:06,  3.12s/it, exist=0.7722, loss=0.8783, lr=1.79e-06]
Epoch 1/5:   2%|▏         | 21/1177 [01:52<1:00:06,  3.12s/it, exist=0.7704, loss=0.8779, lr=1.87e-06]
Epoch 1/5:   2%|▏         | 22/1177 [01:52<1:05:48,  3.42s/it, exist=0.7704, loss=0.8779, lr=1.87e-06]
Epoch 1/5:   2%|▏         | 22/1177 [01:55<1:05:48,  3.42s/it, exist=0.7722, loss=0.8780, lr=1.96e-06]
Epoch 1/5:   2%|▏         | 23/1177 [01:55<1:01:46,  3.21s/it, exist=0.7722, loss=0.8780, lr=1.96e-06]
Epoch 1/5:   2%|▏         | 23/1177 [01:57<1:01:46,  3.21s/it, exist=0.7708, loss=0.8795, lr=2.04e-06]
Epoch 1/5:   2%|▏         | 24/1177 [01:57<55:04,  2.87s/it, exist=0.7708, loss=0.8795, lr=2.04e-06]  
Epoch 1/5:   2%|▏         | 24/1177 [02:00<55:04,  2.87s/it, exist=0.7706, loss=0.8804, lr=2.13e-06]
Epoch 1/5:   2%|▏         | 25/1177 [02:00<54:27,  2.84s/it, exist=0.7706, loss=0.8804, lr=2.13e-06]
Epoch 1/5:   2%|▏         | 25/1177 [02:02<54:27,  2.84s/it, exist=0.7715, loss=0.8837, lr=2.21e-06]
Epoch 1/5:   2%|▏         | 26/1177 [02:02<50:25,  2.63s/it, exist=0.7715, loss=0.8837, lr=2.21e-06]
Epoch 1/5:   2%|▏         | 26/1177 [02:04<50:25,  2.63s/it, exist=0.7729, loss=0.8823, lr=2.30e-06]
Epoch 1/5:   2%|▏         | 27/1177 [02:04<47:08,  2.46s/it, exist=0.7729, loss=0.8823, lr=2.30e-06]
Epoch 1/5:   2%|▏         | 27/1177 [02:08<47:08,  2.46s/it, exist=0.7738, loss=0.8818, lr=2.38e-06]
Epoch 1/5:   2%|▏         | 28/1177 [02:08<54:15,  2.83s/it, exist=0.7738, loss=0.8818, lr=2.38e-06]
Epoch 1/5:   2%|▏         | 28/1177 [02:11<54:15,  2.83s/it, exist=0.7778, loss=0.8861, lr=2.47e-06]
Epoch 1/5:   2%|▏         | 29/1177 [02:11<56:04,  2.93s/it, exist=0.7778, loss=0.8861, lr=2.47e-06]
Epoch 1/5:   2%|▏         | 29/1177 [02:14<56:04,  2.93s/it, exist=0.7783, loss=0.8875, lr=2.55e-06]
Epoch 1/5:   3%|▎         | 30/1177 [02:14<56:04,  2.93s/it, exist=0.7783, loss=0.8875, lr=2.55e-06]
Epoch 1/5:   3%|▎         | 30/1177 [02:17<56:04,  2.93s/it, exist=0.7783, loss=0.8867, lr=2.64e-06]
Epoch 1/5:   3%|▎         | 31/1177 [02:17<57:02,  2.99s/it, exist=0.7783, loss=0.8867, lr=2.64e-06]
Epoch 1/5:   3%|▎         | 31/1177 [02:19<57:02,  2.99s/it, exist=0.7805, loss=0.8933, lr=2.72e-06]
Epoch 1/5:   3%|▎         | 32/1177 [02:19<51:30,  2.70s/it, exist=0.7805, loss=0.8933, lr=2.72e-06]
Epoch 1/5:   3%|▎         | 32/1177 [02:21<51:30,  2.70s/it, exist=0.7788, loss=0.8894, lr=2.81e-06]
Epoch 1/5:   3%|▎         | 33/1177 [02:21<49:35,  2.60s/it, exist=0.7788, loss=0.8894, lr=2.81e-06]
Epoch 1/5:   3%|▎         | 33/1177 [02:23<49:35,  2.60s/it, exist=0.7765, loss=0.8857, lr=2.89e-06]
Epoch 1/5:   3%|▎         | 34/1177 [02:23<46:05,  2.42s/it, exist=0.7765, loss=0.8857, lr=2.89e-06]
Epoch 1/5:   3%|▎         | 34/1177 [02:26<46:05,  2.42s/it, exist=0.7786, loss=0.8866, lr=2.98e-06]
Epoch 1/5:   3%|▎         | 35/1177 [02:26<50:29,  2.65s/it, exist=0.7786, loss=0.8866, lr=2.98e-06]
Epoch 1/5:   3%|▎         | 35/1177 [02:29<50:29,  2.65s/it, exist=0.7789, loss=0.8902, lr=3.06e-06]
Epoch 1/5:   3%|▎         | 36/1177 [02:29<50:16,  2.64s/it, exist=0.7789, loss=0.8902, lr=3.06e-06]
Epoch 1/5:   3%|▎         | 36/1177 [02:31<50:16,  2.64s/it, exist=0.7789, loss=0.8906, lr=3.15e-06]
Epoch 1/5:   3%|▎         | 37/1177 [02:31<46:29,  2.45s/it, exist=0.7789, loss=0.8906, lr=3.15e-06]
Epoch 1/5:   3%|▎         | 37/1177 [02:33<46:29,  2.45s/it, exist=0.7779, loss=0.8879, lr=3.23e-06]
Epoch 1/5:   3%|▎         | 38/1177 [02:33<43:41,  2.30s/it, exist=0.7779, loss=0.8879, lr=3.23e-06]
Epoch 1/5:   3%|▎         | 38/1177 [02:36<43:41,  2.30s/it, exist=0.7791, loss=0.8875, lr=3.32e-06]
Epoch 1/5:   3%|▎         | 39/1177 [02:36<46:15,  2.44s/it, exist=0.7791, loss=0.8875, lr=3.32e-06]
Epoch 1/5:   3%|▎         | 39/1177 [02:39<46:15,  2.44s/it, exist=0.7784, loss=0.8884, lr=3.40e-06]
Epoch 1/5:   3%|▎         | 40/1177 [02:39<51:04,  2.70s/it, exist=0.7784, loss=0.8884, lr=3.40e-06]
Epoch 1/5:   3%|▎         | 40/1177 [02:42<51:04,  2.70s/it, exist=0.7797, loss=0.8902, lr=3.49e-06]
Epoch 1/5:   3%|▎         | 41/1177 [02:42<51:01,  2.70s/it, exist=0.7797, loss=0.8902, lr=3.49e-06]
Epoch 1/5:   3%|▎         | 41/1177 [02:45<51:01,  2.70s/it, exist=0.7803, loss=0.8894, lr=3.57e-06]
Epoch 1/5:   4%|▎         | 42/1177 [02:45<53:49,  2.84s/it, exist=0.7803, loss=0.8894, lr=3.57e-06]
Epoch 1/5:   4%|▎         | 42/1177 [02:48<53:49,  2.84s/it, exist=0.7824, loss=0.8909, lr=3.66e-06]
Epoch 1/5:   4%|▎         | 43/1177 [02:48<53:58,  2.86s/it, exist=0.7824, loss=0.8909, lr=3.66e-06]
Epoch 1/5:   4%|▎         | 43/1177 [02:50<53:58,  2.86s/it, exist=0.7844, loss=0.8928, lr=3.74e-06]
Epoch 1/5:   4%|▎         | 44/1177 [02:50<52:46,  2.80s/it, exist=0.7844, loss=0.8928, lr=3.74e-06]
Epoch 1/5:   4%|▎         | 44/1177 [02:52<52:46,  2.80s/it, exist=0.7860, loss=0.8933, lr=3.83e-06]
Epoch 1/5:   4%|▍         | 45/1177 [02:52<48:09,  2.55s/it, exist=0.7860, loss=0.8933, lr=3.83e-06]
Epoch 1/5:   4%|▍         | 45/1177 [02:56<48:09,  2.55s/it, exist=0.7867, loss=0.8928, lr=3.91e-06]
Epoch 1/5:   4%|▍         | 46/1177 [02:56<52:46,  2.80s/it, exist=0.7867, loss=0.8928, lr=3.91e-06]
Epoch 1/5:   4%|▍         | 46/1177 [02:58<52:46,  2.80s/it, exist=0.7848, loss=0.8897, lr=4.00e-06]
Epoch 1/5:   4%|▍         | 47/1177 [02:58<48:09,  2.56s/it, exist=0.7848, loss=0.8897, lr=4.00e-06]
Epoch 1/5:   4%|▍         | 47/1177 [03:00<48:09,  2.56s/it, exist=0.7838, loss=0.8888, lr=4.08e-06]
Epoch 1/5:   4%|▍         | 48/1177 [03:00<47:31,  2.53s/it, exist=0.7838, loss=0.8888, lr=4.08e-06]
Epoch 1/5:   4%|▍         | 48/1177 [03:02<47:31,  2.53s/it, exist=0.7822, loss=0.8864, lr=4.17e-06]
Epoch 1/5:   4%|▍         | 49/1177 [03:02<44:26,  2.36s/it, exist=0.7822, loss=0.8864, lr=4.17e-06]
Epoch 1/5:   4%|▍         | 49/1177 [03:06<44:26,  2.36s/it, exist=0.7829, loss=0.8869, lr=4.25e-06]
Epoch 1/5:   4%|▍         | 50/1177 [03:06<50:38,  2.70s/it, exist=0.7829, loss=0.8869, lr=4.25e-06]
Epoch 1/5:   4%|▍         | 50/1177 [03:08<50:38,  2.70s/it, exist=0.7836, loss=0.8870, lr=4.34e-06]
Epoch 1/5:   4%|▍         | 51/1177 [03:08<50:21,  2.68s/it, exist=0.7836, loss=0.8870, lr=4.34e-06]
Epoch 1/5:   4%|▍         | 51/1177 [03:11<50:21,  2.68s/it, exist=0.7843, loss=0.8864, lr=4.42e-06]
Epoch 1/5:   4%|▍         | 52/1177 [03:11<51:45,  2.76s/it, exist=0.7843, loss=0.8864, lr=4.42e-06]
Epoch 1/5:   4%|▍         | 52/1177 [03:15<51:45,  2.76s/it, exist=0.7848, loss=0.8865, lr=4.51e-06]
Epoch 1/5:   5%|▍         | 53/1177 [03:15<56:31,  3.02s/it, exist=0.7848, loss=0.8865, lr=4.51e-06]
Epoch 1/5:   5%|▍         | 53/1177 [03:18<56:31,  3.02s/it, exist=0.7858, loss=0.8871, lr=4.59e-06]
Epoch 1/5:   5%|▍         | 54/1177 [03:18<57:55,  3.09s/it, exist=0.7858, loss=0.8871, lr=4.59e-06]
Epoch 1/5:   5%|▍         | 54/1177 [03:20<57:55,  3.09s/it, exist=0.7848, loss=0.8858, lr=4.68e-06]
Epoch 1/5:   5%|▍         | 55/1177 [03:20<51:36,  2.76s/it, exist=0.7848, loss=0.8858, lr=4.68e-06]
Epoch 1/5:   5%|▍         | 55/1177 [03:23<51:36,  2.76s/it, exist=0.7842, loss=0.8841, lr=4.76e-06]
Epoch 1/5:   5%|▍         | 56/1177 [03:23<50:48,  2.72s/it, exist=0.7842, loss=0.8841, lr=4.76e-06]
Epoch 1/5:   5%|▍         | 56/1177 [03:25<50:48,  2.72s/it, exist=0.7834, loss=0.8827, lr=4.85e-06]
Epoch 1/5:   5%|▍         | 57/1177 [03:25<49:58,  2.68s/it, exist=0.7834, loss=0.8827, lr=4.85e-06]
Epoch 1/5:   5%|▍         | 57/1177 [03:27<49:58,  2.68s/it, exist=0.7845, loss=0.8827, lr=4.93e-06]
Epoch 1/5:   5%|▍         | 58/1177 [03:27<46:05,  2.47s/it, exist=0.7845, loss=0.8827, lr=4.93e-06]
Epoch 1/5:   5%|▍         | 58/1177 [03:31<46:05,  2.47s/it, exist=0.7836, loss=0.8822, lr=5.02e-06]
Epoch 1/5:   5%|▌         | 59/1177 [03:31<50:14,  2.70s/it, exist=0.7836, loss=0.8822, lr=5.02e-06]
Epoch 1/5:   5%|▌         | 59/1177 [03:33<50:14,  2.70s/it, exist=0.7825, loss=0.8829, lr=5.10e-06]
Epoch 1/5:   5%|▌         | 60/1177 [03:33<49:46,  2.67s/it, exist=0.7825, loss=0.8829, lr=5.10e-06]
Epoch 1/5:   5%|▌         | 60/1177 [03:36<49:46,  2.67s/it, exist=0.7833, loss=0.8829, lr=5.19e-06]
Epoch 1/5:   5%|▌         | 61/1177 [03:36<49:31,  2.66s/it, exist=0.7833, loss=0.8829, lr=5.19e-06]
Epoch 1/5:   5%|▌         | 61/1177 [03:38<49:31,  2.66s/it, exist=0.7826, loss=0.8813, lr=5.27e-06]
Epoch 1/5:   5%|▌         | 62/1177 [03:38<48:54,  2.63s/it, exist=0.7826, loss=0.8813, lr=5.27e-06]
Epoch 1/5:   5%|▌         | 62/1177 [03:41<48:54,  2.63s/it, exist=0.7821, loss=0.8819, lr=5.36e-06]
Epoch 1/5:   5%|▌         | 63/1177 [03:41<48:52,  2.63s/it, exist=0.7821, loss=0.8819, lr=5.36e-06]
Epoch 1/5:   5%|▌         | 63/1177 [03:44<48:52,  2.63s/it, exist=0.7819, loss=0.8814, lr=5.44e-06]
Epoch 1/5:   5%|▌         | 64/1177 [03:44<48:37,  2.62s/it, exist=0.7819, loss=0.8814, lr=5.44e-06]
Epoch 1/5:   5%|▌         | 64/1177 [03:46<48:37,  2.62s/it, exist=0.7821, loss=0.8836, lr=5.53e-06]
Epoch 1/5:   6%|▌         | 65/1177 [03:46<49:41,  2.68s/it, exist=0.7821, loss=0.8836, lr=5.53e-06]
Epoch 1/5:   6%|▌         | 65/1177 [03:50<49:41,  2.68s/it, exist=0.7824, loss=0.8838, lr=5.61e-06]
Epoch 1/5:   6%|▌         | 66/1177 [03:50<53:49,  2.91s/it, exist=0.7824, loss=0.8838, lr=5.61e-06]
Epoch 1/5:   6%|▌         | 66/1177 [03:53<53:49,  2.91s/it, exist=0.7822, loss=0.8844, lr=5.70e-06]
Epoch 1/5:   6%|▌         | 67/1177 [03:53<54:03,  2.92s/it, exist=0.7822, loss=0.8844, lr=5.70e-06]
Epoch 1/5:   6%|▌         | 67/1177 [03:55<54:03,  2.92s/it, exist=0.7817, loss=0.8837, lr=5.78e-06]
Epoch 1/5:   6%|▌         | 68/1177 [03:55<48:56,  2.65s/it, exist=0.7817, loss=0.8837, lr=5.78e-06]
Epoch 1/5:   6%|▌         | 68/1177 [03:57<48:56,  2.65s/it, exist=0.7819, loss=0.8834, lr=5.87e-06]
Epoch 1/5:   6%|▌         | 69/1177 [03:57<48:50,  2.64s/it, exist=0.7819, loss=0.8834, lr=5.87e-06]
Epoch 1/5:   6%|▌         | 69/1177 [04:00<48:50,  2.64s/it, exist=0.7817, loss=0.8835, lr=5.95e-06]
Epoch 1/5:   6%|▌         | 70/1177 [04:00<48:38,  2.64s/it, exist=0.7817, loss=0.8835, lr=5.95e-06]
Epoch 1/5:   6%|▌         | 70/1177 [04:02<48:38,  2.64s/it, exist=0.7818, loss=0.8826, lr=6.04e-06]
Epoch 1/5:   6%|▌         | 71/1177 [04:02<45:09,  2.45s/it, exist=0.7818, loss=0.8826, lr=6.04e-06]
Epoch 1/5:   6%|▌         | 71/1177 [04:06<45:09,  2.45s/it, exist=0.7811, loss=0.8822, lr=6.12e-06]
Epoch 1/5:   6%|▌         | 72/1177 [04:06<51:56,  2.82s/it, exist=0.7811, loss=0.8822, lr=6.12e-06]
Epoch 1/5:   6%|▌         | 72/1177 [04:08<51:56,  2.82s/it, exist=0.7798, loss=0.8801, lr=6.21e-06]
Epoch 1/5:   6%|▌         | 73/1177 [04:08<47:20,  2.57s/it, exist=0.7798, loss=0.8801, lr=6.21e-06]
Epoch 1/5:   6%|▌         | 73/1177 [04:11<47:20,  2.57s/it, exist=0.7796, loss=0.8819, lr=6.29e-06]
Epoch 1/5:   6%|▋         | 74/1177 [04:11<51:51,  2.82s/it, exist=0.7796, loss=0.8819, lr=6.29e-06]
Epoch 1/5:   6%|▋         | 74/1177 [04:13<51:51,  2.82s/it, exist=0.7780, loss=0.8798, lr=6.38e-06]
Epoch 1/5:   6%|▋         | 75/1177 [04:13<46:56,  2.56s/it, exist=0.7780, loss=0.8798, lr=6.38e-06]
Epoch 1/5:   6%|▋         | 75/1177 [04:16<46:56,  2.56s/it, exist=0.7773, loss=0.8784, lr=6.46e-06]
Epoch 1/5:   6%|▋         | 76/1177 [04:16<50:35,  2.76s/it, exist=0.7773, loss=0.8784, lr=6.46e-06]
Epoch 1/5:   6%|▋         | 76/1177 [04:19<50:35,  2.76s/it, exist=0.7765, loss=0.8777, lr=6.55e-06]
Epoch 1/5:   7%|▋         | 77/1177 [04:19<49:47,  2.72s/it, exist=0.7765, loss=0.8777, lr=6.55e-06]
Epoch 1/5:   7%|▋         | 77/1177 [04:21<49:47,  2.72s/it, exist=0.7762, loss=0.8770, lr=6.63e-06]
Epoch 1/5:   7%|▋         | 78/1177 [04:21<46:02,  2.51s/it, exist=0.7762, loss=0.8770, lr=6.63e-06]
Epoch 1/5:   7%|▋         | 78/1177 [04:23<46:02,  2.51s/it, exist=0.7753, loss=0.8753, lr=6.72e-06]
Epoch 1/5:   7%|▋         | 79/1177 [04:23<45:51,  2.51s/it, exist=0.7753, loss=0.8753, lr=6.72e-06]
Epoch 1/5:   7%|▋         | 79/1177 [04:26<45:51,  2.51s/it, exist=0.7745, loss=0.8741, lr=6.80e-06]
Epoch 1/5:   7%|▋         | 80/1177 [04:26<47:03,  2.57s/it, exist=0.7745, loss=0.8741, lr=6.80e-06]
Epoch 1/5:   7%|▋         | 80/1177 [04:29<47:03,  2.57s/it, exist=0.7734, loss=0.8726, lr=6.89e-06]
Epoch 1/5:   7%|▋         | 81/1177 [04:29<46:19,  2.54s/it, exist=0.7734, loss=0.8726, lr=6.89e-06]
Epoch 1/5:   7%|▋         | 81/1177 [04:32<46:19,  2.54s/it, exist=0.7718, loss=0.8706, lr=6.97e-06]
Epoch 1/5:   7%|▋         | 82/1177 [04:32<49:49,  2.73s/it, exist=0.7718, loss=0.8706, lr=6.97e-06]
Epoch 1/5:   7%|▋         | 82/1177 [04:34<49:49,  2.73s/it, exist=0.7704, loss=0.8689, lr=7.06e-06]
Epoch 1/5:   7%|▋         | 83/1177 [04:34<45:45,  2.51s/it, exist=0.7704, loss=0.8689, lr=7.06e-06]
Epoch 1/5:   7%|▋         | 83/1177 [04:36<45:45,  2.51s/it, exist=0.7700, loss=0.8691, lr=7.14e-06]
Epoch 1/5:   7%|▋         | 84/1177 [04:36<46:17,  2.54s/it, exist=0.7700, loss=0.8691, lr=7.14e-06]
Epoch 1/5:   7%|▋         | 84/1177 [04:40<46:17,  2.54s/it, exist=0.7693, loss=0.8677, lr=7.23e-06]
Epoch 1/5:   7%|▋         | 85/1177 [04:40<49:59,  2.75s/it, exist=0.7693, loss=0.8677, lr=7.23e-06]
Epoch 1/5:   7%|▋         | 85/1177 [04:42<49:59,  2.75s/it, exist=0.7689, loss=0.8669, lr=7.31e-06]
Epoch 1/5:   7%|▋         | 86/1177 [04:42<49:04,  2.70s/it, exist=0.7689, loss=0.8669, lr=7.31e-06]
Epoch 1/5:   7%|▋         | 86/1177 [04:44<49:04,  2.70s/it, exist=0.7682, loss=0.8675, lr=7.40e-06]
Epoch 1/5:   7%|▋         | 87/1177 [04:44<45:04,  2.48s/it, exist=0.7682, loss=0.8675, lr=7.40e-06]
Epoch 1/5:   7%|▋         | 87/1177 [04:47<45:04,  2.48s/it, exist=0.7681, loss=0.8676, lr=7.48e-06]
Epoch 1/5:   7%|▋         | 88/1177 [04:47<48:31,  2.67s/it, exist=0.7681, loss=0.8676, lr=7.48e-06]
Epoch 1/5:   7%|▋         | 88/1177 [04:50<48:31,  2.67s/it, exist=0.7678, loss=0.8677, lr=7.57e-06]
Epoch 1/5:   8%|▊         | 89/1177 [04:50<48:22,  2.67s/it, exist=0.7678, loss=0.8677, lr=7.57e-06]
Epoch 1/5:   8%|▊         | 89/1177 [04:52<48:22,  2.67s/it, exist=0.7677, loss=0.8671, lr=7.65e-06]
Epoch 1/5:   8%|▊         | 90/1177 [04:52<44:54,  2.48s/it, exist=0.7677, loss=0.8671, lr=7.65e-06]
Epoch 1/5:   8%|▊         | 90/1177 [04:55<44:54,  2.48s/it, exist=0.7671, loss=0.8671, lr=7.74e-06]
Epoch 1/5:   8%|▊         | 91/1177 [04:55<48:28,  2.68s/it, exist=0.7671, loss=0.8671, lr=7.74e-06]
Epoch 1/5:   8%|▊         | 91/1177 [04:58<48:28,  2.68s/it, exist=0.7661, loss=0.8658, lr=7.82e-06]
Epoch 1/5:   8%|▊         | 92/1177 [04:58<47:48,  2.64s/it, exist=0.7661, loss=0.8658, lr=7.82e-06]
Epoch 1/5:   8%|▊         | 92/1177 [05:00<47:48,  2.64s/it, exist=0.7651, loss=0.8646, lr=7.91e-06]
Epoch 1/5:   8%|▊         | 93/1177 [05:00<44:20,  2.45s/it, exist=0.7651, loss=0.8646, lr=7.91e-06]
Epoch 1/5:   8%|▊         | 93/1177 [05:02<44:20,  2.45s/it, exist=0.7646, loss=0.8643, lr=7.99e-06]
Epoch 1/5:   8%|▊         | 94/1177 [05:02<41:36,  2.31s/it, exist=0.7646, loss=0.8643, lr=7.99e-06]
Epoch 1/5:   8%|▊         | 94/1177 [05:05<41:36,  2.31s/it, exist=0.7638, loss=0.8628, lr=8.08e-06]
Epoch 1/5:   8%|▊         | 95/1177 [05:05<46:23,  2.57s/it, exist=0.7638, loss=0.8628, lr=8.08e-06]
Epoch 1/5:   8%|▊         | 95/1177 [05:08<46:23,  2.57s/it, exist=0.7635, loss=0.8635, lr=8.16e-06]
Epoch 1/5:   8%|▊         | 96/1177 [05:08<46:26,  2.58s/it, exist=0.7635, loss=0.8635, lr=8.16e-06]
Epoch 1/5:   8%|▊         | 96/1177 [05:10<46:26,  2.58s/it, exist=0.7630, loss=0.8626, lr=8.25e-06]
Epoch 1/5:   8%|▊         | 97/1177 [05:10<46:53,  2.61s/it, exist=0.7630, loss=0.8626, lr=8.25e-06]
Epoch 1/5:   8%|▊         | 97/1177 [05:13<46:53,  2.61s/it, exist=0.7623, loss=0.8618, lr=8.33e-06]
Epoch 1/5:   8%|▊         | 98/1177 [05:13<46:16,  2.57s/it, exist=0.7623, loss=0.8618, lr=8.33e-06]
Epoch 1/5:   8%|▊         | 98/1177 [05:16<46:16,  2.57s/it, exist=0.7615, loss=0.8612, lr=8.42e-06]
Epoch 1/5:   8%|▊         | 99/1177 [05:16<51:02,  2.84s/it, exist=0.7615, loss=0.8612, lr=8.42e-06]
Epoch 1/5:   8%|▊         | 99/1177 [05:19<51:02,  2.84s/it, exist=0.7610, loss=0.8608, lr=8.50e-06]
Epoch 1/5:   8%|▊         | 100/1177 [05:19<51:36,  2.87s/it, exist=0.7610, loss=0.8608, lr=8.50e-06]
Epoch 1/5:   8%|▊         | 100/1177 [05:23<51:36,  2.87s/it, exist=0.7605, loss=0.8603, lr=8.59e-06]
Epoch 1/5:   9%|▊         | 101/1177 [05:23<56:35,  3.16s/it, exist=0.7605, loss=0.8603, lr=8.59e-06]
Epoch 1/5:   9%|▊         | 101/1177 [05:25<56:35,  3.16s/it, exist=0.7600, loss=0.8597, lr=8.67e-06]
Epoch 1/5:   9%|▊         | 102/1177 [05:25<52:57,  2.96s/it, exist=0.7600, loss=0.8597, lr=8.67e-06]
Epoch 1/5:   9%|▊         | 102/1177 [05:28<52:57,  2.96s/it, exist=0.7590, loss=0.8585, lr=8.76e-06]
Epoch 1/5:   9%|▉         | 103/1177 [05:28<50:01,  2.79s/it, exist=0.7590, loss=0.8585, lr=8.76e-06]
Epoch 1/5:   9%|▉         | 103/1177 [05:30<50:01,  2.79s/it, exist=0.7581, loss=0.8586, lr=8.84e-06]
Epoch 1/5:   9%|▉         | 104/1177 [05:30<45:46,  2.56s/it, exist=0.7581, loss=0.8586, lr=8.84e-06]
Epoch 1/5:   9%|▉         | 104/1177 [05:33<45:46,  2.56s/it, exist=0.7575, loss=0.8577, lr=8.93e-06]
Epoch 1/5:   9%|▉         | 105/1177 [05:33<46:52,  2.62s/it, exist=0.7575, loss=0.8577, lr=8.93e-06]
Epoch 1/5:   9%|▉         | 105/1177 [05:35<46:52,  2.62s/it, exist=0.7568, loss=0.8567, lr=9.01e-06]
Epoch 1/5:   9%|▉         | 106/1177 [05:35<44:07,  2.47s/it, exist=0.7568, loss=0.8567, lr=9.01e-06]
Epoch 1/5:   9%|▉         | 106/1177 [05:38<44:07,  2.47s/it, exist=0.7564, loss=0.8558, lr=9.10e-06]
Epoch 1/5:   9%|▉         | 107/1177 [05:38<48:33,  2.72s/it, exist=0.7564, loss=0.8558, lr=9.10e-06]
Epoch 1/5:   9%|▉         | 107/1177 [05:41<48:33,  2.72s/it, exist=0.7556, loss=0.8545, lr=9.18e-06]
Epoch 1/5:   9%|▉         | 108/1177 [05:41<51:09,  2.87s/it, exist=0.7556, loss=0.8545, lr=9.18e-06]
Epoch 1/5:   9%|▉         | 108/1177 [05:44<51:09,  2.87s/it, exist=0.7545, loss=0.8530, lr=9.27e-06]
Epoch 1/5:   9%|▉         | 109/1177 [05:44<48:41,  2.74s/it, exist=0.7545, loss=0.8530, lr=9.27e-06]
Epoch 1/5:   9%|▉         | 109/1177 [05:46<48:41,  2.74s/it, exist=0.7537, loss=0.8526, lr=9.35e-06]
Epoch 1/5:   9%|▉         | 110/1177 [05:46<44:33,  2.51s/it, exist=0.7537, loss=0.8526, lr=9.35e-06]
Epoch 1/5:   9%|▉         | 110/1177 [05:48<44:33,  2.51s/it, exist=0.7530, loss=0.8514, lr=9.44e-06]
Epoch 1/5:   9%|▉         | 111/1177 [05:48<45:40,  2.57s/it, exist=0.7530, loss=0.8514, lr=9.44e-06]
Epoch 1/5:   9%|▉         | 111/1177 [05:51<45:40,  2.57s/it, exist=0.7523, loss=0.8510, lr=9.52e-06]
Epoch 1/5:  10%|▉         | 112/1177 [05:51<45:29,  2.56s/it, exist=0.7523, loss=0.8510, lr=9.52e-06]
Epoch 1/5:  10%|▉         | 112/1177 [05:54<45:29,  2.56s/it, exist=0.7512, loss=0.8505, lr=9.61e-06]
Epoch 1/5:  10%|▉         | 113/1177 [05:54<48:18,  2.72s/it, exist=0.7512, loss=0.8505, lr=9.61e-06]
Epoch 1/5:  10%|▉         | 113/1177 [05:56<48:18,  2.72s/it, exist=0.7508, loss=0.8495, lr=9.69e-06]
Epoch 1/5:  10%|▉         | 114/1177 [05:56<44:06,  2.49s/it, exist=0.7508, loss=0.8495, lr=9.69e-06]
Epoch 1/5:  10%|▉         | 114/1177 [05:59<44:06,  2.49s/it, exist=0.7502, loss=0.8497, lr=9.78e-06]
Epoch 1/5:  10%|▉         | 115/1177 [05:59<44:24,  2.51s/it, exist=0.7502, loss=0.8497, lr=9.78e-06]
Epoch 1/5:  10%|▉         | 115/1177 [06:02<44:24,  2.51s/it, exist=0.7495, loss=0.8488, lr=9.86e-06]
Epoch 1/5:  10%|▉         | 116/1177 [06:02<48:11,  2.73s/it, exist=0.7495, loss=0.8488, lr=9.86e-06]
Epoch 1/5:  10%|▉         | 116/1177 [06:05<48:11,  2.73s/it, exist=0.7489, loss=0.8478, lr=9.95e-06]
Epoch 1/5:  10%|▉         | 117/1177 [06:05<49:01,  2.78s/it, exist=0.7489, loss=0.8478, lr=9.95e-06]
Epoch 1/5:  10%|▉         | 117/1177 [06:07<49:01,  2.78s/it, exist=0.7483, loss=0.8469, lr=1.00e-05]
Epoch 1/5:  10%|█         | 118/1177 [06:07<44:56,  2.55s/it, exist=0.7483, loss=0.8469, lr=1.00e-05]
Epoch 1/5:  10%|█         | 118/1177 [06:10<44:56,  2.55s/it, exist=0.7474, loss=0.8462, lr=1.01e-05]
Epoch 1/5:  10%|█         | 119/1177 [06:10<49:25,  2.80s/it, exist=0.7474, loss=0.8462, lr=1.01e-05]
Epoch 1/5:  10%|█         | 119/1177 [06:13<49:25,  2.80s/it, exist=0.7462, loss=0.8448, lr=1.02e-05]
Epoch 1/5:  10%|█         | 120/1177 [06:13<48:10,  2.73s/it, exist=0.7462, loss=0.8448, lr=1.02e-05]
Epoch 1/5:  10%|█         | 120/1177 [06:16<48:10,  2.73s/it, exist=0.7455, loss=0.8446, lr=1.03e-05]
Epoch 1/5:  10%|█         | 121/1177 [06:16<48:57,  2.78s/it, exist=0.7455, loss=0.8446, lr=1.03e-05]
Epoch 1/5:  10%|█         | 121/1177 [06:18<48:57,  2.78s/it, exist=0.7446, loss=0.8435, lr=1.04e-05]
Epoch 1/5:  10%|█         | 122/1177 [06:18<48:04,  2.73s/it, exist=0.7446, loss=0.8435, lr=1.04e-05]
Epoch 1/5:  10%|█         | 122/1177 [06:21<48:04,  2.73s/it, exist=0.7437, loss=0.8421, lr=1.05e-05]
Epoch 1/5:  10%|█         | 123/1177 [06:21<48:55,  2.79s/it, exist=0.7437, loss=0.8421, lr=1.05e-05]
Epoch 1/5:  10%|█         | 123/1177 [06:23<48:55,  2.79s/it, exist=0.7433, loss=0.8416, lr=1.05e-05]
Epoch 1/5:  11%|█         | 124/1177 [06:23<45:43,  2.61s/it, exist=0.7433, loss=0.8416, lr=1.05e-05]
Epoch 1/5:  11%|█         | 124/1177 [06:26<45:43,  2.61s/it, exist=0.7427, loss=0.8409, lr=1.06e-05]
Epoch 1/5:  11%|█         | 125/1177 [06:26<45:53,  2.62s/it, exist=0.7427, loss=0.8409, lr=1.06e-05]
Epoch 1/5:  11%|█         | 125/1177 [06:29<45:53,  2.62s/it, exist=0.7413, loss=0.8398, lr=1.07e-05]
Epoch 1/5:  11%|█         | 126/1177 [06:29<48:26,  2.77s/it, exist=0.7413, loss=0.8398, lr=1.07e-05]
Epoch 1/5:  11%|█         | 126/1177 [06:32<48:26,  2.77s/it, exist=0.7401, loss=0.8389, lr=1.08e-05]
Epoch 1/5:  11%|█         | 127/1177 [06:32<49:15,  2.81s/it, exist=0.7401, loss=0.8389, lr=1.08e-05]
Epoch 1/5:  11%|█         | 127/1177 [06:34<49:15,  2.81s/it, exist=0.7387, loss=0.8382, lr=1.09e-05]
Epoch 1/5:  11%|█         | 128/1177 [06:34<47:37,  2.72s/it, exist=0.7387, loss=0.8382, lr=1.09e-05]
Epoch 1/5:  11%|█         | 128/1177 [06:37<47:37,  2.72s/it, exist=0.7380, loss=0.8377, lr=1.10e-05]
Epoch 1/5:  11%|█         | 129/1177 [06:37<48:09,  2.76s/it, exist=0.7380, loss=0.8377, lr=1.10e-05]
Epoch 1/5:  11%|█         | 129/1177 [06:40<48:09,  2.76s/it, exist=0.7370, loss=0.8367, lr=1.11e-05]
Epoch 1/5:  11%|█         | 130/1177 [06:40<47:27,  2.72s/it, exist=0.7370, loss=0.8367, lr=1.11e-05]
Epoch 1/5:  11%|█         | 130/1177 [06:43<47:27,  2.72s/it, exist=0.7368, loss=0.8368, lr=1.11e-05]
Epoch 1/5:  11%|█         | 131/1177 [06:43<47:49,  2.74s/it, exist=0.7368, loss=0.8368, lr=1.11e-05]
Epoch 1/5:  11%|█         | 131/1177 [06:45<47:49,  2.74s/it, exist=0.7359, loss=0.8356, lr=1.12e-05]
Epoch 1/5:  11%|█         | 132/1177 [06:45<43:43,  2.51s/it, exist=0.7359, loss=0.8356, lr=1.12e-05]
Epoch 1/5:  11%|█         | 132/1177 [06:48<43:43,  2.51s/it, exist=0.7350, loss=0.8358, lr=1.13e-05]
Epoch 1/5:  11%|█▏        | 133/1177 [06:48<47:27,  2.73s/it, exist=0.7350, loss=0.8358, lr=1.13e-05]
Epoch 1/5:  11%|█▏        | 133/1177 [06:50<47:27,  2.73s/it, exist=0.7347, loss=0.8376, lr=1.14e-05]
Epoch 1/5:  11%|█▏        | 134/1177 [06:50<46:21,  2.67s/it, exist=0.7347, loss=0.8376, lr=1.14e-05]
Epoch 1/5:  11%|█▏        | 134/1177 [06:53<46:21,  2.67s/it, exist=0.7334, loss=0.8365, lr=1.15e-05]
Epoch 1/5:  11%|█▏        | 135/1177 [06:53<47:19,  2.72s/it, exist=0.7334, loss=0.8365, lr=1.15e-05]
Epoch 1/5:  11%|█▏        | 135/1177 [06:56<47:19,  2.72s/it, exist=0.7323, loss=0.8354, lr=1.16e-05]
Epoch 1/5:  12%|█▏        | 136/1177 [06:56<46:32,  2.68s/it, exist=0.7323, loss=0.8354, lr=1.16e-05]
Epoch 1/5:  12%|█▏        | 136/1177 [06:59<46:32,  2.68s/it, exist=0.7313, loss=0.8342, lr=1.16e-05]
Epoch 1/5:  12%|█▏        | 137/1177 [06:59<46:34,  2.69s/it, exist=0.7313, loss=0.8342, lr=1.16e-05]
Epoch 1/5:  12%|█▏        | 137/1177 [07:01<46:34,  2.69s/it, exist=0.7305, loss=0.8333, lr=1.17e-05]
Epoch 1/5:  12%|█▏        | 138/1177 [07:01<45:37,  2.63s/it, exist=0.7305, loss=0.8333, lr=1.17e-05]
Epoch 1/5:  12%|█▏        | 138/1177 [07:04<45:37,  2.63s/it, exist=0.7292, loss=0.8317, lr=1.18e-05]
Epoch 1/5:  12%|█▏        | 139/1177 [07:04<47:09,  2.73s/it, exist=0.7292, loss=0.8317, lr=1.18e-05]
Epoch 1/5:  12%|█▏        | 139/1177 [07:07<47:09,  2.73s/it, exist=0.7284, loss=0.8312, lr=1.19e-05]
Epoch 1/5:  12%|█▏        | 140/1177 [07:07<46:32,  2.69s/it, exist=0.7284, loss=0.8312, lr=1.19e-05]
Epoch 1/5:  12%|█▏        | 140/1177 [07:09<46:32,  2.69s/it, exist=0.7274, loss=0.8298, lr=1.20e-05]
Epoch 1/5:  12%|█▏        | 141/1177 [07:09<42:38,  2.47s/it, exist=0.7274, loss=0.8298, lr=1.20e-05]
Epoch 1/5:  12%|█▏        | 141/1177 [07:12<42:38,  2.47s/it, exist=0.7273, loss=0.8299, lr=1.21e-05]
Epoch 1/5:  12%|█▏        | 142/1177 [07:12<46:56,  2.72s/it, exist=0.7273, loss=0.8299, lr=1.21e-05]
Epoch 1/5:  12%|█▏        | 142/1177 [07:14<46:56,  2.72s/it, exist=0.7260, loss=0.8287, lr=1.22e-05]
Epoch 1/5:  12%|█▏        | 143/1177 [07:14<46:00,  2.67s/it, exist=0.7260, loss=0.8287, lr=1.22e-05]
Epoch 1/5:  12%|█▏        | 143/1177 [07:17<46:00,  2.67s/it, exist=0.7250, loss=0.8274, lr=1.22e-05]
Epoch 1/5:  12%|█▏        | 144/1177 [07:17<45:36,  2.65s/it, exist=0.7250, loss=0.8274, lr=1.22e-05]
Epoch 1/5:  12%|█▏        | 144/1177 [07:20<45:36,  2.65s/it, exist=0.7243, loss=0.8274, lr=1.23e-05]
Epoch 1/5:  12%|█▏        | 145/1177 [07:20<46:08,  2.68s/it, exist=0.7243, loss=0.8274, lr=1.23e-05]
Epoch 1/5:  12%|█▏        | 145/1177 [07:22<46:08,  2.68s/it, exist=0.7239, loss=0.8266, lr=1.24e-05]
Epoch 1/5:  12%|█▏        | 146/1177 [07:22<45:44,  2.66s/it, exist=0.7239, loss=0.8266, lr=1.24e-05]
Epoch 1/5:  12%|█▏        | 146/1177 [07:26<45:44,  2.66s/it, exist=0.7230, loss=0.8260, lr=1.25e-05]
Epoch 1/5:  12%|█▏        | 147/1177 [07:26<48:46,  2.84s/it, exist=0.7230, loss=0.8260, lr=1.25e-05]
Epoch 1/5:  12%|█▏        | 147/1177 [07:28<48:46,  2.84s/it, exist=0.7224, loss=0.8250, lr=1.26e-05]
Epoch 1/5:  13%|█▎        | 148/1177 [07:28<44:17,  2.58s/it, exist=0.7224, loss=0.8250, lr=1.26e-05]
Epoch 1/5:  13%|█▎        | 148/1177 [07:30<44:17,  2.58s/it, exist=0.7211, loss=0.8234, lr=1.27e-05]
Epoch 1/5:  13%|█▎        | 149/1177 [07:30<44:11,  2.58s/it, exist=0.7211, loss=0.8234, lr=1.27e-05]
Epoch 1/5:  13%|█▎        | 149/1177 [07:33<44:11,  2.58s/it, exist=0.7209, loss=0.8236, lr=1.28e-05]
Epoch 1/5:  13%|█▎        | 150/1177 [07:33<44:07,  2.58s/it, exist=0.7209, loss=0.8236, lr=1.28e-05]
Epoch 1/5:  13%|█▎        | 150/1177 [07:35<44:07,  2.58s/it, exist=0.7203, loss=0.8233, lr=1.28e-05]
Epoch 1/5:  13%|█▎        | 151/1177 [07:35<44:05,  2.58s/it, exist=0.7203, loss=0.8233, lr=1.28e-05]
Epoch 1/5:  13%|█▎        | 151/1177 [07:37<44:05,  2.58s/it, exist=0.7194, loss=0.8220, lr=1.29e-05]
Epoch 1/5:  13%|█▎        | 152/1177 [07:37<40:58,  2.40s/it, exist=0.7194, loss=0.8220, lr=1.29e-05]
Epoch 1/5:  13%|█▎        | 152/1177 [07:40<40:58,  2.40s/it, exist=0.7188, loss=0.8212, lr=1.30e-05]
Epoch 1/5:  13%|█▎        | 153/1177 [07:40<41:25,  2.43s/it, exist=0.7188, loss=0.8212, lr=1.30e-05]
Epoch 1/5:  13%|█▎        | 153/1177 [07:43<41:25,  2.43s/it, exist=0.7174, loss=0.8195, lr=1.31e-05]
Epoch 1/5:  13%|█▎        | 154/1177 [07:43<44:25,  2.61s/it, exist=0.7174, loss=0.8195, lr=1.31e-05]
Epoch 1/5:  13%|█▎        | 154/1177 [07:45<44:25,  2.61s/it, exist=0.7169, loss=0.8187, lr=1.32e-05]
Epoch 1/5:  13%|█▎        | 155/1177 [07:45<44:00,  2.58s/it, exist=0.7169, loss=0.8187, lr=1.32e-05]
Epoch 1/5:  13%|█▎        | 155/1177 [07:48<44:00,  2.58s/it, exist=0.7160, loss=0.8179, lr=1.33e-05]
Epoch 1/5:  13%|█▎        | 156/1177 [07:48<43:38,  2.56s/it, exist=0.7160, loss=0.8179, lr=1.33e-05]
Epoch 1/5:  13%|█▎        | 156/1177 [07:50<43:38,  2.56s/it, exist=0.7148, loss=0.8168, lr=1.34e-05]
Epoch 1/5:  13%|█▎        | 157/1177 [07:50<42:51,  2.52s/it, exist=0.7148, loss=0.8168, lr=1.34e-05]
Epoch 1/5:  13%|█▎        | 157/1177 [07:53<42:51,  2.52s/it, exist=0.7149, loss=0.8169, lr=1.34e-05]
Epoch 1/5:  13%|█▎        | 158/1177 [07:53<42:50,  2.52s/it, exist=0.7149, loss=0.8169, lr=1.34e-05]
Epoch 1/5:  13%|█▎        | 158/1177 [07:55<42:50,  2.52s/it, exist=0.7148, loss=0.8165, lr=1.35e-05]
Epoch 1/5:  14%|█▎        | 159/1177 [07:55<39:48,  2.35s/it, exist=0.7148, loss=0.8165, lr=1.35e-05]
Epoch 1/5:  14%|█▎        | 159/1177 [07:57<39:48,  2.35s/it, exist=0.7145, loss=0.8160, lr=1.36e-05]
Epoch 1/5:  14%|█▎        | 160/1177 [07:57<41:14,  2.43s/it, exist=0.7145, loss=0.8160, lr=1.36e-05]
Epoch 1/5:  14%|█▎        | 160/1177 [07:59<41:14,  2.43s/it, exist=0.7132, loss=0.8148, lr=1.37e-05]
Epoch 1/5:  14%|█▎        | 161/1177 [07:59<39:03,  2.31s/it, exist=0.7132, loss=0.8148, lr=1.37e-05]
Epoch 1/5:  14%|█▎        | 161/1177 [08:03<39:03,  2.31s/it, exist=0.7119, loss=0.8137, lr=1.38e-05]
Epoch 1/5:  14%|█▍        | 162/1177 [08:03<43:12,  2.55s/it, exist=0.7119, loss=0.8137, lr=1.38e-05]
Epoch 1/5:  14%|█▍        | 162/1177 [08:07<43:12,  2.55s/it, exist=0.7117, loss=0.8134, lr=1.39e-05]
Epoch 1/5:  14%|█▍        | 163/1177 [08:07<51:06,  3.02s/it, exist=0.7117, loss=0.8134, lr=1.39e-05]
Epoch 1/5:  14%|█▍        | 163/1177 [08:09<51:06,  3.02s/it, exist=0.7115, loss=0.8130, lr=1.39e-05]
Epoch 1/5:  14%|█▍        | 164/1177 [08:09<46:44,  2.77s/it, exist=0.7115, loss=0.8130, lr=1.39e-05]
Epoch 1/5:  14%|█▍        | 164/1177 [08:13<46:44,  2.77s/it, exist=0.7104, loss=0.8117, lr=1.40e-05]
Epoch 1/5:  14%|█▍        | 165/1177 [08:13<52:21,  3.10s/it, exist=0.7104, loss=0.8117, lr=1.40e-05]
Epoch 1/5:  14%|█▍        | 165/1177 [08:15<52:21,  3.10s/it, exist=0.7099, loss=0.8108, lr=1.41e-05]
Epoch 1/5:  14%|█▍        | 166/1177 [08:15<46:52,  2.78s/it, exist=0.7099, loss=0.8108, lr=1.41e-05]
Epoch 1/5:  14%|█▍        | 166/1177 [08:17<46:52,  2.78s/it, exist=0.7085, loss=0.8100, lr=1.42e-05]
Epoch 1/5:  14%|█▍        | 167/1177 [08:17<45:57,  2.73s/it, exist=0.7085, loss=0.8100, lr=1.42e-05]
Epoch 1/5:  14%|█▍        | 167/1177 [08:20<45:57,  2.73s/it, exist=0.7079, loss=0.8092, lr=1.43e-05]
Epoch 1/5:  14%|█▍        | 168/1177 [08:20<44:48,  2.66s/it, exist=0.7079, loss=0.8092, lr=1.43e-05]
Epoch 1/5:  14%|█▍        | 168/1177 [08:22<44:48,  2.66s/it, exist=0.7074, loss=0.8089, lr=1.44e-05]
Epoch 1/5:  14%|█▍        | 169/1177 [08:22<41:27,  2.47s/it, exist=0.7074, loss=0.8089, lr=1.44e-05]
Epoch 1/5:  14%|█▍        | 169/1177 [08:25<41:27,  2.47s/it, exist=0.7058, loss=0.8072, lr=1.45e-05]
Epoch 1/5:  14%|█▍        | 170/1177 [08:25<44:40,  2.66s/it, exist=0.7058, loss=0.8072, lr=1.45e-05]
Epoch 1/5:  14%|█▍        | 170/1177 [08:28<44:40,  2.66s/it, exist=0.7051, loss=0.8065, lr=1.45e-05]
Epoch 1/5:  15%|█▍        | 171/1177 [08:28<46:50,  2.79s/it, exist=0.7051, loss=0.8065, lr=1.45e-05]
Epoch 1/5:  15%|█▍        | 171/1177 [08:31<46:50,  2.79s/it, exist=0.7044, loss=0.8054, lr=1.46e-05]
Epoch 1/5:  15%|█▍        | 172/1177 [08:31<46:58,  2.80s/it, exist=0.7044, loss=0.8054, lr=1.46e-05]
Epoch 1/5:  15%|█▍        | 172/1177 [08:33<46:58,  2.80s/it, exist=0.7033, loss=0.8040, lr=1.47e-05]
Epoch 1/5:  15%|█▍        | 173/1177 [08:33<42:50,  2.56s/it, exist=0.7033, loss=0.8040, lr=1.47e-05]
Epoch 1/5:  15%|█▍        | 173/1177 [08:36<42:50,  2.56s/it, exist=0.7022, loss=0.8026, lr=1.48e-05]
Epoch 1/5:  15%|█▍        | 174/1177 [08:36<46:35,  2.79s/it, exist=0.7022, loss=0.8026, lr=1.48e-05]
Epoch 1/5:  15%|█▍        | 174/1177 [08:40<46:35,  2.79s/it, exist=0.7014, loss=0.8015, lr=1.49e-05]
Epoch 1/5:  15%|█▍        | 175/1177 [08:40<48:41,  2.92s/it, exist=0.7014, loss=0.8015, lr=1.49e-05]
Epoch 1/5:  15%|█▍        | 175/1177 [08:42<48:41,  2.92s/it, exist=0.6998, loss=0.8002, lr=1.50e-05]
Epoch 1/5:  15%|█▍        | 176/1177 [08:42<44:14,  2.65s/it, exist=0.6998, loss=0.8002, lr=1.50e-05]
Epoch 1/5:  15%|█▍        | 176/1177 [08:45<44:14,  2.65s/it, exist=0.6986, loss=0.7991, lr=1.51e-05]
Epoch 1/5:  15%|█▌        | 177/1177 [08:45<48:53,  2.93s/it, exist=0.6986, loss=0.7991, lr=1.51e-05]
Epoch 1/5:  15%|█▌        | 177/1177 [08:48<48:53,  2.93s/it, exist=0.6976, loss=0.7984, lr=1.51e-05]
Epoch 1/5:  15%|█▌        | 178/1177 [08:48<47:08,  2.83s/it, exist=0.6976, loss=0.7984, lr=1.51e-05]
Epoch 1/5:  15%|█▌        | 178/1177 [08:51<47:08,  2.83s/it, exist=0.6967, loss=0.7980, lr=1.52e-05]
Epoch 1/5:  15%|█▌        | 179/1177 [08:51<47:54,  2.88s/it, exist=0.6967, loss=0.7980, lr=1.52e-05]
Epoch 1/5:  15%|█▌        | 179/1177 [08:53<47:54,  2.88s/it, exist=0.6953, loss=0.7965, lr=1.53e-05]
Epoch 1/5:  15%|█▌        | 180/1177 [08:53<46:51,  2.82s/it, exist=0.6953, loss=0.7965, lr=1.53e-05]
Epoch 1/5:  15%|█▌        | 180/1177 [08:56<46:51,  2.82s/it, exist=0.6950, loss=0.7958, lr=1.54e-05]
Epoch 1/5:  15%|█▌        | 181/1177 [08:56<46:09,  2.78s/it, exist=0.6950, loss=0.7958, lr=1.54e-05]
Epoch 1/5:  15%|█▌        | 181/1177 [08:59<46:09,  2.78s/it, exist=0.6946, loss=0.7953, lr=1.55e-05]
Epoch 1/5:  15%|█▌        | 182/1177 [08:59<45:08,  2.72s/it, exist=0.6946, loss=0.7953, lr=1.55e-05]
Epoch 1/5:  15%|█▌        | 182/1177 [09:01<45:08,  2.72s/it, exist=0.6952, loss=0.7959, lr=1.56e-05]
Epoch 1/5:  16%|█▌        | 183/1177 [09:01<44:47,  2.70s/it, exist=0.6952, loss=0.7959, lr=1.56e-05]
Epoch 1/5:  16%|█▌        | 183/1177 [09:04<44:47,  2.70s/it, exist=0.6949, loss=0.7955, lr=1.56e-05]
Epoch 1/5:  16%|█▌        | 184/1177 [09:04<44:10,  2.67s/it, exist=0.6949, loss=0.7955, lr=1.56e-05]
Epoch 1/5:  16%|█▌        | 184/1177 [09:06<44:10,  2.67s/it, exist=0.6947, loss=0.7952, lr=1.57e-05]
Epoch 1/5:  16%|█▌        | 185/1177 [09:06<40:32,  2.45s/it, exist=0.6947, loss=0.7952, lr=1.57e-05]
Epoch 1/5:  16%|█▌        | 185/1177 [09:09<40:32,  2.45s/it, exist=0.6933, loss=0.7936, lr=1.58e-05]
Epoch 1/5:  16%|█▌        | 186/1177 [09:09<41:55,  2.54s/it, exist=0.6933, loss=0.7936, lr=1.58e-05]
Epoch 1/5:  16%|█▌        | 186/1177 [09:12<41:55,  2.54s/it, exist=0.6935, loss=0.7939, lr=1.59e-05]
Epoch 1/5:  16%|█▌        | 187/1177 [09:12<44:39,  2.71s/it, exist=0.6935, loss=0.7939, lr=1.59e-05]
Epoch 1/5:  16%|█▌        | 187/1177 [09:14<44:39,  2.71s/it, exist=0.6925, loss=0.7926, lr=1.60e-05]
Epoch 1/5:  16%|█▌        | 188/1177 [09:14<43:52,  2.66s/it, exist=0.6925, loss=0.7926, lr=1.60e-05]
Epoch 1/5:  16%|█▌        | 188/1177 [09:17<43:52,  2.66s/it, exist=0.6918, loss=0.7920, lr=1.61e-05]
Epoch 1/5:  16%|█▌        | 189/1177 [09:17<44:11,  2.68s/it, exist=0.6918, loss=0.7920, lr=1.61e-05]
Epoch 1/5:  16%|█▌        | 189/1177 [09:19<44:11,  2.68s/it, exist=0.6913, loss=0.7912, lr=1.62e-05]
Epoch 1/5:  16%|█▌        | 190/1177 [09:19<40:49,  2.48s/it, exist=0.6913, loss=0.7912, lr=1.62e-05]
Epoch 1/5:  16%|█▌        | 190/1177 [09:22<40:49,  2.48s/it, exist=0.6903, loss=0.7904, lr=1.62e-05]
Epoch 1/5:  16%|█▌        | 191/1177 [09:22<41:51,  2.55s/it, exist=0.6903, loss=0.7904, lr=1.62e-05]
Epoch 1/5:  16%|█▌        | 191/1177 [09:24<41:51,  2.55s/it, exist=0.6915, loss=0.7913, lr=1.63e-05]
Epoch 1/5:  16%|█▋        | 192/1177 [09:24<42:13,  2.57s/it, exist=0.6915, loss=0.7913, lr=1.63e-05]
Epoch 1/5:  16%|█▋        | 192/1177 [09:28<42:13,  2.57s/it, exist=0.6909, loss=0.7908, lr=1.64e-05]
Epoch 1/5:  16%|█▋        | 193/1177 [09:28<46:46,  2.85s/it, exist=0.6909, loss=0.7908, lr=1.64e-05]
Epoch 1/5:  16%|█▋        | 193/1177 [09:30<46:46,  2.85s/it, exist=0.6904, loss=0.7901, lr=1.65e-05]
Epoch 1/5:  16%|█▋        | 194/1177 [09:30<45:24,  2.77s/it, exist=0.6904, loss=0.7901, lr=1.65e-05]
Epoch 1/5:  16%|█▋        | 194/1177 [09:33<45:24,  2.77s/it, exist=0.6897, loss=0.7890, lr=1.66e-05]
Epoch 1/5:  17%|█▋        | 195/1177 [09:33<45:45,  2.80s/it, exist=0.6897, loss=0.7890, lr=1.66e-05]
Epoch 1/5:  17%|█▋        | 195/1177 [09:35<45:45,  2.80s/it, exist=0.6896, loss=0.7886, lr=1.67e-05]
Epoch 1/5:  17%|█▋        | 196/1177 [09:35<41:44,  2.55s/it, exist=0.6896, loss=0.7886, lr=1.67e-05]
Epoch 1/5:  17%|█▋        | 196/1177 [09:38<41:44,  2.55s/it, exist=0.6888, loss=0.7876, lr=1.68e-05]
Epoch 1/5:  17%|█▋        | 197/1177 [09:38<42:45,  2.62s/it, exist=0.6888, loss=0.7876, lr=1.68e-05]
Epoch 1/5:  17%|█▋        | 197/1177 [09:41<42:45,  2.62s/it, exist=0.6890, loss=0.7883, lr=1.68e-05]
Epoch 1/5:  17%|█▋        | 198/1177 [09:41<45:47,  2.81s/it, exist=0.6890, loss=0.7883, lr=1.68e-05]
Epoch 1/5:  17%|█▋        | 198/1177 [09:43<45:47,  2.81s/it, exist=0.6893, loss=0.7884, lr=1.69e-05]
Epoch 1/5:  17%|█▋        | 199/1177 [09:43<41:39,  2.56s/it, exist=0.6893, loss=0.7884, lr=1.69e-05]
Epoch 1/5:  17%|█▋        | 199/1177 [09:46<41:39,  2.56s/it, exist=0.6895, loss=0.7886, lr=1.70e-05]
Epoch 1/5:  17%|█▋        | 200/1177 [09:46<44:46,  2.75s/it, exist=0.6895, loss=0.7886, lr=1.70e-05]
Epoch 1/5:  17%|█▋        | 200/1177 [09:48<44:46,  2.75s/it, exist=0.6900, loss=0.7890, lr=1.71e-05]
Epoch 1/5:  17%|█▋        | 201/1177 [09:48<40:58,  2.52s/it, exist=0.6900, loss=0.7890, lr=1.71e-05]
Epoch 1/5:  17%|█▋        | 201/1177 [09:52<40:58,  2.52s/it, exist=0.6890, loss=0.7880, lr=1.72e-05]
Epoch 1/5:  17%|█▋        | 202/1177 [09:52<44:16,  2.72s/it, exist=0.6890, loss=0.7880, lr=1.72e-05]
Epoch 1/5:  17%|█▋        | 202/1177 [09:54<44:16,  2.72s/it, exist=0.6882, loss=0.7870, lr=1.73e-05]
Epoch 1/5:  17%|█▋        | 203/1177 [09:54<40:33,  2.50s/it, exist=0.6882, loss=0.7870, lr=1.73e-05]
Epoch 1/5:  17%|█▋        | 203/1177 [09:57<40:33,  2.50s/it, exist=0.6874, loss=0.7862, lr=1.73e-05]
Epoch 1/5:  17%|█▋        | 204/1177 [09:57<46:20,  2.86s/it, exist=0.6874, loss=0.7862, lr=1.73e-05]
Epoch 1/5:  17%|█▋        | 204/1177 [10:01<46:20,  2.86s/it, exist=0.6872, loss=0.7859, lr=1.74e-05]
Epoch 1/5:  17%|█▋        | 205/1177 [10:01<48:19,  2.98s/it, exist=0.6872, loss=0.7859, lr=1.74e-05]
Epoch 1/5:  17%|█▋        | 205/1177 [10:03<48:19,  2.98s/it, exist=0.6870, loss=0.7864, lr=1.75e-05]
Epoch 1/5:  18%|█▊        | 206/1177 [10:03<43:42,  2.70s/it, exist=0.6870, loss=0.7864, lr=1.75e-05]
Epoch 1/5:  18%|█▊        | 206/1177 [10:05<43:42,  2.70s/it, exist=0.6874, loss=0.7870, lr=1.76e-05]
Epoch 1/5:  18%|█▊        | 207/1177 [10:05<40:05,  2.48s/it, exist=0.6874, loss=0.7870, lr=1.76e-05]
Epoch 1/5:  18%|█▊        | 207/1177 [10:08<40:05,  2.48s/it, exist=0.6862, loss=0.7857, lr=1.77e-05]
Epoch 1/5:  18%|█▊        | 208/1177 [10:08<46:04,  2.85s/it, exist=0.6862, loss=0.7857, lr=1.77e-05]
Epoch 1/5:  18%|█▊        | 208/1177 [10:10<46:04,  2.85s/it, exist=0.6849, loss=0.7846, lr=1.78e-05]
Epoch 1/5:  18%|█▊        | 209/1177 [10:10<42:01,  2.60s/it, exist=0.6849, loss=0.7846, lr=1.78e-05]
Epoch 1/5:  18%|█▊        | 209/1177 [10:14<42:01,  2.60s/it, exist=0.6852, loss=0.7848, lr=1.79e-05]
Epoch 1/5:  18%|█▊        | 210/1177 [10:14<47:40,  2.96s/it, exist=0.6852, loss=0.7848, lr=1.79e-05]
Epoch 1/5:  18%|█▊        | 210/1177 [10:17<47:40,  2.96s/it, exist=0.6845, loss=0.7843, lr=1.79e-05]
Epoch 1/5:  18%|█▊        | 211/1177 [10:17<45:39,  2.84s/it, exist=0.6845, loss=0.7843, lr=1.79e-05]
Epoch 1/5:  18%|█▊        | 211/1177 [10:19<45:39,  2.84s/it, exist=0.6840, loss=0.7841, lr=1.80e-05]
Epoch 1/5:  18%|█▊        | 212/1177 [10:19<43:48,  2.72s/it, exist=0.6840, loss=0.7841, lr=1.80e-05]
Epoch 1/5:  18%|█▊        | 212/1177 [10:22<43:48,  2.72s/it, exist=0.6836, loss=0.7840, lr=1.81e-05]
Epoch 1/5:  18%|█▊        | 213/1177 [10:22<42:44,  2.66s/it, exist=0.6836, loss=0.7840, lr=1.81e-05]
Epoch 1/5:  18%|█▊        | 213/1177 [10:25<42:44,  2.66s/it, exist=0.6830, loss=0.7834, lr=1.82e-05]
Epoch 1/5:  18%|█▊        | 214/1177 [10:25<45:05,  2.81s/it, exist=0.6830, loss=0.7834, lr=1.82e-05]
Epoch 1/5:  18%|█▊        | 214/1177 [10:27<45:05,  2.81s/it, exist=0.6830, loss=0.7833, lr=1.83e-05]
Epoch 1/5:  18%|█▊        | 215/1177 [10:27<40:54,  2.55s/it, exist=0.6830, loss=0.7833, lr=1.83e-05]
Epoch 1/5:  18%|█▊        | 215/1177 [10:29<40:54,  2.55s/it, exist=0.6829, loss=0.7834, lr=1.84e-05]
Epoch 1/5:  18%|█▊        | 216/1177 [10:29<41:12,  2.57s/it, exist=0.6829, loss=0.7834, lr=1.84e-05]
Epoch 1/5:  18%|█▊        | 216/1177 [10:31<41:12,  2.57s/it, exist=0.6818, loss=0.7820, lr=1.85e-05]
Epoch 1/5:  18%|█▊        | 217/1177 [10:31<38:28,  2.40s/it, exist=0.6818, loss=0.7820, lr=1.85e-05]
Epoch 1/5:  18%|█▊        | 217/1177 [10:33<38:28,  2.40s/it, exist=0.6812, loss=0.7824, lr=1.85e-05]
Epoch 1/5:  19%|█▊        | 218/1177 [10:33<36:42,  2.30s/it, exist=0.6812, loss=0.7824, lr=1.85e-05]
Epoch 1/5:  19%|█▊        | 218/1177 [10:38<36:42,  2.30s/it, exist=0.6807, loss=0.7818, lr=1.86e-05]
Epoch 1/5:  19%|█▊        | 219/1177 [10:38<46:47,  2.93s/it, exist=0.6807, loss=0.7818, lr=1.86e-05]
Epoch 1/5:  19%|█▊        | 219/1177 [10:41<46:47,  2.93s/it, exist=0.6807, loss=0.7816, lr=1.87e-05]
Epoch 1/5:  19%|█▊        | 220/1177 [10:41<49:29,  3.10s/it, exist=0.6807, loss=0.7816, lr=1.87e-05]
Epoch 1/5:  19%|█▊        | 220/1177 [10:46<49:29,  3.10s/it, exist=0.6802, loss=0.7808, lr=1.88e-05]
Epoch 1/5:  19%|█▉        | 221/1177 [10:46<55:56,  3.51s/it, exist=0.6802, loss=0.7808, lr=1.88e-05]
Epoch 1/5:  19%|█▉        | 221/1177 [10:51<55:56,  3.51s/it, exist=0.6793, loss=0.7800, lr=1.89e-05]
Epoch 1/5:  19%|█▉        | 222/1177 [10:51<1:02:57,  3.96s/it, exist=0.6793, loss=0.7800, lr=1.89e-05]
Epoch 1/5:  19%|█▉        | 222/1177 [10:55<1:02:57,  3.96s/it, exist=0.6784, loss=0.7793, lr=1.90e-05]
Epoch 1/5:  19%|█▉        | 223/1177 [10:55<1:01:42,  3.88s/it, exist=0.6784, loss=0.7793, lr=1.90e-05]
Epoch 1/5:  19%|█▉        | 223/1177 [10:58<1:01:42,  3.88s/it, exist=0.6785, loss=0.7796, lr=1.90e-05]
Epoch 1/5:  19%|█▉        | 224/1177 [10:58<1:00:14,  3.79s/it, exist=0.6785, loss=0.7796, lr=1.90e-05]
Epoch 1/5:  19%|█▉        | 224/1177 [11:02<1:00:14,  3.79s/it, exist=0.6782, loss=0.7792, lr=1.91e-05]
Epoch 1/5:  19%|█▉        | 225/1177 [11:02<58:20,  3.68s/it, exist=0.6782, loss=0.7792, lr=1.91e-05]  
Epoch 1/5:  19%|█▉        | 225/1177 [11:04<58:20,  3.68s/it, exist=0.6780, loss=0.7789, lr=1.92e-05]
Epoch 1/5:  19%|█▉        | 226/1177 [11:04<50:26,  3.18s/it, exist=0.6780, loss=0.7789, lr=1.92e-05]
Epoch 1/5:  19%|█▉        | 226/1177 [11:06<50:26,  3.18s/it, exist=0.6771, loss=0.7784, lr=1.93e-05]
Epoch 1/5:  19%|█▉        | 227/1177 [11:06<44:57,  2.84s/it, exist=0.6771, loss=0.7784, lr=1.93e-05]
Epoch 1/5:  19%|█▉        | 227/1177 [11:09<44:57,  2.84s/it, exist=0.6760, loss=0.7772, lr=1.94e-05]
Epoch 1/5:  19%|█▉        | 228/1177 [11:09<46:26,  2.94s/it, exist=0.6760, loss=0.7772, lr=1.94e-05]
Epoch 1/5:  19%|█▉        | 228/1177 [11:11<46:26,  2.94s/it, exist=0.6748, loss=0.7759, lr=1.95e-05]
Epoch 1/5:  19%|█▉        | 229/1177 [11:11<43:58,  2.78s/it, exist=0.6748, loss=0.7759, lr=1.95e-05]
Epoch 1/5:  19%|█▉        | 229/1177 [11:13<43:58,  2.78s/it, exist=0.6736, loss=0.7745, lr=1.96e-05]
Epoch 1/5:  20%|█▉        | 230/1177 [11:13<40:28,  2.56s/it, exist=0.6736, loss=0.7745, lr=1.96e-05]
Epoch 1/5:  20%|█▉        | 230/1177 [11:17<40:28,  2.56s/it, exist=0.6728, loss=0.7736, lr=1.96e-05]
Epoch 1/5:  20%|█▉        | 231/1177 [11:17<44:02,  2.79s/it, exist=0.6728, loss=0.7736, lr=1.96e-05]
Epoch 1/5:  20%|█▉        | 231/1177 [11:19<44:02,  2.79s/it, exist=0.6717, loss=0.7725, lr=1.97e-05]
Epoch 1/5:  20%|█▉        | 232/1177 [11:19<40:39,  2.58s/it, exist=0.6717, loss=0.7725, lr=1.97e-05]
Epoch 1/5:  20%|█▉        | 232/1177 [11:21<40:39,  2.58s/it, exist=0.6707, loss=0.7716, lr=1.98e-05]
Epoch 1/5:  20%|█▉        | 233/1177 [11:21<40:24,  2.57s/it, exist=0.6707, loss=0.7716, lr=1.98e-05]
Epoch 1/5:  20%|█▉        | 233/1177 [11:24<40:24,  2.57s/it, exist=0.6705, loss=0.7710, lr=1.99e-05]
Epoch 1/5:  20%|█▉        | 234/1177 [11:24<43:48,  2.79s/it, exist=0.6705, loss=0.7710, lr=1.99e-05]
Epoch 1/5:  20%|█▉        | 234/1177 [11:27<43:48,  2.79s/it, exist=0.6705, loss=0.7714, lr=2.00e-05]
Epoch 1/5:  20%|█▉        | 235/1177 [11:27<43:05,  2.75s/it, exist=0.6705, loss=0.7714, lr=2.00e-05]
Epoch 1/5:  20%|█▉        | 235/1177 [11:30<43:05,  2.75s/it, exist=0.6704, loss=0.7711, lr=2.01e-05]
Epoch 1/5:  20%|██        | 236/1177 [11:30<41:27,  2.64s/it, exist=0.6704, loss=0.7711, lr=2.01e-05]
Epoch 1/5:  20%|██        | 236/1177 [11:32<41:27,  2.64s/it, exist=0.6700, loss=0.7708, lr=2.02e-05]
Epoch 1/5:  20%|██        | 237/1177 [11:32<41:10,  2.63s/it, exist=0.6700, loss=0.7708, lr=2.02e-05]
Epoch 1/5:  20%|██        | 237/1177 [11:34<41:10,  2.63s/it, exist=0.6695, loss=0.7702, lr=2.02e-05]
Epoch 1/5:  20%|██        | 238/1177 [11:34<38:30,  2.46s/it, exist=0.6695, loss=0.7702, lr=2.02e-05]
Epoch 1/5:  20%|██        | 238/1177 [11:37<38:30,  2.46s/it, exist=0.6689, loss=0.7697, lr=2.03e-05]
Epoch 1/5:  20%|██        | 239/1177 [11:37<41:23,  2.65s/it, exist=0.6689, loss=0.7697, lr=2.03e-05]
Epoch 1/5:  20%|██        | 239/1177 [11:40<41:23,  2.65s/it, exist=0.6677, loss=0.7682, lr=2.04e-05]
Epoch 1/5:  20%|██        | 240/1177 [11:40<41:17,  2.64s/it, exist=0.6677, loss=0.7682, lr=2.04e-05]
Epoch 1/5:  20%|██        | 240/1177 [11:42<41:17,  2.64s/it, exist=0.6681, loss=0.7685, lr=2.05e-05]
Epoch 1/5:  20%|██        | 241/1177 [11:42<40:10,  2.58s/it, exist=0.6681, loss=0.7685, lr=2.05e-05]
Epoch 1/5:  20%|██        | 241/1177 [11:45<40:10,  2.58s/it, exist=0.6677, loss=0.7678, lr=2.06e-05]
Epoch 1/5:  21%|██        | 242/1177 [11:45<40:31,  2.60s/it, exist=0.6677, loss=0.7678, lr=2.06e-05]
Epoch 1/5:  21%|██        | 242/1177 [11:47<40:31,  2.60s/it, exist=0.6669, loss=0.7668, lr=2.07e-05]
Epoch 1/5:  21%|██        | 243/1177 [11:47<37:52,  2.43s/it, exist=0.6669, loss=0.7668, lr=2.07e-05]
Epoch 1/5:  21%|██        | 243/1177 [11:50<37:52,  2.43s/it, exist=0.6663, loss=0.7660, lr=2.07e-05]
Epoch 1/5:  21%|██        | 244/1177 [11:50<38:49,  2.50s/it, exist=0.6663, loss=0.7660, lr=2.07e-05]
Epoch 1/5:  21%|██        | 244/1177 [11:52<38:49,  2.50s/it, exist=0.6650, loss=0.7649, lr=2.08e-05]
Epoch 1/5:  21%|██        | 245/1177 [11:52<39:54,  2.57s/it, exist=0.6650, loss=0.7649, lr=2.08e-05]
Epoch 1/5:  21%|██        | 245/1177 [11:56<39:54,  2.57s/it, exist=0.6639, loss=0.7638, lr=2.09e-05]
Epoch 1/5:  21%|██        | 246/1177 [11:56<42:31,  2.74s/it, exist=0.6639, loss=0.7638, lr=2.09e-05]
Epoch 1/5:  21%|██        | 246/1177 [11:58<42:31,  2.74s/it, exist=0.6634, loss=0.7632, lr=2.10e-05]
Epoch 1/5:  21%|██        | 247/1177 [11:58<39:05,  2.52s/it, exist=0.6634, loss=0.7632, lr=2.10e-05]
Epoch 1/5:  21%|██        | 247/1177 [12:00<39:05,  2.52s/it, exist=0.6627, loss=0.7625, lr=2.11e-05]
Epoch 1/5:  21%|██        | 248/1177 [12:00<39:42,  2.56s/it, exist=0.6627, loss=0.7625, lr=2.11e-05]
Epoch 1/5:  21%|██        | 248/1177 [12:02<39:42,  2.56s/it, exist=0.6619, loss=0.7620, lr=2.12e-05]
Epoch 1/5:  21%|██        | 249/1177 [12:02<37:16,  2.41s/it, exist=0.6619, loss=0.7620, lr=2.12e-05]
Epoch 1/5:  21%|██        | 249/1177 [12:06<37:16,  2.41s/it, exist=0.6611, loss=0.7611, lr=2.13e-05]
Epoch 1/5:  21%|██        | 250/1177 [12:06<42:02,  2.72s/it, exist=0.6611, loss=0.7611, lr=2.13e-05]
Epoch 1/5:  21%|██        | 250/1177 [12:08<42:02,  2.72s/it, exist=0.6605, loss=0.7605, lr=2.13e-05]
Epoch 1/5:  21%|██▏       | 251/1177 [12:08<41:10,  2.67s/it, exist=0.6605, loss=0.7605, lr=2.13e-05]
Epoch 1/5:  21%|██▏       | 251/1177 [12:11<41:10,  2.67s/it, exist=0.6596, loss=0.7597, lr=2.14e-05]
Epoch 1/5:  21%|██▏       | 252/1177 [12:11<43:14,  2.80s/it, exist=0.6596, loss=0.7597, lr=2.14e-05]
Epoch 1/5:  21%|██▏       | 252/1177 [12:14<43:14,  2.80s/it, exist=0.6597, loss=0.7598, lr=2.15e-05]
Epoch 1/5:  21%|██▏       | 253/1177 [12:14<41:06,  2.67s/it, exist=0.6597, loss=0.7598, lr=2.15e-05]
Epoch 1/5:  21%|██▏       | 253/1177 [12:17<41:06,  2.67s/it, exist=0.6585, loss=0.7590, lr=2.16e-05]
Epoch 1/5:  22%|██▏       | 254/1177 [12:17<43:19,  2.82s/it, exist=0.6585, loss=0.7590, lr=2.16e-05]
Epoch 1/5:  22%|██▏       | 254/1177 [12:19<43:19,  2.82s/it, exist=0.6573, loss=0.7576, lr=2.17e-05]
Epoch 1/5:  22%|██▏       | 255/1177 [12:19<41:29,  2.70s/it, exist=0.6573, loss=0.7576, lr=2.17e-05]
Epoch 1/5:  22%|██▏       | 255/1177 [12:21<41:29,  2.70s/it, exist=0.6561, loss=0.7566, lr=2.18e-05]
Epoch 1/5:  22%|██▏       | 256/1177 [12:21<38:12,  2.49s/it, exist=0.6561, loss=0.7566, lr=2.18e-05]
Epoch 1/5:  22%|██▏       | 256/1177 [12:24<38:12,  2.49s/it, exist=0.6566, loss=0.7570, lr=2.19e-05]
Epoch 1/5:  22%|██▏       | 257/1177 [12:24<38:18,  2.50s/it, exist=0.6566, loss=0.7570, lr=2.19e-05]
Epoch 1/5:  22%|██▏       | 257/1177 [12:26<38:18,  2.50s/it, exist=0.6568, loss=0.7571, lr=2.19e-05]
Epoch 1/5:  22%|██▏       | 258/1177 [12:26<38:17,  2.50s/it, exist=0.6568, loss=0.7571, lr=2.19e-05]
Epoch 1/5:  22%|██▏       | 258/1177 [12:29<38:17,  2.50s/it, exist=0.6560, loss=0.7567, lr=2.20e-05]
Epoch 1/5:  22%|██▏       | 259/1177 [12:29<40:58,  2.68s/it, exist=0.6560, loss=0.7567, lr=2.20e-05]
Epoch 1/5:  22%|██▏       | 259/1177 [12:31<40:58,  2.68s/it, exist=0.6560, loss=0.7567, lr=2.21e-05]
Epoch 1/5:  22%|██▏       | 260/1177 [12:31<37:44,  2.47s/it, exist=0.6560, loss=0.7567, lr=2.21e-05]
Epoch 1/5:  22%|██▏       | 260/1177 [12:35<37:44,  2.47s/it, exist=0.6556, loss=0.7564, lr=2.22e-05]
Epoch 1/5:  22%|██▏       | 261/1177 [12:35<40:38,  2.66s/it, exist=0.6556, loss=0.7564, lr=2.22e-05]
Epoch 1/5:  22%|██▏       | 261/1177 [12:37<40:38,  2.66s/it, exist=0.6546, loss=0.7555, lr=2.23e-05]
Epoch 1/5:  22%|██▏       | 262/1177 [12:37<40:25,  2.65s/it, exist=0.6546, loss=0.7555, lr=2.23e-05]
Epoch 1/5:  22%|██▏       | 262/1177 [12:40<40:25,  2.65s/it, exist=0.6534, loss=0.7542, lr=2.24e-05]
Epoch 1/5:  22%|██▏       | 263/1177 [12:40<42:35,  2.80s/it, exist=0.6534, loss=0.7542, lr=2.24e-05]
Epoch 1/5:  22%|██▏       | 263/1177 [12:42<42:35,  2.80s/it, exist=0.6523, loss=0.7530, lr=2.24e-05]
Epoch 1/5:  22%|██▏       | 264/1177 [12:42<38:55,  2.56s/it, exist=0.6523, loss=0.7530, lr=2.24e-05]
Epoch 1/5:  22%|██▏       | 264/1177 [12:45<38:55,  2.56s/it, exist=0.6526, loss=0.7534, lr=2.25e-05]
Epoch 1/5:  23%|██▎       | 265/1177 [12:45<37:23,  2.46s/it, exist=0.6526, loss=0.7534, lr=2.25e-05]
Epoch 1/5:  23%|██▎       | 265/1177 [12:48<37:23,  2.46s/it, exist=0.6530, loss=0.7536, lr=2.26e-05]
Epoch 1/5:  23%|██▎       | 266/1177 [12:48<40:38,  2.68s/it, exist=0.6530, loss=0.7536, lr=2.26e-05]
Epoch 1/5:  23%|██▎       | 266/1177 [12:50<40:38,  2.68s/it, exist=0.6526, loss=0.7531, lr=2.27e-05]
Epoch 1/5:  23%|██▎       | 267/1177 [12:50<40:04,  2.64s/it, exist=0.6526, loss=0.7531, lr=2.27e-05]
Epoch 1/5:  23%|██▎       | 267/1177 [12:53<40:04,  2.64s/it, exist=0.6522, loss=0.7529, lr=2.28e-05]
Epoch 1/5:  23%|██▎       | 268/1177 [12:53<39:46,  2.63s/it, exist=0.6522, loss=0.7529, lr=2.28e-05]
Epoch 1/5:  23%|██▎       | 268/1177 [12:55<39:46,  2.63s/it, exist=0.6524, loss=0.7529, lr=2.29e-05]
Epoch 1/5:  23%|██▎       | 269/1177 [12:55<39:16,  2.60s/it, exist=0.6524, loss=0.7529, lr=2.29e-05]
Epoch 1/5:  23%|██▎       | 269/1177 [12:58<39:16,  2.60s/it, exist=0.6517, loss=0.7522, lr=2.30e-05]
Epoch 1/5:  23%|██▎       | 270/1177 [12:58<39:39,  2.62s/it, exist=0.6517, loss=0.7522, lr=2.30e-05]
Epoch 1/5:  23%|██▎       | 270/1177 [13:01<39:39,  2.62s/it, exist=0.6517, loss=0.7524, lr=2.30e-05]
Epoch 1/5:  23%|██▎       | 271/1177 [13:01<40:55,  2.71s/it, exist=0.6517, loss=0.7524, lr=2.30e-05]
Epoch 1/5:  23%|██▎       | 271/1177 [13:03<40:55,  2.71s/it, exist=0.6507, loss=0.7513, lr=2.31e-05]
Epoch 1/5:  23%|██▎       | 272/1177 [13:03<38:14,  2.54s/it, exist=0.6507, loss=0.7513, lr=2.31e-05]
Epoch 1/5:  23%|██▎       | 272/1177 [13:06<38:14,  2.54s/it, exist=0.6496, loss=0.7502, lr=2.32e-05]
Epoch 1/5:  23%|██▎       | 273/1177 [13:06<40:57,  2.72s/it, exist=0.6496, loss=0.7502, lr=2.32e-05]
Epoch 1/5:  23%|██▎       | 273/1177 [13:09<40:57,  2.72s/it, exist=0.6499, loss=0.7503, lr=2.33e-05]
Epoch 1/5:  23%|██▎       | 274/1177 [13:09<43:11,  2.87s/it, exist=0.6499, loss=0.7503, lr=2.33e-05]
Epoch 1/5:  23%|██▎       | 274/1177 [13:12<43:11,  2.87s/it, exist=0.6489, loss=0.7493, lr=2.34e-05]
Epoch 1/5:  23%|██▎       | 275/1177 [13:12<39:34,  2.63s/it, exist=0.6489, loss=0.7493, lr=2.34e-05]
Epoch 1/5:  23%|██▎       | 275/1177 [13:14<39:34,  2.63s/it, exist=0.6485, loss=0.7488, lr=2.35e-05]
Epoch 1/5:  23%|██▎       | 276/1177 [13:14<38:50,  2.59s/it, exist=0.6485, loss=0.7488, lr=2.35e-05]
Epoch 1/5:  23%|██▎       | 276/1177 [13:17<38:50,  2.59s/it, exist=0.6485, loss=0.7490, lr=2.36e-05]
Epoch 1/5:  24%|██▎       | 277/1177 [13:17<39:00,  2.60s/it, exist=0.6485, loss=0.7490, lr=2.36e-05]
Epoch 1/5:  24%|██▎       | 277/1177 [13:19<39:00,  2.60s/it, exist=0.6478, loss=0.7481, lr=2.36e-05]
Epoch 1/5:  24%|██▎       | 278/1177 [13:19<39:57,  2.67s/it, exist=0.6478, loss=0.7481, lr=2.36e-05]
Epoch 1/5:  24%|██▎       | 278/1177 [13:23<39:57,  2.67s/it, exist=0.6475, loss=0.7478, lr=2.37e-05]
Epoch 1/5:  24%|██▎       | 279/1177 [13:23<44:11,  2.95s/it, exist=0.6475, loss=0.7478, lr=2.37e-05]
Epoch 1/5:  24%|██▎       | 279/1177 [13:25<44:11,  2.95s/it, exist=0.6480, loss=0.7482, lr=2.38e-05]
Epoch 1/5:  24%|██▍       | 280/1177 [13:25<39:51,  2.67s/it, exist=0.6480, loss=0.7482, lr=2.38e-05]
Epoch 1/5:  24%|██▍       | 280/1177 [13:28<39:51,  2.67s/it, exist=0.6484, loss=0.7486, lr=2.39e-05]
Epoch 1/5:  24%|██▍       | 281/1177 [13:28<39:23,  2.64s/it, exist=0.6484, loss=0.7486, lr=2.39e-05]
Epoch 1/5:  24%|██▍       | 281/1177 [13:30<39:23,  2.64s/it, exist=0.6482, loss=0.7486, lr=2.40e-05]
Epoch 1/5:  24%|██▍       | 282/1177 [13:30<39:32,  2.65s/it, exist=0.6482, loss=0.7486, lr=2.40e-05]
Epoch 1/5:  24%|██▍       | 282/1177 [13:33<39:32,  2.65s/it, exist=0.6486, loss=0.7488, lr=2.41e-05]
Epoch 1/5:  24%|██▍       | 283/1177 [13:33<39:10,  2.63s/it, exist=0.6486, loss=0.7488, lr=2.41e-05]
Epoch 1/5:  24%|██▍       | 283/1177 [13:35<39:10,  2.63s/it, exist=0.6483, loss=0.7486, lr=2.41e-05]
Epoch 1/5:  24%|██▍       | 284/1177 [13:35<36:17,  2.44s/it, exist=0.6483, loss=0.7486, lr=2.41e-05]
Epoch 1/5:  24%|██▍       | 284/1177 [13:38<36:17,  2.44s/it, exist=0.6478, loss=0.7484, lr=2.42e-05]
Epoch 1/5:  24%|██▍       | 285/1177 [13:38<39:54,  2.68s/it, exist=0.6478, loss=0.7484, lr=2.42e-05]
Epoch 1/5:  24%|██▍       | 285/1177 [13:40<39:54,  2.68s/it, exist=0.6474, loss=0.7480, lr=2.43e-05]
Epoch 1/5:  24%|██▍       | 286/1177 [13:40<37:11,  2.50s/it, exist=0.6474, loss=0.7480, lr=2.43e-05]
Epoch 1/5:  24%|██▍       | 286/1177 [13:43<37:11,  2.50s/it, exist=0.6461, loss=0.7470, lr=2.44e-05]
Epoch 1/5:  24%|██▍       | 287/1177 [13:43<38:12,  2.58s/it, exist=0.6461, loss=0.7470, lr=2.44e-05]
Epoch 1/5:  24%|██▍       | 287/1177 [13:46<38:12,  2.58s/it, exist=0.6455, loss=0.7464, lr=2.45e-05]
Epoch 1/5:  24%|██▍       | 288/1177 [13:46<41:55,  2.83s/it, exist=0.6455, loss=0.7464, lr=2.45e-05]
Epoch 1/5:  24%|██▍       | 288/1177 [13:48<41:55,  2.83s/it, exist=0.6453, loss=0.7462, lr=2.46e-05]
Epoch 1/5:  25%|██▍       | 289/1177 [13:48<38:25,  2.60s/it, exist=0.6453, loss=0.7462, lr=2.46e-05]
Epoch 1/5:  25%|██▍       | 289/1177 [13:51<38:25,  2.60s/it, exist=0.6451, loss=0.7460, lr=2.47e-05]
Epoch 1/5:  25%|██▍       | 290/1177 [13:51<39:03,  2.64s/it, exist=0.6451, loss=0.7460, lr=2.47e-05]
Epoch 1/5:  25%|██▍       | 290/1177 [13:53<39:03,  2.64s/it, exist=0.6446, loss=0.7458, lr=2.47e-05]
Epoch 1/5:  25%|██▍       | 291/1177 [13:53<36:34,  2.48s/it, exist=0.6446, loss=0.7458, lr=2.47e-05]
Epoch 1/5:  25%|██▍       | 291/1177 [13:58<36:34,  2.48s/it, exist=0.6444, loss=0.7456, lr=2.48e-05]
Epoch 1/5:  25%|██▍       | 292/1177 [13:58<45:22,  3.08s/it, exist=0.6444, loss=0.7456, lr=2.48e-05]
Epoch 1/5:  25%|██▍       | 292/1177 [14:00<45:22,  3.08s/it, exist=0.6435, loss=0.7448, lr=2.49e-05]
Epoch 1/5:  25%|██▍       | 293/1177 [14:00<40:36,  2.76s/it, exist=0.6435, loss=0.7448, lr=2.49e-05]
Epoch 1/5:  25%|██▍       | 293/1177 [14:03<40:36,  2.76s/it, exist=0.6429, loss=0.7444, lr=2.50e-05]
Epoch 1/5:  25%|██▍       | 294/1177 [14:03<43:10,  2.93s/it, exist=0.6429, loss=0.7444, lr=2.50e-05]
Epoch 1/5:  25%|██▍       | 294/1177 [14:06<43:10,  2.93s/it, exist=0.6419, loss=0.7432, lr=2.51e-05]
Epoch 1/5:  25%|██▌       | 295/1177 [14:06<40:52,  2.78s/it, exist=0.6419, loss=0.7432, lr=2.51e-05]
Epoch 1/5:  25%|██▌       | 295/1177 [14:08<40:52,  2.78s/it, exist=0.6417, loss=0.7429, lr=2.52e-05]
Epoch 1/5:  25%|██▌       | 296/1177 [14:08<40:06,  2.73s/it, exist=0.6417, loss=0.7429, lr=2.52e-05]
Epoch 1/5:  25%|██▌       | 296/1177 [14:11<40:06,  2.73s/it, exist=0.6406, loss=0.7421, lr=2.53e-05]
Epoch 1/5:  25%|██▌       | 297/1177 [14:11<38:39,  2.64s/it, exist=0.6406, loss=0.7421, lr=2.53e-05]
Epoch 1/5:  25%|██▌       | 297/1177 [14:13<38:39,  2.64s/it, exist=0.6408, loss=0.7421, lr=2.53e-05]
Epoch 1/5:  25%|██▌       | 298/1177 [14:13<38:29,  2.63s/it, exist=0.6408, loss=0.7421, lr=2.53e-05]
Epoch 1/5:  25%|██▌       | 298/1177 [14:16<38:29,  2.63s/it, exist=0.6409, loss=0.7426, lr=2.54e-05]
Epoch 1/5:  25%|██▌       | 299/1177 [14:16<38:21,  2.62s/it, exist=0.6409, loss=0.7426, lr=2.54e-05]
Epoch 1/5:  25%|██▌       | 299/1177 [14:18<38:21,  2.62s/it, exist=0.6400, loss=0.7419, lr=2.55e-05]
Epoch 1/5:  25%|██▌       | 300/1177 [14:18<38:29,  2.63s/it, exist=0.6400, loss=0.7419, lr=2.55e-05]
Epoch 1/5:  25%|██▌       | 300/1177 [14:22<38:29,  2.63s/it, exist=0.6394, loss=0.7414, lr=2.56e-05]
Epoch 1/5:  26%|██▌       | 301/1177 [14:22<40:42,  2.79s/it, exist=0.6394, loss=0.7414, lr=2.56e-05]
Epoch 1/5:  26%|██▌       | 301/1177 [14:24<40:42,  2.79s/it, exist=0.6389, loss=0.7410, lr=2.57e-05]
Epoch 1/5:  26%|██▌       | 302/1177 [14:24<37:21,  2.56s/it, exist=0.6389, loss=0.7410, lr=2.57e-05]
Epoch 1/5:  26%|██▌       | 302/1177 [14:26<37:21,  2.56s/it, exist=0.6375, loss=0.7395, lr=2.58e-05]
Epoch 1/5:  26%|██▌       | 303/1177 [14:26<36:59,  2.54s/it, exist=0.6375, loss=0.7395, lr=2.58e-05]
Epoch 1/5:  26%|██▌       | 303/1177 [14:29<36:59,  2.54s/it, exist=0.6377, loss=0.7395, lr=2.59e-05]
Epoch 1/5:  26%|██▌       | 304/1177 [14:29<37:08,  2.55s/it, exist=0.6377, loss=0.7395, lr=2.59e-05]
Epoch 1/5:  26%|██▌       | 304/1177 [14:31<37:08,  2.55s/it, exist=0.6372, loss=0.7389, lr=2.59e-05]
Epoch 1/5:  26%|██▌       | 305/1177 [14:31<36:55,  2.54s/it, exist=0.6372, loss=0.7389, lr=2.59e-05]
Epoch 1/5:  26%|██▌       | 305/1177 [14:34<36:55,  2.54s/it, exist=0.6376, loss=0.7393, lr=2.60e-05]
Epoch 1/5:  26%|██▌       | 306/1177 [14:34<36:56,  2.54s/it, exist=0.6376, loss=0.7393, lr=2.60e-05]
Epoch 1/5:  26%|██▌       | 306/1177 [14:36<36:56,  2.54s/it, exist=0.6375, loss=0.7391, lr=2.61e-05]
Epoch 1/5:  26%|██▌       | 307/1177 [14:36<37:21,  2.58s/it, exist=0.6375, loss=0.7391, lr=2.61e-05]
Epoch 1/5:  26%|██▌       | 307/1177 [14:38<37:21,  2.58s/it, exist=0.6370, loss=0.7389, lr=2.62e-05]
Epoch 1/5:  26%|██▌       | 308/1177 [14:38<34:40,  2.39s/it, exist=0.6370, loss=0.7389, lr=2.62e-05]
Epoch 1/5:  26%|██▌       | 308/1177 [14:41<34:40,  2.39s/it, exist=0.6371, loss=0.7390, lr=2.63e-05]
Epoch 1/5:  26%|██▋       | 309/1177 [14:41<37:20,  2.58s/it, exist=0.6371, loss=0.7390, lr=2.63e-05]
Epoch 1/5:  26%|██▋       | 309/1177 [14:44<37:20,  2.58s/it, exist=0.6368, loss=0.7385, lr=2.64e-05]
Epoch 1/5:  26%|██▋       | 310/1177 [14:44<37:11,  2.57s/it, exist=0.6368, loss=0.7385, lr=2.64e-05]
Epoch 1/5:  26%|██▋       | 310/1177 [14:47<37:11,  2.57s/it, exist=0.6362, loss=0.7378, lr=2.64e-05]
Epoch 1/5:  26%|██▋       | 311/1177 [14:47<37:23,  2.59s/it, exist=0.6362, loss=0.7378, lr=2.64e-05]
Epoch 1/5:  26%|██▋       | 311/1177 [14:49<37:23,  2.59s/it, exist=0.6370, loss=0.7385, lr=2.65e-05]
Epoch 1/5:  27%|██▋       | 312/1177 [14:49<37:20,  2.59s/it, exist=0.6370, loss=0.7385, lr=2.65e-05]
Epoch 1/5:  27%|██▋       | 312/1177 [14:52<37:20,  2.59s/it, exist=0.6371, loss=0.7392, lr=2.66e-05]
Epoch 1/5:  27%|██▋       | 313/1177 [14:52<37:31,  2.61s/it, exist=0.6371, loss=0.7392, lr=2.66e-05]
Epoch 1/5:  27%|██▋       | 313/1177 [14:54<37:31,  2.61s/it, exist=0.6370, loss=0.7390, lr=2.67e-05]
Epoch 1/5:  27%|██▋       | 314/1177 [14:54<34:49,  2.42s/it, exist=0.6370, loss=0.7390, lr=2.67e-05]
Epoch 1/5:  27%|██▋       | 314/1177 [14:56<34:49,  2.42s/it, exist=0.6375, loss=0.7393, lr=2.68e-05]
Epoch 1/5:  27%|██▋       | 315/1177 [14:56<33:15,  2.31s/it, exist=0.6375, loss=0.7393, lr=2.68e-05]
Epoch 1/5:  27%|██▋       | 315/1177 [15:01<33:15,  2.31s/it, exist=0.6375, loss=0.7396, lr=2.69e-05]
Epoch 1/5:  27%|██▋       | 316/1177 [15:01<46:37,  3.25s/it, exist=0.6375, loss=0.7396, lr=2.69e-05]
Epoch 1/5:  27%|██▋       | 316/1177 [15:07<46:37,  3.25s/it, exist=0.6372, loss=0.7394, lr=2.70e-05]
Epoch 1/5:  27%|██▋       | 317/1177 [15:07<58:23,  4.07s/it, exist=0.6372, loss=0.7394, lr=2.70e-05]
Epoch 1/5:  27%|██▋       | 317/1177 [15:12<58:23,  4.07s/it, exist=0.6369, loss=0.7392, lr=2.70e-05]
Epoch 1/5:  27%|██▋       | 318/1177 [15:12<1:02:54,  4.39s/it, exist=0.6369, loss=0.7392, lr=2.70e-05]
Epoch 1/5:  27%|██▋       | 318/1177 [15:17<1:02:54,  4.39s/it, exist=0.6360, loss=0.7385, lr=2.71e-05]
Epoch 1/5:  27%|██▋       | 319/1177 [15:17<1:05:16,  4.56s/it, exist=0.6360, loss=0.7385, lr=2.71e-05]
Epoch 1/5:  27%|██▋       | 319/1177 [15:20<1:05:16,  4.56s/it, exist=0.6365, loss=0.7389, lr=2.72e-05]
Epoch 1/5:  27%|██▋       | 320/1177 [15:20<57:59,  4.06s/it, exist=0.6365, loss=0.7389, lr=2.72e-05]  
Epoch 1/5:  27%|██▋       | 320/1177 [15:23<57:59,  4.06s/it, exist=0.6356, loss=0.7379, lr=2.73e-05]
Epoch 1/5:  27%|██▋       | 321/1177 [15:23<51:46,  3.63s/it, exist=0.6356, loss=0.7379, lr=2.73e-05]
Epoch 1/5:  27%|██▋       | 321/1177 [15:25<51:46,  3.63s/it, exist=0.6354, loss=0.7377, lr=2.74e-05]
Epoch 1/5:  27%|██▋       | 322/1177 [15:25<46:58,  3.30s/it, exist=0.6354, loss=0.7377, lr=2.74e-05]
Epoch 1/5:  27%|██▋       | 322/1177 [15:28<46:58,  3.30s/it, exist=0.6347, loss=0.7369, lr=2.75e-05]
Epoch 1/5:  27%|██▋       | 323/1177 [15:28<43:45,  3.07s/it, exist=0.6347, loss=0.7369, lr=2.75e-05]
Epoch 1/5:  27%|██▋       | 323/1177 [15:30<43:45,  3.07s/it, exist=0.6339, loss=0.7360, lr=2.76e-05]
Epoch 1/5:  28%|██▊       | 324/1177 [15:30<39:13,  2.76s/it, exist=0.6339, loss=0.7360, lr=2.76e-05]
Epoch 1/5:  28%|██▊       | 324/1177 [15:32<39:13,  2.76s/it, exist=0.6334, loss=0.7354, lr=2.76e-05]
Epoch 1/5:  28%|██▊       | 325/1177 [15:32<35:53,  2.53s/it, exist=0.6334, loss=0.7354, lr=2.76e-05]
Epoch 1/5:  28%|██▊       | 325/1177 [15:36<35:53,  2.53s/it, exist=0.6328, loss=0.7347, lr=2.77e-05]
Epoch 1/5:  28%|██▊       | 326/1177 [15:36<41:41,  2.94s/it, exist=0.6328, loss=0.7347, lr=2.77e-05]
Epoch 1/5:  28%|██▊       | 326/1177 [15:39<41:41,  2.94s/it, exist=0.6331, loss=0.7352, lr=2.78e-05]
Epoch 1/5:  28%|██▊       | 327/1177 [15:39<40:11,  2.84s/it, exist=0.6331, loss=0.7352, lr=2.78e-05]
Epoch 1/5:  28%|██▊       | 327/1177 [15:41<40:11,  2.84s/it, exist=0.6328, loss=0.7357, lr=2.79e-05]
Epoch 1/5:  28%|██▊       | 328/1177 [15:41<38:21,  2.71s/it, exist=0.6328, loss=0.7357, lr=2.79e-05]
Epoch 1/5:  28%|██▊       | 328/1177 [15:43<38:21,  2.71s/it, exist=0.6326, loss=0.7353, lr=2.80e-05]
Epoch 1/5:  28%|██▊       | 329/1177 [15:43<37:24,  2.65s/it, exist=0.6326, loss=0.7353, lr=2.80e-05]
Epoch 1/5:  28%|██▊       | 329/1177 [15:46<37:24,  2.65s/it, exist=0.6329, loss=0.7354, lr=2.81e-05]
Epoch 1/5:  28%|██▊       | 330/1177 [15:46<36:28,  2.58s/it, exist=0.6329, loss=0.7354, lr=2.81e-05]
Epoch 1/5:  28%|██▊       | 330/1177 [15:48<36:28,  2.58s/it, exist=0.6327, loss=0.7353, lr=2.81e-05]
Epoch 1/5:  28%|██▊       | 331/1177 [15:48<34:01,  2.41s/it, exist=0.6327, loss=0.7353, lr=2.81e-05]
Epoch 1/5:  28%|██▊       | 331/1177 [15:51<34:01,  2.41s/it, exist=0.6328, loss=0.7355, lr=2.82e-05]
Epoch 1/5:  28%|██▊       | 332/1177 [15:51<37:02,  2.63s/it, exist=0.6328, loss=0.7355, lr=2.82e-05]
Epoch 1/5:  28%|██▊       | 332/1177 [15:54<37:02,  2.63s/it, exist=0.6329, loss=0.7356, lr=2.83e-05]
Epoch 1/5:  28%|██▊       | 333/1177 [15:54<39:45,  2.83s/it, exist=0.6329, loss=0.7356, lr=2.83e-05]
Epoch 1/5:  28%|██▊       | 333/1177 [15:58<39:45,  2.83s/it, exist=0.6331, loss=0.7358, lr=2.84e-05]
Epoch 1/5:  28%|██▊       | 334/1177 [15:58<42:51,  3.05s/it, exist=0.6331, loss=0.7358, lr=2.84e-05]
Epoch 1/5:  28%|██▊       | 334/1177 [16:00<42:51,  3.05s/it, exist=0.6329, loss=0.7354, lr=2.85e-05]
Epoch 1/5:  28%|██▊       | 335/1177 [16:00<38:39,  2.75s/it, exist=0.6329, loss=0.7354, lr=2.85e-05]
Epoch 1/5:  28%|██▊       | 335/1177 [16:02<38:39,  2.75s/it, exist=0.6323, loss=0.7348, lr=2.86e-05]
Epoch 1/5:  29%|██▊       | 336/1177 [16:02<37:35,  2.68s/it, exist=0.6323, loss=0.7348, lr=2.86e-05]
Epoch 1/5:  29%|██▊       | 336/1177 [16:05<37:35,  2.68s/it, exist=0.6324, loss=0.7348, lr=2.87e-05]
Epoch 1/5:  29%|██▊       | 337/1177 [16:05<37:02,  2.65s/it, exist=0.6324, loss=0.7348, lr=2.87e-05]
Epoch 1/5:  29%|██▊       | 337/1177 [16:07<37:02,  2.65s/it, exist=0.6320, loss=0.7345, lr=2.87e-05]
Epoch 1/5:  29%|██▊       | 338/1177 [16:07<34:16,  2.45s/it, exist=0.6320, loss=0.7345, lr=2.87e-05]
Epoch 1/5:  29%|██▊       | 338/1177 [16:12<34:16,  2.45s/it, exist=0.6319, loss=0.7345, lr=2.88e-05]
Epoch 1/5:  29%|██▉       | 339/1177 [16:12<44:41,  3.20s/it, exist=0.6319, loss=0.7345, lr=2.88e-05]
Epoch 1/5:  29%|██▉       | 339/1177 [16:16<44:41,  3.20s/it, exist=0.6319, loss=0.7345, lr=2.89e-05]
Epoch 1/5:  29%|██▉       | 340/1177 [16:16<47:50,  3.43s/it, exist=0.6319, loss=0.7345, lr=2.89e-05]
Epoch 1/5:  29%|██▉       | 340/1177 [16:20<47:50,  3.43s/it, exist=0.6314, loss=0.7346, lr=2.90e-05]
Epoch 1/5:  29%|██▉       | 341/1177 [16:20<48:46,  3.50s/it, exist=0.6314, loss=0.7346, lr=2.90e-05]
Epoch 1/5:  29%|██▉       | 341/1177 [16:23<48:46,  3.50s/it, exist=0.6306, loss=0.7342, lr=2.91e-05]
Epoch 1/5:  29%|██▉       | 342/1177 [16:23<49:58,  3.59s/it, exist=0.6306, loss=0.7342, lr=2.91e-05]
Epoch 1/5:  29%|██▉       | 342/1177 [16:26<49:58,  3.59s/it, exist=0.6311, loss=0.7347, lr=2.92e-05]
Epoch 1/5:  29%|██▉       | 343/1177 [16:26<46:58,  3.38s/it, exist=0.6311, loss=0.7347, lr=2.92e-05]
Epoch 1/5:  29%|██▉       | 343/1177 [16:30<46:58,  3.38s/it, exist=0.6304, loss=0.7339, lr=2.93e-05]
Epoch 1/5:  29%|██▉       | 344/1177 [16:30<48:12,  3.47s/it, exist=0.6304, loss=0.7339, lr=2.93e-05]
Epoch 1/5:  29%|██▉       | 344/1177 [16:34<48:12,  3.47s/it, exist=0.6302, loss=0.7336, lr=2.93e-05]
Epoch 1/5:  29%|██▉       | 345/1177 [16:34<49:27,  3.57s/it, exist=0.6302, loss=0.7336, lr=2.93e-05]
Epoch 1/5:  29%|██▉       | 345/1177 [16:36<49:27,  3.57s/it, exist=0.6302, loss=0.7333, lr=2.94e-05]
Epoch 1/5:  29%|██▉       | 346/1177 [16:36<42:57,  3.10s/it, exist=0.6302, loss=0.7333, lr=2.94e-05]
Epoch 1/5:  29%|██▉       | 346/1177 [16:38<42:57,  3.10s/it, exist=0.6303, loss=0.7333, lr=2.95e-05]
Epoch 1/5:  29%|██▉       | 347/1177 [16:38<40:59,  2.96s/it, exist=0.6303, loss=0.7333, lr=2.95e-05]
Epoch 1/5:  29%|██▉       | 347/1177 [16:41<40:59,  2.96s/it, exist=0.6302, loss=0.7332, lr=2.96e-05]
Epoch 1/5:  30%|██▉       | 348/1177 [16:41<40:04,  2.90s/it, exist=0.6302, loss=0.7332, lr=2.96e-05]
Epoch 1/5:  30%|██▉       | 348/1177 [16:45<40:04,  2.90s/it, exist=0.6302, loss=0.7330, lr=2.97e-05]
Epoch 1/5:  30%|██▉       | 349/1177 [16:45<43:04,  3.12s/it, exist=0.6302, loss=0.7330, lr=2.97e-05]
Epoch 1/5:  30%|██▉       | 349/1177 [16:49<43:04,  3.12s/it, exist=0.6302, loss=0.7331, lr=2.98e-05]
Epoch 1/5:  30%|██▉       | 350/1177 [16:49<47:07,  3.42s/it, exist=0.6302, loss=0.7331, lr=2.98e-05]
Epoch 1/5:  30%|██▉       | 350/1177 [16:53<47:07,  3.42s/it, exist=0.6305, loss=0.7333, lr=2.98e-05]
Epoch 1/5:  30%|██▉       | 351/1177 [16:53<49:11,  3.57s/it, exist=0.6305, loss=0.7333, lr=2.98e-05]
Epoch 1/5:  30%|██▉       | 351/1177 [16:57<49:11,  3.57s/it, exist=0.6301, loss=0.7327, lr=2.99e-05]
Epoch 1/5:  30%|██▉       | 352/1177 [16:57<52:08,  3.79s/it, exist=0.6301, loss=0.7327, lr=2.99e-05]
Epoch 1/5:  30%|██▉       | 352/1177 [17:01<52:08,  3.79s/it, exist=0.6305, loss=0.7330, lr=3.00e-05]
Epoch 1/5:  30%|██▉       | 353/1177 [17:01<52:12,  3.80s/it, exist=0.6305, loss=0.7330, lr=3.00e-05]
Epoch 1/5:  30%|██▉       | 353/1177 [17:05<52:12,  3.80s/it, exist=0.6298, loss=0.7323, lr=3.01e-05]
Epoch 1/5:  30%|███       | 354/1177 [17:05<53:26,  3.90s/it, exist=0.6298, loss=0.7323, lr=3.01e-05]
Epoch 1/5:  30%|███       | 354/1177 [17:09<53:26,  3.90s/it, exist=0.6296, loss=0.7322, lr=3.02e-05]
Epoch 1/5:  30%|███       | 355/1177 [17:09<53:50,  3.93s/it, exist=0.6296, loss=0.7322, lr=3.02e-05]
Epoch 1/5:  30%|███       | 355/1177 [17:12<53:50,  3.93s/it, exist=0.6294, loss=0.7320, lr=3.03e-05]
Epoch 1/5:  30%|███       | 356/1177 [17:12<49:18,  3.60s/it, exist=0.6294, loss=0.7320, lr=3.03e-05]
Epoch 1/5:  30%|███       | 356/1177 [17:16<49:18,  3.60s/it, exist=0.6290, loss=0.7316, lr=3.04e-05]
Epoch 1/5:  30%|███       | 357/1177 [17:16<53:00,  3.88s/it, exist=0.6290, loss=0.7316, lr=3.04e-05]
Epoch 1/5:  30%|███       | 357/1177 [17:20<53:00,  3.88s/it, exist=0.6286, loss=0.7312, lr=3.04e-05]
Epoch 1/5:  30%|███       | 358/1177 [17:20<52:23,  3.84s/it, exist=0.6286, loss=0.7312, lr=3.04e-05]
Epoch 1/5:  30%|███       | 358/1177 [17:24<52:23,  3.84s/it, exist=0.6284, loss=0.7310, lr=3.05e-05]
Epoch 1/5:  31%|███       | 359/1177 [17:24<53:09,  3.90s/it, exist=0.6284, loss=0.7310, lr=3.05e-05]
Epoch 1/5:  31%|███       | 359/1177 [17:28<53:09,  3.90s/it, exist=0.6282, loss=0.7307, lr=3.06e-05]
Epoch 1/5:  31%|███       | 360/1177 [17:28<51:32,  3.78s/it, exist=0.6282, loss=0.7307, lr=3.06e-05]
Epoch 1/5:  31%|███       | 360/1177 [17:31<51:32,  3.78s/it, exist=0.6278, loss=0.7303, lr=3.07e-05]
Epoch 1/5:  31%|███       | 361/1177 [17:31<51:07,  3.76s/it, exist=0.6278, loss=0.7303, lr=3.07e-05]
Epoch 1/5:  31%|███       | 361/1177 [17:35<51:07,  3.76s/it, exist=0.6284, loss=0.7308, lr=3.08e-05]
Epoch 1/5:  31%|███       | 362/1177 [17:35<50:53,  3.75s/it, exist=0.6284, loss=0.7308, lr=3.08e-05]
Epoch 1/5:  31%|███       | 362/1177 [17:39<50:53,  3.75s/it, exist=0.6287, loss=0.7310, lr=3.09e-05]
Epoch 1/5:  31%|███       | 363/1177 [17:39<49:54,  3.68s/it, exist=0.6287, loss=0.7310, lr=3.09e-05]
Epoch 1/5:  31%|███       | 363/1177 [17:42<49:54,  3.68s/it, exist=0.6284, loss=0.7307, lr=3.10e-05]
Epoch 1/5:  31%|███       | 364/1177 [17:42<47:41,  3.52s/it, exist=0.6284, loss=0.7307, lr=3.10e-05]
Epoch 1/5:  31%|███       | 364/1177 [17:44<47:41,  3.52s/it, exist=0.6284, loss=0.7305, lr=3.10e-05]
Epoch 1/5:  31%|███       | 365/1177 [17:44<41:37,  3.08s/it, exist=0.6284, loss=0.7305, lr=3.10e-05]
Epoch 1/5:  31%|███       | 365/1177 [17:47<41:37,  3.08s/it, exist=0.6285, loss=0.7307, lr=3.11e-05]
Epoch 1/5:  31%|███       | 366/1177 [17:47<39:55,  2.95s/it, exist=0.6285, loss=0.7307, lr=3.11e-05]
Epoch 1/5:  31%|███       | 366/1177 [17:49<39:55,  2.95s/it, exist=0.6284, loss=0.7305, lr=3.12e-05]
Epoch 1/5:  31%|███       | 367/1177 [17:49<36:01,  2.67s/it, exist=0.6284, loss=0.7305, lr=3.12e-05]
Epoch 1/5:  31%|███       | 367/1177 [17:51<36:01,  2.67s/it, exist=0.6278, loss=0.7299, lr=3.13e-05]
Epoch 1/5:  31%|███▏      | 368/1177 [17:51<36:02,  2.67s/it, exist=0.6278, loss=0.7299, lr=3.13e-05]
Epoch 1/5:  31%|███▏      | 368/1177 [17:54<36:02,  2.67s/it, exist=0.6275, loss=0.7295, lr=3.14e-05]
Epoch 1/5:  31%|███▏      | 369/1177 [17:54<37:54,  2.81s/it, exist=0.6275, loss=0.7295, lr=3.14e-05]
Epoch 1/5:  31%|███▏      | 369/1177 [17:59<37:54,  2.81s/it, exist=0.6271, loss=0.7290, lr=3.15e-05]
Epoch 1/5:  31%|███▏      | 370/1177 [17:59<43:29,  3.23s/it, exist=0.6271, loss=0.7290, lr=3.15e-05]
Epoch 1/5:  31%|███▏      | 370/1177 [18:01<43:29,  3.23s/it, exist=0.6265, loss=0.7285, lr=3.15e-05]
Epoch 1/5:  32%|███▏      | 371/1177 [18:01<41:08,  3.06s/it, exist=0.6265, loss=0.7285, lr=3.15e-05]
Epoch 1/5:  32%|███▏      | 371/1177 [18:04<41:08,  3.06s/it, exist=0.6262, loss=0.7281, lr=3.16e-05]
Epoch 1/5:  32%|███▏      | 372/1177 [18:04<40:32,  3.02s/it, exist=0.6262, loss=0.7281, lr=3.16e-05]
Epoch 1/5:  32%|███▏      | 372/1177 [18:07<40:32,  3.02s/it, exist=0.6256, loss=0.7280, lr=3.17e-05]
Epoch 1/5:  32%|███▏      | 373/1177 [18:07<40:13,  3.00s/it, exist=0.6256, loss=0.7280, lr=3.17e-05]
Epoch 1/5:  32%|███▏      | 373/1177 [18:11<40:13,  3.00s/it, exist=0.6257, loss=0.7280, lr=3.18e-05]
Epoch 1/5:  32%|███▏      | 374/1177 [18:11<44:40,  3.34s/it, exist=0.6257, loss=0.7280, lr=3.18e-05]
Epoch 1/5:  32%|███▏      | 374/1177 [18:14<44:40,  3.34s/it, exist=0.6255, loss=0.7276, lr=3.19e-05]
Epoch 1/5:  32%|███▏      | 375/1177 [18:14<41:22,  3.10s/it, exist=0.6255, loss=0.7276, lr=3.19e-05]
Epoch 1/5:  32%|███▏      | 375/1177 [18:16<41:22,  3.10s/it, exist=0.6257, loss=0.7278, lr=3.20e-05]
Epoch 1/5:  32%|███▏      | 376/1177 [18:16<39:06,  2.93s/it, exist=0.6257, loss=0.7278, lr=3.20e-05]
Epoch 1/5:  32%|███▏      | 376/1177 [18:19<39:06,  2.93s/it, exist=0.6251, loss=0.7271, lr=3.21e-05]
Epoch 1/5:  32%|███▏      | 377/1177 [18:19<38:09,  2.86s/it, exist=0.6251, loss=0.7271, lr=3.21e-05]
Epoch 1/5:  32%|███▏      | 377/1177 [18:22<38:09,  2.86s/it, exist=0.6247, loss=0.7269, lr=3.21e-05]
Epoch 1/5:  32%|███▏      | 378/1177 [18:22<38:24,  2.88s/it, exist=0.6247, loss=0.7269, lr=3.21e-05]
Epoch 1/5:  32%|███▏      | 378/1177 [18:27<38:24,  2.88s/it, exist=0.6245, loss=0.7268, lr=3.22e-05]
Epoch 1/5:  32%|███▏      | 379/1177 [18:27<46:44,  3.51s/it, exist=0.6245, loss=0.7268, lr=3.22e-05]
Epoch 1/5:  32%|███▏      | 379/1177 [18:30<46:44,  3.51s/it, exist=0.6241, loss=0.7263, lr=3.23e-05]
Epoch 1/5:  32%|███▏      | 380/1177 [18:30<44:28,  3.35s/it, exist=0.6241, loss=0.7263, lr=3.23e-05]
Epoch 1/5:  32%|███▏      | 380/1177 [18:33<44:28,  3.35s/it, exist=0.6237, loss=0.7259, lr=3.24e-05]
Epoch 1/5:  32%|███▏      | 381/1177 [18:33<44:34,  3.36s/it, exist=0.6237, loss=0.7259, lr=3.24e-05]
Epoch 1/5:  32%|███▏      | 381/1177 [18:37<44:34,  3.36s/it, exist=0.6235, loss=0.7262, lr=3.25e-05]
Epoch 1/5:  32%|███▏      | 382/1177 [18:37<45:00,  3.40s/it, exist=0.6235, loss=0.7262, lr=3.25e-05]
Epoch 1/5:  32%|███▏      | 382/1177 [18:39<45:00,  3.40s/it, exist=0.6231, loss=0.7258, lr=3.26e-05]
Epoch 1/5:  33%|███▎      | 383/1177 [18:39<41:55,  3.17s/it, exist=0.6231, loss=0.7258, lr=3.26e-05]
Epoch 1/5:  33%|███▎      | 383/1177 [18:42<41:55,  3.17s/it, exist=0.6233, loss=0.7258, lr=3.27e-05]
Epoch 1/5:  33%|███▎      | 384/1177 [18:42<40:02,  3.03s/it, exist=0.6233, loss=0.7258, lr=3.27e-05]
Epoch 1/5:  33%|███▎      | 384/1177 [18:45<40:02,  3.03s/it, exist=0.6230, loss=0.7256, lr=3.27e-05]
Epoch 1/5:  33%|███▎      | 385/1177 [18:45<38:37,  2.93s/it, exist=0.6230, loss=0.7256, lr=3.27e-05]
Epoch 1/5:  33%|███▎      | 385/1177 [18:49<38:37,  2.93s/it, exist=0.6226, loss=0.7251, lr=3.28e-05]
Epoch 1/5:  33%|███▎      | 386/1177 [18:49<44:01,  3.34s/it, exist=0.6226, loss=0.7251, lr=3.28e-05]
Epoch 1/5:  33%|███▎      | 386/1177 [18:52<44:01,  3.34s/it, exist=0.6227, loss=0.7252, lr=3.29e-05]
Epoch 1/5:  33%|███▎      | 387/1177 [18:52<41:12,  3.13s/it, exist=0.6227, loss=0.7252, lr=3.29e-05]
Epoch 1/5:  33%|███▎      | 387/1177 [18:55<41:12,  3.13s/it, exist=0.6239, loss=0.7261, lr=3.30e-05]
Epoch 1/5:  33%|███▎      | 388/1177 [18:55<39:44,  3.02s/it, exist=0.6239, loss=0.7261, lr=3.30e-05]
Epoch 1/5:  33%|███▎      | 388/1177 [18:58<39:44,  3.02s/it, exist=0.6231, loss=0.7252, lr=3.31e-05]
Epoch 1/5:  33%|███▎      | 389/1177 [18:58<39:39,  3.02s/it, exist=0.6231, loss=0.7252, lr=3.31e-05]
Epoch 1/5:  33%|███▎      | 389/1177 [19:01<39:39,  3.02s/it, exist=0.6230, loss=0.7252, lr=3.32e-05]
Epoch 1/5:  33%|███▎      | 390/1177 [19:01<42:12,  3.22s/it, exist=0.6230, loss=0.7252, lr=3.32e-05]
Epoch 1/5:  33%|███▎      | 390/1177 [19:05<42:12,  3.22s/it, exist=0.6229, loss=0.7251, lr=3.32e-05]
Epoch 1/5:  33%|███▎      | 391/1177 [19:05<43:22,  3.31s/it, exist=0.6229, loss=0.7251, lr=3.32e-05]
Epoch 1/5:  33%|███▎      | 391/1177 [19:08<43:22,  3.31s/it, exist=0.6233, loss=0.7254, lr=3.33e-05]
Epoch 1/5:  33%|███▎      | 392/1177 [19:08<43:00,  3.29s/it, exist=0.6233, loss=0.7254, lr=3.33e-05]
Epoch 1/5:  33%|███▎      | 392/1177 [19:11<43:00,  3.29s/it, exist=0.6239, loss=0.7258, lr=3.34e-05]
Epoch 1/5:  33%|███▎      | 393/1177 [19:11<41:18,  3.16s/it, exist=0.6239, loss=0.7258, lr=3.34e-05]
Epoch 1/5:  33%|███▎      | 393/1177 [19:15<41:18,  3.16s/it, exist=0.6245, loss=0.7263, lr=3.35e-05]
Epoch 1/5:  33%|███▎      | 394/1177 [19:15<44:13,  3.39s/it, exist=0.6245, loss=0.7263, lr=3.35e-05]
Epoch 1/5:  33%|███▎      | 394/1177 [19:19<44:13,  3.39s/it, exist=0.6243, loss=0.7261, lr=3.36e-05]
Epoch 1/5:  34%|███▎      | 395/1177 [19:19<48:02,  3.69s/it, exist=0.6243, loss=0.7261, lr=3.36e-05]
Epoch 1/5:  34%|███▎      | 395/1177 [19:23<48:02,  3.69s/it, exist=0.6244, loss=0.7261, lr=3.37e-05]
Epoch 1/5:  34%|███▎      | 396/1177 [19:23<48:36,  3.73s/it, exist=0.6244, loss=0.7261, lr=3.37e-05]
Epoch 1/5:  34%|███▎      | 396/1177 [19:27<48:36,  3.73s/it, exist=0.6241, loss=0.7260, lr=3.38e-05]
Epoch 1/5:  34%|███▎      | 397/1177 [19:27<48:17,  3.71s/it, exist=0.6241, loss=0.7260, lr=3.38e-05]
Epoch 1/5:  34%|███▎      | 397/1177 [19:30<48:17,  3.71s/it, exist=0.6240, loss=0.7257, lr=3.38e-05]
Epoch 1/5:  34%|███▍      | 398/1177 [19:30<47:34,  3.66s/it, exist=0.6240, loss=0.7257, lr=3.38e-05]
Epoch 1/5:  34%|███▍      | 398/1177 [19:33<47:34,  3.66s/it, exist=0.6241, loss=0.7262, lr=3.39e-05]
Epoch 1/5:  34%|███▍      | 399/1177 [19:33<44:23,  3.42s/it, exist=0.6241, loss=0.7262, lr=3.39e-05]
Epoch 1/5:  34%|███▍      | 399/1177 [19:35<44:23,  3.42s/it, exist=0.6243, loss=0.7262, lr=3.40e-05]
Epoch 1/5:  34%|███▍      | 400/1177 [19:35<39:00,  3.01s/it, exist=0.6243, loss=0.7262, lr=3.40e-05]
Epoch 1/5:  34%|███▍      | 400/1177 [19:39<39:00,  3.01s/it, exist=0.6246, loss=0.7265, lr=3.41e-05]
Epoch 1/5:  34%|███▍      | 401/1177 [19:39<40:50,  3.16s/it, exist=0.6246, loss=0.7265, lr=3.41e-05]
Epoch 1/5:  34%|███▍      | 401/1177 [19:42<40:50,  3.16s/it, exist=0.6250, loss=0.7267, lr=3.42e-05]
Epoch 1/5:  34%|███▍      | 402/1177 [19:42<42:43,  3.31s/it, exist=0.6250, loss=0.7267, lr=3.42e-05]
Epoch 1/5:  34%|███▍      | 402/1177 [19:47<42:43,  3.31s/it, exist=0.6248, loss=0.7263, lr=3.43e-05]
Epoch 1/5:  34%|███▍      | 403/1177 [19:47<46:52,  3.63s/it, exist=0.6248, loss=0.7263, lr=3.43e-05]
Epoch 1/5:  34%|███▍      | 403/1177 [19:49<46:52,  3.63s/it, exist=0.6244, loss=0.7262, lr=3.44e-05]
Epoch 1/5:  34%|███▍      | 404/1177 [19:49<40:32,  3.15s/it, exist=0.6244, loss=0.7262, lr=3.44e-05]
Epoch 1/5:  34%|███▍      | 404/1177 [19:51<40:32,  3.15s/it, exist=0.6247, loss=0.7264, lr=3.44e-05]
Epoch 1/5:  34%|███▍      | 405/1177 [19:51<38:00,  2.95s/it, exist=0.6247, loss=0.7264, lr=3.44e-05]
Epoch 1/5:  34%|███▍      | 405/1177 [19:54<38:00,  2.95s/it, exist=0.6250, loss=0.7269, lr=3.45e-05]
Epoch 1/5:  34%|███▍      | 406/1177 [19:54<36:30,  2.84s/it, exist=0.6250, loss=0.7269, lr=3.45e-05]
Epoch 1/5:  34%|███▍      | 406/1177 [19:56<36:30,  2.84s/it, exist=0.6250, loss=0.7270, lr=3.46e-05]
Epoch 1/5:  35%|███▍      | 407/1177 [19:56<35:36,  2.78s/it, exist=0.6250, loss=0.7270, lr=3.46e-05]
Epoch 1/5:  35%|███▍      | 407/1177 [19:58<35:36,  2.78s/it, exist=0.6249, loss=0.7267, lr=3.47e-05]
Epoch 1/5:  35%|███▍      | 408/1177 [19:58<32:44,  2.55s/it, exist=0.6249, loss=0.7267, lr=3.47e-05]
Epoch 1/5:  35%|███▍      | 408/1177 [20:02<32:44,  2.55s/it, exist=0.6246, loss=0.7264, lr=3.48e-05]
Epoch 1/5:  35%|███▍      | 409/1177 [20:02<35:11,  2.75s/it, exist=0.6246, loss=0.7264, lr=3.48e-05]
Epoch 1/5:  35%|███▍      | 409/1177 [20:06<35:11,  2.75s/it, exist=0.6244, loss=0.7266, lr=3.49e-05]
Epoch 1/5:  35%|███▍      | 410/1177 [20:06<40:14,  3.15s/it, exist=0.6244, loss=0.7266, lr=3.49e-05]
Epoch 1/5:  35%|███▍      | 410/1177 [20:09<40:14,  3.15s/it, exist=0.6243, loss=0.7268, lr=3.49e-05]
Epoch 1/5:  35%|███▍      | 411/1177 [20:09<41:43,  3.27s/it, exist=0.6243, loss=0.7268, lr=3.49e-05]
Epoch 1/5:  35%|███▍      | 411/1177 [20:14<41:43,  3.27s/it, exist=0.6239, loss=0.7263, lr=3.50e-05]
Epoch 1/5:  35%|███▌      | 412/1177 [20:14<45:37,  3.58s/it, exist=0.6239, loss=0.7263, lr=3.50e-05]
Epoch 1/5:  35%|███▌      | 412/1177 [20:16<45:37,  3.58s/it, exist=0.6237, loss=0.7261, lr=3.51e-05]
Epoch 1/5:  35%|███▌      | 413/1177 [20:16<41:48,  3.28s/it, exist=0.6237, loss=0.7261, lr=3.51e-05]
Epoch 1/5:  35%|███▌      | 413/1177 [20:18<41:48,  3.28s/it, exist=0.6236, loss=0.7260, lr=3.52e-05]
Epoch 1/5:  35%|███▌      | 414/1177 [20:18<37:26,  2.94s/it, exist=0.6236, loss=0.7260, lr=3.52e-05]
Epoch 1/5:  35%|███▌      | 414/1177 [20:22<37:26,  2.94s/it, exist=0.6237, loss=0.7262, lr=3.53e-05]
Epoch 1/5:  35%|███▌      | 415/1177 [20:22<40:42,  3.21s/it, exist=0.6237, loss=0.7262, lr=3.53e-05]
Epoch 1/5:  35%|███▌      | 415/1177 [20:25<40:42,  3.21s/it, exist=0.6234, loss=0.7261, lr=3.54e-05]
Epoch 1/5:  35%|███▌      | 416/1177 [20:25<40:07,  3.16s/it, exist=0.6234, loss=0.7261, lr=3.54e-05]
Epoch 1/5:  35%|███▌      | 416/1177 [20:28<40:07,  3.16s/it, exist=0.6237, loss=0.7263, lr=3.55e-05]
Epoch 1/5:  35%|███▌      | 417/1177 [20:28<37:39,  2.97s/it, exist=0.6237, loss=0.7263, lr=3.55e-05]
Epoch 1/5:  35%|███▌      | 417/1177 [20:31<37:39,  2.97s/it, exist=0.6235, loss=0.7259, lr=3.55e-05]
Epoch 1/5:  36%|███▌      | 418/1177 [20:31<37:48,  2.99s/it, exist=0.6235, loss=0.7259, lr=3.55e-05]
Epoch 1/5:  36%|███▌      | 418/1177 [20:33<37:48,  2.99s/it, exist=0.6232, loss=0.7259, lr=3.56e-05]
Epoch 1/5:  36%|███▌      | 419/1177 [20:33<34:09,  2.70s/it, exist=0.6232, loss=0.7259, lr=3.56e-05]
Epoch 1/5:  36%|███▌      | 419/1177 [20:35<34:09,  2.70s/it, exist=0.6233, loss=0.7259, lr=3.57e-05]
Epoch 1/5:  36%|███▌      | 420/1177 [20:35<33:14,  2.63s/it, exist=0.6233, loss=0.7259, lr=3.57e-05]
Epoch 1/5:  36%|███▌      | 420/1177 [20:38<33:14,  2.63s/it, exist=0.6232, loss=0.7260, lr=3.58e-05]
Epoch 1/5:  36%|███▌      | 421/1177 [20:38<32:48,  2.60s/it, exist=0.6232, loss=0.7260, lr=3.58e-05]
Epoch 1/5:  36%|███▌      | 421/1177 [20:40<32:48,  2.60s/it, exist=0.6228, loss=0.7256, lr=3.59e-05]
Epoch 1/5:  36%|███▌      | 422/1177 [20:40<32:32,  2.59s/it, exist=0.6228, loss=0.7256, lr=3.59e-05]
Epoch 1/5:  36%|███▌      | 422/1177 [20:43<32:32,  2.59s/it, exist=0.6227, loss=0.7261, lr=3.60e-05]
Epoch 1/5:  36%|███▌      | 423/1177 [20:43<32:39,  2.60s/it, exist=0.6227, loss=0.7261, lr=3.60e-05]
Epoch 1/5:  36%|███▌      | 423/1177 [20:45<32:39,  2.60s/it, exist=0.6226, loss=0.7260, lr=3.61e-05]
Epoch 1/5:  36%|███▌      | 424/1177 [20:45<32:00,  2.55s/it, exist=0.6226, loss=0.7260, lr=3.61e-05]
Epoch 1/5:  36%|███▌      | 424/1177 [20:48<32:00,  2.55s/it, exist=0.6224, loss=0.7258, lr=3.61e-05]
Epoch 1/5:  36%|███▌      | 425/1177 [20:48<32:05,  2.56s/it, exist=0.6224, loss=0.7258, lr=3.61e-05]
Epoch 1/5:  36%|███▌      | 425/1177 [20:51<32:05,  2.56s/it, exist=0.6218, loss=0.7254, lr=3.62e-05]
Epoch 1/5:  36%|███▌      | 426/1177 [20:51<33:40,  2.69s/it, exist=0.6218, loss=0.7254, lr=3.62e-05]
Epoch 1/5:  36%|███▌      | 426/1177 [20:54<33:40,  2.69s/it, exist=0.6213, loss=0.7248, lr=3.63e-05]
Epoch 1/5:  36%|███▋      | 427/1177 [20:54<35:10,  2.81s/it, exist=0.6213, loss=0.7248, lr=3.63e-05]
Epoch 1/5:  36%|███▋      | 427/1177 [20:56<35:10,  2.81s/it, exist=0.6213, loss=0.7249, lr=3.64e-05]
Epoch 1/5:  36%|███▋      | 428/1177 [20:56<32:00,  2.56s/it, exist=0.6213, loss=0.7249, lr=3.64e-05]
Epoch 1/5:  36%|███▋      | 428/1177 [21:00<32:00,  2.56s/it, exist=0.6213, loss=0.7249, lr=3.65e-05]
Epoch 1/5:  36%|███▋      | 429/1177 [21:00<36:16,  2.91s/it, exist=0.6213, loss=0.7249, lr=3.65e-05]
Epoch 1/5:  36%|███▋      | 429/1177 [21:04<36:16,  2.91s/it, exist=0.6215, loss=0.7251, lr=3.66e-05]
Epoch 1/5:  37%|███▋      | 430/1177 [21:04<41:32,  3.34s/it, exist=0.6215, loss=0.7251, lr=3.66e-05]
Epoch 1/5:  37%|███▋      | 430/1177 [21:08<41:32,  3.34s/it, exist=0.6213, loss=0.7250, lr=3.66e-05]
Epoch 1/5:  37%|███▋      | 431/1177 [21:08<43:12,  3.48s/it, exist=0.6213, loss=0.7250, lr=3.66e-05]
Epoch 1/5:  37%|███▋      | 431/1177 [21:10<43:12,  3.48s/it, exist=0.6207, loss=0.7244, lr=3.67e-05]
Epoch 1/5:  37%|███▋      | 432/1177 [21:10<38:07,  3.07s/it, exist=0.6207, loss=0.7244, lr=3.67e-05]
Epoch 1/5:  37%|███▋      | 432/1177 [21:13<38:07,  3.07s/it, exist=0.6208, loss=0.7249, lr=3.68e-05]
Epoch 1/5:  37%|███▋      | 433/1177 [21:13<36:25,  2.94s/it, exist=0.6208, loss=0.7249, lr=3.68e-05]
Epoch 1/5:  37%|███▋      | 433/1177 [21:15<36:25,  2.94s/it, exist=0.6206, loss=0.7246, lr=3.69e-05]
Epoch 1/5:  37%|███▋      | 434/1177 [21:15<34:43,  2.80s/it, exist=0.6206, loss=0.7246, lr=3.69e-05]
Epoch 1/5:  37%|███▋      | 434/1177 [21:18<34:43,  2.80s/it, exist=0.6205, loss=0.7243, lr=3.70e-05]
Epoch 1/5:  37%|███▋      | 435/1177 [21:18<36:32,  2.95s/it, exist=0.6205, loss=0.7243, lr=3.70e-05]
Epoch 1/5:  37%|███▋      | 435/1177 [21:20<36:32,  2.95s/it, exist=0.6203, loss=0.7241, lr=3.71e-05]
Epoch 1/5:  37%|███▋      | 436/1177 [21:20<32:55,  2.67s/it, exist=0.6203, loss=0.7241, lr=3.71e-05]
Epoch 1/5:  37%|███▋      | 436/1177 [21:23<32:55,  2.67s/it, exist=0.6199, loss=0.7237, lr=3.72e-05]
Epoch 1/5:  37%|███▋      | 437/1177 [21:23<32:55,  2.67s/it, exist=0.6199, loss=0.7237, lr=3.72e-05]
Epoch 1/5:  37%|███▋      | 437/1177 [21:26<32:55,  2.67s/it, exist=0.6195, loss=0.7233, lr=3.72e-05]
Epoch 1/5:  37%|███▋      | 438/1177 [21:26<34:08,  2.77s/it, exist=0.6195, loss=0.7233, lr=3.72e-05]
Epoch 1/5:  37%|███▋      | 438/1177 [21:30<34:08,  2.77s/it, exist=0.6196, loss=0.7237, lr=3.73e-05]
Epoch 1/5:  37%|███▋      | 439/1177 [21:30<37:24,  3.04s/it, exist=0.6196, loss=0.7237, lr=3.73e-05]
Epoch 1/5:  37%|███▋      | 439/1177 [21:34<37:24,  3.04s/it, exist=0.6194, loss=0.7237, lr=3.74e-05]
Epoch 1/5:  37%|███▋      | 440/1177 [21:34<41:16,  3.36s/it, exist=0.6194, loss=0.7237, lr=3.74e-05]
Epoch 1/5:  37%|███▋      | 440/1177 [21:37<41:16,  3.36s/it, exist=0.6196, loss=0.7238, lr=3.75e-05]
Epoch 1/5:  37%|███▋      | 441/1177 [21:37<41:02,  3.35s/it, exist=0.6196, loss=0.7238, lr=3.75e-05]
Epoch 1/5:  37%|███▋      | 441/1177 [21:41<41:02,  3.35s/it, exist=0.6194, loss=0.7237, lr=3.76e-05]
Epoch 1/5:  38%|███▊      | 442/1177 [21:41<42:27,  3.47s/it, exist=0.6194, loss=0.7237, lr=3.76e-05]
Epoch 1/5:  38%|███▊      | 442/1177 [21:43<42:27,  3.47s/it, exist=0.6192, loss=0.7235, lr=3.77e-05]
Epoch 1/5:  38%|███▊      | 443/1177 [21:43<37:09,  3.04s/it, exist=0.6192, loss=0.7235, lr=3.77e-05]
Epoch 1/5:  38%|███▊      | 443/1177 [21:46<37:09,  3.04s/it, exist=0.6188, loss=0.7232, lr=3.78e-05]
Epoch 1/5:  38%|███▊      | 444/1177 [21:46<35:57,  2.94s/it, exist=0.6188, loss=0.7232, lr=3.78e-05]
Epoch 1/5:  38%|███▊      | 444/1177 [21:48<35:57,  2.94s/it, exist=0.6183, loss=0.7227, lr=3.78e-05]
Epoch 1/5:  38%|███▊      | 445/1177 [21:48<32:46,  2.69s/it, exist=0.6183, loss=0.7227, lr=3.78e-05]
Epoch 1/5:  38%|███▊      | 445/1177 [21:51<32:46,  2.69s/it, exist=0.6179, loss=0.7223, lr=3.79e-05]
Epoch 1/5:  38%|███▊      | 446/1177 [21:51<32:42,  2.68s/it, exist=0.6179, loss=0.7223, lr=3.79e-05]
Epoch 1/5:  38%|███▊      | 446/1177 [21:55<32:42,  2.68s/it, exist=0.6175, loss=0.7218, lr=3.80e-05]
Epoch 1/5:  38%|███▊      | 447/1177 [21:55<38:39,  3.18s/it, exist=0.6175, loss=0.7218, lr=3.80e-05]
Epoch 1/5:  38%|███▊      | 447/1177 [21:57<38:39,  3.18s/it, exist=0.6177, loss=0.7220, lr=3.81e-05]
Epoch 1/5:  38%|███▊      | 448/1177 [21:57<34:24,  2.83s/it, exist=0.6177, loss=0.7220, lr=3.81e-05]
Epoch 1/5:  38%|███▊      | 448/1177 [21:59<34:24,  2.83s/it, exist=0.6178, loss=0.7222, lr=3.82e-05]
Epoch 1/5:  38%|███▊      | 449/1177 [21:59<33:09,  2.73s/it, exist=0.6178, loss=0.7222, lr=3.82e-05]
Epoch 1/5:  38%|███▊      | 449/1177 [22:03<33:09,  2.73s/it, exist=0.6172, loss=0.7214, lr=3.83e-05]
Epoch 1/5:  38%|███▊      | 450/1177 [22:03<35:02,  2.89s/it, exist=0.6172, loss=0.7214, lr=3.83e-05]
Epoch 1/5:  38%|███▊      | 450/1177 [22:06<35:02,  2.89s/it, exist=0.6170, loss=0.7213, lr=3.84e-05]
Epoch 1/5:  38%|███▊      | 451/1177 [22:06<37:54,  3.13s/it, exist=0.6170, loss=0.7213, lr=3.84e-05]
Epoch 1/5:  38%|███▊      | 451/1177 [22:10<37:54,  3.13s/it, exist=0.6162, loss=0.7205, lr=3.84e-05]
Epoch 1/5:  38%|███▊      | 452/1177 [22:10<40:52,  3.38s/it, exist=0.6162, loss=0.7205, lr=3.84e-05]
Epoch 1/5:  38%|███▊      | 452/1177 [22:14<40:52,  3.38s/it, exist=0.6162, loss=0.7207, lr=3.85e-05]
Epoch 1/5:  38%|███▊      | 453/1177 [22:14<40:15,  3.34s/it, exist=0.6162, loss=0.7207, lr=3.85e-05]
Epoch 1/5:  38%|███▊      | 453/1177 [22:18<40:15,  3.34s/it, exist=0.6161, loss=0.7205, lr=3.86e-05]
Epoch 1/5:  39%|███▊      | 454/1177 [22:18<42:44,  3.55s/it, exist=0.6161, loss=0.7205, lr=3.86e-05]
Epoch 1/5:  39%|███▊      | 454/1177 [22:21<42:44,  3.55s/it, exist=0.6156, loss=0.7200, lr=3.87e-05]
Epoch 1/5:  39%|███▊      | 455/1177 [22:21<43:06,  3.58s/it, exist=0.6156, loss=0.7200, lr=3.87e-05]
Epoch 1/5:  39%|███▊      | 455/1177 [22:25<43:06,  3.58s/it, exist=0.6153, loss=0.7198, lr=3.88e-05]
Epoch 1/5:  39%|███▊      | 456/1177 [22:25<42:14,  3.52s/it, exist=0.6153, loss=0.7198, lr=3.88e-05]
Epoch 1/5:  39%|███▊      | 456/1177 [22:27<42:14,  3.52s/it, exist=0.6153, loss=0.7198, lr=3.89e-05]
Epoch 1/5:  39%|███▉      | 457/1177 [22:27<36:56,  3.08s/it, exist=0.6153, loss=0.7198, lr=3.89e-05]
Epoch 1/5:  39%|███▉      | 457/1177 [22:29<36:56,  3.08s/it, exist=0.6151, loss=0.7196, lr=3.89e-05]
Epoch 1/5:  39%|███▉      | 458/1177 [22:29<34:53,  2.91s/it, exist=0.6151, loss=0.7196, lr=3.89e-05]
Epoch 1/5:  39%|███▉      | 458/1177 [22:32<34:53,  2.91s/it, exist=0.6156, loss=0.7200, lr=3.90e-05]
Epoch 1/5:  39%|███▉      | 459/1177 [22:32<36:14,  3.03s/it, exist=0.6156, loss=0.7200, lr=3.90e-05]
Epoch 1/5:  39%|███▉      | 459/1177 [22:36<36:14,  3.03s/it, exist=0.6153, loss=0.7198, lr=3.91e-05]
Epoch 1/5:  39%|███▉      | 460/1177 [22:36<39:35,  3.31s/it, exist=0.6153, loss=0.7198, lr=3.91e-05]
Epoch 1/5:  39%|███▉      | 460/1177 [22:38<39:35,  3.31s/it, exist=0.6153, loss=0.7197, lr=3.92e-05]
Epoch 1/5:  39%|███▉      | 461/1177 [22:38<34:55,  2.93s/it, exist=0.6153, loss=0.7197, lr=3.92e-05]
Epoch 1/5:  39%|███▉      | 461/1177 [22:42<34:55,  2.93s/it, exist=0.6151, loss=0.7194, lr=3.93e-05]
Epoch 1/5:  39%|███▉      | 462/1177 [22:42<36:57,  3.10s/it, exist=0.6151, loss=0.7194, lr=3.93e-05]
Epoch 1/5:  39%|███▉      | 462/1177 [22:45<36:57,  3.10s/it, exist=0.6145, loss=0.7188, lr=3.94e-05]
Epoch 1/5:  39%|███▉      | 463/1177 [22:45<36:04,  3.03s/it, exist=0.6145, loss=0.7188, lr=3.94e-05]
Epoch 1/5:  39%|███▉      | 463/1177 [22:48<36:04,  3.03s/it, exist=0.6139, loss=0.7182, lr=3.95e-05]
Epoch 1/5:  39%|███▉      | 464/1177 [22:48<37:40,  3.17s/it, exist=0.6139, loss=0.7182, lr=3.95e-05]
Epoch 1/5:  39%|███▉      | 464/1177 [22:52<37:40,  3.17s/it, exist=0.6136, loss=0.7182, lr=3.95e-05]
Epoch 1/5:  40%|███▉      | 465/1177 [22:52<38:36,  3.25s/it, exist=0.6136, loss=0.7182, lr=3.95e-05]
Epoch 1/5:  40%|███▉      | 465/1177 [22:56<38:36,  3.25s/it, exist=0.6142, loss=0.7188, lr=3.96e-05]
Epoch 1/5:  40%|███▉      | 466/1177 [22:56<42:45,  3.61s/it, exist=0.6142, loss=0.7188, lr=3.96e-05]
Epoch 1/5:  40%|███▉      | 466/1177 [23:00<42:45,  3.61s/it, exist=0.6145, loss=0.7191, lr=3.97e-05]
Epoch 1/5:  40%|███▉      | 467/1177 [23:00<42:54,  3.63s/it, exist=0.6145, loss=0.7191, lr=3.97e-05]
Epoch 1/5:  40%|███▉      | 467/1177 [23:03<42:54,  3.63s/it, exist=0.6142, loss=0.7190, lr=3.98e-05]
Epoch 1/5:  40%|███▉      | 468/1177 [23:03<40:48,  3.45s/it, exist=0.6142, loss=0.7190, lr=3.98e-05]
Epoch 1/5:  40%|███▉      | 468/1177 [23:06<40:48,  3.45s/it, exist=0.6141, loss=0.7190, lr=3.99e-05]
Epoch 1/5:  40%|███▉      | 469/1177 [23:06<39:06,  3.31s/it, exist=0.6141, loss=0.7190, lr=3.99e-05]
Epoch 1/5:  40%|███▉      | 469/1177 [23:10<39:06,  3.31s/it, exist=0.6141, loss=0.7189, lr=4.00e-05]
Epoch 1/5:  40%|███▉      | 470/1177 [23:10<40:06,  3.40s/it, exist=0.6141, loss=0.7189, lr=4.00e-05]
Epoch 1/5:  40%|███▉      | 470/1177 [23:13<40:06,  3.40s/it, exist=0.6138, loss=0.7185, lr=4.01e-05]
Epoch 1/5:  40%|████      | 471/1177 [23:13<40:52,  3.47s/it, exist=0.6138, loss=0.7185, lr=4.01e-05]
Epoch 1/5:  40%|████      | 471/1177 [23:16<40:52,  3.47s/it, exist=0.6134, loss=0.7181, lr=4.01e-05]
Epoch 1/5:  40%|████      | 472/1177 [23:16<39:02,  3.32s/it, exist=0.6134, loss=0.7181, lr=4.01e-05]
Epoch 1/5:  40%|████      | 472/1177 [23:19<39:02,  3.32s/it, exist=0.6134, loss=0.7184, lr=4.02e-05]
Epoch 1/5:  40%|████      | 473/1177 [23:19<37:45,  3.22s/it, exist=0.6134, loss=0.7184, lr=4.02e-05]
Epoch 1/5:  40%|████      | 473/1177 [23:23<37:45,  3.22s/it, exist=0.6128, loss=0.7177, lr=4.03e-05]
Epoch 1/5:  40%|████      | 474/1177 [23:23<38:33,  3.29s/it, exist=0.6128, loss=0.7177, lr=4.03e-05]
Epoch 1/5:  40%|████      | 474/1177 [23:26<38:33,  3.29s/it, exist=0.6125, loss=0.7174, lr=4.04e-05]
Epoch 1/5:  40%|████      | 475/1177 [23:26<37:14,  3.18s/it, exist=0.6125, loss=0.7174, lr=4.04e-05]
Epoch 1/5:  40%|████      | 475/1177 [23:29<37:14,  3.18s/it, exist=0.6124, loss=0.7173, lr=4.05e-05]
Epoch 1/5:  40%|████      | 476/1177 [23:29<37:47,  3.23s/it, exist=0.6124, loss=0.7173, lr=4.05e-05]
Epoch 1/5:  40%|████      | 476/1177 [23:33<37:47,  3.23s/it, exist=0.6121, loss=0.7171, lr=4.06e-05]
Epoch 1/5:  41%|████      | 477/1177 [23:33<39:24,  3.38s/it, exist=0.6121, loss=0.7171, lr=4.06e-05]
Epoch 1/5:  41%|████      | 477/1177 [23:35<39:24,  3.38s/it, exist=0.6127, loss=0.7177, lr=4.06e-05]
Epoch 1/5:  41%|████      | 478/1177 [23:35<37:09,  3.19s/it, exist=0.6127, loss=0.7177, lr=4.06e-05]
Epoch 1/5:  41%|████      | 478/1177 [23:39<37:09,  3.19s/it, exist=0.6125, loss=0.7176, lr=4.07e-05]
Epoch 1/5:  41%|████      | 479/1177 [23:39<38:29,  3.31s/it, exist=0.6125, loss=0.7176, lr=4.07e-05]
Epoch 1/5:  41%|████      | 479/1177 [23:42<38:29,  3.31s/it, exist=0.6118, loss=0.7169, lr=4.08e-05]
Epoch 1/5:  41%|████      | 480/1177 [23:42<37:14,  3.21s/it, exist=0.6118, loss=0.7169, lr=4.08e-05]
Epoch 1/5:  41%|████      | 480/1177 [23:44<37:14,  3.21s/it, exist=0.6115, loss=0.7168, lr=4.09e-05]
Epoch 1/5:  41%|████      | 481/1177 [23:44<33:03,  2.85s/it, exist=0.6115, loss=0.7168, lr=4.09e-05]
Epoch 1/5:  41%|████      | 481/1177 [23:47<33:03,  2.85s/it, exist=0.6108, loss=0.7161, lr=4.10e-05]
Epoch 1/5:  41%|████      | 482/1177 [23:47<34:10,  2.95s/it, exist=0.6108, loss=0.7161, lr=4.10e-05]
Epoch 1/5:  41%|████      | 482/1177 [23:51<34:10,  2.95s/it, exist=0.6105, loss=0.7157, lr=4.11e-05]
Epoch 1/5:  41%|████      | 483/1177 [23:51<38:59,  3.37s/it, exist=0.6105, loss=0.7157, lr=4.11e-05]
Epoch 1/5:  41%|████      | 483/1177 [23:54<38:59,  3.37s/it, exist=0.6110, loss=0.7162, lr=4.12e-05]
Epoch 1/5:  41%|████      | 484/1177 [23:54<37:15,  3.23s/it, exist=0.6110, loss=0.7162, lr=4.12e-05]
Epoch 1/5:  41%|████      | 484/1177 [23:57<37:15,  3.23s/it, exist=0.6106, loss=0.7157, lr=4.12e-05]
Epoch 1/5:  41%|████      | 485/1177 [23:57<35:05,  3.04s/it, exist=0.6106, loss=0.7157, lr=4.12e-05]
Epoch 1/5:  41%|████      | 485/1177 [24:00<35:05,  3.04s/it, exist=0.6109, loss=0.7161, lr=4.13e-05]
Epoch 1/5:  41%|████▏     | 486/1177 [24:00<34:14,  2.97s/it, exist=0.6109, loss=0.7161, lr=4.13e-05]
Epoch 1/5:  41%|████▏     | 486/1177 [24:03<34:14,  2.97s/it, exist=0.6108, loss=0.7162, lr=4.14e-05]
Epoch 1/5:  41%|████▏     | 487/1177 [24:03<34:08,  2.97s/it, exist=0.6108, loss=0.7162, lr=4.14e-05]
Epoch 1/5:  41%|████▏     | 487/1177 [24:06<34:08,  2.97s/it, exist=0.6110, loss=0.7163, lr=4.15e-05]
Epoch 1/5:  41%|████▏     | 488/1177 [24:06<34:51,  3.04s/it, exist=0.6110, loss=0.7163, lr=4.15e-05]
Epoch 1/5:  41%|████▏     | 488/1177 [24:09<34:51,  3.04s/it, exist=0.6106, loss=0.7159, lr=4.16e-05]
Epoch 1/5:  42%|████▏     | 489/1177 [24:09<34:02,  2.97s/it, exist=0.6106, loss=0.7159, lr=4.16e-05]
Epoch 1/5:  42%|████▏     | 489/1177 [24:13<34:02,  2.97s/it, exist=0.6107, loss=0.7159, lr=4.17e-05]
Epoch 1/5:  42%|████▏     | 490/1177 [24:13<38:26,  3.36s/it, exist=0.6107, loss=0.7159, lr=4.17e-05]
Epoch 1/5:  42%|████▏     | 490/1177 [24:16<38:26,  3.36s/it, exist=0.6104, loss=0.7155, lr=4.18e-05]
Epoch 1/5:  42%|████▏     | 491/1177 [24:16<38:48,  3.39s/it, exist=0.6104, loss=0.7155, lr=4.18e-05]
Epoch 1/5:  42%|████▏     | 491/1177 [24:20<38:48,  3.39s/it, exist=0.6100, loss=0.7151, lr=4.18e-05]
Epoch 1/5:  42%|████▏     | 492/1177 [24:20<39:27,  3.46s/it, exist=0.6100, loss=0.7151, lr=4.18e-05]
Epoch 1/5:  42%|████▏     | 492/1177 [24:22<39:27,  3.46s/it, exist=0.6102, loss=0.7152, lr=4.19e-05]
Epoch 1/5:  42%|████▏     | 493/1177 [24:22<34:29,  3.03s/it, exist=0.6102, loss=0.7152, lr=4.19e-05]
Epoch 1/5:  42%|████▏     | 493/1177 [24:26<34:29,  3.03s/it, exist=0.6098, loss=0.7148, lr=4.20e-05]
Epoch 1/5:  42%|████▏     | 494/1177 [24:26<37:36,  3.30s/it, exist=0.6098, loss=0.7148, lr=4.20e-05]
Epoch 1/5:  42%|████▏     | 494/1177 [24:30<37:36,  3.30s/it, exist=0.6095, loss=0.7147, lr=4.21e-05]
Epoch 1/5:  42%|████▏     | 495/1177 [24:30<38:13,  3.36s/it, exist=0.6095, loss=0.7147, lr=4.21e-05]
Epoch 1/5:  42%|████▏     | 495/1177 [24:33<38:13,  3.36s/it, exist=0.6093, loss=0.7146, lr=4.22e-05]
Epoch 1/5:  42%|████▏     | 496/1177 [24:33<38:57,  3.43s/it, exist=0.6093, loss=0.7146, lr=4.22e-05]
Epoch 1/5:  42%|████▏     | 496/1177 [24:36<38:57,  3.43s/it, exist=0.6089, loss=0.7141, lr=4.23e-05]
Epoch 1/5:  42%|████▏     | 497/1177 [24:36<36:21,  3.21s/it, exist=0.6089, loss=0.7141, lr=4.23e-05]
Epoch 1/5:  42%|████▏     | 497/1177 [24:40<36:21,  3.21s/it, exist=0.6085, loss=0.7136, lr=4.23e-05]
Epoch 1/5:  42%|████▏     | 498/1177 [24:40<38:16,  3.38s/it, exist=0.6085, loss=0.7136, lr=4.23e-05]
Epoch 1/5:  42%|████▏     | 498/1177 [24:43<38:16,  3.38s/it, exist=0.6084, loss=0.7133, lr=4.24e-05]
Epoch 1/5:  42%|████▏     | 499/1177 [24:43<39:48,  3.52s/it, exist=0.6084, loss=0.7133, lr=4.24e-05]
Epoch 1/5:  42%|████▏     | 499/1177 [24:46<39:48,  3.52s/it, exist=0.6079, loss=0.7129, lr=4.25e-05]
Epoch 1/5:  42%|████▏     | 500/1177 [24:46<35:47,  3.17s/it, exist=0.6079, loss=0.7129, lr=4.25e-05]
Epoch 1/5:  42%|████▏     | 500/1177 [24:49<35:47,  3.17s/it, exist=0.6075, loss=0.7125, lr=4.26e-05]
Epoch 1/5:  43%|████▎     | 501/1177 [24:49<36:43,  3.26s/it, exist=0.6075, loss=0.7125, lr=4.26e-05]
Epoch 1/5:  43%|████▎     | 501/1177 [24:53<36:43,  3.26s/it, exist=0.6073, loss=0.7122, lr=4.27e-05]
Epoch 1/5:  43%|████▎     | 502/1177 [24:53<36:38,  3.26s/it, exist=0.6073, loss=0.7122, lr=4.27e-05]
Epoch 1/5:  43%|████▎     | 502/1177 [24:55<36:38,  3.26s/it, exist=0.6072, loss=0.7121, lr=4.28e-05]
Epoch 1/5:  43%|████▎     | 503/1177 [24:55<35:12,  3.13s/it, exist=0.6072, loss=0.7121, lr=4.28e-05]
Epoch 1/5:  43%|████▎     | 503/1177 [24:59<35:12,  3.13s/it, exist=0.6072, loss=0.7120, lr=4.29e-05]
Epoch 1/5:  43%|████▎     | 504/1177 [24:59<36:00,  3.21s/it, exist=0.6072, loss=0.7120, lr=4.29e-05]
Epoch 1/5:  43%|████▎     | 504/1177 [25:01<36:00,  3.21s/it, exist=0.6076, loss=0.7123, lr=4.29e-05]
Epoch 1/5:  43%|████▎     | 505/1177 [25:01<31:48,  2.84s/it, exist=0.6076, loss=0.7123, lr=4.29e-05]
Epoch 1/5:  43%|████▎     | 505/1177 [25:04<31:48,  2.84s/it, exist=0.6074, loss=0.7122, lr=4.30e-05]
Epoch 1/5:  43%|████▎     | 506/1177 [25:04<34:09,  3.05s/it, exist=0.6074, loss=0.7122, lr=4.30e-05]
Epoch 1/5:  43%|████▎     | 506/1177 [25:08<34:09,  3.05s/it, exist=0.6076, loss=0.7124, lr=4.31e-05]
Epoch 1/5:  43%|████▎     | 507/1177 [25:08<35:49,  3.21s/it, exist=0.6076, loss=0.7124, lr=4.31e-05]
Epoch 1/5:  43%|████▎     | 507/1177 [25:11<35:49,  3.21s/it, exist=0.6073, loss=0.7120, lr=4.32e-05]
Epoch 1/5:  43%|████▎     | 508/1177 [25:11<35:36,  3.19s/it, exist=0.6073, loss=0.7120, lr=4.32e-05]
Epoch 1/5:  43%|████▎     | 508/1177 [25:14<35:36,  3.19s/it, exist=0.6070, loss=0.7117, lr=4.33e-05]
Epoch 1/5:  43%|████▎     | 509/1177 [25:14<33:33,  3.01s/it, exist=0.6070, loss=0.7117, lr=4.33e-05]
Epoch 1/5:  43%|████▎     | 509/1177 [25:18<33:33,  3.01s/it, exist=0.6067, loss=0.7113, lr=4.34e-05]
Epoch 1/5:  43%|████▎     | 510/1177 [25:18<36:51,  3.32s/it, exist=0.6067, loss=0.7113, lr=4.34e-05]
Epoch 1/5:  43%|████▎     | 510/1177 [25:21<36:51,  3.32s/it, exist=0.6066, loss=0.7114, lr=4.35e-05]
Epoch 1/5:  43%|████▎     | 511/1177 [25:21<38:21,  3.46s/it, exist=0.6066, loss=0.7114, lr=4.35e-05]
Epoch 1/5:  43%|████▎     | 511/1177 [25:25<38:21,  3.46s/it, exist=0.6067, loss=0.7114, lr=4.35e-05]
Epoch 1/5:  44%|████▎     | 512/1177 [25:25<38:50,  3.50s/it, exist=0.6067, loss=0.7114, lr=4.35e-05]
Epoch 1/5:  44%|████▎     | 512/1177 [25:27<38:50,  3.50s/it, exist=0.6069, loss=0.7118, lr=4.36e-05]
Epoch 1/5:  44%|████▎     | 513/1177 [25:27<34:13,  3.09s/it, exist=0.6069, loss=0.7118, lr=4.36e-05]
Epoch 1/5:  44%|████▎     | 513/1177 [25:30<34:13,  3.09s/it, exist=0.6067, loss=0.7115, lr=4.37e-05]
Epoch 1/5:  44%|████▎     | 514/1177 [25:30<32:23,  2.93s/it, exist=0.6067, loss=0.7115, lr=4.37e-05]
Epoch 1/5:  44%|████▎     | 514/1177 [25:34<32:23,  2.93s/it, exist=0.6065, loss=0.7113, lr=4.38e-05]
Epoch 1/5:  44%|████▍     | 515/1177 [25:34<35:02,  3.18s/it, exist=0.6065, loss=0.7113, lr=4.38e-05]
Epoch 1/5:  44%|████▍     | 515/1177 [25:37<35:02,  3.18s/it, exist=0.6061, loss=0.7112, lr=4.39e-05]
Epoch 1/5:  44%|████▍     | 516/1177 [25:37<35:34,  3.23s/it, exist=0.6061, loss=0.7112, lr=4.39e-05]
Epoch 1/5:  44%|████▍     | 516/1177 [25:40<35:34,  3.23s/it, exist=0.6057, loss=0.7112, lr=4.40e-05]
Epoch 1/5:  44%|████▍     | 517/1177 [25:40<35:07,  3.19s/it, exist=0.6057, loss=0.7112, lr=4.40e-05]
Epoch 1/5:  44%|████▍     | 517/1177 [25:43<35:07,  3.19s/it, exist=0.6060, loss=0.7114, lr=4.40e-05]
Epoch 1/5:  44%|████▍     | 518/1177 [25:43<36:06,  3.29s/it, exist=0.6060, loss=0.7114, lr=4.40e-05]
Epoch 1/5:  44%|████▍     | 518/1177 [25:46<36:06,  3.29s/it, exist=0.6057, loss=0.7112, lr=4.41e-05]
Epoch 1/5:  44%|████▍     | 519/1177 [25:46<34:36,  3.16s/it, exist=0.6057, loss=0.7112, lr=4.41e-05]
Epoch 1/5:  44%|████▍     | 519/1177 [25:49<34:36,  3.16s/it, exist=0.6063, loss=0.7117, lr=4.42e-05]
Epoch 1/5:  44%|████▍     | 520/1177 [25:49<33:23,  3.05s/it, exist=0.6063, loss=0.7117, lr=4.42e-05]
Epoch 1/5:  44%|████▍     | 520/1177 [25:53<33:23,  3.05s/it, exist=0.6061, loss=0.7114, lr=4.43e-05]
Epoch 1/5:  44%|████▍     | 521/1177 [25:53<36:04,  3.30s/it, exist=0.6061, loss=0.7114, lr=4.43e-05]
Epoch 1/5:  44%|████▍     | 521/1177 [25:56<36:04,  3.30s/it, exist=0.6061, loss=0.7114, lr=4.44e-05]
Epoch 1/5:  44%|████▍     | 522/1177 [25:56<34:26,  3.16s/it, exist=0.6061, loss=0.7114, lr=4.44e-05]
Epoch 1/5:  44%|████▍     | 522/1177 [25:59<34:26,  3.16s/it, exist=0.6061, loss=0.7115, lr=4.45e-05]
Epoch 1/5:  44%|████▍     | 523/1177 [25:59<35:25,  3.25s/it, exist=0.6061, loss=0.7115, lr=4.45e-05]
Epoch 1/5:  44%|████▍     | 523/1177 [26:01<35:25,  3.25s/it, exist=0.6058, loss=0.7112, lr=4.46e-05]
Epoch 1/5:  45%|████▍     | 524/1177 [26:01<31:10,  2.86s/it, exist=0.6058, loss=0.7112, lr=4.46e-05]
Epoch 1/5:  45%|████▍     | 524/1177 [26:04<31:10,  2.86s/it, exist=0.6055, loss=0.7108, lr=4.46e-05]
Epoch 1/5:  45%|████▍     | 525/1177 [26:04<29:45,  2.74s/it, exist=0.6055, loss=0.7108, lr=4.46e-05]
Epoch 1/5:  45%|████▍     | 525/1177 [26:07<29:45,  2.74s/it, exist=0.6057, loss=0.7110, lr=4.47e-05]
Epoch 1/5:  45%|████▍     | 526/1177 [26:07<31:59,  2.95s/it, exist=0.6057, loss=0.7110, lr=4.47e-05]
Epoch 1/5:  45%|████▍     | 526/1177 [26:09<31:59,  2.95s/it, exist=0.6060, loss=0.7113, lr=4.48e-05]
Epoch 1/5:  45%|████▍     | 527/1177 [26:09<28:40,  2.65s/it, exist=0.6060, loss=0.7113, lr=4.48e-05]
Epoch 1/5:  45%|████▍     | 527/1177 [26:13<28:40,  2.65s/it, exist=0.6059, loss=0.7115, lr=4.49e-05]
Epoch 1/5:  45%|████▍     | 528/1177 [26:13<32:39,  3.02s/it, exist=0.6059, loss=0.7115, lr=4.49e-05]
Epoch 1/5:  45%|████▍     | 528/1177 [26:15<32:39,  3.02s/it, exist=0.6058, loss=0.7113, lr=4.50e-05]
Epoch 1/5:  45%|████▍     | 529/1177 [26:15<30:56,  2.86s/it, exist=0.6058, loss=0.7113, lr=4.50e-05]
Epoch 1/5:  45%|████▍     | 529/1177 [26:19<30:56,  2.86s/it, exist=0.6056, loss=0.7112, lr=4.51e-05]
Epoch 1/5:  45%|████▌     | 530/1177 [26:19<33:28,  3.10s/it, exist=0.6056, loss=0.7112, lr=4.51e-05]
Epoch 1/5:  45%|████▌     | 530/1177 [26:22<33:28,  3.10s/it, exist=0.6051, loss=0.7106, lr=4.52e-05]
Epoch 1/5:  45%|████▌     | 531/1177 [26:22<32:46,  3.04s/it, exist=0.6051, loss=0.7106, lr=4.52e-05]
Epoch 1/5:  45%|████▌     | 531/1177 [26:25<32:46,  3.04s/it, exist=0.6048, loss=0.7103, lr=4.52e-05]
Epoch 1/5:  45%|████▌     | 532/1177 [26:25<31:29,  2.93s/it, exist=0.6048, loss=0.7103, lr=4.52e-05]
Epoch 1/5:  45%|████▌     | 532/1177 [26:27<31:29,  2.93s/it, exist=0.6046, loss=0.7101, lr=4.53e-05]
Epoch 1/5:  45%|████▌     | 533/1177 [26:27<30:29,  2.84s/it, exist=0.6046, loss=0.7101, lr=4.53e-05]
Epoch 1/5:  45%|████▌     | 533/1177 [26:29<30:29,  2.84s/it, exist=0.6045, loss=0.7102, lr=4.54e-05]
Epoch 1/5:  45%|████▌     | 534/1177 [26:29<27:49,  2.60s/it, exist=0.6045, loss=0.7102, lr=4.54e-05]
Epoch 1/5:  45%|████▌     | 534/1177 [26:33<27:49,  2.60s/it, exist=0.6041, loss=0.7100, lr=4.55e-05]
Epoch 1/5:  45%|████▌     | 535/1177 [26:33<29:59,  2.80s/it, exist=0.6041, loss=0.7100, lr=4.55e-05]
Epoch 1/5:  45%|████▌     | 535/1177 [26:35<29:59,  2.80s/it, exist=0.6041, loss=0.7098, lr=4.56e-05]
Epoch 1/5:  46%|████▌     | 536/1177 [26:35<29:13,  2.74s/it, exist=0.6041, loss=0.7098, lr=4.56e-05]
Epoch 1/5:  46%|████▌     | 536/1177 [26:38<29:13,  2.74s/it, exist=0.6040, loss=0.7097, lr=4.57e-05]
Epoch 1/5:  46%|████▌     | 537/1177 [26:38<29:12,  2.74s/it, exist=0.6040, loss=0.7097, lr=4.57e-05]
Epoch 1/5:  46%|████▌     | 537/1177 [26:41<29:12,  2.74s/it, exist=0.6039, loss=0.7095, lr=4.57e-05]
Epoch 1/5:  46%|████▌     | 538/1177 [26:41<28:50,  2.71s/it, exist=0.6039, loss=0.7095, lr=4.57e-05]
Epoch 1/5:  46%|████▌     | 538/1177 [26:43<28:50,  2.71s/it, exist=0.6036, loss=0.7091, lr=4.58e-05]
Epoch 1/5:  46%|████▌     | 539/1177 [26:43<28:33,  2.69s/it, exist=0.6036, loss=0.7091, lr=4.58e-05]
Epoch 1/5:  46%|████▌     | 539/1177 [26:46<28:33,  2.69s/it, exist=0.6040, loss=0.7095, lr=4.59e-05]
Epoch 1/5:  46%|████▌     | 540/1177 [26:46<28:10,  2.65s/it, exist=0.6040, loss=0.7095, lr=4.59e-05]
Epoch 1/5:  46%|████▌     | 540/1177 [26:48<28:10,  2.65s/it, exist=0.6043, loss=0.7099, lr=4.60e-05]
Epoch 1/5:  46%|████▌     | 541/1177 [26:48<27:57,  2.64s/it, exist=0.6043, loss=0.7099, lr=4.60e-05]
Epoch 1/5:  46%|████▌     | 541/1177 [26:51<27:57,  2.64s/it, exist=0.6040, loss=0.7095, lr=4.61e-05]
Epoch 1/5:  46%|████▌     | 542/1177 [26:51<26:51,  2.54s/it, exist=0.6040, loss=0.7095, lr=4.61e-05]
Epoch 1/5:  46%|████▌     | 542/1177 [26:54<26:51,  2.54s/it, exist=0.6037, loss=0.7091, lr=4.62e-05]
Epoch 1/5:  46%|████▌     | 543/1177 [26:54<29:01,  2.75s/it, exist=0.6037, loss=0.7091, lr=4.62e-05]
Epoch 1/5:  46%|████▌     | 543/1177 [26:57<29:01,  2.75s/it, exist=0.6036, loss=0.7090, lr=4.63e-05]
Epoch 1/5:  46%|████▌     | 544/1177 [26:57<28:33,  2.71s/it, exist=0.6036, loss=0.7090, lr=4.63e-05]
Epoch 1/5:  46%|████▌     | 544/1177 [26:59<28:33,  2.71s/it, exist=0.6037, loss=0.7091, lr=4.63e-05]
Epoch 1/5:  46%|████▋     | 545/1177 [26:59<26:30,  2.52s/it, exist=0.6037, loss=0.7091, lr=4.63e-05]
Epoch 1/5:  46%|████▋     | 545/1177 [27:02<26:30,  2.52s/it, exist=0.6037, loss=0.7091, lr=4.64e-05]
Epoch 1/5:  46%|████▋     | 546/1177 [27:02<30:23,  2.89s/it, exist=0.6037, loss=0.7091, lr=4.64e-05]
Epoch 1/5:  46%|████▋     | 546/1177 [27:05<30:23,  2.89s/it, exist=0.6037, loss=0.7090, lr=4.65e-05]
Epoch 1/5:  46%|████▋     | 547/1177 [27:05<28:13,  2.69s/it, exist=0.6037, loss=0.7090, lr=4.65e-05]
Epoch 1/5:  46%|████▋     | 547/1177 [27:09<28:13,  2.69s/it, exist=0.6035, loss=0.7088, lr=4.66e-05]
Epoch 1/5:  47%|████▋     | 548/1177 [27:09<34:42,  3.31s/it, exist=0.6035, loss=0.7088, lr=4.66e-05]
Epoch 1/5:  47%|████▋     | 548/1177 [27:11<34:42,  3.31s/it, exist=0.6039, loss=0.7092, lr=4.67e-05]
Epoch 1/5:  47%|████▋     | 549/1177 [27:11<30:30,  2.91s/it, exist=0.6039, loss=0.7092, lr=4.67e-05]
Epoch 1/5:  47%|████▋     | 549/1177 [27:16<30:30,  2.91s/it, exist=0.6040, loss=0.7093, lr=4.68e-05]
Epoch 1/5:  47%|████▋     | 550/1177 [27:16<34:20,  3.29s/it, exist=0.6040, loss=0.7093, lr=4.68e-05]
Epoch 1/5:  47%|████▋     | 550/1177 [27:19<34:20,  3.29s/it, exist=0.6039, loss=0.7090, lr=4.69e-05]
Epoch 1/5:  47%|████▋     | 551/1177 [27:19<34:40,  3.32s/it, exist=0.6039, loss=0.7090, lr=4.69e-05]
Epoch 1/5:  47%|████▋     | 551/1177 [27:22<34:40,  3.32s/it, exist=0.6035, loss=0.7086, lr=4.69e-05]
Epoch 1/5:  47%|████▋     | 552/1177 [27:22<32:22,  3.11s/it, exist=0.6035, loss=0.7086, lr=4.69e-05]
Epoch 1/5:  47%|████▋     | 552/1177 [27:24<32:22,  3.11s/it, exist=0.6032, loss=0.7084, lr=4.70e-05]
Epoch 1/5:  47%|████▋     | 553/1177 [27:24<29:17,  2.82s/it, exist=0.6032, loss=0.7084, lr=4.70e-05]
Epoch 1/5:  47%|████▋     | 553/1177 [27:27<29:17,  2.82s/it, exist=0.6032, loss=0.7083, lr=4.71e-05]
Epoch 1/5:  47%|████▋     | 554/1177 [27:27<32:17,  3.11s/it, exist=0.6032, loss=0.7083, lr=4.71e-05]
Epoch 1/5:  47%|████▋     | 554/1177 [27:30<32:17,  3.11s/it, exist=0.6032, loss=0.7082, lr=4.72e-05]
Epoch 1/5:  47%|████▋     | 555/1177 [27:30<31:27,  3.03s/it, exist=0.6032, loss=0.7082, lr=4.72e-05]
Epoch 1/5:  47%|████▋     | 555/1177 [27:34<31:27,  3.03s/it, exist=0.6035, loss=0.7085, lr=4.73e-05]
Epoch 1/5:  47%|████▋     | 556/1177 [27:34<31:50,  3.08s/it, exist=0.6035, loss=0.7085, lr=4.73e-05]
Epoch 1/5:  47%|████▋     | 556/1177 [27:36<31:50,  3.08s/it, exist=0.6033, loss=0.7084, lr=4.74e-05]
Epoch 1/5:  47%|████▋     | 557/1177 [27:36<28:33,  2.76s/it, exist=0.6033, loss=0.7084, lr=4.74e-05]
Epoch 1/5:  47%|████▋     | 557/1177 [27:37<28:33,  2.76s/it, exist=0.6036, loss=0.7088, lr=4.74e-05]
Epoch 1/5:  47%|████▋     | 558/1177 [27:37<25:58,  2.52s/it, exist=0.6036, loss=0.7088, lr=4.74e-05]
Epoch 1/5:  47%|████▋     | 558/1177 [27:41<25:58,  2.52s/it, exist=0.6037, loss=0.7089, lr=4.75e-05]
Epoch 1/5:  47%|████▋     | 559/1177 [27:41<28:48,  2.80s/it, exist=0.6037, loss=0.7089, lr=4.75e-05]
Epoch 1/5:  47%|████▋     | 559/1177 [27:44<28:48,  2.80s/it, exist=0.6036, loss=0.7088, lr=4.76e-05]
Epoch 1/5:  48%|████▊     | 560/1177 [27:44<30:53,  3.00s/it, exist=0.6036, loss=0.7088, lr=4.76e-05]
Epoch 1/5:  48%|████▊     | 560/1177 [27:49<30:53,  3.00s/it, exist=0.6033, loss=0.7085, lr=4.77e-05]
Epoch 1/5:  48%|████▊     | 561/1177 [27:49<34:28,  3.36s/it, exist=0.6033, loss=0.7085, lr=4.77e-05]
Epoch 1/5:  48%|████▊     | 561/1177 [27:51<34:28,  3.36s/it, exist=0.6030, loss=0.7082, lr=4.78e-05]
Epoch 1/5:  48%|████▊     | 562/1177 [27:51<32:08,  3.14s/it, exist=0.6030, loss=0.7082, lr=4.78e-05]
Epoch 1/5:  48%|████▊     | 562/1177 [27:54<32:08,  3.14s/it, exist=0.6028, loss=0.7080, lr=4.79e-05]
Epoch 1/5:  48%|████▊     | 563/1177 [27:54<30:35,  2.99s/it, exist=0.6028, loss=0.7080, lr=4.79e-05]
Epoch 1/5:  48%|████▊     | 563/1177 [27:56<30:35,  2.99s/it, exist=0.6027, loss=0.7079, lr=4.80e-05]
Epoch 1/5:  48%|████▊     | 564/1177 [27:56<27:25,  2.68s/it, exist=0.6027, loss=0.7079, lr=4.80e-05]
Epoch 1/5:  48%|████▊     | 564/1177 [27:58<27:25,  2.68s/it, exist=0.6026, loss=0.7078, lr=4.80e-05]
Epoch 1/5:  48%|████▊     | 565/1177 [27:58<27:10,  2.66s/it, exist=0.6026, loss=0.7078, lr=4.80e-05]
Epoch 1/5:  48%|████▊     | 565/1177 [28:01<27:10,  2.66s/it, exist=0.6027, loss=0.7079, lr=4.81e-05]
Epoch 1/5:  48%|████▊     | 566/1177 [28:01<26:48,  2.63s/it, exist=0.6027, loss=0.7079, lr=4.81e-05]
Epoch 1/5:  48%|████▊     | 566/1177 [28:04<26:48,  2.63s/it, exist=0.6027, loss=0.7081, lr=4.82e-05]
Epoch 1/5:  48%|████▊     | 567/1177 [28:04<26:40,  2.62s/it, exist=0.6027, loss=0.7081, lr=4.82e-05]
Epoch 1/5:  48%|████▊     | 567/1177 [28:06<26:40,  2.62s/it, exist=0.6024, loss=0.7078, lr=4.83e-05]
Epoch 1/5:  48%|████▊     | 568/1177 [28:06<26:36,  2.62s/it, exist=0.6024, loss=0.7078, lr=4.83e-05]
Epoch 1/5:  48%|████▊     | 568/1177 [28:09<26:36,  2.62s/it, exist=0.6024, loss=0.7080, lr=4.84e-05]
Epoch 1/5:  48%|████▊     | 569/1177 [28:09<26:33,  2.62s/it, exist=0.6024, loss=0.7080, lr=4.84e-05]
Epoch 1/5:  48%|████▊     | 569/1177 [28:11<26:33,  2.62s/it, exist=0.6022, loss=0.7078, lr=4.85e-05]
Epoch 1/5:  48%|████▊     | 570/1177 [28:11<26:27,  2.62s/it, exist=0.6022, loss=0.7078, lr=4.85e-05]
Epoch 1/5:  48%|████▊     | 570/1177 [28:14<26:27,  2.62s/it, exist=0.6024, loss=0.7078, lr=4.86e-05]
Epoch 1/5:  49%|████▊     | 571/1177 [28:14<26:07,  2.59s/it, exist=0.6024, loss=0.7078, lr=4.86e-05]
Epoch 1/5:  49%|████▊     | 571/1177 [28:17<26:07,  2.59s/it, exist=0.6020, loss=0.7076, lr=4.86e-05]
Epoch 1/5:  49%|████▊     | 572/1177 [28:17<26:06,  2.59s/it, exist=0.6020, loss=0.7076, lr=4.86e-05]
Epoch 1/5:  49%|████▊     | 572/1177 [28:19<26:06,  2.59s/it, exist=0.6021, loss=0.7077, lr=4.87e-05]
Epoch 1/5:  49%|████▊     | 573/1177 [28:19<25:39,  2.55s/it, exist=0.6021, loss=0.7077, lr=4.87e-05]
Epoch 1/5:  49%|████▊     | 573/1177 [28:22<25:39,  2.55s/it, exist=0.6016, loss=0.7073, lr=4.88e-05]
Epoch 1/5:  49%|████▉     | 574/1177 [28:22<27:05,  2.70s/it, exist=0.6016, loss=0.7073, lr=4.88e-05]
Epoch 1/5:  49%|████▉     | 574/1177 [28:26<27:05,  2.70s/it, exist=0.6013, loss=0.7071, lr=4.89e-05]
Epoch 1/5:  49%|████▉     | 575/1177 [28:26<31:04,  3.10s/it, exist=0.6013, loss=0.7071, lr=4.89e-05]
Epoch 1/5:  49%|████▉     | 575/1177 [28:29<31:04,  3.10s/it, exist=0.6015, loss=0.7072, lr=4.90e-05]
Epoch 1/5:  49%|████▉     | 576/1177 [28:29<29:20,  2.93s/it, exist=0.6015, loss=0.7072, lr=4.90e-05]
Epoch 1/5:  49%|████▉     | 576/1177 [28:33<29:20,  2.93s/it, exist=0.6014, loss=0.7070, lr=4.91e-05]
Epoch 1/5:  49%|████▉     | 577/1177 [28:33<32:29,  3.25s/it, exist=0.6014, loss=0.7070, lr=4.91e-05]
Epoch 1/5:  49%|████▉     | 577/1177 [28:35<32:29,  3.25s/it, exist=0.6015, loss=0.7072, lr=4.91e-05]
Epoch 1/5:  49%|████▉     | 578/1177 [28:35<30:22,  3.04s/it, exist=0.6015, loss=0.7072, lr=4.91e-05]
Epoch 1/5:  49%|████▉     | 578/1177 [28:39<30:22,  3.04s/it, exist=0.6013, loss=0.7069, lr=4.92e-05]
Epoch 1/5:  49%|████▉     | 579/1177 [28:39<32:49,  3.29s/it, exist=0.6013, loss=0.7069, lr=4.92e-05]
Epoch 1/5:  49%|████▉     | 579/1177 [28:42<32:49,  3.29s/it, exist=0.6011, loss=0.7066, lr=4.93e-05]
Epoch 1/5:  49%|████▉     | 580/1177 [28:42<30:32,  3.07s/it, exist=0.6011, loss=0.7066, lr=4.93e-05]
Epoch 1/5:  49%|████▉     | 580/1177 [28:45<30:32,  3.07s/it, exist=0.6011, loss=0.7067, lr=4.94e-05]
Epoch 1/5:  49%|████▉     | 581/1177 [28:45<30:45,  3.10s/it, exist=0.6011, loss=0.7067, lr=4.94e-05]
Epoch 1/5:  49%|████▉     | 581/1177 [28:47<30:45,  3.10s/it, exist=0.6014, loss=0.7069, lr=4.95e-05]
Epoch 1/5:  49%|████▉     | 582/1177 [28:47<29:15,  2.95s/it, exist=0.6014, loss=0.7069, lr=4.95e-05]
Epoch 1/5:  49%|████▉     | 582/1177 [28:51<29:15,  2.95s/it, exist=0.6011, loss=0.7066, lr=4.96e-05]
Epoch 1/5:  50%|████▉     | 583/1177 [28:51<31:52,  3.22s/it, exist=0.6011, loss=0.7066, lr=4.96e-05]
Epoch 1/5:  50%|████▉     | 583/1177 [28:54<31:52,  3.22s/it, exist=0.6013, loss=0.7067, lr=4.97e-05]
Epoch 1/5:  50%|████▉     | 584/1177 [28:54<31:48,  3.22s/it, exist=0.6013, loss=0.7067, lr=4.97e-05]
Epoch 1/5:  50%|████▉     | 584/1177 [28:57<31:48,  3.22s/it, exist=0.6013, loss=0.7068, lr=4.97e-05]
Epoch 1/5:  50%|████▉     | 585/1177 [28:57<30:41,  3.11s/it, exist=0.6013, loss=0.7068, lr=4.97e-05]
Epoch 1/5:  50%|████▉     | 585/1177 [29:00<30:41,  3.11s/it, exist=0.6014, loss=0.7068, lr=4.98e-05]
Epoch 1/5:  50%|████▉     | 586/1177 [29:00<28:25,  2.89s/it, exist=0.6014, loss=0.7068, lr=4.98e-05]
Epoch 1/5:  50%|████▉     | 586/1177 [29:02<28:25,  2.89s/it, exist=0.6014, loss=0.7069, lr=4.99e-05]
Epoch 1/5:  50%|████▉     | 587/1177 [29:02<27:48,  2.83s/it, exist=0.6014, loss=0.7069, lr=4.99e-05]
Epoch 1/5:  50%|████▉     | 587/1177 [29:05<27:48,  2.83s/it, exist=0.6018, loss=0.7073, lr=5.00e-05]
Epoch 1/5:  50%|████▉     | 588/1177 [29:05<27:10,  2.77s/it, exist=0.6018, loss=0.7073, lr=5.00e-05]
Epoch 1/5:  50%|████▉     | 588/1177 [29:08<27:10,  2.77s/it, exist=0.6016, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 589/1177 [29:08<26:26,  2.70s/it, exist=0.6016, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 589/1177 [29:10<26:26,  2.70s/it, exist=0.6016, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 590/1177 [29:10<25:45,  2.63s/it, exist=0.6016, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 590/1177 [29:13<25:45,  2.63s/it, exist=0.6018, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 591/1177 [29:13<25:38,  2.62s/it, exist=0.6018, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 591/1177 [29:15<25:38,  2.62s/it, exist=0.6020, loss=0.7072, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 592/1177 [29:15<25:35,  2.62s/it, exist=0.6020, loss=0.7072, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 592/1177 [29:18<25:35,  2.62s/it, exist=0.6019, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 593/1177 [29:18<25:50,  2.66s/it, exist=0.6019, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 593/1177 [29:20<25:50,  2.66s/it, exist=0.6017, loss=0.7069, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 594/1177 [29:20<24:00,  2.47s/it, exist=0.6017, loss=0.7069, lr=5.00e-05]
Epoch 1/5:  50%|█████     | 594/1177 [29:23<24:00,  2.47s/it, exist=0.6018, loss=0.7072, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 595/1177 [29:23<24:08,  2.49s/it, exist=0.6018, loss=0.7072, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 595/1177 [29:26<24:08,  2.49s/it, exist=0.6015, loss=0.7069, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 596/1177 [29:26<26:18,  2.72s/it, exist=0.6015, loss=0.7069, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 596/1177 [29:30<26:18,  2.72s/it, exist=0.6013, loss=0.7066, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 597/1177 [29:30<31:37,  3.27s/it, exist=0.6013, loss=0.7066, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 597/1177 [29:33<31:37,  3.27s/it, exist=0.6011, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 598/1177 [29:33<31:01,  3.21s/it, exist=0.6011, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 598/1177 [29:37<31:01,  3.21s/it, exist=0.6012, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 599/1177 [29:37<32:06,  3.33s/it, exist=0.6012, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 599/1177 [29:39<32:06,  3.33s/it, exist=0.6012, loss=0.7068, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 600/1177 [29:39<28:12,  2.93s/it, exist=0.6012, loss=0.7068, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 600/1177 [29:42<28:12,  2.93s/it, exist=0.6009, loss=0.7065, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 601/1177 [29:42<26:49,  2.79s/it, exist=0.6009, loss=0.7065, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 601/1177 [29:45<26:49,  2.79s/it, exist=0.6012, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 602/1177 [29:45<28:09,  2.94s/it, exist=0.6012, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 602/1177 [29:49<28:09,  2.94s/it, exist=0.6009, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 603/1177 [29:49<31:37,  3.31s/it, exist=0.6009, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  51%|█████     | 603/1177 [29:52<31:37,  3.31s/it, exist=0.6009, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  51%|█████▏    | 604/1177 [29:52<29:58,  3.14s/it, exist=0.6009, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  51%|█████▏    | 604/1177 [29:54<29:58,  3.14s/it, exist=0.6011, loss=0.7065, lr=5.00e-05]
Epoch 1/5:  51%|█████▏    | 605/1177 [29:54<27:49,  2.92s/it, exist=0.6011, loss=0.7065, lr=5.00e-05]
Epoch 1/5:  51%|█████▏    | 605/1177 [29:57<27:49,  2.92s/it, exist=0.6013, loss=0.7066, lr=5.00e-05]
Epoch 1/5:  51%|█████▏    | 606/1177 [29:57<28:09,  2.96s/it, exist=0.6013, loss=0.7066, lr=5.00e-05]
Epoch 1/5:  51%|█████▏    | 606/1177 [30:00<28:09,  2.96s/it, exist=0.6009, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 607/1177 [30:00<28:35,  3.01s/it, exist=0.6009, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 607/1177 [30:04<28:35,  3.01s/it, exist=0.6010, loss=0.7063, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 608/1177 [30:04<29:13,  3.08s/it, exist=0.6010, loss=0.7063, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 608/1177 [30:06<29:13,  3.08s/it, exist=0.6010, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 609/1177 [30:06<28:02,  2.96s/it, exist=0.6010, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 609/1177 [30:09<28:02,  2.96s/it, exist=0.6010, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 610/1177 [30:09<27:12,  2.88s/it, exist=0.6010, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 610/1177 [30:12<27:12,  2.88s/it, exist=0.6008, loss=0.7063, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 611/1177 [30:12<28:30,  3.02s/it, exist=0.6008, loss=0.7063, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 611/1177 [30:15<28:30,  3.02s/it, exist=0.6008, loss=0.7061, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 612/1177 [30:15<27:24,  2.91s/it, exist=0.6008, loss=0.7061, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 612/1177 [30:18<27:24,  2.91s/it, exist=0.6006, loss=0.7060, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 613/1177 [30:18<26:36,  2.83s/it, exist=0.6006, loss=0.7060, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 613/1177 [30:21<26:36,  2.83s/it, exist=0.6005, loss=0.7059, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 614/1177 [30:21<27:32,  2.94s/it, exist=0.6005, loss=0.7059, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 614/1177 [30:24<27:32,  2.94s/it, exist=0.6005, loss=0.7060, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 615/1177 [30:24<27:00,  2.88s/it, exist=0.6005, loss=0.7060, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 615/1177 [30:27<27:00,  2.88s/it, exist=0.6004, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 616/1177 [30:27<28:19,  3.03s/it, exist=0.6004, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 616/1177 [30:29<28:19,  3.03s/it, exist=0.6007, loss=0.7061, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 617/1177 [30:29<26:42,  2.86s/it, exist=0.6007, loss=0.7061, lr=5.00e-05]
Epoch 1/5:  52%|█████▏    | 617/1177 [30:32<26:42,  2.86s/it, exist=0.6007, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 618/1177 [30:32<25:59,  2.79s/it, exist=0.6007, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 618/1177 [30:35<25:59,  2.79s/it, exist=0.6006, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 619/1177 [30:35<27:15,  2.93s/it, exist=0.6006, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 619/1177 [30:38<27:15,  2.93s/it, exist=0.6006, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 620/1177 [30:38<25:45,  2.77s/it, exist=0.6006, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 620/1177 [30:40<25:45,  2.77s/it, exist=0.6007, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 621/1177 [30:40<23:39,  2.55s/it, exist=0.6007, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 621/1177 [30:43<23:39,  2.55s/it, exist=0.6005, loss=0.7061, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 622/1177 [30:43<26:07,  2.82s/it, exist=0.6005, loss=0.7061, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 622/1177 [30:48<26:07,  2.82s/it, exist=0.6004, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 623/1177 [30:48<30:54,  3.35s/it, exist=0.6004, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 623/1177 [30:51<30:54,  3.35s/it, exist=0.6002, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 624/1177 [30:51<31:26,  3.41s/it, exist=0.6002, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 624/1177 [30:53<31:26,  3.41s/it, exist=0.6000, loss=0.7063, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 625/1177 [30:53<27:36,  3.00s/it, exist=0.6000, loss=0.7063, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 625/1177 [30:58<27:36,  3.00s/it, exist=0.5997, loss=0.7059, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 626/1177 [30:58<31:26,  3.42s/it, exist=0.5997, loss=0.7059, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 626/1177 [31:00<31:26,  3.42s/it, exist=0.5999, loss=0.7061, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 627/1177 [31:00<29:24,  3.21s/it, exist=0.5999, loss=0.7061, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 627/1177 [31:03<29:24,  3.21s/it, exist=0.6001, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 628/1177 [31:03<28:58,  3.17s/it, exist=0.6001, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 628/1177 [31:06<28:58,  3.17s/it, exist=0.6000, loss=0.7063, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 629/1177 [31:06<26:42,  2.92s/it, exist=0.6000, loss=0.7063, lr=5.00e-05]
Epoch 1/5:  53%|█████▎    | 629/1177 [31:09<26:42,  2.92s/it, exist=0.5999, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  54%|█████▎    | 630/1177 [31:09<26:58,  2.96s/it, exist=0.5999, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  54%|█████▎    | 630/1177 [31:11<26:58,  2.96s/it, exist=0.6000, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  54%|█████▎    | 631/1177 [31:11<24:21,  2.68s/it, exist=0.6000, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  54%|█████▎    | 631/1177 [31:16<24:21,  2.68s/it, exist=0.6002, loss=0.7065, lr=5.00e-05]
Epoch 1/5:  54%|█████▎    | 632/1177 [31:16<30:04,  3.31s/it, exist=0.6002, loss=0.7065, lr=5.00e-05]
Epoch 1/5:  54%|█████▎    | 632/1177 [31:20<30:04,  3.31s/it, exist=0.6004, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 633/1177 [31:20<32:07,  3.54s/it, exist=0.6004, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 633/1177 [31:22<32:07,  3.54s/it, exist=0.6004, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 634/1177 [31:22<29:02,  3.21s/it, exist=0.6004, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 634/1177 [31:26<29:02,  3.21s/it, exist=0.6005, loss=0.7073, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 635/1177 [31:26<29:26,  3.26s/it, exist=0.6005, loss=0.7073, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 635/1177 [31:28<29:26,  3.26s/it, exist=0.6001, loss=0.7071, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 636/1177 [31:28<27:23,  3.04s/it, exist=0.6001, loss=0.7071, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 636/1177 [31:31<27:23,  3.04s/it, exist=0.6001, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 637/1177 [31:31<25:47,  2.87s/it, exist=0.6001, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 637/1177 [31:33<25:47,  2.87s/it, exist=0.6001, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 638/1177 [31:33<23:28,  2.61s/it, exist=0.6001, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 638/1177 [31:35<23:28,  2.61s/it, exist=0.5999, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 639/1177 [31:35<23:06,  2.58s/it, exist=0.5999, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 639/1177 [31:38<23:06,  2.58s/it, exist=0.6000, loss=0.7068, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 640/1177 [31:38<23:15,  2.60s/it, exist=0.6000, loss=0.7068, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 640/1177 [31:40<23:15,  2.60s/it, exist=0.5999, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 641/1177 [31:40<22:49,  2.55s/it, exist=0.5999, loss=0.7067, lr=5.00e-05]
Epoch 1/5:  54%|█████▍    | 641/1177 [31:42<22:49,  2.55s/it, exist=0.6000, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 642/1177 [31:42<21:29,  2.41s/it, exist=0.6000, loss=0.7070, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 642/1177 [31:46<21:29,  2.41s/it, exist=0.5999, loss=0.7068, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 643/1177 [31:46<25:06,  2.82s/it, exist=0.5999, loss=0.7068, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 643/1177 [31:48<25:06,  2.82s/it, exist=0.5996, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 644/1177 [31:48<22:51,  2.57s/it, exist=0.5996, loss=0.7064, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 644/1177 [31:51<22:51,  2.57s/it, exist=0.5994, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 645/1177 [31:51<24:10,  2.73s/it, exist=0.5994, loss=0.7062, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 645/1177 [31:55<24:10,  2.73s/it, exist=0.5990, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 646/1177 [31:55<27:13,  3.08s/it, exist=0.5990, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 646/1177 [31:57<27:13,  3.08s/it, exist=0.5989, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 647/1177 [31:57<24:31,  2.78s/it, exist=0.5989, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  55%|█████▍    | 647/1177 [31:59<24:31,  2.78s/it, exist=0.5988, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 648/1177 [31:59<22:29,  2.55s/it, exist=0.5988, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 648/1177 [32:02<22:29,  2.55s/it, exist=0.5986, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 649/1177 [32:02<23:55,  2.72s/it, exist=0.5986, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 649/1177 [32:04<23:55,  2.72s/it, exist=0.5986, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 650/1177 [32:04<21:57,  2.50s/it, exist=0.5986, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 650/1177 [32:06<21:57,  2.50s/it, exist=0.5986, loss=0.7055, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 651/1177 [32:06<20:36,  2.35s/it, exist=0.5986, loss=0.7055, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 651/1177 [32:10<20:36,  2.35s/it, exist=0.5984, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 652/1177 [32:10<24:22,  2.79s/it, exist=0.5984, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 652/1177 [32:14<24:22,  2.79s/it, exist=0.5985, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 653/1177 [32:14<28:21,  3.25s/it, exist=0.5985, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  55%|█████▌    | 653/1177 [32:17<28:21,  3.25s/it, exist=0.5983, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 654/1177 [32:17<26:11,  3.01s/it, exist=0.5983, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 654/1177 [32:19<26:11,  3.01s/it, exist=0.5984, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 655/1177 [32:19<24:55,  2.87s/it, exist=0.5984, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 655/1177 [32:21<24:55,  2.87s/it, exist=0.5982, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 656/1177 [32:21<22:41,  2.61s/it, exist=0.5982, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 656/1177 [32:23<22:41,  2.61s/it, exist=0.5982, loss=0.7055, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 657/1177 [32:23<21:05,  2.43s/it, exist=0.5982, loss=0.7055, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 657/1177 [32:25<21:05,  2.43s/it, exist=0.5979, loss=0.7052, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 658/1177 [32:25<20:06,  2.32s/it, exist=0.5979, loss=0.7052, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 658/1177 [32:29<20:06,  2.32s/it, exist=0.5980, loss=0.7054, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 659/1177 [32:29<24:03,  2.79s/it, exist=0.5980, loss=0.7054, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 659/1177 [32:32<24:03,  2.79s/it, exist=0.5979, loss=0.7054, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 660/1177 [32:32<24:30,  2.84s/it, exist=0.5979, loss=0.7054, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 660/1177 [32:36<24:30,  2.84s/it, exist=0.5978, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 661/1177 [32:36<25:37,  2.98s/it, exist=0.5978, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 661/1177 [32:38<25:37,  2.98s/it, exist=0.5974, loss=0.7053, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 662/1177 [32:38<23:20,  2.72s/it, exist=0.5974, loss=0.7053, lr=5.00e-05]
Epoch 1/5:  56%|█████▌    | 662/1177 [32:41<23:20,  2.72s/it, exist=0.5975, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  56%|█████▋    | 663/1177 [32:41<24:48,  2.90s/it, exist=0.5975, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  56%|█████▋    | 663/1177 [32:44<24:48,  2.90s/it, exist=0.5972, loss=0.7053, lr=5.00e-05]
Epoch 1/5:  56%|█████▋    | 664/1177 [32:44<24:06,  2.82s/it, exist=0.5972, loss=0.7053, lr=5.00e-05]
Epoch 1/5:  56%|█████▋    | 664/1177 [32:47<24:06,  2.82s/it, exist=0.5969, loss=0.7050, lr=5.00e-05]
Epoch 1/5:  56%|█████▋    | 665/1177 [32:47<24:12,  2.84s/it, exist=0.5969, loss=0.7050, lr=5.00e-05]
Epoch 1/5:  56%|█████▋    | 665/1177 [32:50<24:12,  2.84s/it, exist=0.5966, loss=0.7047, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 666/1177 [32:50<25:59,  3.05s/it, exist=0.5966, loss=0.7047, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 666/1177 [32:54<25:59,  3.05s/it, exist=0.5965, loss=0.7046, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 667/1177 [32:54<27:00,  3.18s/it, exist=0.5965, loss=0.7046, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 667/1177 [32:56<27:00,  3.18s/it, exist=0.5965, loss=0.7046, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 668/1177 [32:56<25:31,  3.01s/it, exist=0.5965, loss=0.7046, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 668/1177 [32:58<25:31,  3.01s/it, exist=0.5966, loss=0.7048, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 669/1177 [32:58<22:56,  2.71s/it, exist=0.5966, loss=0.7048, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 669/1177 [33:01<22:56,  2.71s/it, exist=0.5967, loss=0.7049, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 670/1177 [33:01<22:32,  2.67s/it, exist=0.5967, loss=0.7049, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 670/1177 [33:05<22:32,  2.67s/it, exist=0.5965, loss=0.7047, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 671/1177 [33:05<27:42,  3.29s/it, exist=0.5965, loss=0.7047, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 671/1177 [33:08<27:42,  3.29s/it, exist=0.5962, loss=0.7046, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 672/1177 [33:08<26:11,  3.11s/it, exist=0.5962, loss=0.7046, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 672/1177 [33:10<26:11,  3.11s/it, exist=0.5963, loss=0.7047, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 673/1177 [33:10<23:15,  2.77s/it, exist=0.5963, loss=0.7047, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 673/1177 [33:13<23:15,  2.77s/it, exist=0.5965, loss=0.7049, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 674/1177 [33:13<23:09,  2.76s/it, exist=0.5965, loss=0.7049, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 674/1177 [33:15<23:09,  2.76s/it, exist=0.5964, loss=0.7050, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 675/1177 [33:15<22:37,  2.70s/it, exist=0.5964, loss=0.7050, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 675/1177 [33:18<22:37,  2.70s/it, exist=0.5963, loss=0.7051, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 676/1177 [33:18<22:08,  2.65s/it, exist=0.5963, loss=0.7051, lr=5.00e-05]
Epoch 1/5:  57%|█████▋    | 676/1177 [33:20<22:08,  2.65s/it, exist=0.5963, loss=0.7052, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 677/1177 [33:20<20:29,  2.46s/it, exist=0.5963, loss=0.7052, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 677/1177 [33:23<20:29,  2.46s/it, exist=0.5963, loss=0.7054, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 678/1177 [33:23<22:06,  2.66s/it, exist=0.5963, loss=0.7054, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 678/1177 [33:25<22:06,  2.66s/it, exist=0.5962, loss=0.7053, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 679/1177 [33:25<20:25,  2.46s/it, exist=0.5962, loss=0.7053, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 679/1177 [33:28<20:25,  2.46s/it, exist=0.5959, loss=0.7050, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 680/1177 [33:28<21:56,  2.65s/it, exist=0.5959, loss=0.7050, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 680/1177 [33:31<21:56,  2.65s/it, exist=0.5958, loss=0.7049, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 681/1177 [33:31<21:51,  2.64s/it, exist=0.5958, loss=0.7049, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 681/1177 [33:34<21:51,  2.64s/it, exist=0.5955, loss=0.7049, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 682/1177 [33:34<21:55,  2.66s/it, exist=0.5955, loss=0.7049, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 682/1177 [33:36<21:55,  2.66s/it, exist=0.5954, loss=0.7048, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 683/1177 [33:36<20:21,  2.47s/it, exist=0.5954, loss=0.7048, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 683/1177 [33:38<20:21,  2.47s/it, exist=0.5953, loss=0.7047, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 684/1177 [33:38<20:51,  2.54s/it, exist=0.5953, loss=0.7047, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 684/1177 [33:42<20:51,  2.54s/it, exist=0.5954, loss=0.7051, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 685/1177 [33:42<23:07,  2.82s/it, exist=0.5954, loss=0.7051, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 685/1177 [33:44<23:07,  2.82s/it, exist=0.5953, loss=0.7050, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 686/1177 [33:44<22:05,  2.70s/it, exist=0.5953, loss=0.7050, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 686/1177 [33:46<22:05,  2.70s/it, exist=0.5955, loss=0.7053, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 687/1177 [33:46<20:21,  2.49s/it, exist=0.5955, loss=0.7053, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 687/1177 [33:49<20:21,  2.49s/it, exist=0.5953, loss=0.7051, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 688/1177 [33:49<22:09,  2.72s/it, exist=0.5953, loss=0.7051, lr=5.00e-05]
Epoch 1/5:  58%|█████▊    | 688/1177 [33:52<22:09,  2.72s/it, exist=0.5957, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  59%|█████▊    | 689/1177 [33:52<21:50,  2.69s/it, exist=0.5957, loss=0.7056, lr=5.00e-05]
Epoch 1/5:  59%|█████▊    | 689/1177 [33:54<21:50,  2.69s/it, exist=0.5959, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  59%|█████▊    | 690/1177 [33:54<20:13,  2.49s/it, exist=0.5959, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  59%|█████▊    | 690/1177 [33:57<20:13,  2.49s/it, exist=0.5959, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  59%|█████▊    | 691/1177 [33:57<22:00,  2.72s/it, exist=0.5959, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  59%|█████▊    | 691/1177 [34:00<22:00,  2.72s/it, exist=0.5960, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  59%|█████▉    | 692/1177 [34:00<21:41,  2.68s/it, exist=0.5960, loss=0.7058, lr=5.00e-05]
Epoch 1/5:  59%|█████▉    | 692/1177 [34:03<21:41,  2.68s/it, exist=0.5958, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  59%|█████▉    | 693/1177 [34:03<21:40,  2.69s/it, exist=0.5958, loss=0.7057, lr=5.00e-05]
Epoch 1/5:  59%|█████▉    | 693/1177 [34:08<21:40,  2.69s/it, exist=0.5956, loss=0.7055, lr=5.00e-05]
Epoch 1/5:  59%|█████▉    | 694/1177 [34:08<28:05,  3.49s/it, exist=0.5956, loss=0.7055, lr=5.00e-05]
Epoch 1/5:  59%|█████▉    | 694/1177 [34:12<28:05,  3.49s/it, exist=0.5956, loss=0.7055, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 695/1177 [34:12<28:28,  3.54s/it, exist=0.5956, loss=0.7055, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 695/1177 [34:14<28:28,  3.54s/it, exist=0.5954, loss=0.7055, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 696/1177 [34:14<26:45,  3.34s/it, exist=0.5954, loss=0.7055, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 696/1177 [34:17<26:45,  3.34s/it, exist=0.5951, loss=0.7051, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 697/1177 [34:17<25:10,  3.15s/it, exist=0.5951, loss=0.7051, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 697/1177 [34:20<25:10,  3.15s/it, exist=0.5951, loss=0.7054, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 698/1177 [34:20<24:18,  3.04s/it, exist=0.5951, loss=0.7054, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 698/1177 [34:23<24:18,  3.04s/it, exist=0.5952, loss=0.7055, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 699/1177 [34:23<23:22,  2.93s/it, exist=0.5952, loss=0.7055, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 699/1177 [34:25<23:22,  2.93s/it, exist=0.5949, loss=0.7052, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 700/1177 [34:25<22:21,  2.81s/it, exist=0.5949, loss=0.7052, lr=4.99e-05]
Epoch 1/5:  59%|█████▉    | 700/1177 [34:28<22:21,  2.81s/it, exist=0.5947, loss=0.7050, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 701/1177 [34:28<21:51,  2.76s/it, exist=0.5947, loss=0.7050, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 701/1177 [34:31<21:51,  2.76s/it, exist=0.5946, loss=0.7049, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 702/1177 [34:31<22:33,  2.85s/it, exist=0.5946, loss=0.7049, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 702/1177 [34:33<22:33,  2.85s/it, exist=0.5947, loss=0.7050, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 703/1177 [34:33<20:26,  2.59s/it, exist=0.5947, loss=0.7050, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 703/1177 [34:35<20:26,  2.59s/it, exist=0.5946, loss=0.7050, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 704/1177 [34:35<18:59,  2.41s/it, exist=0.5946, loss=0.7050, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 704/1177 [34:38<18:59,  2.41s/it, exist=0.5945, loss=0.7050, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 705/1177 [34:38<21:10,  2.69s/it, exist=0.5945, loss=0.7050, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 705/1177 [34:41<21:10,  2.69s/it, exist=0.5943, loss=0.7049, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 706/1177 [34:41<21:56,  2.79s/it, exist=0.5943, loss=0.7049, lr=4.99e-05]
Epoch 1/5:  60%|█████▉    | 706/1177 [34:44<21:56,  2.79s/it, exist=0.5941, loss=0.7048, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 707/1177 [34:44<21:00,  2.68s/it, exist=0.5941, loss=0.7048, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 707/1177 [34:46<21:00,  2.68s/it, exist=0.5943, loss=0.7049, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 708/1177 [34:46<19:17,  2.47s/it, exist=0.5943, loss=0.7049, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 708/1177 [34:49<19:17,  2.47s/it, exist=0.5942, loss=0.7048, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 709/1177 [34:49<20:13,  2.59s/it, exist=0.5942, loss=0.7048, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 709/1177 [34:51<20:13,  2.59s/it, exist=0.5939, loss=0.7044, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 710/1177 [34:51<20:02,  2.57s/it, exist=0.5939, loss=0.7044, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 710/1177 [34:54<20:02,  2.57s/it, exist=0.5939, loss=0.7043, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 711/1177 [34:54<19:56,  2.57s/it, exist=0.5939, loss=0.7043, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 711/1177 [34:56<19:56,  2.57s/it, exist=0.5938, loss=0.7042, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 712/1177 [34:56<19:53,  2.57s/it, exist=0.5938, loss=0.7042, lr=4.99e-05]
Epoch 1/5:  60%|██████    | 712/1177 [34:59<19:53,  2.57s/it, exist=0.5935, loss=0.7039, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 713/1177 [34:59<19:46,  2.56s/it, exist=0.5935, loss=0.7039, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 713/1177 [35:02<19:46,  2.56s/it, exist=0.5933, loss=0.7037, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 714/1177 [35:02<21:42,  2.81s/it, exist=0.5933, loss=0.7037, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 714/1177 [35:04<21:42,  2.81s/it, exist=0.5931, loss=0.7035, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 715/1177 [35:04<19:51,  2.58s/it, exist=0.5931, loss=0.7035, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 715/1177 [35:07<19:51,  2.58s/it, exist=0.5928, loss=0.7032, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 716/1177 [35:07<19:56,  2.60s/it, exist=0.5928, loss=0.7032, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 716/1177 [35:09<19:56,  2.60s/it, exist=0.5928, loss=0.7034, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 717/1177 [35:09<18:37,  2.43s/it, exist=0.5928, loss=0.7034, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 717/1177 [35:12<18:37,  2.43s/it, exist=0.5929, loss=0.7034, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 718/1177 [35:12<20:29,  2.68s/it, exist=0.5929, loss=0.7034, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 718/1177 [35:15<20:29,  2.68s/it, exist=0.5929, loss=0.7034, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 719/1177 [35:15<20:05,  2.63s/it, exist=0.5929, loss=0.7034, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 719/1177 [35:18<20:05,  2.63s/it, exist=0.5929, loss=0.7033, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 720/1177 [35:18<20:45,  2.73s/it, exist=0.5929, loss=0.7033, lr=4.99e-05]
Epoch 1/5:  61%|██████    | 720/1177 [35:20<20:45,  2.73s/it, exist=0.5930, loss=0.7034, lr=4.99e-05]
Epoch 1/5:  61%|██████▏   | 721/1177 [35:20<19:15,  2.53s/it, exist=0.5930, loss=0.7034, lr=4.99e-05]
Epoch 1/5:  61%|██████▏   | 721/1177 [35:22<19:15,  2.53s/it, exist=0.5928, loss=0.7032, lr=4.99e-05]
Epoch 1/5:  61%|██████▏   | 722/1177 [35:22<19:29,  2.57s/it, exist=0.5928, loss=0.7032, lr=4.99e-05]
Epoch 1/5:  61%|██████▏   | 722/1177 [35:26<19:29,  2.57s/it, exist=0.5927, loss=0.7032, lr=4.99e-05]
Epoch 1/5:  61%|██████▏   | 723/1177 [35:26<22:26,  2.97s/it, exist=0.5927, loss=0.7032, lr=4.99e-05]
Epoch 1/5:  61%|██████▏   | 723/1177 [35:29<22:26,  2.97s/it, exist=0.5926, loss=0.7031, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 724/1177 [35:29<21:28,  2.84s/it, exist=0.5926, loss=0.7031, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 724/1177 [35:31<21:28,  2.84s/it, exist=0.5924, loss=0.7029, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 725/1177 [35:31<20:55,  2.78s/it, exist=0.5924, loss=0.7029, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 725/1177 [35:38<20:55,  2.78s/it, exist=0.5920, loss=0.7026, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 726/1177 [35:38<29:52,  3.97s/it, exist=0.5920, loss=0.7026, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 726/1177 [35:42<29:52,  3.97s/it, exist=0.5919, loss=0.7024, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 727/1177 [35:42<30:18,  4.04s/it, exist=0.5919, loss=0.7024, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 727/1177 [35:44<30:18,  4.04s/it, exist=0.5914, loss=0.7019, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 728/1177 [35:44<25:41,  3.43s/it, exist=0.5914, loss=0.7019, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 728/1177 [35:47<25:41,  3.43s/it, exist=0.5910, loss=0.7015, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 729/1177 [35:47<23:34,  3.16s/it, exist=0.5910, loss=0.7015, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 729/1177 [35:50<23:34,  3.16s/it, exist=0.5910, loss=0.7016, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 730/1177 [35:50<22:54,  3.08s/it, exist=0.5910, loss=0.7016, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 730/1177 [35:53<22:54,  3.08s/it, exist=0.5907, loss=0.7013, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 731/1177 [35:53<24:01,  3.23s/it, exist=0.5907, loss=0.7013, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 731/1177 [35:56<24:01,  3.23s/it, exist=0.5907, loss=0.7011, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 732/1177 [35:56<22:17,  3.01s/it, exist=0.5907, loss=0.7011, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 732/1177 [35:58<22:17,  3.01s/it, exist=0.5903, loss=0.7008, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 733/1177 [35:58<20:06,  2.72s/it, exist=0.5903, loss=0.7008, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 733/1177 [36:01<20:06,  2.72s/it, exist=0.5902, loss=0.7006, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 734/1177 [36:01<21:56,  2.97s/it, exist=0.5902, loss=0.7006, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 734/1177 [36:04<21:56,  2.97s/it, exist=0.5899, loss=0.7005, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 735/1177 [36:04<22:01,  2.99s/it, exist=0.5899, loss=0.7005, lr=4.99e-05]
Epoch 1/5:  62%|██████▏   | 735/1177 [36:07<22:01,  2.99s/it, exist=0.5898, loss=0.7004, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 736/1177 [36:07<21:19,  2.90s/it, exist=0.5898, loss=0.7004, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 736/1177 [36:10<21:19,  2.90s/it, exist=0.5897, loss=0.7003, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 737/1177 [36:10<20:49,  2.84s/it, exist=0.5897, loss=0.7003, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 737/1177 [36:14<20:49,  2.84s/it, exist=0.5896, loss=0.7001, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 738/1177 [36:14<24:09,  3.30s/it, exist=0.5896, loss=0.7001, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 738/1177 [36:19<24:09,  3.30s/it, exist=0.5894, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 739/1177 [36:19<27:04,  3.71s/it, exist=0.5894, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 739/1177 [36:22<27:04,  3.71s/it, exist=0.5890, loss=0.6995, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 740/1177 [36:22<24:43,  3.39s/it, exist=0.5890, loss=0.6995, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 740/1177 [36:25<24:43,  3.39s/it, exist=0.5892, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 741/1177 [36:25<24:45,  3.41s/it, exist=0.5892, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 741/1177 [36:30<24:45,  3.41s/it, exist=0.5892, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 742/1177 [36:30<27:26,  3.79s/it, exist=0.5892, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 742/1177 [36:33<27:26,  3.79s/it, exist=0.5892, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 743/1177 [36:33<26:00,  3.60s/it, exist=0.5892, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 743/1177 [36:35<26:00,  3.60s/it, exist=0.5891, loss=0.7000, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 744/1177 [36:35<22:37,  3.13s/it, exist=0.5891, loss=0.7000, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 744/1177 [36:37<22:37,  3.13s/it, exist=0.5891, loss=0.7001, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 745/1177 [36:37<21:15,  2.95s/it, exist=0.5891, loss=0.7001, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 745/1177 [36:41<21:15,  2.95s/it, exist=0.5887, loss=0.6997, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 746/1177 [36:41<22:26,  3.12s/it, exist=0.5887, loss=0.6997, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 746/1177 [36:45<22:26,  3.12s/it, exist=0.5889, loss=0.6999, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 747/1177 [36:45<23:32,  3.28s/it, exist=0.5889, loss=0.6999, lr=4.99e-05]
Epoch 1/5:  63%|██████▎   | 747/1177 [36:47<23:32,  3.28s/it, exist=0.5886, loss=0.6997, lr=4.99e-05]
Epoch 1/5:  64%|██████▎   | 748/1177 [36:47<22:01,  3.08s/it, exist=0.5886, loss=0.6997, lr=4.99e-05]
Epoch 1/5:  64%|██████▎   | 748/1177 [36:50<22:01,  3.08s/it, exist=0.5884, loss=0.6995, lr=4.99e-05]
Epoch 1/5:  64%|██████▎   | 749/1177 [36:50<20:55,  2.93s/it, exist=0.5884, loss=0.6995, lr=4.99e-05]
Epoch 1/5:  64%|██████▎   | 749/1177 [36:53<20:55,  2.93s/it, exist=0.5888, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  64%|██████▎   | 750/1177 [36:53<20:44,  2.92s/it, exist=0.5888, loss=0.6998, lr=4.99e-05]
Epoch 1/5:  64%|██████▎   | 750/1177 [36:56<20:44,  2.92s/it, exist=0.5885, loss=0.6995, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 751/1177 [36:56<21:42,  3.06s/it, exist=0.5885, loss=0.6995, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 751/1177 [36:59<21:42,  3.06s/it, exist=0.5884, loss=0.6993, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 752/1177 [36:59<20:28,  2.89s/it, exist=0.5884, loss=0.6993, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 752/1177 [37:01<20:28,  2.89s/it, exist=0.5887, loss=0.6996, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 753/1177 [37:01<18:32,  2.62s/it, exist=0.5887, loss=0.6996, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 753/1177 [37:06<18:32,  2.62s/it, exist=0.5885, loss=0.6993, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 754/1177 [37:06<23:55,  3.39s/it, exist=0.5885, loss=0.6993, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 754/1177 [37:10<23:55,  3.39s/it, exist=0.5881, loss=0.6990, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 755/1177 [37:10<24:54,  3.54s/it, exist=0.5881, loss=0.6990, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 755/1177 [37:11<24:54,  3.54s/it, exist=0.5882, loss=0.6992, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 756/1177 [37:11<21:22,  3.05s/it, exist=0.5882, loss=0.6992, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 756/1177 [37:14<21:22,  3.05s/it, exist=0.5879, loss=0.6988, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 757/1177 [37:14<19:17,  2.76s/it, exist=0.5879, loss=0.6988, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 757/1177 [37:19<19:17,  2.76s/it, exist=0.5876, loss=0.6985, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 758/1177 [37:19<25:26,  3.64s/it, exist=0.5876, loss=0.6985, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 758/1177 [37:23<25:26,  3.64s/it, exist=0.5875, loss=0.6986, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 759/1177 [37:23<26:00,  3.73s/it, exist=0.5875, loss=0.6986, lr=4.99e-05]
Epoch 1/5:  64%|██████▍   | 759/1177 [37:25<26:00,  3.73s/it, exist=0.5873, loss=0.6985, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 760/1177 [37:25<22:14,  3.20s/it, exist=0.5873, loss=0.6985, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 760/1177 [37:27<22:14,  3.20s/it, exist=0.5869, loss=0.6982, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 761/1177 [37:27<19:46,  2.85s/it, exist=0.5869, loss=0.6982, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 761/1177 [37:31<19:46,  2.85s/it, exist=0.5866, loss=0.6980, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 762/1177 [37:31<22:31,  3.26s/it, exist=0.5866, loss=0.6980, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 762/1177 [37:34<22:31,  3.26s/it, exist=0.5866, loss=0.6979, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 763/1177 [37:34<22:03,  3.20s/it, exist=0.5866, loss=0.6979, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 763/1177 [37:38<22:03,  3.20s/it, exist=0.5866, loss=0.6980, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 764/1177 [37:38<23:20,  3.39s/it, exist=0.5866, loss=0.6980, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 764/1177 [37:40<23:20,  3.39s/it, exist=0.5866, loss=0.6982, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 765/1177 [37:40<20:23,  2.97s/it, exist=0.5866, loss=0.6982, lr=4.99e-05]
Epoch 1/5:  65%|██████▍   | 765/1177 [37:44<20:23,  2.97s/it, exist=0.5861, loss=0.6978, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 766/1177 [37:44<22:01,  3.22s/it, exist=0.5861, loss=0.6978, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 766/1177 [37:47<22:01,  3.22s/it, exist=0.5859, loss=0.6975, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 767/1177 [37:47<21:58,  3.22s/it, exist=0.5859, loss=0.6975, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 767/1177 [37:49<21:58,  3.22s/it, exist=0.5858, loss=0.6974, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 768/1177 [37:49<19:20,  2.84s/it, exist=0.5858, loss=0.6974, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 768/1177 [37:52<19:20,  2.84s/it, exist=0.5856, loss=0.6972, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 769/1177 [37:52<19:03,  2.80s/it, exist=0.5856, loss=0.6972, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 769/1177 [37:55<19:03,  2.80s/it, exist=0.5855, loss=0.6971, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 770/1177 [37:55<19:13,  2.83s/it, exist=0.5855, loss=0.6971, lr=4.99e-05]
Epoch 1/5:  65%|██████▌   | 770/1177 [37:58<19:13,  2.83s/it, exist=0.5853, loss=0.6968, lr=4.99e-05]
Epoch 1/5:  66%|██████▌   | 771/1177 [37:58<19:05,  2.82s/it, exist=0.5853, loss=0.6968, lr=4.99e-05]
Epoch 1/5:  66%|██████▌   | 771/1177 [38:02<19:05,  2.82s/it, exist=0.5853, loss=0.6971, lr=4.99e-05]
Epoch 1/5:  66%|██████▌   | 772/1177 [38:02<22:00,  3.26s/it, exist=0.5853, loss=0.6971, lr=4.99e-05]
Epoch 1/5:  66%|██████▌   | 772/1177 [38:04<22:00,  3.26s/it, exist=0.5855, loss=0.6971, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 773/1177 [38:04<19:25,  2.89s/it, exist=0.5855, loss=0.6971, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 773/1177 [38:07<19:25,  2.89s/it, exist=0.5851, loss=0.6968, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 774/1177 [38:07<18:44,  2.79s/it, exist=0.5851, loss=0.6968, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 774/1177 [38:09<18:44,  2.79s/it, exist=0.5848, loss=0.6967, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 775/1177 [38:09<18:31,  2.76s/it, exist=0.5848, loss=0.6967, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 775/1177 [38:11<18:31,  2.76s/it, exist=0.5846, loss=0.6964, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 776/1177 [38:11<16:59,  2.54s/it, exist=0.5846, loss=0.6964, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 776/1177 [38:14<16:59,  2.54s/it, exist=0.5848, loss=0.6965, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 777/1177 [38:14<17:19,  2.60s/it, exist=0.5848, loss=0.6965, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 777/1177 [38:17<17:19,  2.60s/it, exist=0.5846, loss=0.6963, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 778/1177 [38:17<18:33,  2.79s/it, exist=0.5846, loss=0.6963, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 778/1177 [38:20<18:33,  2.79s/it, exist=0.5841, loss=0.6959, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 779/1177 [38:20<18:18,  2.76s/it, exist=0.5841, loss=0.6959, lr=4.98e-05]
Epoch 1/5:  66%|██████▌   | 779/1177 [38:22<18:18,  2.76s/it, exist=0.5838, loss=0.6955, lr=4.98e-05]
Epoch 1/5:  66%|██████▋   | 780/1177 [38:22<17:40,  2.67s/it, exist=0.5838, loss=0.6955, lr=4.98e-05]
Epoch 1/5:  66%|██████▋   | 780/1177 [38:26<17:40,  2.67s/it, exist=0.5835, loss=0.6952, lr=4.98e-05]
Epoch 1/5:  66%|██████▋   | 781/1177 [38:26<18:31,  2.81s/it, exist=0.5835, loss=0.6952, lr=4.98e-05]
Epoch 1/5:  66%|██████▋   | 781/1177 [38:28<18:31,  2.81s/it, exist=0.5837, loss=0.6955, lr=4.98e-05]
Epoch 1/5:  66%|██████▋   | 782/1177 [38:28<18:29,  2.81s/it, exist=0.5837, loss=0.6955, lr=4.98e-05]
Epoch 1/5:  66%|██████▋   | 782/1177 [38:30<18:29,  2.81s/it, exist=0.5837, loss=0.6955, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 783/1177 [38:30<16:55,  2.58s/it, exist=0.5837, loss=0.6955, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 783/1177 [38:33<16:55,  2.58s/it, exist=0.5837, loss=0.6963, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 784/1177 [38:33<16:51,  2.57s/it, exist=0.5837, loss=0.6963, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 784/1177 [38:36<16:51,  2.57s/it, exist=0.5834, loss=0.6961, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 785/1177 [38:36<16:50,  2.58s/it, exist=0.5834, loss=0.6961, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 785/1177 [38:39<16:50,  2.58s/it, exist=0.5832, loss=0.6960, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 786/1177 [38:39<18:14,  2.80s/it, exist=0.5832, loss=0.6960, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 786/1177 [38:43<18:14,  2.80s/it, exist=0.5832, loss=0.6961, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 787/1177 [38:43<20:31,  3.16s/it, exist=0.5832, loss=0.6961, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 787/1177 [38:45<20:31,  3.16s/it, exist=0.5831, loss=0.6960, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 788/1177 [38:45<19:19,  2.98s/it, exist=0.5831, loss=0.6960, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 788/1177 [38:48<19:19,  2.98s/it, exist=0.5828, loss=0.6956, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 789/1177 [38:48<19:11,  2.97s/it, exist=0.5828, loss=0.6956, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 789/1177 [38:52<19:11,  2.97s/it, exist=0.5826, loss=0.6954, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 790/1177 [38:52<19:53,  3.08s/it, exist=0.5826, loss=0.6954, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 790/1177 [38:55<19:53,  3.08s/it, exist=0.5822, loss=0.6951, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 791/1177 [38:55<20:39,  3.21s/it, exist=0.5822, loss=0.6951, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 791/1177 [38:58<20:39,  3.21s/it, exist=0.5822, loss=0.6952, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 792/1177 [38:58<19:51,  3.09s/it, exist=0.5822, loss=0.6952, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 792/1177 [39:00<19:51,  3.09s/it, exist=0.5821, loss=0.6951, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 793/1177 [39:00<17:43,  2.77s/it, exist=0.5821, loss=0.6951, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 793/1177 [39:03<17:43,  2.77s/it, exist=0.5821, loss=0.6951, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 794/1177 [39:03<18:55,  2.97s/it, exist=0.5821, loss=0.6951, lr=4.98e-05]
Epoch 1/5:  67%|██████▋   | 794/1177 [39:07<18:55,  2.97s/it, exist=0.5820, loss=0.6949, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 795/1177 [39:07<20:35,  3.23s/it, exist=0.5820, loss=0.6949, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 795/1177 [39:09<20:35,  3.23s/it, exist=0.5821, loss=0.6951, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 796/1177 [39:09<18:09,  2.86s/it, exist=0.5821, loss=0.6951, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 796/1177 [39:12<18:09,  2.86s/it, exist=0.5818, loss=0.6950, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 797/1177 [39:12<18:00,  2.84s/it, exist=0.5818, loss=0.6950, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 797/1177 [39:16<18:00,  2.84s/it, exist=0.5815, loss=0.6948, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 798/1177 [39:16<20:39,  3.27s/it, exist=0.5815, loss=0.6948, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 798/1177 [39:20<20:39,  3.27s/it, exist=0.5812, loss=0.6946, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 799/1177 [39:20<20:27,  3.25s/it, exist=0.5812, loss=0.6946, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 799/1177 [39:22<20:27,  3.25s/it, exist=0.5812, loss=0.6945, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 800/1177 [39:22<19:02,  3.03s/it, exist=0.5812, loss=0.6945, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 800/1177 [39:24<19:02,  3.03s/it, exist=0.5812, loss=0.6946, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 801/1177 [39:24<16:57,  2.71s/it, exist=0.5812, loss=0.6946, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 801/1177 [39:27<16:57,  2.71s/it, exist=0.5808, loss=0.6942, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 802/1177 [39:27<16:49,  2.69s/it, exist=0.5808, loss=0.6942, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 802/1177 [39:30<16:49,  2.69s/it, exist=0.5807, loss=0.6941, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 803/1177 [39:30<17:41,  2.84s/it, exist=0.5807, loss=0.6941, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 803/1177 [39:33<17:41,  2.84s/it, exist=0.5807, loss=0.6940, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 804/1177 [39:33<17:40,  2.84s/it, exist=0.5807, loss=0.6940, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 804/1177 [39:36<17:40,  2.84s/it, exist=0.5808, loss=0.6942, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 805/1177 [39:36<18:35,  3.00s/it, exist=0.5808, loss=0.6942, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 805/1177 [39:40<18:35,  3.00s/it, exist=0.5810, loss=0.6943, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 806/1177 [39:40<20:41,  3.35s/it, exist=0.5810, loss=0.6943, lr=4.98e-05]
Epoch 1/5:  68%|██████▊   | 806/1177 [39:44<20:41,  3.35s/it, exist=0.5811, loss=0.6944, lr=4.98e-05]
Epoch 1/5:  69%|██████▊   | 807/1177 [39:44<20:59,  3.40s/it, exist=0.5811, loss=0.6944, lr=4.98e-05]
Epoch 1/5:  69%|██████▊   | 807/1177 [39:46<20:59,  3.40s/it, exist=0.5808, loss=0.6942, lr=4.98e-05]
Epoch 1/5:  69%|██████▊   | 808/1177 [39:46<19:30,  3.17s/it, exist=0.5808, loss=0.6942, lr=4.98e-05]
Epoch 1/5:  69%|██████▊   | 808/1177 [39:49<19:30,  3.17s/it, exist=0.5809, loss=0.6943, lr=4.98e-05]
Epoch 1/5:  69%|██████▊   | 809/1177 [39:49<18:51,  3.07s/it, exist=0.5809, loss=0.6943, lr=4.98e-05]
Epoch 1/5:  69%|██████▊   | 809/1177 [39:53<18:51,  3.07s/it, exist=0.5809, loss=0.6945, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 810/1177 [39:53<20:43,  3.39s/it, exist=0.5809, loss=0.6945, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 810/1177 [39:56<20:43,  3.39s/it, exist=0.5806, loss=0.6943, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 811/1177 [39:56<20:04,  3.29s/it, exist=0.5806, loss=0.6943, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 811/1177 [39:59<20:04,  3.29s/it, exist=0.5805, loss=0.6941, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 812/1177 [39:59<18:28,  3.04s/it, exist=0.5805, loss=0.6941, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 812/1177 [40:01<18:28,  3.04s/it, exist=0.5803, loss=0.6939, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 813/1177 [40:01<17:10,  2.83s/it, exist=0.5803, loss=0.6939, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 813/1177 [40:04<17:10,  2.83s/it, exist=0.5802, loss=0.6938, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 814/1177 [40:04<17:40,  2.92s/it, exist=0.5802, loss=0.6938, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 814/1177 [40:08<17:40,  2.92s/it, exist=0.5802, loss=0.6941, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 815/1177 [40:08<19:28,  3.23s/it, exist=0.5802, loss=0.6941, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 815/1177 [40:11<19:28,  3.23s/it, exist=0.5799, loss=0.6937, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 816/1177 [40:11<18:06,  3.01s/it, exist=0.5799, loss=0.6937, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 816/1177 [40:14<18:06,  3.01s/it, exist=0.5798, loss=0.6937, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 817/1177 [40:14<17:26,  2.91s/it, exist=0.5798, loss=0.6937, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 817/1177 [40:16<17:26,  2.91s/it, exist=0.5795, loss=0.6935, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 818/1177 [40:16<17:30,  2.93s/it, exist=0.5795, loss=0.6935, lr=4.98e-05]
Epoch 1/5:  69%|██████▉   | 818/1177 [40:20<17:30,  2.93s/it, exist=0.5793, loss=0.6933, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 819/1177 [40:20<18:31,  3.10s/it, exist=0.5793, loss=0.6933, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 819/1177 [40:22<18:31,  3.10s/it, exist=0.5790, loss=0.6930, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 820/1177 [40:22<16:29,  2.77s/it, exist=0.5790, loss=0.6930, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 820/1177 [40:24<16:29,  2.77s/it, exist=0.5787, loss=0.6928, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 821/1177 [40:24<15:17,  2.58s/it, exist=0.5787, loss=0.6928, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 821/1177 [40:28<15:17,  2.58s/it, exist=0.5787, loss=0.6928, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 822/1177 [40:28<17:34,  2.97s/it, exist=0.5787, loss=0.6928, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 822/1177 [40:30<17:34,  2.97s/it, exist=0.5787, loss=0.6929, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 823/1177 [40:30<15:53,  2.69s/it, exist=0.5787, loss=0.6929, lr=4.98e-05]
Epoch 1/5:  70%|██████▉   | 823/1177 [40:33<15:53,  2.69s/it, exist=0.5790, loss=0.6932, lr=4.98e-05]
Epoch 1/5:  70%|███████   | 824/1177 [40:33<15:44,  2.67s/it, exist=0.5790, loss=0.6932, lr=4.98e-05]
Epoch 1/5:  70%|███████   | 824/1177 [40:35<15:44,  2.67s/it, exist=0.5790, loss=0.6932, lr=4.98e-05]
Epoch 1/5:  70%|███████   | 825/1177 [40:35<14:30,  2.47s/it, exist=0.5790, loss=0.6932, lr=4.98e-05]
Epoch 1/5:  70%|███████   | 825/1177 [40:38<14:30,  2.47s/it, exist=0.5789, loss=0.6932, lr=4.98e-05]
Epoch 1/5:  70%|███████   | 826/1177 [40:38<16:22,  2.80s/it, exist=0.5789, loss=0.6932, lr=4.98e-05]
Epoch 1/5:  70%|███████   | 826/1177 [40:41<16:22,  2.80s/it, exist=0.5789, loss=0.6932, lr=4.97e-05]
Epoch 1/5:  70%|███████   | 827/1177 [40:41<17:01,  2.92s/it, exist=0.5789, loss=0.6932, lr=4.97e-05]
Epoch 1/5:  70%|███████   | 827/1177 [40:43<17:01,  2.92s/it, exist=0.5788, loss=0.6932, lr=4.97e-05]
Epoch 1/5:  70%|███████   | 828/1177 [40:43<15:18,  2.63s/it, exist=0.5788, loss=0.6932, lr=4.97e-05]
Epoch 1/5:  70%|███████   | 828/1177 [40:46<15:18,  2.63s/it, exist=0.5786, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  70%|███████   | 829/1177 [40:46<15:45,  2.72s/it, exist=0.5786, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  70%|███████   | 829/1177 [40:49<15:45,  2.72s/it, exist=0.5786, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 830/1177 [40:49<16:20,  2.83s/it, exist=0.5786, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 830/1177 [40:53<16:20,  2.83s/it, exist=0.5786, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 831/1177 [40:53<17:27,  3.03s/it, exist=0.5786, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 831/1177 [40:57<17:27,  3.03s/it, exist=0.5785, loss=0.6933, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 832/1177 [40:57<18:40,  3.25s/it, exist=0.5785, loss=0.6933, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 832/1177 [41:00<18:40,  3.25s/it, exist=0.5782, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 833/1177 [41:00<18:09,  3.17s/it, exist=0.5782, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 833/1177 [41:04<18:09,  3.17s/it, exist=0.5782, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 834/1177 [41:04<19:30,  3.41s/it, exist=0.5782, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 834/1177 [41:07<19:30,  3.41s/it, exist=0.5780, loss=0.6928, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 835/1177 [41:07<19:01,  3.34s/it, exist=0.5780, loss=0.6928, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 835/1177 [41:10<19:01,  3.34s/it, exist=0.5780, loss=0.6927, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 836/1177 [41:10<19:01,  3.35s/it, exist=0.5780, loss=0.6927, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 836/1177 [41:13<19:01,  3.35s/it, exist=0.5783, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 837/1177 [41:13<18:14,  3.22s/it, exist=0.5783, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 837/1177 [41:16<18:14,  3.22s/it, exist=0.5785, loss=0.6933, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 838/1177 [41:16<17:38,  3.12s/it, exist=0.5785, loss=0.6933, lr=4.97e-05]
Epoch 1/5:  71%|███████   | 838/1177 [41:20<17:38,  3.12s/it, exist=0.5783, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████▏  | 839/1177 [41:20<19:31,  3.47s/it, exist=0.5783, loss=0.6930, lr=4.97e-05]
Epoch 1/5:  71%|███████▏  | 839/1177 [41:22<19:31,  3.47s/it, exist=0.5782, loss=0.6931, lr=4.97e-05]
Epoch 1/5:  71%|███████▏  | 840/1177 [41:22<17:12,  3.06s/it, exist=0.5782, loss=0.6931, lr=4.97e-05]
Epoch 1/5:  71%|███████▏  | 840/1177 [41:25<17:12,  3.06s/it, exist=0.5782, loss=0.6931, lr=4.97e-05]
Epoch 1/5:  71%|███████▏  | 841/1177 [41:25<16:25,  2.93s/it, exist=0.5782, loss=0.6931, lr=4.97e-05]
Epoch 1/5:  71%|███████▏  | 841/1177 [41:28<16:25,  2.93s/it, exist=0.5782, loss=0.6932, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 842/1177 [41:28<15:49,  2.83s/it, exist=0.5782, loss=0.6932, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 842/1177 [41:30<15:49,  2.83s/it, exist=0.5781, loss=0.6933, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 843/1177 [41:30<14:23,  2.58s/it, exist=0.5781, loss=0.6933, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 843/1177 [41:33<14:23,  2.58s/it, exist=0.5779, loss=0.6933, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 844/1177 [41:33<15:54,  2.87s/it, exist=0.5779, loss=0.6933, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 844/1177 [41:36<15:54,  2.87s/it, exist=0.5777, loss=0.6931, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 845/1177 [41:36<15:55,  2.88s/it, exist=0.5777, loss=0.6931, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 845/1177 [41:40<15:55,  2.88s/it, exist=0.5775, loss=0.6929, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 846/1177 [41:40<17:30,  3.17s/it, exist=0.5775, loss=0.6929, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 846/1177 [41:43<17:30,  3.17s/it, exist=0.5773, loss=0.6926, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 847/1177 [41:43<17:48,  3.24s/it, exist=0.5773, loss=0.6926, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 847/1177 [41:47<17:48,  3.24s/it, exist=0.5772, loss=0.6926, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 848/1177 [41:47<17:57,  3.28s/it, exist=0.5772, loss=0.6926, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 848/1177 [41:49<17:57,  3.28s/it, exist=0.5769, loss=0.6924, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 849/1177 [41:49<16:53,  3.09s/it, exist=0.5769, loss=0.6924, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 849/1177 [41:51<16:53,  3.09s/it, exist=0.5768, loss=0.6923, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 850/1177 [41:51<15:07,  2.77s/it, exist=0.5768, loss=0.6923, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 850/1177 [41:53<15:07,  2.77s/it, exist=0.5767, loss=0.6921, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 851/1177 [41:53<13:54,  2.56s/it, exist=0.5767, loss=0.6921, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 851/1177 [41:57<13:54,  2.56s/it, exist=0.5766, loss=0.6920, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 852/1177 [41:57<15:01,  2.78s/it, exist=0.5766, loss=0.6920, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 852/1177 [41:59<15:01,  2.78s/it, exist=0.5764, loss=0.6918, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 853/1177 [41:59<14:37,  2.71s/it, exist=0.5764, loss=0.6918, lr=4.97e-05]
Epoch 1/5:  72%|███████▏  | 853/1177 [42:02<14:37,  2.71s/it, exist=0.5760, loss=0.6914, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 854/1177 [42:02<14:55,  2.77s/it, exist=0.5760, loss=0.6914, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 854/1177 [42:06<14:55,  2.77s/it, exist=0.5759, loss=0.6913, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 855/1177 [42:06<16:25,  3.06s/it, exist=0.5759, loss=0.6913, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 855/1177 [42:09<16:25,  3.06s/it, exist=0.5758, loss=0.6913, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 856/1177 [42:09<16:26,  3.07s/it, exist=0.5758, loss=0.6913, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 856/1177 [42:11<16:26,  3.07s/it, exist=0.5757, loss=0.6912, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 857/1177 [42:11<15:27,  2.90s/it, exist=0.5757, loss=0.6912, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 857/1177 [42:14<15:27,  2.90s/it, exist=0.5755, loss=0.6910, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 858/1177 [42:14<15:26,  2.90s/it, exist=0.5755, loss=0.6910, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 858/1177 [42:18<15:26,  2.90s/it, exist=0.5756, loss=0.6912, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 859/1177 [42:18<16:37,  3.14s/it, exist=0.5756, loss=0.6912, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 859/1177 [42:22<16:37,  3.14s/it, exist=0.5755, loss=0.6911, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 860/1177 [42:22<17:34,  3.33s/it, exist=0.5755, loss=0.6911, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 860/1177 [42:24<17:34,  3.33s/it, exist=0.5753, loss=0.6910, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 861/1177 [42:24<15:29,  2.94s/it, exist=0.5753, loss=0.6910, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 861/1177 [42:28<15:29,  2.94s/it, exist=0.5756, loss=0.6914, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 862/1177 [42:28<18:03,  3.44s/it, exist=0.5756, loss=0.6914, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 862/1177 [42:32<18:03,  3.44s/it, exist=0.5754, loss=0.6912, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 863/1177 [42:32<17:57,  3.43s/it, exist=0.5754, loss=0.6912, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 863/1177 [42:34<17:57,  3.43s/it, exist=0.5755, loss=0.6913, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 864/1177 [42:34<16:34,  3.18s/it, exist=0.5755, loss=0.6913, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 864/1177 [42:37<16:34,  3.18s/it, exist=0.5753, loss=0.6911, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 865/1177 [42:37<15:34,  3.00s/it, exist=0.5753, loss=0.6911, lr=4.97e-05]
Epoch 1/5:  73%|███████▎  | 865/1177 [42:40<15:34,  3.00s/it, exist=0.5754, loss=0.6913, lr=4.97e-05]
Epoch 1/5:  74%|███████▎  | 866/1177 [42:40<14:51,  2.87s/it, exist=0.5754, loss=0.6913, lr=4.97e-05]
Epoch 1/5:  74%|███████▎  | 866/1177 [42:42<14:51,  2.87s/it, exist=0.5752, loss=0.6911, lr=4.97e-05]
Epoch 1/5:  74%|███████▎  | 867/1177 [42:42<14:28,  2.80s/it, exist=0.5752, loss=0.6911, lr=4.97e-05]
Epoch 1/5:  74%|███████▎  | 867/1177 [42:44<14:28,  2.80s/it, exist=0.5750, loss=0.6909, lr=4.97e-05]
Epoch 1/5:  74%|███████▎  | 868/1177 [42:44<13:12,  2.56s/it, exist=0.5750, loss=0.6909, lr=4.97e-05]
Epoch 1/5:  74%|███████▎  | 868/1177 [42:48<13:12,  2.56s/it, exist=0.5747, loss=0.6906, lr=4.97e-05]
Epoch 1/5:  74%|███████▍  | 869/1177 [42:48<14:12,  2.77s/it, exist=0.5747, loss=0.6906, lr=4.97e-05]
Epoch 1/5:  74%|███████▍  | 869/1177 [42:50<14:12,  2.77s/it, exist=0.5748, loss=0.6907, lr=4.97e-05]
Epoch 1/5:  74%|███████▍  | 870/1177 [42:50<12:59,  2.54s/it, exist=0.5748, loss=0.6907, lr=4.97e-05]
Epoch 1/5:  74%|███████▍  | 870/1177 [42:53<12:59,  2.54s/it, exist=0.5747, loss=0.6907, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 871/1177 [42:53<14:12,  2.79s/it, exist=0.5747, loss=0.6907, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 871/1177 [42:55<14:12,  2.79s/it, exist=0.5744, loss=0.6904, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 872/1177 [42:55<13:44,  2.70s/it, exist=0.5744, loss=0.6904, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 872/1177 [42:57<13:44,  2.70s/it, exist=0.5747, loss=0.6906, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 873/1177 [42:57<12:40,  2.50s/it, exist=0.5747, loss=0.6906, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 873/1177 [43:01<12:40,  2.50s/it, exist=0.5744, loss=0.6904, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 874/1177 [43:01<13:51,  2.74s/it, exist=0.5744, loss=0.6904, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 874/1177 [43:03<13:51,  2.74s/it, exist=0.5743, loss=0.6903, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 875/1177 [43:03<13:12,  2.62s/it, exist=0.5743, loss=0.6903, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 875/1177 [43:05<13:12,  2.62s/it, exist=0.5742, loss=0.6905, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 876/1177 [43:05<12:49,  2.56s/it, exist=0.5742, loss=0.6905, lr=4.96e-05]
Epoch 1/5:  74%|███████▍  | 876/1177 [43:08<12:49,  2.56s/it, exist=0.5745, loss=0.6908, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 877/1177 [43:08<12:49,  2.56s/it, exist=0.5745, loss=0.6908, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 877/1177 [43:13<12:49,  2.56s/it, exist=0.5745, loss=0.6908, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 878/1177 [43:13<16:02,  3.22s/it, exist=0.5745, loss=0.6908, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 878/1177 [43:16<16:02,  3.22s/it, exist=0.5745, loss=0.6908, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 879/1177 [43:16<15:49,  3.19s/it, exist=0.5745, loss=0.6908, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 879/1177 [43:18<15:49,  3.19s/it, exist=0.5745, loss=0.6908, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 880/1177 [43:18<14:47,  2.99s/it, exist=0.5745, loss=0.6908, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 880/1177 [43:21<14:47,  2.99s/it, exist=0.5743, loss=0.6905, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 881/1177 [43:21<13:44,  2.78s/it, exist=0.5743, loss=0.6905, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 881/1177 [43:24<13:44,  2.78s/it, exist=0.5741, loss=0.6903, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 882/1177 [43:24<14:28,  2.94s/it, exist=0.5741, loss=0.6903, lr=4.96e-05]
Epoch 1/5:  75%|███████▍  | 882/1177 [43:28<14:28,  2.94s/it, exist=0.5737, loss=0.6899, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 883/1177 [43:28<15:23,  3.14s/it, exist=0.5737, loss=0.6899, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 883/1177 [43:30<15:23,  3.14s/it, exist=0.5737, loss=0.6900, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 884/1177 [43:30<14:10,  2.90s/it, exist=0.5737, loss=0.6900, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 884/1177 [43:32<14:10,  2.90s/it, exist=0.5736, loss=0.6898, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 885/1177 [43:32<12:49,  2.64s/it, exist=0.5736, loss=0.6898, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 885/1177 [43:35<12:49,  2.64s/it, exist=0.5736, loss=0.6898, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 886/1177 [43:35<12:47,  2.64s/it, exist=0.5736, loss=0.6898, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 886/1177 [43:37<12:47,  2.64s/it, exist=0.5737, loss=0.6900, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 887/1177 [43:37<12:28,  2.58s/it, exist=0.5737, loss=0.6900, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 887/1177 [43:40<12:28,  2.58s/it, exist=0.5736, loss=0.6899, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 888/1177 [43:40<12:16,  2.55s/it, exist=0.5736, loss=0.6899, lr=4.96e-05]
Epoch 1/5:  75%|███████▌  | 888/1177 [43:42<12:16,  2.55s/it, exist=0.5734, loss=0.6897, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 889/1177 [43:42<12:07,  2.53s/it, exist=0.5734, loss=0.6897, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 889/1177 [43:45<12:07,  2.53s/it, exist=0.5735, loss=0.6899, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 890/1177 [43:45<12:39,  2.64s/it, exist=0.5735, loss=0.6899, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 890/1177 [43:48<12:39,  2.64s/it, exist=0.5733, loss=0.6898, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 891/1177 [43:48<13:39,  2.86s/it, exist=0.5733, loss=0.6898, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 891/1177 [43:51<13:39,  2.86s/it, exist=0.5734, loss=0.6899, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 892/1177 [43:51<13:07,  2.76s/it, exist=0.5734, loss=0.6899, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 892/1177 [43:53<13:07,  2.76s/it, exist=0.5732, loss=0.6896, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 893/1177 [43:53<12:01,  2.54s/it, exist=0.5732, loss=0.6896, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 893/1177 [43:55<12:01,  2.54s/it, exist=0.5731, loss=0.6894, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 894/1177 [43:55<11:18,  2.40s/it, exist=0.5731, loss=0.6894, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 894/1177 [43:58<11:18,  2.40s/it, exist=0.5729, loss=0.6893, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 895/1177 [43:58<12:26,  2.65s/it, exist=0.5729, loss=0.6893, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 895/1177 [44:01<12:26,  2.65s/it, exist=0.5733, loss=0.6896, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 896/1177 [44:01<12:17,  2.62s/it, exist=0.5733, loss=0.6896, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 896/1177 [44:03<12:17,  2.62s/it, exist=0.5731, loss=0.6894, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 897/1177 [44:03<11:30,  2.47s/it, exist=0.5731, loss=0.6894, lr=4.96e-05]
Epoch 1/5:  76%|███████▌  | 897/1177 [44:07<11:30,  2.47s/it, exist=0.5730, loss=0.6893, lr=4.96e-05]
Epoch 1/5:  76%|███████▋  | 898/1177 [44:07<13:35,  2.92s/it, exist=0.5730, loss=0.6893, lr=4.96e-05]
Epoch 1/5:  76%|███████▋  | 898/1177 [44:10<13:35,  2.92s/it, exist=0.5730, loss=0.6894, lr=4.96e-05]
Epoch 1/5:  76%|███████▋  | 899/1177 [44:10<14:15,  3.08s/it, exist=0.5730, loss=0.6894, lr=4.96e-05]
Epoch 1/5:  76%|███████▋  | 899/1177 [44:13<14:15,  3.08s/it, exist=0.5729, loss=0.6892, lr=4.96e-05]
Epoch 1/5:  76%|███████▋  | 900/1177 [44:13<13:26,  2.91s/it, exist=0.5729, loss=0.6892, lr=4.96e-05]
Epoch 1/5:  76%|███████▋  | 900/1177 [44:16<13:26,  2.91s/it, exist=0.5727, loss=0.6892, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 901/1177 [44:16<13:12,  2.87s/it, exist=0.5727, loss=0.6892, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 901/1177 [44:19<13:12,  2.87s/it, exist=0.5727, loss=0.6892, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 902/1177 [44:19<13:17,  2.90s/it, exist=0.5727, loss=0.6892, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 902/1177 [44:22<13:17,  2.90s/it, exist=0.5727, loss=0.6893, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 903/1177 [44:22<13:49,  3.03s/it, exist=0.5727, loss=0.6893, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 903/1177 [44:24<13:49,  3.03s/it, exist=0.5726, loss=0.6892, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 904/1177 [44:24<12:57,  2.85s/it, exist=0.5726, loss=0.6892, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 904/1177 [44:26<12:57,  2.85s/it, exist=0.5724, loss=0.6890, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 905/1177 [44:26<11:49,  2.61s/it, exist=0.5724, loss=0.6890, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 905/1177 [44:29<11:49,  2.61s/it, exist=0.5723, loss=0.6889, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 906/1177 [44:29<11:46,  2.61s/it, exist=0.5723, loss=0.6889, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 906/1177 [44:31<11:46,  2.61s/it, exist=0.5721, loss=0.6887, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 907/1177 [44:31<11:31,  2.56s/it, exist=0.5721, loss=0.6887, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 907/1177 [44:34<11:31,  2.56s/it, exist=0.5720, loss=0.6887, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 908/1177 [44:34<11:30,  2.57s/it, exist=0.5720, loss=0.6887, lr=4.96e-05]
Epoch 1/5:  77%|███████▋  | 908/1177 [44:37<11:30,  2.57s/it, exist=0.5719, loss=0.6888, lr=4.95e-05]
Epoch 1/5:  77%|███████▋  | 909/1177 [44:37<11:39,  2.61s/it, exist=0.5719, loss=0.6888, lr=4.95e-05]
Epoch 1/5:  77%|███████▋  | 909/1177 [44:39<11:39,  2.61s/it, exist=0.5720, loss=0.6888, lr=4.95e-05]
Epoch 1/5:  77%|███████▋  | 910/1177 [44:39<11:39,  2.62s/it, exist=0.5720, loss=0.6888, lr=4.95e-05]
Epoch 1/5:  77%|███████▋  | 910/1177 [44:42<11:39,  2.62s/it, exist=0.5718, loss=0.6886, lr=4.95e-05]
Epoch 1/5:  77%|███████▋  | 911/1177 [44:42<11:33,  2.61s/it, exist=0.5718, loss=0.6886, lr=4.95e-05]
Epoch 1/5:  77%|███████▋  | 911/1177 [44:45<11:33,  2.61s/it, exist=0.5718, loss=0.6886, lr=4.95e-05]
Epoch 1/5:  77%|███████▋  | 912/1177 [44:45<12:05,  2.74s/it, exist=0.5718, loss=0.6886, lr=4.95e-05]
Epoch 1/5:  77%|███████▋  | 912/1177 [44:47<12:05,  2.74s/it, exist=0.5716, loss=0.6884, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 913/1177 [44:47<11:02,  2.51s/it, exist=0.5716, loss=0.6884, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 913/1177 [44:49<11:02,  2.51s/it, exist=0.5713, loss=0.6881, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 914/1177 [44:49<10:30,  2.40s/it, exist=0.5713, loss=0.6881, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 914/1177 [44:52<10:30,  2.40s/it, exist=0.5711, loss=0.6881, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 915/1177 [44:52<11:35,  2.65s/it, exist=0.5711, loss=0.6881, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 915/1177 [44:55<11:35,  2.65s/it, exist=0.5710, loss=0.6880, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 916/1177 [44:55<10:52,  2.50s/it, exist=0.5710, loss=0.6880, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 916/1177 [44:58<10:52,  2.50s/it, exist=0.5710, loss=0.6880, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 917/1177 [44:58<12:33,  2.90s/it, exist=0.5710, loss=0.6880, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 917/1177 [45:01<12:33,  2.90s/it, exist=0.5710, loss=0.6880, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 918/1177 [45:01<12:33,  2.91s/it, exist=0.5710, loss=0.6880, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 918/1177 [45:04<12:33,  2.91s/it, exist=0.5711, loss=0.6880, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 919/1177 [45:04<12:02,  2.80s/it, exist=0.5711, loss=0.6880, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 919/1177 [45:06<12:02,  2.80s/it, exist=0.5710, loss=0.6882, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 920/1177 [45:06<10:56,  2.55s/it, exist=0.5710, loss=0.6882, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 920/1177 [45:08<10:56,  2.55s/it, exist=0.5707, loss=0.6879, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 921/1177 [45:08<11:00,  2.58s/it, exist=0.5707, loss=0.6879, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 921/1177 [45:10<11:00,  2.58s/it, exist=0.5706, loss=0.6879, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 922/1177 [45:10<10:16,  2.42s/it, exist=0.5706, loss=0.6879, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 922/1177 [45:13<10:16,  2.42s/it, exist=0.5706, loss=0.6878, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 923/1177 [45:13<10:58,  2.59s/it, exist=0.5706, loss=0.6878, lr=4.95e-05]
Epoch 1/5:  78%|███████▊  | 923/1177 [45:16<10:58,  2.59s/it, exist=0.5704, loss=0.6877, lr=4.95e-05]
Epoch 1/5:  79%|███████▊  | 924/1177 [45:16<10:57,  2.60s/it, exist=0.5704, loss=0.6877, lr=4.95e-05]
Epoch 1/5:  79%|███████▊  | 924/1177 [45:19<10:57,  2.60s/it, exist=0.5705, loss=0.6877, lr=4.95e-05]
Epoch 1/5:  79%|███████▊  | 925/1177 [45:19<10:53,  2.59s/it, exist=0.5705, loss=0.6877, lr=4.95e-05]
Epoch 1/5:  79%|███████▊  | 925/1177 [45:21<10:53,  2.59s/it, exist=0.5704, loss=0.6877, lr=4.95e-05]
Epoch 1/5:  79%|███████▊  | 926/1177 [45:21<10:49,  2.59s/it, exist=0.5704, loss=0.6877, lr=4.95e-05]
Epoch 1/5:  79%|███████▊  | 926/1177 [45:25<10:49,  2.59s/it, exist=0.5701, loss=0.6875, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 927/1177 [45:25<12:10,  2.92s/it, exist=0.5701, loss=0.6875, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 927/1177 [45:28<12:10,  2.92s/it, exist=0.5699, loss=0.6874, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 928/1177 [45:28<12:01,  2.90s/it, exist=0.5699, loss=0.6874, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 928/1177 [45:31<12:01,  2.90s/it, exist=0.5698, loss=0.6873, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 929/1177 [45:31<12:09,  2.94s/it, exist=0.5698, loss=0.6873, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 929/1177 [45:35<12:09,  2.94s/it, exist=0.5695, loss=0.6870, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 930/1177 [45:35<13:10,  3.20s/it, exist=0.5695, loss=0.6870, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 930/1177 [45:38<13:10,  3.20s/it, exist=0.5694, loss=0.6869, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 931/1177 [45:38<12:50,  3.13s/it, exist=0.5694, loss=0.6869, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 931/1177 [45:40<12:50,  3.13s/it, exist=0.5693, loss=0.6869, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 932/1177 [45:40<12:07,  2.97s/it, exist=0.5693, loss=0.6869, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 932/1177 [45:42<12:07,  2.97s/it, exist=0.5693, loss=0.6869, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 933/1177 [45:42<10:54,  2.68s/it, exist=0.5693, loss=0.6869, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 933/1177 [45:45<10:54,  2.68s/it, exist=0.5689, loss=0.6865, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 934/1177 [45:45<11:10,  2.76s/it, exist=0.5689, loss=0.6865, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 934/1177 [45:49<11:10,  2.76s/it, exist=0.5687, loss=0.6863, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 935/1177 [45:49<12:26,  3.09s/it, exist=0.5687, loss=0.6863, lr=4.95e-05]
Epoch 1/5:  79%|███████▉  | 935/1177 [45:52<12:26,  3.09s/it, exist=0.5687, loss=0.6867, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 936/1177 [45:52<11:49,  2.94s/it, exist=0.5687, loss=0.6867, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 936/1177 [45:54<11:49,  2.94s/it, exist=0.5685, loss=0.6865, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 937/1177 [45:54<11:22,  2.84s/it, exist=0.5685, loss=0.6865, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 937/1177 [45:57<11:22,  2.84s/it, exist=0.5683, loss=0.6863, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 938/1177 [45:57<10:56,  2.75s/it, exist=0.5683, loss=0.6863, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 938/1177 [45:59<10:56,  2.75s/it, exist=0.5681, loss=0.6861, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 939/1177 [45:59<10:36,  2.67s/it, exist=0.5681, loss=0.6861, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 939/1177 [46:02<10:36,  2.67s/it, exist=0.5678, loss=0.6859, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 940/1177 [46:02<10:29,  2.66s/it, exist=0.5678, loss=0.6859, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 940/1177 [46:05<10:29,  2.66s/it, exist=0.5679, loss=0.6860, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 941/1177 [46:05<10:26,  2.65s/it, exist=0.5679, loss=0.6860, lr=4.95e-05]
Epoch 1/5:  80%|███████▉  | 941/1177 [46:07<10:26,  2.65s/it, exist=0.5677, loss=0.6858, lr=4.95e-05]
Epoch 1/5:  80%|████████  | 942/1177 [46:07<10:25,  2.66s/it, exist=0.5677, loss=0.6858, lr=4.95e-05]
Epoch 1/5:  80%|████████  | 942/1177 [46:10<10:25,  2.66s/it, exist=0.5677, loss=0.6860, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 943/1177 [46:10<10:11,  2.61s/it, exist=0.5677, loss=0.6860, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 943/1177 [46:13<10:11,  2.61s/it, exist=0.5679, loss=0.6864, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 944/1177 [46:13<10:26,  2.69s/it, exist=0.5679, loss=0.6864, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 944/1177 [46:15<10:26,  2.69s/it, exist=0.5677, loss=0.6862, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 945/1177 [46:15<09:38,  2.49s/it, exist=0.5677, loss=0.6862, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 945/1177 [46:19<09:38,  2.49s/it, exist=0.5676, loss=0.6861, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 946/1177 [46:19<11:24,  2.96s/it, exist=0.5676, loss=0.6861, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 946/1177 [46:21<11:24,  2.96s/it, exist=0.5673, loss=0.6858, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 947/1177 [46:21<10:18,  2.69s/it, exist=0.5673, loss=0.6858, lr=4.94e-05]
Epoch 1/5:  80%|████████  | 947/1177 [46:23<10:18,  2.69s/it, exist=0.5671, loss=0.6855, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 948/1177 [46:23<09:28,  2.48s/it, exist=0.5671, loss=0.6855, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 948/1177 [46:25<09:28,  2.48s/it, exist=0.5667, loss=0.6852, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 949/1177 [46:25<09:34,  2.52s/it, exist=0.5667, loss=0.6852, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 949/1177 [46:29<09:34,  2.52s/it, exist=0.5666, loss=0.6851, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 950/1177 [46:29<10:18,  2.73s/it, exist=0.5666, loss=0.6851, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 950/1177 [46:31<10:18,  2.73s/it, exist=0.5665, loss=0.6850, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 951/1177 [46:31<09:54,  2.63s/it, exist=0.5665, loss=0.6850, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 951/1177 [46:34<09:54,  2.63s/it, exist=0.5663, loss=0.6849, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 952/1177 [46:34<10:35,  2.82s/it, exist=0.5663, loss=0.6849, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 952/1177 [46:37<10:35,  2.82s/it, exist=0.5663, loss=0.6849, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 953/1177 [46:37<10:15,  2.75s/it, exist=0.5663, loss=0.6849, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 953/1177 [46:40<10:15,  2.75s/it, exist=0.5661, loss=0.6848, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 954/1177 [46:40<10:21,  2.79s/it, exist=0.5661, loss=0.6848, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 954/1177 [46:43<10:21,  2.79s/it, exist=0.5662, loss=0.6849, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 955/1177 [46:43<11:04,  2.99s/it, exist=0.5662, loss=0.6849, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 955/1177 [46:46<11:04,  2.99s/it, exist=0.5659, loss=0.6846, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 956/1177 [46:46<10:34,  2.87s/it, exist=0.5659, loss=0.6846, lr=4.94e-05]
Epoch 1/5:  81%|████████  | 956/1177 [46:48<10:34,  2.87s/it, exist=0.5658, loss=0.6847, lr=4.94e-05]
Epoch 1/5:  81%|████████▏ | 957/1177 [46:48<09:33,  2.61s/it, exist=0.5658, loss=0.6847, lr=4.94e-05]
Epoch 1/5:  81%|████████▏ | 957/1177 [46:51<09:33,  2.61s/it, exist=0.5655, loss=0.6844, lr=4.94e-05]
Epoch 1/5:  81%|████████▏ | 958/1177 [46:51<10:40,  2.93s/it, exist=0.5655, loss=0.6844, lr=4.94e-05]
Epoch 1/5:  81%|████████▏ | 958/1177 [46:55<10:40,  2.93s/it, exist=0.5653, loss=0.6842, lr=4.94e-05]
Epoch 1/5:  81%|████████▏ | 959/1177 [46:55<10:58,  3.02s/it, exist=0.5653, loss=0.6842, lr=4.94e-05]
Epoch 1/5:  81%|████████▏ | 959/1177 [46:57<10:58,  3.02s/it, exist=0.5650, loss=0.6839, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 960/1177 [46:57<10:34,  2.92s/it, exist=0.5650, loss=0.6839, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 960/1177 [46:59<10:34,  2.92s/it, exist=0.5649, loss=0.6839, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 961/1177 [46:59<09:32,  2.65s/it, exist=0.5649, loss=0.6839, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 961/1177 [47:01<09:32,  2.65s/it, exist=0.5647, loss=0.6837, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 962/1177 [47:01<08:52,  2.48s/it, exist=0.5647, loss=0.6837, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 962/1177 [47:05<08:52,  2.48s/it, exist=0.5646, loss=0.6836, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 963/1177 [47:05<09:40,  2.71s/it, exist=0.5646, loss=0.6836, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 963/1177 [47:07<09:40,  2.71s/it, exist=0.5648, loss=0.6838, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 964/1177 [47:07<08:47,  2.48s/it, exist=0.5648, loss=0.6838, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 964/1177 [47:10<08:47,  2.48s/it, exist=0.5647, loss=0.6838, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 965/1177 [47:10<09:24,  2.66s/it, exist=0.5647, loss=0.6838, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 965/1177 [47:12<09:24,  2.66s/it, exist=0.5643, loss=0.6835, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 966/1177 [47:12<09:21,  2.66s/it, exist=0.5643, loss=0.6835, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 966/1177 [47:15<09:21,  2.66s/it, exist=0.5643, loss=0.6835, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 967/1177 [47:15<09:09,  2.62s/it, exist=0.5643, loss=0.6835, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 967/1177 [47:17<09:09,  2.62s/it, exist=0.5644, loss=0.6835, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 968/1177 [47:17<09:03,  2.60s/it, exist=0.5644, loss=0.6835, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 968/1177 [47:20<09:03,  2.60s/it, exist=0.5643, loss=0.6834, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 969/1177 [47:20<09:04,  2.62s/it, exist=0.5643, loss=0.6834, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 969/1177 [47:22<09:04,  2.62s/it, exist=0.5642, loss=0.6834, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 970/1177 [47:22<08:26,  2.44s/it, exist=0.5642, loss=0.6834, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 970/1177 [47:24<08:26,  2.44s/it, exist=0.5639, loss=0.6832, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 971/1177 [47:24<08:00,  2.33s/it, exist=0.5639, loss=0.6832, lr=4.94e-05]
Epoch 1/5:  82%|████████▏ | 971/1177 [47:29<08:00,  2.33s/it, exist=0.5636, loss=0.6830, lr=4.94e-05]
Epoch 1/5:  83%|████████▎ | 972/1177 [47:29<10:29,  3.07s/it, exist=0.5636, loss=0.6830, lr=4.94e-05]
Epoch 1/5:  83%|████████▎ | 972/1177 [47:32<10:29,  3.07s/it, exist=0.5637, loss=0.6831, lr=4.94e-05]
Epoch 1/5:  83%|████████▎ | 973/1177 [47:32<09:58,  2.93s/it, exist=0.5637, loss=0.6831, lr=4.94e-05]
Epoch 1/5:  83%|████████▎ | 973/1177 [47:35<09:58,  2.93s/it, exist=0.5636, loss=0.6829, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 974/1177 [47:35<10:39,  3.15s/it, exist=0.5636, loss=0.6829, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 974/1177 [47:38<10:39,  3.15s/it, exist=0.5634, loss=0.6827, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 975/1177 [47:38<10:38,  3.16s/it, exist=0.5634, loss=0.6827, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 975/1177 [47:41<10:38,  3.16s/it, exist=0.5632, loss=0.6826, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 976/1177 [47:41<10:00,  2.99s/it, exist=0.5632, loss=0.6826, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 976/1177 [47:43<10:00,  2.99s/it, exist=0.5630, loss=0.6824, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 977/1177 [47:43<09:14,  2.77s/it, exist=0.5630, loss=0.6824, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 977/1177 [47:47<09:14,  2.77s/it, exist=0.5629, loss=0.6823, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 978/1177 [47:47<09:42,  2.93s/it, exist=0.5629, loss=0.6823, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 978/1177 [47:50<09:42,  2.93s/it, exist=0.5628, loss=0.6822, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 979/1177 [47:50<09:55,  3.01s/it, exist=0.5628, loss=0.6822, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 979/1177 [47:52<09:55,  3.01s/it, exist=0.5628, loss=0.6822, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 980/1177 [47:52<09:25,  2.87s/it, exist=0.5628, loss=0.6822, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 980/1177 [47:55<09:25,  2.87s/it, exist=0.5627, loss=0.6824, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 981/1177 [47:55<09:02,  2.77s/it, exist=0.5627, loss=0.6824, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 981/1177 [47:58<09:02,  2.77s/it, exist=0.5626, loss=0.6825, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 982/1177 [47:58<09:25,  2.90s/it, exist=0.5626, loss=0.6825, lr=4.93e-05]
Epoch 1/5:  83%|████████▎ | 982/1177 [48:02<09:25,  2.90s/it, exist=0.5626, loss=0.6825, lr=4.93e-05]
Epoch 1/5:  84%|████████▎ | 983/1177 [48:02<10:11,  3.15s/it, exist=0.5626, loss=0.6825, lr=4.93e-05]
Epoch 1/5:  84%|████████▎ | 983/1177 [48:04<10:11,  3.15s/it, exist=0.5626, loss=0.6825, lr=4.93e-05]
Epoch 1/5:  84%|████████▎ | 984/1177 [48:04<09:01,  2.81s/it, exist=0.5626, loss=0.6825, lr=4.93e-05]
Epoch 1/5:  84%|████████▎ | 984/1177 [48:06<09:01,  2.81s/it, exist=0.5624, loss=0.6824, lr=4.93e-05]
Epoch 1/5:  84%|████████▎ | 985/1177 [48:06<08:44,  2.73s/it, exist=0.5624, loss=0.6824, lr=4.93e-05]
Epoch 1/5:  84%|████████▎ | 985/1177 [48:09<08:44,  2.73s/it, exist=0.5621, loss=0.6822, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 986/1177 [48:09<08:40,  2.73s/it, exist=0.5621, loss=0.6822, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 986/1177 [48:11<08:40,  2.73s/it, exist=0.5620, loss=0.6821, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 987/1177 [48:11<08:19,  2.63s/it, exist=0.5620, loss=0.6821, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 987/1177 [48:14<08:19,  2.63s/it, exist=0.5618, loss=0.6819, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 988/1177 [48:14<08:16,  2.63s/it, exist=0.5618, loss=0.6819, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 988/1177 [48:17<08:16,  2.63s/it, exist=0.5614, loss=0.6815, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 989/1177 [48:17<08:17,  2.64s/it, exist=0.5614, loss=0.6815, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 989/1177 [48:20<08:17,  2.64s/it, exist=0.5612, loss=0.6814, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 990/1177 [48:20<08:45,  2.81s/it, exist=0.5612, loss=0.6814, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 990/1177 [48:22<08:45,  2.81s/it, exist=0.5613, loss=0.6814, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 991/1177 [48:22<07:56,  2.56s/it, exist=0.5613, loss=0.6814, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 991/1177 [48:25<07:56,  2.56s/it, exist=0.5611, loss=0.6812, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 992/1177 [48:25<07:59,  2.59s/it, exist=0.5611, loss=0.6812, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 992/1177 [48:27<07:59,  2.59s/it, exist=0.5609, loss=0.6810, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 993/1177 [48:27<07:54,  2.58s/it, exist=0.5609, loss=0.6810, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 993/1177 [48:29<07:54,  2.58s/it, exist=0.5613, loss=0.6815, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 994/1177 [48:29<07:18,  2.40s/it, exist=0.5613, loss=0.6815, lr=4.93e-05]
Epoch 1/5:  84%|████████▍ | 994/1177 [48:32<07:18,  2.40s/it, exist=0.5612, loss=0.6815, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 995/1177 [48:32<07:16,  2.40s/it, exist=0.5612, loss=0.6815, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 995/1177 [48:35<07:16,  2.40s/it, exist=0.5610, loss=0.6813, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 996/1177 [48:35<07:57,  2.64s/it, exist=0.5610, loss=0.6813, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 996/1177 [48:38<07:57,  2.64s/it, exist=0.5608, loss=0.6811, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 997/1177 [48:38<08:12,  2.74s/it, exist=0.5608, loss=0.6811, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 997/1177 [48:40<08:12,  2.74s/it, exist=0.5608, loss=0.6811, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 998/1177 [48:40<07:31,  2.52s/it, exist=0.5608, loss=0.6811, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 998/1177 [48:44<07:31,  2.52s/it, exist=0.5607, loss=0.6811, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 999/1177 [48:44<08:42,  2.93s/it, exist=0.5607, loss=0.6811, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 999/1177 [48:46<08:42,  2.93s/it, exist=0.5605, loss=0.6809, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 1000/1177 [48:46<07:48,  2.65s/it, exist=0.5605, loss=0.6809, lr=4.93e-05]
Epoch 1/5:  85%|████████▍ | 1000/1177 [48:49<07:48,  2.65s/it, exist=0.5602, loss=0.6806, lr=4.93e-05]
Epoch 1/5:  85%|████████▌ | 1001/1177 [48:49<08:24,  2.86s/it, exist=0.5602, loss=0.6806, lr=4.93e-05]
Epoch 1/5:  85%|████████▌ | 1001/1177 [48:52<08:24,  2.86s/it, exist=0.5601, loss=0.6804, lr=4.93e-05]
Epoch 1/5:  85%|████████▌ | 1002/1177 [48:52<08:27,  2.90s/it, exist=0.5601, loss=0.6804, lr=4.93e-05]
Epoch 1/5:  85%|████████▌ | 1002/1177 [48:55<08:27,  2.90s/it, exist=0.5601, loss=0.6805, lr=4.92e-05]
Epoch 1/5:  85%|████████▌ | 1003/1177 [48:55<08:56,  3.08s/it, exist=0.5601, loss=0.6805, lr=4.92e-05]
Epoch 1/5:  85%|████████▌ | 1003/1177 [48:57<08:56,  3.08s/it, exist=0.5600, loss=0.6805, lr=4.92e-05]
Epoch 1/5:  85%|████████▌ | 1004/1177 [48:57<07:56,  2.76s/it, exist=0.5600, loss=0.6805, lr=4.92e-05]
Epoch 1/5:  85%|████████▌ | 1004/1177 [49:01<07:56,  2.76s/it, exist=0.5602, loss=0.6808, lr=4.92e-05]
Epoch 1/5:  85%|████████▌ | 1005/1177 [49:01<08:21,  2.92s/it, exist=0.5602, loss=0.6808, lr=4.92e-05]
Epoch 1/5:  85%|████████▌ | 1005/1177 [49:03<08:21,  2.92s/it, exist=0.5601, loss=0.6806, lr=4.92e-05]
Epoch 1/5:  85%|████████▌ | 1006/1177 [49:03<07:32,  2.65s/it, exist=0.5601, loss=0.6806, lr=4.92e-05]
Epoch 1/5:  85%|████████▌ | 1006/1177 [49:06<07:32,  2.65s/it, exist=0.5598, loss=0.6805, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1007/1177 [49:06<08:09,  2.88s/it, exist=0.5598, loss=0.6805, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1007/1177 [49:09<08:09,  2.88s/it, exist=0.5596, loss=0.6803, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1008/1177 [49:09<07:52,  2.80s/it, exist=0.5596, loss=0.6803, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1008/1177 [49:11<07:52,  2.80s/it, exist=0.5595, loss=0.6806, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1009/1177 [49:11<07:40,  2.74s/it, exist=0.5595, loss=0.6806, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1009/1177 [49:15<07:40,  2.74s/it, exist=0.5595, loss=0.6807, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1010/1177 [49:15<07:55,  2.85s/it, exist=0.5595, loss=0.6807, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1010/1177 [49:17<07:55,  2.85s/it, exist=0.5593, loss=0.6805, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1011/1177 [49:17<07:11,  2.60s/it, exist=0.5593, loss=0.6805, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1011/1177 [49:19<07:11,  2.60s/it, exist=0.5591, loss=0.6804, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1012/1177 [49:19<07:07,  2.59s/it, exist=0.5591, loss=0.6804, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1012/1177 [49:21<07:07,  2.59s/it, exist=0.5590, loss=0.6803, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1013/1177 [49:21<06:40,  2.44s/it, exist=0.5590, loss=0.6803, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1013/1177 [49:23<06:40,  2.44s/it, exist=0.5589, loss=0.6803, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1014/1177 [49:23<06:19,  2.33s/it, exist=0.5589, loss=0.6803, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1014/1177 [49:27<06:19,  2.33s/it, exist=0.5588, loss=0.6803, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1015/1177 [49:27<07:28,  2.77s/it, exist=0.5588, loss=0.6803, lr=4.92e-05]
Epoch 1/5:  86%|████████▌ | 1015/1177 [49:30<07:28,  2.77s/it, exist=0.5584, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  86%|████████▋ | 1016/1177 [49:30<07:12,  2.68s/it, exist=0.5584, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  86%|████████▋ | 1016/1177 [49:33<07:12,  2.68s/it, exist=0.5583, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  86%|████████▋ | 1017/1177 [49:33<07:34,  2.84s/it, exist=0.5583, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  86%|████████▋ | 1017/1177 [49:37<07:34,  2.84s/it, exist=0.5582, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  86%|████████▋ | 1018/1177 [49:37<08:26,  3.19s/it, exist=0.5582, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  86%|████████▋ | 1018/1177 [49:40<08:26,  3.19s/it, exist=0.5580, loss=0.6798, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1019/1177 [49:40<08:12,  3.12s/it, exist=0.5580, loss=0.6798, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1019/1177 [49:42<08:12,  3.12s/it, exist=0.5579, loss=0.6796, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1020/1177 [49:42<07:39,  2.93s/it, exist=0.5579, loss=0.6796, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1020/1177 [49:44<07:39,  2.93s/it, exist=0.5580, loss=0.6797, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1021/1177 [49:44<07:07,  2.74s/it, exist=0.5580, loss=0.6797, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1021/1177 [49:46<07:07,  2.74s/it, exist=0.5582, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1022/1177 [49:46<06:28,  2.51s/it, exist=0.5582, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1022/1177 [49:49<06:28,  2.51s/it, exist=0.5582, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1023/1177 [49:49<06:28,  2.52s/it, exist=0.5582, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1023/1177 [49:51<06:28,  2.52s/it, exist=0.5580, loss=0.6798, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1024/1177 [49:51<06:23,  2.51s/it, exist=0.5580, loss=0.6798, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1024/1177 [49:54<06:23,  2.51s/it, exist=0.5580, loss=0.6799, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1025/1177 [49:54<06:31,  2.58s/it, exist=0.5580, loss=0.6799, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1025/1177 [49:57<06:31,  2.58s/it, exist=0.5581, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1026/1177 [49:57<06:57,  2.76s/it, exist=0.5581, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1026/1177 [50:00<06:57,  2.76s/it, exist=0.5581, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1027/1177 [50:00<06:45,  2.70s/it, exist=0.5581, loss=0.6800, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1027/1177 [50:03<06:45,  2.70s/it, exist=0.5580, loss=0.6801, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1028/1177 [50:03<06:37,  2.67s/it, exist=0.5580, loss=0.6801, lr=4.92e-05]
Epoch 1/5:  87%|████████▋ | 1028/1177 [50:05<06:37,  2.67s/it, exist=0.5579, loss=0.6800, lr=4.91e-05]
Epoch 1/5:  87%|████████▋ | 1029/1177 [50:05<06:09,  2.49s/it, exist=0.5579, loss=0.6800, lr=4.91e-05]
Epoch 1/5:  87%|████████▋ | 1029/1177 [50:08<06:09,  2.49s/it, exist=0.5578, loss=0.6799, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1030/1177 [50:08<06:41,  2.73s/it, exist=0.5578, loss=0.6799, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1030/1177 [50:10<06:41,  2.73s/it, exist=0.5577, loss=0.6798, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1031/1177 [50:10<06:15,  2.57s/it, exist=0.5577, loss=0.6798, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1031/1177 [50:13<06:15,  2.57s/it, exist=0.5578, loss=0.6798, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1032/1177 [50:13<06:41,  2.77s/it, exist=0.5578, loss=0.6798, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1032/1177 [50:15<06:41,  2.77s/it, exist=0.5576, loss=0.6797, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1033/1177 [50:15<06:05,  2.54s/it, exist=0.5576, loss=0.6797, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1033/1177 [50:19<06:05,  2.54s/it, exist=0.5576, loss=0.6796, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1034/1177 [50:19<07:10,  3.01s/it, exist=0.5576, loss=0.6796, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1034/1177 [50:23<07:10,  3.01s/it, exist=0.5573, loss=0.6794, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1035/1177 [50:23<07:14,  3.06s/it, exist=0.5573, loss=0.6794, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1035/1177 [50:25<07:14,  3.06s/it, exist=0.5573, loss=0.6793, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1036/1177 [50:25<06:49,  2.91s/it, exist=0.5573, loss=0.6793, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1036/1177 [50:27<06:49,  2.91s/it, exist=0.5571, loss=0.6791, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1037/1177 [50:27<06:09,  2.64s/it, exist=0.5571, loss=0.6791, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1037/1177 [50:30<06:09,  2.64s/it, exist=0.5569, loss=0.6789, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1038/1177 [50:30<06:22,  2.75s/it, exist=0.5569, loss=0.6789, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1038/1177 [50:34<06:22,  2.75s/it, exist=0.5567, loss=0.6786, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1039/1177 [50:34<06:59,  3.04s/it, exist=0.5567, loss=0.6786, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1039/1177 [50:38<06:59,  3.04s/it, exist=0.5565, loss=0.6785, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1040/1177 [50:38<07:43,  3.38s/it, exist=0.5565, loss=0.6785, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1040/1177 [50:41<07:43,  3.38s/it, exist=0.5567, loss=0.6788, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1041/1177 [50:41<07:19,  3.23s/it, exist=0.5567, loss=0.6788, lr=4.91e-05]
Epoch 1/5:  88%|████████▊ | 1041/1177 [50:43<07:19,  3.23s/it, exist=0.5570, loss=0.6790, lr=4.91e-05]
Epoch 1/5:  89%|████████▊ | 1042/1177 [50:43<06:35,  2.93s/it, exist=0.5570, loss=0.6790, lr=4.91e-05]
Epoch 1/5:  89%|████████▊ | 1042/1177 [50:46<06:35,  2.93s/it, exist=0.5566, loss=0.6787, lr=4.91e-05]
Epoch 1/5:  89%|████████▊ | 1043/1177 [50:46<06:24,  2.87s/it, exist=0.5566, loss=0.6787, lr=4.91e-05]
Epoch 1/5:  89%|████████▊ | 1043/1177 [50:48<06:24,  2.87s/it, exist=0.5568, loss=0.6789, lr=4.91e-05]
Epoch 1/5:  89%|████████▊ | 1044/1177 [50:48<05:46,  2.61s/it, exist=0.5568, loss=0.6789, lr=4.91e-05]
Epoch 1/5:  89%|████████▊ | 1044/1177 [50:51<05:46,  2.61s/it, exist=0.5565, loss=0.6786, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1045/1177 [50:51<06:14,  2.84s/it, exist=0.5565, loss=0.6786, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1045/1177 [50:53<06:14,  2.84s/it, exist=0.5565, loss=0.6786, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1046/1177 [50:53<05:41,  2.60s/it, exist=0.5565, loss=0.6786, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1046/1177 [50:57<05:41,  2.60s/it, exist=0.5564, loss=0.6785, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1047/1177 [50:57<06:21,  2.93s/it, exist=0.5564, loss=0.6785, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1047/1177 [50:59<06:21,  2.93s/it, exist=0.5561, loss=0.6783, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1048/1177 [50:59<05:44,  2.67s/it, exist=0.5561, loss=0.6783, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1048/1177 [51:02<05:44,  2.67s/it, exist=0.5560, loss=0.6782, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1049/1177 [51:02<05:42,  2.68s/it, exist=0.5560, loss=0.6782, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1049/1177 [51:04<05:42,  2.68s/it, exist=0.5560, loss=0.6781, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1050/1177 [51:04<05:15,  2.48s/it, exist=0.5560, loss=0.6781, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1050/1177 [51:06<05:15,  2.48s/it, exist=0.5557, loss=0.6779, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1051/1177 [51:06<05:17,  2.52s/it, exist=0.5557, loss=0.6779, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1051/1177 [51:10<05:17,  2.52s/it, exist=0.5556, loss=0.6778, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1052/1177 [51:10<05:49,  2.80s/it, exist=0.5556, loss=0.6778, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1052/1177 [51:12<05:49,  2.80s/it, exist=0.5555, loss=0.6777, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1053/1177 [51:12<05:18,  2.57s/it, exist=0.5555, loss=0.6777, lr=4.91e-05]
Epoch 1/5:  89%|████████▉ | 1053/1177 [51:16<05:18,  2.57s/it, exist=0.5552, loss=0.6775, lr=4.91e-05]
Epoch 1/5:  90%|████████▉ | 1054/1177 [51:16<06:23,  3.12s/it, exist=0.5552, loss=0.6775, lr=4.91e-05]
Epoch 1/5:  90%|████████▉ | 1054/1177 [51:19<06:23,  3.12s/it, exist=0.5550, loss=0.6773, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1055/1177 [51:19<06:20,  3.12s/it, exist=0.5550, loss=0.6773, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1055/1177 [51:23<06:20,  3.12s/it, exist=0.5548, loss=0.6771, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1056/1177 [51:23<06:15,  3.10s/it, exist=0.5548, loss=0.6771, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1056/1177 [51:25<06:15,  3.10s/it, exist=0.5546, loss=0.6769, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1057/1177 [51:25<05:35,  2.80s/it, exist=0.5546, loss=0.6769, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1057/1177 [51:27<05:35,  2.80s/it, exist=0.5544, loss=0.6767, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1058/1177 [51:27<05:25,  2.73s/it, exist=0.5544, loss=0.6767, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1058/1177 [51:30<05:25,  2.73s/it, exist=0.5543, loss=0.6767, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1059/1177 [51:30<05:17,  2.69s/it, exist=0.5543, loss=0.6767, lr=4.90e-05]
Epoch 1/5:  90%|████████▉ | 1059/1177 [51:32<05:17,  2.69s/it, exist=0.5544, loss=0.6769, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1060/1177 [51:32<05:09,  2.65s/it, exist=0.5544, loss=0.6769, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1060/1177 [51:36<05:09,  2.65s/it, exist=0.5542, loss=0.6767, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1061/1177 [51:36<05:27,  2.82s/it, exist=0.5542, loss=0.6767, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1061/1177 [51:38<05:27,  2.82s/it, exist=0.5542, loss=0.6767, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1062/1177 [51:38<05:23,  2.81s/it, exist=0.5542, loss=0.6767, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1062/1177 [51:41<05:23,  2.81s/it, exist=0.5541, loss=0.6766, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1063/1177 [51:41<05:07,  2.69s/it, exist=0.5541, loss=0.6766, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1063/1177 [51:43<05:07,  2.69s/it, exist=0.5540, loss=0.6766, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1064/1177 [51:43<04:40,  2.48s/it, exist=0.5540, loss=0.6766, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1064/1177 [51:45<04:40,  2.48s/it, exist=0.5537, loss=0.6763, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1065/1177 [51:45<04:42,  2.52s/it, exist=0.5537, loss=0.6763, lr=4.90e-05]
Epoch 1/5:  90%|█████████ | 1065/1177 [51:48<04:42,  2.52s/it, exist=0.5536, loss=0.6762, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1066/1177 [51:48<04:38,  2.50s/it, exist=0.5536, loss=0.6762, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1066/1177 [51:51<04:38,  2.50s/it, exist=0.5533, loss=0.6761, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1067/1177 [51:51<05:08,  2.80s/it, exist=0.5533, loss=0.6761, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1067/1177 [51:54<05:08,  2.80s/it, exist=0.5534, loss=0.6761, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1068/1177 [51:54<05:02,  2.77s/it, exist=0.5534, loss=0.6761, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1068/1177 [51:58<05:02,  2.77s/it, exist=0.5534, loss=0.6762, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1069/1177 [51:58<05:28,  3.04s/it, exist=0.5534, loss=0.6762, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1069/1177 [52:00<05:28,  3.04s/it, exist=0.5532, loss=0.6759, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1070/1177 [52:00<04:52,  2.73s/it, exist=0.5532, loss=0.6759, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1070/1177 [52:03<04:52,  2.73s/it, exist=0.5530, loss=0.6758, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1071/1177 [52:03<04:57,  2.81s/it, exist=0.5530, loss=0.6758, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1071/1177 [52:05<04:57,  2.81s/it, exist=0.5528, loss=0.6756, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1072/1177 [52:05<04:29,  2.56s/it, exist=0.5528, loss=0.6756, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1072/1177 [52:07<04:29,  2.56s/it, exist=0.5526, loss=0.6755, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1073/1177 [52:07<04:29,  2.59s/it, exist=0.5526, loss=0.6755, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1073/1177 [52:10<04:29,  2.59s/it, exist=0.5525, loss=0.6754, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1074/1177 [52:10<04:27,  2.60s/it, exist=0.5525, loss=0.6754, lr=4.90e-05]
Epoch 1/5:  91%|█████████ | 1074/1177 [52:13<04:27,  2.60s/it, exist=0.5523, loss=0.6753, lr=4.90e-05]
Epoch 1/5:  91%|█████████▏| 1075/1177 [52:13<04:24,  2.59s/it, exist=0.5523, loss=0.6753, lr=4.90e-05]
Epoch 1/5:  91%|█████████▏| 1075/1177 [52:15<04:24,  2.59s/it, exist=0.5523, loss=0.6752, lr=4.90e-05]
Epoch 1/5:  91%|█████████▏| 1076/1177 [52:15<04:03,  2.42s/it, exist=0.5523, loss=0.6752, lr=4.90e-05]
Epoch 1/5:  91%|█████████▏| 1076/1177 [52:18<04:03,  2.42s/it, exist=0.5521, loss=0.6750, lr=4.90e-05]
Epoch 1/5:  92%|█████████▏| 1077/1177 [52:18<04:26,  2.66s/it, exist=0.5521, loss=0.6750, lr=4.90e-05]
Epoch 1/5:  92%|█████████▏| 1077/1177 [52:21<04:26,  2.66s/it, exist=0.5520, loss=0.6749, lr=4.90e-05]
Epoch 1/5:  92%|█████████▏| 1078/1177 [52:21<04:35,  2.78s/it, exist=0.5520, loss=0.6749, lr=4.90e-05]
Epoch 1/5:  92%|█████████▏| 1078/1177 [52:25<04:35,  2.78s/it, exist=0.5520, loss=0.6748, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1079/1177 [52:25<05:01,  3.08s/it, exist=0.5520, loss=0.6748, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1079/1177 [52:27<05:01,  3.08s/it, exist=0.5517, loss=0.6745, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1080/1177 [52:27<04:38,  2.87s/it, exist=0.5517, loss=0.6745, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1080/1177 [52:29<04:38,  2.87s/it, exist=0.5517, loss=0.6746, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1081/1177 [52:29<04:14,  2.66s/it, exist=0.5517, loss=0.6746, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1081/1177 [52:33<04:14,  2.66s/it, exist=0.5515, loss=0.6745, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1082/1177 [52:33<04:53,  3.09s/it, exist=0.5515, loss=0.6745, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1082/1177 [52:36<04:53,  3.09s/it, exist=0.5514, loss=0.6743, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1083/1177 [52:36<04:44,  3.03s/it, exist=0.5514, loss=0.6743, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1083/1177 [52:40<04:44,  3.03s/it, exist=0.5513, loss=0.6743, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1084/1177 [52:40<05:01,  3.24s/it, exist=0.5513, loss=0.6743, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1084/1177 [52:42<05:01,  3.24s/it, exist=0.5514, loss=0.6746, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1085/1177 [52:42<04:22,  2.85s/it, exist=0.5514, loss=0.6746, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1085/1177 [52:45<04:22,  2.85s/it, exist=0.5513, loss=0.6745, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1086/1177 [52:45<04:15,  2.80s/it, exist=0.5513, loss=0.6745, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1086/1177 [52:46<04:15,  2.80s/it, exist=0.5510, loss=0.6743, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1087/1177 [52:46<03:50,  2.56s/it, exist=0.5510, loss=0.6743, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1087/1177 [52:49<03:50,  2.56s/it, exist=0.5507, loss=0.6740, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1088/1177 [52:49<03:33,  2.39s/it, exist=0.5507, loss=0.6740, lr=4.89e-05]
Epoch 1/5:  92%|█████████▏| 1088/1177 [52:53<03:33,  2.39s/it, exist=0.5507, loss=0.6741, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1089/1177 [52:53<04:29,  3.07s/it, exist=0.5507, loss=0.6741, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1089/1177 [52:56<04:29,  3.07s/it, exist=0.5505, loss=0.6738, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1090/1177 [52:56<04:11,  2.89s/it, exist=0.5505, loss=0.6738, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1090/1177 [52:58<04:11,  2.89s/it, exist=0.5502, loss=0.6736, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1091/1177 [52:58<04:00,  2.80s/it, exist=0.5502, loss=0.6736, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1091/1177 [53:01<04:00,  2.80s/it, exist=0.5499, loss=0.6733, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1092/1177 [53:01<03:53,  2.75s/it, exist=0.5499, loss=0.6733, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1092/1177 [53:03<03:53,  2.75s/it, exist=0.5498, loss=0.6734, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1093/1177 [53:03<03:46,  2.69s/it, exist=0.5498, loss=0.6734, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1093/1177 [53:05<03:46,  2.69s/it, exist=0.5498, loss=0.6735, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1094/1177 [53:05<03:24,  2.46s/it, exist=0.5498, loss=0.6735, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1094/1177 [53:09<03:24,  2.46s/it, exist=0.5496, loss=0.6733, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1095/1177 [53:09<03:49,  2.79s/it, exist=0.5496, loss=0.6733, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1095/1177 [53:11<03:49,  2.79s/it, exist=0.5495, loss=0.6733, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1096/1177 [53:11<03:40,  2.73s/it, exist=0.5495, loss=0.6733, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1096/1177 [53:13<03:40,  2.73s/it, exist=0.5497, loss=0.6735, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1097/1177 [53:13<03:19,  2.49s/it, exist=0.5497, loss=0.6735, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1097/1177 [53:18<03:19,  2.49s/it, exist=0.5494, loss=0.6733, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1098/1177 [53:18<04:17,  3.26s/it, exist=0.5494, loss=0.6733, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1098/1177 [53:21<04:17,  3.26s/it, exist=0.5492, loss=0.6732, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1099/1177 [53:21<04:07,  3.17s/it, exist=0.5492, loss=0.6732, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1099/1177 [53:23<04:07,  3.17s/it, exist=0.5489, loss=0.6729, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1100/1177 [53:23<03:36,  2.81s/it, exist=0.5489, loss=0.6729, lr=4.89e-05]
Epoch 1/5:  93%|█████████▎| 1100/1177 [53:26<03:36,  2.81s/it, exist=0.5489, loss=0.6729, lr=4.89e-05]
Epoch 1/5:  94%|█████████▎| 1101/1177 [53:26<03:31,  2.78s/it, exist=0.5489, loss=0.6729, lr=4.89e-05]
Epoch 1/5:  94%|█████████▎| 1101/1177 [53:29<03:31,  2.78s/it, exist=0.5489, loss=0.6729, lr=4.88e-05]
Epoch 1/5:  94%|█████████▎| 1102/1177 [53:29<03:34,  2.86s/it, exist=0.5489, loss=0.6729, lr=4.88e-05]
Epoch 1/5:  94%|█████████▎| 1102/1177 [53:33<03:34,  2.86s/it, exist=0.5485, loss=0.6725, lr=4.88e-05]
Epoch 1/5:  94%|█████████▎| 1103/1177 [53:33<03:50,  3.12s/it, exist=0.5485, loss=0.6725, lr=4.88e-05]
Epoch 1/5:  94%|█████████▎| 1103/1177 [53:35<03:50,  3.12s/it, exist=0.5482, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1104/1177 [53:35<03:32,  2.91s/it, exist=0.5482, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1104/1177 [53:38<03:32,  2.91s/it, exist=0.5482, loss=0.6725, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1105/1177 [53:38<03:18,  2.76s/it, exist=0.5482, loss=0.6725, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1105/1177 [53:40<03:18,  2.76s/it, exist=0.5481, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1106/1177 [53:40<03:16,  2.77s/it, exist=0.5481, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1106/1177 [53:44<03:16,  2.77s/it, exist=0.5481, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1107/1177 [53:44<03:26,  2.94s/it, exist=0.5481, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1107/1177 [53:46<03:26,  2.94s/it, exist=0.5484, loss=0.6727, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1108/1177 [53:46<03:02,  2.65s/it, exist=0.5484, loss=0.6727, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1108/1177 [53:48<03:02,  2.65s/it, exist=0.5484, loss=0.6728, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1109/1177 [53:48<02:47,  2.46s/it, exist=0.5484, loss=0.6728, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1109/1177 [53:51<02:47,  2.46s/it, exist=0.5482, loss=0.6726, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1110/1177 [53:51<03:00,  2.70s/it, exist=0.5482, loss=0.6726, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1110/1177 [53:53<03:00,  2.70s/it, exist=0.5482, loss=0.6726, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1111/1177 [53:53<02:52,  2.61s/it, exist=0.5482, loss=0.6726, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1111/1177 [53:56<02:52,  2.61s/it, exist=0.5483, loss=0.6727, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1112/1177 [53:56<02:56,  2.71s/it, exist=0.5483, loss=0.6727, lr=4.88e-05]
Epoch 1/5:  94%|█████████▍| 1112/1177 [53:58<02:56,  2.71s/it, exist=0.5481, loss=0.6726, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1113/1177 [53:58<02:39,  2.49s/it, exist=0.5481, loss=0.6726, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1113/1177 [54:00<02:39,  2.49s/it, exist=0.5480, loss=0.6725, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1114/1177 [54:00<02:27,  2.34s/it, exist=0.5480, loss=0.6725, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1114/1177 [54:03<02:27,  2.34s/it, exist=0.5477, loss=0.6725, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1115/1177 [54:03<02:35,  2.51s/it, exist=0.5477, loss=0.6725, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1115/1177 [54:06<02:35,  2.51s/it, exist=0.5476, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1116/1177 [54:06<02:41,  2.64s/it, exist=0.5476, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1116/1177 [54:09<02:41,  2.64s/it, exist=0.5474, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1117/1177 [54:09<02:37,  2.62s/it, exist=0.5474, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1117/1177 [54:11<02:37,  2.62s/it, exist=0.5473, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1118/1177 [54:11<02:33,  2.61s/it, exist=0.5473, loss=0.6724, lr=4.88e-05]
Epoch 1/5:  95%|█████████▍| 1118/1177 [54:14<02:33,  2.61s/it, exist=0.5471, loss=0.6723, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1119/1177 [54:14<02:32,  2.62s/it, exist=0.5471, loss=0.6723, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1119/1177 [54:17<02:32,  2.62s/it, exist=0.5469, loss=0.6721, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1120/1177 [54:17<02:36,  2.75s/it, exist=0.5469, loss=0.6721, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1120/1177 [54:20<02:36,  2.75s/it, exist=0.5468, loss=0.6719, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1121/1177 [54:20<02:38,  2.82s/it, exist=0.5468, loss=0.6719, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1121/1177 [54:22<02:38,  2.82s/it, exist=0.5468, loss=0.6719, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1122/1177 [54:22<02:21,  2.58s/it, exist=0.5468, loss=0.6719, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1122/1177 [54:26<02:21,  2.58s/it, exist=0.5467, loss=0.6719, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1123/1177 [54:26<02:39,  2.95s/it, exist=0.5467, loss=0.6719, lr=4.88e-05]
Epoch 1/5:  95%|█████████▌| 1123/1177 [54:28<02:39,  2.95s/it, exist=0.5465, loss=0.6717, lr=4.87e-05]
Epoch 1/5:  95%|█████████▌| 1124/1177 [54:28<02:20,  2.66s/it, exist=0.5465, loss=0.6717, lr=4.87e-05]
Epoch 1/5:  95%|█████████▌| 1124/1177 [54:31<02:20,  2.66s/it, exist=0.5464, loss=0.6716, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1125/1177 [54:31<02:25,  2.80s/it, exist=0.5464, loss=0.6716, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1125/1177 [54:33<02:25,  2.80s/it, exist=0.5464, loss=0.6719, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1126/1177 [54:33<02:10,  2.56s/it, exist=0.5464, loss=0.6719, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1126/1177 [54:36<02:10,  2.56s/it, exist=0.5464, loss=0.6720, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1127/1177 [54:36<02:10,  2.61s/it, exist=0.5464, loss=0.6720, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1127/1177 [54:38<02:10,  2.61s/it, exist=0.5463, loss=0.6721, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1128/1177 [54:38<02:08,  2.62s/it, exist=0.5463, loss=0.6721, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1128/1177 [54:41<02:08,  2.62s/it, exist=0.5461, loss=0.6720, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1129/1177 [54:41<02:04,  2.60s/it, exist=0.5461, loss=0.6720, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1129/1177 [54:43<02:04,  2.60s/it, exist=0.5459, loss=0.6719, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1130/1177 [54:43<02:00,  2.56s/it, exist=0.5459, loss=0.6719, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1130/1177 [54:46<02:00,  2.56s/it, exist=0.5459, loss=0.6719, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1131/1177 [54:46<01:58,  2.57s/it, exist=0.5459, loss=0.6719, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1131/1177 [54:49<01:58,  2.57s/it, exist=0.5456, loss=0.6716, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1132/1177 [54:49<02:02,  2.71s/it, exist=0.5456, loss=0.6716, lr=4.87e-05]
Epoch 1/5:  96%|█████████▌| 1132/1177 [54:51<02:02,  2.71s/it, exist=0.5454, loss=0.6714, lr=4.87e-05]
Epoch 1/5:  96%|█████████▋| 1133/1177 [54:51<01:50,  2.51s/it, exist=0.5454, loss=0.6714, lr=4.87e-05]
Epoch 1/5:  96%|█████████▋| 1133/1177 [54:55<01:50,  2.51s/it, exist=0.5451, loss=0.6712, lr=4.87e-05]
Epoch 1/5:  96%|█████████▋| 1134/1177 [54:55<02:01,  2.83s/it, exist=0.5451, loss=0.6712, lr=4.87e-05]
Epoch 1/5:  96%|█████████▋| 1134/1177 [54:58<02:01,  2.83s/it, exist=0.5449, loss=0.6710, lr=4.87e-05]
Epoch 1/5:  96%|█████████▋| 1135/1177 [54:58<02:01,  2.90s/it, exist=0.5449, loss=0.6710, lr=4.87e-05]
Epoch 1/5:  96%|█████████▋| 1135/1177 [55:01<02:01,  2.90s/it, exist=0.5447, loss=0.6708, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1136/1177 [55:01<02:01,  2.97s/it, exist=0.5447, loss=0.6708, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1136/1177 [55:03<02:01,  2.97s/it, exist=0.5446, loss=0.6707, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1137/1177 [55:03<01:46,  2.67s/it, exist=0.5446, loss=0.6707, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1137/1177 [55:05<01:46,  2.67s/it, exist=0.5447, loss=0.6709, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1138/1177 [55:05<01:41,  2.61s/it, exist=0.5447, loss=0.6709, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1138/1177 [55:08<01:41,  2.61s/it, exist=0.5444, loss=0.6707, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1139/1177 [55:08<01:38,  2.60s/it, exist=0.5444, loss=0.6707, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1139/1177 [55:10<01:38,  2.60s/it, exist=0.5445, loss=0.6709, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1140/1177 [55:10<01:36,  2.60s/it, exist=0.5445, loss=0.6709, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1140/1177 [55:13<01:36,  2.60s/it, exist=0.5444, loss=0.6708, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1141/1177 [55:13<01:34,  2.61s/it, exist=0.5444, loss=0.6708, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1141/1177 [55:16<01:34,  2.61s/it, exist=0.5445, loss=0.6708, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1142/1177 [55:16<01:31,  2.62s/it, exist=0.5445, loss=0.6708, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1142/1177 [55:19<01:31,  2.62s/it, exist=0.5443, loss=0.6709, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1143/1177 [55:19<01:34,  2.76s/it, exist=0.5443, loss=0.6709, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1143/1177 [55:22<01:34,  2.76s/it, exist=0.5441, loss=0.6708, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1144/1177 [55:22<01:37,  2.94s/it, exist=0.5441, loss=0.6708, lr=4.87e-05]
Epoch 1/5:  97%|█████████▋| 1144/1177 [55:24<01:37,  2.94s/it, exist=0.5438, loss=0.6706, lr=4.86e-05]
Epoch 1/5:  97%|█████████▋| 1145/1177 [55:24<01:25,  2.67s/it, exist=0.5438, loss=0.6706, lr=4.86e-05]
Epoch 1/5:  97%|█████████▋| 1145/1177 [55:27<01:25,  2.67s/it, exist=0.5437, loss=0.6704, lr=4.86e-05]
Epoch 1/5:  97%|█████████▋| 1146/1177 [55:27<01:26,  2.79s/it, exist=0.5437, loss=0.6704, lr=4.86e-05]
Epoch 1/5:  97%|█████████▋| 1146/1177 [55:30<01:26,  2.79s/it, exist=0.5435, loss=0.6702, lr=4.86e-05]
Epoch 1/5:  97%|█████████▋| 1147/1177 [55:30<01:19,  2.65s/it, exist=0.5435, loss=0.6702, lr=4.86e-05]
Epoch 1/5:  97%|█████████▋| 1147/1177 [55:32<01:19,  2.65s/it, exist=0.5434, loss=0.6702, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1148/1177 [55:32<01:16,  2.64s/it, exist=0.5434, loss=0.6702, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1148/1177 [55:35<01:16,  2.64s/it, exist=0.5433, loss=0.6700, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1149/1177 [55:35<01:12,  2.58s/it, exist=0.5433, loss=0.6700, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1149/1177 [55:38<01:12,  2.58s/it, exist=0.5433, loss=0.6701, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1150/1177 [55:38<01:13,  2.73s/it, exist=0.5433, loss=0.6701, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1150/1177 [55:41<01:13,  2.73s/it, exist=0.5433, loss=0.6701, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1151/1177 [55:41<01:16,  2.96s/it, exist=0.5433, loss=0.6701, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1151/1177 [55:44<01:16,  2.96s/it, exist=0.5431, loss=0.6699, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1152/1177 [55:44<01:11,  2.87s/it, exist=0.5431, loss=0.6699, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1152/1177 [55:46<01:11,  2.87s/it, exist=0.5430, loss=0.6699, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1153/1177 [55:46<01:06,  2.77s/it, exist=0.5430, loss=0.6699, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1153/1177 [55:49<01:06,  2.77s/it, exist=0.5431, loss=0.6699, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1154/1177 [55:49<01:04,  2.81s/it, exist=0.5431, loss=0.6699, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1154/1177 [55:51<01:04,  2.81s/it, exist=0.5428, loss=0.6696, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1155/1177 [55:51<00:56,  2.57s/it, exist=0.5428, loss=0.6696, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1155/1177 [55:55<00:56,  2.57s/it, exist=0.5429, loss=0.6697, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1156/1177 [55:55<00:58,  2.79s/it, exist=0.5429, loss=0.6697, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1156/1177 [55:57<00:58,  2.79s/it, exist=0.5427, loss=0.6695, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1157/1177 [55:57<00:55,  2.75s/it, exist=0.5427, loss=0.6695, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1157/1177 [55:59<00:55,  2.75s/it, exist=0.5425, loss=0.6692, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1158/1177 [55:59<00:48,  2.53s/it, exist=0.5425, loss=0.6692, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1158/1177 [56:03<00:48,  2.53s/it, exist=0.5423, loss=0.6691, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1159/1177 [56:03<00:51,  2.86s/it, exist=0.5423, loss=0.6691, lr=4.86e-05]
Epoch 1/5:  98%|█████████▊| 1159/1177 [56:06<00:51,  2.86s/it, exist=0.5421, loss=0.6690, lr=4.86e-05]
Epoch 1/5:  99%|█████████▊| 1160/1177 [56:06<00:48,  2.88s/it, exist=0.5421, loss=0.6690, lr=4.86e-05]
Epoch 1/5:  99%|█████████▊| 1160/1177 [56:09<00:48,  2.88s/it, exist=0.5419, loss=0.6688, lr=4.86e-05]
Epoch 1/5:  99%|█████████▊| 1161/1177 [56:09<00:46,  2.94s/it, exist=0.5419, loss=0.6688, lr=4.86e-05]
Epoch 1/5:  99%|█████████▊| 1161/1177 [56:11<00:46,  2.94s/it, exist=0.5417, loss=0.6685, lr=4.86e-05]
Epoch 1/5:  99%|█████████▊| 1162/1177 [56:11<00:39,  2.65s/it, exist=0.5417, loss=0.6685, lr=4.86e-05]
Epoch 1/5:  99%|█████████▊| 1162/1177 [56:14<00:39,  2.65s/it, exist=0.5418, loss=0.6687, lr=4.86e-05]
Epoch 1/5:  99%|█████████▉| 1163/1177 [56:14<00:37,  2.64s/it, exist=0.5418, loss=0.6687, lr=4.86e-05]
Epoch 1/5:  99%|█████████▉| 1163/1177 [56:16<00:37,  2.64s/it, exist=0.5418, loss=0.6686, lr=4.86e-05]
Epoch 1/5:  99%|█████████▉| 1164/1177 [56:16<00:31,  2.46s/it, exist=0.5418, loss=0.6686, lr=4.86e-05]
Epoch 1/5:  99%|█████████▉| 1164/1177 [56:18<00:31,  2.46s/it, exist=0.5415, loss=0.6684, lr=4.86e-05]
Epoch 1/5:  99%|█████████▉| 1165/1177 [56:18<00:30,  2.52s/it, exist=0.5415, loss=0.6684, lr=4.86e-05]
Epoch 1/5:  99%|█████████▉| 1165/1177 [56:22<00:30,  2.52s/it, exist=0.5414, loss=0.6684, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1166/1177 [56:22<00:31,  2.86s/it, exist=0.5414, loss=0.6684, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1166/1177 [56:27<00:31,  2.86s/it, exist=0.5412, loss=0.6681, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1167/1177 [56:27<00:34,  3.48s/it, exist=0.5412, loss=0.6681, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1167/1177 [56:29<00:34,  3.48s/it, exist=0.5412, loss=0.6683, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1168/1177 [56:29<00:28,  3.21s/it, exist=0.5412, loss=0.6683, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1168/1177 [56:32<00:28,  3.21s/it, exist=0.5412, loss=0.6682, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1169/1177 [56:32<00:23,  2.97s/it, exist=0.5412, loss=0.6682, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1169/1177 [56:34<00:23,  2.97s/it, exist=0.5411, loss=0.6682, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1170/1177 [56:34<00:18,  2.68s/it, exist=0.5411, loss=0.6682, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1170/1177 [56:36<00:18,  2.68s/it, exist=0.5409, loss=0.6680, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1171/1177 [56:36<00:15,  2.60s/it, exist=0.5409, loss=0.6680, lr=4.85e-05]
Epoch 1/5:  99%|█████████▉| 1171/1177 [56:38<00:15,  2.60s/it, exist=0.5408, loss=0.6678, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1172/1177 [56:38<00:12,  2.41s/it, exist=0.5408, loss=0.6678, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1172/1177 [56:40<00:12,  2.41s/it, exist=0.5406, loss=0.6676, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1173/1177 [56:40<00:09,  2.29s/it, exist=0.5406, loss=0.6676, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1173/1177 [56:42<00:09,  2.29s/it, exist=0.5405, loss=0.6676, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1174/1177 [56:42<00:06,  2.20s/it, exist=0.5405, loss=0.6676, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1174/1177 [56:44<00:06,  2.20s/it, exist=0.5403, loss=0.6676, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1175/1177 [56:44<00:04,  2.13s/it, exist=0.5403, loss=0.6676, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1175/1177 [56:46<00:04,  2.13s/it, exist=0.5404, loss=0.6676, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1176/1177 [56:46<00:02,  2.08s/it, exist=0.5404, loss=0.6676, lr=4.85e-05]
Epoch 1/5: 100%|█████████▉| 1176/1177 [56:47<00:02,  2.08s/it, exist=0.5401, loss=0.6674, lr=4.85e-05]
Epoch 1/5: 100%|██████████| 1177/1177 [56:47<00:00,  1.76s/it, exist=0.5401, loss=0.6674, lr=4.85e-05]
Epoch 1/5: 100%|██████████| 1177/1177 [56:48<00:00,  2.90s/it, exist=0.5401, loss=0.6674, lr=4.85e-05]
Epoch 1  loss=0.6674  ce=0.0000  mask=0.1114  exist=0.5401  lr=4.85e-05
Saved: checkpoints/ec_simtoken/ec_simtoken_v1_ep1.pth
Epoch 1: skipping eval (scheduled at [2, 5, 7, 10])

Epoch 2/5:   0%|          | 0/1177 [00:00<?, ?it/s]
Epoch 2/5:   0%|          | 0/1177 [00:30<?, ?it/s, exist=0.3977, loss=0.6024, lr=4.85e-05]
Epoch 2/5:   0%|          | 1/1177 [00:30<9:59:06, 30.57s/it, exist=0.3977, loss=0.6024, lr=4.85e-05]
Epoch 2/5:   0%|          | 1/1177 [00:34<9:59:06, 30.57s/it, exist=0.3336, loss=0.5355, lr=4.85e-05]
Epoch 2/5:   0%|          | 2/1177 [00:34<4:57:14, 15.18s/it, exist=0.3336, loss=0.5355, lr=4.85e-05]
Epoch 2/5:   0%|          | 2/1177 [00:37<4:57:14, 15.18s/it, exist=0.3685, loss=0.5551, lr=4.85e-05]
Epoch 2/5:   0%|          | 3/1177 [00:37<2:59:30,  9.17s/it, exist=0.3685, loss=0.5551, lr=4.85e-05]
Epoch 2/5:   0%|          | 3/1177 [00:39<2:59:30,  9.17s/it, exist=0.3112, loss=0.4850, lr=4.85e-05]
Epoch 2/5:   0%|          | 4/1177 [00:39<2:11:09,  6.71s/it, exist=0.3112, loss=0.4850, lr=4.85e-05]
Epoch 2/5:   0%|          | 4/1177 [00:42<2:11:09,  6.71s/it, exist=0.3493, loss=0.5382, lr=4.85e-05]
Epoch 2/5:   0%|          | 5/1177 [00:42<1:38:23,  5.04s/it, exist=0.3493, loss=0.5382, lr=4.85e-05]
Epoch 2/5:   0%|          | 5/1177 [00:44<1:38:23,  5.04s/it, exist=0.3346, loss=0.5369, lr=4.85e-05]
Epoch 2/5:   1%|          | 6/1177 [00:44<1:22:56,  4.25s/it, exist=0.3346, loss=0.5369, lr=4.85e-05]
Epoch 2/5:   1%|          | 6/1177 [00:47<1:22:56,  4.25s/it, exist=0.3451, loss=0.5531, lr=4.85e-05]
Epoch 2/5:   1%|          | 7/1177 [00:47<1:16:09,  3.91s/it, exist=0.3451, loss=0.5531, lr=4.85e-05]
Epoch 2/5:   1%|          | 7/1177 [00:50<1:16:09,  3.91s/it, exist=0.3609, loss=0.5604, lr=4.84e-05]
Epoch 2/5:   1%|          | 8/1177 [00:50<1:08:35,  3.52s/it, exist=0.3609, loss=0.5604, lr=4.84e-05]
Epoch 2/5:   1%|          | 8/1177 [00:52<1:08:35,  3.52s/it, exist=0.3564, loss=0.5495, lr=4.84e-05]
Epoch 2/5:   1%|          | 9/1177 [00:52<59:37,  3.06s/it, exist=0.3564, loss=0.5495, lr=4.84e-05]  
Epoch 2/5:   1%|          | 9/1177 [00:55<59:37,  3.06s/it, exist=0.3565, loss=0.5436, lr=4.84e-05]
Epoch 2/5:   1%|          | 10/1177 [00:55<1:00:55,  3.13s/it, exist=0.3565, loss=0.5436, lr=4.84e-05]
Epoch 2/5:   1%|          | 10/1177 [00:59<1:00:55,  3.13s/it, exist=0.3658, loss=0.5727, lr=4.84e-05]
Epoch 2/5:   1%|          | 11/1177 [00:59<1:03:06,  3.25s/it, exist=0.3658, loss=0.5727, lr=4.84e-05]
Epoch 2/5:   1%|          | 11/1177 [01:01<1:03:06,  3.25s/it, exist=0.3770, loss=0.5844, lr=4.84e-05]
Epoch 2/5:   1%|          | 12/1177 [01:01<56:02,  2.89s/it, exist=0.3770, loss=0.5844, lr=4.84e-05]  
Epoch 2/5:   1%|          | 12/1177 [01:04<56:02,  2.89s/it, exist=0.3906, loss=0.5891, lr=4.84e-05]
Epoch 2/5:   1%|          | 13/1177 [01:04<55:16,  2.85s/it, exist=0.3906, loss=0.5891, lr=4.84e-05]
Epoch 2/5:   1%|          | 13/1177 [01:06<55:16,  2.85s/it, exist=0.3860, loss=0.5820, lr=4.84e-05]
Epoch 2/5:   1%|          | 14/1177 [01:06<53:38,  2.77s/it, exist=0.3860, loss=0.5820, lr=4.84e-05]
Epoch 2/5:   1%|          | 14/1177 [01:09<53:38,  2.77s/it, exist=0.3979, loss=0.5966, lr=4.84e-05]
Epoch 2/5:   1%|▏         | 15/1177 [01:09<52:44,  2.72s/it, exist=0.3979, loss=0.5966, lr=4.84e-05]
Epoch 2/5:   1%|▏         | 15/1177 [01:11<52:44,  2.72s/it, exist=0.3869, loss=0.5901, lr=4.84e-05]
Epoch 2/5:   1%|▏         | 16/1177 [01:11<48:52,  2.53s/it, exist=0.3869, loss=0.5901, lr=4.84e-05]
Epoch 2/5:   1%|▏         | 16/1177 [01:15<48:52,  2.53s/it, exist=0.3948, loss=0.5946, lr=4.84e-05]
Epoch 2/5:   1%|▏         | 17/1177 [01:15<55:56,  2.89s/it, exist=0.3948, loss=0.5946, lr=4.84e-05]
Epoch 2/5:   1%|▏         | 17/1177 [01:18<55:56,  2.89s/it, exist=0.4163, loss=0.6110, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 18/1177 [01:18<54:51,  2.84s/it, exist=0.4163, loss=0.6110, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 18/1177 [01:20<54:51,  2.84s/it, exist=0.4119, loss=0.6111, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 19/1177 [01:20<53:47,  2.79s/it, exist=0.4119, loss=0.6111, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 19/1177 [01:23<53:47,  2.79s/it, exist=0.4167, loss=0.6154, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 20/1177 [01:23<54:33,  2.83s/it, exist=0.4167, loss=0.6154, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 20/1177 [01:28<54:33,  2.83s/it, exist=0.4163, loss=0.6190, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 21/1177 [01:28<1:04:35,  3.35s/it, exist=0.4163, loss=0.6190, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 21/1177 [01:31<1:04:35,  3.35s/it, exist=0.4122, loss=0.6105, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 22/1177 [01:31<1:06:03,  3.43s/it, exist=0.4122, loss=0.6105, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 22/1177 [01:34<1:06:03,  3.43s/it, exist=0.4182, loss=0.6152, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 23/1177 [01:34<1:01:04,  3.18s/it, exist=0.4182, loss=0.6152, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 23/1177 [01:36<1:01:04,  3.18s/it, exist=0.4175, loss=0.6124, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 24/1177 [01:36<54:46,  2.85s/it, exist=0.4175, loss=0.6124, lr=4.84e-05]  
Epoch 2/5:   2%|▏         | 24/1177 [01:39<54:46,  2.85s/it, exist=0.4237, loss=0.6183, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 25/1177 [01:39<53:38,  2.79s/it, exist=0.4237, loss=0.6183, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 25/1177 [01:41<53:38,  2.79s/it, exist=0.4183, loss=0.6102, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 26/1177 [01:41<52:19,  2.73s/it, exist=0.4183, loss=0.6102, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 26/1177 [01:43<52:19,  2.73s/it, exist=0.4169, loss=0.6071, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 27/1177 [01:43<48:25,  2.53s/it, exist=0.4169, loss=0.6071, lr=4.84e-05]
Epoch 2/5:   2%|▏         | 27/1177 [01:47<48:25,  2.53s/it, exist=0.4186, loss=0.6068, lr=4.83e-05]
Epoch 2/5:   2%|▏         | 28/1177 [01:47<52:46,  2.76s/it, exist=0.4186, loss=0.6068, lr=4.83e-05]
Epoch 2/5:   2%|▏         | 28/1177 [01:49<52:46,  2.76s/it, exist=0.4173, loss=0.6045, lr=4.83e-05]
Epoch 2/5:   2%|▏         | 29/1177 [01:49<48:46,  2.55s/it, exist=0.4173, loss=0.6045, lr=4.83e-05]
Epoch 2/5:   2%|▏         | 29/1177 [01:51<48:46,  2.55s/it, exist=0.4200, loss=0.6085, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 30/1177 [01:51<49:21,  2.58s/it, exist=0.4200, loss=0.6085, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 30/1177 [01:54<49:21,  2.58s/it, exist=0.4150, loss=0.6065, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 31/1177 [01:54<49:31,  2.59s/it, exist=0.4150, loss=0.6065, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 31/1177 [01:57<49:31,  2.59s/it, exist=0.4152, loss=0.6041, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 32/1177 [01:57<53:29,  2.80s/it, exist=0.4152, loss=0.6041, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 32/1177 [02:00<53:29,  2.80s/it, exist=0.4278, loss=0.6152, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 33/1177 [02:00<52:10,  2.74s/it, exist=0.4278, loss=0.6152, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 33/1177 [02:02<52:10,  2.74s/it, exist=0.4217, loss=0.6085, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 34/1177 [02:02<50:40,  2.66s/it, exist=0.4217, loss=0.6085, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 34/1177 [02:05<50:40,  2.66s/it, exist=0.4194, loss=0.6082, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 35/1177 [02:05<49:22,  2.59s/it, exist=0.4194, loss=0.6082, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 35/1177 [02:07<49:22,  2.59s/it, exist=0.4205, loss=0.6097, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 36/1177 [02:07<49:56,  2.63s/it, exist=0.4205, loss=0.6097, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 36/1177 [02:10<49:56,  2.63s/it, exist=0.4199, loss=0.6093, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 37/1177 [02:10<50:05,  2.64s/it, exist=0.4199, loss=0.6093, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 37/1177 [02:12<50:05,  2.64s/it, exist=0.4185, loss=0.6100, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 38/1177 [02:12<46:31,  2.45s/it, exist=0.4185, loss=0.6100, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 38/1177 [02:15<46:31,  2.45s/it, exist=0.4161, loss=0.6075, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 39/1177 [02:15<49:53,  2.63s/it, exist=0.4161, loss=0.6075, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 39/1177 [02:18<49:53,  2.63s/it, exist=0.4236, loss=0.6138, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 40/1177 [02:18<53:27,  2.82s/it, exist=0.4236, loss=0.6138, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 40/1177 [02:20<53:27,  2.82s/it, exist=0.4264, loss=0.6183, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 41/1177 [02:20<48:46,  2.58s/it, exist=0.4264, loss=0.6183, lr=4.83e-05]
Epoch 2/5:   3%|▎         | 41/1177 [02:23<48:46,  2.58s/it, exist=0.4216, loss=0.6146, lr=4.83e-05]
Epoch 2/5:   4%|▎         | 42/1177 [02:23<48:07,  2.54s/it, exist=0.4216, loss=0.6146, lr=4.83e-05]
Epoch 2/5:   4%|▎         | 42/1177 [02:25<48:07,  2.54s/it, exist=0.4231, loss=0.6184, lr=4.83e-05]
Epoch 2/5:   4%|▎         | 43/1177 [02:25<47:50,  2.53s/it, exist=0.4231, loss=0.6184, lr=4.83e-05]
Epoch 2/5:   4%|▎         | 43/1177 [02:28<47:50,  2.53s/it, exist=0.4209, loss=0.6152, lr=4.83e-05]
Epoch 2/5:   4%|▎         | 44/1177 [02:28<47:45,  2.53s/it, exist=0.4209, loss=0.6152, lr=4.83e-05]
Epoch 2/5:   4%|▎         | 44/1177 [02:30<47:45,  2.53s/it, exist=0.4170, loss=0.6126, lr=4.83e-05]
Epoch 2/5:   4%|▍         | 45/1177 [02:30<47:41,  2.53s/it, exist=0.4170, loss=0.6126, lr=4.83e-05]
Epoch 2/5:   4%|▍         | 45/1177 [02:33<47:41,  2.53s/it, exist=0.4162, loss=0.6101, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 46/1177 [02:33<47:42,  2.53s/it, exist=0.4162, loss=0.6101, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 46/1177 [02:35<47:42,  2.53s/it, exist=0.4118, loss=0.6067, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 47/1177 [02:35<47:19,  2.51s/it, exist=0.4118, loss=0.6067, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 47/1177 [02:38<47:19,  2.51s/it, exist=0.4151, loss=0.6103, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 48/1177 [02:38<48:08,  2.56s/it, exist=0.4151, loss=0.6103, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 48/1177 [02:40<48:08,  2.56s/it, exist=0.4111, loss=0.6094, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 49/1177 [02:40<45:16,  2.41s/it, exist=0.4111, loss=0.6094, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 49/1177 [02:43<45:16,  2.41s/it, exist=0.4115, loss=0.6114, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 50/1177 [02:43<49:36,  2.64s/it, exist=0.4115, loss=0.6114, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 50/1177 [02:46<49:36,  2.64s/it, exist=0.4095, loss=0.6080, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 51/1177 [02:46<49:17,  2.63s/it, exist=0.4095, loss=0.6080, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 51/1177 [02:49<49:17,  2.63s/it, exist=0.4060, loss=0.6038, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 52/1177 [02:49<49:54,  2.66s/it, exist=0.4060, loss=0.6038, lr=4.82e-05]
Epoch 2/5:   4%|▍         | 52/1177 [02:51<49:54,  2.66s/it, exist=0.4042, loss=0.6015, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 53/1177 [02:51<49:04,  2.62s/it, exist=0.4042, loss=0.6015, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 53/1177 [02:54<49:04,  2.62s/it, exist=0.4085, loss=0.6055, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 54/1177 [02:54<47:52,  2.56s/it, exist=0.4085, loss=0.6055, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 54/1177 [02:56<47:52,  2.56s/it, exist=0.4091, loss=0.6058, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 55/1177 [02:56<48:10,  2.58s/it, exist=0.4091, loss=0.6058, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 55/1177 [02:59<48:10,  2.58s/it, exist=0.4091, loss=0.6056, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 56/1177 [02:59<48:51,  2.61s/it, exist=0.4091, loss=0.6056, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 56/1177 [03:02<48:51,  2.61s/it, exist=0.4097, loss=0.6057, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 57/1177 [03:02<49:23,  2.65s/it, exist=0.4097, loss=0.6057, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 57/1177 [03:04<49:23,  2.65s/it, exist=0.4061, loss=0.6009, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 58/1177 [03:04<48:57,  2.62s/it, exist=0.4061, loss=0.6009, lr=4.82e-05]
Epoch 2/5:   5%|▍         | 58/1177 [03:06<48:57,  2.62s/it, exist=0.4128, loss=0.6071, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 59/1177 [03:06<45:44,  2.46s/it, exist=0.4128, loss=0.6071, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 59/1177 [03:10<45:44,  2.46s/it, exist=0.4172, loss=0.6112, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 60/1177 [03:10<50:36,  2.72s/it, exist=0.4172, loss=0.6112, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 60/1177 [03:12<50:36,  2.72s/it, exist=0.4196, loss=0.6130, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 61/1177 [03:12<50:09,  2.70s/it, exist=0.4196, loss=0.6130, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 61/1177 [03:15<50:09,  2.70s/it, exist=0.4156, loss=0.6093, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 62/1177 [03:15<48:23,  2.60s/it, exist=0.4156, loss=0.6093, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 62/1177 [03:17<48:23,  2.60s/it, exist=0.4176, loss=0.6100, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 63/1177 [03:17<48:09,  2.59s/it, exist=0.4176, loss=0.6100, lr=4.82e-05]
Epoch 2/5:   5%|▌         | 63/1177 [03:20<48:09,  2.59s/it, exist=0.4186, loss=0.6108, lr=4.81e-05]
Epoch 2/5:   5%|▌         | 64/1177 [03:20<48:29,  2.61s/it, exist=0.4186, loss=0.6108, lr=4.81e-05]
Epoch 2/5:   5%|▌         | 64/1177 [03:22<48:29,  2.61s/it, exist=0.4179, loss=0.6111, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 65/1177 [03:22<47:38,  2.57s/it, exist=0.4179, loss=0.6111, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 65/1177 [03:25<47:38,  2.57s/it, exist=0.4147, loss=0.6087, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 66/1177 [03:25<47:28,  2.56s/it, exist=0.4147, loss=0.6087, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 66/1177 [03:27<47:28,  2.56s/it, exist=0.4127, loss=0.6067, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 67/1177 [03:27<47:26,  2.56s/it, exist=0.4127, loss=0.6067, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 67/1177 [03:30<47:26,  2.56s/it, exist=0.4090, loss=0.6031, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 68/1177 [03:30<48:07,  2.60s/it, exist=0.4090, loss=0.6031, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 68/1177 [03:33<48:07,  2.60s/it, exist=0.4067, loss=0.6005, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 69/1177 [03:33<47:53,  2.59s/it, exist=0.4067, loss=0.6005, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 69/1177 [03:35<47:53,  2.59s/it, exist=0.4052, loss=0.5977, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 70/1177 [03:35<44:32,  2.41s/it, exist=0.4052, loss=0.5977, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 70/1177 [03:38<44:32,  2.41s/it, exist=0.4052, loss=0.5990, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 71/1177 [03:38<48:53,  2.65s/it, exist=0.4052, loss=0.5990, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 71/1177 [03:41<48:53,  2.65s/it, exist=0.4045, loss=0.5981, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 72/1177 [03:41<50:26,  2.74s/it, exist=0.4045, loss=0.5981, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 72/1177 [03:45<50:26,  2.74s/it, exist=0.4029, loss=0.5968, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 73/1177 [03:45<56:51,  3.09s/it, exist=0.4029, loss=0.5968, lr=4.81e-05]
Epoch 2/5:   6%|▌         | 73/1177 [03:49<56:51,  3.09s/it, exist=0.4046, loss=0.5979, lr=4.81e-05]
Epoch 2/5:   6%|▋         | 74/1177 [03:49<1:02:33,  3.40s/it, exist=0.4046, loss=0.5979, lr=4.81e-05]
Epoch 2/5:   6%|▋         | 74/1177 [03:52<1:02:33,  3.40s/it, exist=0.4030, loss=0.5962, lr=4.81e-05]
Epoch 2/5:   6%|▋         | 75/1177 [03:52<1:01:15,  3.34s/it, exist=0.4030, loss=0.5962, lr=4.81e-05]
Epoch 2/5:   6%|▋         | 75/1177 [03:55<1:01:15,  3.34s/it, exist=0.4037, loss=0.5966, lr=4.81e-05]
Epoch 2/5:   6%|▋         | 76/1177 [03:55<57:57,  3.16s/it, exist=0.4037, loss=0.5966, lr=4.81e-05]  
Epoch 2/5:   6%|▋         | 76/1177 [03:57<57:57,  3.16s/it, exist=0.4003, loss=0.5940, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 77/1177 [03:57<51:55,  2.83s/it, exist=0.4003, loss=0.5940, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 77/1177 [03:59<51:55,  2.83s/it, exist=0.3991, loss=0.5926, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 78/1177 [03:59<50:15,  2.74s/it, exist=0.3991, loss=0.5926, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 78/1177 [04:02<50:15,  2.74s/it, exist=0.3964, loss=0.5904, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 79/1177 [04:02<48:25,  2.65s/it, exist=0.3964, loss=0.5904, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 79/1177 [04:04<48:25,  2.65s/it, exist=0.3947, loss=0.5877, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 80/1177 [04:04<45:00,  2.46s/it, exist=0.3947, loss=0.5877, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 80/1177 [04:06<45:00,  2.46s/it, exist=0.3962, loss=0.5905, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 81/1177 [04:06<43:48,  2.40s/it, exist=0.3962, loss=0.5905, lr=4.81e-05]
Epoch 2/5:   7%|▋         | 81/1177 [04:10<43:48,  2.40s/it, exist=0.3980, loss=0.5927, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 82/1177 [04:10<50:49,  2.78s/it, exist=0.3980, loss=0.5927, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 82/1177 [04:12<50:49,  2.78s/it, exist=0.3961, loss=0.5910, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 83/1177 [04:12<49:39,  2.72s/it, exist=0.3961, loss=0.5910, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 83/1177 [04:16<49:39,  2.72s/it, exist=0.3949, loss=0.5906, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 84/1177 [04:16<51:43,  2.84s/it, exist=0.3949, loss=0.5906, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 84/1177 [04:18<51:43,  2.84s/it, exist=0.3965, loss=0.5935, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 85/1177 [04:18<47:30,  2.61s/it, exist=0.3965, loss=0.5935, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 85/1177 [04:20<47:30,  2.61s/it, exist=0.3975, loss=0.5956, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 86/1177 [04:20<44:21,  2.44s/it, exist=0.3975, loss=0.5956, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 86/1177 [04:23<44:21,  2.44s/it, exist=0.3971, loss=0.5945, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 87/1177 [04:23<48:59,  2.70s/it, exist=0.3971, loss=0.5945, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 87/1177 [04:26<48:59,  2.70s/it, exist=0.3953, loss=0.5920, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 88/1177 [04:26<48:34,  2.68s/it, exist=0.3953, loss=0.5920, lr=4.80e-05]
Epoch 2/5:   7%|▋         | 88/1177 [04:28<48:34,  2.68s/it, exist=0.3963, loss=0.5935, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 89/1177 [04:28<45:48,  2.53s/it, exist=0.3963, loss=0.5935, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 89/1177 [04:30<45:48,  2.53s/it, exist=0.3973, loss=0.5946, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 90/1177 [04:30<46:42,  2.58s/it, exist=0.3973, loss=0.5946, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 90/1177 [04:34<46:42,  2.58s/it, exist=0.3975, loss=0.5942, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 91/1177 [04:34<53:16,  2.94s/it, exist=0.3975, loss=0.5942, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 91/1177 [04:37<53:16,  2.94s/it, exist=0.3973, loss=0.5935, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 92/1177 [04:37<51:17,  2.84s/it, exist=0.3973, loss=0.5935, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 92/1177 [04:41<51:17,  2.84s/it, exist=0.4002, loss=0.5967, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 93/1177 [04:41<1:00:12,  3.33s/it, exist=0.4002, loss=0.5967, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 93/1177 [04:44<1:00:12,  3.33s/it, exist=0.4014, loss=0.5986, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 94/1177 [04:44<57:54,  3.21s/it, exist=0.4014, loss=0.5986, lr=4.80e-05]  
Epoch 2/5:   8%|▊         | 94/1177 [04:48<57:54,  3.21s/it, exist=0.4054, loss=0.6021, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 95/1177 [04:48<1:02:25,  3.46s/it, exist=0.4054, loss=0.6021, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 95/1177 [04:51<1:02:25,  3.46s/it, exist=0.4070, loss=0.6040, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 96/1177 [04:51<59:46,  3.32s/it, exist=0.4070, loss=0.6040, lr=4.80e-05]  
Epoch 2/5:   8%|▊         | 96/1177 [04:54<59:46,  3.32s/it, exist=0.4111, loss=0.6089, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 97/1177 [04:54<54:58,  3.05s/it, exist=0.4111, loss=0.6089, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 97/1177 [04:56<54:58,  3.05s/it, exist=0.4097, loss=0.6072, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 98/1177 [04:56<49:09,  2.73s/it, exist=0.4097, loss=0.6072, lr=4.80e-05]
Epoch 2/5:   8%|▊         | 98/1177 [04:58<49:09,  2.73s/it, exist=0.4086, loss=0.6055, lr=4.79e-05]
Epoch 2/5:   8%|▊         | 99/1177 [04:58<48:27,  2.70s/it, exist=0.4086, loss=0.6055, lr=4.79e-05]
Epoch 2/5:   8%|▊         | 99/1177 [05:01<48:27,  2.70s/it, exist=0.4080, loss=0.6047, lr=4.79e-05]
Epoch 2/5:   8%|▊         | 100/1177 [05:01<47:50,  2.67s/it, exist=0.4080, loss=0.6047, lr=4.79e-05]
Epoch 2/5:   8%|▊         | 100/1177 [05:04<47:50,  2.67s/it, exist=0.4100, loss=0.6093, lr=4.79e-05]
Epoch 2/5:   9%|▊         | 101/1177 [05:04<47:37,  2.66s/it, exist=0.4100, loss=0.6093, lr=4.79e-05]
Epoch 2/5:   9%|▊         | 101/1177 [05:06<47:37,  2.66s/it, exist=0.4110, loss=0.6098, lr=4.79e-05]
Epoch 2/5:   9%|▊         | 102/1177 [05:06<46:44,  2.61s/it, exist=0.4110, loss=0.6098, lr=4.79e-05]
Epoch 2/5:   9%|▊         | 102/1177 [05:09<46:44,  2.61s/it, exist=0.4116, loss=0.6139, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 103/1177 [05:09<46:23,  2.59s/it, exist=0.4116, loss=0.6139, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 103/1177 [05:11<46:23,  2.59s/it, exist=0.4114, loss=0.6135, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 104/1177 [05:11<46:45,  2.61s/it, exist=0.4114, loss=0.6135, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 104/1177 [05:13<46:45,  2.61s/it, exist=0.4109, loss=0.6133, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 105/1177 [05:13<43:55,  2.46s/it, exist=0.4109, loss=0.6133, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 105/1177 [05:16<43:55,  2.46s/it, exist=0.4112, loss=0.6133, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 106/1177 [05:16<44:03,  2.47s/it, exist=0.4112, loss=0.6133, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 106/1177 [05:19<44:03,  2.47s/it, exist=0.4113, loss=0.6140, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 107/1177 [05:19<47:58,  2.69s/it, exist=0.4113, loss=0.6140, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 107/1177 [05:22<47:58,  2.69s/it, exist=0.4093, loss=0.6113, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 108/1177 [05:22<47:32,  2.67s/it, exist=0.4093, loss=0.6113, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 108/1177 [05:24<47:32,  2.67s/it, exist=0.4088, loss=0.6110, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 109/1177 [05:24<44:30,  2.50s/it, exist=0.4088, loss=0.6110, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 109/1177 [05:29<44:30,  2.50s/it, exist=0.4100, loss=0.6115, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 110/1177 [05:29<58:34,  3.29s/it, exist=0.4100, loss=0.6115, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 110/1177 [05:32<58:34,  3.29s/it, exist=0.4091, loss=0.6112, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 111/1177 [05:32<59:24,  3.34s/it, exist=0.4091, loss=0.6112, lr=4.79e-05]
Epoch 2/5:   9%|▉         | 111/1177 [05:36<59:24,  3.34s/it, exist=0.4081, loss=0.6093, lr=4.79e-05]
Epoch 2/5:  10%|▉         | 112/1177 [05:36<59:59,  3.38s/it, exist=0.4081, loss=0.6093, lr=4.79e-05]
Epoch 2/5:  10%|▉         | 112/1177 [05:40<59:59,  3.38s/it, exist=0.4075, loss=0.6084, lr=4.79e-05]
Epoch 2/5:  10%|▉         | 113/1177 [05:40<1:02:52,  3.55s/it, exist=0.4075, loss=0.6084, lr=4.79e-05]
Epoch 2/5:  10%|▉         | 113/1177 [05:43<1:02:52,  3.55s/it, exist=0.4062, loss=0.6066, lr=4.79e-05]
Epoch 2/5:  10%|▉         | 114/1177 [05:43<59:27,  3.36s/it, exist=0.4062, loss=0.6066, lr=4.79e-05]  
Epoch 2/5:  10%|▉         | 114/1177 [05:47<59:27,  3.36s/it, exist=0.4080, loss=0.6079, lr=4.79e-05]
Epoch 2/5:  10%|▉         | 115/1177 [05:47<1:04:19,  3.63s/it, exist=0.4080, loss=0.6079, lr=4.79e-05]
Epoch 2/5:  10%|▉         | 115/1177 [05:49<1:04:19,  3.63s/it, exist=0.4079, loss=0.6074, lr=4.78e-05]
Epoch 2/5:  10%|▉         | 116/1177 [05:49<56:34,  3.20s/it, exist=0.4079, loss=0.6074, lr=4.78e-05]  
Epoch 2/5:  10%|▉         | 116/1177 [05:53<56:34,  3.20s/it, exist=0.4075, loss=0.6077, lr=4.78e-05]
Epoch 2/5:  10%|▉         | 117/1177 [05:53<1:01:56,  3.51s/it, exist=0.4075, loss=0.6077, lr=4.78e-05]
Epoch 2/5:  10%|▉         | 117/1177 [05:57<1:01:56,  3.51s/it, exist=0.4101, loss=0.6105, lr=4.78e-05]
Epoch 2/5:  10%|█         | 118/1177 [05:57<1:02:16,  3.53s/it, exist=0.4101, loss=0.6105, lr=4.78e-05]
Epoch 2/5:  10%|█         | 118/1177 [06:00<1:02:16,  3.53s/it, exist=0.4084, loss=0.6089, lr=4.78e-05]
Epoch 2/5:  10%|█         | 119/1177 [06:00<59:59,  3.40s/it, exist=0.4084, loss=0.6089, lr=4.78e-05]  
Epoch 2/5:  10%|█         | 119/1177 [06:03<59:59,  3.40s/it, exist=0.4087, loss=0.6092, lr=4.78e-05]
Epoch 2/5:  10%|█         | 120/1177 [06:03<57:22,  3.26s/it, exist=0.4087, loss=0.6092, lr=4.78e-05]
Epoch 2/5:  10%|█         | 120/1177 [06:07<57:22,  3.26s/it, exist=0.4074, loss=0.6077, lr=4.78e-05]
Epoch 2/5:  10%|█         | 121/1177 [06:07<1:00:03,  3.41s/it, exist=0.4074, loss=0.6077, lr=4.78e-05]
Epoch 2/5:  10%|█         | 121/1177 [06:10<1:00:03,  3.41s/it, exist=0.4097, loss=0.6094, lr=4.78e-05]
Epoch 2/5:  10%|█         | 122/1177 [06:10<1:00:44,  3.45s/it, exist=0.4097, loss=0.6094, lr=4.78e-05]
Epoch 2/5:  10%|█         | 122/1177 [06:13<1:00:44,  3.45s/it, exist=0.4086, loss=0.6081, lr=4.78e-05]
Epoch 2/5:  10%|█         | 123/1177 [06:13<59:02,  3.36s/it, exist=0.4086, loss=0.6081, lr=4.78e-05]  
Epoch 2/5:  10%|█         | 123/1177 [06:17<59:02,  3.36s/it, exist=0.4069, loss=0.6064, lr=4.78e-05]
Epoch 2/5:  11%|█         | 124/1177 [06:17<57:51,  3.30s/it, exist=0.4069, loss=0.6064, lr=4.78e-05]
Epoch 2/5:  11%|█         | 124/1177 [06:19<57:51,  3.30s/it, exist=0.4065, loss=0.6060, lr=4.78e-05]
Epoch 2/5:  11%|█         | 125/1177 [06:19<53:43,  3.06s/it, exist=0.4065, loss=0.6060, lr=4.78e-05]
Epoch 2/5:  11%|█         | 125/1177 [06:23<53:43,  3.06s/it, exist=0.4061, loss=0.6054, lr=4.78e-05]
Epoch 2/5:  11%|█         | 126/1177 [06:23<1:00:00,  3.43s/it, exist=0.4061, loss=0.6054, lr=4.78e-05]
Epoch 2/5:  11%|█         | 126/1177 [06:26<1:00:00,  3.43s/it, exist=0.4052, loss=0.6039, lr=4.78e-05]
Epoch 2/5:  11%|█         | 127/1177 [06:26<57:57,  3.31s/it, exist=0.4052, loss=0.6039, lr=4.78e-05]  
Epoch 2/5:  11%|█         | 127/1177 [06:29<57:57,  3.31s/it, exist=0.4045, loss=0.6032, lr=4.78e-05]
Epoch 2/5:  11%|█         | 128/1177 [06:29<56:01,  3.20s/it, exist=0.4045, loss=0.6032, lr=4.78e-05]
Epoch 2/5:  11%|█         | 128/1177 [06:32<56:01,  3.20s/it, exist=0.4023, loss=0.6004, lr=4.78e-05]
Epoch 2/5:  11%|█         | 129/1177 [06:32<52:19,  3.00s/it, exist=0.4023, loss=0.6004, lr=4.78e-05]
Epoch 2/5:  11%|█         | 129/1177 [06:34<52:19,  3.00s/it, exist=0.4035, loss=0.6014, lr=4.78e-05]
Epoch 2/5:  11%|█         | 130/1177 [06:34<46:58,  2.69s/it, exist=0.4035, loss=0.6014, lr=4.78e-05]
Epoch 2/5:  11%|█         | 130/1177 [06:36<46:58,  2.69s/it, exist=0.4046, loss=0.6022, lr=4.78e-05]
Epoch 2/5:  11%|█         | 131/1177 [06:36<43:17,  2.48s/it, exist=0.4046, loss=0.6022, lr=4.78e-05]
Epoch 2/5:  11%|█         | 131/1177 [06:39<43:17,  2.48s/it, exist=0.4053, loss=0.6031, lr=4.77e-05]
Epoch 2/5:  11%|█         | 132/1177 [06:39<47:03,  2.70s/it, exist=0.4053, loss=0.6031, lr=4.77e-05]
Epoch 2/5:  11%|█         | 132/1177 [06:42<47:03,  2.70s/it, exist=0.4050, loss=0.6034, lr=4.77e-05]
Epoch 2/5:  11%|█▏        | 133/1177 [06:42<45:44,  2.63s/it, exist=0.4050, loss=0.6034, lr=4.77e-05]
Epoch 2/5:  11%|█▏        | 133/1177 [06:44<45:44,  2.63s/it, exist=0.4039, loss=0.6020, lr=4.77e-05]
Epoch 2/5:  11%|█▏        | 134/1177 [06:44<45:33,  2.62s/it, exist=0.4039, loss=0.6020, lr=4.77e-05]
Epoch 2/5:  11%|█▏        | 134/1177 [06:47<45:33,  2.62s/it, exist=0.4034, loss=0.6016, lr=4.77e-05]
Epoch 2/5:  11%|█▏        | 135/1177 [06:47<45:32,  2.62s/it, exist=0.4034, loss=0.6016, lr=4.77e-05]
Epoch 2/5:  11%|█▏        | 135/1177 [06:50<45:32,  2.62s/it, exist=0.4024, loss=0.6001, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 136/1177 [06:50<46:01,  2.65s/it, exist=0.4024, loss=0.6001, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 136/1177 [06:52<46:01,  2.65s/it, exist=0.4031, loss=0.6022, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 137/1177 [06:52<45:53,  2.65s/it, exist=0.4031, loss=0.6022, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 137/1177 [06:54<45:53,  2.65s/it, exist=0.4019, loss=0.6013, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 138/1177 [06:54<43:00,  2.48s/it, exist=0.4019, loss=0.6013, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 138/1177 [06:57<43:00,  2.48s/it, exist=0.4025, loss=0.6014, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 139/1177 [06:57<46:49,  2.71s/it, exist=0.4025, loss=0.6014, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 139/1177 [07:00<46:49,  2.71s/it, exist=0.4027, loss=0.6028, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 140/1177 [07:00<48:04,  2.78s/it, exist=0.4027, loss=0.6028, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 140/1177 [07:05<48:04,  2.78s/it, exist=0.4040, loss=0.6038, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 141/1177 [07:05<55:18,  3.20s/it, exist=0.4040, loss=0.6038, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 141/1177 [07:07<55:18,  3.20s/it, exist=0.4031, loss=0.6028, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 142/1177 [07:07<53:17,  3.09s/it, exist=0.4031, loss=0.6028, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 142/1177 [07:12<53:17,  3.09s/it, exist=0.4032, loss=0.6025, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 143/1177 [07:12<1:00:21,  3.50s/it, exist=0.4032, loss=0.6025, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 143/1177 [07:15<1:00:21,  3.50s/it, exist=0.4038, loss=0.6030, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 144/1177 [07:15<56:18,  3.27s/it, exist=0.4038, loss=0.6030, lr=4.77e-05]  
Epoch 2/5:  12%|█▏        | 144/1177 [07:17<56:18,  3.27s/it, exist=0.4062, loss=0.6065, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 145/1177 [07:17<52:04,  3.03s/it, exist=0.4062, loss=0.6065, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 145/1177 [07:19<52:04,  3.03s/it, exist=0.4079, loss=0.6081, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 146/1177 [07:19<46:39,  2.71s/it, exist=0.4079, loss=0.6081, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 146/1177 [07:22<46:39,  2.71s/it, exist=0.4092, loss=0.6098, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 147/1177 [07:22<45:42,  2.66s/it, exist=0.4092, loss=0.6098, lr=4.77e-05]
Epoch 2/5:  12%|█▏        | 147/1177 [07:24<45:42,  2.66s/it, exist=0.4116, loss=0.6119, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 148/1177 [07:24<45:48,  2.67s/it, exist=0.4116, loss=0.6119, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 148/1177 [07:26<45:48,  2.67s/it, exist=0.4107, loss=0.6108, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 149/1177 [07:26<42:32,  2.48s/it, exist=0.4107, loss=0.6108, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 149/1177 [07:30<42:32,  2.48s/it, exist=0.4094, loss=0.6096, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 150/1177 [07:30<47:28,  2.77s/it, exist=0.4094, loss=0.6096, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 150/1177 [07:32<47:28,  2.77s/it, exist=0.4089, loss=0.6097, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 151/1177 [07:32<46:28,  2.72s/it, exist=0.4089, loss=0.6097, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 151/1177 [07:35<46:28,  2.72s/it, exist=0.4086, loss=0.6089, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 152/1177 [07:35<43:21,  2.54s/it, exist=0.4086, loss=0.6089, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 152/1177 [07:38<43:21,  2.54s/it, exist=0.4081, loss=0.6088, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 153/1177 [07:38<47:10,  2.76s/it, exist=0.4081, loss=0.6088, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 153/1177 [07:40<47:10,  2.76s/it, exist=0.4083, loss=0.6087, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 154/1177 [07:40<43:19,  2.54s/it, exist=0.4083, loss=0.6087, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 154/1177 [07:44<43:19,  2.54s/it, exist=0.4074, loss=0.6076, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 155/1177 [07:44<49:35,  2.91s/it, exist=0.4074, loss=0.6076, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 155/1177 [07:46<49:35,  2.91s/it, exist=0.4069, loss=0.6072, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 156/1177 [07:46<45:18,  2.66s/it, exist=0.4069, loss=0.6072, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 156/1177 [07:50<45:18,  2.66s/it, exist=0.4072, loss=0.6073, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 157/1177 [07:50<55:31,  3.27s/it, exist=0.4072, loss=0.6073, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 157/1177 [07:54<55:31,  3.27s/it, exist=0.4078, loss=0.6076, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 158/1177 [07:54<57:02,  3.36s/it, exist=0.4078, loss=0.6076, lr=4.76e-05]
Epoch 2/5:  13%|█▎        | 158/1177 [07:57<57:02,  3.36s/it, exist=0.4096, loss=0.6092, lr=4.76e-05]
Epoch 2/5:  14%|█▎        | 159/1177 [07:57<57:18,  3.38s/it, exist=0.4096, loss=0.6092, lr=4.76e-05]
Epoch 2/5:  14%|█▎        | 159/1177 [08:01<57:18,  3.38s/it, exist=0.4093, loss=0.6086, lr=4.76e-05]
Epoch 2/5:  14%|█▎        | 160/1177 [08:01<58:56,  3.48s/it, exist=0.4093, loss=0.6086, lr=4.76e-05]
Epoch 2/5:  14%|█▎        | 160/1177 [08:05<58:56,  3.48s/it, exist=0.4087, loss=0.6078, lr=4.76e-05]
Epoch 2/5:  14%|█▎        | 161/1177 [08:05<59:48,  3.53s/it, exist=0.4087, loss=0.6078, lr=4.76e-05]
Epoch 2/5:  14%|█▎        | 161/1177 [08:08<59:48,  3.53s/it, exist=0.4079, loss=0.6078, lr=4.76e-05]
Epoch 2/5:  14%|█▍        | 162/1177 [08:08<1:00:13,  3.56s/it, exist=0.4079, loss=0.6078, lr=4.76e-05]
Epoch 2/5:  14%|█▍        | 162/1177 [08:12<1:00:13,  3.56s/it, exist=0.4084, loss=0.6086, lr=4.76e-05]
Epoch 2/5:  14%|█▍        | 163/1177 [08:12<59:17,  3.51s/it, exist=0.4084, loss=0.6086, lr=4.76e-05]  
Epoch 2/5:  14%|█▍        | 163/1177 [08:15<59:17,  3.51s/it, exist=0.4069, loss=0.6067, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 164/1177 [08:15<58:36,  3.47s/it, exist=0.4069, loss=0.6067, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 164/1177 [08:19<58:36,  3.47s/it, exist=0.4074, loss=0.6079, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 165/1177 [08:19<59:16,  3.51s/it, exist=0.4074, loss=0.6079, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 165/1177 [08:22<59:16,  3.51s/it, exist=0.4076, loss=0.6085, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 166/1177 [08:22<59:14,  3.52s/it, exist=0.4076, loss=0.6085, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 166/1177 [08:25<59:14,  3.52s/it, exist=0.4069, loss=0.6074, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 167/1177 [08:25<53:37,  3.19s/it, exist=0.4069, loss=0.6074, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 167/1177 [08:27<53:37,  3.19s/it, exist=0.4070, loss=0.6072, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 168/1177 [08:27<47:34,  2.83s/it, exist=0.4070, loss=0.6072, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 168/1177 [08:29<47:34,  2.83s/it, exist=0.4062, loss=0.6063, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 169/1177 [08:29<46:38,  2.78s/it, exist=0.4062, loss=0.6063, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 169/1177 [08:31<46:38,  2.78s/it, exist=0.4057, loss=0.6054, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 170/1177 [08:31<42:50,  2.55s/it, exist=0.4057, loss=0.6054, lr=4.75e-05]
Epoch 2/5:  14%|█▍        | 170/1177 [08:34<42:50,  2.55s/it, exist=0.4062, loss=0.6057, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 171/1177 [08:34<42:51,  2.56s/it, exist=0.4062, loss=0.6057, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 171/1177 [08:37<42:51,  2.56s/it, exist=0.4055, loss=0.6054, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 172/1177 [08:37<46:40,  2.79s/it, exist=0.4055, loss=0.6054, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 172/1177 [08:40<46:40,  2.79s/it, exist=0.4067, loss=0.6064, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 173/1177 [08:40<44:38,  2.67s/it, exist=0.4067, loss=0.6064, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 173/1177 [08:42<44:38,  2.67s/it, exist=0.4066, loss=0.6062, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 174/1177 [08:42<42:01,  2.51s/it, exist=0.4066, loss=0.6062, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 174/1177 [08:45<42:01,  2.51s/it, exist=0.4059, loss=0.6051, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 175/1177 [08:45<43:38,  2.61s/it, exist=0.4059, loss=0.6051, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 175/1177 [08:48<43:38,  2.61s/it, exist=0.4064, loss=0.6055, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 176/1177 [08:48<46:11,  2.77s/it, exist=0.4064, loss=0.6055, lr=4.75e-05]
Epoch 2/5:  15%|█▍        | 176/1177 [08:52<46:11,  2.77s/it, exist=0.4072, loss=0.6066, lr=4.75e-05]
Epoch 2/5:  15%|█▌        | 177/1177 [08:52<55:02,  3.30s/it, exist=0.4072, loss=0.6066, lr=4.75e-05]
Epoch 2/5:  15%|█▌        | 177/1177 [08:56<55:02,  3.30s/it, exist=0.4068, loss=0.6064, lr=4.75e-05]
Epoch 2/5:  15%|█▌        | 178/1177 [08:56<56:16,  3.38s/it, exist=0.4068, loss=0.6064, lr=4.75e-05]
Epoch 2/5:  15%|█▌        | 178/1177 [09:01<56:16,  3.38s/it, exist=0.4059, loss=0.6055, lr=4.75e-05]
Epoch 2/5:  15%|█▌        | 179/1177 [09:01<1:04:36,  3.88s/it, exist=0.4059, loss=0.6055, lr=4.75e-05]
Epoch 2/5:  15%|█▌        | 179/1177 [09:04<1:04:36,  3.88s/it, exist=0.4060, loss=0.6054, lr=4.74e-05]
Epoch 2/5:  15%|█▌        | 180/1177 [09:04<59:35,  3.59s/it, exist=0.4060, loss=0.6054, lr=4.74e-05]  
Epoch 2/5:  15%|█▌        | 180/1177 [09:08<59:35,  3.59s/it, exist=0.4061, loss=0.6056, lr=4.74e-05]
Epoch 2/5:  15%|█▌        | 181/1177 [09:08<1:00:58,  3.67s/it, exist=0.4061, loss=0.6056, lr=4.74e-05]
Epoch 2/5:  15%|█▌        | 181/1177 [09:11<1:00:58,  3.67s/it, exist=0.4054, loss=0.6049, lr=4.74e-05]
Epoch 2/5:  15%|█▌        | 182/1177 [09:11<56:54,  3.43s/it, exist=0.4054, loss=0.6049, lr=4.74e-05]  
Epoch 2/5:  15%|█▌        | 182/1177 [09:15<56:54,  3.43s/it, exist=0.4047, loss=0.6040, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 183/1177 [09:15<1:01:49,  3.73s/it, exist=0.4047, loss=0.6040, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 183/1177 [09:19<1:01:49,  3.73s/it, exist=0.4048, loss=0.6061, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 184/1177 [09:19<1:02:35,  3.78s/it, exist=0.4048, loss=0.6061, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 184/1177 [09:23<1:02:35,  3.78s/it, exist=0.4040, loss=0.6050, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 185/1177 [09:23<1:02:44,  3.80s/it, exist=0.4040, loss=0.6050, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 185/1177 [09:27<1:02:44,  3.80s/it, exist=0.4039, loss=0.6047, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 186/1177 [09:27<1:05:13,  3.95s/it, exist=0.4039, loss=0.6047, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 186/1177 [09:31<1:05:13,  3.95s/it, exist=0.4034, loss=0.6041, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 187/1177 [09:31<1:02:50,  3.81s/it, exist=0.4034, loss=0.6041, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 187/1177 [09:33<1:02:50,  3.81s/it, exist=0.4049, loss=0.6069, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 188/1177 [09:33<57:00,  3.46s/it, exist=0.4049, loss=0.6069, lr=4.74e-05]  
Epoch 2/5:  16%|█▌        | 188/1177 [09:36<57:00,  3.46s/it, exist=0.4045, loss=0.6061, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 189/1177 [09:36<52:18,  3.18s/it, exist=0.4045, loss=0.6061, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 189/1177 [09:38<52:18,  3.18s/it, exist=0.4041, loss=0.6055, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 190/1177 [09:38<46:25,  2.82s/it, exist=0.4041, loss=0.6055, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 190/1177 [09:40<46:25,  2.82s/it, exist=0.4029, loss=0.6039, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 191/1177 [09:40<45:14,  2.75s/it, exist=0.4029, loss=0.6039, lr=4.74e-05]
Epoch 2/5:  16%|█▌        | 191/1177 [09:42<45:14,  2.75s/it, exist=0.4029, loss=0.6034, lr=4.74e-05]
Epoch 2/5:  16%|█▋        | 192/1177 [09:42<41:37,  2.54s/it, exist=0.4029, loss=0.6034, lr=4.74e-05]
Epoch 2/5:  16%|█▋        | 192/1177 [09:44<41:37,  2.54s/it, exist=0.4021, loss=0.6022, lr=4.74e-05]
Epoch 2/5:  16%|█▋        | 193/1177 [09:44<39:19,  2.40s/it, exist=0.4021, loss=0.6022, lr=4.74e-05]
Epoch 2/5:  16%|█▋        | 193/1177 [09:48<39:19,  2.40s/it, exist=0.4022, loss=0.6018, lr=4.74e-05]
Epoch 2/5:  16%|█▋        | 194/1177 [09:48<46:12,  2.82s/it, exist=0.4022, loss=0.6018, lr=4.74e-05]
Epoch 2/5:  16%|█▋        | 194/1177 [09:53<46:12,  2.82s/it, exist=0.4020, loss=0.6014, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 195/1177 [09:53<56:48,  3.47s/it, exist=0.4020, loss=0.6014, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 195/1177 [09:55<56:48,  3.47s/it, exist=0.4018, loss=0.6013, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 196/1177 [09:55<50:51,  3.11s/it, exist=0.4018, loss=0.6013, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 196/1177 [10:00<50:51,  3.11s/it, exist=0.4015, loss=0.6010, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 197/1177 [10:00<58:04,  3.56s/it, exist=0.4015, loss=0.6010, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 197/1177 [10:03<58:04,  3.56s/it, exist=0.4023, loss=0.6014, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 198/1177 [10:03<54:39,  3.35s/it, exist=0.4023, loss=0.6014, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 198/1177 [10:07<54:39,  3.35s/it, exist=0.4042, loss=0.6031, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 199/1177 [10:07<58:36,  3.60s/it, exist=0.4042, loss=0.6031, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 199/1177 [10:10<58:36,  3.60s/it, exist=0.4050, loss=0.6037, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 200/1177 [10:10<54:20,  3.34s/it, exist=0.4050, loss=0.6037, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 200/1177 [10:13<54:20,  3.34s/it, exist=0.4041, loss=0.6025, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 201/1177 [10:13<52:19,  3.22s/it, exist=0.4041, loss=0.6025, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 201/1177 [10:15<52:19,  3.22s/it, exist=0.4037, loss=0.6028, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 202/1177 [10:15<48:53,  3.01s/it, exist=0.4037, loss=0.6028, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 202/1177 [10:18<48:53,  3.01s/it, exist=0.4031, loss=0.6022, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 203/1177 [10:18<46:10,  2.84s/it, exist=0.4031, loss=0.6022, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 203/1177 [10:20<46:10,  2.84s/it, exist=0.4036, loss=0.6029, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 204/1177 [10:20<42:17,  2.61s/it, exist=0.4036, loss=0.6029, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 204/1177 [10:22<42:17,  2.61s/it, exist=0.4032, loss=0.6028, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 205/1177 [10:22<42:45,  2.64s/it, exist=0.4032, loss=0.6028, lr=4.73e-05]
Epoch 2/5:  17%|█▋        | 205/1177 [10:26<42:45,  2.64s/it, exist=0.4028, loss=0.6023, lr=4.73e-05]
Epoch 2/5:  18%|█▊        | 206/1177 [10:26<48:31,  3.00s/it, exist=0.4028, loss=0.6023, lr=4.73e-05]
Epoch 2/5:  18%|█▊        | 206/1177 [10:31<48:31,  3.00s/it, exist=0.4024, loss=0.6017, lr=4.73e-05]
Epoch 2/5:  18%|█▊        | 207/1177 [10:31<55:25,  3.43s/it, exist=0.4024, loss=0.6017, lr=4.73e-05]
Epoch 2/5:  18%|█▊        | 207/1177 [10:33<55:25,  3.43s/it, exist=0.4022, loss=0.6014, lr=4.73e-05]
Epoch 2/5:  18%|█▊        | 208/1177 [10:33<48:33,  3.01s/it, exist=0.4022, loss=0.6014, lr=4.73e-05]
Epoch 2/5:  18%|█▊        | 208/1177 [10:36<48:33,  3.01s/it, exist=0.4021, loss=0.6012, lr=4.73e-05]
Epoch 2/5:  18%|█▊        | 209/1177 [10:36<51:09,  3.17s/it, exist=0.4021, loss=0.6012, lr=4.73e-05]
Epoch 2/5:  18%|█▊        | 209/1177 [10:38<51:09,  3.17s/it, exist=0.4037, loss=0.6031, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 210/1177 [10:38<45:36,  2.83s/it, exist=0.4037, loss=0.6031, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 210/1177 [10:41<45:36,  2.83s/it, exist=0.4034, loss=0.6030, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 211/1177 [10:41<42:41,  2.65s/it, exist=0.4034, loss=0.6030, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 211/1177 [10:44<42:41,  2.65s/it, exist=0.4047, loss=0.6047, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 212/1177 [10:44<45:52,  2.85s/it, exist=0.4047, loss=0.6047, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 212/1177 [10:47<45:52,  2.85s/it, exist=0.4053, loss=0.6063, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 213/1177 [10:47<44:54,  2.80s/it, exist=0.4053, loss=0.6063, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 213/1177 [10:49<44:54,  2.80s/it, exist=0.4051, loss=0.6059, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 214/1177 [10:49<44:03,  2.75s/it, exist=0.4051, loss=0.6059, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 214/1177 [10:52<44:03,  2.75s/it, exist=0.4044, loss=0.6050, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 215/1177 [10:52<42:45,  2.67s/it, exist=0.4044, loss=0.6050, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 215/1177 [10:54<42:45,  2.67s/it, exist=0.4040, loss=0.6045, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 216/1177 [10:54<42:40,  2.66s/it, exist=0.4040, loss=0.6045, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 216/1177 [10:56<42:40,  2.66s/it, exist=0.4044, loss=0.6056, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 217/1177 [10:56<39:44,  2.48s/it, exist=0.4044, loss=0.6056, lr=4.72e-05]
Epoch 2/5:  18%|█▊        | 217/1177 [11:00<39:44,  2.48s/it, exist=0.4046, loss=0.6061, lr=4.72e-05]
Epoch 2/5:  19%|█▊        | 218/1177 [11:00<42:56,  2.69s/it, exist=0.4046, loss=0.6061, lr=4.72e-05]
Epoch 2/5:  19%|█▊        | 218/1177 [11:02<42:56,  2.69s/it, exist=0.4044, loss=0.6057, lr=4.72e-05]
Epoch 2/5:  19%|█▊        | 219/1177 [11:02<43:29,  2.72s/it, exist=0.4044, loss=0.6057, lr=4.72e-05]
Epoch 2/5:  19%|█▊        | 219/1177 [11:04<43:29,  2.72s/it, exist=0.4054, loss=0.6068, lr=4.72e-05]
Epoch 2/5:  19%|█▊        | 220/1177 [11:04<40:10,  2.52s/it, exist=0.4054, loss=0.6068, lr=4.72e-05]
Epoch 2/5:  19%|█▊        | 220/1177 [11:07<40:10,  2.52s/it, exist=0.4055, loss=0.6066, lr=4.72e-05]
Epoch 2/5:  19%|█▉        | 221/1177 [11:07<41:12,  2.59s/it, exist=0.4055, loss=0.6066, lr=4.72e-05]
Epoch 2/5:  19%|█▉        | 221/1177 [11:11<41:12,  2.59s/it, exist=0.4051, loss=0.6062, lr=4.72e-05]
Epoch 2/5:  19%|█▉        | 222/1177 [11:11<45:49,  2.88s/it, exist=0.4051, loss=0.6062, lr=4.72e-05]
Epoch 2/5:  19%|█▉        | 222/1177 [11:13<45:49,  2.88s/it, exist=0.4047, loss=0.6055, lr=4.72e-05]
Epoch 2/5:  19%|█▉        | 223/1177 [11:13<44:58,  2.83s/it, exist=0.4047, loss=0.6055, lr=4.72e-05]
Epoch 2/5:  19%|█▉        | 223/1177 [11:16<44:58,  2.83s/it, exist=0.4048, loss=0.6056, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 224/1177 [11:16<41:25,  2.61s/it, exist=0.4048, loss=0.6056, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 224/1177 [11:19<41:25,  2.61s/it, exist=0.4055, loss=0.6060, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 225/1177 [11:19<45:27,  2.87s/it, exist=0.4055, loss=0.6060, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 225/1177 [11:21<45:27,  2.87s/it, exist=0.4062, loss=0.6067, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 226/1177 [11:21<43:40,  2.76s/it, exist=0.4062, loss=0.6067, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 226/1177 [11:24<43:40,  2.76s/it, exist=0.4065, loss=0.6080, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 227/1177 [11:24<42:30,  2.68s/it, exist=0.4065, loss=0.6080, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 227/1177 [11:27<42:30,  2.68s/it, exist=0.4074, loss=0.6091, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 228/1177 [11:27<42:38,  2.70s/it, exist=0.4074, loss=0.6091, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 228/1177 [11:30<42:38,  2.70s/it, exist=0.4067, loss=0.6080, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 229/1177 [11:30<44:43,  2.83s/it, exist=0.4067, loss=0.6080, lr=4.71e-05]
Epoch 2/5:  19%|█▉        | 229/1177 [11:32<44:43,  2.83s/it, exist=0.4071, loss=0.6081, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 230/1177 [11:32<40:51,  2.59s/it, exist=0.4071, loss=0.6081, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 230/1177 [11:35<40:51,  2.59s/it, exist=0.4067, loss=0.6077, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 231/1177 [11:35<42:21,  2.69s/it, exist=0.4067, loss=0.6077, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 231/1177 [11:37<42:21,  2.69s/it, exist=0.4067, loss=0.6083, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 232/1177 [11:37<39:40,  2.52s/it, exist=0.4067, loss=0.6083, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 232/1177 [11:40<39:40,  2.52s/it, exist=0.4063, loss=0.6081, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 233/1177 [11:40<40:04,  2.55s/it, exist=0.4063, loss=0.6081, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 233/1177 [11:42<40:04,  2.55s/it, exist=0.4062, loss=0.6093, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 234/1177 [11:42<37:20,  2.38s/it, exist=0.4062, loss=0.6093, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 234/1177 [11:44<37:20,  2.38s/it, exist=0.4070, loss=0.6097, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 235/1177 [11:44<38:32,  2.45s/it, exist=0.4070, loss=0.6097, lr=4.71e-05]
Epoch 2/5:  20%|█▉        | 235/1177 [11:47<38:32,  2.45s/it, exist=0.4068, loss=0.6092, lr=4.71e-05]
Epoch 2/5:  20%|██        | 236/1177 [11:47<42:26,  2.71s/it, exist=0.4068, loss=0.6092, lr=4.71e-05]
Epoch 2/5:  20%|██        | 236/1177 [11:51<42:26,  2.71s/it, exist=0.4085, loss=0.6112, lr=4.71e-05]
Epoch 2/5:  20%|██        | 237/1177 [11:51<45:28,  2.90s/it, exist=0.4085, loss=0.6112, lr=4.71e-05]
Epoch 2/5:  20%|██        | 237/1177 [11:55<45:28,  2.90s/it, exist=0.4082, loss=0.6111, lr=4.71e-05]
Epoch 2/5:  20%|██        | 238/1177 [11:55<52:36,  3.36s/it, exist=0.4082, loss=0.6111, lr=4.71e-05]
Epoch 2/5:  20%|██        | 238/1177 [11:59<52:36,  3.36s/it, exist=0.4076, loss=0.6101, lr=4.70e-05]
Epoch 2/5:  20%|██        | 239/1177 [11:59<53:31,  3.42s/it, exist=0.4076, loss=0.6101, lr=4.70e-05]
Epoch 2/5:  20%|██        | 239/1177 [12:01<53:31,  3.42s/it, exist=0.4078, loss=0.6105, lr=4.70e-05]
Epoch 2/5:  20%|██        | 240/1177 [12:01<47:04,  3.01s/it, exist=0.4078, loss=0.6105, lr=4.70e-05]
Epoch 2/5:  20%|██        | 240/1177 [12:04<47:04,  3.01s/it, exist=0.4078, loss=0.6103, lr=4.70e-05]
Epoch 2/5:  20%|██        | 241/1177 [12:04<48:29,  3.11s/it, exist=0.4078, loss=0.6103, lr=4.70e-05]
Epoch 2/5:  20%|██        | 241/1177 [12:09<48:29,  3.11s/it, exist=0.4078, loss=0.6102, lr=4.70e-05]
Epoch 2/5:  21%|██        | 242/1177 [12:09<54:35,  3.50s/it, exist=0.4078, loss=0.6102, lr=4.70e-05]
Epoch 2/5:  21%|██        | 242/1177 [12:12<54:35,  3.50s/it, exist=0.4079, loss=0.6102, lr=4.70e-05]
Epoch 2/5:  21%|██        | 243/1177 [12:12<54:51,  3.52s/it, exist=0.4079, loss=0.6102, lr=4.70e-05]
Epoch 2/5:  21%|██        | 243/1177 [12:15<54:51,  3.52s/it, exist=0.4079, loss=0.6102, lr=4.70e-05]
Epoch 2/5:  21%|██        | 244/1177 [12:15<50:40,  3.26s/it, exist=0.4079, loss=0.6102, lr=4.70e-05]
Epoch 2/5:  21%|██        | 244/1177 [12:17<50:40,  3.26s/it, exist=0.4079, loss=0.6105, lr=4.70e-05]
Epoch 2/5:  21%|██        | 245/1177 [12:17<44:41,  2.88s/it, exist=0.4079, loss=0.6105, lr=4.70e-05]
Epoch 2/5:  21%|██        | 245/1177 [12:20<44:41,  2.88s/it, exist=0.4075, loss=0.6101, lr=4.70e-05]
Epoch 2/5:  21%|██        | 246/1177 [12:20<48:07,  3.10s/it, exist=0.4075, loss=0.6101, lr=4.70e-05]
Epoch 2/5:  21%|██        | 246/1177 [12:24<48:07,  3.10s/it, exist=0.4083, loss=0.6104, lr=4.70e-05]
Epoch 2/5:  21%|██        | 247/1177 [12:24<50:24,  3.25s/it, exist=0.4083, loss=0.6104, lr=4.70e-05]
Epoch 2/5:  21%|██        | 247/1177 [12:27<50:24,  3.25s/it, exist=0.4076, loss=0.6098, lr=4.70e-05]
Epoch 2/5:  21%|██        | 248/1177 [12:27<47:33,  3.07s/it, exist=0.4076, loss=0.6098, lr=4.70e-05]
Epoch 2/5:  21%|██        | 248/1177 [12:31<47:33,  3.07s/it, exist=0.4081, loss=0.6103, lr=4.70e-05]
Epoch 2/5:  21%|██        | 249/1177 [12:31<54:50,  3.55s/it, exist=0.4081, loss=0.6103, lr=4.70e-05]
Epoch 2/5:  21%|██        | 249/1177 [12:34<54:50,  3.55s/it, exist=0.4091, loss=0.6111, lr=4.70e-05]
Epoch 2/5:  21%|██        | 250/1177 [12:34<51:36,  3.34s/it, exist=0.4091, loss=0.6111, lr=4.70e-05]
Epoch 2/5:  21%|██        | 250/1177 [12:38<51:36,  3.34s/it, exist=0.4092, loss=0.6110, lr=4.70e-05]
Epoch 2/5:  21%|██▏       | 251/1177 [12:38<53:39,  3.48s/it, exist=0.4092, loss=0.6110, lr=4.70e-05]
Epoch 2/5:  21%|██▏       | 251/1177 [12:43<53:39,  3.48s/it, exist=0.4090, loss=0.6116, lr=4.70e-05]
Epoch 2/5:  21%|██▏       | 252/1177 [12:43<59:45,  3.88s/it, exist=0.4090, loss=0.6116, lr=4.70e-05]
Epoch 2/5:  21%|██▏       | 252/1177 [12:47<59:45,  3.88s/it, exist=0.4088, loss=0.6112, lr=4.69e-05]
Epoch 2/5:  21%|██▏       | 253/1177 [12:47<58:47,  3.82s/it, exist=0.4088, loss=0.6112, lr=4.69e-05]
Epoch 2/5:  21%|██▏       | 253/1177 [12:50<58:47,  3.82s/it, exist=0.4084, loss=0.6114, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 254/1177 [12:50<57:49,  3.76s/it, exist=0.4084, loss=0.6114, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 254/1177 [12:54<57:49,  3.76s/it, exist=0.4075, loss=0.6109, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 255/1177 [12:54<56:57,  3.71s/it, exist=0.4075, loss=0.6109, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 255/1177 [12:58<56:57,  3.71s/it, exist=0.4070, loss=0.6100, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 256/1177 [12:58<57:32,  3.75s/it, exist=0.4070, loss=0.6100, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 256/1177 [13:01<57:32,  3.75s/it, exist=0.4061, loss=0.6090, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 257/1177 [13:01<53:46,  3.51s/it, exist=0.4061, loss=0.6090, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 257/1177 [13:05<53:46,  3.51s/it, exist=0.4066, loss=0.6092, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 258/1177 [13:05<58:04,  3.79s/it, exist=0.4066, loss=0.6092, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 258/1177 [13:08<58:04,  3.79s/it, exist=0.4066, loss=0.6089, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 259/1177 [13:08<52:34,  3.44s/it, exist=0.4066, loss=0.6089, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 259/1177 [13:10<52:34,  3.44s/it, exist=0.4064, loss=0.6084, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 260/1177 [13:10<48:49,  3.19s/it, exist=0.4064, loss=0.6084, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 260/1177 [13:12<48:49,  3.19s/it, exist=0.4078, loss=0.6095, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 261/1177 [13:12<43:06,  2.82s/it, exist=0.4078, loss=0.6095, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 261/1177 [13:15<43:06,  2.82s/it, exist=0.4077, loss=0.6090, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 262/1177 [13:15<42:04,  2.76s/it, exist=0.4077, loss=0.6090, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 262/1177 [13:17<42:04,  2.76s/it, exist=0.4091, loss=0.6104, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 263/1177 [13:17<38:24,  2.52s/it, exist=0.4091, loss=0.6104, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 263/1177 [13:20<38:24,  2.52s/it, exist=0.4083, loss=0.6096, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 264/1177 [13:20<41:56,  2.76s/it, exist=0.4083, loss=0.6096, lr=4.69e-05]
Epoch 2/5:  22%|██▏       | 264/1177 [13:23<41:56,  2.76s/it, exist=0.4074, loss=0.6087, lr=4.69e-05]
Epoch 2/5:  23%|██▎       | 265/1177 [13:23<41:22,  2.72s/it, exist=0.4074, loss=0.6087, lr=4.69e-05]
Epoch 2/5:  23%|██▎       | 265/1177 [13:25<41:22,  2.72s/it, exist=0.4071, loss=0.6085, lr=4.69e-05]
Epoch 2/5:  23%|██▎       | 266/1177 [13:25<39:39,  2.61s/it, exist=0.4071, loss=0.6085, lr=4.69e-05]
Epoch 2/5:  23%|██▎       | 266/1177 [13:28<39:39,  2.61s/it, exist=0.4077, loss=0.6092, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 267/1177 [13:28<41:13,  2.72s/it, exist=0.4077, loss=0.6092, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 267/1177 [13:30<41:13,  2.72s/it, exist=0.4073, loss=0.6087, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 268/1177 [13:30<38:07,  2.52s/it, exist=0.4073, loss=0.6087, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 268/1177 [13:33<38:07,  2.52s/it, exist=0.4072, loss=0.6087, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 269/1177 [13:33<38:20,  2.53s/it, exist=0.4072, loss=0.6087, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 269/1177 [13:35<38:20,  2.53s/it, exist=0.4070, loss=0.6084, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 270/1177 [13:35<35:53,  2.37s/it, exist=0.4070, loss=0.6084, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 270/1177 [13:38<35:53,  2.37s/it, exist=0.4064, loss=0.6079, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 271/1177 [13:38<41:11,  2.73s/it, exist=0.4064, loss=0.6079, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 271/1177 [13:40<41:11,  2.73s/it, exist=0.4054, loss=0.6070, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 272/1177 [13:40<37:50,  2.51s/it, exist=0.4054, loss=0.6070, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 272/1177 [13:43<37:50,  2.51s/it, exist=0.4056, loss=0.6075, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 273/1177 [13:43<38:16,  2.54s/it, exist=0.4056, loss=0.6075, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 273/1177 [13:45<38:16,  2.54s/it, exist=0.4051, loss=0.6069, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 274/1177 [13:45<35:53,  2.38s/it, exist=0.4051, loss=0.6069, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 274/1177 [13:47<35:53,  2.38s/it, exist=0.4042, loss=0.6066, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 275/1177 [13:47<36:45,  2.44s/it, exist=0.4042, loss=0.6066, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 275/1177 [13:51<36:45,  2.44s/it, exist=0.4042, loss=0.6064, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 276/1177 [13:51<40:51,  2.72s/it, exist=0.4042, loss=0.6064, lr=4.68e-05]
Epoch 2/5:  23%|██▎       | 276/1177 [13:53<40:51,  2.72s/it, exist=0.4036, loss=0.6057, lr=4.68e-05]
Epoch 2/5:  24%|██▎       | 277/1177 [13:53<40:22,  2.69s/it, exist=0.4036, loss=0.6057, lr=4.68e-05]
Epoch 2/5:  24%|██▎       | 277/1177 [13:56<40:22,  2.69s/it, exist=0.4028, loss=0.6045, lr=4.68e-05]
Epoch 2/5:  24%|██▎       | 278/1177 [13:56<39:23,  2.63s/it, exist=0.4028, loss=0.6045, lr=4.68e-05]
Epoch 2/5:  24%|██▎       | 278/1177 [13:58<39:23,  2.63s/it, exist=0.4036, loss=0.6050, lr=4.68e-05]
Epoch 2/5:  24%|██▎       | 279/1177 [13:58<38:28,  2.57s/it, exist=0.4036, loss=0.6050, lr=4.68e-05]
Epoch 2/5:  24%|██▎       | 279/1177 [14:01<38:28,  2.57s/it, exist=0.4028, loss=0.6040, lr=4.68e-05]
Epoch 2/5:  24%|██▍       | 280/1177 [14:01<38:30,  2.58s/it, exist=0.4028, loss=0.6040, lr=4.68e-05]
Epoch 2/5:  24%|██▍       | 280/1177 [14:04<38:30,  2.58s/it, exist=0.4033, loss=0.6045, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 281/1177 [14:04<38:40,  2.59s/it, exist=0.4033, loss=0.6045, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 281/1177 [14:06<38:40,  2.59s/it, exist=0.4031, loss=0.6040, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 282/1177 [14:06<38:38,  2.59s/it, exist=0.4031, loss=0.6040, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 282/1177 [14:09<38:38,  2.59s/it, exist=0.4024, loss=0.6032, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 283/1177 [14:09<38:28,  2.58s/it, exist=0.4024, loss=0.6032, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 283/1177 [14:11<38:28,  2.58s/it, exist=0.4022, loss=0.6044, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 284/1177 [14:11<38:44,  2.60s/it, exist=0.4022, loss=0.6044, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 284/1177 [14:14<38:44,  2.60s/it, exist=0.4016, loss=0.6036, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 285/1177 [14:14<37:18,  2.51s/it, exist=0.4016, loss=0.6036, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 285/1177 [14:18<37:18,  2.51s/it, exist=0.4010, loss=0.6027, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 286/1177 [14:18<44:40,  3.01s/it, exist=0.4010, loss=0.6027, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 286/1177 [14:22<44:40,  3.01s/it, exist=0.4011, loss=0.6032, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 287/1177 [14:22<49:50,  3.36s/it, exist=0.4011, loss=0.6032, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 287/1177 [14:25<49:50,  3.36s/it, exist=0.4003, loss=0.6025, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 288/1177 [14:25<46:48,  3.16s/it, exist=0.4003, loss=0.6025, lr=4.67e-05]
Epoch 2/5:  24%|██▍       | 288/1177 [14:27<46:48,  3.16s/it, exist=0.4004, loss=0.6026, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 289/1177 [14:27<43:42,  2.95s/it, exist=0.4004, loss=0.6026, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 289/1177 [14:30<43:42,  2.95s/it, exist=0.3995, loss=0.6018, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 290/1177 [14:30<43:31,  2.94s/it, exist=0.3995, loss=0.6018, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 290/1177 [14:32<43:31,  2.94s/it, exist=0.3992, loss=0.6015, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 291/1177 [14:32<39:17,  2.66s/it, exist=0.3992, loss=0.6015, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 291/1177 [14:35<39:17,  2.66s/it, exist=0.3995, loss=0.6015, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 292/1177 [14:35<39:29,  2.68s/it, exist=0.3995, loss=0.6015, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 292/1177 [14:37<39:29,  2.68s/it, exist=0.3994, loss=0.6013, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 293/1177 [14:37<38:55,  2.64s/it, exist=0.3994, loss=0.6013, lr=4.67e-05]
Epoch 2/5:  25%|██▍       | 293/1177 [14:40<38:55,  2.64s/it, exist=0.3993, loss=0.6013, lr=4.66e-05]
Epoch 2/5:  25%|██▍       | 294/1177 [14:40<38:18,  2.60s/it, exist=0.3993, loss=0.6013, lr=4.66e-05]
Epoch 2/5:  25%|██▍       | 294/1177 [14:42<38:18,  2.60s/it, exist=0.3991, loss=0.6008, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 295/1177 [14:42<38:17,  2.61s/it, exist=0.3991, loss=0.6008, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 295/1177 [14:45<38:17,  2.61s/it, exist=0.3990, loss=0.6006, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 296/1177 [14:45<38:15,  2.61s/it, exist=0.3990, loss=0.6006, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 296/1177 [14:48<38:15,  2.61s/it, exist=0.3989, loss=0.6004, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 297/1177 [14:48<38:38,  2.63s/it, exist=0.3989, loss=0.6004, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 297/1177 [14:50<38:38,  2.63s/it, exist=0.3994, loss=0.6007, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 298/1177 [14:50<38:41,  2.64s/it, exist=0.3994, loss=0.6007, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 298/1177 [14:52<38:41,  2.64s/it, exist=0.3989, loss=0.6005, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 299/1177 [14:52<35:43,  2.44s/it, exist=0.3989, loss=0.6005, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 299/1177 [14:56<35:43,  2.44s/it, exist=0.3993, loss=0.6006, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 300/1177 [14:56<39:21,  2.69s/it, exist=0.3993, loss=0.6006, lr=4.66e-05]
Epoch 2/5:  25%|██▌       | 300/1177 [14:58<39:21,  2.69s/it, exist=0.3995, loss=0.6006, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 301/1177 [14:58<39:08,  2.68s/it, exist=0.3995, loss=0.6006, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 301/1177 [15:00<39:08,  2.68s/it, exist=0.3995, loss=0.6005, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 302/1177 [15:00<36:19,  2.49s/it, exist=0.3995, loss=0.6005, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 302/1177 [15:03<36:19,  2.49s/it, exist=0.4004, loss=0.6012, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 303/1177 [15:03<38:57,  2.67s/it, exist=0.4004, loss=0.6012, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 303/1177 [15:06<38:57,  2.67s/it, exist=0.4003, loss=0.6012, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 304/1177 [15:06<38:48,  2.67s/it, exist=0.4003, loss=0.6012, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 304/1177 [15:10<38:48,  2.67s/it, exist=0.3996, loss=0.6006, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 305/1177 [15:10<42:33,  2.93s/it, exist=0.3996, loss=0.6006, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 305/1177 [15:13<42:33,  2.93s/it, exist=0.3991, loss=0.6001, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 306/1177 [15:13<46:02,  3.17s/it, exist=0.3991, loss=0.6001, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 306/1177 [15:16<46:02,  3.17s/it, exist=0.3991, loss=0.5999, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 307/1177 [15:16<41:50,  2.89s/it, exist=0.3991, loss=0.5999, lr=4.66e-05]
Epoch 2/5:  26%|██▌       | 307/1177 [15:18<41:50,  2.89s/it, exist=0.3987, loss=0.5994, lr=4.65e-05]
Epoch 2/5:  26%|██▌       | 308/1177 [15:18<40:56,  2.83s/it, exist=0.3987, loss=0.5994, lr=4.65e-05]
Epoch 2/5:  26%|██▌       | 308/1177 [15:21<40:56,  2.83s/it, exist=0.3988, loss=0.5998, lr=4.65e-05]
Epoch 2/5:  26%|██▋       | 309/1177 [15:21<40:21,  2.79s/it, exist=0.3988, loss=0.5998, lr=4.65e-05]
Epoch 2/5:  26%|██▋       | 309/1177 [15:24<40:21,  2.79s/it, exist=0.3988, loss=0.5996, lr=4.65e-05]
Epoch 2/5:  26%|██▋       | 310/1177 [15:24<41:02,  2.84s/it, exist=0.3988, loss=0.5996, lr=4.65e-05]
Epoch 2/5:  26%|██▋       | 310/1177 [15:26<41:02,  2.84s/it, exist=0.3985, loss=0.5993, lr=4.65e-05]
Epoch 2/5:  26%|██▋       | 311/1177 [15:26<37:18,  2.58s/it, exist=0.3985, loss=0.5993, lr=4.65e-05]
Epoch 2/5:  26%|██▋       | 311/1177 [15:29<37:18,  2.58s/it, exist=0.3987, loss=0.6005, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 312/1177 [15:29<39:37,  2.75s/it, exist=0.3987, loss=0.6005, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 312/1177 [15:31<39:37,  2.75s/it, exist=0.3996, loss=0.6013, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 313/1177 [15:31<36:31,  2.54s/it, exist=0.3996, loss=0.6013, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 313/1177 [15:33<36:31,  2.54s/it, exist=0.3995, loss=0.6011, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 314/1177 [15:33<34:17,  2.38s/it, exist=0.3995, loss=0.6011, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 314/1177 [15:36<34:17,  2.38s/it, exist=0.3997, loss=0.6011, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 315/1177 [15:36<37:43,  2.63s/it, exist=0.3997, loss=0.6011, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 315/1177 [15:39<37:43,  2.63s/it, exist=0.3992, loss=0.6008, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 316/1177 [15:39<37:06,  2.59s/it, exist=0.3992, loss=0.6008, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 316/1177 [15:43<37:06,  2.59s/it, exist=0.3990, loss=0.6004, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 317/1177 [15:43<44:38,  3.11s/it, exist=0.3990, loss=0.6004, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 317/1177 [15:47<44:38,  3.11s/it, exist=0.3992, loss=0.6005, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 318/1177 [15:47<46:11,  3.23s/it, exist=0.3992, loss=0.6005, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 318/1177 [15:50<46:11,  3.23s/it, exist=0.3991, loss=0.6003, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 319/1177 [15:50<47:46,  3.34s/it, exist=0.3991, loss=0.6003, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 319/1177 [15:52<47:46,  3.34s/it, exist=0.3987, loss=0.6002, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 320/1177 [15:52<42:02,  2.94s/it, exist=0.3987, loss=0.6002, lr=4.65e-05]
Epoch 2/5:  27%|██▋       | 320/1177 [15:55<42:02,  2.94s/it, exist=0.3985, loss=0.5997, lr=4.64e-05]
Epoch 2/5:  27%|██▋       | 321/1177 [15:55<41:01,  2.88s/it, exist=0.3985, loss=0.5997, lr=4.64e-05]
Epoch 2/5:  27%|██▋       | 321/1177 [15:58<41:01,  2.88s/it, exist=0.3986, loss=0.5995, lr=4.64e-05]
Epoch 2/5:  27%|██▋       | 322/1177 [15:58<39:37,  2.78s/it, exist=0.3986, loss=0.5995, lr=4.64e-05]
Epoch 2/5:  27%|██▋       | 322/1177 [16:00<39:37,  2.78s/it, exist=0.3980, loss=0.5997, lr=4.64e-05]
Epoch 2/5:  27%|██▋       | 323/1177 [16:00<36:17,  2.55s/it, exist=0.3980, loss=0.5997, lr=4.64e-05]
Epoch 2/5:  27%|██▋       | 323/1177 [16:02<36:17,  2.55s/it, exist=0.3988, loss=0.6005, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 324/1177 [16:02<36:46,  2.59s/it, exist=0.3988, loss=0.6005, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 324/1177 [16:06<36:46,  2.59s/it, exist=0.3980, loss=0.5999, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 325/1177 [16:06<40:58,  2.89s/it, exist=0.3980, loss=0.5999, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 325/1177 [16:09<40:58,  2.89s/it, exist=0.3976, loss=0.5998, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 326/1177 [16:09<40:08,  2.83s/it, exist=0.3976, loss=0.5998, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 326/1177 [16:12<40:08,  2.83s/it, exist=0.3982, loss=0.6006, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 327/1177 [16:12<40:45,  2.88s/it, exist=0.3982, loss=0.6006, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 327/1177 [16:14<40:45,  2.88s/it, exist=0.3982, loss=0.6009, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 328/1177 [16:14<37:32,  2.65s/it, exist=0.3982, loss=0.6009, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 328/1177 [16:16<37:32,  2.65s/it, exist=0.3987, loss=0.6014, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 329/1177 [16:16<37:08,  2.63s/it, exist=0.3987, loss=0.6014, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 329/1177 [16:18<37:08,  2.63s/it, exist=0.3989, loss=0.6014, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 330/1177 [16:18<34:31,  2.45s/it, exist=0.3989, loss=0.6014, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 330/1177 [16:21<34:31,  2.45s/it, exist=0.3986, loss=0.6010, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 331/1177 [16:21<34:59,  2.48s/it, exist=0.3986, loss=0.6010, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 331/1177 [16:23<34:59,  2.48s/it, exist=0.3987, loss=0.6009, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 332/1177 [16:23<35:11,  2.50s/it, exist=0.3987, loss=0.6009, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 332/1177 [16:27<35:11,  2.50s/it, exist=0.3985, loss=0.6007, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 333/1177 [16:27<38:30,  2.74s/it, exist=0.3985, loss=0.6007, lr=4.64e-05]
Epoch 2/5:  28%|██▊       | 333/1177 [16:29<38:30,  2.74s/it, exist=0.3979, loss=0.6002, lr=4.63e-05]
Epoch 2/5:  28%|██▊       | 334/1177 [16:29<38:29,  2.74s/it, exist=0.3979, loss=0.6002, lr=4.63e-05]
Epoch 2/5:  28%|██▊       | 334/1177 [16:32<38:29,  2.74s/it, exist=0.3979, loss=0.6003, lr=4.63e-05]
Epoch 2/5:  28%|██▊       | 335/1177 [16:32<39:48,  2.84s/it, exist=0.3979, loss=0.6003, lr=4.63e-05]
Epoch 2/5:  28%|██▊       | 335/1177 [16:35<39:48,  2.84s/it, exist=0.3979, loss=0.6003, lr=4.63e-05]
Epoch 2/5:  29%|██▊       | 336/1177 [16:35<36:30,  2.61s/it, exist=0.3979, loss=0.6003, lr=4.63e-05]
Epoch 2/5:  29%|██▊       | 336/1177 [16:37<36:30,  2.61s/it, exist=0.3971, loss=0.5994, lr=4.63e-05]
Epoch 2/5:  29%|██▊       | 337/1177 [16:37<34:05,  2.44s/it, exist=0.3971, loss=0.5994, lr=4.63e-05]
Epoch 2/5:  29%|██▊       | 337/1177 [16:40<34:05,  2.44s/it, exist=0.3968, loss=0.5993, lr=4.63e-05]
Epoch 2/5:  29%|██▊       | 338/1177 [16:40<37:43,  2.70s/it, exist=0.3968, loss=0.5993, lr=4.63e-05]
Epoch 2/5:  29%|██▊       | 338/1177 [16:43<37:43,  2.70s/it, exist=0.3970, loss=0.5998, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 339/1177 [16:43<38:50,  2.78s/it, exist=0.3970, loss=0.5998, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 339/1177 [16:45<38:50,  2.78s/it, exist=0.3966, loss=0.5993, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 340/1177 [16:45<35:27,  2.54s/it, exist=0.3966, loss=0.5993, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 340/1177 [16:48<35:27,  2.54s/it, exist=0.3964, loss=0.5998, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 341/1177 [16:48<36:00,  2.58s/it, exist=0.3964, loss=0.5998, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 341/1177 [16:50<36:00,  2.58s/it, exist=0.3959, loss=0.5992, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 342/1177 [16:50<35:41,  2.57s/it, exist=0.3959, loss=0.5992, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 342/1177 [16:52<35:41,  2.57s/it, exist=0.3962, loss=0.5994, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 343/1177 [16:52<33:27,  2.41s/it, exist=0.3962, loss=0.5994, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 343/1177 [16:55<33:27,  2.41s/it, exist=0.3953, loss=0.5985, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 344/1177 [16:55<36:46,  2.65s/it, exist=0.3953, loss=0.5985, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 344/1177 [16:57<36:46,  2.65s/it, exist=0.3957, loss=0.5991, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 345/1177 [16:57<34:07,  2.46s/it, exist=0.3957, loss=0.5991, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 345/1177 [17:03<34:07,  2.46s/it, exist=0.3949, loss=0.5984, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 346/1177 [17:03<45:26,  3.28s/it, exist=0.3949, loss=0.5984, lr=4.63e-05]
Epoch 2/5:  29%|██▉       | 346/1177 [17:06<45:26,  3.28s/it, exist=0.3951, loss=0.5984, lr=4.62e-05]
Epoch 2/5:  29%|██▉       | 347/1177 [17:06<47:13,  3.41s/it, exist=0.3951, loss=0.5984, lr=4.62e-05]
Epoch 2/5:  29%|██▉       | 347/1177 [17:08<47:13,  3.41s/it, exist=0.3945, loss=0.5978, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 348/1177 [17:08<41:38,  3.01s/it, exist=0.3945, loss=0.5978, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 348/1177 [17:10<41:38,  3.01s/it, exist=0.3944, loss=0.5982, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 349/1177 [17:10<37:30,  2.72s/it, exist=0.3944, loss=0.5982, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 349/1177 [17:13<37:30,  2.72s/it, exist=0.3940, loss=0.5975, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 350/1177 [17:13<36:27,  2.64s/it, exist=0.3940, loss=0.5975, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 350/1177 [17:15<36:27,  2.64s/it, exist=0.3937, loss=0.5972, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 351/1177 [17:15<35:48,  2.60s/it, exist=0.3937, loss=0.5972, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 351/1177 [17:17<35:48,  2.60s/it, exist=0.3931, loss=0.5968, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 352/1177 [17:17<33:29,  2.44s/it, exist=0.3931, loss=0.5968, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 352/1177 [17:21<33:29,  2.44s/it, exist=0.3933, loss=0.5969, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 353/1177 [17:21<36:45,  2.68s/it, exist=0.3933, loss=0.5969, lr=4.62e-05]
Epoch 2/5:  30%|██▉       | 353/1177 [17:23<36:45,  2.68s/it, exist=0.3929, loss=0.5966, lr=4.62e-05]
Epoch 2/5:  30%|███       | 354/1177 [17:23<35:48,  2.61s/it, exist=0.3929, loss=0.5966, lr=4.62e-05]
Epoch 2/5:  30%|███       | 354/1177 [17:25<35:48,  2.61s/it, exist=0.3924, loss=0.5961, lr=4.62e-05]
Epoch 2/5:  30%|███       | 355/1177 [17:25<33:10,  2.42s/it, exist=0.3924, loss=0.5961, lr=4.62e-05]
Epoch 2/5:  30%|███       | 355/1177 [17:28<33:10,  2.42s/it, exist=0.3917, loss=0.5954, lr=4.62e-05]
Epoch 2/5:  30%|███       | 356/1177 [17:28<36:07,  2.64s/it, exist=0.3917, loss=0.5954, lr=4.62e-05]
Epoch 2/5:  30%|███       | 356/1177 [17:30<36:07,  2.64s/it, exist=0.3913, loss=0.5950, lr=4.62e-05]
Epoch 2/5:  30%|███       | 357/1177 [17:30<33:46,  2.47s/it, exist=0.3913, loss=0.5950, lr=4.62e-05]
Epoch 2/5:  30%|███       | 357/1177 [17:32<33:46,  2.47s/it, exist=0.3910, loss=0.5945, lr=4.62e-05]
Epoch 2/5:  30%|███       | 358/1177 [17:32<32:28,  2.38s/it, exist=0.3910, loss=0.5945, lr=4.62e-05]
Epoch 2/5:  30%|███       | 358/1177 [17:38<32:28,  2.38s/it, exist=0.3910, loss=0.5947, lr=4.62e-05]
Epoch 2/5:  31%|███       | 359/1177 [17:38<46:24,  3.40s/it, exist=0.3910, loss=0.5947, lr=4.62e-05]
Epoch 2/5:  31%|███       | 359/1177 [17:41<46:24,  3.40s/it, exist=0.3910, loss=0.5945, lr=4.61e-05]
Epoch 2/5:  31%|███       | 360/1177 [17:41<43:16,  3.18s/it, exist=0.3910, loss=0.5945, lr=4.61e-05]
Epoch 2/5:  31%|███       | 360/1177 [17:45<43:16,  3.18s/it, exist=0.3910, loss=0.5947, lr=4.61e-05]
Epoch 2/5:  31%|███       | 361/1177 [17:45<45:44,  3.36s/it, exist=0.3910, loss=0.5947, lr=4.61e-05]
Epoch 2/5:  31%|███       | 361/1177 [17:48<45:44,  3.36s/it, exist=0.3906, loss=0.5942, lr=4.61e-05]
Epoch 2/5:  31%|███       | 362/1177 [17:48<47:12,  3.48s/it, exist=0.3906, loss=0.5942, lr=4.61e-05]
Epoch 2/5:  31%|███       | 362/1177 [17:52<47:12,  3.48s/it, exist=0.3910, loss=0.5945, lr=4.61e-05]
Epoch 2/5:  31%|███       | 363/1177 [17:52<47:27,  3.50s/it, exist=0.3910, loss=0.5945, lr=4.61e-05]
Epoch 2/5:  31%|███       | 363/1177 [17:55<47:27,  3.50s/it, exist=0.3923, loss=0.5958, lr=4.61e-05]
Epoch 2/5:  31%|███       | 364/1177 [17:55<43:49,  3.23s/it, exist=0.3923, loss=0.5958, lr=4.61e-05]
Epoch 2/5:  31%|███       | 364/1177 [17:57<43:49,  3.23s/it, exist=0.3919, loss=0.5954, lr=4.61e-05]
Epoch 2/5:  31%|███       | 365/1177 [17:57<40:43,  3.01s/it, exist=0.3919, loss=0.5954, lr=4.61e-05]
Epoch 2/5:  31%|███       | 365/1177 [17:59<40:43,  3.01s/it, exist=0.3918, loss=0.5952, lr=4.61e-05]
Epoch 2/5:  31%|███       | 366/1177 [17:59<36:40,  2.71s/it, exist=0.3918, loss=0.5952, lr=4.61e-05]
Epoch 2/5:  31%|███       | 366/1177 [18:02<36:40,  2.71s/it, exist=0.3914, loss=0.5946, lr=4.61e-05]
Epoch 2/5:  31%|███       | 367/1177 [18:02<35:38,  2.64s/it, exist=0.3914, loss=0.5946, lr=4.61e-05]
Epoch 2/5:  31%|███       | 367/1177 [18:04<35:38,  2.64s/it, exist=0.3919, loss=0.5950, lr=4.61e-05]
Epoch 2/5:  31%|███▏      | 368/1177 [18:04<33:09,  2.46s/it, exist=0.3919, loss=0.5950, lr=4.61e-05]
Epoch 2/5:  31%|███▏      | 368/1177 [18:07<33:09,  2.46s/it, exist=0.3918, loss=0.5948, lr=4.61e-05]
Epoch 2/5:  31%|███▏      | 369/1177 [18:07<36:32,  2.71s/it, exist=0.3918, loss=0.5948, lr=4.61e-05]
Epoch 2/5:  31%|███▏      | 369/1177 [18:10<36:32,  2.71s/it, exist=0.3916, loss=0.5945, lr=4.61e-05]
Epoch 2/5:  31%|███▏      | 370/1177 [18:10<37:06,  2.76s/it, exist=0.3916, loss=0.5945, lr=4.61e-05]
Epoch 2/5:  31%|███▏      | 370/1177 [18:12<37:06,  2.76s/it, exist=0.3913, loss=0.5939, lr=4.61e-05]
Epoch 2/5:  32%|███▏      | 371/1177 [18:12<33:46,  2.51s/it, exist=0.3913, loss=0.5939, lr=4.61e-05]
Epoch 2/5:  32%|███▏      | 371/1177 [18:14<33:46,  2.51s/it, exist=0.3914, loss=0.5943, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 372/1177 [18:14<33:50,  2.52s/it, exist=0.3914, loss=0.5943, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 372/1177 [18:17<33:50,  2.52s/it, exist=0.3915, loss=0.5942, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 373/1177 [18:17<33:43,  2.52s/it, exist=0.3915, loss=0.5942, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 373/1177 [18:19<33:43,  2.52s/it, exist=0.3917, loss=0.5944, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 374/1177 [18:19<31:36,  2.36s/it, exist=0.3917, loss=0.5944, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 374/1177 [18:21<31:36,  2.36s/it, exist=0.3915, loss=0.5942, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 375/1177 [18:21<31:55,  2.39s/it, exist=0.3915, loss=0.5942, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 375/1177 [18:24<31:55,  2.39s/it, exist=0.3907, loss=0.5934, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 376/1177 [18:24<35:30,  2.66s/it, exist=0.3907, loss=0.5934, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 376/1177 [18:27<35:30,  2.66s/it, exist=0.3903, loss=0.5932, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 377/1177 [18:27<35:33,  2.67s/it, exist=0.3903, loss=0.5932, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 377/1177 [18:30<35:33,  2.67s/it, exist=0.3901, loss=0.5932, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 378/1177 [18:30<36:57,  2.78s/it, exist=0.3901, loss=0.5932, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 378/1177 [18:32<36:57,  2.78s/it, exist=0.3895, loss=0.5926, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 379/1177 [18:32<33:53,  2.55s/it, exist=0.3895, loss=0.5926, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 379/1177 [18:35<33:53,  2.55s/it, exist=0.3903, loss=0.5932, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 380/1177 [18:35<34:24,  2.59s/it, exist=0.3903, loss=0.5932, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 380/1177 [18:38<34:24,  2.59s/it, exist=0.3902, loss=0.5931, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 381/1177 [18:38<34:21,  2.59s/it, exist=0.3902, loss=0.5931, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 381/1177 [18:39<34:21,  2.59s/it, exist=0.3899, loss=0.5931, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 382/1177 [18:39<31:55,  2.41s/it, exist=0.3899, loss=0.5931, lr=4.60e-05]
Epoch 2/5:  32%|███▏      | 382/1177 [18:42<31:55,  2.41s/it, exist=0.3895, loss=0.5926, lr=4.60e-05]
Epoch 2/5:  33%|███▎      | 383/1177 [18:42<32:45,  2.48s/it, exist=0.3895, loss=0.5926, lr=4.60e-05]
Epoch 2/5:  33%|███▎      | 383/1177 [18:47<32:45,  2.48s/it, exist=0.3895, loss=0.5926, lr=4.60e-05]
Epoch 2/5:  33%|███▎      | 384/1177 [18:47<40:40,  3.08s/it, exist=0.3895, loss=0.5926, lr=4.60e-05]
Epoch 2/5:  33%|███▎      | 384/1177 [18:50<40:40,  3.08s/it, exist=0.3897, loss=0.5930, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 385/1177 [18:50<40:03,  3.04s/it, exist=0.3897, loss=0.5930, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 385/1177 [18:54<40:03,  3.04s/it, exist=0.3905, loss=0.5935, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 386/1177 [18:54<46:02,  3.49s/it, exist=0.3905, loss=0.5935, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 386/1177 [18:57<46:02,  3.49s/it, exist=0.3906, loss=0.5935, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 387/1177 [18:57<45:12,  3.43s/it, exist=0.3906, loss=0.5935, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 387/1177 [19:00<45:12,  3.43s/it, exist=0.3898, loss=0.5929, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 388/1177 [19:00<41:37,  3.17s/it, exist=0.3898, loss=0.5929, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 388/1177 [19:02<41:37,  3.17s/it, exist=0.3892, loss=0.5926, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 389/1177 [19:02<37:00,  2.82s/it, exist=0.3892, loss=0.5926, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 389/1177 [19:05<37:00,  2.82s/it, exist=0.3889, loss=0.5924, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 390/1177 [19:05<36:25,  2.78s/it, exist=0.3889, loss=0.5924, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 390/1177 [19:07<36:25,  2.78s/it, exist=0.3894, loss=0.5927, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 391/1177 [19:07<35:18,  2.70s/it, exist=0.3894, loss=0.5927, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 391/1177 [19:10<35:18,  2.70s/it, exist=0.3895, loss=0.5929, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 392/1177 [19:10<35:06,  2.68s/it, exist=0.3895, loss=0.5929, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 392/1177 [19:13<35:06,  2.68s/it, exist=0.3891, loss=0.5924, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 393/1177 [19:13<36:32,  2.80s/it, exist=0.3891, loss=0.5924, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 393/1177 [19:15<36:32,  2.80s/it, exist=0.3891, loss=0.5925, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 394/1177 [19:15<33:18,  2.55s/it, exist=0.3891, loss=0.5925, lr=4.59e-05]
Epoch 2/5:  33%|███▎      | 394/1177 [19:17<33:18,  2.55s/it, exist=0.3891, loss=0.5923, lr=4.59e-05]
Epoch 2/5:  34%|███▎      | 395/1177 [19:17<33:36,  2.58s/it, exist=0.3891, loss=0.5923, lr=4.59e-05]
Epoch 2/5:  34%|███▎      | 395/1177 [19:19<33:36,  2.58s/it, exist=0.3893, loss=0.5922, lr=4.59e-05]
Epoch 2/5:  34%|███▎      | 396/1177 [19:19<31:19,  2.41s/it, exist=0.3893, loss=0.5922, lr=4.59e-05]
Epoch 2/5:  34%|███▎      | 396/1177 [19:22<31:19,  2.41s/it, exist=0.3887, loss=0.5919, lr=4.58e-05]
Epoch 2/5:  34%|███▎      | 397/1177 [19:22<32:00,  2.46s/it, exist=0.3887, loss=0.5919, lr=4.58e-05]
Epoch 2/5:  34%|███▎      | 397/1177 [19:26<32:00,  2.46s/it, exist=0.3891, loss=0.5923, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 398/1177 [19:26<36:09,  2.78s/it, exist=0.3891, loss=0.5923, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 398/1177 [19:28<36:09,  2.78s/it, exist=0.3891, loss=0.5931, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 399/1177 [19:28<32:49,  2.53s/it, exist=0.3891, loss=0.5931, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 399/1177 [19:30<32:49,  2.53s/it, exist=0.3894, loss=0.5934, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 400/1177 [19:30<30:39,  2.37s/it, exist=0.3894, loss=0.5934, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 400/1177 [19:33<30:39,  2.37s/it, exist=0.3900, loss=0.5939, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 401/1177 [19:33<34:21,  2.66s/it, exist=0.3900, loss=0.5939, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 401/1177 [19:36<34:21,  2.66s/it, exist=0.3896, loss=0.5934, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 402/1177 [19:36<35:27,  2.75s/it, exist=0.3896, loss=0.5934, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 402/1177 [19:38<35:27,  2.75s/it, exist=0.3892, loss=0.5929, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 403/1177 [19:38<34:09,  2.65s/it, exist=0.3892, loss=0.5929, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 403/1177 [19:40<34:09,  2.65s/it, exist=0.3890, loss=0.5930, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 404/1177 [19:40<31:48,  2.47s/it, exist=0.3890, loss=0.5930, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 404/1177 [19:43<31:48,  2.47s/it, exist=0.3887, loss=0.5927, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 405/1177 [19:43<32:25,  2.52s/it, exist=0.3887, loss=0.5927, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 405/1177 [19:46<32:25,  2.52s/it, exist=0.3884, loss=0.5923, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 406/1177 [19:46<33:04,  2.57s/it, exist=0.3884, loss=0.5923, lr=4.58e-05]
Epoch 2/5:  34%|███▍      | 406/1177 [19:48<33:04,  2.57s/it, exist=0.3883, loss=0.5922, lr=4.58e-05]
Epoch 2/5:  35%|███▍      | 407/1177 [19:48<30:47,  2.40s/it, exist=0.3883, loss=0.5922, lr=4.58e-05]
Epoch 2/5:  35%|███▍      | 407/1177 [19:51<30:47,  2.40s/it, exist=0.3883, loss=0.5922, lr=4.58e-05]
Epoch 2/5:  35%|███▍      | 408/1177 [19:51<34:17,  2.68s/it, exist=0.3883, loss=0.5922, lr=4.58e-05]
Epoch 2/5:  35%|███▍      | 408/1177 [19:54<34:17,  2.68s/it, exist=0.3879, loss=0.5920, lr=4.57e-05]
Epoch 2/5:  35%|███▍      | 409/1177 [19:54<34:06,  2.66s/it, exist=0.3879, loss=0.5920, lr=4.57e-05]
Epoch 2/5:  35%|███▍      | 409/1177 [19:56<34:06,  2.66s/it, exist=0.3876, loss=0.5917, lr=4.57e-05]
Epoch 2/5:  35%|███▍      | 410/1177 [19:56<34:53,  2.73s/it, exist=0.3876, loss=0.5917, lr=4.57e-05]
Epoch 2/5:  35%|███▍      | 410/1177 [19:58<34:53,  2.73s/it, exist=0.3880, loss=0.5922, lr=4.57e-05]
Epoch 2/5:  35%|███▍      | 411/1177 [19:58<31:53,  2.50s/it, exist=0.3880, loss=0.5922, lr=4.57e-05]
Epoch 2/5:  35%|███▍      | 411/1177 [20:01<31:53,  2.50s/it, exist=0.3879, loss=0.5921, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 412/1177 [20:01<32:34,  2.56s/it, exist=0.3879, loss=0.5921, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 412/1177 [20:04<32:34,  2.56s/it, exist=0.3876, loss=0.5918, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 413/1177 [20:04<32:47,  2.58s/it, exist=0.3876, loss=0.5918, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 413/1177 [20:06<32:47,  2.58s/it, exist=0.3876, loss=0.5917, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 414/1177 [20:06<32:08,  2.53s/it, exist=0.3876, loss=0.5917, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 414/1177 [20:09<32:08,  2.53s/it, exist=0.3874, loss=0.5919, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 415/1177 [20:09<32:06,  2.53s/it, exist=0.3874, loss=0.5919, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 415/1177 [20:11<32:06,  2.53s/it, exist=0.3879, loss=0.5924, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 416/1177 [20:11<32:23,  2.55s/it, exist=0.3879, loss=0.5924, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 416/1177 [20:13<32:23,  2.55s/it, exist=0.3874, loss=0.5919, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 417/1177 [20:13<30:33,  2.41s/it, exist=0.3874, loss=0.5919, lr=4.57e-05]
Epoch 2/5:  35%|███▌      | 417/1177 [20:16<30:33,  2.41s/it, exist=0.3876, loss=0.5923, lr=4.57e-05]
Epoch 2/5:  36%|███▌      | 418/1177 [20:16<32:43,  2.59s/it, exist=0.3876, loss=0.5923, lr=4.57e-05]
Epoch 2/5:  36%|███▌      | 418/1177 [20:19<32:43,  2.59s/it, exist=0.3878, loss=0.5928, lr=4.57e-05]
Epoch 2/5:  36%|███▌      | 419/1177 [20:19<32:11,  2.55s/it, exist=0.3878, loss=0.5928, lr=4.57e-05]
Epoch 2/5:  36%|███▌      | 419/1177 [20:21<32:11,  2.55s/it, exist=0.3877, loss=0.5927, lr=4.57e-05]
Epoch 2/5:  36%|███▌      | 420/1177 [20:21<32:29,  2.58s/it, exist=0.3877, loss=0.5927, lr=4.57e-05]
Epoch 2/5:  36%|███▌      | 420/1177 [20:24<32:29,  2.58s/it, exist=0.3880, loss=0.5929, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 421/1177 [20:24<30:30,  2.42s/it, exist=0.3880, loss=0.5929, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 421/1177 [20:27<30:30,  2.42s/it, exist=0.3878, loss=0.5925, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 422/1177 [20:27<35:21,  2.81s/it, exist=0.3878, loss=0.5925, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 422/1177 [20:29<35:21,  2.81s/it, exist=0.3880, loss=0.5932, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 423/1177 [20:29<32:17,  2.57s/it, exist=0.3880, loss=0.5932, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 423/1177 [20:32<32:17,  2.57s/it, exist=0.3884, loss=0.5938, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 424/1177 [20:32<32:23,  2.58s/it, exist=0.3884, loss=0.5938, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 424/1177 [20:34<32:23,  2.58s/it, exist=0.3886, loss=0.5941, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 425/1177 [20:34<32:29,  2.59s/it, exist=0.3886, loss=0.5941, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 425/1177 [20:37<32:29,  2.59s/it, exist=0.3882, loss=0.5936, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 426/1177 [20:37<32:43,  2.61s/it, exist=0.3882, loss=0.5936, lr=4.56e-05]
Epoch 2/5:  36%|███▌      | 426/1177 [20:39<32:43,  2.61s/it, exist=0.3877, loss=0.5931, lr=4.56e-05]
Epoch 2/5:  36%|███▋      | 427/1177 [20:39<31:15,  2.50s/it, exist=0.3877, loss=0.5931, lr=4.56e-05]
Epoch 2/5:  36%|███▋      | 427/1177 [20:43<31:15,  2.50s/it, exist=0.3877, loss=0.5930, lr=4.56e-05]
Epoch 2/5:  36%|███▋      | 428/1177 [20:43<34:22,  2.75s/it, exist=0.3877, loss=0.5930, lr=4.56e-05]
Epoch 2/5:  36%|███▋      | 428/1177 [20:45<34:22,  2.75s/it, exist=0.3877, loss=0.5929, lr=4.56e-05]
Epoch 2/5:  36%|███▋      | 429/1177 [20:45<33:12,  2.66s/it, exist=0.3877, loss=0.5929, lr=4.56e-05]
Epoch 2/5:  36%|███▋      | 429/1177 [20:48<33:12,  2.66s/it, exist=0.3879, loss=0.5933, lr=4.56e-05]
Epoch 2/5:  37%|███▋      | 430/1177 [20:48<32:46,  2.63s/it, exist=0.3879, loss=0.5933, lr=4.56e-05]
Epoch 2/5:  37%|███▋      | 430/1177 [20:50<32:46,  2.63s/it, exist=0.3878, loss=0.5934, lr=4.56e-05]
Epoch 2/5:  37%|███▋      | 431/1177 [20:50<31:41,  2.55s/it, exist=0.3878, loss=0.5934, lr=4.56e-05]
Epoch 2/5:  37%|███▋      | 431/1177 [20:52<31:41,  2.55s/it, exist=0.3890, loss=0.5947, lr=4.56e-05]
Epoch 2/5:  37%|███▋      | 432/1177 [20:52<30:07,  2.43s/it, exist=0.3890, loss=0.5947, lr=4.56e-05]
Epoch 2/5:  37%|███▋      | 432/1177 [20:55<30:07,  2.43s/it, exist=0.3886, loss=0.5943, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 433/1177 [20:55<30:57,  2.50s/it, exist=0.3886, loss=0.5943, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 433/1177 [20:57<30:57,  2.50s/it, exist=0.3888, loss=0.5949, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 434/1177 [20:57<30:34,  2.47s/it, exist=0.3888, loss=0.5949, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 434/1177 [21:00<30:34,  2.47s/it, exist=0.3886, loss=0.5948, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 435/1177 [21:00<31:24,  2.54s/it, exist=0.3886, loss=0.5948, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 435/1177 [21:04<31:24,  2.54s/it, exist=0.3885, loss=0.5948, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 436/1177 [21:04<35:34,  2.88s/it, exist=0.3885, loss=0.5948, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 436/1177 [21:06<35:34,  2.88s/it, exist=0.3882, loss=0.5947, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 437/1177 [21:06<34:22,  2.79s/it, exist=0.3882, loss=0.5947, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 437/1177 [21:08<34:22,  2.79s/it, exist=0.3878, loss=0.5945, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 438/1177 [21:08<31:37,  2.57s/it, exist=0.3878, loss=0.5945, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 438/1177 [21:11<31:37,  2.57s/it, exist=0.3877, loss=0.5944, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 439/1177 [21:11<31:30,  2.56s/it, exist=0.3877, loss=0.5944, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 439/1177 [21:13<31:30,  2.56s/it, exist=0.3877, loss=0.5943, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 440/1177 [21:13<31:38,  2.58s/it, exist=0.3877, loss=0.5943, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 440/1177 [21:15<31:38,  2.58s/it, exist=0.3879, loss=0.5949, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 441/1177 [21:15<29:20,  2.39s/it, exist=0.3879, loss=0.5949, lr=4.55e-05]
Epoch 2/5:  37%|███▋      | 441/1177 [21:18<29:20,  2.39s/it, exist=0.3879, loss=0.5948, lr=4.55e-05]
Epoch 2/5:  38%|███▊      | 442/1177 [21:18<29:54,  2.44s/it, exist=0.3879, loss=0.5948, lr=4.55e-05]
Epoch 2/5:  38%|███▊      | 442/1177 [21:21<29:54,  2.44s/it, exist=0.3880, loss=0.5949, lr=4.55e-05]
Epoch 2/5:  38%|███▊      | 443/1177 [21:21<32:18,  2.64s/it, exist=0.3880, loss=0.5949, lr=4.55e-05]
Epoch 2/5:  38%|███▊      | 443/1177 [21:24<32:18,  2.64s/it, exist=0.3877, loss=0.5950, lr=4.55e-05]
Epoch 2/5:  38%|███▊      | 444/1177 [21:24<33:37,  2.75s/it, exist=0.3877, loss=0.5950, lr=4.55e-05]
Epoch 2/5:  38%|███▊      | 444/1177 [21:26<33:37,  2.75s/it, exist=0.3872, loss=0.5946, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 445/1177 [21:26<30:59,  2.54s/it, exist=0.3872, loss=0.5946, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 445/1177 [21:29<30:59,  2.54s/it, exist=0.3870, loss=0.5947, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 446/1177 [21:29<31:05,  2.55s/it, exist=0.3870, loss=0.5947, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 446/1177 [21:32<31:05,  2.55s/it, exist=0.3870, loss=0.5945, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 447/1177 [21:32<34:04,  2.80s/it, exist=0.3870, loss=0.5945, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 447/1177 [21:36<34:04,  2.80s/it, exist=0.3864, loss=0.5938, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 448/1177 [21:36<38:54,  3.20s/it, exist=0.3864, loss=0.5938, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 448/1177 [21:39<38:54,  3.20s/it, exist=0.3862, loss=0.5935, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 449/1177 [21:39<38:56,  3.21s/it, exist=0.3862, loss=0.5935, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 449/1177 [21:42<38:56,  3.21s/it, exist=0.3862, loss=0.5933, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 450/1177 [21:42<36:17,  2.99s/it, exist=0.3862, loss=0.5933, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 450/1177 [21:44<36:17,  2.99s/it, exist=0.3861, loss=0.5934, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 451/1177 [21:44<32:28,  2.68s/it, exist=0.3861, loss=0.5934, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 451/1177 [21:47<32:28,  2.68s/it, exist=0.3866, loss=0.5938, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 452/1177 [21:47<32:08,  2.66s/it, exist=0.3866, loss=0.5938, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 452/1177 [21:49<32:08,  2.66s/it, exist=0.3865, loss=0.5935, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 453/1177 [21:49<31:48,  2.64s/it, exist=0.3865, loss=0.5935, lr=4.54e-05]
Epoch 2/5:  38%|███▊      | 453/1177 [21:51<31:48,  2.64s/it, exist=0.3873, loss=0.5943, lr=4.54e-05]
Epoch 2/5:  39%|███▊      | 454/1177 [21:51<29:32,  2.45s/it, exist=0.3873, loss=0.5943, lr=4.54e-05]
Epoch 2/5:  39%|███▊      | 454/1177 [21:56<29:32,  2.45s/it, exist=0.3867, loss=0.5938, lr=4.54e-05]
Epoch 2/5:  39%|███▊      | 455/1177 [21:56<36:36,  3.04s/it, exist=0.3867, loss=0.5938, lr=4.54e-05]
Epoch 2/5:  39%|███▊      | 455/1177 [21:58<36:36,  3.04s/it, exist=0.3865, loss=0.5934, lr=4.54e-05]
Epoch 2/5:  39%|███▊      | 456/1177 [21:58<34:30,  2.87s/it, exist=0.3865, loss=0.5934, lr=4.54e-05]
Epoch 2/5:  39%|███▊      | 456/1177 [22:00<34:30,  2.87s/it, exist=0.3866, loss=0.5936, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 457/1177 [22:00<31:20,  2.61s/it, exist=0.3866, loss=0.5936, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 457/1177 [22:03<31:20,  2.61s/it, exist=0.3861, loss=0.5932, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 458/1177 [22:03<31:43,  2.65s/it, exist=0.3861, loss=0.5932, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 458/1177 [22:05<31:43,  2.65s/it, exist=0.3858, loss=0.5928, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 459/1177 [22:05<31:24,  2.62s/it, exist=0.3858, loss=0.5928, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 459/1177 [22:08<31:24,  2.62s/it, exist=0.3856, loss=0.5926, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 460/1177 [22:08<31:19,  2.62s/it, exist=0.3856, loss=0.5926, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 460/1177 [22:11<31:19,  2.62s/it, exist=0.3854, loss=0.5925, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 461/1177 [22:11<31:26,  2.63s/it, exist=0.3854, loss=0.5925, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 461/1177 [22:13<31:26,  2.63s/it, exist=0.3854, loss=0.5925, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 462/1177 [22:13<31:20,  2.63s/it, exist=0.3854, loss=0.5925, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 462/1177 [22:16<31:20,  2.63s/it, exist=0.3851, loss=0.5924, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 463/1177 [22:16<30:43,  2.58s/it, exist=0.3851, loss=0.5924, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 463/1177 [22:18<30:43,  2.58s/it, exist=0.3849, loss=0.5922, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 464/1177 [22:18<30:44,  2.59s/it, exist=0.3849, loss=0.5922, lr=4.53e-05]
Epoch 2/5:  39%|███▉      | 464/1177 [22:20<30:44,  2.59s/it, exist=0.3848, loss=0.5920, lr=4.53e-05]
Epoch 2/5:  40%|███▉      | 465/1177 [22:20<28:43,  2.42s/it, exist=0.3848, loss=0.5920, lr=4.53e-05]
Epoch 2/5:  40%|███▉      | 465/1177 [22:24<28:43,  2.42s/it, exist=0.3842, loss=0.5918, lr=4.53e-05]
Epoch 2/5:  40%|███▉      | 466/1177 [22:24<31:53,  2.69s/it, exist=0.3842, loss=0.5918, lr=4.53e-05]
Epoch 2/5:  40%|███▉      | 466/1177 [22:26<31:53,  2.69s/it, exist=0.3839, loss=0.5915, lr=4.53e-05]
Epoch 2/5:  40%|███▉      | 467/1177 [22:26<29:21,  2.48s/it, exist=0.3839, loss=0.5915, lr=4.53e-05]
Epoch 2/5:  40%|███▉      | 467/1177 [22:29<29:21,  2.48s/it, exist=0.3838, loss=0.5916, lr=4.52e-05]
Epoch 2/5:  40%|███▉      | 468/1177 [22:29<33:53,  2.87s/it, exist=0.3838, loss=0.5916, lr=4.52e-05]
Epoch 2/5:  40%|███▉      | 468/1177 [22:31<33:53,  2.87s/it, exist=0.3839, loss=0.5916, lr=4.52e-05]
Epoch 2/5:  40%|███▉      | 469/1177 [22:31<30:43,  2.60s/it, exist=0.3839, loss=0.5916, lr=4.52e-05]
Epoch 2/5:  40%|███▉      | 469/1177 [22:33<30:43,  2.60s/it, exist=0.3841, loss=0.5917, lr=4.52e-05]
Epoch 2/5:  40%|███▉      | 470/1177 [22:33<28:48,  2.44s/it, exist=0.3841, loss=0.5917, lr=4.52e-05]
Epoch 2/5:  40%|███▉      | 470/1177 [22:37<28:48,  2.44s/it, exist=0.3841, loss=0.5920, lr=4.52e-05]
Epoch 2/5:  40%|████      | 471/1177 [22:37<31:33,  2.68s/it, exist=0.3841, loss=0.5920, lr=4.52e-05]
Epoch 2/5:  40%|████      | 471/1177 [22:39<31:33,  2.68s/it, exist=0.3848, loss=0.5926, lr=4.52e-05]
Epoch 2/5:  40%|████      | 472/1177 [22:39<31:11,  2.66s/it, exist=0.3848, loss=0.5926, lr=4.52e-05]
Epoch 2/5:  40%|████      | 472/1177 [22:42<31:11,  2.66s/it, exist=0.3846, loss=0.5924, lr=4.52e-05]
Epoch 2/5:  40%|████      | 473/1177 [22:42<31:13,  2.66s/it, exist=0.3846, loss=0.5924, lr=4.52e-05]
Epoch 2/5:  40%|████      | 473/1177 [22:44<31:13,  2.66s/it, exist=0.3844, loss=0.5922, lr=4.52e-05]
Epoch 2/5:  40%|████      | 474/1177 [22:44<30:23,  2.59s/it, exist=0.3844, loss=0.5922, lr=4.52e-05]
Epoch 2/5:  40%|████      | 474/1177 [22:47<30:23,  2.59s/it, exist=0.3846, loss=0.5926, lr=4.52e-05]
Epoch 2/5:  40%|████      | 475/1177 [22:47<30:18,  2.59s/it, exist=0.3846, loss=0.5926, lr=4.52e-05]
Epoch 2/5:  40%|████      | 475/1177 [22:49<30:18,  2.59s/it, exist=0.3843, loss=0.5921, lr=4.52e-05]
Epoch 2/5:  40%|████      | 476/1177 [22:49<28:30,  2.44s/it, exist=0.3843, loss=0.5921, lr=4.52e-05]
Epoch 2/5:  40%|████      | 476/1177 [22:52<28:30,  2.44s/it, exist=0.3843, loss=0.5922, lr=4.52e-05]
Epoch 2/5:  41%|████      | 477/1177 [22:52<29:06,  2.49s/it, exist=0.3843, loss=0.5922, lr=4.52e-05]
Epoch 2/5:  41%|████      | 477/1177 [22:54<29:06,  2.49s/it, exist=0.3842, loss=0.5925, lr=4.52e-05]
Epoch 2/5:  41%|████      | 478/1177 [22:54<29:43,  2.55s/it, exist=0.3842, loss=0.5925, lr=4.52e-05]
Epoch 2/5:  41%|████      | 478/1177 [22:58<29:43,  2.55s/it, exist=0.3837, loss=0.5919, lr=4.52e-05]
Epoch 2/5:  41%|████      | 479/1177 [22:58<32:04,  2.76s/it, exist=0.3837, loss=0.5919, lr=4.52e-05]
Epoch 2/5:  41%|████      | 479/1177 [23:00<32:04,  2.76s/it, exist=0.3836, loss=0.5919, lr=4.51e-05]
Epoch 2/5:  41%|████      | 480/1177 [23:00<31:39,  2.73s/it, exist=0.3836, loss=0.5919, lr=4.51e-05]
Epoch 2/5:  41%|████      | 480/1177 [23:03<31:39,  2.73s/it, exist=0.3832, loss=0.5916, lr=4.51e-05]
Epoch 2/5:  41%|████      | 481/1177 [23:03<31:32,  2.72s/it, exist=0.3832, loss=0.5916, lr=4.51e-05]
Epoch 2/5:  41%|████      | 481/1177 [23:05<31:32,  2.72s/it, exist=0.3828, loss=0.5910, lr=4.51e-05]
Epoch 2/5:  41%|████      | 482/1177 [23:05<29:15,  2.53s/it, exist=0.3828, loss=0.5910, lr=4.51e-05]
Epoch 2/5:  41%|████      | 482/1177 [23:08<29:15,  2.53s/it, exist=0.3830, loss=0.5912, lr=4.51e-05]
Epoch 2/5:  41%|████      | 483/1177 [23:08<29:42,  2.57s/it, exist=0.3830, loss=0.5912, lr=4.51e-05]
Epoch 2/5:  41%|████      | 483/1177 [23:11<29:42,  2.57s/it, exist=0.3828, loss=0.5908, lr=4.51e-05]
Epoch 2/5:  41%|████      | 484/1177 [23:11<32:15,  2.79s/it, exist=0.3828, loss=0.5908, lr=4.51e-05]
Epoch 2/5:  41%|████      | 484/1177 [23:14<32:15,  2.79s/it, exist=0.3825, loss=0.5905, lr=4.51e-05]
Epoch 2/5:  41%|████      | 485/1177 [23:14<31:37,  2.74s/it, exist=0.3825, loss=0.5905, lr=4.51e-05]
Epoch 2/5:  41%|████      | 485/1177 [23:17<31:37,  2.74s/it, exist=0.3823, loss=0.5903, lr=4.51e-05]
Epoch 2/5:  41%|████▏     | 486/1177 [23:17<32:40,  2.84s/it, exist=0.3823, loss=0.5903, lr=4.51e-05]
Epoch 2/5:  41%|████▏     | 486/1177 [23:19<32:40,  2.84s/it, exist=0.3823, loss=0.5903, lr=4.51e-05]
Epoch 2/5:  41%|████▏     | 487/1177 [23:19<29:41,  2.58s/it, exist=0.3823, loss=0.5903, lr=4.51e-05]
Epoch 2/5:  41%|████▏     | 487/1177 [23:21<29:41,  2.58s/it, exist=0.3819, loss=0.5905, lr=4.51e-05]
Epoch 2/5:  41%|████▏     | 488/1177 [23:21<27:53,  2.43s/it, exist=0.3819, loss=0.5905, lr=4.51e-05]
Epoch 2/5:  41%|████▏     | 488/1177 [23:24<27:53,  2.43s/it, exist=0.3815, loss=0.5902, lr=4.51e-05]
Epoch 2/5:  42%|████▏     | 489/1177 [23:24<30:44,  2.68s/it, exist=0.3815, loss=0.5902, lr=4.51e-05]
Epoch 2/5:  42%|████▏     | 489/1177 [23:26<30:44,  2.68s/it, exist=0.3811, loss=0.5897, lr=4.51e-05]
Epoch 2/5:  42%|████▏     | 490/1177 [23:26<28:25,  2.48s/it, exist=0.3811, loss=0.5897, lr=4.51e-05]
Epoch 2/5:  42%|████▏     | 490/1177 [23:29<28:25,  2.48s/it, exist=0.3810, loss=0.5899, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 491/1177 [23:29<30:50,  2.70s/it, exist=0.3810, loss=0.5899, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 491/1177 [23:31<30:50,  2.70s/it, exist=0.3816, loss=0.5904, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 492/1177 [23:31<28:29,  2.50s/it, exist=0.3816, loss=0.5904, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 492/1177 [23:35<28:29,  2.50s/it, exist=0.3829, loss=0.5918, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 493/1177 [23:35<30:55,  2.71s/it, exist=0.3829, loss=0.5918, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 493/1177 [23:37<30:55,  2.71s/it, exist=0.3833, loss=0.5922, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 494/1177 [23:37<28:32,  2.51s/it, exist=0.3833, loss=0.5922, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 494/1177 [23:39<28:32,  2.51s/it, exist=0.3839, loss=0.5927, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 495/1177 [23:39<29:00,  2.55s/it, exist=0.3839, loss=0.5927, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 495/1177 [23:43<29:00,  2.55s/it, exist=0.3839, loss=0.5929, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 496/1177 [23:43<31:58,  2.82s/it, exist=0.3839, loss=0.5929, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 496/1177 [23:46<31:58,  2.82s/it, exist=0.3836, loss=0.5926, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 497/1177 [23:46<33:19,  2.94s/it, exist=0.3836, loss=0.5926, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 497/1177 [23:48<33:19,  2.94s/it, exist=0.3831, loss=0.5921, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 498/1177 [23:48<30:02,  2.65s/it, exist=0.3831, loss=0.5921, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 498/1177 [23:51<30:02,  2.65s/it, exist=0.3831, loss=0.5922, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 499/1177 [23:51<32:34,  2.88s/it, exist=0.3831, loss=0.5922, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 499/1177 [23:54<32:34,  2.88s/it, exist=0.3827, loss=0.5917, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 500/1177 [23:54<33:07,  2.94s/it, exist=0.3827, loss=0.5917, lr=4.50e-05]
Epoch 2/5:  42%|████▏     | 500/1177 [23:58<33:07,  2.94s/it, exist=0.3827, loss=0.5916, lr=4.50e-05]
Epoch 2/5:  43%|████▎     | 501/1177 [23:58<34:39,  3.08s/it, exist=0.3827, loss=0.5916, lr=4.50e-05]
Epoch 2/5:  43%|████▎     | 501/1177 [24:01<34:39,  3.08s/it, exist=0.3823, loss=0.5913, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 502/1177 [24:01<34:14,  3.04s/it, exist=0.3823, loss=0.5913, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 502/1177 [24:03<34:14,  3.04s/it, exist=0.3820, loss=0.5909, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 503/1177 [24:03<30:49,  2.74s/it, exist=0.3820, loss=0.5909, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 503/1177 [24:06<30:49,  2.74s/it, exist=0.3821, loss=0.5912, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 504/1177 [24:06<30:52,  2.75s/it, exist=0.3821, loss=0.5912, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 504/1177 [24:08<30:52,  2.75s/it, exist=0.3828, loss=0.5920, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 505/1177 [24:08<30:32,  2.73s/it, exist=0.3828, loss=0.5920, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 505/1177 [24:11<30:32,  2.73s/it, exist=0.3826, loss=0.5917, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 506/1177 [24:11<29:47,  2.66s/it, exist=0.3826, loss=0.5917, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 506/1177 [24:13<29:47,  2.66s/it, exist=0.3822, loss=0.5912, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 507/1177 [24:13<28:54,  2.59s/it, exist=0.3822, loss=0.5912, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 507/1177 [24:16<28:54,  2.59s/it, exist=0.3820, loss=0.5909, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 508/1177 [24:16<29:06,  2.61s/it, exist=0.3820, loss=0.5909, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 508/1177 [24:18<29:06,  2.61s/it, exist=0.3814, loss=0.5906, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 509/1177 [24:18<29:22,  2.64s/it, exist=0.3814, loss=0.5906, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 509/1177 [24:21<29:22,  2.64s/it, exist=0.3813, loss=0.5904, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 510/1177 [24:21<29:28,  2.65s/it, exist=0.3813, loss=0.5904, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 510/1177 [24:23<29:28,  2.65s/it, exist=0.3810, loss=0.5900, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 511/1177 [24:23<27:20,  2.46s/it, exist=0.3810, loss=0.5900, lr=4.49e-05]
Epoch 2/5:  43%|████▎     | 511/1177 [24:27<27:20,  2.46s/it, exist=0.3809, loss=0.5901, lr=4.49e-05]
Epoch 2/5:  44%|████▎     | 512/1177 [24:27<30:15,  2.73s/it, exist=0.3809, loss=0.5901, lr=4.49e-05]
Epoch 2/5:  44%|████▎     | 512/1177 [24:29<30:15,  2.73s/it, exist=0.3808, loss=0.5900, lr=4.48e-05]
Epoch 2/5:  44%|████▎     | 513/1177 [24:29<27:57,  2.53s/it, exist=0.3808, loss=0.5900, lr=4.48e-05]
Epoch 2/5:  44%|████▎     | 513/1177 [24:32<27:57,  2.53s/it, exist=0.3808, loss=0.5901, lr=4.48e-05]
Epoch 2/5:  44%|████▎     | 514/1177 [24:32<30:26,  2.76s/it, exist=0.3808, loss=0.5901, lr=4.48e-05]
Epoch 2/5:  44%|████▎     | 514/1177 [24:34<30:26,  2.76s/it, exist=0.3806, loss=0.5900, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 515/1177 [24:34<29:53,  2.71s/it, exist=0.3806, loss=0.5900, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 515/1177 [24:37<29:53,  2.71s/it, exist=0.3811, loss=0.5904, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 516/1177 [24:37<27:49,  2.53s/it, exist=0.3811, loss=0.5904, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 516/1177 [24:40<27:49,  2.53s/it, exist=0.3813, loss=0.5904, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 517/1177 [24:40<30:24,  2.77s/it, exist=0.3813, loss=0.5904, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 517/1177 [24:43<30:24,  2.77s/it, exist=0.3807, loss=0.5899, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 518/1177 [24:43<30:03,  2.74s/it, exist=0.3807, loss=0.5899, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 518/1177 [24:45<30:03,  2.74s/it, exist=0.3802, loss=0.5893, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 519/1177 [24:45<29:33,  2.70s/it, exist=0.3802, loss=0.5893, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 519/1177 [24:47<29:33,  2.70s/it, exist=0.3798, loss=0.5889, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 520/1177 [24:47<27:24,  2.50s/it, exist=0.3798, loss=0.5889, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 520/1177 [24:51<27:24,  2.50s/it, exist=0.3802, loss=0.5894, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 521/1177 [24:51<30:04,  2.75s/it, exist=0.3802, loss=0.5894, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 521/1177 [24:54<30:04,  2.75s/it, exist=0.3806, loss=0.5898, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 522/1177 [24:54<30:49,  2.82s/it, exist=0.3806, loss=0.5898, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 522/1177 [24:56<30:49,  2.82s/it, exist=0.3802, loss=0.5894, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 523/1177 [24:56<28:01,  2.57s/it, exist=0.3802, loss=0.5894, lr=4.48e-05]
Epoch 2/5:  44%|████▍     | 523/1177 [24:58<28:01,  2.57s/it, exist=0.3803, loss=0.5894, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 524/1177 [24:58<28:14,  2.60s/it, exist=0.3803, loss=0.5894, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 524/1177 [25:01<28:14,  2.60s/it, exist=0.3800, loss=0.5897, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 525/1177 [25:01<28:04,  2.58s/it, exist=0.3800, loss=0.5897, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 525/1177 [25:03<28:04,  2.58s/it, exist=0.3808, loss=0.5904, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 526/1177 [25:03<26:11,  2.41s/it, exist=0.3808, loss=0.5904, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 526/1177 [25:05<26:11,  2.41s/it, exist=0.3805, loss=0.5905, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 527/1177 [25:05<26:50,  2.48s/it, exist=0.3805, loss=0.5905, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 527/1177 [25:08<26:50,  2.48s/it, exist=0.3807, loss=0.5908, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 528/1177 [25:08<26:59,  2.50s/it, exist=0.3807, loss=0.5908, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 528/1177 [25:11<26:59,  2.50s/it, exist=0.3807, loss=0.5906, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 529/1177 [25:11<28:56,  2.68s/it, exist=0.3807, loss=0.5906, lr=4.47e-05]
Epoch 2/5:  45%|████▍     | 529/1177 [25:13<28:56,  2.68s/it, exist=0.3805, loss=0.5904, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 530/1177 [25:13<26:51,  2.49s/it, exist=0.3805, loss=0.5904, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 530/1177 [25:16<26:51,  2.49s/it, exist=0.3807, loss=0.5907, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 531/1177 [25:16<26:59,  2.51s/it, exist=0.3807, loss=0.5907, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 531/1177 [25:18<26:59,  2.51s/it, exist=0.3804, loss=0.5904, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 532/1177 [25:18<27:30,  2.56s/it, exist=0.3804, loss=0.5904, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 532/1177 [25:21<27:30,  2.56s/it, exist=0.3805, loss=0.5907, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 533/1177 [25:21<27:59,  2.61s/it, exist=0.3805, loss=0.5907, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 533/1177 [25:23<27:59,  2.61s/it, exist=0.3807, loss=0.5909, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 534/1177 [25:23<27:24,  2.56s/it, exist=0.3807, loss=0.5909, lr=4.47e-05]
Epoch 2/5:  45%|████▌     | 534/1177 [25:28<27:24,  2.56s/it, exist=0.3806, loss=0.5907, lr=4.46e-05]
Epoch 2/5:  45%|████▌     | 535/1177 [25:28<32:29,  3.04s/it, exist=0.3806, loss=0.5907, lr=4.46e-05]
Epoch 2/5:  45%|████▌     | 535/1177 [25:30<32:29,  3.04s/it, exist=0.3804, loss=0.5907, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 536/1177 [25:30<31:00,  2.90s/it, exist=0.3804, loss=0.5907, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 536/1177 [25:34<31:00,  2.90s/it, exist=0.3808, loss=0.5912, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 537/1177 [25:34<34:45,  3.26s/it, exist=0.3808, loss=0.5912, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 537/1177 [25:37<34:45,  3.26s/it, exist=0.3805, loss=0.5913, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 538/1177 [25:37<32:46,  3.08s/it, exist=0.3805, loss=0.5913, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 538/1177 [25:40<32:46,  3.08s/it, exist=0.3805, loss=0.5913, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 539/1177 [25:40<31:12,  2.93s/it, exist=0.3805, loss=0.5913, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 539/1177 [25:42<31:12,  2.93s/it, exist=0.3803, loss=0.5910, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 540/1177 [25:42<28:10,  2.65s/it, exist=0.3803, loss=0.5910, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 540/1177 [25:44<28:10,  2.65s/it, exist=0.3808, loss=0.5914, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 541/1177 [25:44<27:49,  2.63s/it, exist=0.3808, loss=0.5914, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 541/1177 [25:46<27:49,  2.63s/it, exist=0.3808, loss=0.5916, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 542/1177 [25:46<25:53,  2.45s/it, exist=0.3808, loss=0.5916, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 542/1177 [25:49<25:53,  2.45s/it, exist=0.3811, loss=0.5919, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 543/1177 [25:49<26:41,  2.53s/it, exist=0.3811, loss=0.5919, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 543/1177 [25:52<26:41,  2.53s/it, exist=0.3814, loss=0.5922, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 544/1177 [25:52<29:52,  2.83s/it, exist=0.3814, loss=0.5922, lr=4.46e-05]
Epoch 2/5:  46%|████▌     | 544/1177 [25:55<29:52,  2.83s/it, exist=0.3814, loss=0.5921, lr=4.46e-05]
Epoch 2/5:  46%|████▋     | 545/1177 [25:55<28:52,  2.74s/it, exist=0.3814, loss=0.5921, lr=4.46e-05]
Epoch 2/5:  46%|████▋     | 545/1177 [25:58<28:52,  2.74s/it, exist=0.3814, loss=0.5921, lr=4.45e-05]
Epoch 2/5:  46%|████▋     | 546/1177 [25:58<30:26,  2.89s/it, exist=0.3814, loss=0.5921, lr=4.45e-05]
Epoch 2/5:  46%|████▋     | 546/1177 [26:00<30:26,  2.89s/it, exist=0.3815, loss=0.5926, lr=4.45e-05]
Epoch 2/5:  46%|████▋     | 547/1177 [26:00<27:34,  2.63s/it, exist=0.3815, loss=0.5926, lr=4.45e-05]
Epoch 2/5:  46%|████▋     | 547/1177 [26:03<27:34,  2.63s/it, exist=0.3817, loss=0.5928, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 548/1177 [26:03<27:18,  2.61s/it, exist=0.3817, loss=0.5928, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 548/1177 [26:05<27:18,  2.61s/it, exist=0.3817, loss=0.5940, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 549/1177 [26:05<27:36,  2.64s/it, exist=0.3817, loss=0.5940, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 549/1177 [26:07<27:36,  2.64s/it, exist=0.3816, loss=0.5943, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 550/1177 [26:07<25:28,  2.44s/it, exist=0.3816, loss=0.5943, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 550/1177 [26:10<25:28,  2.44s/it, exist=0.3815, loss=0.5940, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 551/1177 [26:10<27:28,  2.63s/it, exist=0.3815, loss=0.5940, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 551/1177 [26:13<27:28,  2.63s/it, exist=0.3812, loss=0.5939, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 552/1177 [26:13<27:33,  2.65s/it, exist=0.3812, loss=0.5939, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 552/1177 [26:15<27:33,  2.65s/it, exist=0.3812, loss=0.5938, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 553/1177 [26:15<25:30,  2.45s/it, exist=0.3812, loss=0.5938, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 553/1177 [26:19<25:30,  2.45s/it, exist=0.3810, loss=0.5935, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 554/1177 [26:19<28:19,  2.73s/it, exist=0.3810, loss=0.5935, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 554/1177 [26:21<28:19,  2.73s/it, exist=0.3810, loss=0.5936, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 555/1177 [26:21<26:05,  2.52s/it, exist=0.3810, loss=0.5936, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 555/1177 [26:23<26:05,  2.52s/it, exist=0.3812, loss=0.5936, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 556/1177 [26:23<26:00,  2.51s/it, exist=0.3812, loss=0.5936, lr=4.45e-05]
Epoch 2/5:  47%|████▋     | 556/1177 [26:26<26:00,  2.51s/it, exist=0.3811, loss=0.5938, lr=4.44e-05]
Epoch 2/5:  47%|████▋     | 557/1177 [26:26<28:40,  2.78s/it, exist=0.3811, loss=0.5938, lr=4.44e-05]
Epoch 2/5:  47%|████▋     | 557/1177 [26:28<28:40,  2.78s/it, exist=0.3812, loss=0.5938, lr=4.44e-05]
Epoch 2/5:  47%|████▋     | 558/1177 [26:28<26:20,  2.55s/it, exist=0.3812, loss=0.5938, lr=4.44e-05]
Epoch 2/5:  47%|████▋     | 558/1177 [26:32<26:20,  2.55s/it, exist=0.3811, loss=0.5943, lr=4.44e-05]
Epoch 2/5:  47%|████▋     | 559/1177 [26:32<28:25,  2.76s/it, exist=0.3811, loss=0.5943, lr=4.44e-05]
Epoch 2/5:  47%|████▋     | 559/1177 [26:34<28:25,  2.76s/it, exist=0.3820, loss=0.5952, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 560/1177 [26:34<28:13,  2.74s/it, exist=0.3820, loss=0.5952, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 560/1177 [26:36<28:13,  2.74s/it, exist=0.3821, loss=0.5951, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 561/1177 [26:36<26:02,  2.54s/it, exist=0.3821, loss=0.5951, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 561/1177 [26:40<26:02,  2.54s/it, exist=0.3815, loss=0.5945, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 562/1177 [26:40<28:25,  2.77s/it, exist=0.3815, loss=0.5945, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 562/1177 [26:42<28:25,  2.77s/it, exist=0.3814, loss=0.5943, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 563/1177 [26:42<26:05,  2.55s/it, exist=0.3814, loss=0.5943, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 563/1177 [26:45<26:05,  2.55s/it, exist=0.3809, loss=0.5940, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 564/1177 [26:45<26:32,  2.60s/it, exist=0.3809, loss=0.5940, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 564/1177 [26:48<26:32,  2.60s/it, exist=0.3805, loss=0.5935, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 565/1177 [26:48<28:54,  2.83s/it, exist=0.3805, loss=0.5935, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 565/1177 [26:51<28:54,  2.83s/it, exist=0.3803, loss=0.5933, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 566/1177 [26:51<28:07,  2.76s/it, exist=0.3803, loss=0.5933, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 566/1177 [26:53<28:07,  2.76s/it, exist=0.3801, loss=0.5930, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 567/1177 [26:53<28:37,  2.82s/it, exist=0.3801, loss=0.5930, lr=4.44e-05]
Epoch 2/5:  48%|████▊     | 567/1177 [26:56<28:37,  2.82s/it, exist=0.3797, loss=0.5926, lr=4.43e-05]
Epoch 2/5:  48%|████▊     | 568/1177 [26:56<26:29,  2.61s/it, exist=0.3797, loss=0.5926, lr=4.43e-05]
Epoch 2/5:  48%|████▊     | 568/1177 [26:58<26:29,  2.61s/it, exist=0.3796, loss=0.5924, lr=4.43e-05]
Epoch 2/5:  48%|████▊     | 569/1177 [26:58<25:52,  2.55s/it, exist=0.3796, loss=0.5924, lr=4.43e-05]
Epoch 2/5:  48%|████▊     | 569/1177 [27:01<25:52,  2.55s/it, exist=0.3791, loss=0.5918, lr=4.43e-05]
Epoch 2/5:  48%|████▊     | 570/1177 [27:01<26:08,  2.58s/it, exist=0.3791, loss=0.5918, lr=4.43e-05]
Epoch 2/5:  48%|████▊     | 570/1177 [27:03<26:08,  2.58s/it, exist=0.3787, loss=0.5913, lr=4.43e-05]
Epoch 2/5:  49%|████▊     | 571/1177 [27:03<26:04,  2.58s/it, exist=0.3787, loss=0.5913, lr=4.43e-05]
Epoch 2/5:  49%|████▊     | 571/1177 [27:06<26:04,  2.58s/it, exist=0.3786, loss=0.5912, lr=4.43e-05]
Epoch 2/5:  49%|████▊     | 572/1177 [27:06<26:12,  2.60s/it, exist=0.3786, loss=0.5912, lr=4.43e-05]
Epoch 2/5:  49%|████▊     | 572/1177 [27:08<26:12,  2.60s/it, exist=0.3790, loss=0.5922, lr=4.43e-05]
Epoch 2/5:  49%|████▊     | 573/1177 [27:08<26:01,  2.59s/it, exist=0.3790, loss=0.5922, lr=4.43e-05]
Epoch 2/5:  49%|████▊     | 573/1177 [27:10<26:01,  2.59s/it, exist=0.3787, loss=0.5921, lr=4.43e-05]
Epoch 2/5:  49%|████▉     | 574/1177 [27:10<24:20,  2.42s/it, exist=0.3787, loss=0.5921, lr=4.43e-05]
Epoch 2/5:  49%|████▉     | 574/1177 [27:14<24:20,  2.42s/it, exist=0.3787, loss=0.5923, lr=4.43e-05]
Epoch 2/5:  49%|████▉     | 575/1177 [27:14<26:55,  2.68s/it, exist=0.3787, loss=0.5923, lr=4.43e-05]
Epoch 2/5:  49%|████▉     | 575/1177 [27:16<26:55,  2.68s/it, exist=0.3791, loss=0.5926, lr=4.43e-05]
Epoch 2/5:  49%|████▉     | 576/1177 [27:16<26:19,  2.63s/it, exist=0.3791, loss=0.5926, lr=4.43e-05]
Epoch 2/5:  49%|████▉     | 576/1177 [27:18<26:19,  2.63s/it, exist=0.3797, loss=0.5933, lr=4.43e-05]
Epoch 2/5:  49%|████▉     | 577/1177 [27:18<24:27,  2.45s/it, exist=0.3797, loss=0.5933, lr=4.43e-05]
Epoch 2/5:  49%|████▉     | 577/1177 [27:22<24:27,  2.45s/it, exist=0.3802, loss=0.5937, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 578/1177 [27:22<27:41,  2.77s/it, exist=0.3802, loss=0.5937, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 578/1177 [27:24<27:41,  2.77s/it, exist=0.3802, loss=0.5937, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 579/1177 [27:24<25:19,  2.54s/it, exist=0.3802, loss=0.5937, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 579/1177 [27:26<25:19,  2.54s/it, exist=0.3807, loss=0.5943, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 580/1177 [27:26<25:34,  2.57s/it, exist=0.3807, loss=0.5943, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 580/1177 [27:29<25:34,  2.57s/it, exist=0.3802, loss=0.5939, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 581/1177 [27:29<25:58,  2.62s/it, exist=0.3802, loss=0.5939, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 581/1177 [27:32<25:58,  2.62s/it, exist=0.3800, loss=0.5935, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 582/1177 [27:32<25:51,  2.61s/it, exist=0.3800, loss=0.5935, lr=4.42e-05]
Epoch 2/5:  49%|████▉     | 582/1177 [27:34<25:51,  2.61s/it, exist=0.3798, loss=0.5937, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 583/1177 [27:34<25:53,  2.62s/it, exist=0.3798, loss=0.5937, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 583/1177 [27:36<25:53,  2.62s/it, exist=0.3800, loss=0.5941, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 584/1177 [27:36<24:10,  2.45s/it, exist=0.3800, loss=0.5941, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 584/1177 [27:39<24:10,  2.45s/it, exist=0.3801, loss=0.5940, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 585/1177 [27:39<25:01,  2.54s/it, exist=0.3801, loss=0.5940, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 585/1177 [27:43<25:01,  2.54s/it, exist=0.3797, loss=0.5938, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 586/1177 [27:43<28:38,  2.91s/it, exist=0.3797, loss=0.5938, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 586/1177 [27:45<28:38,  2.91s/it, exist=0.3797, loss=0.5938, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 587/1177 [27:45<27:06,  2.76s/it, exist=0.3797, loss=0.5938, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 587/1177 [27:47<27:06,  2.76s/it, exist=0.3795, loss=0.5936, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 588/1177 [27:47<24:53,  2.54s/it, exist=0.3795, loss=0.5936, lr=4.42e-05]
Epoch 2/5:  50%|████▉     | 588/1177 [27:50<24:53,  2.54s/it, exist=0.3794, loss=0.5935, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 589/1177 [27:50<25:13,  2.57s/it, exist=0.3794, loss=0.5935, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 589/1177 [27:53<25:13,  2.57s/it, exist=0.3790, loss=0.5929, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 590/1177 [27:53<24:58,  2.55s/it, exist=0.3790, loss=0.5929, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 590/1177 [27:55<24:58,  2.55s/it, exist=0.3791, loss=0.5932, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 591/1177 [27:55<25:05,  2.57s/it, exist=0.3791, loss=0.5932, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 591/1177 [27:57<25:05,  2.57s/it, exist=0.3794, loss=0.5935, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 592/1177 [27:57<23:35,  2.42s/it, exist=0.3794, loss=0.5935, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 592/1177 [28:01<23:35,  2.42s/it, exist=0.3793, loss=0.5938, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 593/1177 [28:01<26:58,  2.77s/it, exist=0.3793, loss=0.5938, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 593/1177 [28:04<26:58,  2.77s/it, exist=0.3790, loss=0.5934, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 594/1177 [28:04<27:40,  2.85s/it, exist=0.3790, loss=0.5934, lr=4.41e-05]
Epoch 2/5:  50%|█████     | 594/1177 [28:06<27:40,  2.85s/it, exist=0.3793, loss=0.5938, lr=4.41e-05]
Epoch 2/5:  51%|█████     | 595/1177 [28:06<26:20,  2.72s/it, exist=0.3793, loss=0.5938, lr=4.41e-05]
Epoch 2/5:  51%|█████     | 595/1177 [28:08<26:20,  2.72s/it, exist=0.3792, loss=0.5938, lr=4.41e-05]
Epoch 2/5:  51%|█████     | 596/1177 [28:08<24:21,  2.51s/it, exist=0.3792, loss=0.5938, lr=4.41e-05]
Epoch 2/5:  51%|█████     | 596/1177 [28:11<24:21,  2.51s/it, exist=0.3788, loss=0.5935, lr=4.41e-05]
Epoch 2/5:  51%|█████     | 597/1177 [28:11<24:39,  2.55s/it, exist=0.3788, loss=0.5935, lr=4.41e-05]
Epoch 2/5:  51%|█████     | 597/1177 [28:14<24:39,  2.55s/it, exist=0.3784, loss=0.5931, lr=4.41e-05]
Epoch 2/5:  51%|█████     | 598/1177 [28:14<24:53,  2.58s/it, exist=0.3784, loss=0.5931, lr=4.41e-05]
Epoch 2/5:  51%|█████     | 598/1177 [28:16<24:53,  2.58s/it, exist=0.3788, loss=0.5938, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 599/1177 [28:16<23:06,  2.40s/it, exist=0.3788, loss=0.5938, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 599/1177 [28:18<23:06,  2.40s/it, exist=0.3792, loss=0.5942, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 600/1177 [28:18<23:16,  2.42s/it, exist=0.3792, loss=0.5942, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 600/1177 [28:21<23:16,  2.42s/it, exist=0.3790, loss=0.5940, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 601/1177 [28:21<26:02,  2.71s/it, exist=0.3790, loss=0.5940, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 601/1177 [28:23<26:02,  2.71s/it, exist=0.3786, loss=0.5934, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 602/1177 [28:23<24:01,  2.51s/it, exist=0.3786, loss=0.5934, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 602/1177 [28:27<24:01,  2.51s/it, exist=0.3789, loss=0.5937, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 603/1177 [28:27<25:51,  2.70s/it, exist=0.3789, loss=0.5937, lr=4.40e-05]
Epoch 2/5:  51%|█████     | 603/1177 [28:29<25:51,  2.70s/it, exist=0.3785, loss=0.5933, lr=4.40e-05]
Epoch 2/5:  51%|█████▏    | 604/1177 [28:29<25:23,  2.66s/it, exist=0.3785, loss=0.5933, lr=4.40e-05]
Epoch 2/5:  51%|█████▏    | 604/1177 [28:32<25:23,  2.66s/it, exist=0.3785, loss=0.5933, lr=4.40e-05]
Epoch 2/5:  51%|█████▏    | 605/1177 [28:32<26:20,  2.76s/it, exist=0.3785, loss=0.5933, lr=4.40e-05]
Epoch 2/5:  51%|█████▏    | 605/1177 [28:34<26:20,  2.76s/it, exist=0.3782, loss=0.5930, lr=4.40e-05]
Epoch 2/5:  51%|█████▏    | 606/1177 [28:34<24:06,  2.53s/it, exist=0.3782, loss=0.5930, lr=4.40e-05]
Epoch 2/5:  51%|█████▏    | 606/1177 [28:37<24:06,  2.53s/it, exist=0.3778, loss=0.5929, lr=4.40e-05]
Epoch 2/5:  52%|█████▏    | 607/1177 [28:37<23:41,  2.49s/it, exist=0.3778, loss=0.5929, lr=4.40e-05]
Epoch 2/5:  52%|█████▏    | 607/1177 [28:39<23:41,  2.49s/it, exist=0.3781, loss=0.5932, lr=4.40e-05]
Epoch 2/5:  52%|█████▏    | 608/1177 [28:39<23:59,  2.53s/it, exist=0.3781, loss=0.5932, lr=4.40e-05]
Epoch 2/5:  52%|█████▏    | 608/1177 [28:42<23:59,  2.53s/it, exist=0.3782, loss=0.5933, lr=4.40e-05]
Epoch 2/5:  52%|█████▏    | 609/1177 [28:42<23:48,  2.52s/it, exist=0.3782, loss=0.5933, lr=4.40e-05]
Epoch 2/5:  52%|█████▏    | 609/1177 [28:44<23:48,  2.52s/it, exist=0.3781, loss=0.5930, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 610/1177 [28:44<23:45,  2.51s/it, exist=0.3781, loss=0.5930, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 610/1177 [28:46<23:45,  2.51s/it, exist=0.3779, loss=0.5928, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 611/1177 [28:46<22:13,  2.36s/it, exist=0.3779, loss=0.5928, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 611/1177 [28:49<22:13,  2.36s/it, exist=0.3777, loss=0.5927, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 612/1177 [28:49<22:59,  2.44s/it, exist=0.3777, loss=0.5927, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 612/1177 [28:52<22:59,  2.44s/it, exist=0.3773, loss=0.5922, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 613/1177 [28:52<25:21,  2.70s/it, exist=0.3773, loss=0.5922, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 613/1177 [28:55<25:21,  2.70s/it, exist=0.3775, loss=0.5924, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 614/1177 [28:55<26:31,  2.83s/it, exist=0.3775, loss=0.5924, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 614/1177 [28:58<26:31,  2.83s/it, exist=0.3771, loss=0.5920, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 615/1177 [28:58<25:17,  2.70s/it, exist=0.3771, loss=0.5920, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 615/1177 [29:00<25:17,  2.70s/it, exist=0.3769, loss=0.5917, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 616/1177 [29:00<23:31,  2.52s/it, exist=0.3769, loss=0.5917, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 616/1177 [29:02<23:31,  2.52s/it, exist=0.3765, loss=0.5912, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 617/1177 [29:02<23:44,  2.54s/it, exist=0.3765, loss=0.5912, lr=4.39e-05]
Epoch 2/5:  52%|█████▏    | 617/1177 [29:05<23:44,  2.54s/it, exist=0.3764, loss=0.5913, lr=4.39e-05]
Epoch 2/5:  53%|█████▎    | 618/1177 [29:05<23:24,  2.51s/it, exist=0.3764, loss=0.5913, lr=4.39e-05]
Epoch 2/5:  53%|█████▎    | 618/1177 [29:07<23:24,  2.51s/it, exist=0.3764, loss=0.5911, lr=4.39e-05]
Epoch 2/5:  53%|█████▎    | 619/1177 [29:07<23:33,  2.53s/it, exist=0.3764, loss=0.5911, lr=4.39e-05]
Epoch 2/5:  53%|█████▎    | 619/1177 [29:10<23:33,  2.53s/it, exist=0.3761, loss=0.5909, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 620/1177 [29:10<23:48,  2.56s/it, exist=0.3761, loss=0.5909, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 620/1177 [29:13<23:48,  2.56s/it, exist=0.3763, loss=0.5913, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 621/1177 [29:13<23:43,  2.56s/it, exist=0.3763, loss=0.5913, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 621/1177 [29:15<23:43,  2.56s/it, exist=0.3759, loss=0.5909, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 622/1177 [29:15<22:16,  2.41s/it, exist=0.3759, loss=0.5909, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 622/1177 [29:18<22:16,  2.41s/it, exist=0.3759, loss=0.5911, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 623/1177 [29:18<24:13,  2.62s/it, exist=0.3759, loss=0.5911, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 623/1177 [29:20<24:13,  2.62s/it, exist=0.3755, loss=0.5909, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 624/1177 [29:20<22:33,  2.45s/it, exist=0.3755, loss=0.5909, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 624/1177 [29:23<22:33,  2.45s/it, exist=0.3754, loss=0.5906, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 625/1177 [29:23<25:00,  2.72s/it, exist=0.3754, loss=0.5906, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 625/1177 [29:26<25:00,  2.72s/it, exist=0.3751, loss=0.5902, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 626/1177 [29:26<24:46,  2.70s/it, exist=0.3751, loss=0.5902, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 626/1177 [29:28<24:46,  2.70s/it, exist=0.3755, loss=0.5907, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 627/1177 [29:28<24:04,  2.63s/it, exist=0.3755, loss=0.5907, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 627/1177 [29:30<24:04,  2.63s/it, exist=0.3751, loss=0.5903, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 628/1177 [29:30<22:27,  2.45s/it, exist=0.3751, loss=0.5903, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 628/1177 [29:34<22:27,  2.45s/it, exist=0.3748, loss=0.5899, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 629/1177 [29:34<24:48,  2.72s/it, exist=0.3748, loss=0.5899, lr=4.38e-05]
Epoch 2/5:  53%|█████▎    | 629/1177 [29:36<24:48,  2.72s/it, exist=0.3743, loss=0.5896, lr=4.37e-05]
Epoch 2/5:  54%|█████▎    | 630/1177 [29:36<24:26,  2.68s/it, exist=0.3743, loss=0.5896, lr=4.37e-05]
Epoch 2/5:  54%|█████▎    | 630/1177 [29:39<24:26,  2.68s/it, exist=0.3744, loss=0.5899, lr=4.37e-05]
Epoch 2/5:  54%|█████▎    | 631/1177 [29:39<25:20,  2.78s/it, exist=0.3744, loss=0.5899, lr=4.37e-05]
Epoch 2/5:  54%|█████▎    | 631/1177 [29:41<25:20,  2.78s/it, exist=0.3746, loss=0.5899, lr=4.37e-05]
Epoch 2/5:  54%|█████▎    | 632/1177 [29:41<23:18,  2.57s/it, exist=0.3746, loss=0.5899, lr=4.37e-05]
Epoch 2/5:  54%|█████▎    | 632/1177 [29:43<23:18,  2.57s/it, exist=0.3742, loss=0.5896, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 633/1177 [29:43<21:57,  2.42s/it, exist=0.3742, loss=0.5896, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 633/1177 [29:48<21:57,  2.42s/it, exist=0.3737, loss=0.5891, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 634/1177 [29:48<28:04,  3.10s/it, exist=0.3737, loss=0.5891, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 634/1177 [29:52<28:04,  3.10s/it, exist=0.3733, loss=0.5887, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 635/1177 [29:52<29:14,  3.24s/it, exist=0.3733, loss=0.5887, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 635/1177 [29:54<29:14,  3.24s/it, exist=0.3729, loss=0.5881, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 636/1177 [29:54<27:35,  3.06s/it, exist=0.3729, loss=0.5881, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 636/1177 [29:56<27:35,  3.06s/it, exist=0.3726, loss=0.5879, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 637/1177 [29:56<24:56,  2.77s/it, exist=0.3726, loss=0.5879, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 637/1177 [29:59<24:56,  2.77s/it, exist=0.3724, loss=0.5877, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 638/1177 [29:59<24:31,  2.73s/it, exist=0.3724, loss=0.5877, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 638/1177 [30:02<24:31,  2.73s/it, exist=0.3720, loss=0.5875, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 639/1177 [30:02<23:48,  2.66s/it, exist=0.3720, loss=0.5875, lr=4.37e-05]
Epoch 2/5:  54%|█████▍    | 639/1177 [30:04<23:48,  2.66s/it, exist=0.3715, loss=0.5870, lr=4.36e-05]
Epoch 2/5:  54%|█████▍    | 640/1177 [30:04<23:51,  2.67s/it, exist=0.3715, loss=0.5870, lr=4.36e-05]
Epoch 2/5:  54%|█████▍    | 640/1177 [30:06<23:51,  2.67s/it, exist=0.3714, loss=0.5868, lr=4.36e-05]
Epoch 2/5:  54%|█████▍    | 641/1177 [30:06<21:55,  2.45s/it, exist=0.3714, loss=0.5868, lr=4.36e-05]
Epoch 2/5:  54%|█████▍    | 641/1177 [30:09<21:55,  2.45s/it, exist=0.3714, loss=0.5868, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 642/1177 [30:09<22:18,  2.50s/it, exist=0.3714, loss=0.5868, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 642/1177 [30:11<22:18,  2.50s/it, exist=0.3713, loss=0.5867, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 643/1177 [30:11<22:44,  2.56s/it, exist=0.3713, loss=0.5867, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 643/1177 [30:14<22:44,  2.56s/it, exist=0.3712, loss=0.5865, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 644/1177 [30:14<22:30,  2.53s/it, exist=0.3712, loss=0.5865, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 644/1177 [30:18<22:30,  2.53s/it, exist=0.3719, loss=0.5872, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 645/1177 [30:18<26:57,  3.04s/it, exist=0.3719, loss=0.5872, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 645/1177 [30:21<26:57,  3.04s/it, exist=0.3715, loss=0.5866, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 646/1177 [30:21<25:29,  2.88s/it, exist=0.3715, loss=0.5866, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 646/1177 [30:23<25:29,  2.88s/it, exist=0.3711, loss=0.5865, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 647/1177 [30:23<24:45,  2.80s/it, exist=0.3711, loss=0.5865, lr=4.36e-05]
Epoch 2/5:  55%|█████▍    | 647/1177 [30:25<24:45,  2.80s/it, exist=0.3711, loss=0.5864, lr=4.36e-05]
Epoch 2/5:  55%|█████▌    | 648/1177 [30:25<22:42,  2.58s/it, exist=0.3711, loss=0.5864, lr=4.36e-05]
Epoch 2/5:  55%|█████▌    | 648/1177 [30:28<22:42,  2.58s/it, exist=0.3707, loss=0.5860, lr=4.36e-05]
Epoch 2/5:  55%|█████▌    | 649/1177 [30:28<22:47,  2.59s/it, exist=0.3707, loss=0.5860, lr=4.36e-05]
Epoch 2/5:  55%|█████▌    | 649/1177 [30:31<22:47,  2.59s/it, exist=0.3705, loss=0.5860, lr=4.35e-05]
Epoch 2/5:  55%|█████▌    | 650/1177 [30:31<22:54,  2.61s/it, exist=0.3705, loss=0.5860, lr=4.35e-05]
Epoch 2/5:  55%|█████▌    | 650/1177 [30:33<22:54,  2.61s/it, exist=0.3709, loss=0.5863, lr=4.35e-05]
Epoch 2/5:  55%|█████▌    | 651/1177 [30:33<22:47,  2.60s/it, exist=0.3709, loss=0.5863, lr=4.35e-05]
Epoch 2/5:  55%|█████▌    | 651/1177 [30:36<22:47,  2.60s/it, exist=0.3711, loss=0.5865, lr=4.35e-05]
Epoch 2/5:  55%|█████▌    | 652/1177 [30:36<22:48,  2.61s/it, exist=0.3711, loss=0.5865, lr=4.35e-05]
Epoch 2/5:  55%|█████▌    | 652/1177 [30:38<22:48,  2.61s/it, exist=0.3709, loss=0.5863, lr=4.35e-05]
Epoch 2/5:  55%|█████▌    | 653/1177 [30:38<21:14,  2.43s/it, exist=0.3709, loss=0.5863, lr=4.35e-05]
Epoch 2/5:  55%|█████▌    | 653/1177 [30:41<21:14,  2.43s/it, exist=0.3711, loss=0.5867, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 654/1177 [30:41<23:18,  2.67s/it, exist=0.3711, loss=0.5867, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 654/1177 [30:43<23:18,  2.67s/it, exist=0.3716, loss=0.5870, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 655/1177 [30:43<22:24,  2.58s/it, exist=0.3716, loss=0.5870, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 655/1177 [30:47<22:24,  2.58s/it, exist=0.3715, loss=0.5870, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 656/1177 [30:47<23:49,  2.74s/it, exist=0.3715, loss=0.5870, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 656/1177 [30:49<23:49,  2.74s/it, exist=0.3715, loss=0.5870, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 657/1177 [30:49<21:49,  2.52s/it, exist=0.3715, loss=0.5870, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 657/1177 [30:52<21:49,  2.52s/it, exist=0.3714, loss=0.5870, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 658/1177 [30:52<23:11,  2.68s/it, exist=0.3714, loss=0.5870, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 658/1177 [30:54<23:11,  2.68s/it, exist=0.3714, loss=0.5867, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 659/1177 [30:54<21:20,  2.47s/it, exist=0.3714, loss=0.5867, lr=4.35e-05]
Epoch 2/5:  56%|█████▌    | 659/1177 [30:56<21:20,  2.47s/it, exist=0.3711, loss=0.5863, lr=4.34e-05]
Epoch 2/5:  56%|█████▌    | 660/1177 [30:56<21:06,  2.45s/it, exist=0.3711, loss=0.5863, lr=4.34e-05]
Epoch 2/5:  56%|█████▌    | 660/1177 [30:58<21:06,  2.45s/it, exist=0.3714, loss=0.5867, lr=4.34e-05]
Epoch 2/5:  56%|█████▌    | 661/1177 [30:58<21:01,  2.44s/it, exist=0.3714, loss=0.5867, lr=4.34e-05]
Epoch 2/5:  56%|█████▌    | 661/1177 [31:00<21:01,  2.44s/it, exist=0.3713, loss=0.5865, lr=4.34e-05]
Epoch 2/5:  56%|█████▌    | 662/1177 [31:00<19:58,  2.33s/it, exist=0.3713, loss=0.5865, lr=4.34e-05]
Epoch 2/5:  56%|█████▌    | 662/1177 [31:04<19:58,  2.33s/it, exist=0.3714, loss=0.5865, lr=4.34e-05]
Epoch 2/5:  56%|█████▋    | 663/1177 [31:04<22:18,  2.60s/it, exist=0.3714, loss=0.5865, lr=4.34e-05]
Epoch 2/5:  56%|█████▋    | 663/1177 [31:07<22:18,  2.60s/it, exist=0.3712, loss=0.5863, lr=4.34e-05]
Epoch 2/5:  56%|█████▋    | 664/1177 [31:07<23:21,  2.73s/it, exist=0.3712, loss=0.5863, lr=4.34e-05]
Epoch 2/5:  56%|█████▋    | 664/1177 [31:09<23:21,  2.73s/it, exist=0.3709, loss=0.5860, lr=4.34e-05]
Epoch 2/5:  56%|█████▋    | 665/1177 [31:09<21:22,  2.50s/it, exist=0.3709, loss=0.5860, lr=4.34e-05]
Epoch 2/5:  56%|█████▋    | 665/1177 [31:12<21:22,  2.50s/it, exist=0.3709, loss=0.5862, lr=4.34e-05]
Epoch 2/5:  57%|█████▋    | 666/1177 [31:12<23:47,  2.79s/it, exist=0.3709, loss=0.5862, lr=4.34e-05]
Epoch 2/5:  57%|█████▋    | 666/1177 [31:16<23:47,  2.79s/it, exist=0.3707, loss=0.5861, lr=4.34e-05]
Epoch 2/5:  57%|█████▋    | 667/1177 [31:16<25:52,  3.04s/it, exist=0.3707, loss=0.5861, lr=4.34e-05]
Epoch 2/5:  57%|█████▋    | 667/1177 [31:20<25:52,  3.04s/it, exist=0.3705, loss=0.5859, lr=4.34e-05]
Epoch 2/5:  57%|█████▋    | 668/1177 [31:20<29:40,  3.50s/it, exist=0.3705, loss=0.5859, lr=4.34e-05]
Epoch 2/5:  57%|█████▋    | 668/1177 [31:24<29:40,  3.50s/it, exist=0.3702, loss=0.5855, lr=4.34e-05]
Epoch 2/5:  57%|█████▋    | 669/1177 [31:24<29:01,  3.43s/it, exist=0.3702, loss=0.5855, lr=4.34e-05]
Epoch 2/5:  57%|█████▋    | 669/1177 [31:26<29:01,  3.43s/it, exist=0.3699, loss=0.5854, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 670/1177 [31:26<25:26,  3.01s/it, exist=0.3699, loss=0.5854, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 670/1177 [31:28<25:26,  3.01s/it, exist=0.3697, loss=0.5850, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 671/1177 [31:28<22:49,  2.71s/it, exist=0.3697, loss=0.5850, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 671/1177 [31:30<22:49,  2.71s/it, exist=0.3696, loss=0.5848, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 672/1177 [31:30<22:48,  2.71s/it, exist=0.3696, loss=0.5848, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 672/1177 [31:32<22:48,  2.71s/it, exist=0.3693, loss=0.5845, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 673/1177 [31:32<21:03,  2.51s/it, exist=0.3693, loss=0.5845, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 673/1177 [31:36<21:03,  2.51s/it, exist=0.3699, loss=0.5853, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 674/1177 [31:36<22:53,  2.73s/it, exist=0.3699, loss=0.5853, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 674/1177 [31:38<22:53,  2.73s/it, exist=0.3700, loss=0.5852, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 675/1177 [31:38<20:57,  2.51s/it, exist=0.3700, loss=0.5852, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 675/1177 [31:41<20:57,  2.51s/it, exist=0.3697, loss=0.5849, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 676/1177 [31:41<22:56,  2.75s/it, exist=0.3697, loss=0.5849, lr=4.33e-05]
Epoch 2/5:  57%|█████▋    | 676/1177 [31:44<22:56,  2.75s/it, exist=0.3696, loss=0.5848, lr=4.33e-05]
Epoch 2/5:  58%|█████▊    | 677/1177 [31:44<22:32,  2.71s/it, exist=0.3696, loss=0.5848, lr=4.33e-05]
Epoch 2/5:  58%|█████▊    | 677/1177 [31:46<22:32,  2.71s/it, exist=0.3696, loss=0.5847, lr=4.33e-05]
Epoch 2/5:  58%|█████▊    | 678/1177 [31:46<22:25,  2.70s/it, exist=0.3696, loss=0.5847, lr=4.33e-05]
Epoch 2/5:  58%|█████▊    | 678/1177 [31:49<22:25,  2.70s/it, exist=0.3693, loss=0.5844, lr=4.33e-05]
Epoch 2/5:  58%|█████▊    | 679/1177 [31:49<22:09,  2.67s/it, exist=0.3693, loss=0.5844, lr=4.33e-05]
Epoch 2/5:  58%|█████▊    | 679/1177 [31:52<22:09,  2.67s/it, exist=0.3689, loss=0.5840, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 680/1177 [31:52<22:04,  2.67s/it, exist=0.3689, loss=0.5840, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 680/1177 [31:54<22:04,  2.67s/it, exist=0.3689, loss=0.5839, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 681/1177 [31:54<21:27,  2.60s/it, exist=0.3689, loss=0.5839, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 681/1177 [31:56<21:27,  2.60s/it, exist=0.3692, loss=0.5841, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 682/1177 [31:56<20:04,  2.43s/it, exist=0.3692, loss=0.5841, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 682/1177 [31:59<20:04,  2.43s/it, exist=0.3692, loss=0.5840, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 683/1177 [31:59<22:26,  2.73s/it, exist=0.3692, loss=0.5840, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 683/1177 [32:01<22:26,  2.73s/it, exist=0.3690, loss=0.5837, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 684/1177 [32:01<20:42,  2.52s/it, exist=0.3690, loss=0.5837, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 684/1177 [32:04<20:42,  2.52s/it, exist=0.3688, loss=0.5835, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 685/1177 [32:04<20:55,  2.55s/it, exist=0.3688, loss=0.5835, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 685/1177 [32:08<20:55,  2.55s/it, exist=0.3687, loss=0.5833, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 686/1177 [32:08<23:05,  2.82s/it, exist=0.3687, loss=0.5833, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 686/1177 [32:10<23:05,  2.82s/it, exist=0.3687, loss=0.5832, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 687/1177 [32:10<22:36,  2.77s/it, exist=0.3687, loss=0.5832, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 687/1177 [32:13<22:36,  2.77s/it, exist=0.3682, loss=0.5828, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 688/1177 [32:13<22:21,  2.74s/it, exist=0.3682, loss=0.5828, lr=4.32e-05]
Epoch 2/5:  58%|█████▊    | 688/1177 [32:15<22:21,  2.74s/it, exist=0.3690, loss=0.5835, lr=4.32e-05]
Epoch 2/5:  59%|█████▊    | 689/1177 [32:15<22:00,  2.71s/it, exist=0.3690, loss=0.5835, lr=4.32e-05]
Epoch 2/5:  59%|█████▊    | 689/1177 [32:18<22:00,  2.71s/it, exist=0.3693, loss=0.5838, lr=4.31e-05]
Epoch 2/5:  59%|█████▊    | 690/1177 [32:18<21:46,  2.68s/it, exist=0.3693, loss=0.5838, lr=4.31e-05]
Epoch 2/5:  59%|█████▊    | 690/1177 [32:20<21:46,  2.68s/it, exist=0.3688, loss=0.5834, lr=4.31e-05]
Epoch 2/5:  59%|█████▊    | 691/1177 [32:20<20:09,  2.49s/it, exist=0.3688, loss=0.5834, lr=4.31e-05]
Epoch 2/5:  59%|█████▊    | 691/1177 [32:23<20:09,  2.49s/it, exist=0.3685, loss=0.5830, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 692/1177 [32:23<22:06,  2.74s/it, exist=0.3685, loss=0.5830, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 692/1177 [32:26<22:06,  2.74s/it, exist=0.3683, loss=0.5828, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 693/1177 [32:26<21:49,  2.71s/it, exist=0.3683, loss=0.5828, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 693/1177 [32:28<21:49,  2.71s/it, exist=0.3683, loss=0.5827, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 694/1177 [32:28<20:08,  2.50s/it, exist=0.3683, loss=0.5827, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 694/1177 [32:31<20:08,  2.50s/it, exist=0.3683, loss=0.5828, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 695/1177 [32:31<22:00,  2.74s/it, exist=0.3683, loss=0.5828, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 695/1177 [32:34<22:00,  2.74s/it, exist=0.3687, loss=0.5831, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 696/1177 [32:34<21:27,  2.68s/it, exist=0.3687, loss=0.5831, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 696/1177 [32:36<21:27,  2.68s/it, exist=0.3684, loss=0.5829, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 697/1177 [32:36<20:55,  2.61s/it, exist=0.3684, loss=0.5829, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 697/1177 [32:39<20:55,  2.61s/it, exist=0.3681, loss=0.5826, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 698/1177 [32:39<21:05,  2.64s/it, exist=0.3681, loss=0.5826, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 698/1177 [32:42<21:05,  2.64s/it, exist=0.3679, loss=0.5823, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 699/1177 [32:42<21:05,  2.65s/it, exist=0.3679, loss=0.5823, lr=4.31e-05]
Epoch 2/5:  59%|█████▉    | 699/1177 [32:44<21:05,  2.65s/it, exist=0.3686, loss=0.5831, lr=4.30e-05]
Epoch 2/5:  59%|█████▉    | 700/1177 [32:44<20:52,  2.63s/it, exist=0.3686, loss=0.5831, lr=4.30e-05]
Epoch 2/5:  59%|█████▉    | 700/1177 [32:46<20:52,  2.63s/it, exist=0.3682, loss=0.5827, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 701/1177 [32:46<19:28,  2.45s/it, exist=0.3682, loss=0.5827, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 701/1177 [32:50<19:28,  2.45s/it, exist=0.3684, loss=0.5829, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 702/1177 [32:50<21:17,  2.69s/it, exist=0.3684, loss=0.5829, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 702/1177 [32:52<21:17,  2.69s/it, exist=0.3687, loss=0.5833, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 703/1177 [32:52<21:02,  2.66s/it, exist=0.3687, loss=0.5833, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 703/1177 [32:55<21:02,  2.66s/it, exist=0.3686, loss=0.5833, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 704/1177 [32:55<20:48,  2.64s/it, exist=0.3686, loss=0.5833, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 704/1177 [32:57<20:48,  2.64s/it, exist=0.3689, loss=0.5839, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 705/1177 [32:57<20:46,  2.64s/it, exist=0.3689, loss=0.5839, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 705/1177 [33:00<20:46,  2.64s/it, exist=0.3690, loss=0.5840, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 706/1177 [33:00<20:56,  2.67s/it, exist=0.3690, loss=0.5840, lr=4.30e-05]
Epoch 2/5:  60%|█████▉    | 706/1177 [33:03<20:56,  2.67s/it, exist=0.3691, loss=0.5840, lr=4.30e-05]
Epoch 2/5:  60%|██████    | 707/1177 [33:03<20:55,  2.67s/it, exist=0.3691, loss=0.5840, lr=4.30e-05]
Epoch 2/5:  60%|██████    | 707/1177 [33:05<20:55,  2.67s/it, exist=0.3688, loss=0.5837, lr=4.30e-05]
Epoch 2/5:  60%|██████    | 708/1177 [33:05<19:18,  2.47s/it, exist=0.3688, loss=0.5837, lr=4.30e-05]
Epoch 2/5:  60%|██████    | 708/1177 [33:08<19:18,  2.47s/it, exist=0.3690, loss=0.5838, lr=4.30e-05]
Epoch 2/5:  60%|██████    | 709/1177 [33:08<21:10,  2.71s/it, exist=0.3690, loss=0.5838, lr=4.30e-05]
Epoch 2/5:  60%|██████    | 709/1177 [33:11<21:10,  2.71s/it, exist=0.3688, loss=0.5836, lr=4.29e-05]
Epoch 2/5:  60%|██████    | 710/1177 [33:11<20:38,  2.65s/it, exist=0.3688, loss=0.5836, lr=4.29e-05]
Epoch 2/5:  60%|██████    | 710/1177 [33:13<20:38,  2.65s/it, exist=0.3687, loss=0.5835, lr=4.29e-05]
Epoch 2/5:  60%|██████    | 711/1177 [33:13<20:38,  2.66s/it, exist=0.3687, loss=0.5835, lr=4.29e-05]
Epoch 2/5:  60%|██████    | 711/1177 [33:15<20:38,  2.66s/it, exist=0.3687, loss=0.5834, lr=4.29e-05]
Epoch 2/5:  60%|██████    | 712/1177 [33:15<19:09,  2.47s/it, exist=0.3687, loss=0.5834, lr=4.29e-05]
Epoch 2/5:  60%|██████    | 712/1177 [33:18<19:09,  2.47s/it, exist=0.3687, loss=0.5833, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 713/1177 [33:18<19:44,  2.55s/it, exist=0.3687, loss=0.5833, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 713/1177 [33:21<19:44,  2.55s/it, exist=0.3686, loss=0.5833, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 714/1177 [33:21<19:34,  2.54s/it, exist=0.3686, loss=0.5833, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 714/1177 [33:23<19:34,  2.54s/it, exist=0.3684, loss=0.5831, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 715/1177 [33:23<19:43,  2.56s/it, exist=0.3684, loss=0.5831, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 715/1177 [33:27<19:43,  2.56s/it, exist=0.3684, loss=0.5831, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 716/1177 [33:27<21:30,  2.80s/it, exist=0.3684, loss=0.5831, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 716/1177 [33:30<21:30,  2.80s/it, exist=0.3682, loss=0.5831, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 717/1177 [33:30<22:11,  2.90s/it, exist=0.3682, loss=0.5831, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 717/1177 [33:32<22:11,  2.90s/it, exist=0.3684, loss=0.5833, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 718/1177 [33:32<20:16,  2.65s/it, exist=0.3684, loss=0.5833, lr=4.29e-05]
Epoch 2/5:  61%|██████    | 718/1177 [33:34<20:16,  2.65s/it, exist=0.3685, loss=0.5833, lr=4.28e-05]
Epoch 2/5:  61%|██████    | 719/1177 [33:34<18:47,  2.46s/it, exist=0.3685, loss=0.5833, lr=4.28e-05]
Epoch 2/5:  61%|██████    | 719/1177 [33:37<18:47,  2.46s/it, exist=0.3690, loss=0.5838, lr=4.28e-05]
Epoch 2/5:  61%|██████    | 720/1177 [33:37<20:23,  2.68s/it, exist=0.3690, loss=0.5838, lr=4.28e-05]
Epoch 2/5:  61%|██████    | 720/1177 [33:39<20:23,  2.68s/it, exist=0.3693, loss=0.5841, lr=4.28e-05]
Epoch 2/5:  61%|██████▏   | 721/1177 [33:39<19:45,  2.60s/it, exist=0.3693, loss=0.5841, lr=4.28e-05]
Epoch 2/5:  61%|██████▏   | 721/1177 [33:42<19:45,  2.60s/it, exist=0.3693, loss=0.5842, lr=4.28e-05]
Epoch 2/5:  61%|██████▏   | 722/1177 [33:42<19:32,  2.58s/it, exist=0.3693, loss=0.5842, lr=4.28e-05]
Epoch 2/5:  61%|██████▏   | 722/1177 [33:44<19:32,  2.58s/it, exist=0.3690, loss=0.5839, lr=4.28e-05]
Epoch 2/5:  61%|██████▏   | 723/1177 [33:44<18:14,  2.41s/it, exist=0.3690, loss=0.5839, lr=4.28e-05]
Epoch 2/5:  61%|██████▏   | 723/1177 [33:46<18:14,  2.41s/it, exist=0.3688, loss=0.5838, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 724/1177 [33:46<17:19,  2.29s/it, exist=0.3688, loss=0.5838, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 724/1177 [33:50<17:19,  2.29s/it, exist=0.3690, loss=0.5839, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 725/1177 [33:50<20:57,  2.78s/it, exist=0.3690, loss=0.5839, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 725/1177 [33:53<20:57,  2.78s/it, exist=0.3689, loss=0.5837, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 726/1177 [33:53<20:37,  2.74s/it, exist=0.3689, loss=0.5837, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 726/1177 [33:55<20:37,  2.74s/it, exist=0.3688, loss=0.5836, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 727/1177 [33:55<20:06,  2.68s/it, exist=0.3688, loss=0.5836, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 727/1177 [33:58<20:06,  2.68s/it, exist=0.3684, loss=0.5832, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 728/1177 [33:58<20:11,  2.70s/it, exist=0.3684, loss=0.5832, lr=4.28e-05]
Epoch 2/5:  62%|██████▏   | 728/1177 [34:00<20:11,  2.70s/it, exist=0.3686, loss=0.5834, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 729/1177 [34:00<18:33,  2.49s/it, exist=0.3686, loss=0.5834, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 729/1177 [34:02<18:33,  2.49s/it, exist=0.3683, loss=0.5831, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 730/1177 [34:02<18:45,  2.52s/it, exist=0.3683, loss=0.5831, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 730/1177 [34:06<18:45,  2.52s/it, exist=0.3679, loss=0.5826, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 731/1177 [34:06<20:23,  2.74s/it, exist=0.3679, loss=0.5826, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 731/1177 [34:09<20:23,  2.74s/it, exist=0.3678, loss=0.5826, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 732/1177 [34:09<20:59,  2.83s/it, exist=0.3678, loss=0.5826, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 732/1177 [34:11<20:59,  2.83s/it, exist=0.3676, loss=0.5823, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 733/1177 [34:11<19:03,  2.57s/it, exist=0.3676, loss=0.5823, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 733/1177 [34:13<19:03,  2.57s/it, exist=0.3676, loss=0.5823, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 734/1177 [34:13<19:23,  2.63s/it, exist=0.3676, loss=0.5823, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 734/1177 [34:16<19:23,  2.63s/it, exist=0.3674, loss=0.5819, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 735/1177 [34:16<19:32,  2.65s/it, exist=0.3674, loss=0.5819, lr=4.27e-05]
Epoch 2/5:  62%|██████▏   | 735/1177 [34:19<19:32,  2.65s/it, exist=0.3676, loss=0.5820, lr=4.27e-05]
Epoch 2/5:  63%|██████▎   | 736/1177 [34:19<19:27,  2.65s/it, exist=0.3676, loss=0.5820, lr=4.27e-05]
Epoch 2/5:  63%|██████▎   | 736/1177 [34:21<19:27,  2.65s/it, exist=0.3675, loss=0.5818, lr=4.27e-05]
Epoch 2/5:  63%|██████▎   | 737/1177 [34:21<18:01,  2.46s/it, exist=0.3675, loss=0.5818, lr=4.27e-05]
Epoch 2/5:  63%|██████▎   | 737/1177 [34:24<18:01,  2.46s/it, exist=0.3674, loss=0.5818, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 738/1177 [34:24<20:02,  2.74s/it, exist=0.3674, loss=0.5818, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 738/1177 [34:27<20:02,  2.74s/it, exist=0.3673, loss=0.5819, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 739/1177 [34:27<19:46,  2.71s/it, exist=0.3673, loss=0.5819, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 739/1177 [34:30<19:46,  2.71s/it, exist=0.3671, loss=0.5816, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 740/1177 [34:30<20:47,  2.85s/it, exist=0.3671, loss=0.5816, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 740/1177 [34:32<20:47,  2.85s/it, exist=0.3667, loss=0.5812, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 741/1177 [34:32<18:45,  2.58s/it, exist=0.3667, loss=0.5812, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 741/1177 [34:35<18:45,  2.58s/it, exist=0.3666, loss=0.5811, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 742/1177 [34:35<18:57,  2.61s/it, exist=0.3666, loss=0.5811, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 742/1177 [34:37<18:57,  2.61s/it, exist=0.3663, loss=0.5808, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 743/1177 [34:37<18:57,  2.62s/it, exist=0.3663, loss=0.5808, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 743/1177 [34:40<18:57,  2.62s/it, exist=0.3662, loss=0.5807, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 744/1177 [34:40<18:57,  2.63s/it, exist=0.3662, loss=0.5807, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 744/1177 [34:43<18:57,  2.63s/it, exist=0.3661, loss=0.5806, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 745/1177 [34:43<18:51,  2.62s/it, exist=0.3661, loss=0.5806, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 745/1177 [34:45<18:51,  2.62s/it, exist=0.3660, loss=0.5805, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 746/1177 [34:45<18:54,  2.63s/it, exist=0.3660, loss=0.5805, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 746/1177 [34:48<18:54,  2.63s/it, exist=0.3659, loss=0.5804, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 747/1177 [34:48<18:52,  2.63s/it, exist=0.3659, loss=0.5804, lr=4.26e-05]
Epoch 2/5:  63%|██████▎   | 747/1177 [34:50<18:52,  2.63s/it, exist=0.3659, loss=0.5804, lr=4.25e-05]
Epoch 2/5:  64%|██████▎   | 748/1177 [34:50<17:29,  2.45s/it, exist=0.3659, loss=0.5804, lr=4.25e-05]
Epoch 2/5:  64%|██████▎   | 748/1177 [34:53<17:29,  2.45s/it, exist=0.3655, loss=0.5799, lr=4.25e-05]
Epoch 2/5:  64%|██████▎   | 749/1177 [34:53<19:17,  2.70s/it, exist=0.3655, loss=0.5799, lr=4.25e-05]
Epoch 2/5:  64%|██████▎   | 749/1177 [34:56<19:17,  2.70s/it, exist=0.3653, loss=0.5798, lr=4.25e-05]
Epoch 2/5:  64%|██████▎   | 750/1177 [34:56<20:07,  2.83s/it, exist=0.3653, loss=0.5798, lr=4.25e-05]
Epoch 2/5:  64%|██████▎   | 750/1177 [34:58<20:07,  2.83s/it, exist=0.3652, loss=0.5797, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 751/1177 [34:58<18:27,  2.60s/it, exist=0.3652, loss=0.5797, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 751/1177 [35:01<18:27,  2.60s/it, exist=0.3653, loss=0.5798, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 752/1177 [35:01<18:33,  2.62s/it, exist=0.3653, loss=0.5798, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 752/1177 [35:04<18:33,  2.62s/it, exist=0.3650, loss=0.5795, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 753/1177 [35:04<18:36,  2.63s/it, exist=0.3650, loss=0.5795, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 753/1177 [35:07<18:36,  2.63s/it, exist=0.3647, loss=0.5796, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 754/1177 [35:07<19:49,  2.81s/it, exist=0.3647, loss=0.5796, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 754/1177 [35:10<19:49,  2.81s/it, exist=0.3647, loss=0.5795, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 755/1177 [35:10<19:51,  2.82s/it, exist=0.3647, loss=0.5795, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 755/1177 [35:13<19:51,  2.82s/it, exist=0.3649, loss=0.5796, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 756/1177 [35:13<21:38,  3.08s/it, exist=0.3649, loss=0.5796, lr=4.25e-05]
Epoch 2/5:  64%|██████▍   | 756/1177 [35:17<21:38,  3.08s/it, exist=0.3648, loss=0.5795, lr=4.24e-05]
Epoch 2/5:  64%|██████▍   | 757/1177 [35:17<22:06,  3.16s/it, exist=0.3648, loss=0.5795, lr=4.24e-05]
Epoch 2/5:  64%|██████▍   | 757/1177 [35:19<22:06,  3.16s/it, exist=0.3646, loss=0.5794, lr=4.24e-05]
Epoch 2/5:  64%|██████▍   | 758/1177 [35:20<21:05,  3.02s/it, exist=0.3646, loss=0.5794, lr=4.24e-05]
Epoch 2/5:  64%|██████▍   | 758/1177 [35:22<21:05,  3.02s/it, exist=0.3643, loss=0.5790, lr=4.24e-05]
Epoch 2/5:  64%|██████▍   | 759/1177 [35:22<19:39,  2.82s/it, exist=0.3643, loss=0.5790, lr=4.24e-05]
Epoch 2/5:  64%|██████▍   | 759/1177 [35:27<19:39,  2.82s/it, exist=0.3643, loss=0.5790, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 760/1177 [35:27<23:28,  3.38s/it, exist=0.3643, loss=0.5790, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 760/1177 [35:30<23:28,  3.38s/it, exist=0.3643, loss=0.5791, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 761/1177 [35:30<22:46,  3.29s/it, exist=0.3643, loss=0.5791, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 761/1177 [35:32<22:46,  3.29s/it, exist=0.3639, loss=0.5788, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 762/1177 [35:32<20:10,  2.92s/it, exist=0.3639, loss=0.5788, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 762/1177 [35:35<20:10,  2.92s/it, exist=0.3639, loss=0.5788, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 763/1177 [35:35<20:18,  2.94s/it, exist=0.3639, loss=0.5788, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 763/1177 [35:38<20:18,  2.94s/it, exist=0.3639, loss=0.5788, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 764/1177 [35:38<21:59,  3.19s/it, exist=0.3639, loss=0.5788, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 764/1177 [35:43<21:59,  3.19s/it, exist=0.3643, loss=0.5791, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 765/1177 [35:43<24:37,  3.59s/it, exist=0.3643, loss=0.5791, lr=4.24e-05]
Epoch 2/5:  65%|██████▍   | 765/1177 [35:46<24:37,  3.59s/it, exist=0.3642, loss=0.5789, lr=4.24e-05]
Epoch 2/5:  65%|██████▌   | 766/1177 [35:46<23:57,  3.50s/it, exist=0.3642, loss=0.5789, lr=4.24e-05]
Epoch 2/5:  65%|██████▌   | 766/1177 [35:48<23:57,  3.50s/it, exist=0.3642, loss=0.5791, lr=4.23e-05]
Epoch 2/5:  65%|██████▌   | 767/1177 [35:48<20:49,  3.05s/it, exist=0.3642, loss=0.5791, lr=4.23e-05]
Epoch 2/5:  65%|██████▌   | 767/1177 [35:51<20:49,  3.05s/it, exist=0.3644, loss=0.5792, lr=4.23e-05]
Epoch 2/5:  65%|██████▌   | 768/1177 [35:51<19:53,  2.92s/it, exist=0.3644, loss=0.5792, lr=4.23e-05]
Epoch 2/5:  65%|██████▌   | 768/1177 [35:53<19:53,  2.92s/it, exist=0.3641, loss=0.5788, lr=4.23e-05]
Epoch 2/5:  65%|██████▌   | 769/1177 [35:53<19:07,  2.81s/it, exist=0.3641, loss=0.5788, lr=4.23e-05]
Epoch 2/5:  65%|██████▌   | 769/1177 [35:56<19:07,  2.81s/it, exist=0.3639, loss=0.5785, lr=4.23e-05]
Epoch 2/5:  65%|██████▌   | 770/1177 [35:56<18:43,  2.76s/it, exist=0.3639, loss=0.5785, lr=4.23e-05]
Epoch 2/5:  65%|██████▌   | 770/1177 [35:59<18:43,  2.76s/it, exist=0.3639, loss=0.5785, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 771/1177 [35:59<18:31,  2.74s/it, exist=0.3639, loss=0.5785, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 771/1177 [36:01<18:31,  2.74s/it, exist=0.3641, loss=0.5786, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 772/1177 [36:01<16:56,  2.51s/it, exist=0.3641, loss=0.5786, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 772/1177 [36:03<16:56,  2.51s/it, exist=0.3641, loss=0.5786, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 773/1177 [36:03<16:47,  2.49s/it, exist=0.3641, loss=0.5786, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 773/1177 [36:06<16:47,  2.49s/it, exist=0.3639, loss=0.5786, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 774/1177 [36:06<16:50,  2.51s/it, exist=0.3639, loss=0.5786, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 774/1177 [36:09<16:50,  2.51s/it, exist=0.3638, loss=0.5785, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 775/1177 [36:09<18:18,  2.73s/it, exist=0.3638, loss=0.5785, lr=4.23e-05]
Epoch 2/5:  66%|██████▌   | 775/1177 [36:11<18:18,  2.73s/it, exist=0.3639, loss=0.5786, lr=4.22e-05]
Epoch 2/5:  66%|██████▌   | 776/1177 [36:11<16:40,  2.50s/it, exist=0.3639, loss=0.5786, lr=4.22e-05]
Epoch 2/5:  66%|██████▌   | 776/1177 [36:14<16:40,  2.50s/it, exist=0.3638, loss=0.5785, lr=4.22e-05]
Epoch 2/5:  66%|██████▌   | 777/1177 [36:14<17:46,  2.67s/it, exist=0.3638, loss=0.5785, lr=4.22e-05]
Epoch 2/5:  66%|██████▌   | 777/1177 [36:16<17:46,  2.67s/it, exist=0.3635, loss=0.5782, lr=4.22e-05]
Epoch 2/5:  66%|██████▌   | 778/1177 [36:16<16:27,  2.47s/it, exist=0.3635, loss=0.5782, lr=4.22e-05]
Epoch 2/5:  66%|██████▌   | 778/1177 [36:19<16:27,  2.47s/it, exist=0.3634, loss=0.5781, lr=4.22e-05]
Epoch 2/5:  66%|██████▌   | 779/1177 [36:19<18:09,  2.74s/it, exist=0.3634, loss=0.5781, lr=4.22e-05]
Epoch 2/5:  66%|██████▌   | 779/1177 [36:22<18:09,  2.74s/it, exist=0.3636, loss=0.5782, lr=4.22e-05]
Epoch 2/5:  66%|██████▋   | 780/1177 [36:22<17:54,  2.71s/it, exist=0.3636, loss=0.5782, lr=4.22e-05]
Epoch 2/5:  66%|██████▋   | 780/1177 [36:25<17:54,  2.71s/it, exist=0.3638, loss=0.5784, lr=4.22e-05]
Epoch 2/5:  66%|██████▋   | 781/1177 [36:25<17:35,  2.67s/it, exist=0.3638, loss=0.5784, lr=4.22e-05]
Epoch 2/5:  66%|██████▋   | 781/1177 [36:27<17:35,  2.67s/it, exist=0.3636, loss=0.5784, lr=4.22e-05]
Epoch 2/5:  66%|██████▋   | 782/1177 [36:27<17:39,  2.68s/it, exist=0.3636, loss=0.5784, lr=4.22e-05]
Epoch 2/5:  66%|██████▋   | 782/1177 [36:30<17:39,  2.68s/it, exist=0.3632, loss=0.5779, lr=4.22e-05]
Epoch 2/5:  67%|██████▋   | 783/1177 [36:30<17:36,  2.68s/it, exist=0.3632, loss=0.5779, lr=4.22e-05]
Epoch 2/5:  67%|██████▋   | 783/1177 [36:33<17:36,  2.68s/it, exist=0.3629, loss=0.5775, lr=4.22e-05]
Epoch 2/5:  67%|██████▋   | 784/1177 [36:33<17:41,  2.70s/it, exist=0.3629, loss=0.5775, lr=4.22e-05]
Epoch 2/5:  67%|██████▋   | 784/1177 [36:35<17:41,  2.70s/it, exist=0.3628, loss=0.5774, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 785/1177 [36:35<17:32,  2.68s/it, exist=0.3628, loss=0.5774, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 785/1177 [36:38<17:32,  2.68s/it, exist=0.3626, loss=0.5772, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 786/1177 [36:38<18:16,  2.80s/it, exist=0.3626, loss=0.5772, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 786/1177 [36:40<18:16,  2.80s/it, exist=0.3626, loss=0.5772, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 787/1177 [36:40<16:39,  2.56s/it, exist=0.3626, loss=0.5772, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 787/1177 [36:43<16:39,  2.56s/it, exist=0.3623, loss=0.5770, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 788/1177 [36:43<16:54,  2.61s/it, exist=0.3623, loss=0.5770, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 788/1177 [36:46<16:54,  2.61s/it, exist=0.3620, loss=0.5767, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 789/1177 [36:46<16:59,  2.63s/it, exist=0.3620, loss=0.5767, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 789/1177 [36:48<16:59,  2.63s/it, exist=0.3617, loss=0.5769, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 790/1177 [36:48<15:43,  2.44s/it, exist=0.3617, loss=0.5769, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 790/1177 [36:51<15:43,  2.44s/it, exist=0.3616, loss=0.5768, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 791/1177 [36:51<17:24,  2.71s/it, exist=0.3616, loss=0.5768, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 791/1177 [36:54<17:24,  2.71s/it, exist=0.3618, loss=0.5773, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 792/1177 [36:54<17:12,  2.68s/it, exist=0.3618, loss=0.5773, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 792/1177 [36:56<17:12,  2.68s/it, exist=0.3619, loss=0.5775, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 793/1177 [36:56<17:08,  2.68s/it, exist=0.3619, loss=0.5775, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 793/1177 [36:59<17:08,  2.68s/it, exist=0.3618, loss=0.5774, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 794/1177 [36:59<16:59,  2.66s/it, exist=0.3618, loss=0.5774, lr=4.21e-05]
Epoch 2/5:  67%|██████▋   | 794/1177 [37:02<16:59,  2.66s/it, exist=0.3617, loss=0.5774, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 795/1177 [37:02<16:41,  2.62s/it, exist=0.3617, loss=0.5774, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 795/1177 [37:04<16:41,  2.62s/it, exist=0.3618, loss=0.5775, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 796/1177 [37:04<15:27,  2.43s/it, exist=0.3618, loss=0.5775, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 796/1177 [37:07<15:27,  2.43s/it, exist=0.3616, loss=0.5773, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 797/1177 [37:07<17:04,  2.69s/it, exist=0.3616, loss=0.5773, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 797/1177 [37:09<17:04,  2.69s/it, exist=0.3614, loss=0.5771, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 798/1177 [37:09<16:39,  2.64s/it, exist=0.3614, loss=0.5771, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 798/1177 [37:12<16:39,  2.64s/it, exist=0.3614, loss=0.5770, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 799/1177 [37:12<16:50,  2.67s/it, exist=0.3614, loss=0.5770, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 799/1177 [37:17<16:50,  2.67s/it, exist=0.3613, loss=0.5769, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 800/1177 [37:17<20:47,  3.31s/it, exist=0.3613, loss=0.5769, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 800/1177 [37:21<20:47,  3.31s/it, exist=0.3610, loss=0.5767, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 801/1177 [37:21<22:52,  3.65s/it, exist=0.3610, loss=0.5767, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 801/1177 [37:24<22:52,  3.65s/it, exist=0.3614, loss=0.5770, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 802/1177 [37:24<20:57,  3.35s/it, exist=0.3614, loss=0.5770, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 802/1177 [37:26<20:57,  3.35s/it, exist=0.3615, loss=0.5770, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 803/1177 [37:26<18:25,  2.96s/it, exist=0.3615, loss=0.5770, lr=4.20e-05]
Epoch 2/5:  68%|██████▊   | 803/1177 [37:29<18:25,  2.96s/it, exist=0.3614, loss=0.5768, lr=4.19e-05]
Epoch 2/5:  68%|██████▊   | 804/1177 [37:29<18:01,  2.90s/it, exist=0.3614, loss=0.5768, lr=4.19e-05]
Epoch 2/5:  68%|██████▊   | 804/1177 [37:31<18:01,  2.90s/it, exist=0.3611, loss=0.5765, lr=4.19e-05]
Epoch 2/5:  68%|██████▊   | 805/1177 [37:31<17:27,  2.82s/it, exist=0.3611, loss=0.5765, lr=4.19e-05]
Epoch 2/5:  68%|██████▊   | 805/1177 [37:34<17:27,  2.82s/it, exist=0.3608, loss=0.5761, lr=4.19e-05]
Epoch 2/5:  68%|██████▊   | 806/1177 [37:34<17:07,  2.77s/it, exist=0.3608, loss=0.5761, lr=4.19e-05]
Epoch 2/5:  68%|██████▊   | 806/1177 [37:37<17:07,  2.77s/it, exist=0.3610, loss=0.5764, lr=4.19e-05]
Epoch 2/5:  69%|██████▊   | 807/1177 [37:37<16:32,  2.68s/it, exist=0.3610, loss=0.5764, lr=4.19e-05]
Epoch 2/5:  69%|██████▊   | 807/1177 [37:39<16:32,  2.68s/it, exist=0.3612, loss=0.5766, lr=4.19e-05]
Epoch 2/5:  69%|██████▊   | 808/1177 [37:39<15:08,  2.46s/it, exist=0.3612, loss=0.5766, lr=4.19e-05]
Epoch 2/5:  69%|██████▊   | 808/1177 [37:42<15:08,  2.46s/it, exist=0.3610, loss=0.5766, lr=4.19e-05]
Epoch 2/5:  69%|██████▊   | 809/1177 [37:42<16:45,  2.73s/it, exist=0.3610, loss=0.5766, lr=4.19e-05]
Epoch 2/5:  69%|██████▊   | 809/1177 [37:44<16:45,  2.73s/it, exist=0.3608, loss=0.5764, lr=4.19e-05]
Epoch 2/5:  69%|██████▉   | 810/1177 [37:44<15:31,  2.54s/it, exist=0.3608, loss=0.5764, lr=4.19e-05]
Epoch 2/5:  69%|██████▉   | 810/1177 [37:47<15:31,  2.54s/it, exist=0.3611, loss=0.5767, lr=4.19e-05]
Epoch 2/5:  69%|██████▉   | 811/1177 [37:47<16:46,  2.75s/it, exist=0.3611, loss=0.5767, lr=4.19e-05]
Epoch 2/5:  69%|██████▉   | 811/1177 [37:50<16:46,  2.75s/it, exist=0.3613, loss=0.5769, lr=4.19e-05]
Epoch 2/5:  69%|██████▉   | 812/1177 [37:50<16:13,  2.67s/it, exist=0.3613, loss=0.5769, lr=4.19e-05]
Epoch 2/5:  69%|██████▉   | 812/1177 [37:52<16:13,  2.67s/it, exist=0.3612, loss=0.5768, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 813/1177 [37:52<16:06,  2.66s/it, exist=0.3612, loss=0.5768, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 813/1177 [37:54<16:06,  2.66s/it, exist=0.3611, loss=0.5767, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 814/1177 [37:54<14:51,  2.46s/it, exist=0.3611, loss=0.5767, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 814/1177 [37:58<14:51,  2.46s/it, exist=0.3608, loss=0.5764, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 815/1177 [37:58<16:29,  2.73s/it, exist=0.3608, loss=0.5764, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 815/1177 [38:00<16:29,  2.73s/it, exist=0.3609, loss=0.5764, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 816/1177 [38:00<16:23,  2.73s/it, exist=0.3609, loss=0.5764, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 816/1177 [38:02<16:23,  2.73s/it, exist=0.3606, loss=0.5760, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 817/1177 [38:02<15:00,  2.50s/it, exist=0.3606, loss=0.5760, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 817/1177 [38:06<15:00,  2.50s/it, exist=0.3606, loss=0.5760, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 818/1177 [38:06<17:30,  2.93s/it, exist=0.3606, loss=0.5760, lr=4.18e-05]
Epoch 2/5:  69%|██████▉   | 818/1177 [38:08<17:30,  2.93s/it, exist=0.3605, loss=0.5760, lr=4.18e-05]
Epoch 2/5:  70%|██████▉   | 819/1177 [38:08<15:49,  2.65s/it, exist=0.3605, loss=0.5760, lr=4.18e-05]
Epoch 2/5:  70%|██████▉   | 819/1177 [38:10<15:49,  2.65s/it, exist=0.3608, loss=0.5762, lr=4.18e-05]
Epoch 2/5:  70%|██████▉   | 820/1177 [38:10<14:36,  2.45s/it, exist=0.3608, loss=0.5762, lr=4.18e-05]
Epoch 2/5:  70%|██████▉   | 820/1177 [38:13<14:36,  2.45s/it, exist=0.3607, loss=0.5762, lr=4.18e-05]
Epoch 2/5:  70%|██████▉   | 821/1177 [38:13<14:56,  2.52s/it, exist=0.3607, loss=0.5762, lr=4.18e-05]
Epoch 2/5:  70%|██████▉   | 821/1177 [38:17<14:56,  2.52s/it, exist=0.3605, loss=0.5759, lr=4.17e-05]
Epoch 2/5:  70%|██████▉   | 822/1177 [38:17<17:23,  2.94s/it, exist=0.3605, loss=0.5759, lr=4.17e-05]
Epoch 2/5:  70%|██████▉   | 822/1177 [38:19<17:23,  2.94s/it, exist=0.3606, loss=0.5760, lr=4.17e-05]
Epoch 2/5:  70%|██████▉   | 823/1177 [38:19<15:46,  2.67s/it, exist=0.3606, loss=0.5760, lr=4.17e-05]
Epoch 2/5:  70%|██████▉   | 823/1177 [38:24<15:46,  2.67s/it, exist=0.3604, loss=0.5758, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 824/1177 [38:24<19:08,  3.25s/it, exist=0.3604, loss=0.5758, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 824/1177 [38:27<19:08,  3.25s/it, exist=0.3605, loss=0.5760, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 825/1177 [38:27<19:52,  3.39s/it, exist=0.3605, loss=0.5760, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 825/1177 [38:31<19:52,  3.39s/it, exist=0.3602, loss=0.5757, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 826/1177 [38:31<20:22,  3.48s/it, exist=0.3602, loss=0.5757, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 826/1177 [38:33<20:22,  3.48s/it, exist=0.3599, loss=0.5754, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 827/1177 [38:33<18:35,  3.19s/it, exist=0.3599, loss=0.5754, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 827/1177 [38:36<18:35,  3.19s/it, exist=0.3597, loss=0.5754, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 828/1177 [38:36<16:30,  2.84s/it, exist=0.3597, loss=0.5754, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 828/1177 [38:38<16:30,  2.84s/it, exist=0.3598, loss=0.5755, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 829/1177 [38:38<16:10,  2.79s/it, exist=0.3598, loss=0.5755, lr=4.17e-05]
Epoch 2/5:  70%|███████   | 829/1177 [38:40<16:10,  2.79s/it, exist=0.3597, loss=0.5756, lr=4.17e-05]
Epoch 2/5:  71%|███████   | 830/1177 [38:40<14:43,  2.55s/it, exist=0.3597, loss=0.5756, lr=4.17e-05]
Epoch 2/5:  71%|███████   | 830/1177 [38:43<14:43,  2.55s/it, exist=0.3597, loss=0.5755, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 831/1177 [38:43<15:51,  2.75s/it, exist=0.3597, loss=0.5755, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 831/1177 [38:47<15:51,  2.75s/it, exist=0.3598, loss=0.5756, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 832/1177 [38:47<17:38,  3.07s/it, exist=0.3598, loss=0.5756, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 832/1177 [38:50<17:38,  3.07s/it, exist=0.3596, loss=0.5754, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 833/1177 [38:50<17:20,  3.02s/it, exist=0.3596, loss=0.5754, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 833/1177 [38:55<17:20,  3.02s/it, exist=0.3595, loss=0.5753, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 834/1177 [38:55<20:09,  3.53s/it, exist=0.3595, loss=0.5753, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 834/1177 [38:58<20:09,  3.53s/it, exist=0.3594, loss=0.5754, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 835/1177 [38:58<19:07,  3.36s/it, exist=0.3594, loss=0.5754, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 835/1177 [39:00<19:07,  3.36s/it, exist=0.3590, loss=0.5753, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 836/1177 [39:00<16:44,  2.95s/it, exist=0.3590, loss=0.5753, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 836/1177 [39:02<16:44,  2.95s/it, exist=0.3588, loss=0.5752, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 837/1177 [39:02<15:07,  2.67s/it, exist=0.3588, loss=0.5752, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 837/1177 [39:04<15:07,  2.67s/it, exist=0.3586, loss=0.5750, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 838/1177 [39:04<15:04,  2.67s/it, exist=0.3586, loss=0.5750, lr=4.16e-05]
Epoch 2/5:  71%|███████   | 838/1177 [39:08<15:04,  2.67s/it, exist=0.3584, loss=0.5748, lr=4.16e-05]
Epoch 2/5:  71%|███████▏  | 839/1177 [39:08<16:59,  3.02s/it, exist=0.3584, loss=0.5748, lr=4.16e-05]
Epoch 2/5:  71%|███████▏  | 839/1177 [39:10<16:59,  3.02s/it, exist=0.3588, loss=0.5752, lr=4.15e-05]
Epoch 2/5:  71%|███████▏  | 840/1177 [39:10<15:11,  2.70s/it, exist=0.3588, loss=0.5752, lr=4.15e-05]
Epoch 2/5:  71%|███████▏  | 840/1177 [39:13<15:11,  2.70s/it, exist=0.3587, loss=0.5750, lr=4.15e-05]
Epoch 2/5:  71%|███████▏  | 841/1177 [39:13<15:59,  2.85s/it, exist=0.3587, loss=0.5750, lr=4.15e-05]
Epoch 2/5:  71%|███████▏  | 841/1177 [39:16<15:59,  2.85s/it, exist=0.3584, loss=0.5747, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 842/1177 [39:16<14:39,  2.62s/it, exist=0.3584, loss=0.5747, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 842/1177 [39:18<14:39,  2.62s/it, exist=0.3583, loss=0.5745, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 843/1177 [39:18<13:36,  2.44s/it, exist=0.3583, loss=0.5745, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 843/1177 [39:21<13:36,  2.44s/it, exist=0.3581, loss=0.5744, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 844/1177 [39:21<15:00,  2.70s/it, exist=0.3581, loss=0.5744, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 844/1177 [39:24<15:00,  2.70s/it, exist=0.3580, loss=0.5743, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 845/1177 [39:24<14:49,  2.68s/it, exist=0.3580, loss=0.5743, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 845/1177 [39:26<14:49,  2.68s/it, exist=0.3590, loss=0.5752, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 846/1177 [39:26<14:41,  2.66s/it, exist=0.3590, loss=0.5752, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 846/1177 [39:29<14:41,  2.66s/it, exist=0.3590, loss=0.5751, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 847/1177 [39:29<14:37,  2.66s/it, exist=0.3590, loss=0.5751, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 847/1177 [39:31<14:37,  2.66s/it, exist=0.3589, loss=0.5750, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 848/1177 [39:31<14:14,  2.60s/it, exist=0.3589, loss=0.5750, lr=4.15e-05]
Epoch 2/5:  72%|███████▏  | 848/1177 [39:34<14:14,  2.60s/it, exist=0.3587, loss=0.5747, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 849/1177 [39:34<14:21,  2.63s/it, exist=0.3587, loss=0.5747, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 849/1177 [39:37<14:21,  2.63s/it, exist=0.3585, loss=0.5746, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 850/1177 [39:37<14:14,  2.61s/it, exist=0.3585, loss=0.5746, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 850/1177 [39:39<14:14,  2.61s/it, exist=0.3585, loss=0.5746, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 851/1177 [39:39<14:15,  2.62s/it, exist=0.3585, loss=0.5746, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 851/1177 [39:42<14:15,  2.62s/it, exist=0.3585, loss=0.5746, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 852/1177 [39:42<15:07,  2.79s/it, exist=0.3585, loss=0.5746, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 852/1177 [39:45<15:07,  2.79s/it, exist=0.3582, loss=0.5743, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 853/1177 [39:45<15:13,  2.82s/it, exist=0.3582, loss=0.5743, lr=4.14e-05]
Epoch 2/5:  72%|███████▏  | 853/1177 [39:50<15:13,  2.82s/it, exist=0.3582, loss=0.5744, lr=4.14e-05]
Epoch 2/5:  73%|███████▎  | 854/1177 [39:50<19:03,  3.54s/it, exist=0.3582, loss=0.5744, lr=4.14e-05]
Epoch 2/5:  73%|███████▎  | 854/1177 [39:53<19:03,  3.54s/it, exist=0.3581, loss=0.5743, lr=4.14e-05]
Epoch 2/5:  73%|███████▎  | 855/1177 [39:53<17:27,  3.25s/it, exist=0.3581, loss=0.5743, lr=4.14e-05]
Epoch 2/5:  73%|███████▎  | 855/1177 [39:56<17:27,  3.25s/it, exist=0.3579, loss=0.5741, lr=4.14e-05]
Epoch 2/5:  73%|███████▎  | 856/1177 [39:56<16:14,  3.04s/it, exist=0.3579, loss=0.5741, lr=4.14e-05]
Epoch 2/5:  73%|███████▎  | 856/1177 [39:58<16:14,  3.04s/it, exist=0.3580, loss=0.5742, lr=4.14e-05]
Epoch 2/5:  73%|███████▎  | 857/1177 [39:58<14:29,  2.72s/it, exist=0.3580, loss=0.5742, lr=4.14e-05]
Epoch 2/5:  73%|███████▎  | 857/1177 [40:00<14:29,  2.72s/it, exist=0.3578, loss=0.5741, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 858/1177 [40:00<14:29,  2.73s/it, exist=0.3578, loss=0.5741, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 858/1177 [40:03<14:29,  2.73s/it, exist=0.3578, loss=0.5741, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 859/1177 [40:03<14:10,  2.67s/it, exist=0.3578, loss=0.5741, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 859/1177 [40:06<14:10,  2.67s/it, exist=0.3576, loss=0.5738, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 860/1177 [40:06<14:06,  2.67s/it, exist=0.3576, loss=0.5738, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 860/1177 [40:08<14:06,  2.67s/it, exist=0.3574, loss=0.5737, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 861/1177 [40:08<14:09,  2.69s/it, exist=0.3574, loss=0.5737, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 861/1177 [40:10<14:09,  2.69s/it, exist=0.3574, loss=0.5736, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 862/1177 [40:10<13:05,  2.49s/it, exist=0.3574, loss=0.5736, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 862/1177 [40:13<13:05,  2.49s/it, exist=0.3572, loss=0.5734, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 863/1177 [40:13<13:58,  2.67s/it, exist=0.3572, loss=0.5734, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 863/1177 [40:18<13:58,  2.67s/it, exist=0.3573, loss=0.5734, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 864/1177 [40:18<16:30,  3.16s/it, exist=0.3573, loss=0.5734, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 864/1177 [40:21<16:30,  3.16s/it, exist=0.3570, loss=0.5732, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 865/1177 [40:21<16:54,  3.25s/it, exist=0.3570, loss=0.5732, lr=4.13e-05]
Epoch 2/5:  73%|███████▎  | 865/1177 [40:24<16:54,  3.25s/it, exist=0.3570, loss=0.5733, lr=4.13e-05]
Epoch 2/5:  74%|███████▎  | 866/1177 [40:24<15:52,  3.06s/it, exist=0.3570, loss=0.5733, lr=4.13e-05]
Epoch 2/5:  74%|███████▎  | 866/1177 [40:26<15:52,  3.06s/it, exist=0.3569, loss=0.5731, lr=4.12e-05]
Epoch 2/5:  74%|███████▎  | 867/1177 [40:26<15:05,  2.92s/it, exist=0.3569, loss=0.5731, lr=4.12e-05]
Epoch 2/5:  74%|███████▎  | 867/1177 [40:28<15:05,  2.92s/it, exist=0.3567, loss=0.5730, lr=4.12e-05]
Epoch 2/5:  74%|███████▎  | 868/1177 [40:28<13:44,  2.67s/it, exist=0.3567, loss=0.5730, lr=4.12e-05]
Epoch 2/5:  74%|███████▎  | 868/1177 [40:31<13:44,  2.67s/it, exist=0.3567, loss=0.5728, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 869/1177 [40:31<13:37,  2.65s/it, exist=0.3567, loss=0.5728, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 869/1177 [40:34<13:37,  2.65s/it, exist=0.3566, loss=0.5728, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 870/1177 [40:34<13:34,  2.65s/it, exist=0.3566, loss=0.5728, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 870/1177 [40:37<13:34,  2.65s/it, exist=0.3568, loss=0.5729, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 871/1177 [40:37<14:14,  2.79s/it, exist=0.3568, loss=0.5729, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 871/1177 [40:39<14:14,  2.79s/it, exist=0.3567, loss=0.5728, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 872/1177 [40:39<12:59,  2.55s/it, exist=0.3567, loss=0.5728, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 872/1177 [40:41<12:59,  2.55s/it, exist=0.3566, loss=0.5727, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 873/1177 [40:41<12:09,  2.40s/it, exist=0.3566, loss=0.5727, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 873/1177 [40:44<12:09,  2.40s/it, exist=0.3565, loss=0.5726, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 874/1177 [40:44<12:56,  2.56s/it, exist=0.3565, loss=0.5726, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 874/1177 [40:46<12:56,  2.56s/it, exist=0.3569, loss=0.5730, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 875/1177 [40:46<12:59,  2.58s/it, exist=0.3569, loss=0.5730, lr=4.12e-05]
Epoch 2/5:  74%|███████▍  | 875/1177 [40:49<12:59,  2.58s/it, exist=0.3568, loss=0.5731, lr=4.11e-05]
Epoch 2/5:  74%|███████▍  | 876/1177 [40:49<13:11,  2.63s/it, exist=0.3568, loss=0.5731, lr=4.11e-05]
Epoch 2/5:  74%|███████▍  | 876/1177 [40:53<13:11,  2.63s/it, exist=0.3565, loss=0.5729, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 877/1177 [40:53<14:54,  2.98s/it, exist=0.3565, loss=0.5729, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 877/1177 [40:57<14:54,  2.98s/it, exist=0.3566, loss=0.5730, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 878/1177 [40:57<16:33,  3.32s/it, exist=0.3566, loss=0.5730, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 878/1177 [41:00<16:33,  3.32s/it, exist=0.3564, loss=0.5727, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 879/1177 [41:00<15:55,  3.21s/it, exist=0.3564, loss=0.5727, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 879/1177 [41:04<15:55,  3.21s/it, exist=0.3562, loss=0.5727, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 880/1177 [41:04<16:46,  3.39s/it, exist=0.3562, loss=0.5727, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 880/1177 [41:07<16:46,  3.39s/it, exist=0.3564, loss=0.5728, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 881/1177 [41:07<16:12,  3.29s/it, exist=0.3564, loss=0.5728, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 881/1177 [41:10<16:12,  3.29s/it, exist=0.3562, loss=0.5726, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 882/1177 [41:10<15:12,  3.09s/it, exist=0.3562, loss=0.5726, lr=4.11e-05]
Epoch 2/5:  75%|███████▍  | 882/1177 [41:11<15:12,  3.09s/it, exist=0.3562, loss=0.5728, lr=4.11e-05]
Epoch 2/5:  75%|███████▌  | 883/1177 [41:11<13:30,  2.76s/it, exist=0.3562, loss=0.5728, lr=4.11e-05]
Epoch 2/5:  75%|███████▌  | 883/1177 [41:14<13:30,  2.76s/it, exist=0.3561, loss=0.5727, lr=4.11e-05]
Epoch 2/5:  75%|███████▌  | 884/1177 [41:14<13:05,  2.68s/it, exist=0.3561, loss=0.5727, lr=4.11e-05]
Epoch 2/5:  75%|███████▌  | 884/1177 [41:16<13:05,  2.68s/it, exist=0.3560, loss=0.5728, lr=4.10e-05]
Epoch 2/5:  75%|███████▌  | 885/1177 [41:16<12:09,  2.50s/it, exist=0.3560, loss=0.5728, lr=4.10e-05]
Epoch 2/5:  75%|███████▌  | 885/1177 [41:19<12:09,  2.50s/it, exist=0.3559, loss=0.5727, lr=4.10e-05]
Epoch 2/5:  75%|███████▌  | 886/1177 [41:19<13:24,  2.77s/it, exist=0.3559, loss=0.5727, lr=4.10e-05]
Epoch 2/5:  75%|███████▌  | 886/1177 [41:22<13:24,  2.77s/it, exist=0.3557, loss=0.5724, lr=4.10e-05]
Epoch 2/5:  75%|███████▌  | 887/1177 [41:22<13:28,  2.79s/it, exist=0.3557, loss=0.5724, lr=4.10e-05]
Epoch 2/5:  75%|███████▌  | 887/1177 [41:24<13:28,  2.79s/it, exist=0.3559, loss=0.5725, lr=4.10e-05]
Epoch 2/5:  75%|███████▌  | 888/1177 [41:24<12:18,  2.56s/it, exist=0.3559, loss=0.5725, lr=4.10e-05]
Epoch 2/5:  75%|███████▌  | 888/1177 [41:26<12:18,  2.56s/it, exist=0.3556, loss=0.5723, lr=4.10e-05]
Epoch 2/5:  76%|███████▌  | 889/1177 [41:26<11:32,  2.41s/it, exist=0.3556, loss=0.5723, lr=4.10e-05]
Epoch 2/5:  76%|███████▌  | 889/1177 [41:29<11:32,  2.41s/it, exist=0.3556, loss=0.5723, lr=4.10e-05]
Epoch 2/5:  76%|███████▌  | 890/1177 [41:29<11:59,  2.51s/it, exist=0.3556, loss=0.5723, lr=4.10e-05]
Epoch 2/5:  76%|███████▌  | 890/1177 [41:32<11:59,  2.51s/it, exist=0.3555, loss=0.5722, lr=4.10e-05]
Epoch 2/5:  76%|███████▌  | 891/1177 [41:32<12:55,  2.71s/it, exist=0.3555, loss=0.5722, lr=4.10e-05]
Epoch 2/5:  76%|███████▌  | 891/1177 [41:35<12:55,  2.71s/it, exist=0.3554, loss=0.5722, lr=4.10e-05]
Epoch 2/5:  76%|███████▌  | 892/1177 [41:35<12:40,  2.67s/it, exist=0.3554, loss=0.5722, lr=4.10e-05]
Epoch 2/5:  76%|███████▌  | 892/1177 [41:37<12:40,  2.67s/it, exist=0.3553, loss=0.5721, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 893/1177 [41:37<12:24,  2.62s/it, exist=0.3553, loss=0.5721, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 893/1177 [41:40<12:24,  2.62s/it, exist=0.3551, loss=0.5720, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 894/1177 [41:40<12:08,  2.57s/it, exist=0.3551, loss=0.5720, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 894/1177 [41:42<12:08,  2.57s/it, exist=0.3549, loss=0.5718, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 895/1177 [41:42<12:07,  2.58s/it, exist=0.3549, loss=0.5718, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 895/1177 [41:45<12:07,  2.58s/it, exist=0.3547, loss=0.5716, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 896/1177 [41:45<12:03,  2.57s/it, exist=0.3547, loss=0.5716, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 896/1177 [41:48<12:03,  2.57s/it, exist=0.3548, loss=0.5716, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 897/1177 [41:48<12:00,  2.57s/it, exist=0.3548, loss=0.5716, lr=4.09e-05]
Epoch 2/5:  76%|███████▌  | 897/1177 [41:50<12:00,  2.57s/it, exist=0.3546, loss=0.5715, lr=4.09e-05]
Epoch 2/5:  76%|███████▋  | 898/1177 [41:50<11:52,  2.55s/it, exist=0.3546, loss=0.5715, lr=4.09e-05]
Epoch 2/5:  76%|███████▋  | 898/1177 [41:53<11:52,  2.55s/it, exist=0.3546, loss=0.5716, lr=4.09e-05]
Epoch 2/5:  76%|███████▋  | 899/1177 [41:53<11:48,  2.55s/it, exist=0.3546, loss=0.5716, lr=4.09e-05]
Epoch 2/5:  76%|███████▋  | 899/1177 [41:55<11:48,  2.55s/it, exist=0.3556, loss=0.5726, lr=4.09e-05]
Epoch 2/5:  76%|███████▋  | 900/1177 [41:55<11:38,  2.52s/it, exist=0.3556, loss=0.5726, lr=4.09e-05]
Epoch 2/5:  76%|███████▋  | 900/1177 [41:57<11:38,  2.52s/it, exist=0.3557, loss=0.5726, lr=4.09e-05]
Epoch 2/5:  77%|███████▋  | 901/1177 [41:57<10:55,  2.38s/it, exist=0.3557, loss=0.5726, lr=4.09e-05]
Epoch 2/5:  77%|███████▋  | 901/1177 [42:00<10:55,  2.38s/it, exist=0.3557, loss=0.5727, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 902/1177 [42:00<11:55,  2.60s/it, exist=0.3557, loss=0.5727, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 902/1177 [42:03<11:55,  2.60s/it, exist=0.3558, loss=0.5728, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 903/1177 [42:03<11:42,  2.56s/it, exist=0.3558, loss=0.5728, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 903/1177 [42:05<11:42,  2.56s/it, exist=0.3555, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 904/1177 [42:05<10:59,  2.42s/it, exist=0.3555, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 904/1177 [42:08<10:59,  2.42s/it, exist=0.3556, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 905/1177 [42:08<11:59,  2.65s/it, exist=0.3556, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 905/1177 [42:11<11:59,  2.65s/it, exist=0.3555, loss=0.5724, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 906/1177 [42:11<12:04,  2.67s/it, exist=0.3555, loss=0.5724, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 906/1177 [42:14<12:04,  2.67s/it, exist=0.3555, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 907/1177 [42:14<12:20,  2.74s/it, exist=0.3555, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 907/1177 [42:16<12:20,  2.74s/it, exist=0.3554, loss=0.5724, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 908/1177 [42:16<11:20,  2.53s/it, exist=0.3554, loss=0.5724, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 908/1177 [42:18<11:20,  2.53s/it, exist=0.3556, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 909/1177 [42:18<11:15,  2.52s/it, exist=0.3556, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 909/1177 [42:20<11:15,  2.52s/it, exist=0.3556, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 910/1177 [42:20<10:30,  2.36s/it, exist=0.3556, loss=0.5726, lr=4.08e-05]
Epoch 2/5:  77%|███████▋  | 910/1177 [42:23<10:30,  2.36s/it, exist=0.3556, loss=0.5726, lr=4.07e-05]
Epoch 2/5:  77%|███████▋  | 911/1177 [42:23<11:38,  2.63s/it, exist=0.3556, loss=0.5726, lr=4.07e-05]
Epoch 2/5:  77%|███████▋  | 911/1177 [42:26<11:38,  2.63s/it, exist=0.3560, loss=0.5729, lr=4.07e-05]
Epoch 2/5:  77%|███████▋  | 912/1177 [42:26<11:36,  2.63s/it, exist=0.3560, loss=0.5729, lr=4.07e-05]
Epoch 2/5:  77%|███████▋  | 912/1177 [42:28<11:36,  2.63s/it, exist=0.3558, loss=0.5727, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 913/1177 [42:28<10:45,  2.45s/it, exist=0.3558, loss=0.5727, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 913/1177 [42:32<10:45,  2.45s/it, exist=0.3555, loss=0.5726, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 914/1177 [42:32<12:20,  2.82s/it, exist=0.3555, loss=0.5726, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 914/1177 [42:34<12:20,  2.82s/it, exist=0.3552, loss=0.5723, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 915/1177 [42:34<11:14,  2.58s/it, exist=0.3552, loss=0.5723, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 915/1177 [42:37<11:14,  2.58s/it, exist=0.3550, loss=0.5721, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 916/1177 [42:37<11:57,  2.75s/it, exist=0.3550, loss=0.5721, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 916/1177 [42:39<11:57,  2.75s/it, exist=0.3549, loss=0.5719, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 917/1177 [42:39<10:59,  2.53s/it, exist=0.3549, loss=0.5719, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 917/1177 [42:41<10:59,  2.53s/it, exist=0.3546, loss=0.5719, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 918/1177 [42:41<10:18,  2.39s/it, exist=0.3546, loss=0.5719, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 918/1177 [42:44<10:18,  2.39s/it, exist=0.3546, loss=0.5719, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 919/1177 [42:44<11:25,  2.66s/it, exist=0.3546, loss=0.5719, lr=4.07e-05]
Epoch 2/5:  78%|███████▊  | 919/1177 [42:47<11:25,  2.66s/it, exist=0.3544, loss=0.5716, lr=4.06e-05]
Epoch 2/5:  78%|███████▊  | 920/1177 [42:47<12:07,  2.83s/it, exist=0.3544, loss=0.5716, lr=4.06e-05]
Epoch 2/5:  78%|███████▊  | 920/1177 [42:51<12:07,  2.83s/it, exist=0.3542, loss=0.5714, lr=4.06e-05]
Epoch 2/5:  78%|███████▊  | 921/1177 [42:51<13:13,  3.10s/it, exist=0.3542, loss=0.5714, lr=4.06e-05]
Epoch 2/5:  78%|███████▊  | 921/1177 [42:55<13:13,  3.10s/it, exist=0.3542, loss=0.5715, lr=4.06e-05]
Epoch 2/5:  78%|███████▊  | 922/1177 [42:55<14:11,  3.34s/it, exist=0.3542, loss=0.5715, lr=4.06e-05]
Epoch 2/5:  78%|███████▊  | 922/1177 [42:58<14:11,  3.34s/it, exist=0.3539, loss=0.5712, lr=4.06e-05]
Epoch 2/5:  78%|███████▊  | 923/1177 [42:58<13:11,  3.12s/it, exist=0.3539, loss=0.5712, lr=4.06e-05]
Epoch 2/5:  78%|███████▊  | 923/1177 [43:00<13:11,  3.12s/it, exist=0.3543, loss=0.5717, lr=4.06e-05]
Epoch 2/5:  79%|███████▊  | 924/1177 [43:00<12:33,  2.98s/it, exist=0.3543, loss=0.5717, lr=4.06e-05]
Epoch 2/5:  79%|███████▊  | 924/1177 [43:02<12:33,  2.98s/it, exist=0.3543, loss=0.5717, lr=4.06e-05]
Epoch 2/5:  79%|███████▊  | 925/1177 [43:02<11:18,  2.69s/it, exist=0.3543, loss=0.5717, lr=4.06e-05]
Epoch 2/5:  79%|███████▊  | 925/1177 [43:05<11:18,  2.69s/it, exist=0.3543, loss=0.5719, lr=4.06e-05]
Epoch 2/5:  79%|███████▊  | 926/1177 [43:05<11:10,  2.67s/it, exist=0.3543, loss=0.5719, lr=4.06e-05]
Epoch 2/5:  79%|███████▊  | 926/1177 [43:08<11:10,  2.67s/it, exist=0.3541, loss=0.5716, lr=4.06e-05]
Epoch 2/5:  79%|███████▉  | 927/1177 [43:08<11:00,  2.64s/it, exist=0.3541, loss=0.5716, lr=4.06e-05]
Epoch 2/5:  79%|███████▉  | 927/1177 [43:10<11:00,  2.64s/it, exist=0.3538, loss=0.5714, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 928/1177 [43:10<10:55,  2.63s/it, exist=0.3538, loss=0.5714, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 928/1177 [43:13<10:55,  2.63s/it, exist=0.3540, loss=0.5715, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 929/1177 [43:13<10:51,  2.63s/it, exist=0.3540, loss=0.5715, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 929/1177 [43:15<10:51,  2.63s/it, exist=0.3538, loss=0.5713, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 930/1177 [43:15<10:05,  2.45s/it, exist=0.3538, loss=0.5713, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 930/1177 [43:18<10:05,  2.45s/it, exist=0.3536, loss=0.5711, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 931/1177 [43:18<11:08,  2.72s/it, exist=0.3536, loss=0.5711, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 931/1177 [43:21<11:08,  2.72s/it, exist=0.3539, loss=0.5714, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 932/1177 [43:21<10:54,  2.67s/it, exist=0.3539, loss=0.5714, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 932/1177 [43:23<10:54,  2.67s/it, exist=0.3537, loss=0.5716, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 933/1177 [43:23<10:06,  2.48s/it, exist=0.3537, loss=0.5716, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 933/1177 [43:25<10:06,  2.48s/it, exist=0.3534, loss=0.5712, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 934/1177 [43:25<09:32,  2.36s/it, exist=0.3534, loss=0.5712, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 934/1177 [43:29<09:32,  2.36s/it, exist=0.3533, loss=0.5711, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 935/1177 [43:29<11:32,  2.86s/it, exist=0.3533, loss=0.5711, lr=4.05e-05]
Epoch 2/5:  79%|███████▉  | 935/1177 [43:32<11:32,  2.86s/it, exist=0.3532, loss=0.5710, lr=4.05e-05]
Epoch 2/5:  80%|███████▉  | 936/1177 [43:32<11:20,  2.82s/it, exist=0.3532, loss=0.5710, lr=4.05e-05]
Epoch 2/5:  80%|███████▉  | 936/1177 [43:34<11:20,  2.82s/it, exist=0.3530, loss=0.5709, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 937/1177 [43:34<10:58,  2.75s/it, exist=0.3530, loss=0.5709, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 937/1177 [43:37<10:58,  2.75s/it, exist=0.3528, loss=0.5707, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 938/1177 [43:37<10:58,  2.76s/it, exist=0.3528, loss=0.5707, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 938/1177 [43:39<10:58,  2.76s/it, exist=0.3527, loss=0.5708, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 939/1177 [43:39<10:08,  2.56s/it, exist=0.3527, loss=0.5708, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 939/1177 [43:41<10:08,  2.56s/it, exist=0.3529, loss=0.5711, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 940/1177 [43:41<09:27,  2.40s/it, exist=0.3529, loss=0.5711, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 940/1177 [43:45<09:27,  2.40s/it, exist=0.3529, loss=0.5710, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 941/1177 [43:45<11:18,  2.88s/it, exist=0.3529, loss=0.5710, lr=4.04e-05]
Epoch 2/5:  80%|███████▉  | 941/1177 [43:48<11:18,  2.88s/it, exist=0.3526, loss=0.5708, lr=4.04e-05]
Epoch 2/5:  80%|████████  | 942/1177 [43:48<11:03,  2.83s/it, exist=0.3526, loss=0.5708, lr=4.04e-05]
Epoch 2/5:  80%|████████  | 942/1177 [43:51<11:03,  2.83s/it, exist=0.3526, loss=0.5707, lr=4.04e-05]
Epoch 2/5:  80%|████████  | 943/1177 [43:51<11:17,  2.89s/it, exist=0.3526, loss=0.5707, lr=4.04e-05]
Epoch 2/5:  80%|████████  | 943/1177 [43:53<11:17,  2.89s/it, exist=0.3524, loss=0.5705, lr=4.04e-05]
Epoch 2/5:  80%|████████  | 944/1177 [43:53<10:17,  2.65s/it, exist=0.3524, loss=0.5705, lr=4.04e-05]
Epoch 2/5:  80%|████████  | 944/1177 [43:56<10:17,  2.65s/it, exist=0.3524, loss=0.5705, lr=4.03e-05]
Epoch 2/5:  80%|████████  | 945/1177 [43:56<10:12,  2.64s/it, exist=0.3524, loss=0.5705, lr=4.03e-05]
Epoch 2/5:  80%|████████  | 945/1177 [43:58<10:12,  2.64s/it, exist=0.3524, loss=0.5705, lr=4.03e-05]
Epoch 2/5:  80%|████████  | 946/1177 [43:58<09:27,  2.46s/it, exist=0.3524, loss=0.5705, lr=4.03e-05]
Epoch 2/5:  80%|████████  | 946/1177 [44:00<09:27,  2.46s/it, exist=0.3523, loss=0.5703, lr=4.03e-05]
Epoch 2/5:  80%|████████  | 947/1177 [44:00<09:42,  2.53s/it, exist=0.3523, loss=0.5703, lr=4.03e-05]
Epoch 2/5:  80%|████████  | 947/1177 [44:03<09:42,  2.53s/it, exist=0.3525, loss=0.5706, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 948/1177 [44:03<10:23,  2.72s/it, exist=0.3525, loss=0.5706, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 948/1177 [44:05<10:23,  2.72s/it, exist=0.3522, loss=0.5702, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 949/1177 [44:05<09:31,  2.51s/it, exist=0.3522, loss=0.5702, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 949/1177 [44:09<09:31,  2.51s/it, exist=0.3520, loss=0.5700, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 950/1177 [44:09<10:27,  2.76s/it, exist=0.3520, loss=0.5700, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 950/1177 [44:11<10:27,  2.76s/it, exist=0.3521, loss=0.5702, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 951/1177 [44:11<10:09,  2.70s/it, exist=0.3521, loss=0.5702, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 951/1177 [44:14<10:09,  2.70s/it, exist=0.3518, loss=0.5699, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 952/1177 [44:14<10:23,  2.77s/it, exist=0.3518, loss=0.5699, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 952/1177 [44:16<10:23,  2.77s/it, exist=0.3516, loss=0.5697, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 953/1177 [44:16<09:31,  2.55s/it, exist=0.3516, loss=0.5697, lr=4.03e-05]
Epoch 2/5:  81%|████████  | 953/1177 [44:18<09:31,  2.55s/it, exist=0.3516, loss=0.5696, lr=4.02e-05]
Epoch 2/5:  81%|████████  | 954/1177 [44:18<08:53,  2.39s/it, exist=0.3516, loss=0.5696, lr=4.02e-05]
Epoch 2/5:  81%|████████  | 954/1177 [44:21<08:53,  2.39s/it, exist=0.3515, loss=0.5694, lr=4.02e-05]
Epoch 2/5:  81%|████████  | 955/1177 [44:21<09:12,  2.49s/it, exist=0.3515, loss=0.5694, lr=4.02e-05]
Epoch 2/5:  81%|████████  | 955/1177 [44:24<09:12,  2.49s/it, exist=0.3513, loss=0.5694, lr=4.02e-05]
Epoch 2/5:  81%|████████  | 956/1177 [44:24<09:16,  2.52s/it, exist=0.3513, loss=0.5694, lr=4.02e-05]
Epoch 2/5:  81%|████████  | 956/1177 [44:27<09:16,  2.52s/it, exist=0.3512, loss=0.5693, lr=4.02e-05]
Epoch 2/5:  81%|████████▏ | 957/1177 [44:27<10:36,  2.90s/it, exist=0.3512, loss=0.5693, lr=4.02e-05]
Epoch 2/5:  81%|████████▏ | 957/1177 [44:29<10:36,  2.90s/it, exist=0.3512, loss=0.5695, lr=4.02e-05]
Epoch 2/5:  81%|████████▏ | 958/1177 [44:29<09:35,  2.63s/it, exist=0.3512, loss=0.5695, lr=4.02e-05]
Epoch 2/5:  81%|████████▏ | 958/1177 [44:32<09:35,  2.63s/it, exist=0.3517, loss=0.5701, lr=4.02e-05]
Epoch 2/5:  81%|████████▏ | 959/1177 [44:32<09:30,  2.62s/it, exist=0.3517, loss=0.5701, lr=4.02e-05]
Epoch 2/5:  81%|████████▏ | 959/1177 [44:34<09:30,  2.62s/it, exist=0.3516, loss=0.5702, lr=4.02e-05]
Epoch 2/5:  82%|████████▏ | 960/1177 [44:34<08:50,  2.45s/it, exist=0.3516, loss=0.5702, lr=4.02e-05]
Epoch 2/5:  82%|████████▏ | 960/1177 [44:37<08:50,  2.45s/it, exist=0.3513, loss=0.5699, lr=4.02e-05]
Epoch 2/5:  82%|████████▏ | 961/1177 [44:37<09:44,  2.71s/it, exist=0.3513, loss=0.5699, lr=4.02e-05]
Epoch 2/5:  82%|████████▏ | 961/1177 [44:40<09:44,  2.71s/it, exist=0.3513, loss=0.5699, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 962/1177 [44:40<09:49,  2.74s/it, exist=0.3513, loss=0.5699, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 962/1177 [44:42<09:49,  2.74s/it, exist=0.3516, loss=0.5702, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 963/1177 [44:42<08:59,  2.52s/it, exist=0.3516, loss=0.5702, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 963/1177 [44:44<08:59,  2.52s/it, exist=0.3515, loss=0.5701, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 964/1177 [44:44<08:23,  2.37s/it, exist=0.3515, loss=0.5701, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 964/1177 [44:47<08:23,  2.37s/it, exist=0.3514, loss=0.5701, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 965/1177 [44:47<08:31,  2.41s/it, exist=0.3514, loss=0.5701, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 965/1177 [44:50<08:31,  2.41s/it, exist=0.3513, loss=0.5698, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 966/1177 [44:50<08:57,  2.55s/it, exist=0.3513, loss=0.5698, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 966/1177 [44:53<08:57,  2.55s/it, exist=0.3512, loss=0.5697, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 967/1177 [44:53<09:48,  2.80s/it, exist=0.3512, loss=0.5697, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 967/1177 [44:55<09:48,  2.80s/it, exist=0.3511, loss=0.5697, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 968/1177 [44:55<08:53,  2.55s/it, exist=0.3511, loss=0.5697, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 968/1177 [44:58<08:53,  2.55s/it, exist=0.3509, loss=0.5694, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 969/1177 [44:58<09:24,  2.71s/it, exist=0.3509, loss=0.5694, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 969/1177 [45:01<09:24,  2.71s/it, exist=0.3508, loss=0.5694, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 970/1177 [45:01<09:18,  2.70s/it, exist=0.3508, loss=0.5694, lr=4.01e-05]
Epoch 2/5:  82%|████████▏ | 970/1177 [45:03<09:18,  2.70s/it, exist=0.3508, loss=0.5695, lr=4.00e-05]
Epoch 2/5:  82%|████████▏ | 971/1177 [45:03<09:11,  2.68s/it, exist=0.3508, loss=0.5695, lr=4.00e-05]
Epoch 2/5:  82%|████████▏ | 971/1177 [45:06<09:11,  2.68s/it, exist=0.3506, loss=0.5693, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 972/1177 [45:06<09:00,  2.64s/it, exist=0.3506, loss=0.5693, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 972/1177 [45:09<09:00,  2.64s/it, exist=0.3507, loss=0.5694, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 973/1177 [45:09<08:59,  2.64s/it, exist=0.3507, loss=0.5694, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 973/1177 [45:11<08:59,  2.64s/it, exist=0.3505, loss=0.5693, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 974/1177 [45:11<08:50,  2.61s/it, exist=0.3505, loss=0.5693, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 974/1177 [45:13<08:50,  2.61s/it, exist=0.3505, loss=0.5692, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 975/1177 [45:13<08:34,  2.55s/it, exist=0.3505, loss=0.5692, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 975/1177 [45:16<08:34,  2.55s/it, exist=0.3505, loss=0.5693, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 976/1177 [45:16<08:38,  2.58s/it, exist=0.3505, loss=0.5693, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 976/1177 [45:19<08:38,  2.58s/it, exist=0.3505, loss=0.5694, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 977/1177 [45:19<08:36,  2.58s/it, exist=0.3505, loss=0.5694, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 977/1177 [45:21<08:36,  2.58s/it, exist=0.3505, loss=0.5692, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 978/1177 [45:21<08:43,  2.63s/it, exist=0.3505, loss=0.5692, lr=4.00e-05]
Epoch 2/5:  83%|████████▎ | 978/1177 [45:24<08:43,  2.63s/it, exist=0.3507, loss=0.5695, lr=3.99e-05]
Epoch 2/5:  83%|████████▎ | 979/1177 [45:24<08:41,  2.63s/it, exist=0.3507, loss=0.5695, lr=3.99e-05]
Epoch 2/5:  83%|████████▎ | 979/1177 [45:27<08:41,  2.63s/it, exist=0.3507, loss=0.5696, lr=3.99e-05]
Epoch 2/5:  83%|████████▎ | 980/1177 [45:27<08:24,  2.56s/it, exist=0.3507, loss=0.5696, lr=3.99e-05]
Epoch 2/5:  83%|████████▎ | 980/1177 [45:28<08:24,  2.56s/it, exist=0.3507, loss=0.5695, lr=3.99e-05]
Epoch 2/5:  83%|████████▎ | 981/1177 [45:28<07:48,  2.39s/it, exist=0.3507, loss=0.5695, lr=3.99e-05]
Epoch 2/5:  83%|████████▎ | 981/1177 [45:32<07:48,  2.39s/it, exist=0.3508, loss=0.5696, lr=3.99e-05]
Epoch 2/5:  83%|████████▎ | 982/1177 [45:32<08:40,  2.67s/it, exist=0.3508, loss=0.5696, lr=3.99e-05]
Epoch 2/5:  83%|████████▎ | 982/1177 [45:34<08:40,  2.67s/it, exist=0.3508, loss=0.5696, lr=3.99e-05]
Epoch 2/5:  84%|████████▎ | 983/1177 [45:34<08:37,  2.67s/it, exist=0.3508, loss=0.5696, lr=3.99e-05]
Epoch 2/5:  84%|████████▎ | 983/1177 [45:37<08:37,  2.67s/it, exist=0.3508, loss=0.5697, lr=3.99e-05]
Epoch 2/5:  84%|████████▎ | 984/1177 [45:37<08:32,  2.66s/it, exist=0.3508, loss=0.5697, lr=3.99e-05]
Epoch 2/5:  84%|████████▎ | 984/1177 [45:40<08:32,  2.66s/it, exist=0.3509, loss=0.5699, lr=3.99e-05]
Epoch 2/5:  84%|████████▎ | 985/1177 [45:40<08:16,  2.59s/it, exist=0.3509, loss=0.5699, lr=3.99e-05]
Epoch 2/5:  84%|████████▎ | 985/1177 [45:42<08:16,  2.59s/it, exist=0.3513, loss=0.5703, lr=3.99e-05]
Epoch 2/5:  84%|████████▍ | 986/1177 [45:42<07:41,  2.42s/it, exist=0.3513, loss=0.5703, lr=3.99e-05]
Epoch 2/5:  84%|████████▍ | 986/1177 [45:45<07:41,  2.42s/it, exist=0.3514, loss=0.5703, lr=3.99e-05]
Epoch 2/5:  84%|████████▍ | 987/1177 [45:45<08:31,  2.69s/it, exist=0.3514, loss=0.5703, lr=3.99e-05]
Epoch 2/5:  84%|████████▍ | 987/1177 [45:48<08:31,  2.69s/it, exist=0.3512, loss=0.5703, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 988/1177 [45:48<08:25,  2.68s/it, exist=0.3512, loss=0.5703, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 988/1177 [45:50<08:25,  2.68s/it, exist=0.3513, loss=0.5704, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 989/1177 [45:50<08:11,  2.62s/it, exist=0.3513, loss=0.5704, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 989/1177 [45:53<08:11,  2.62s/it, exist=0.3514, loss=0.5705, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 990/1177 [45:53<08:13,  2.64s/it, exist=0.3514, loss=0.5705, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 990/1177 [45:55<08:13,  2.64s/it, exist=0.3513, loss=0.5704, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 991/1177 [45:55<08:16,  2.67s/it, exist=0.3513, loss=0.5704, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 991/1177 [45:58<08:16,  2.67s/it, exist=0.3511, loss=0.5701, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 992/1177 [45:58<08:04,  2.62s/it, exist=0.3511, loss=0.5701, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 992/1177 [46:00<08:04,  2.62s/it, exist=0.3511, loss=0.5701, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 993/1177 [46:00<07:27,  2.43s/it, exist=0.3511, loss=0.5701, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 993/1177 [46:03<07:27,  2.43s/it, exist=0.3509, loss=0.5700, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 994/1177 [46:03<08:15,  2.71s/it, exist=0.3509, loss=0.5700, lr=3.98e-05]
Epoch 2/5:  84%|████████▍ | 994/1177 [46:06<08:15,  2.71s/it, exist=0.3514, loss=0.5706, lr=3.98e-05]
Epoch 2/5:  85%|████████▍ | 995/1177 [46:06<08:09,  2.69s/it, exist=0.3514, loss=0.5706, lr=3.98e-05]
Epoch 2/5:  85%|████████▍ | 995/1177 [46:09<08:09,  2.69s/it, exist=0.3513, loss=0.5704, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 996/1177 [46:09<08:03,  2.67s/it, exist=0.3513, loss=0.5704, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 996/1177 [46:11<08:03,  2.67s/it, exist=0.3511, loss=0.5702, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 997/1177 [46:11<07:56,  2.65s/it, exist=0.3511, loss=0.5702, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 997/1177 [46:14<07:56,  2.65s/it, exist=0.3513, loss=0.5704, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 998/1177 [46:14<07:45,  2.60s/it, exist=0.3513, loss=0.5704, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 998/1177 [46:16<07:45,  2.60s/it, exist=0.3511, loss=0.5704, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 999/1177 [46:16<07:45,  2.61s/it, exist=0.3511, loss=0.5704, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 999/1177 [46:19<07:45,  2.61s/it, exist=0.3511, loss=0.5706, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 1000/1177 [46:19<07:54,  2.68s/it, exist=0.3511, loss=0.5706, lr=3.97e-05]
Epoch 2/5:  85%|████████▍ | 1000/1177 [46:22<07:54,  2.68s/it, exist=0.3513, loss=0.5708, lr=3.97e-05]
Epoch 2/5:  85%|████████▌ | 1001/1177 [46:22<07:44,  2.64s/it, exist=0.3513, loss=0.5708, lr=3.97e-05]
Epoch 2/5:  85%|████████▌ | 1001/1177 [46:24<07:44,  2.64s/it, exist=0.3511, loss=0.5706, lr=3.97e-05]
Epoch 2/5:  85%|████████▌ | 1002/1177 [46:24<07:43,  2.65s/it, exist=0.3511, loss=0.5706, lr=3.97e-05]
Epoch 2/5:  85%|████████▌ | 1002/1177 [46:27<07:43,  2.65s/it, exist=0.3509, loss=0.5704, lr=3.97e-05]
Epoch 2/5:  85%|████████▌ | 1003/1177 [46:27<07:35,  2.62s/it, exist=0.3509, loss=0.5704, lr=3.97e-05]
Epoch 2/5:  85%|████████▌ | 1003/1177 [46:29<07:35,  2.62s/it, exist=0.3510, loss=0.5705, lr=3.96e-05]
Epoch 2/5:  85%|████████▌ | 1004/1177 [46:29<07:26,  2.58s/it, exist=0.3510, loss=0.5705, lr=3.96e-05]
Epoch 2/5:  85%|████████▌ | 1004/1177 [46:32<07:26,  2.58s/it, exist=0.3508, loss=0.5703, lr=3.96e-05]
Epoch 2/5:  85%|████████▌ | 1005/1177 [46:32<07:30,  2.62s/it, exist=0.3508, loss=0.5703, lr=3.96e-05]
Epoch 2/5:  85%|████████▌ | 1005/1177 [46:35<07:30,  2.62s/it, exist=0.3507, loss=0.5702, lr=3.96e-05]
Epoch 2/5:  85%|████████▌ | 1006/1177 [46:35<07:31,  2.64s/it, exist=0.3507, loss=0.5702, lr=3.96e-05]
Epoch 2/5:  85%|████████▌ | 1006/1177 [46:37<07:31,  2.64s/it, exist=0.3504, loss=0.5699, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1007/1177 [46:37<07:21,  2.60s/it, exist=0.3504, loss=0.5699, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1007/1177 [46:40<07:21,  2.60s/it, exist=0.3506, loss=0.5700, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1008/1177 [46:40<07:21,  2.61s/it, exist=0.3506, loss=0.5700, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1008/1177 [46:43<07:21,  2.61s/it, exist=0.3508, loss=0.5702, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1009/1177 [46:43<07:20,  2.62s/it, exist=0.3508, loss=0.5702, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1009/1177 [46:45<07:20,  2.62s/it, exist=0.3507, loss=0.5701, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1010/1177 [46:45<07:23,  2.66s/it, exist=0.3507, loss=0.5701, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1010/1177 [46:48<07:23,  2.66s/it, exist=0.3504, loss=0.5698, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1011/1177 [46:48<07:19,  2.65s/it, exist=0.3504, loss=0.5698, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1011/1177 [46:51<07:19,  2.65s/it, exist=0.3505, loss=0.5699, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1012/1177 [46:51<07:17,  2.65s/it, exist=0.3505, loss=0.5699, lr=3.96e-05]
Epoch 2/5:  86%|████████▌ | 1012/1177 [46:53<07:17,  2.65s/it, exist=0.3504, loss=0.5698, lr=3.95e-05]
Epoch 2/5:  86%|████████▌ | 1013/1177 [46:53<06:43,  2.46s/it, exist=0.3504, loss=0.5698, lr=3.95e-05]
Epoch 2/5:  86%|████████▌ | 1013/1177 [46:55<06:43,  2.46s/it, exist=0.3503, loss=0.5697, lr=3.95e-05]
Epoch 2/5:  86%|████████▌ | 1014/1177 [46:55<06:48,  2.51s/it, exist=0.3503, loss=0.5697, lr=3.95e-05]
Epoch 2/5:  86%|████████▌ | 1014/1177 [46:58<06:48,  2.51s/it, exist=0.3501, loss=0.5697, lr=3.95e-05]
Epoch 2/5:  86%|████████▌ | 1015/1177 [46:58<07:18,  2.71s/it, exist=0.3501, loss=0.5697, lr=3.95e-05]
Epoch 2/5:  86%|████████▌ | 1015/1177 [47:01<07:18,  2.71s/it, exist=0.3499, loss=0.5696, lr=3.95e-05]
Epoch 2/5:  86%|████████▋ | 1016/1177 [47:01<07:12,  2.68s/it, exist=0.3499, loss=0.5696, lr=3.95e-05]
Epoch 2/5:  86%|████████▋ | 1016/1177 [47:04<07:12,  2.68s/it, exist=0.3496, loss=0.5692, lr=3.95e-05]
Epoch 2/5:  86%|████████▋ | 1017/1177 [47:04<07:00,  2.63s/it, exist=0.3496, loss=0.5692, lr=3.95e-05]
Epoch 2/5:  86%|████████▋ | 1017/1177 [47:06<07:00,  2.63s/it, exist=0.3496, loss=0.5692, lr=3.95e-05]
Epoch 2/5:  86%|████████▋ | 1018/1177 [47:06<07:02,  2.65s/it, exist=0.3496, loss=0.5692, lr=3.95e-05]
Epoch 2/5:  86%|████████▋ | 1018/1177 [47:09<07:02,  2.65s/it, exist=0.3493, loss=0.5689, lr=3.95e-05]
Epoch 2/5:  87%|████████▋ | 1019/1177 [47:09<07:18,  2.77s/it, exist=0.3493, loss=0.5689, lr=3.95e-05]
Epoch 2/5:  87%|████████▋ | 1019/1177 [47:11<07:18,  2.77s/it, exist=0.3491, loss=0.5687, lr=3.95e-05]
Epoch 2/5:  87%|████████▋ | 1020/1177 [47:11<06:40,  2.55s/it, exist=0.3491, loss=0.5687, lr=3.95e-05]
Epoch 2/5:  87%|████████▋ | 1020/1177 [47:14<06:40,  2.55s/it, exist=0.3489, loss=0.5685, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1021/1177 [47:14<06:31,  2.51s/it, exist=0.3489, loss=0.5685, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1021/1177 [47:16<06:31,  2.51s/it, exist=0.3488, loss=0.5684, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1022/1177 [47:16<06:07,  2.37s/it, exist=0.3488, loss=0.5684, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1022/1177 [47:19<06:07,  2.37s/it, exist=0.3489, loss=0.5685, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1023/1177 [47:19<06:45,  2.63s/it, exist=0.3489, loss=0.5685, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1023/1177 [47:21<06:45,  2.63s/it, exist=0.3487, loss=0.5684, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1024/1177 [47:21<06:13,  2.44s/it, exist=0.3487, loss=0.5684, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1024/1177 [47:24<06:13,  2.44s/it, exist=0.3485, loss=0.5681, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1025/1177 [47:24<06:43,  2.66s/it, exist=0.3485, loss=0.5681, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1025/1177 [47:27<06:43,  2.66s/it, exist=0.3482, loss=0.5678, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1026/1177 [47:27<06:45,  2.69s/it, exist=0.3482, loss=0.5678, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1026/1177 [47:30<06:45,  2.69s/it, exist=0.3488, loss=0.5683, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1027/1177 [47:30<07:07,  2.85s/it, exist=0.3488, loss=0.5683, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1027/1177 [47:32<07:07,  2.85s/it, exist=0.3489, loss=0.5684, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1028/1177 [47:32<06:24,  2.58s/it, exist=0.3489, loss=0.5684, lr=3.94e-05]
Epoch 2/5:  87%|████████▋ | 1028/1177 [47:35<06:24,  2.58s/it, exist=0.3487, loss=0.5682, lr=3.93e-05]
Epoch 2/5:  87%|████████▋ | 1029/1177 [47:35<06:24,  2.60s/it, exist=0.3487, loss=0.5682, lr=3.93e-05]
Epoch 2/5:  87%|████████▋ | 1029/1177 [47:37<06:24,  2.60s/it, exist=0.3490, loss=0.5686, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1030/1177 [47:37<05:57,  2.43s/it, exist=0.3490, loss=0.5686, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1030/1177 [47:40<05:57,  2.43s/it, exist=0.3489, loss=0.5685, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1031/1177 [47:40<06:26,  2.65s/it, exist=0.3489, loss=0.5685, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1031/1177 [47:42<06:26,  2.65s/it, exist=0.3488, loss=0.5684, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1032/1177 [47:42<05:58,  2.47s/it, exist=0.3488, loss=0.5684, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1032/1177 [47:45<05:58,  2.47s/it, exist=0.3487, loss=0.5684, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1033/1177 [47:45<06:30,  2.71s/it, exist=0.3487, loss=0.5684, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1033/1177 [47:47<06:30,  2.71s/it, exist=0.3489, loss=0.5686, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1034/1177 [47:47<05:55,  2.49s/it, exist=0.3489, loss=0.5686, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1034/1177 [47:51<05:55,  2.49s/it, exist=0.3487, loss=0.5684, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1035/1177 [47:51<06:28,  2.74s/it, exist=0.3487, loss=0.5684, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1035/1177 [47:53<06:28,  2.74s/it, exist=0.3486, loss=0.5685, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1036/1177 [47:53<06:21,  2.71s/it, exist=0.3486, loss=0.5685, lr=3.93e-05]
Epoch 2/5:  88%|████████▊ | 1036/1177 [47:56<06:21,  2.71s/it, exist=0.3484, loss=0.5683, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1037/1177 [47:56<06:10,  2.64s/it, exist=0.3484, loss=0.5683, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1037/1177 [47:58<06:10,  2.64s/it, exist=0.3483, loss=0.5681, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1038/1177 [47:58<06:01,  2.60s/it, exist=0.3483, loss=0.5681, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1038/1177 [48:00<06:01,  2.60s/it, exist=0.3483, loss=0.5682, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1039/1177 [48:00<05:37,  2.44s/it, exist=0.3483, loss=0.5682, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1039/1177 [48:04<05:37,  2.44s/it, exist=0.3488, loss=0.5686, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1040/1177 [48:04<06:09,  2.69s/it, exist=0.3488, loss=0.5686, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1040/1177 [48:06<06:09,  2.69s/it, exist=0.3487, loss=0.5686, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1041/1177 [48:06<06:01,  2.66s/it, exist=0.3487, loss=0.5686, lr=3.92e-05]
Epoch 2/5:  88%|████████▊ | 1041/1177 [48:08<06:01,  2.66s/it, exist=0.3485, loss=0.5683, lr=3.92e-05]
Epoch 2/5:  89%|████████▊ | 1042/1177 [48:08<05:34,  2.47s/it, exist=0.3485, loss=0.5683, lr=3.92e-05]
Epoch 2/5:  89%|████████▊ | 1042/1177 [48:11<05:34,  2.47s/it, exist=0.3484, loss=0.5681, lr=3.92e-05]
Epoch 2/5:  89%|████████▊ | 1043/1177 [48:11<05:41,  2.55s/it, exist=0.3484, loss=0.5681, lr=3.92e-05]
Epoch 2/5:  89%|████████▊ | 1043/1177 [48:14<05:41,  2.55s/it, exist=0.3482, loss=0.5680, lr=3.92e-05]
Epoch 2/5:  89%|████████▊ | 1044/1177 [48:14<05:44,  2.59s/it, exist=0.3482, loss=0.5680, lr=3.92e-05]
Epoch 2/5:  89%|████████▊ | 1044/1177 [48:17<05:44,  2.59s/it, exist=0.3480, loss=0.5679, lr=3.92e-05]
Epoch 2/5:  89%|████████▉ | 1045/1177 [48:17<06:28,  2.95s/it, exist=0.3480, loss=0.5679, lr=3.92e-05]
Epoch 2/5:  89%|████████▉ | 1045/1177 [48:20<06:28,  2.95s/it, exist=0.3484, loss=0.5682, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1046/1177 [48:20<06:09,  2.82s/it, exist=0.3484, loss=0.5682, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1046/1177 [48:22<06:09,  2.82s/it, exist=0.3483, loss=0.5681, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1047/1177 [48:22<05:36,  2.59s/it, exist=0.3483, loss=0.5681, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1047/1177 [48:25<05:36,  2.59s/it, exist=0.3487, loss=0.5684, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1048/1177 [48:25<05:35,  2.60s/it, exist=0.3487, loss=0.5684, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1048/1177 [48:27<05:35,  2.60s/it, exist=0.3485, loss=0.5682, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1049/1177 [48:27<05:09,  2.42s/it, exist=0.3485, loss=0.5682, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1049/1177 [48:29<05:09,  2.42s/it, exist=0.3484, loss=0.5681, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1050/1177 [48:29<04:51,  2.30s/it, exist=0.3484, loss=0.5681, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1050/1177 [48:33<04:51,  2.30s/it, exist=0.3484, loss=0.5681, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1051/1177 [48:33<05:55,  2.82s/it, exist=0.3484, loss=0.5681, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1051/1177 [48:35<05:55,  2.82s/it, exist=0.3483, loss=0.5681, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1052/1177 [48:35<05:45,  2.77s/it, exist=0.3483, loss=0.5681, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1052/1177 [48:38<05:45,  2.77s/it, exist=0.3482, loss=0.5687, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1053/1177 [48:38<05:53,  2.85s/it, exist=0.3482, loss=0.5687, lr=3.91e-05]
Epoch 2/5:  89%|████████▉ | 1053/1177 [48:40<05:53,  2.85s/it, exist=0.3480, loss=0.5684, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1054/1177 [48:40<05:22,  2.62s/it, exist=0.3480, loss=0.5684, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1054/1177 [48:43<05:22,  2.62s/it, exist=0.3478, loss=0.5684, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1055/1177 [48:43<05:11,  2.56s/it, exist=0.3478, loss=0.5684, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1055/1177 [48:45<05:11,  2.56s/it, exist=0.3478, loss=0.5683, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1056/1177 [48:45<05:10,  2.57s/it, exist=0.3478, loss=0.5683, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1056/1177 [48:47<05:10,  2.57s/it, exist=0.3476, loss=0.5683, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1057/1177 [48:47<04:46,  2.39s/it, exist=0.3476, loss=0.5683, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1057/1177 [48:51<04:46,  2.39s/it, exist=0.3481, loss=0.5689, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1058/1177 [48:51<05:29,  2.77s/it, exist=0.3481, loss=0.5689, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1058/1177 [48:53<05:29,  2.77s/it, exist=0.3478, loss=0.5686, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1059/1177 [48:53<05:00,  2.55s/it, exist=0.3478, loss=0.5686, lr=3.90e-05]
Epoch 2/5:  90%|████████▉ | 1059/1177 [48:55<05:00,  2.55s/it, exist=0.3482, loss=0.5690, lr=3.90e-05]
Epoch 2/5:  90%|█████████ | 1060/1177 [48:55<04:39,  2.39s/it, exist=0.3482, loss=0.5690, lr=3.90e-05]
Epoch 2/5:  90%|█████████ | 1060/1177 [48:57<04:39,  2.39s/it, exist=0.3481, loss=0.5690, lr=3.90e-05]
Epoch 2/5:  90%|█████████ | 1061/1177 [48:57<04:37,  2.39s/it, exist=0.3481, loss=0.5690, lr=3.90e-05]
Epoch 2/5:  90%|█████████ | 1061/1177 [49:00<04:37,  2.39s/it, exist=0.3479, loss=0.5686, lr=3.89e-05]
Epoch 2/5:  90%|█████████ | 1062/1177 [49:00<04:46,  2.49s/it, exist=0.3479, loss=0.5686, lr=3.89e-05]
Epoch 2/5:  90%|█████████ | 1062/1177 [49:03<04:46,  2.49s/it, exist=0.3478, loss=0.5686, lr=3.89e-05]
Epoch 2/5:  90%|█████████ | 1063/1177 [49:03<05:06,  2.69s/it, exist=0.3478, loss=0.5686, lr=3.89e-05]
Epoch 2/5:  90%|█████████ | 1063/1177 [49:06<05:06,  2.69s/it, exist=0.3478, loss=0.5685, lr=3.89e-05]
Epoch 2/5:  90%|█████████ | 1064/1177 [49:06<04:55,  2.62s/it, exist=0.3478, loss=0.5685, lr=3.89e-05]
Epoch 2/5:  90%|█████████ | 1064/1177 [49:08<04:55,  2.62s/it, exist=0.3476, loss=0.5683, lr=3.89e-05]
Epoch 2/5:  90%|█████████ | 1065/1177 [49:08<04:54,  2.63s/it, exist=0.3476, loss=0.5683, lr=3.89e-05]
Epoch 2/5:  90%|█████████ | 1065/1177 [49:11<04:54,  2.63s/it, exist=0.3473, loss=0.5681, lr=3.89e-05]
Epoch 2/5:  91%|█████████ | 1066/1177 [49:11<04:32,  2.46s/it, exist=0.3473, loss=0.5681, lr=3.89e-05]
Epoch 2/5:  91%|█████████ | 1066/1177 [49:14<04:32,  2.46s/it, exist=0.3472, loss=0.5679, lr=3.89e-05]
Epoch 2/5:  91%|█████████ | 1067/1177 [49:14<04:59,  2.73s/it, exist=0.3472, loss=0.5679, lr=3.89e-05]
Epoch 2/5:  91%|█████████ | 1067/1177 [49:16<04:59,  2.73s/it, exist=0.3473, loss=0.5681, lr=3.89e-05]
Epoch 2/5:  91%|█████████ | 1068/1177 [49:16<04:50,  2.66s/it, exist=0.3473, loss=0.5681, lr=3.89e-05]
Epoch 2/5:  91%|█████████ | 1068/1177 [49:19<04:50,  2.66s/it, exist=0.3472, loss=0.5681, lr=3.89e-05]
Epoch 2/5:  91%|█████████ | 1069/1177 [49:19<05:02,  2.80s/it, exist=0.3472, loss=0.5681, lr=3.89e-05]
Epoch 2/5:  91%|█████████ | 1069/1177 [49:21<05:02,  2.80s/it, exist=0.3472, loss=0.5681, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1070/1177 [49:21<04:33,  2.56s/it, exist=0.3472, loss=0.5681, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1070/1177 [49:24<04:33,  2.56s/it, exist=0.3474, loss=0.5682, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1071/1177 [49:24<04:14,  2.40s/it, exist=0.3474, loss=0.5682, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1071/1177 [49:27<04:14,  2.40s/it, exist=0.3474, loss=0.5683, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1072/1177 [49:27<04:40,  2.67s/it, exist=0.3474, loss=0.5683, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1072/1177 [49:29<04:40,  2.67s/it, exist=0.3475, loss=0.5683, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1073/1177 [49:29<04:35,  2.65s/it, exist=0.3475, loss=0.5683, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1073/1177 [49:32<04:35,  2.65s/it, exist=0.3475, loss=0.5685, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1074/1177 [49:32<04:32,  2.64s/it, exist=0.3475, loss=0.5685, lr=3.88e-05]
Epoch 2/5:  91%|█████████ | 1074/1177 [49:34<04:32,  2.64s/it, exist=0.3475, loss=0.5684, lr=3.88e-05]
Epoch 2/5:  91%|█████████▏| 1075/1177 [49:34<04:09,  2.45s/it, exist=0.3475, loss=0.5684, lr=3.88e-05]
Epoch 2/5:  91%|█████████▏| 1075/1177 [49:37<04:09,  2.45s/it, exist=0.3474, loss=0.5683, lr=3.88e-05]
Epoch 2/5:  91%|█████████▏| 1076/1177 [49:37<04:15,  2.53s/it, exist=0.3474, loss=0.5683, lr=3.88e-05]
Epoch 2/5:  91%|█████████▏| 1076/1177 [49:40<04:15,  2.53s/it, exist=0.3477, loss=0.5687, lr=3.88e-05]
Epoch 2/5:  92%|█████████▏| 1077/1177 [49:40<04:34,  2.75s/it, exist=0.3477, loss=0.5687, lr=3.88e-05]
Epoch 2/5:  92%|█████████▏| 1077/1177 [49:43<04:34,  2.75s/it, exist=0.3477, loss=0.5688, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1078/1177 [49:43<04:31,  2.74s/it, exist=0.3477, loss=0.5688, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1078/1177 [49:45<04:31,  2.74s/it, exist=0.3475, loss=0.5686, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1079/1177 [49:45<04:07,  2.52s/it, exist=0.3475, loss=0.5686, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1079/1177 [49:48<04:07,  2.52s/it, exist=0.3474, loss=0.5686, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1080/1177 [49:48<04:27,  2.76s/it, exist=0.3474, loss=0.5686, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1080/1177 [49:51<04:27,  2.76s/it, exist=0.3472, loss=0.5684, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1081/1177 [49:51<04:23,  2.74s/it, exist=0.3472, loss=0.5684, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1081/1177 [49:53<04:23,  2.74s/it, exist=0.3472, loss=0.5683, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1082/1177 [49:53<04:18,  2.73s/it, exist=0.3472, loss=0.5683, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1082/1177 [49:57<04:18,  2.73s/it, exist=0.3471, loss=0.5682, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1083/1177 [49:57<04:32,  2.90s/it, exist=0.3471, loss=0.5682, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1083/1177 [49:59<04:32,  2.90s/it, exist=0.3469, loss=0.5681, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1084/1177 [49:59<04:06,  2.65s/it, exist=0.3469, loss=0.5681, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1084/1177 [50:01<04:06,  2.65s/it, exist=0.3468, loss=0.5683, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1085/1177 [50:01<04:01,  2.63s/it, exist=0.3468, loss=0.5683, lr=3.87e-05]
Epoch 2/5:  92%|█████████▏| 1085/1177 [50:04<04:01,  2.63s/it, exist=0.3466, loss=0.5682, lr=3.86e-05]
Epoch 2/5:  92%|█████████▏| 1086/1177 [50:04<04:01,  2.65s/it, exist=0.3466, loss=0.5682, lr=3.86e-05]
Epoch 2/5:  92%|█████████▏| 1086/1177 [50:06<04:01,  2.65s/it, exist=0.3464, loss=0.5680, lr=3.86e-05]
Epoch 2/5:  92%|█████████▏| 1087/1177 [50:06<03:41,  2.46s/it, exist=0.3464, loss=0.5680, lr=3.86e-05]
Epoch 2/5:  92%|█████████▏| 1087/1177 [50:09<03:41,  2.46s/it, exist=0.3463, loss=0.5679, lr=3.86e-05]
Epoch 2/5:  92%|█████████▏| 1088/1177 [50:09<03:45,  2.53s/it, exist=0.3463, loss=0.5679, lr=3.86e-05]
Epoch 2/5:  92%|█████████▏| 1088/1177 [50:11<03:45,  2.53s/it, exist=0.3464, loss=0.5680, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1089/1177 [50:11<03:43,  2.54s/it, exist=0.3464, loss=0.5680, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1089/1177 [50:15<03:43,  2.54s/it, exist=0.3463, loss=0.5680, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1090/1177 [50:15<04:16,  2.95s/it, exist=0.3463, loss=0.5680, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1090/1177 [50:17<04:16,  2.95s/it, exist=0.3464, loss=0.5682, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1091/1177 [50:17<03:50,  2.68s/it, exist=0.3464, loss=0.5682, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1091/1177 [50:19<03:50,  2.68s/it, exist=0.3465, loss=0.5682, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1092/1177 [50:19<03:29,  2.47s/it, exist=0.3465, loss=0.5682, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1092/1177 [50:23<03:29,  2.47s/it, exist=0.3465, loss=0.5681, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1093/1177 [50:23<03:49,  2.73s/it, exist=0.3465, loss=0.5681, lr=3.86e-05]
Epoch 2/5:  93%|█████████▎| 1093/1177 [50:25<03:49,  2.73s/it, exist=0.3462, loss=0.5678, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1094/1177 [50:25<03:44,  2.71s/it, exist=0.3462, loss=0.5678, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1094/1177 [50:28<03:44,  2.71s/it, exist=0.3466, loss=0.5682, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1095/1177 [50:28<03:39,  2.67s/it, exist=0.3466, loss=0.5682, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1095/1177 [50:30<03:39,  2.67s/it, exist=0.3466, loss=0.5682, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1096/1177 [50:30<03:33,  2.64s/it, exist=0.3466, loss=0.5682, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1096/1177 [50:33<03:33,  2.64s/it, exist=0.3465, loss=0.5680, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1097/1177 [50:33<03:31,  2.64s/it, exist=0.3465, loss=0.5680, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1097/1177 [50:35<03:31,  2.64s/it, exist=0.3463, loss=0.5679, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1098/1177 [50:35<03:14,  2.47s/it, exist=0.3463, loss=0.5679, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1098/1177 [50:38<03:14,  2.47s/it, exist=0.3461, loss=0.5676, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1099/1177 [50:38<03:14,  2.49s/it, exist=0.3461, loss=0.5676, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1099/1177 [50:41<03:14,  2.49s/it, exist=0.3459, loss=0.5675, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1100/1177 [50:41<03:26,  2.68s/it, exist=0.3459, loss=0.5675, lr=3.85e-05]
Epoch 2/5:  93%|█████████▎| 1100/1177 [50:43<03:26,  2.68s/it, exist=0.3463, loss=0.5678, lr=3.85e-05]
Epoch 2/5:  94%|█████████▎| 1101/1177 [50:43<03:18,  2.61s/it, exist=0.3463, loss=0.5678, lr=3.85e-05]
Epoch 2/5:  94%|█████████▎| 1101/1177 [50:45<03:18,  2.61s/it, exist=0.3462, loss=0.5677, lr=3.84e-05]
Epoch 2/5:  94%|█████████▎| 1102/1177 [50:45<03:02,  2.43s/it, exist=0.3462, loss=0.5677, lr=3.84e-05]
Epoch 2/5:  94%|█████████▎| 1102/1177 [50:49<03:02,  2.43s/it, exist=0.3462, loss=0.5677, lr=3.84e-05]
Epoch 2/5:  94%|█████████▎| 1103/1177 [50:49<03:19,  2.70s/it, exist=0.3462, loss=0.5677, lr=3.84e-05]
Epoch 2/5:  94%|█████████▎| 1103/1177 [50:51<03:19,  2.70s/it, exist=0.3463, loss=0.5678, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1104/1177 [50:51<03:16,  2.70s/it, exist=0.3463, loss=0.5678, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1104/1177 [50:54<03:16,  2.70s/it, exist=0.3463, loss=0.5678, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1105/1177 [50:54<03:24,  2.84s/it, exist=0.3463, loss=0.5678, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1105/1177 [50:57<03:24,  2.84s/it, exist=0.3462, loss=0.5677, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1106/1177 [50:57<03:05,  2.61s/it, exist=0.3462, loss=0.5677, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1106/1177 [51:00<03:05,  2.61s/it, exist=0.3464, loss=0.5679, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1107/1177 [51:00<03:19,  2.85s/it, exist=0.3464, loss=0.5679, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1107/1177 [51:02<03:19,  2.85s/it, exist=0.3466, loss=0.5682, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1108/1177 [51:02<02:59,  2.60s/it, exist=0.3466, loss=0.5682, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1108/1177 [51:05<02:59,  2.60s/it, exist=0.3467, loss=0.5682, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1109/1177 [51:05<03:09,  2.79s/it, exist=0.3467, loss=0.5682, lr=3.84e-05]
Epoch 2/5:  94%|█████████▍| 1109/1177 [51:08<03:09,  2.79s/it, exist=0.3466, loss=0.5683, lr=3.83e-05]
Epoch 2/5:  94%|█████████▍| 1110/1177 [51:08<03:04,  2.75s/it, exist=0.3466, loss=0.5683, lr=3.83e-05]
Epoch 2/5:  94%|█████████▍| 1110/1177 [51:11<03:04,  2.75s/it, exist=0.3464, loss=0.5682, lr=3.83e-05]
Epoch 2/5:  94%|█████████▍| 1111/1177 [51:11<03:01,  2.75s/it, exist=0.3464, loss=0.5682, lr=3.83e-05]
Epoch 2/5:  94%|█████████▍| 1111/1177 [51:14<03:01,  2.75s/it, exist=0.3462, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  94%|█████████▍| 1112/1177 [51:14<03:02,  2.80s/it, exist=0.3462, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  94%|█████████▍| 1112/1177 [51:16<03:02,  2.80s/it, exist=0.3463, loss=0.5681, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1113/1177 [51:16<02:44,  2.57s/it, exist=0.3463, loss=0.5681, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1113/1177 [51:18<02:44,  2.57s/it, exist=0.3463, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1114/1177 [51:18<02:31,  2.40s/it, exist=0.3463, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1114/1177 [51:21<02:31,  2.40s/it, exist=0.3463, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1115/1177 [51:21<02:44,  2.66s/it, exist=0.3463, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1115/1177 [51:23<02:44,  2.66s/it, exist=0.3463, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1116/1177 [51:23<02:29,  2.45s/it, exist=0.3463, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1116/1177 [51:26<02:29,  2.45s/it, exist=0.3462, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1117/1177 [51:26<02:41,  2.70s/it, exist=0.3462, loss=0.5680, lr=3.83e-05]
Epoch 2/5:  95%|█████████▍| 1117/1177 [51:28<02:41,  2.70s/it, exist=0.3461, loss=0.5679, lr=3.82e-05]
Epoch 2/5:  95%|█████████▍| 1118/1177 [51:28<02:26,  2.49s/it, exist=0.3461, loss=0.5679, lr=3.82e-05]
Epoch 2/5:  95%|█████████▍| 1118/1177 [51:31<02:26,  2.49s/it, exist=0.3460, loss=0.5678, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1119/1177 [51:31<02:40,  2.76s/it, exist=0.3460, loss=0.5678, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1119/1177 [51:35<02:40,  2.76s/it, exist=0.3458, loss=0.5676, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1120/1177 [51:35<02:44,  2.89s/it, exist=0.3458, loss=0.5676, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1120/1177 [51:38<02:44,  2.89s/it, exist=0.3456, loss=0.5675, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1121/1177 [51:38<02:55,  3.13s/it, exist=0.3456, loss=0.5675, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1121/1177 [51:41<02:55,  3.13s/it, exist=0.3455, loss=0.5674, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1122/1177 [51:41<02:46,  3.03s/it, exist=0.3455, loss=0.5674, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1122/1177 [51:44<02:46,  3.03s/it, exist=0.3455, loss=0.5673, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1123/1177 [51:44<02:46,  3.08s/it, exist=0.3455, loss=0.5673, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1123/1177 [51:46<02:46,  3.08s/it, exist=0.3454, loss=0.5673, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1124/1177 [51:46<02:26,  2.75s/it, exist=0.3454, loss=0.5673, lr=3.82e-05]
Epoch 2/5:  95%|█████████▌| 1124/1177 [51:49<02:26,  2.75s/it, exist=0.3452, loss=0.5671, lr=3.82e-05]
Epoch 2/5:  96%|█████████▌| 1125/1177 [51:49<02:21,  2.72s/it, exist=0.3452, loss=0.5671, lr=3.82e-05]
Epoch 2/5:  96%|█████████▌| 1125/1177 [51:52<02:21,  2.72s/it, exist=0.3451, loss=0.5669, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1126/1177 [51:52<02:19,  2.73s/it, exist=0.3451, loss=0.5669, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1126/1177 [51:54<02:19,  2.73s/it, exist=0.3451, loss=0.5670, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1127/1177 [51:54<02:05,  2.51s/it, exist=0.3451, loss=0.5670, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1127/1177 [51:57<02:05,  2.51s/it, exist=0.3450, loss=0.5668, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1128/1177 [51:57<02:12,  2.71s/it, exist=0.3450, loss=0.5668, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1128/1177 [51:59<02:12,  2.71s/it, exist=0.3448, loss=0.5668, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1129/1177 [51:59<02:08,  2.67s/it, exist=0.3448, loss=0.5668, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1129/1177 [52:02<02:08,  2.67s/it, exist=0.3447, loss=0.5667, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1130/1177 [52:02<02:00,  2.56s/it, exist=0.3447, loss=0.5667, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1130/1177 [52:05<02:00,  2.56s/it, exist=0.3447, loss=0.5666, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1131/1177 [52:05<02:12,  2.89s/it, exist=0.3447, loss=0.5666, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1131/1177 [52:07<02:12,  2.89s/it, exist=0.3446, loss=0.5666, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1132/1177 [52:07<01:58,  2.63s/it, exist=0.3446, loss=0.5666, lr=3.81e-05]
Epoch 2/5:  96%|█████████▌| 1132/1177 [52:10<01:58,  2.63s/it, exist=0.3445, loss=0.5666, lr=3.81e-05]
Epoch 2/5:  96%|█████████▋| 1133/1177 [52:10<01:54,  2.61s/it, exist=0.3445, loss=0.5666, lr=3.81e-05]
Epoch 2/5:  96%|█████████▋| 1133/1177 [52:13<01:54,  2.61s/it, exist=0.3443, loss=0.5665, lr=3.80e-05]
Epoch 2/5:  96%|█████████▋| 1134/1177 [52:13<01:53,  2.63s/it, exist=0.3443, loss=0.5665, lr=3.80e-05]
Epoch 2/5:  96%|█████████▋| 1134/1177 [52:15<01:53,  2.63s/it, exist=0.3447, loss=0.5667, lr=3.80e-05]
Epoch 2/5:  96%|█████████▋| 1135/1177 [52:15<01:50,  2.62s/it, exist=0.3447, loss=0.5667, lr=3.80e-05]
Epoch 2/5:  96%|█████████▋| 1135/1177 [52:18<01:50,  2.62s/it, exist=0.3445, loss=0.5665, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1136/1177 [52:18<01:47,  2.63s/it, exist=0.3445, loss=0.5665, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1136/1177 [52:21<01:47,  2.63s/it, exist=0.3444, loss=0.5664, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1137/1177 [52:21<01:44,  2.61s/it, exist=0.3444, loss=0.5664, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1137/1177 [52:23<01:44,  2.61s/it, exist=0.3444, loss=0.5664, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1138/1177 [52:23<01:43,  2.65s/it, exist=0.3444, loss=0.5664, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1138/1177 [52:26<01:43,  2.65s/it, exist=0.3444, loss=0.5665, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1139/1177 [52:26<01:41,  2.66s/it, exist=0.3444, loss=0.5665, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1139/1177 [52:29<01:41,  2.66s/it, exist=0.3444, loss=0.5664, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1140/1177 [52:29<01:38,  2.65s/it, exist=0.3444, loss=0.5664, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1140/1177 [52:31<01:38,  2.65s/it, exist=0.3442, loss=0.5664, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1141/1177 [52:31<01:35,  2.64s/it, exist=0.3442, loss=0.5664, lr=3.80e-05]
Epoch 2/5:  97%|█████████▋| 1141/1177 [52:33<01:35,  2.64s/it, exist=0.3444, loss=0.5665, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1142/1177 [52:33<01:25,  2.45s/it, exist=0.3444, loss=0.5665, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1142/1177 [52:36<01:25,  2.45s/it, exist=0.3444, loss=0.5666, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1143/1177 [52:36<01:31,  2.68s/it, exist=0.3444, loss=0.5666, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1143/1177 [52:39<01:31,  2.68s/it, exist=0.3445, loss=0.5668, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1144/1177 [52:39<01:28,  2.67s/it, exist=0.3445, loss=0.5668, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1144/1177 [52:42<01:28,  2.67s/it, exist=0.3444, loss=0.5666, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1145/1177 [52:42<01:24,  2.64s/it, exist=0.3444, loss=0.5666, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1145/1177 [52:44<01:24,  2.64s/it, exist=0.3445, loss=0.5669, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1146/1177 [52:44<01:15,  2.44s/it, exist=0.3445, loss=0.5669, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1146/1177 [52:47<01:15,  2.44s/it, exist=0.3446, loss=0.5670, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1147/1177 [52:47<01:21,  2.71s/it, exist=0.3446, loss=0.5670, lr=3.79e-05]
Epoch 2/5:  97%|█████████▋| 1147/1177 [52:50<01:21,  2.71s/it, exist=0.3444, loss=0.5667, lr=3.79e-05]
Epoch 2/5:  98%|█████████▊| 1148/1177 [52:50<01:18,  2.71s/it, exist=0.3444, loss=0.5667, lr=3.79e-05]
Epoch 2/5:  98%|█████████▊| 1148/1177 [52:52<01:18,  2.71s/it, exist=0.3445, loss=0.5669, lr=3.79e-05]
Epoch 2/5:  98%|█████████▊| 1149/1177 [52:52<01:15,  2.68s/it, exist=0.3445, loss=0.5669, lr=3.79e-05]
Epoch 2/5:  98%|█████████▊| 1149/1177 [52:55<01:15,  2.68s/it, exist=0.3445, loss=0.5669, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1150/1177 [52:55<01:11,  2.64s/it, exist=0.3445, loss=0.5669, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1150/1177 [52:57<01:11,  2.64s/it, exist=0.3443, loss=0.5669, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1151/1177 [52:57<01:07,  2.60s/it, exist=0.3443, loss=0.5669, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1151/1177 [53:00<01:07,  2.60s/it, exist=0.3443, loss=0.5670, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1152/1177 [53:00<01:04,  2.58s/it, exist=0.3443, loss=0.5670, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1152/1177 [53:02<01:04,  2.58s/it, exist=0.3445, loss=0.5671, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1153/1177 [53:02<00:57,  2.42s/it, exist=0.3445, loss=0.5671, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1153/1177 [53:05<00:57,  2.42s/it, exist=0.3444, loss=0.5671, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1154/1177 [53:05<01:02,  2.70s/it, exist=0.3444, loss=0.5671, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1154/1177 [53:07<01:02,  2.70s/it, exist=0.3442, loss=0.5669, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1155/1177 [53:07<00:55,  2.52s/it, exist=0.3442, loss=0.5669, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1155/1177 [53:11<00:55,  2.52s/it, exist=0.3441, loss=0.5668, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1156/1177 [53:11<01:01,  2.95s/it, exist=0.3441, loss=0.5668, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1156/1177 [53:13<01:01,  2.95s/it, exist=0.3441, loss=0.5669, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1157/1177 [53:13<00:53,  2.66s/it, exist=0.3441, loss=0.5669, lr=3.78e-05]
Epoch 2/5:  98%|█████████▊| 1157/1177 [53:15<00:53,  2.66s/it, exist=0.3442, loss=0.5669, lr=3.77e-05]
Epoch 2/5:  98%|█████████▊| 1158/1177 [53:15<00:46,  2.46s/it, exist=0.3442, loss=0.5669, lr=3.77e-05]
Epoch 2/5:  98%|█████████▊| 1158/1177 [53:19<00:46,  2.46s/it, exist=0.3440, loss=0.5668, lr=3.77e-05]
Epoch 2/5:  98%|█████████▊| 1159/1177 [53:19<00:49,  2.73s/it, exist=0.3440, loss=0.5668, lr=3.77e-05]
Epoch 2/5:  98%|█████████▊| 1159/1177 [53:21<00:49,  2.73s/it, exist=0.3440, loss=0.5667, lr=3.77e-05]
Epoch 2/5:  99%|█████████▊| 1160/1177 [53:21<00:42,  2.52s/it, exist=0.3440, loss=0.5667, lr=3.77e-05]
Epoch 2/5:  99%|█████████▊| 1160/1177 [53:24<00:42,  2.52s/it, exist=0.3439, loss=0.5667, lr=3.77e-05]
Epoch 2/5:  99%|█████████▊| 1161/1177 [53:24<00:45,  2.83s/it, exist=0.3439, loss=0.5667, lr=3.77e-05]
Epoch 2/5:  99%|█████████▊| 1161/1177 [53:27<00:45,  2.83s/it, exist=0.3439, loss=0.5666, lr=3.77e-05]
Epoch 2/5:  99%|█████████▊| 1162/1177 [53:27<00:40,  2.72s/it, exist=0.3439, loss=0.5666, lr=3.77e-05]
Epoch 2/5:  99%|█████████▊| 1162/1177 [53:29<00:40,  2.72s/it, exist=0.3440, loss=0.5667, lr=3.77e-05]
Epoch 2/5:  99%|█████████▉| 1163/1177 [53:29<00:35,  2.52s/it, exist=0.3440, loss=0.5667, lr=3.77e-05]
Epoch 2/5:  99%|█████████▉| 1163/1177 [53:31<00:35,  2.52s/it, exist=0.3441, loss=0.5667, lr=3.77e-05]
Epoch 2/5:  99%|█████████▉| 1164/1177 [53:31<00:33,  2.55s/it, exist=0.3441, loss=0.5667, lr=3.77e-05]
Epoch 2/5:  99%|█████████▉| 1164/1177 [53:34<00:33,  2.55s/it, exist=0.3441, loss=0.5667, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1165/1177 [53:34<00:30,  2.57s/it, exist=0.3441, loss=0.5667, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1165/1177 [53:37<00:30,  2.57s/it, exist=0.3441, loss=0.5667, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1166/1177 [53:37<00:28,  2.61s/it, exist=0.3441, loss=0.5667, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1166/1177 [53:39<00:28,  2.61s/it, exist=0.3439, loss=0.5667, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1167/1177 [53:39<00:25,  2.58s/it, exist=0.3439, loss=0.5667, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1167/1177 [53:41<00:25,  2.58s/it, exist=0.3437, loss=0.5665, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1168/1177 [53:41<00:21,  2.41s/it, exist=0.3437, loss=0.5665, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1168/1177 [53:45<00:21,  2.41s/it, exist=0.3436, loss=0.5664, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1169/1177 [53:45<00:21,  2.66s/it, exist=0.3436, loss=0.5664, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1169/1177 [53:47<00:21,  2.66s/it, exist=0.3433, loss=0.5662, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1170/1177 [53:47<00:18,  2.66s/it, exist=0.3433, loss=0.5662, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1170/1177 [53:49<00:18,  2.66s/it, exist=0.3433, loss=0.5661, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1171/1177 [53:49<00:14,  2.45s/it, exist=0.3433, loss=0.5661, lr=3.76e-05]
Epoch 2/5:  99%|█████████▉| 1171/1177 [53:52<00:14,  2.45s/it, exist=0.3433, loss=0.5662, lr=3.76e-05]
Epoch 2/5: 100%|█████████▉| 1172/1177 [53:52<00:12,  2.47s/it, exist=0.3433, loss=0.5662, lr=3.76e-05]
Epoch 2/5: 100%|█████████▉| 1172/1177 [53:54<00:12,  2.47s/it, exist=0.3434, loss=0.5663, lr=3.75e-05]
Epoch 2/5: 100%|█████████▉| 1173/1177 [53:54<00:09,  2.33s/it, exist=0.3434, loss=0.5663, lr=3.75e-05]
Epoch 2/5: 100%|█████████▉| 1173/1177 [53:56<00:09,  2.33s/it, exist=0.3432, loss=0.5661, lr=3.75e-05]
Epoch 2/5: 100%|█████████▉| 1174/1177 [53:56<00:06,  2.23s/it, exist=0.3432, loss=0.5661, lr=3.75e-05]
Epoch 2/5: 100%|█████████▉| 1174/1177 [53:58<00:06,  2.23s/it, exist=0.3433, loss=0.5661, lr=3.75e-05]
Epoch 2/5: 100%|█████████▉| 1175/1177 [53:58<00:04,  2.15s/it, exist=0.3433, loss=0.5661, lr=3.75e-05]
Epoch 2/5: 100%|█████████▉| 1175/1177 [54:00<00:04,  2.15s/it, exist=0.3434, loss=0.5663, lr=3.75e-05]
Epoch 2/5: 100%|█████████▉| 1176/1177 [54:00<00:02,  2.09s/it, exist=0.3434, loss=0.5663, lr=3.75e-05]
Epoch 2/5: 100%|█████████▉| 1176/1177 [54:00<00:02,  2.09s/it, exist=0.3431, loss=0.5659, lr=3.75e-05]
Epoch 2/5: 100%|██████████| 1177/1177 [54:00<00:00,  1.53s/it, exist=0.3431, loss=0.5659, lr=3.75e-05]
Epoch 2/5: 100%|██████████| 1177/1177 [54:01<00:00,  2.75s/it, exist=0.3431, loss=0.5659, lr=3.75e-05]
Epoch 2  loss=0.5659  ce=0.0000  mask=0.1347  exist=0.3431  lr=3.75e-05
Saved: checkpoints/ec_simtoken/ec_simtoken_v1_ep2.pth

Eval test_s:   0%|          | 0/572 [00:00<?, ?it/s]
Eval test_s:   0%|          | 1/572 [00:22<3:36:47, 22.78s/it]
Eval test_s:   0%|          | 2/572 [00:26<1:48:05, 11.38s/it]
Eval test_s:   1%|          | 3/572 [00:29<1:13:28,  7.75s/it]
Eval test_s:   1%|          | 4/572 [00:33<57:12,  6.04s/it]  
Eval test_s:   1%|          | 5/572 [00:36<48:22,  5.12s/it]
Eval test_s:   1%|          | 6/572 [00:39<42:49,  4.54s/it]
Eval test_s:   1%|          | 7/572 [00:41<34:44,  3.69s/it]
Eval test_s:   1%|▏         | 8/572 [00:43<29:25,  3.13s/it]
Eval test_s:   2%|▏         | 9/572 [00:45<25:48,  2.75s/it]
Eval test_s:   2%|▏         | 10/572 [00:47<23:23,  2.50s/it]
Eval test_s:   2%|▏         | 11/572 [00:49<21:44,  2.33s/it]
Eval test_s:   2%|▏         | 12/572 [00:51<20:03,  2.15s/it]
Eval test_s:   2%|▏         | 13/572 [00:53<20:19,  2.18s/it]
Eval test_s:   2%|▏         | 14/572 [00:55<19:32,  2.10s/it]
Eval test_s:   3%|▎         | 15/572 [00:57<19:07,  2.06s/it]
Eval test_s:   3%|▎         | 16/572 [00:59<18:11,  1.96s/it]
Eval test_s:   3%|▎         | 17/572 [01:01<18:59,  2.05s/it]
Eval test_s:   3%|▎         | 18/572 [01:03<18:48,  2.04s/it]
Eval test_s:   3%|▎         | 19/572 [01:05<18:41,  2.03s/it]
Eval test_s:   3%|▎         | 20/572 [01:07<18:34,  2.02s/it]
Eval test_s:   4%|▎         | 21/572 [01:09<18:13,  1.98s/it]
Eval test_s:   4%|▍         | 22/572 [01:11<18:09,  1.98s/it]
Eval test_s:   4%|▍         | 23/572 [01:13<18:02,  1.97s/it]
Eval test_s:   4%|▍         | 24/572 [01:15<17:22,  1.90s/it]
Eval test_s:   4%|▍         | 25/572 [01:17<17:40,  1.94s/it]
Eval test_s:   5%|▍         | 26/572 [01:19<18:21,  2.02s/it]
Eval test_s:   5%|▍         | 27/572 [01:21<18:16,  2.01s/it]
Eval test_s:   5%|▍         | 28/572 [01:23<18:12,  2.01s/it]
Eval test_s:   5%|▌         | 29/572 [01:25<18:04,  2.00s/it]
Eval test_s:   5%|▌         | 30/572 [01:27<18:08,  2.01s/it]
Eval test_s:   5%|▌         | 31/572 [01:29<17:49,  1.98s/it]
Eval test_s:   6%|▌         | 32/572 [01:31<17:48,  1.98s/it]
Eval test_s:   6%|▌         | 33/572 [01:33<17:45,  1.98s/it]
Eval test_s:   6%|▌         | 34/572 [01:35<17:45,  1.98s/it]
Eval test_s:   6%|▌         | 35/572 [01:36<17:12,  1.92s/it]
Eval test_s:   6%|▋         | 36/572 [01:39<18:17,  2.05s/it]
Eval test_s:   6%|▋         | 37/572 [01:43<22:59,  2.58s/it]
Eval test_s:   7%|▋         | 38/572 [01:46<24:16,  2.73s/it]
Eval test_s:   7%|▋         | 39/572 [01:47<21:45,  2.45s/it]
Eval test_s:   7%|▋         | 40/572 [01:50<21:37,  2.44s/it]
Eval test_s:   7%|▋         | 41/572 [01:52<20:16,  2.29s/it]
Eval test_s:   7%|▋         | 42/572 [01:54<20:27,  2.32s/it]
Eval test_s:   8%|▊         | 43/572 [01:58<23:49,  2.70s/it]
Eval test_s:   8%|▊         | 44/572 [02:00<21:25,  2.43s/it]
Eval test_s:   8%|▊         | 45/572 [02:02<20:08,  2.29s/it]
Eval test_s:   8%|▊         | 46/572 [02:04<19:15,  2.20s/it]
Eval test_s:   8%|▊         | 47/572 [02:05<18:00,  2.06s/it]
Eval test_s:   8%|▊         | 48/572 [02:07<18:21,  2.10s/it]
Eval test_s:   9%|▊         | 49/572 [02:09<18:04,  2.07s/it]
Eval test_s:   9%|▊         | 50/572 [02:11<17:49,  2.05s/it]
Eval test_s:   9%|▉         | 51/572 [02:13<17:26,  2.01s/it]
Eval test_s:   9%|▉         | 52/572 [02:15<17:20,  2.00s/it]
Eval test_s:   9%|▉         | 53/572 [02:17<17:06,  1.98s/it]
Eval test_s:   9%|▉         | 54/572 [02:19<17:02,  1.97s/it]
Eval test_s:  10%|▉         | 55/572 [02:21<16:51,  1.96s/it]
Eval test_s:  10%|▉         | 56/572 [02:23<16:51,  1.96s/it]
Eval test_s:  10%|▉         | 57/572 [02:25<16:44,  1.95s/it]
Eval test_s:  10%|█         | 58/572 [02:27<16:10,  1.89s/it]
Eval test_s:  10%|█         | 59/572 [02:29<16:25,  1.92s/it]
Eval test_s:  10%|█         | 60/572 [02:31<17:08,  2.01s/it]
Eval test_s:  11%|█         | 61/572 [02:33<16:50,  1.98s/it]
Eval test_s:  11%|█         | 62/572 [02:35<16:53,  1.99s/it]
Eval test_s:  11%|█         | 63/572 [02:37<16:57,  2.00s/it]
Eval test_s:  11%|█         | 64/572 [02:39<16:49,  1.99s/it]
Eval test_s:  11%|█▏        | 65/572 [02:41<16:33,  1.96s/it]
Eval test_s:  12%|█▏        | 66/572 [02:43<16:26,  1.95s/it]
Eval test_s:  12%|█▏        | 67/572 [02:45<16:16,  1.93s/it]
Eval test_s:  12%|█▏        | 68/572 [02:47<16:24,  1.95s/it]
Eval test_s:  12%|█▏        | 69/572 [02:49<16:17,  1.94s/it]
Eval test_s:  12%|█▏        | 70/572 [02:51<16:25,  1.96s/it]
Eval test_s:  12%|█▏        | 71/572 [02:52<16:11,  1.94s/it]
Eval test_s:  13%|█▎        | 72/572 [02:54<16:11,  1.94s/it]
Eval test_s:  13%|█▎        | 73/572 [02:56<15:58,  1.92s/it]
Eval test_s:  13%|█▎        | 74/572 [02:58<15:59,  1.93s/it]
Eval test_s:  13%|█▎        | 75/572 [03:00<16:13,  1.96s/it]
Eval test_s:  13%|█▎        | 76/572 [03:02<16:21,  1.98s/it]
Eval test_s:  13%|█▎        | 77/572 [03:04<16:10,  1.96s/it]
Eval test_s:  14%|█▎        | 78/572 [03:06<16:17,  1.98s/it]
Eval test_s:  14%|█▍        | 79/572 [03:08<16:08,  1.97s/it]
Eval test_s:  14%|█▍        | 80/572 [03:10<16:05,  1.96s/it]
Eval test_s:  14%|█▍        | 81/572 [03:12<16:04,  1.96s/it]
Eval test_s:  14%|█▍        | 82/572 [03:14<16:03,  1.97s/it]
Eval test_s:  15%|█▍        | 83/572 [03:16<15:57,  1.96s/it]
Eval test_s:  15%|█▍        | 84/572 [03:18<15:55,  1.96s/it]
Eval test_s:  15%|█▍        | 85/572 [03:20<15:57,  1.97s/it]
Eval test_s:  15%|█▌        | 86/572 [03:22<15:50,  1.96s/it]
Eval test_s:  15%|█▌        | 87/572 [03:24<15:40,  1.94s/it]
Eval test_s:  15%|█▌        | 88/572 [03:26<15:41,  1.95s/it]
Eval test_s:  16%|█▌        | 89/572 [03:28<15:39,  1.94s/it]
Eval test_s:  16%|█▌        | 90/572 [03:30<15:36,  1.94s/it]
Eval test_s:  16%|█▌        | 91/572 [03:32<15:31,  1.94s/it]
Eval test_s:  16%|█▌        | 92/572 [03:33<15:30,  1.94s/it]
Eval test_s:  16%|█▋        | 93/572 [03:35<15:22,  1.93s/it]
Eval test_s:  16%|█▋        | 94/572 [03:37<15:25,  1.94s/it]
Eval test_s:  17%|█▋        | 95/572 [03:39<15:19,  1.93s/it]
Eval test_s:  17%|█▋        | 96/572 [03:41<15:23,  1.94s/it]
Eval test_s:  17%|█▋        | 97/572 [03:43<15:11,  1.92s/it]
Eval test_s:  17%|█▋        | 98/572 [03:45<15:15,  1.93s/it]
Eval test_s:  17%|█▋        | 99/572 [03:47<15:17,  1.94s/it]
Eval test_s:  17%|█▋        | 100/572 [03:49<14:48,  1.88s/it]
Eval test_s:  18%|█▊        | 101/572 [03:51<15:25,  1.96s/it]
Eval test_s:  18%|█▊        | 102/572 [03:53<15:25,  1.97s/it]
Eval test_s:  18%|█▊        | 103/572 [03:55<15:12,  1.95s/it]
Eval test_s:  18%|█▊        | 104/572 [03:57<15:15,  1.96s/it]
Eval test_s:  18%|█▊        | 105/572 [03:59<15:07,  1.94s/it]
Eval test_s:  19%|█▊        | 106/572 [04:01<15:35,  2.01s/it]
Eval test_s:  19%|█▊        | 107/572 [04:03<15:48,  2.04s/it]
Eval test_s:  19%|█▉        | 108/572 [04:05<15:34,  2.01s/it]
Eval test_s:  19%|█▉        | 109/572 [04:07<16:28,  2.13s/it]
Eval test_s:  19%|█▉        | 110/572 [04:09<16:03,  2.08s/it]
Eval test_s:  19%|█▉        | 111/572 [04:11<15:32,  2.02s/it]
Eval test_s:  20%|█▉        | 112/572 [04:13<15:23,  2.01s/it]
Eval test_s:  20%|█▉        | 113/572 [04:15<14:41,  1.92s/it]
Eval test_s:  20%|█▉        | 114/572 [04:17<14:48,  1.94s/it]
Eval test_s:  20%|██        | 115/572 [04:19<15:16,  2.01s/it]
Eval test_s:  20%|██        | 116/572 [04:21<15:04,  1.98s/it]
Eval test_s:  20%|██        | 117/572 [04:23<14:51,  1.96s/it]
Eval test_s:  21%|██        | 118/572 [04:25<14:46,  1.95s/it]
Eval test_s:  21%|██        | 119/572 [04:27<14:39,  1.94s/it]
Eval test_s:  21%|██        | 120/572 [04:29<14:38,  1.94s/it]
Eval test_s:  21%|██        | 121/572 [04:30<14:28,  1.93s/it]
Eval test_s:  21%|██▏       | 122/572 [04:32<14:36,  1.95s/it]
Eval test_s:  22%|██▏       | 123/572 [04:34<14:21,  1.92s/it]
Eval test_s:  22%|██▏       | 124/572 [04:36<14:25,  1.93s/it]
Eval test_s:  22%|██▏       | 125/572 [04:39<15:00,  2.02s/it]
Eval test_s:  22%|██▏       | 126/572 [04:41<15:27,  2.08s/it]
Eval test_s:  22%|██▏       | 127/572 [04:43<15:04,  2.03s/it]
Eval test_s:  22%|██▏       | 128/572 [04:45<14:50,  2.01s/it]
Eval test_s:  23%|██▎       | 129/572 [04:47<14:38,  1.98s/it]
Eval test_s:  23%|██▎       | 130/572 [04:49<14:56,  2.03s/it]
Eval test_s:  23%|██▎       | 131/572 [04:50<14:15,  1.94s/it]
Eval test_s:  23%|██▎       | 132/572 [04:52<14:25,  1.97s/it]
Eval test_s:  23%|██▎       | 133/572 [04:54<14:22,  1.97s/it]
Eval test_s:  23%|██▎       | 134/572 [04:56<14:24,  1.97s/it]
Eval test_s:  24%|██▎       | 135/572 [04:59<16:11,  2.22s/it]
Eval test_s:  24%|██▍       | 136/572 [05:01<16:01,  2.21s/it]
Eval test_s:  24%|██▍       | 137/572 [05:05<18:31,  2.55s/it]
Eval test_s:  24%|██▍       | 138/572 [05:07<17:11,  2.38s/it]
Eval test_s:  24%|██▍       | 139/572 [05:09<16:08,  2.24s/it]
Eval test_s:  24%|██▍       | 140/572 [05:11<15:23,  2.14s/it]
Eval test_s:  25%|██▍       | 141/572 [05:12<14:53,  2.07s/it]
Eval test_s:  25%|██▍       | 142/572 [05:14<14:09,  1.98s/it]
Eval test_s:  25%|██▌       | 143/572 [05:16<13:55,  1.95s/it]
Eval test_s:  25%|██▌       | 144/572 [05:18<14:17,  2.00s/it]
Eval test_s:  25%|██▌       | 145/572 [05:20<13:57,  1.96s/it]
Eval test_s:  26%|██▌       | 146/572 [05:22<13:54,  1.96s/it]
Eval test_s:  26%|██▌       | 147/572 [05:24<13:44,  1.94s/it]
Eval test_s:  26%|██▌       | 148/572 [05:26<13:48,  1.95s/it]
Eval test_s:  26%|██▌       | 149/572 [05:28<13:39,  1.94s/it]
Eval test_s:  26%|██▌       | 150/572 [05:30<13:54,  1.98s/it]
Eval test_s:  26%|██▋       | 151/572 [05:32<13:44,  1.96s/it]
Eval test_s:  27%|██▋       | 152/572 [05:34<13:14,  1.89s/it]
Eval test_s:  27%|██▋       | 153/572 [05:36<14:04,  2.02s/it]
Eval test_s:  27%|██▋       | 154/572 [05:38<14:00,  2.01s/it]
Eval test_s:  27%|██▋       | 155/572 [05:40<13:47,  1.99s/it]
Eval test_s:  27%|██▋       | 156/572 [05:42<13:52,  2.00s/it]
Eval test_s:  27%|██▋       | 157/572 [05:44<13:39,  1.98s/it]
Eval test_s:  28%|██▊       | 158/572 [05:46<13:23,  1.94s/it]
Eval test_s:  28%|██▊       | 159/572 [05:47<12:57,  1.88s/it]
Eval test_s:  28%|██▊       | 160/572 [05:49<13:30,  1.97s/it]
Eval test_s:  28%|██▊       | 161/572 [05:52<14:37,  2.14s/it]
Eval test_s:  28%|██▊       | 162/572 [05:54<14:06,  2.06s/it]
Eval test_s:  28%|██▊       | 163/572 [05:56<13:22,  1.96s/it]
Eval test_s:  29%|██▊       | 164/572 [06:00<18:16,  2.69s/it]
Eval test_s:  29%|██▉       | 165/572 [06:02<16:56,  2.50s/it]
Eval test_s:  29%|██▉       | 166/572 [06:05<18:47,  2.78s/it]
Eval test_s:  29%|██▉       | 167/572 [06:08<17:42,  2.62s/it]
Eval test_s:  29%|██▉       | 168/572 [06:10<16:18,  2.42s/it]
Eval test_s:  30%|██▉       | 169/572 [06:11<14:51,  2.21s/it]
Eval test_s:  30%|██▉       | 170/572 [06:13<14:19,  2.14s/it]
Eval test_s:  30%|██▉       | 171/572 [06:15<14:02,  2.10s/it]
Eval test_s:  30%|███       | 172/572 [06:18<15:54,  2.39s/it]
Eval test_s:  30%|███       | 173/572 [06:22<18:08,  2.73s/it]
Eval test_s:  30%|███       | 174/572 [06:26<19:58,  3.01s/it]
Eval test_s:  31%|███       | 175/572 [06:29<21:35,  3.26s/it]
Eval test_s:  31%|███       | 176/572 [06:32<19:38,  2.98s/it]
Eval test_s:  31%|███       | 177/572 [06:34<17:36,  2.67s/it]
Eval test_s:  31%|███       | 178/572 [06:36<15:55,  2.43s/it]
Eval test_s:  31%|███▏      | 179/572 [06:38<15:23,  2.35s/it]
Eval test_s:  31%|███▏      | 180/572 [06:40<15:14,  2.33s/it]
Eval test_s:  32%|███▏      | 181/572 [06:42<14:20,  2.20s/it]
Eval test_s:  32%|███▏      | 182/572 [06:44<13:49,  2.13s/it]
Eval test_s:  32%|███▏      | 183/572 [06:46<13:21,  2.06s/it]
Eval test_s:  32%|███▏      | 184/572 [06:48<13:02,  2.02s/it]
Eval test_s:  32%|███▏      | 185/572 [06:50<12:58,  2.01s/it]
Eval test_s:  33%|███▎      | 186/572 [06:52<12:46,  1.99s/it]
Eval test_s:  33%|███▎      | 187/572 [06:54<12:31,  1.95s/it]
Eval test_s:  33%|███▎      | 188/572 [06:55<12:24,  1.94s/it]
Eval test_s:  33%|███▎      | 189/572 [06:57<12:21,  1.94s/it]
Eval test_s:  33%|███▎      | 190/572 [06:59<12:23,  1.95s/it]
Eval test_s:  33%|███▎      | 191/572 [07:01<11:54,  1.87s/it]
Eval test_s:  34%|███▎      | 192/572 [07:03<12:26,  1.96s/it]
Eval test_s:  34%|███▎      | 193/572 [07:05<12:10,  1.93s/it]
Eval test_s:  34%|███▍      | 194/572 [07:07<11:47,  1.87s/it]
Eval test_s:  34%|███▍      | 195/572 [07:09<12:05,  1.92s/it]
Eval test_s:  34%|███▍      | 196/572 [07:11<12:01,  1.92s/it]
Eval test_s:  34%|███▍      | 197/572 [07:13<11:54,  1.91s/it]
Eval test_s:  35%|███▍      | 198/572 [07:15<11:57,  1.92s/it]
Eval test_s:  35%|███▍      | 199/572 [07:16<11:52,  1.91s/it]
Eval test_s:  35%|███▍      | 200/572 [07:19<12:04,  1.95s/it]
Eval test_s:  35%|███▌      | 201/572 [07:20<11:35,  1.87s/it]
Eval test_s:  35%|███▌      | 202/572 [07:22<11:54,  1.93s/it]
Eval test_s:  35%|███▌      | 203/572 [07:24<12:05,  1.97s/it]
Eval test_s:  36%|███▌      | 204/572 [07:26<11:43,  1.91s/it]
Eval test_s:  36%|███▌      | 205/572 [07:28<11:41,  1.91s/it]
Eval test_s:  36%|███▌      | 206/572 [07:30<12:03,  1.98s/it]
Eval test_s:  36%|███▌      | 207/572 [07:32<11:31,  1.90s/it]
Eval test_s:  36%|███▋      | 208/572 [07:34<11:36,  1.91s/it]
Eval test_s:  37%|███▋      | 209/572 [07:36<11:33,  1.91s/it]
Eval test_s:  37%|███▋      | 210/572 [07:38<11:35,  1.92s/it]
Eval test_s:  37%|███▋      | 211/572 [07:39<11:04,  1.84s/it]
Eval test_s:  37%|███▋      | 212/572 [07:42<11:54,  1.99s/it]
Eval test_s:  37%|███▋      | 213/572 [07:43<11:22,  1.90s/it]
Eval test_s:  37%|███▋      | 214/572 [07:45<11:25,  1.92s/it]
Eval test_s:  38%|███▊      | 215/572 [07:47<11:22,  1.91s/it]
Eval test_s:  38%|███▊      | 216/572 [07:49<11:22,  1.92s/it]
Eval test_s:  38%|███▊      | 217/572 [07:51<11:01,  1.86s/it]
Eval test_s:  38%|███▊      | 218/572 [07:53<11:14,  1.90s/it]
Eval test_s:  38%|███▊      | 219/572 [07:55<11:42,  1.99s/it]
Eval test_s:  38%|███▊      | 220/572 [07:57<11:31,  1.97s/it]
Eval test_s:  39%|███▊      | 221/572 [07:59<11:26,  1.96s/it]
Eval test_s:  39%|███▉      | 222/572 [08:01<11:25,  1.96s/it]
Eval test_s:  39%|███▉      | 223/572 [08:03<10:56,  1.88s/it]
Eval test_s:  39%|███▉      | 224/572 [08:05<11:01,  1.90s/it]
Eval test_s:  39%|███▉      | 225/572 [08:06<11:01,  1.91s/it]
Eval test_s:  40%|███▉      | 226/572 [08:09<11:17,  1.96s/it]
Eval test_s:  40%|███▉      | 227/572 [08:10<11:08,  1.94s/it]
Eval test_s:  40%|███▉      | 228/572 [08:12<11:05,  1.94s/it]
Eval test_s:  40%|████      | 229/572 [08:14<10:56,  1.91s/it]
Eval test_s:  40%|████      | 230/572 [08:16<10:56,  1.92s/it]
Eval test_s:  40%|████      | 231/572 [08:18<10:50,  1.91s/it]
Eval test_s:  41%|████      | 232/572 [08:20<10:48,  1.91s/it]
Eval test_s:  41%|████      | 233/572 [08:22<10:43,  1.90s/it]
Eval test_s:  41%|████      | 234/572 [08:24<10:41,  1.90s/it]
Eval test_s:  41%|████      | 235/572 [08:26<10:38,  1.90s/it]
Eval test_s:  41%|████▏     | 236/572 [08:27<10:38,  1.90s/it]
Eval test_s:  41%|████▏     | 237/572 [08:29<10:16,  1.84s/it]
Eval test_s:  42%|████▏     | 238/572 [08:31<10:29,  1.89s/it]
Eval test_s:  42%|████▏     | 239/572 [08:33<10:50,  1.95s/it]
Eval test_s:  42%|████▏     | 240/572 [08:35<10:43,  1.94s/it]
Eval test_s:  42%|████▏     | 241/572 [08:37<10:33,  1.91s/it]
Eval test_s:  42%|████▏     | 242/572 [08:39<10:32,  1.92s/it]
Eval test_s:  42%|████▏     | 243/572 [08:41<10:32,  1.92s/it]
Eval test_s:  43%|████▎     | 244/572 [08:43<10:31,  1.92s/it]
Eval test_s:  43%|████▎     | 245/572 [08:45<10:23,  1.91s/it]
Eval test_s:  43%|████▎     | 246/572 [08:47<10:21,  1.91s/it]
Eval test_s:  43%|████▎     | 247/572 [08:48<10:17,  1.90s/it]
Eval test_s:  43%|████▎     | 248/572 [08:50<10:20,  1.92s/it]
Eval test_s:  44%|████▎     | 249/572 [08:52<10:17,  1.91s/it]
Eval test_s:  44%|████▎     | 250/572 [08:54<10:05,  1.88s/it]
Eval test_s:  44%|████▍     | 251/572 [08:56<10:03,  1.88s/it]
Eval test_s:  44%|████▍     | 252/572 [08:58<10:02,  1.88s/it]
Eval test_s:  44%|████▍     | 253/572 [09:00<10:05,  1.90s/it]
Eval test_s:  44%|████▍     | 254/572 [09:02<10:05,  1.90s/it]
Eval test_s:  45%|████▍     | 255/572 [09:04<10:04,  1.91s/it]
Eval test_s:  45%|████▍     | 256/572 [09:06<10:03,  1.91s/it]
Eval test_s:  45%|████▍     | 257/572 [09:07<09:57,  1.90s/it]
Eval test_s:  45%|████▌     | 258/572 [09:09<09:55,  1.90s/it]
Eval test_s:  45%|████▌     | 259/572 [09:11<09:51,  1.89s/it]
Eval test_s:  45%|████▌     | 260/572 [09:13<09:50,  1.89s/it]
Eval test_s:  46%|████▌     | 261/572 [09:15<09:45,  1.88s/it]
Eval test_s:  46%|████▌     | 262/572 [09:17<09:44,  1.89s/it]
Eval test_s:  46%|████▌     | 263/572 [09:19<09:43,  1.89s/it]
Eval test_s:  46%|████▌     | 264/572 [09:21<09:43,  1.89s/it]
Eval test_s:  46%|████▋     | 265/572 [09:23<09:36,  1.88s/it]
Eval test_s:  47%|████▋     | 266/572 [09:24<09:35,  1.88s/it]
Eval test_s:  47%|████▋     | 267/572 [09:26<09:31,  1.88s/it]
Eval test_s:  47%|████▋     | 268/572 [09:28<09:28,  1.87s/it]
Eval test_s:  47%|████▋     | 269/572 [09:30<09:25,  1.87s/it]
Eval test_s:  47%|████▋     | 270/572 [09:32<09:27,  1.88s/it]
Eval test_s:  47%|████▋     | 271/572 [09:34<09:07,  1.82s/it]
Eval test_s:  48%|████▊     | 272/572 [09:36<09:33,  1.91s/it]
Eval test_s:  48%|████▊     | 273/572 [09:38<09:29,  1.90s/it]
Eval test_s:  48%|████▊     | 274/572 [09:39<09:11,  1.85s/it]
Eval test_s:  48%|████▊     | 275/572 [09:41<09:35,  1.94s/it]
Eval test_s:  48%|████▊     | 276/572 [09:43<09:30,  1.93s/it]
Eval test_s:  48%|████▊     | 277/572 [09:45<09:23,  1.91s/it]
Eval test_s:  49%|████▊     | 278/572 [09:47<09:22,  1.91s/it]
Eval test_s:  49%|████▉     | 279/572 [09:49<09:17,  1.90s/it]
Eval test_s:  49%|████▉     | 280/572 [09:51<09:14,  1.90s/it]
Eval test_s:  49%|████▉     | 281/572 [09:53<09:09,  1.89s/it]
Eval test_s:  49%|████▉     | 282/572 [09:55<09:12,  1.90s/it]
Eval test_s:  49%|████▉     | 283/572 [09:57<09:07,  1.90s/it]
Eval test_s:  50%|████▉     | 284/572 [09:59<09:06,  1.90s/it]
Eval test_s:  50%|████▉     | 285/572 [10:00<09:04,  1.90s/it]
Eval test_s:  50%|█████     | 286/572 [10:02<08:44,  1.83s/it]
Eval test_s:  50%|█████     | 287/572 [10:04<08:30,  1.79s/it]
Eval test_s:  50%|█████     | 288/572 [10:06<09:28,  2.00s/it]
Eval test_s:  51%|█████     | 289/572 [10:08<09:35,  2.03s/it]
Eval test_s:  51%|█████     | 290/572 [10:11<10:22,  2.21s/it]
Eval test_s:  51%|█████     | 291/572 [10:13<09:53,  2.11s/it]
Eval test_s:  51%|█████     | 292/572 [10:15<09:34,  2.05s/it]
Eval test_s:  51%|█████     | 293/572 [10:17<10:22,  2.23s/it]
Eval test_s:  51%|█████▏    | 294/572 [10:21<11:30,  2.48s/it]
Eval test_s:  52%|█████▏    | 295/572 [10:22<10:37,  2.30s/it]
Eval test_s:  52%|█████▏    | 296/572 [10:24<10:01,  2.18s/it]
Eval test_s:  52%|█████▏    | 297/572 [10:26<09:37,  2.10s/it]
Eval test_s:  52%|█████▏    | 298/572 [10:28<09:19,  2.04s/it]
Eval test_s:  52%|█████▏    | 299/572 [10:30<09:03,  1.99s/it]
Eval test_s:  52%|█████▏    | 300/572 [10:32<08:54,  1.97s/it]
Eval test_s:  53%|█████▎    | 301/572 [10:34<08:44,  1.94s/it]
Eval test_s:  53%|█████▎    | 302/572 [10:36<08:41,  1.93s/it]
Eval test_s:  53%|█████▎    | 303/572 [10:38<08:35,  1.92s/it]
Eval test_s:  53%|█████▎    | 304/572 [10:39<08:33,  1.92s/it]
Eval test_s:  53%|█████▎    | 305/572 [10:41<08:26,  1.90s/it]
Eval test_s:  53%|█████▎    | 306/572 [10:43<08:26,  1.90s/it]
Eval test_s:  54%|█████▎    | 307/572 [10:45<08:21,  1.89s/it]
Eval test_s:  54%|█████▍    | 308/572 [10:47<08:23,  1.91s/it]
Eval test_s:  54%|█████▍    | 309/572 [10:49<08:18,  1.90s/it]
Eval test_s:  54%|█████▍    | 310/572 [10:51<08:19,  1.91s/it]
Eval test_s:  54%|█████▍    | 311/572 [10:53<08:15,  1.90s/it]
Eval test_s:  55%|█████▍    | 312/572 [10:55<08:14,  1.90s/it]
Eval test_s:  55%|█████▍    | 313/572 [10:56<07:58,  1.85s/it]
Eval test_s:  55%|█████▍    | 314/572 [10:58<08:16,  1.92s/it]
Eval test_s:  55%|█████▌    | 315/572 [11:00<08:16,  1.93s/it]
Eval test_s:  55%|█████▌    | 316/572 [11:02<07:57,  1.86s/it]
Eval test_s:  55%|█████▌    | 317/572 [11:04<08:14,  1.94s/it]
Eval test_s:  56%|█████▌    | 318/572 [11:06<08:08,  1.92s/it]
Eval test_s:  56%|█████▌    | 319/572 [11:08<08:00,  1.90s/it]
Eval test_s:  56%|█████▌    | 320/572 [11:10<07:58,  1.90s/it]
Eval test_s:  56%|█████▌    | 321/572 [11:12<07:58,  1.91s/it]
Eval test_s:  56%|█████▋    | 322/572 [11:14<07:57,  1.91s/it]
Eval test_s:  56%|█████▋    | 323/572 [11:16<07:57,  1.92s/it]
Eval test_s:  57%|█████▋    | 324/572 [11:17<07:43,  1.87s/it]
Eval test_s:  57%|█████▋    | 325/572 [11:19<07:41,  1.87s/it]
Eval test_s:  57%|█████▋    | 326/572 [11:21<08:02,  1.96s/it]
Eval test_s:  57%|█████▋    | 327/572 [11:23<07:55,  1.94s/it]
Eval test_s:  57%|█████▋    | 328/572 [11:25<07:51,  1.93s/it]
Eval test_s:  58%|█████▊    | 329/572 [11:27<07:43,  1.91s/it]
Eval test_s:  58%|█████▊    | 330/572 [11:29<07:55,  1.97s/it]
Eval test_s:  58%|█████▊    | 331/572 [11:31<07:46,  1.94s/it]
Eval test_s:  58%|█████▊    | 332/572 [11:33<07:42,  1.93s/it]
Eval test_s:  58%|█████▊    | 333/572 [11:35<07:38,  1.92s/it]
Eval test_s:  58%|█████▊    | 334/572 [11:38<08:58,  2.26s/it]
Eval test_s:  59%|█████▊    | 335/572 [11:40<09:07,  2.31s/it]
Eval test_s:  59%|█████▊    | 336/572 [11:42<08:46,  2.23s/it]
Eval test_s:  59%|█████▉    | 337/572 [11:46<09:48,  2.50s/it]
Eval test_s:  59%|█████▉    | 338/572 [11:48<09:43,  2.49s/it]
Eval test_s:  59%|█████▉    | 339/572 [11:50<09:00,  2.32s/it]
Eval test_s:  59%|█████▉    | 340/572 [11:52<08:28,  2.19s/it]
Eval test_s:  60%|█████▉    | 341/572 [11:54<08:06,  2.11s/it]
Eval test_s:  60%|█████▉    | 342/572 [11:57<09:43,  2.54s/it]
Eval test_s:  60%|█████▉    | 343/572 [11:59<09:09,  2.40s/it]
Eval test_s:  60%|██████    | 344/572 [12:01<08:37,  2.27s/it]
Eval test_s:  60%|██████    | 345/572 [12:03<08:12,  2.17s/it]
Eval test_s:  60%|██████    | 346/572 [12:05<07:56,  2.11s/it]
Eval test_s:  61%|██████    | 347/572 [12:07<07:38,  2.04s/it]
Eval test_s:  61%|██████    | 348/572 [12:09<07:30,  2.01s/it]
Eval test_s:  61%|██████    | 349/572 [12:11<07:21,  1.98s/it]
Eval test_s:  61%|██████    | 350/572 [12:13<07:15,  1.96s/it]
Eval test_s:  61%|██████▏   | 351/572 [12:15<07:23,  2.01s/it]
Eval test_s:  62%|██████▏   | 352/572 [12:17<07:14,  1.98s/it]
Eval test_s:  62%|██████▏   | 353/572 [12:19<07:06,  1.95s/it]
Eval test_s:  62%|██████▏   | 354/572 [12:21<07:06,  1.96s/it]
Eval test_s:  62%|██████▏   | 355/572 [12:22<06:48,  1.88s/it]
Eval test_s:  62%|██████▏   | 356/572 [12:25<07:09,  1.99s/it]
Eval test_s:  62%|██████▏   | 357/572 [12:27<07:03,  1.97s/it]
Eval test_s:  63%|██████▎   | 358/572 [12:29<06:58,  1.96s/it]
Eval test_s:  63%|██████▎   | 359/572 [12:31<06:56,  1.96s/it]
Eval test_s:  63%|██████▎   | 360/572 [12:32<06:50,  1.94s/it]
Eval test_s:  63%|██████▎   | 361/572 [12:34<06:46,  1.93s/it]
Eval test_s:  63%|██████▎   | 362/572 [12:36<06:44,  1.93s/it]
Eval test_s:  63%|██████▎   | 363/572 [12:38<06:32,  1.88s/it]
Eval test_s:  64%|██████▎   | 364/572 [12:40<06:32,  1.89s/it]
Eval test_s:  64%|██████▍   | 365/572 [12:42<06:33,  1.90s/it]
Eval test_s:  64%|██████▍   | 366/572 [12:44<06:32,  1.90s/it]
Eval test_s:  64%|██████▍   | 367/572 [12:46<06:29,  1.90s/it]
Eval test_s:  64%|██████▍   | 368/572 [12:48<06:25,  1.89s/it]
Eval test_s:  65%|██████▍   | 369/572 [12:49<06:21,  1.88s/it]
Eval test_s:  65%|██████▍   | 370/572 [12:51<06:22,  1.89s/it]
Eval test_s:  65%|██████▍   | 371/572 [12:53<06:21,  1.90s/it]
Eval test_s:  65%|██████▌   | 372/572 [12:55<06:22,  1.91s/it]
Eval test_s:  65%|██████▌   | 373/572 [12:57<06:21,  1.92s/it]
Eval test_s:  65%|██████▌   | 374/572 [12:59<06:21,  1.93s/it]
Eval test_s:  66%|██████▌   | 375/572 [13:01<06:28,  1.97s/it]
Eval test_s:  66%|██████▌   | 376/572 [13:03<06:19,  1.94s/it]
Eval test_s:  66%|██████▌   | 377/572 [13:05<06:13,  1.92s/it]
Eval test_s:  66%|██████▌   | 378/572 [13:07<06:09,  1.91s/it]
Eval test_s:  66%|██████▋   | 379/572 [13:09<06:10,  1.92s/it]
Eval test_s:  66%|██████▋   | 380/572 [13:11<06:07,  1.91s/it]
Eval test_s:  67%|██████▋   | 381/572 [13:12<06:05,  1.91s/it]
Eval test_s:  67%|██████▋   | 382/572 [13:14<06:02,  1.91s/it]
Eval test_s:  67%|██████▋   | 383/572 [13:16<05:58,  1.89s/it]
Eval test_s:  67%|██████▋   | 384/572 [13:18<05:54,  1.88s/it]
Eval test_s:  67%|██████▋   | 385/572 [13:20<05:49,  1.87s/it]
Eval test_s:  67%|██████▋   | 386/572 [13:22<05:48,  1.88s/it]
Eval test_s:  68%|██████▊   | 387/572 [13:24<05:49,  1.89s/it]
Eval test_s:  68%|██████▊   | 388/572 [13:26<05:46,  1.88s/it]
Eval test_s:  68%|██████▊   | 389/572 [13:27<05:43,  1.88s/it]
Eval test_s:  68%|██████▊   | 390/572 [13:29<05:43,  1.89s/it]
Eval test_s:  68%|██████▊   | 391/572 [13:31<05:42,  1.89s/it]
Eval test_s:  69%|██████▊   | 392/572 [13:33<05:38,  1.88s/it]
Eval test_s:  69%|██████▊   | 393/572 [13:35<05:27,  1.83s/it]
Eval test_s:  69%|██████▉   | 394/572 [13:37<05:44,  1.94s/it]
Eval test_s:  69%|██████▉   | 395/572 [13:39<05:43,  1.94s/it]
Eval test_s:  69%|██████▉   | 396/572 [13:41<05:38,  1.92s/it]
Eval test_s:  69%|██████▉   | 397/572 [13:43<05:33,  1.91s/it]
Eval test_s:  70%|██████▉   | 398/572 [13:45<05:31,  1.90s/it]
Eval test_s:  70%|██████▉   | 399/572 [13:47<05:30,  1.91s/it]
Eval test_s:  70%|██████▉   | 400/572 [13:48<05:25,  1.89s/it]
Eval test_s:  70%|███████   | 401/572 [13:50<05:13,  1.83s/it]
Eval test_s:  70%|███████   | 402/572 [13:52<05:30,  1.94s/it]
Eval test_s:  70%|███████   | 403/572 [13:54<05:25,  1.93s/it]
Eval test_s:  71%|███████   | 404/572 [13:56<05:22,  1.92s/it]
Eval test_s:  71%|███████   | 405/572 [13:58<05:09,  1.85s/it]
Eval test_s:  71%|███████   | 406/572 [14:00<05:12,  1.88s/it]
Eval test_s:  71%|███████   | 407/572 [14:02<05:24,  1.97s/it]
Eval test_s:  71%|███████▏  | 408/572 [14:04<05:18,  1.94s/it]
Eval test_s:  72%|███████▏  | 409/572 [14:06<05:14,  1.93s/it]
Eval test_s:  72%|███████▏  | 410/572 [14:08<05:10,  1.92s/it]
Eval test_s:  72%|███████▏  | 411/572 [14:09<05:07,  1.91s/it]
Eval test_s:  72%|███████▏  | 412/572 [14:11<05:04,  1.90s/it]
Eval test_s:  72%|███████▏  | 413/572 [14:13<05:01,  1.90s/it]
Eval test_s:  72%|███████▏  | 414/572 [14:15<05:00,  1.90s/it]
Eval test_s:  73%|███████▎  | 415/572 [14:17<04:59,  1.90s/it]
Eval test_s:  73%|███████▎  | 416/572 [14:19<04:49,  1.86s/it]
Eval test_s:  73%|███████▎  | 417/572 [14:21<04:56,  1.91s/it]
Eval test_s:  73%|███████▎  | 418/572 [14:23<04:52,  1.90s/it]
Eval test_s:  73%|███████▎  | 419/572 [14:25<04:50,  1.90s/it]
Eval test_s:  73%|███████▎  | 420/572 [14:26<04:43,  1.86s/it]
Eval test_s:  74%|███████▎  | 421/572 [14:28<04:40,  1.86s/it]
Eval test_s:  74%|███████▍  | 422/572 [14:30<04:39,  1.86s/it]
Eval test_s:  74%|███████▍  | 423/572 [14:32<04:39,  1.87s/it]
Eval test_s:  74%|███████▍  | 424/572 [14:34<04:38,  1.88s/it]
Eval test_s:  74%|███████▍  | 425/572 [14:36<04:38,  1.90s/it]
Eval test_s:  74%|███████▍  | 426/572 [14:38<04:36,  1.89s/it]
Eval test_s:  75%|███████▍  | 427/572 [14:40<04:35,  1.90s/it]
Eval test_s:  75%|███████▍  | 428/572 [14:42<04:32,  1.89s/it]
Eval test_s:  75%|███████▌  | 429/572 [14:43<04:29,  1.89s/it]
Eval test_s:  75%|███████▌  | 430/572 [14:45<04:27,  1.89s/it]
Eval test_s:  75%|███████▌  | 431/572 [14:47<04:27,  1.90s/it]
Eval test_s:  76%|███████▌  | 432/572 [14:49<04:28,  1.92s/it]
Eval test_s:  76%|███████▌  | 433/572 [14:51<04:23,  1.90s/it]
Eval test_s:  76%|███████▌  | 434/572 [14:53<04:20,  1.88s/it]
Eval test_s:  76%|███████▌  | 435/572 [14:55<04:20,  1.90s/it]
Eval test_s:  76%|███████▌  | 436/572 [14:57<04:16,  1.89s/it]
Eval test_s:  76%|███████▋  | 437/572 [14:59<04:14,  1.89s/it]
Eval test_s:  77%|███████▋  | 438/572 [15:00<04:14,  1.90s/it]
Eval test_s:  77%|███████▋  | 439/572 [15:02<04:05,  1.84s/it]
Eval test_s:  77%|███████▋  | 440/572 [15:04<04:16,  1.94s/it]
Eval test_s:  77%|███████▋  | 441/572 [15:06<04:14,  1.94s/it]
Eval test_s:  77%|███████▋  | 442/572 [15:08<04:10,  1.93s/it]
Eval test_s:  77%|███████▋  | 443/572 [15:10<04:07,  1.92s/it]
Eval test_s:  78%|███████▊  | 444/572 [15:12<03:59,  1.87s/it]
Eval test_s:  78%|███████▊  | 445/572 [15:14<03:52,  1.83s/it]
Eval test_s:  78%|███████▊  | 446/572 [15:16<03:53,  1.86s/it]
Eval test_s:  78%|███████▊  | 447/572 [15:18<04:14,  2.04s/it]
Eval test_s:  78%|███████▊  | 448/572 [15:20<04:01,  1.95s/it]
Eval test_s:  78%|███████▊  | 449/572 [15:22<04:19,  2.11s/it]
Eval test_s:  79%|███████▊  | 450/572 [15:24<04:10,  2.06s/it]
Eval test_s:  79%|███████▉  | 451/572 [15:28<05:04,  2.51s/it]
Eval test_s:  79%|███████▉  | 452/572 [15:30<04:58,  2.49s/it]
Eval test_s:  79%|███████▉  | 453/572 [15:32<04:36,  2.32s/it]
Eval test_s:  79%|███████▉  | 454/572 [15:34<04:12,  2.14s/it]
Eval test_s:  80%|███████▉  | 455/572 [15:36<04:02,  2.08s/it]
Eval test_s:  80%|███████▉  | 456/572 [15:38<04:03,  2.10s/it]
Eval test_s:  80%|███████▉  | 457/572 [15:40<03:55,  2.05s/it]
Eval test_s:  80%|████████  | 458/572 [15:41<03:41,  1.94s/it]
Eval test_s:  80%|████████  | 459/572 [15:44<03:46,  2.00s/it]
Eval test_s:  80%|████████  | 460/572 [15:46<03:41,  1.97s/it]
Eval test_s:  81%|████████  | 461/572 [15:48<03:41,  1.99s/it]
Eval test_s:  81%|████████  | 462/572 [15:49<03:36,  1.97s/it]
Eval test_s:  81%|████████  | 463/572 [15:51<03:31,  1.94s/it]
Eval test_s:  81%|████████  | 464/572 [15:53<03:27,  1.92s/it]
Eval test_s:  81%|████████▏ | 465/572 [15:55<03:25,  1.92s/it]
Eval test_s:  81%|████████▏ | 466/572 [15:57<03:22,  1.91s/it]
Eval test_s:  82%|████████▏ | 467/572 [15:59<03:21,  1.92s/it]
Eval test_s:  82%|████████▏ | 468/572 [16:01<03:19,  1.92s/it]
Eval test_s:  82%|████████▏ | 469/572 [16:03<03:17,  1.91s/it]
Eval test_s:  82%|████████▏ | 470/572 [16:05<03:15,  1.92s/it]
Eval test_s:  82%|████████▏ | 471/572 [16:07<03:13,  1.92s/it]
Eval test_s:  83%|████████▎ | 472/572 [16:09<03:11,  1.91s/it]
Eval test_s:  83%|████████▎ | 473/572 [16:10<03:02,  1.84s/it]
Eval test_s:  83%|████████▎ | 474/572 [16:12<03:08,  1.93s/it]
Eval test_s:  83%|████████▎ | 475/572 [16:14<03:06,  1.92s/it]
Eval test_s:  83%|████████▎ | 476/572 [16:16<03:01,  1.90s/it]
Eval test_s:  83%|████████▎ | 477/572 [16:18<02:59,  1.89s/it]
Eval test_s:  84%|████████▎ | 478/572 [16:20<02:51,  1.82s/it]
Eval test_s:  84%|████████▎ | 479/572 [16:22<02:55,  1.89s/it]
Eval test_s:  84%|████████▍ | 480/572 [16:24<02:52,  1.87s/it]
Eval test_s:  84%|████████▍ | 481/572 [16:25<02:50,  1.87s/it]
Eval test_s:  84%|████████▍ | 482/572 [16:27<02:47,  1.87s/it]
Eval test_s:  84%|████████▍ | 483/572 [16:29<02:51,  1.92s/it]
Eval test_s:  85%|████████▍ | 484/572 [16:31<02:42,  1.85s/it]
Eval test_s:  85%|████████▍ | 485/572 [16:33<02:41,  1.85s/it]
Eval test_s:  85%|████████▍ | 486/572 [16:35<02:39,  1.86s/it]
Eval test_s:  85%|████████▌ | 487/572 [16:37<02:40,  1.89s/it]
Eval test_s:  85%|████████▌ | 488/572 [16:39<02:38,  1.89s/it]
Eval test_s:  85%|████████▌ | 489/572 [16:40<02:34,  1.86s/it]
Eval test_s:  86%|████████▌ | 490/572 [16:42<02:31,  1.85s/it]
Eval test_s:  86%|████████▌ | 491/572 [16:44<02:31,  1.86s/it]
Eval test_s:  86%|████████▌ | 492/572 [16:46<02:30,  1.88s/it]
Eval test_s:  86%|████████▌ | 493/572 [16:48<02:24,  1.82s/it]
Eval test_s:  86%|████████▋ | 494/572 [16:50<02:25,  1.87s/it]
Eval test_s:  87%|████████▋ | 495/572 [16:52<02:30,  1.95s/it]
Eval test_s:  87%|████████▋ | 496/572 [16:54<02:27,  1.94s/it]
Eval test_s:  87%|████████▋ | 497/572 [16:56<02:24,  1.92s/it]
Eval test_s:  87%|████████▋ | 498/572 [16:58<02:21,  1.92s/it]
Eval test_s:  87%|████████▋ | 499/572 [16:59<02:15,  1.86s/it]
Eval test_s:  87%|████████▋ | 500/572 [17:01<02:21,  1.96s/it]
Eval test_s:  88%|████████▊ | 501/572 [17:03<02:17,  1.94s/it]
Eval test_s:  88%|████████▊ | 502/572 [17:05<02:14,  1.92s/it]
Eval test_s:  88%|████████▊ | 503/572 [17:07<02:12,  1.91s/it]
Eval test_s:  88%|████████▊ | 504/572 [17:09<02:09,  1.91s/it]
Eval test_s:  88%|████████▊ | 505/572 [17:11<02:06,  1.89s/it]
Eval test_s:  88%|████████▊ | 506/572 [17:13<02:04,  1.89s/it]
Eval test_s:  89%|████████▊ | 507/572 [17:15<02:03,  1.90s/it]
Eval test_s:  89%|████████▉ | 508/572 [17:17<02:01,  1.89s/it]
Eval test_s:  89%|████████▉ | 509/572 [17:18<01:59,  1.90s/it]
Eval test_s:  89%|████████▉ | 510/572 [17:20<01:54,  1.85s/it]
Eval test_s:  89%|████████▉ | 511/572 [17:22<01:53,  1.86s/it]
Eval test_s:  90%|████████▉ | 512/572 [17:24<01:56,  1.94s/it]
Eval test_s:  90%|████████▉ | 513/572 [17:26<01:53,  1.92s/it]
Eval test_s:  90%|████████▉ | 514/572 [17:28<01:50,  1.91s/it]
Eval test_s:  90%|█████████ | 515/572 [17:30<01:49,  1.92s/it]
Eval test_s:  90%|█████████ | 516/572 [17:32<01:47,  1.92s/it]
Eval test_s:  90%|█████████ | 517/572 [17:34<01:45,  1.91s/it]
Eval test_s:  91%|█████████ | 518/572 [17:36<01:43,  1.91s/it]
Eval test_s:  91%|█████████ | 519/572 [17:38<01:42,  1.93s/it]
Eval test_s:  91%|█████████ | 520/572 [17:40<01:40,  1.93s/it]
Eval test_s:  91%|█████████ | 521/572 [17:41<01:37,  1.92s/it]
Eval test_s:  91%|█████████▏| 522/572 [17:43<01:35,  1.90s/it]
Eval test_s:  91%|█████████▏| 523/572 [17:45<01:33,  1.91s/it]
Eval test_s:  92%|█████████▏| 524/572 [17:47<01:31,  1.90s/it]
Eval test_s:  92%|█████████▏| 525/572 [17:49<01:29,  1.90s/it]
Eval test_s:  92%|█████████▏| 526/572 [17:51<01:28,  1.91s/it]
Eval test_s:  92%|█████████▏| 527/572 [17:53<01:23,  1.86s/it]
Eval test_s:  92%|█████████▏| 528/572 [17:55<01:25,  1.95s/it]
Eval test_s:  92%|█████████▏| 529/572 [17:57<01:23,  1.94s/it]
Eval test_s:  93%|█████████▎| 530/572 [17:59<01:20,  1.92s/it]
Eval test_s:  93%|█████████▎| 531/572 [18:01<01:18,  1.92s/it]
Eval test_s:  93%|█████████▎| 532/572 [18:02<01:16,  1.92s/it]
Eval test_s:  93%|█████████▎| 533/572 [18:04<01:14,  1.91s/it]
Eval test_s:  93%|█████████▎| 534/572 [18:06<01:12,  1.91s/it]
Eval test_s:  94%|█████████▎| 535/572 [18:08<01:10,  1.91s/it]
Eval test_s:  94%|█████████▎| 536/572 [18:10<01:08,  1.90s/it]
Eval test_s:  94%|█████████▍| 537/572 [18:12<01:06,  1.90s/it]
Eval test_s:  94%|█████████▍| 538/572 [18:14<01:03,  1.88s/it]
Eval test_s:  94%|█████████▍| 539/572 [18:16<01:02,  1.88s/it]
Eval test_s:  94%|█████████▍| 540/572 [18:18<00:59,  1.87s/it]
Eval test_s:  95%|█████████▍| 541/572 [18:19<00:58,  1.87s/it]
Eval test_s:  95%|█████████▍| 542/572 [18:21<00:54,  1.81s/it]
Eval test_s:  95%|█████████▍| 543/572 [18:23<00:55,  1.92s/it]
Eval test_s:  95%|█████████▌| 544/572 [18:25<00:53,  1.90s/it]
Eval test_s:  95%|█████████▌| 545/572 [18:27<00:49,  1.84s/it]
Eval test_s:  95%|█████████▌| 546/572 [18:29<00:50,  1.94s/it]
Eval test_s:  96%|█████████▌| 547/572 [18:31<00:48,  1.93s/it]
Eval test_s:  96%|█████████▌| 548/572 [18:33<00:45,  1.91s/it]
Eval test_s:  96%|█████████▌| 549/572 [18:35<00:43,  1.90s/it]
Eval test_s:  96%|█████████▌| 550/572 [18:36<00:41,  1.90s/it]
Eval test_s:  96%|█████████▋| 551/572 [18:38<00:40,  1.90s/it]
Eval test_s:  97%|█████████▋| 552/572 [18:40<00:37,  1.89s/it]
Eval test_s:  97%|█████████▋| 553/572 [18:42<00:35,  1.89s/it]
Eval test_s:  97%|█████████▋| 554/572 [18:44<00:34,  1.89s/it]
Eval test_s:  97%|█████████▋| 555/572 [18:46<00:31,  1.85s/it]
Eval test_s:  97%|█████████▋| 556/572 [18:48<00:29,  1.82s/it]
Eval test_s:  97%|█████████▋| 557/572 [18:51<00:33,  2.23s/it]
Eval test_s:  98%|█████████▊| 558/572 [18:53<00:30,  2.18s/it]
Eval test_s:  98%|█████████▊| 559/572 [18:55<00:27,  2.11s/it]
Eval test_s:  98%|█████████▊| 560/572 [18:57<00:24,  2.07s/it]
Eval test_s:  98%|█████████▊| 561/572 [18:58<00:21,  1.96s/it]
Eval test_s:  98%|█████████▊| 562/572 [19:02<00:23,  2.36s/it]
Eval test_s:  98%|█████████▊| 563/572 [19:04<00:21,  2.34s/it]
Eval test_s:  99%|█████████▊| 564/572 [19:06<00:17,  2.20s/it]
Eval test_s:  99%|█████████▉| 565/572 [19:08<00:14,  2.09s/it]
Eval test_s:  99%|█████████▉| 566/572 [19:09<00:11,  1.96s/it]
Eval test_s:  99%|█████████▉| 567/572 [19:11<00:09,  1.87s/it]
Eval test_s:  99%|█████████▉| 568/572 [19:13<00:07,  1.81s/it]
Eval test_s:  99%|█████████▉| 569/572 [19:14<00:05,  1.77s/it]
Eval test_s: 100%|█████████▉| 570/572 [19:16<00:03,  1.74s/it]
Eval test_s: 100%|█████████▉| 571/572 [19:18<00:01,  1.72s/it]
Eval test_s: 100%|██████████| 572/572 [19:19<00:00,  1.70s/it]
                                                              
  [test_s]  mIoU=0.6986  F=0.7994

Eval test_u:   0%|          | 0/414 [00:00<?, ?it/s]
Eval test_u:   0%|          | 1/414 [00:22<2:37:13, 22.84s/it]
Eval test_u:   0%|          | 2/414 [00:26<1:18:15, 11.40s/it]
Eval test_u:   1%|          | 3/414 [00:29<53:49,  7.86s/it]  
Eval test_u:   1%|          | 4/414 [00:33<42:09,  6.17s/it]
Eval test_u:   1%|          | 5/414 [00:37<35:38,  5.23s/it]
Eval test_u:   1%|▏         | 6/414 [00:40<30:55,  4.55s/it]
Eval test_u:   2%|▏         | 7/414 [00:44<29:17,  4.32s/it]
Eval test_u:   2%|▏         | 8/414 [00:46<25:15,  3.73s/it]
Eval test_u:   2%|▏         | 9/414 [00:48<21:24,  3.17s/it]
Eval test_u:   2%|▏         | 10/414 [00:50<18:47,  2.79s/it]
Eval test_u:   3%|▎         | 11/414 [00:52<17:15,  2.57s/it]
Eval test_u:   3%|▎         | 12/414 [00:54<16:01,  2.39s/it]
Eval test_u:   3%|▎         | 13/414 [00:56<14:58,  2.24s/it]
Eval test_u:   3%|▎         | 14/414 [00:58<14:20,  2.15s/it]
Eval test_u:   4%|▎         | 15/414 [01:00<13:52,  2.09s/it]
Eval test_u:   4%|▍         | 16/414 [01:02<13:38,  2.06s/it]
Eval test_u:   4%|▍         | 17/414 [01:04<13:16,  2.01s/it]
Eval test_u:   4%|▍         | 18/414 [01:06<13:03,  1.98s/it]
Eval test_u:   5%|▍         | 19/414 [01:07<12:53,  1.96s/it]
Eval test_u:   5%|▍         | 20/414 [01:09<12:47,  1.95s/it]
Eval test_u:   5%|▌         | 21/414 [01:11<12:39,  1.93s/it]
Eval test_u:   5%|▌         | 22/414 [01:13<12:36,  1.93s/it]
Eval test_u:   6%|▌         | 23/414 [01:15<12:31,  1.92s/it]
Eval test_u:   6%|▌         | 24/414 [01:17<12:33,  1.93s/it]
Eval test_u:   6%|▌         | 25/414 [01:19<12:25,  1.92s/it]
Eval test_u:   6%|▋         | 26/414 [01:21<12:23,  1.92s/it]
Eval test_u:   7%|▋         | 27/414 [01:23<12:26,  1.93s/it]
Eval test_u:   7%|▋         | 28/414 [01:25<12:30,  1.94s/it]
Eval test_u:   7%|▋         | 29/414 [01:27<12:21,  1.93s/it]
Eval test_u:   7%|▋         | 30/414 [01:29<12:18,  1.92s/it]
Eval test_u:   7%|▋         | 31/414 [01:31<12:21,  1.94s/it]
Eval test_u:   8%|▊         | 32/414 [01:33<12:25,  1.95s/it]
Eval test_u:   8%|▊         | 33/414 [01:34<12:15,  1.93s/it]
Eval test_u:   8%|▊         | 34/414 [01:36<12:09,  1.92s/it]
Eval test_u:   8%|▊         | 35/414 [01:38<12:04,  1.91s/it]
Eval test_u:   9%|▊         | 36/414 [01:40<12:07,  1.92s/it]
Eval test_u:   9%|▉         | 37/414 [01:42<11:56,  1.90s/it]
Eval test_u:   9%|▉         | 38/414 [01:44<11:50,  1.89s/it]
Eval test_u:   9%|▉         | 39/414 [01:46<11:48,  1.89s/it]
Eval test_u:  10%|▉         | 40/414 [01:48<11:56,  1.92s/it]
Eval test_u:  10%|▉         | 41/414 [01:50<11:51,  1.91s/it]
Eval test_u:  10%|█         | 42/414 [01:52<11:48,  1.90s/it]
Eval test_u:  10%|█         | 43/414 [01:53<11:44,  1.90s/it]
Eval test_u:  11%|█         | 44/414 [01:55<11:53,  1.93s/it]
Eval test_u:  11%|█         | 45/414 [01:57<11:46,  1.92s/it]
Eval test_u:  11%|█         | 46/414 [01:59<11:38,  1.90s/it]
Eval test_u:  11%|█▏        | 47/414 [02:01<11:31,  1.89s/it]
Eval test_u:  12%|█▏        | 48/414 [02:03<11:40,  1.91s/it]
Eval test_u:  12%|█▏        | 49/414 [02:05<11:35,  1.91s/it]
Eval test_u:  12%|█▏        | 50/414 [02:07<11:33,  1.90s/it]
Eval test_u:  12%|█▏        | 51/414 [02:09<11:27,  1.89s/it]
Eval test_u:  13%|█▎        | 52/414 [02:11<11:37,  1.93s/it]
Eval test_u:  13%|█▎        | 53/414 [02:13<11:31,  1.92s/it]
Eval test_u:  13%|█▎        | 54/414 [02:14<11:29,  1.92s/it]
Eval test_u:  13%|█▎        | 55/414 [02:16<11:18,  1.89s/it]
Eval test_u:  14%|█▎        | 56/414 [02:18<10:32,  1.77s/it]
Eval test_u:  14%|█▍        | 57/414 [02:20<10:52,  1.83s/it]
Eval test_u:  14%|█▍        | 58/414 [02:22<10:59,  1.85s/it]
Eval test_u:  14%|█▍        | 59/414 [02:24<10:58,  1.86s/it]
Eval test_u:  14%|█▍        | 60/414 [02:25<11:07,  1.88s/it]
Eval test_u:  15%|█▍        | 61/414 [02:27<11:05,  1.88s/it]
Eval test_u:  15%|█▍        | 62/414 [02:29<11:07,  1.90s/it]
Eval test_u:  15%|█▌        | 63/414 [02:31<11:00,  1.88s/it]
Eval test_u:  15%|█▌        | 64/414 [02:33<11:07,  1.91s/it]
Eval test_u:  16%|█▌        | 65/414 [02:35<11:02,  1.90s/it]
Eval test_u:  16%|█▌        | 66/414 [02:37<11:00,  1.90s/it]
Eval test_u:  16%|█▌        | 67/414 [02:39<10:54,  1.89s/it]
Eval test_u:  16%|█▋        | 68/414 [02:41<10:59,  1.91s/it]
Eval test_u:  17%|█▋        | 69/414 [02:43<10:52,  1.89s/it]
Eval test_u:  17%|█▋        | 70/414 [02:44<10:51,  1.89s/it]
Eval test_u:  17%|█▋        | 71/414 [02:46<10:46,  1.88s/it]
Eval test_u:  17%|█▋        | 72/414 [02:48<10:50,  1.90s/it]
Eval test_u:  18%|█▊        | 73/414 [02:50<10:45,  1.89s/it]
Eval test_u:  18%|█▊        | 74/414 [02:52<10:49,  1.91s/it]
Eval test_u:  18%|█▊        | 75/414 [02:54<10:45,  1.90s/it]
Eval test_u:  18%|█▊        | 76/414 [02:56<10:43,  1.90s/it]
Eval test_u:  19%|█▊        | 77/414 [02:58<10:38,  1.89s/it]
Eval test_u:  19%|█▉        | 78/414 [03:00<10:37,  1.90s/it]
Eval test_u:  19%|█▉        | 79/414 [03:02<10:35,  1.90s/it]
Eval test_u:  19%|█▉        | 80/414 [03:04<10:41,  1.92s/it]
Eval test_u:  20%|█▉        | 81/414 [03:05<10:43,  1.93s/it]
Eval test_u:  20%|█▉        | 82/414 [03:07<10:37,  1.92s/it]
Eval test_u:  20%|██        | 83/414 [03:09<10:30,  1.90s/it]
Eval test_u:  20%|██        | 84/414 [03:11<10:34,  1.92s/it]
Eval test_u:  21%|██        | 85/414 [03:13<10:31,  1.92s/it]
Eval test_u:  21%|██        | 86/414 [03:15<10:25,  1.91s/it]
Eval test_u:  21%|██        | 87/414 [03:17<10:20,  1.90s/it]
Eval test_u:  21%|██▏       | 88/414 [03:19<10:24,  1.92s/it]
Eval test_u:  21%|██▏       | 89/414 [03:21<10:17,  1.90s/it]
Eval test_u:  22%|██▏       | 90/414 [03:23<10:09,  1.88s/it]
Eval test_u:  22%|██▏       | 91/414 [03:24<10:09,  1.89s/it]
Eval test_u:  22%|██▏       | 92/414 [03:26<10:11,  1.90s/it]
Eval test_u:  22%|██▏       | 93/414 [03:28<10:05,  1.89s/it]
Eval test_u:  23%|██▎       | 94/414 [03:30<10:00,  1.88s/it]
Eval test_u:  23%|██▎       | 95/414 [03:32<09:55,  1.87s/it]
Eval test_u:  23%|██▎       | 96/414 [03:34<09:53,  1.87s/it]
Eval test_u:  23%|██▎       | 97/414 [03:36<09:48,  1.86s/it]
Eval test_u:  24%|██▎       | 98/414 [03:37<09:46,  1.86s/it]
Eval test_u:  24%|██▍       | 99/414 [03:39<09:52,  1.88s/it]
Eval test_u:  24%|██▍       | 100/414 [03:41<09:56,  1.90s/it]
Eval test_u:  24%|██▍       | 101/414 [03:43<09:53,  1.90s/it]
Eval test_u:  25%|██▍       | 102/414 [03:45<09:47,  1.88s/it]
Eval test_u:  25%|██▍       | 103/414 [03:47<09:43,  1.88s/it]
Eval test_u:  25%|██▌       | 104/414 [03:49<09:48,  1.90s/it]
Eval test_u:  25%|██▌       | 105/414 [03:51<09:41,  1.88s/it]
Eval test_u:  26%|██▌       | 106/414 [03:53<09:44,  1.90s/it]
Eval test_u:  26%|██▌       | 107/414 [03:55<09:39,  1.89s/it]
Eval test_u:  26%|██▌       | 108/414 [03:56<09:43,  1.91s/it]
Eval test_u:  26%|██▋       | 109/414 [03:58<09:40,  1.90s/it]
Eval test_u:  27%|██▋       | 110/414 [04:00<09:37,  1.90s/it]
Eval test_u:  27%|██▋       | 111/414 [04:02<09:38,  1.91s/it]
Eval test_u:  27%|██▋       | 112/414 [04:04<09:34,  1.90s/it]
Eval test_u:  27%|██▋       | 113/414 [04:06<09:35,  1.91s/it]
Eval test_u:  28%|██▊       | 114/414 [04:08<09:31,  1.91s/it]
Eval test_u:  28%|██▊       | 115/414 [04:10<09:21,  1.88s/it]
Eval test_u:  28%|██▊       | 116/414 [04:12<09:21,  1.88s/it]
Eval test_u:  28%|██▊       | 117/414 [04:14<09:22,  1.89s/it]
Eval test_u:  29%|██▊       | 118/414 [04:15<09:16,  1.88s/it]
Eval test_u:  29%|██▊       | 119/414 [04:17<09:15,  1.88s/it]
Eval test_u:  29%|██▉       | 120/414 [04:19<09:20,  1.91s/it]
Eval test_u:  29%|██▉       | 121/414 [04:21<09:17,  1.90s/it]
Eval test_u:  29%|██▉       | 122/414 [04:23<09:12,  1.89s/it]
Eval test_u:  30%|██▉       | 123/414 [04:25<09:09,  1.89s/it]
Eval test_u:  30%|██▉       | 124/414 [04:27<09:11,  1.90s/it]
Eval test_u:  30%|███       | 125/414 [04:29<09:08,  1.90s/it]
Eval test_u:  30%|███       | 126/414 [04:30<08:41,  1.81s/it]
Eval test_u:  31%|███       | 127/414 [04:32<08:44,  1.83s/it]
Eval test_u:  31%|███       | 128/414 [04:34<08:48,  1.85s/it]
Eval test_u:  31%|███       | 129/414 [04:36<08:47,  1.85s/it]
Eval test_u:  31%|███▏      | 130/414 [04:38<08:48,  1.86s/it]
Eval test_u:  32%|███▏      | 131/414 [04:40<08:44,  1.85s/it]
Eval test_u:  32%|███▏      | 132/414 [04:42<08:45,  1.86s/it]
Eval test_u:  32%|███▏      | 133/414 [04:43<08:42,  1.86s/it]
Eval test_u:  32%|███▏      | 134/414 [04:46<09:12,  1.97s/it]
Eval test_u:  33%|███▎      | 135/414 [04:48<09:53,  2.13s/it]
Eval test_u:  33%|███▎      | 136/414 [04:50<09:33,  2.06s/it]
Eval test_u:  33%|███▎      | 137/414 [04:53<10:11,  2.21s/it]
Eval test_u:  33%|███▎      | 138/414 [04:55<10:36,  2.31s/it]
Eval test_u:  34%|███▎      | 139/414 [04:58<11:51,  2.59s/it]
Eval test_u:  34%|███▍      | 140/414 [05:01<12:10,  2.66s/it]
Eval test_u:  34%|███▍      | 141/414 [05:03<11:30,  2.53s/it]
Eval test_u:  34%|███▍      | 142/414 [05:06<11:05,  2.44s/it]
Eval test_u:  35%|███▍      | 143/414 [05:08<10:15,  2.27s/it]
Eval test_u:  35%|███▍      | 144/414 [05:10<09:50,  2.19s/it]
Eval test_u:  35%|███▌      | 145/414 [05:12<09:49,  2.19s/it]
Eval test_u:  35%|███▌      | 146/414 [05:14<10:10,  2.28s/it]
Eval test_u:  36%|███▌      | 147/414 [05:17<10:29,  2.36s/it]
Eval test_u:  36%|███▌      | 148/414 [05:19<10:44,  2.42s/it]
Eval test_u:  36%|███▌      | 149/414 [05:22<10:49,  2.45s/it]
Eval test_u:  36%|███▌      | 150/414 [05:24<10:49,  2.46s/it]
Eval test_u:  36%|███▋      | 151/414 [05:26<09:58,  2.28s/it]
Eval test_u:  37%|███▋      | 152/414 [05:28<09:30,  2.18s/it]
Eval test_u:  37%|███▋      | 153/414 [05:30<09:18,  2.14s/it]
Eval test_u:  37%|███▋      | 154/414 [05:34<10:53,  2.51s/it]
Eval test_u:  37%|███▋      | 155/414 [05:37<11:44,  2.72s/it]
Eval test_u:  38%|███▊      | 156/414 [05:40<12:35,  2.93s/it]
Eval test_u:  38%|███▊      | 157/414 [05:43<11:54,  2.78s/it]
Eval test_u:  38%|███▊      | 158/414 [05:45<11:33,  2.71s/it]
Eval test_u:  38%|███▊      | 159/414 [05:48<11:15,  2.65s/it]
Eval test_u:  39%|███▊      | 160/414 [05:50<11:02,  2.61s/it]
Eval test_u:  39%|███▉      | 161/414 [05:52<10:02,  2.38s/it]
Eval test_u:  39%|███▉      | 162/414 [05:54<09:27,  2.25s/it]
Eval test_u:  39%|███▉      | 163/414 [05:56<08:56,  2.14s/it]
Eval test_u:  40%|███▉      | 164/414 [05:58<08:42,  2.09s/it]
Eval test_u:  40%|███▉      | 165/414 [06:00<08:47,  2.12s/it]
Eval test_u:  40%|████      | 166/414 [06:02<08:26,  2.04s/it]
Eval test_u:  40%|████      | 167/414 [06:04<08:08,  1.98s/it]
Eval test_u:  41%|████      | 168/414 [06:06<08:02,  1.96s/it]
Eval test_u:  41%|████      | 169/414 [06:07<07:54,  1.94s/it]
Eval test_u:  41%|████      | 170/414 [06:09<07:46,  1.91s/it]
Eval test_u:  41%|████▏     | 171/414 [06:12<08:15,  2.04s/it]
Eval test_u:  42%|████▏     | 172/414 [06:14<08:07,  2.02s/it]
Eval test_u:  42%|████▏     | 173/414 [06:16<08:24,  2.09s/it]
Eval test_u:  42%|████▏     | 174/414 [06:18<08:07,  2.03s/it]
Eval test_u:  42%|████▏     | 175/414 [06:20<07:56,  1.99s/it]
Eval test_u:  43%|████▎     | 176/414 [06:22<07:52,  1.98s/it]
Eval test_u:  43%|████▎     | 177/414 [06:25<09:06,  2.31s/it]
Eval test_u:  43%|████▎     | 178/414 [06:28<10:40,  2.72s/it]
Eval test_u:  43%|████▎     | 179/414 [06:32<11:17,  2.89s/it]
Eval test_u:  43%|████▎     | 180/414 [06:34<11:07,  2.85s/it]
Eval test_u:  44%|████▎     | 181/414 [06:37<10:33,  2.72s/it]
Eval test_u:  44%|████▍     | 182/414 [06:39<10:03,  2.60s/it]
Eval test_u:  44%|████▍     | 183/414 [06:42<09:53,  2.57s/it]
Eval test_u:  44%|████▍     | 184/414 [06:44<09:56,  2.59s/it]
Eval test_u:  45%|████▍     | 185/414 [06:47<09:46,  2.56s/it]
Eval test_u:  45%|████▍     | 186/414 [06:50<10:21,  2.73s/it]
Eval test_u:  45%|████▌     | 187/414 [06:52<09:07,  2.41s/it]
Eval test_u:  45%|████▌     | 188/414 [06:54<08:30,  2.26s/it]
Eval test_u:  46%|████▌     | 189/414 [06:55<07:27,  1.99s/it]
Eval test_u:  46%|████▌     | 190/414 [06:57<07:24,  1.99s/it]
Eval test_u:  46%|████▌     | 191/414 [06:59<07:27,  2.01s/it]
Eval test_u:  46%|████▋     | 192/414 [07:02<08:05,  2.19s/it]
Eval test_u:  47%|████▋     | 193/414 [07:03<07:40,  2.08s/it]
Eval test_u:  47%|████▋     | 194/414 [07:05<07:25,  2.03s/it]
Eval test_u:  47%|████▋     | 195/414 [07:07<07:12,  1.98s/it]
Eval test_u:  47%|████▋     | 196/414 [07:09<07:07,  1.96s/it]
Eval test_u:  48%|████▊     | 197/414 [07:11<06:59,  1.93s/it]
Eval test_u:  48%|████▊     | 198/414 [07:13<07:17,  2.02s/it]
Eval test_u:  48%|████▊     | 199/414 [07:16<07:50,  2.19s/it]
Eval test_u:  48%|████▊     | 200/414 [07:18<07:46,  2.18s/it]
Eval test_u:  49%|████▊     | 201/414 [07:20<07:21,  2.07s/it]
Eval test_u:  49%|████▉     | 202/414 [07:22<07:27,  2.11s/it]
Eval test_u:  49%|████▉     | 203/414 [07:24<07:10,  2.04s/it]
Eval test_u:  49%|████▉     | 204/414 [07:25<06:46,  1.94s/it]
Eval test_u:  50%|████▉     | 205/414 [07:28<06:57,  2.00s/it]
Eval test_u:  50%|████▉     | 206/414 [07:29<06:47,  1.96s/it]
Eval test_u:  50%|█████     | 207/414 [07:31<06:40,  1.93s/it]
Eval test_u:  50%|█████     | 208/414 [07:33<06:37,  1.93s/it]
Eval test_u:  50%|█████     | 209/414 [07:36<07:05,  2.08s/it]
Eval test_u:  51%|█████     | 210/414 [07:38<07:20,  2.16s/it]
Eval test_u:  51%|█████     | 211/414 [07:40<07:29,  2.21s/it]
Eval test_u:  51%|█████     | 212/414 [07:43<07:31,  2.24s/it]
Eval test_u:  51%|█████▏    | 213/414 [07:45<07:37,  2.27s/it]
Eval test_u:  52%|█████▏    | 214/414 [07:47<07:31,  2.26s/it]
Eval test_u:  52%|█████▏    | 215/414 [07:50<07:43,  2.33s/it]
Eval test_u:  52%|█████▏    | 216/414 [07:52<07:43,  2.34s/it]
Eval test_u:  52%|█████▏    | 217/414 [07:54<07:34,  2.31s/it]
Eval test_u:  53%|█████▎    | 218/414 [07:57<07:30,  2.30s/it]
Eval test_u:  53%|█████▎    | 219/414 [07:59<07:29,  2.31s/it]
Eval test_u:  53%|█████▎    | 220/414 [08:01<07:30,  2.32s/it]
Eval test_u:  53%|█████▎    | 221/414 [08:03<07:19,  2.27s/it]
Eval test_u:  54%|█████▎    | 222/414 [08:06<07:20,  2.29s/it]
Eval test_u:  54%|█████▍    | 223/414 [08:09<07:44,  2.43s/it]
Eval test_u:  54%|█████▍    | 224/414 [08:11<07:37,  2.41s/it]
Eval test_u:  54%|█████▍    | 225/414 [08:13<07:27,  2.37s/it]
Eval test_u:  55%|█████▍    | 226/414 [08:15<07:12,  2.30s/it]
Eval test_u:  55%|█████▍    | 227/414 [08:18<07:38,  2.45s/it]
Eval test_u:  55%|█████▌    | 228/414 [08:20<07:05,  2.29s/it]
Eval test_u:  55%|█████▌    | 229/414 [08:22<06:46,  2.20s/it]
Eval test_u:  56%|█████▌    | 230/414 [08:24<06:27,  2.10s/it]
Eval test_u:  56%|█████▌    | 231/414 [08:26<06:13,  2.04s/it]
Eval test_u:  56%|█████▌    | 232/414 [08:28<06:05,  2.01s/it]
Eval test_u:  56%|█████▋    | 233/414 [08:30<05:57,  1.98s/it]
Eval test_u:  57%|█████▋    | 234/414 [08:31<05:47,  1.93s/it]
Eval test_u:  57%|█████▋    | 235/414 [08:33<05:40,  1.90s/it]
Eval test_u:  57%|█████▋    | 236/414 [08:35<05:40,  1.91s/it]
Eval test_u:  57%|█████▋    | 237/414 [08:37<05:35,  1.89s/it]
Eval test_u:  57%|█████▋    | 238/414 [08:39<05:33,  1.89s/it]
Eval test_u:  58%|█████▊    | 239/414 [08:41<05:28,  1.88s/it]
Eval test_u:  58%|█████▊    | 240/414 [08:43<05:29,  1.89s/it]
Eval test_u:  58%|█████▊    | 241/414 [08:45<05:25,  1.88s/it]
Eval test_u:  58%|█████▊    | 242/414 [08:46<05:21,  1.87s/it]
Eval test_u:  59%|█████▊    | 243/414 [08:48<05:22,  1.89s/it]
Eval test_u:  59%|█████▉    | 244/414 [08:50<05:22,  1.90s/it]
Eval test_u:  59%|█████▉    | 245/414 [08:53<05:39,  2.01s/it]
Eval test_u:  59%|█████▉    | 246/414 [08:55<05:52,  2.10s/it]
Eval test_u:  60%|█████▉    | 247/414 [08:58<06:26,  2.31s/it]
Eval test_u:  60%|█████▉    | 248/414 [09:00<06:13,  2.25s/it]
Eval test_u:  60%|██████    | 249/414 [09:02<05:52,  2.14s/it]
Eval test_u:  60%|██████    | 250/414 [09:04<05:39,  2.07s/it]
Eval test_u:  61%|██████    | 251/414 [09:05<05:28,  2.01s/it]
Eval test_u:  61%|██████    | 252/414 [09:07<05:22,  1.99s/it]
Eval test_u:  61%|██████    | 253/414 [09:09<05:14,  1.96s/it]
Eval test_u:  61%|██████▏   | 254/414 [09:11<05:21,  2.01s/it]
Eval test_u:  62%|██████▏   | 255/414 [09:14<05:49,  2.20s/it]
Eval test_u:  62%|██████▏   | 256/414 [09:16<05:44,  2.18s/it]
Eval test_u:  62%|██████▏   | 257/414 [09:18<05:44,  2.19s/it]
Eval test_u:  62%|██████▏   | 258/414 [09:21<05:46,  2.22s/it]
Eval test_u:  63%|██████▎   | 259/414 [09:23<05:47,  2.24s/it]
Eval test_u:  63%|██████▎   | 260/414 [09:25<05:52,  2.29s/it]
Eval test_u:  63%|██████▎   | 261/414 [09:28<05:54,  2.32s/it]
Eval test_u:  63%|██████▎   | 262/414 [09:30<05:54,  2.33s/it]
Eval test_u:  64%|██████▎   | 263/414 [09:32<05:53,  2.34s/it]
Eval test_u:  64%|██████▍   | 264/414 [09:35<05:56,  2.37s/it]
Eval test_u:  64%|██████▍   | 265/414 [09:37<05:50,  2.35s/it]
Eval test_u:  64%|██████▍   | 266/414 [09:40<05:44,  2.33s/it]
Eval test_u:  64%|██████▍   | 267/414 [09:42<06:00,  2.45s/it]
Eval test_u:  65%|██████▍   | 268/414 [09:45<05:53,  2.42s/it]
Eval test_u:  65%|██████▍   | 269/414 [09:47<05:45,  2.39s/it]
Eval test_u:  65%|██████▌   | 270/414 [09:49<05:21,  2.23s/it]
Eval test_u:  65%|██████▌   | 271/414 [09:51<05:24,  2.27s/it]
Eval test_u:  66%|██████▌   | 272/414 [09:54<05:30,  2.32s/it]
Eval test_u:  66%|██████▌   | 273/414 [09:56<05:27,  2.32s/it]
Eval test_u:  66%|██████▌   | 274/414 [09:58<05:05,  2.18s/it]
Eval test_u:  66%|██████▋   | 275/414 [10:00<04:49,  2.08s/it]
Eval test_u:  67%|██████▋   | 276/414 [10:02<05:02,  2.19s/it]
Eval test_u:  67%|██████▋   | 277/414 [10:04<05:02,  2.21s/it]
Eval test_u:  67%|██████▋   | 278/414 [10:06<04:47,  2.11s/it]
Eval test_u:  67%|██████▋   | 279/414 [10:09<05:01,  2.23s/it]
Eval test_u:  68%|██████▊   | 280/414 [10:11<05:06,  2.29s/it]
Eval test_u:  68%|██████▊   | 281/414 [10:13<04:44,  2.14s/it]
Eval test_u:  68%|██████▊   | 282/414 [10:15<04:41,  2.13s/it]
Eval test_u:  68%|██████▊   | 283/414 [10:18<04:57,  2.27s/it]
Eval test_u:  69%|██████▊   | 284/414 [10:20<04:54,  2.26s/it]
Eval test_u:  69%|██████▉   | 285/414 [10:22<04:55,  2.29s/it]
Eval test_u:  69%|██████▉   | 286/414 [10:25<04:54,  2.30s/it]
Eval test_u:  69%|██████▉   | 287/414 [10:27<05:10,  2.44s/it]
Eval test_u:  70%|██████▉   | 288/414 [10:29<04:55,  2.35s/it]
Eval test_u:  70%|██████▉   | 289/414 [10:31<04:35,  2.20s/it]
Eval test_u:  70%|███████   | 290/414 [10:33<04:21,  2.11s/it]
Eval test_u:  70%|███████   | 291/414 [10:35<04:24,  2.15s/it]
Eval test_u:  71%|███████   | 292/414 [10:38<04:32,  2.24s/it]
Eval test_u:  71%|███████   | 293/414 [10:40<04:18,  2.13s/it]
Eval test_u:  71%|███████   | 294/414 [10:42<04:06,  2.05s/it]
Eval test_u:  71%|███████▏  | 295/414 [10:44<04:18,  2.18s/it]
Eval test_u:  71%|███████▏  | 296/414 [10:46<04:23,  2.24s/it]
Eval test_u:  72%|███████▏  | 297/414 [10:49<04:22,  2.24s/it]
Eval test_u:  72%|███████▏  | 298/414 [10:51<04:09,  2.15s/it]
Eval test_u:  72%|███████▏  | 299/414 [10:53<04:19,  2.26s/it]
Eval test_u:  72%|███████▏  | 300/414 [10:55<04:19,  2.27s/it]
Eval test_u:  73%|███████▎  | 301/414 [10:58<04:18,  2.28s/it]
Eval test_u:  73%|███████▎  | 302/414 [11:00<04:17,  2.30s/it]
Eval test_u:  73%|███████▎  | 303/414 [11:03<04:32,  2.45s/it]
Eval test_u:  73%|███████▎  | 304/414 [11:05<04:15,  2.32s/it]
Eval test_u:  74%|███████▎  | 305/414 [11:07<04:03,  2.24s/it]
Eval test_u:  74%|███████▍  | 306/414 [11:09<04:03,  2.26s/it]
Eval test_u:  74%|███████▍  | 307/414 [11:12<04:16,  2.40s/it]
Eval test_u:  74%|███████▍  | 308/414 [11:14<04:04,  2.31s/it]
Eval test_u:  75%|███████▍  | 309/414 [11:16<03:58,  2.27s/it]
Eval test_u:  75%|███████▍  | 310/414 [11:19<03:58,  2.29s/it]
Eval test_u:  75%|███████▌  | 311/414 [11:21<04:00,  2.33s/it]
Eval test_u:  75%|███████▌  | 312/414 [11:24<04:06,  2.42s/it]
Eval test_u:  76%|███████▌  | 313/414 [11:26<03:53,  2.31s/it]
Eval test_u:  76%|███████▌  | 314/414 [11:28<03:48,  2.28s/it]
Eval test_u:  76%|███████▌  | 315/414 [11:31<03:58,  2.41s/it]
Eval test_u:  76%|███████▋  | 316/414 [11:33<03:47,  2.32s/it]
Eval test_u:  77%|███████▋  | 317/414 [11:35<03:45,  2.32s/it]
Eval test_u:  77%|███████▋  | 318/414 [11:37<03:37,  2.27s/it]
Eval test_u:  77%|███████▋  | 319/414 [11:40<03:41,  2.33s/it]
Eval test_u:  77%|███████▋  | 320/414 [11:42<03:38,  2.33s/it]
Eval test_u:  78%|███████▊  | 321/414 [11:44<03:23,  2.18s/it]
Eval test_u:  78%|███████▊  | 322/414 [11:46<03:12,  2.09s/it]
Eval test_u:  78%|███████▊  | 323/414 [11:48<03:21,  2.21s/it]
Eval test_u:  78%|███████▊  | 324/414 [11:51<03:21,  2.24s/it]
Eval test_u:  79%|███████▊  | 325/414 [11:53<03:16,  2.21s/it]
Eval test_u:  79%|███████▊  | 326/414 [11:55<03:15,  2.23s/it]
Eval test_u:  79%|███████▉  | 327/414 [11:58<03:28,  2.40s/it]
Eval test_u:  79%|███████▉  | 328/414 [12:00<03:18,  2.30s/it]
Eval test_u:  79%|███████▉  | 329/414 [12:02<03:12,  2.27s/it]
Eval test_u:  80%|███████▉  | 330/414 [12:04<03:11,  2.28s/it]
Eval test_u:  80%|███████▉  | 331/414 [12:07<03:22,  2.44s/it]
Eval test_u:  80%|████████  | 332/414 [12:09<03:09,  2.32s/it]
Eval test_u:  80%|████████  | 333/414 [12:11<02:56,  2.18s/it]
Eval test_u:  81%|████████  | 334/414 [12:13<02:47,  2.10s/it]
Eval test_u:  81%|████████  | 335/414 [12:15<02:35,  1.96s/it]
Eval test_u:  81%|████████  | 336/414 [12:17<02:33,  1.97s/it]
Eval test_u:  81%|████████▏ | 337/414 [12:18<02:29,  1.94s/it]
Eval test_u:  82%|████████▏ | 338/414 [12:20<02:26,  1.93s/it]
Eval test_u:  82%|████████▏ | 339/414 [12:22<02:23,  1.91s/it]
Eval test_u:  82%|████████▏ | 340/414 [12:24<02:21,  1.91s/it]
Eval test_u:  82%|████████▏ | 341/414 [12:26<02:18,  1.90s/it]
Eval test_u:  83%|████████▎ | 342/414 [12:28<02:16,  1.89s/it]
Eval test_u:  83%|████████▎ | 343/414 [12:30<02:13,  1.89s/it]
Eval test_u:  83%|████████▎ | 344/414 [12:32<02:13,  1.91s/it]
Eval test_u:  83%|████████▎ | 345/414 [12:34<02:11,  1.90s/it]
Eval test_u:  84%|████████▎ | 346/414 [12:36<02:09,  1.90s/it]
Eval test_u:  84%|████████▍ | 347/414 [12:37<02:06,  1.89s/it]
Eval test_u:  84%|████████▍ | 348/414 [12:39<02:05,  1.90s/it]
Eval test_u:  84%|████████▍ | 349/414 [12:41<02:02,  1.89s/it]
Eval test_u:  85%|████████▍ | 350/414 [12:43<02:06,  1.98s/it]
Eval test_u:  85%|████████▍ | 351/414 [12:46<02:13,  2.11s/it]
Eval test_u:  85%|████████▌ | 352/414 [12:48<02:13,  2.15s/it]
Eval test_u:  85%|████████▌ | 353/414 [12:50<02:06,  2.07s/it]
Eval test_u:  86%|████████▌ | 354/414 [12:52<02:06,  2.11s/it]
Eval test_u:  86%|████████▌ | 355/414 [12:55<02:15,  2.30s/it]
Eval test_u:  86%|████████▌ | 356/414 [12:57<02:08,  2.22s/it]
Eval test_u:  86%|████████▌ | 357/414 [12:59<02:00,  2.12s/it]
Eval test_u:  86%|████████▋ | 358/414 [13:01<01:54,  2.05s/it]
Eval test_u:  87%|████████▋ | 359/414 [13:03<01:50,  2.01s/it]
Eval test_u:  87%|████████▋ | 360/414 [13:05<01:47,  2.00s/it]
Eval test_u:  87%|████████▋ | 361/414 [13:06<01:43,  1.96s/it]
Eval test_u:  87%|████████▋ | 362/414 [13:08<01:40,  1.93s/it]
Eval test_u:  88%|████████▊ | 363/414 [13:10<01:37,  1.91s/it]
Eval test_u:  88%|████████▊ | 364/414 [13:12<01:36,  1.93s/it]
Eval test_u:  88%|████████▊ | 365/414 [13:14<01:34,  1.92s/it]
Eval test_u:  88%|████████▊ | 366/414 [13:16<01:31,  1.91s/it]
Eval test_u:  89%|████████▊ | 367/414 [13:18<01:29,  1.91s/it]
Eval test_u:  89%|████████▉ | 368/414 [13:20<01:27,  1.91s/it]
Eval test_u:  89%|████████▉ | 369/414 [13:22<01:25,  1.90s/it]
Eval test_u:  89%|████████▉ | 370/414 [13:23<01:23,  1.89s/it]
Eval test_u:  90%|████████▉ | 371/414 [13:25<01:21,  1.89s/it]
Eval test_u:  90%|████████▉ | 372/414 [13:27<01:19,  1.90s/it]
Eval test_u:  90%|█████████ | 373/414 [13:29<01:20,  1.96s/it]
Eval test_u:  90%|█████████ | 374/414 [13:32<01:20,  2.01s/it]
Eval test_u:  91%|█████████ | 375/414 [13:34<01:27,  2.23s/it]
Eval test_u:  91%|█████████ | 376/414 [13:36<01:24,  2.22s/it]
Eval test_u:  91%|█████████ | 377/414 [13:39<01:21,  2.20s/it]
Eval test_u:  91%|█████████▏| 378/414 [13:40<01:15,  2.09s/it]
Eval test_u:  92%|█████████▏| 379/414 [13:43<01:18,  2.24s/it]
Eval test_u:  92%|█████████▏| 380/414 [13:45<01:15,  2.22s/it]
Eval test_u:  92%|█████████▏| 381/414 [13:47<01:09,  2.12s/it]
Eval test_u:  92%|█████████▏| 382/414 [13:49<01:05,  2.05s/it]
Eval test_u:  93%|█████████▎| 383/414 [13:51<01:02,  2.00s/it]
Eval test_u:  93%|█████████▎| 384/414 [13:53<00:59,  1.97s/it]
Eval test_u:  93%|█████████▎| 385/414 [13:54<00:51,  1.78s/it]
Eval test_u:  93%|█████████▎| 386/414 [13:56<00:50,  1.80s/it]
Eval test_u:  93%|█████████▎| 387/414 [13:58<00:49,  1.82s/it]
Eval test_u:  94%|█████████▎| 388/414 [14:00<00:48,  1.85s/it]
Eval test_u:  94%|█████████▍| 389/414 [14:02<00:46,  1.85s/it]
Eval test_u:  94%|█████████▍| 390/414 [14:03<00:44,  1.85s/it]
Eval test_u:  94%|█████████▍| 391/414 [14:05<00:42,  1.86s/it]
Eval test_u:  95%|█████████▍| 392/414 [14:07<00:41,  1.88s/it]
Eval test_u:  95%|█████████▍| 393/414 [14:09<00:39,  1.88s/it]
Eval test_u:  95%|█████████▌| 394/414 [14:11<00:37,  1.88s/it]
Eval test_u:  95%|█████████▌| 395/414 [14:13<00:34,  1.83s/it]
Eval test_u:  96%|█████████▌| 396/414 [14:15<00:33,  1.86s/it]
Eval test_u:  96%|█████████▌| 397/414 [14:17<00:31,  1.87s/it]
Eval test_u:  96%|█████████▌| 398/414 [14:18<00:29,  1.86s/it]
Eval test_u:  96%|█████████▋| 399/414 [14:20<00:27,  1.86s/it]
Eval test_u:  97%|█████████▋| 400/414 [14:22<00:26,  1.90s/it]
Eval test_u:  97%|█████████▋| 401/414 [14:24<00:24,  1.90s/it]
Eval test_u:  97%|█████████▋| 402/414 [14:26<00:22,  1.90s/it]
Eval test_u:  97%|█████████▋| 403/414 [14:28<00:20,  1.89s/it]
Eval test_u:  98%|█████████▊| 404/414 [14:30<00:18,  1.90s/it]
Eval test_u:  98%|█████████▊| 405/414 [14:32<00:17,  1.89s/it]
Eval test_u:  98%|█████████▊| 406/414 [14:34<00:15,  1.88s/it]
Eval test_u:  98%|█████████▊| 407/414 [14:36<00:14,  2.02s/it]
Eval test_u:  99%|█████████▊| 408/414 [14:38<00:12,  2.09s/it]
Eval test_u:  99%|█████████▉| 409/414 [14:40<00:09,  1.96s/it]
Eval test_u:  99%|█████████▉| 410/414 [14:41<00:07,  1.87s/it]
Eval test_u:  99%|█████████▉| 411/414 [14:43<00:05,  1.81s/it]
Eval test_u: 100%|█████████▉| 412/414 [14:45<00:03,  1.78s/it]
Eval test_u: 100%|█████████▉| 413/414 [14:47<00:01,  1.74s/it]
Eval test_u: 100%|██████████| 414/414 [14:48<00:00,  1.72s/it]
                                                              
  [test_u]  mIoU=0.6792  F=0.7772

Eval test_n:   0%|          | 0/257 [00:00<?, ?it/s]
Eval test_n:   0%|          | 1/257 [00:18<1:19:01, 18.52s/it]
Eval test_n:   1%|          | 2/257 [00:19<33:36,  7.91s/it]  
Eval test_n:   1%|          | 3/257 [00:19<19:12,  4.54s/it]
Eval test_n:   2%|▏         | 4/257 [00:20<13:27,  3.19s/it]
Eval test_n:   2%|▏         | 5/257 [00:21<09:33,  2.28s/it]
Eval test_n:   2%|▏         | 6/257 [00:21<06:59,  1.67s/it]
Eval test_n:   3%|▎         | 7/257 [00:22<05:21,  1.29s/it]
Eval test_n:   3%|▎         | 8/257 [00:23<04:34,  1.10s/it]
Eval test_n:   4%|▎         | 9/257 [00:24<04:33,  1.10s/it]
Eval test_n:   4%|▍         | 10/257 [00:24<03:46,  1.09it/s]
Eval test_n:   4%|▍         | 11/257 [00:25<03:14,  1.26it/s]
Eval test_n:   5%|▍         | 12/257 [00:26<03:24,  1.20it/s]
Eval test_n:   5%|▌         | 13/257 [00:27<03:33,  1.15it/s]
Eval test_n:   5%|▌         | 14/257 [00:27<03:04,  1.31it/s]
Eval test_n:   6%|▌         | 15/257 [00:28<02:45,  1.47it/s]
Eval test_n:   6%|▌         | 16/257 [00:28<02:39,  1.51it/s]
Eval test_n:   7%|▋         | 17/257 [00:29<02:42,  1.48it/s]
Eval test_n:   7%|▋         | 18/257 [00:30<02:58,  1.34it/s]
Eval test_n:   7%|▋         | 19/257 [00:30<02:38,  1.50it/s]
Eval test_n:   8%|▊         | 20/257 [00:31<02:26,  1.62it/s]
Eval test_n:   8%|▊         | 21/257 [00:32<03:10,  1.24it/s]
Eval test_n:   9%|▊         | 22/257 [00:33<02:54,  1.35it/s]
Eval test_n:   9%|▉         | 23/257 [00:33<02:34,  1.52it/s]
Eval test_n:   9%|▉         | 24/257 [00:34<02:34,  1.51it/s]
Eval test_n:  10%|▉         | 25/257 [00:35<03:26,  1.12it/s]
Eval test_n:  10%|█         | 26/257 [00:36<03:03,  1.26it/s]
Eval test_n:  11%|█         | 27/257 [00:37<03:22,  1.14it/s]
Eval test_n:  11%|█         | 28/257 [00:38<03:10,  1.20it/s]
Eval test_n:  11%|█▏        | 29/257 [00:38<03:15,  1.17it/s]
Eval test_n:  12%|█▏        | 30/257 [00:39<03:18,  1.14it/s]
Eval test_n:  12%|█▏        | 31/257 [00:40<02:51,  1.32it/s]
Eval test_n:  12%|█▏        | 32/257 [00:40<02:32,  1.48it/s]
Eval test_n:  13%|█▎        | 33/257 [00:41<02:46,  1.35it/s]
Eval test_n:  13%|█▎        | 34/257 [00:42<02:53,  1.28it/s]
Eval test_n:  14%|█▎        | 35/257 [00:43<02:45,  1.34it/s]
Eval test_n:  14%|█▍        | 36/257 [00:44<02:52,  1.28it/s]
Eval test_n:  14%|█▍        | 37/257 [00:45<03:13,  1.14it/s]
Eval test_n:  15%|█▍        | 38/257 [00:45<03:06,  1.17it/s]
Eval test_n:  15%|█▌        | 39/257 [00:46<02:51,  1.27it/s]
Eval test_n:  16%|█▌        | 40/257 [00:47<03:10,  1.14it/s]
Eval test_n:  16%|█▌        | 41/257 [00:48<02:44,  1.31it/s]
Eval test_n:  16%|█▋        | 42/257 [00:48<02:26,  1.47it/s]
Eval test_n:  17%|█▋        | 43/257 [00:49<02:41,  1.32it/s]
Eval test_n:  17%|█▋        | 44/257 [00:50<02:34,  1.38it/s]
Eval test_n:  18%|█▊        | 45/257 [00:50<02:29,  1.41it/s]
Eval test_n:  18%|█▊        | 46/257 [00:51<02:27,  1.43it/s]
Eval test_n:  18%|█▊        | 47/257 [00:52<02:25,  1.44it/s]
Eval test_n:  19%|█▊        | 48/257 [00:53<02:24,  1.44it/s]
Eval test_n:  19%|█▉        | 49/257 [00:53<02:23,  1.45it/s]
Eval test_n:  19%|█▉        | 50/257 [00:54<02:27,  1.41it/s]
Eval test_n:  20%|█▉        | 51/257 [00:55<02:25,  1.42it/s]
Eval test_n:  20%|██        | 52/257 [00:55<02:22,  1.44it/s]
Eval test_n:  21%|██        | 53/257 [00:56<02:21,  1.45it/s]
Eval test_n:  21%|██        | 54/257 [00:57<02:21,  1.44it/s]
Eval test_n:  21%|██▏       | 55/257 [00:57<02:06,  1.59it/s]
Eval test_n:  22%|██▏       | 56/257 [00:58<01:57,  1.70it/s]
Eval test_n:  22%|██▏       | 57/257 [00:58<01:51,  1.79it/s]
Eval test_n:  23%|██▎       | 58/257 [00:59<02:09,  1.54it/s]
Eval test_n:  23%|██▎       | 59/257 [01:04<06:17,  1.91s/it]
Eval test_n:  23%|██▎       | 60/257 [01:04<04:50,  1.47s/it]
Eval test_n:  24%|██▎       | 61/257 [01:05<03:49,  1.17s/it]
Eval test_n:  24%|██▍       | 62/257 [01:05<03:09,  1.03it/s]
Eval test_n:  25%|██▍       | 63/257 [01:06<03:09,  1.02it/s]
Eval test_n:  25%|██▍       | 64/257 [01:07<02:39,  1.21it/s]
Eval test_n:  25%|██▌       | 65/257 [01:08<02:41,  1.19it/s]
Eval test_n:  26%|██▌       | 66/257 [01:09<02:45,  1.15it/s]
Eval test_n:  26%|██▌       | 67/257 [01:09<02:23,  1.32it/s]
Eval test_n:  26%|██▋       | 68/257 [01:10<02:07,  1.49it/s]
Eval test_n:  27%|██▋       | 69/257 [01:10<01:56,  1.62it/s]
Eval test_n:  27%|██▋       | 70/257 [01:11<02:12,  1.41it/s]
Eval test_n:  28%|██▊       | 71/257 [01:12<02:20,  1.32it/s]
Eval test_n:  28%|██▊       | 72/257 [01:12<02:03,  1.49it/s]
Eval test_n:  28%|██▊       | 73/257 [01:13<01:52,  1.64it/s]
Eval test_n:  29%|██▉       | 74/257 [01:14<02:14,  1.36it/s]
Eval test_n:  29%|██▉       | 75/257 [01:14<02:10,  1.40it/s]
Eval test_n:  30%|██▉       | 76/257 [01:15<01:56,  1.56it/s]
Eval test_n:  30%|██▉       | 77/257 [01:15<01:47,  1.67it/s]
Eval test_n:  30%|███       | 78/257 [01:16<02:07,  1.40it/s]
Eval test_n:  31%|███       | 79/257 [01:17<01:54,  1.55it/s]
Eval test_n:  31%|███       | 80/257 [01:17<01:46,  1.66it/s]
Eval test_n:  32%|███▏      | 81/257 [01:18<02:02,  1.44it/s]
Eval test_n:  32%|███▏      | 82/257 [01:22<04:45,  1.63s/it]
Eval test_n:  32%|███▏      | 83/257 [01:23<03:43,  1.28s/it]
Eval test_n:  33%|███▎      | 84/257 [01:23<03:00,  1.04s/it]
Eval test_n:  33%|███▎      | 85/257 [01:24<02:30,  1.14it/s]
Eval test_n:  33%|███▎      | 86/257 [01:26<03:38,  1.28s/it]
Eval test_n:  34%|███▍      | 87/257 [01:27<03:17,  1.16s/it]
Eval test_n:  34%|███▍      | 88/257 [01:27<02:40,  1.05it/s]
Eval test_n:  35%|███▍      | 89/257 [01:28<02:22,  1.18it/s]
Eval test_n:  35%|███▌      | 90/257 [01:28<02:02,  1.36it/s]
Eval test_n:  35%|███▌      | 91/257 [01:29<01:59,  1.39it/s]
Eval test_n:  36%|███▌      | 92/257 [01:29<01:47,  1.54it/s]
Eval test_n:  36%|███▌      | 93/257 [01:30<02:08,  1.28it/s]
Eval test_n:  37%|███▋      | 94/257 [01:31<01:52,  1.44it/s]
Eval test_n:  37%|███▋      | 95/257 [01:31<01:41,  1.59it/s]
Eval test_n:  37%|███▋      | 96/257 [01:32<01:34,  1.71it/s]
Eval test_n:  38%|███▊      | 97/257 [01:33<01:58,  1.35it/s]
Eval test_n:  38%|███▊      | 98/257 [01:34<01:53,  1.40it/s]
Eval test_n:  39%|███▊      | 99/257 [01:34<01:42,  1.53it/s]
Eval test_n:  39%|███▉      | 100/257 [01:35<01:53,  1.39it/s]
Eval test_n:  39%|███▉      | 101/257 [01:36<01:51,  1.40it/s]
Eval test_n:  40%|███▉      | 102/257 [01:36<01:50,  1.40it/s]
Eval test_n:  40%|████      | 103/257 [01:37<01:49,  1.41it/s]
Eval test_n:  40%|████      | 104/257 [01:38<01:38,  1.55it/s]
Eval test_n:  41%|████      | 105/257 [01:38<01:46,  1.43it/s]
Eval test_n:  41%|████      | 106/257 [01:39<01:39,  1.51it/s]
Eval test_n:  42%|████▏     | 107/257 [01:40<01:41,  1.47it/s]
Eval test_n:  42%|████▏     | 108/257 [01:40<01:42,  1.45it/s]
Eval test_n:  42%|████▏     | 109/257 [01:41<01:38,  1.50it/s]
Eval test_n:  43%|████▎     | 110/257 [01:42<01:29,  1.64it/s]
Eval test_n:  43%|████▎     | 111/257 [01:43<01:50,  1.32it/s]
Eval test_n:  44%|████▎     | 112/257 [01:43<01:38,  1.48it/s]
Eval test_n:  44%|████▍     | 113/257 [01:44<01:35,  1.51it/s]
Eval test_n:  44%|████▍     | 114/257 [01:44<01:27,  1.64it/s]
Eval test_n:  45%|████▍     | 115/257 [01:45<01:43,  1.37it/s]
Eval test_n:  45%|████▌     | 116/257 [01:46<01:32,  1.52it/s]
Eval test_n:  46%|████▌     | 117/257 [01:46<01:34,  1.49it/s]
Eval test_n:  46%|████▌     | 118/257 [01:47<01:35,  1.46it/s]
Eval test_n:  46%|████▋     | 119/257 [01:48<01:43,  1.33it/s]
Eval test_n:  47%|████▋     | 120/257 [01:49<01:32,  1.48it/s]
Eval test_n:  47%|████▋     | 121/257 [01:49<01:33,  1.46it/s]
Eval test_n:  47%|████▋     | 122/257 [01:50<01:24,  1.59it/s]
Eval test_n:  48%|████▊     | 123/257 [01:51<01:40,  1.34it/s]
Eval test_n:  48%|████▊     | 124/257 [01:51<01:28,  1.49it/s]
Eval test_n:  49%|████▊     | 125/257 [01:52<01:21,  1.62it/s]
Eval test_n:  49%|████▉     | 126/257 [01:53<01:24,  1.55it/s]
Eval test_n:  49%|████▉     | 127/257 [01:53<01:33,  1.39it/s]
Eval test_n:  50%|████▉     | 128/257 [01:54<01:32,  1.40it/s]
Eval test_n:  50%|█████     | 129/257 [01:55<01:22,  1.56it/s]
Eval test_n:  51%|█████     | 130/257 [01:56<01:39,  1.28it/s]
Eval test_n:  51%|█████     | 131/257 [01:56<01:26,  1.45it/s]
Eval test_n:  51%|█████▏    | 132/257 [01:57<01:17,  1.60it/s]
Eval test_n:  52%|█████▏    | 133/257 [01:57<01:23,  1.49it/s]
Eval test_n:  52%|█████▏    | 134/257 [01:58<01:22,  1.49it/s]
Eval test_n:  53%|█████▎    | 135/257 [01:59<01:20,  1.52it/s]
Eval test_n:  53%|█████▎    | 136/257 [01:59<01:20,  1.49it/s]
Eval test_n:  53%|█████▎    | 137/257 [02:00<01:20,  1.49it/s]
Eval test_n:  54%|█████▎    | 138/257 [02:01<01:27,  1.37it/s]
Eval test_n:  54%|█████▍    | 139/257 [02:01<01:17,  1.52it/s]
Eval test_n:  54%|█████▍    | 140/257 [02:02<01:10,  1.65it/s]
Eval test_n:  55%|█████▍    | 141/257 [02:03<01:13,  1.59it/s]
Eval test_n:  55%|█████▌    | 142/257 [02:04<01:25,  1.34it/s]
Eval test_n:  56%|█████▌    | 143/257 [02:04<01:15,  1.51it/s]
Eval test_n:  56%|█████▌    | 144/257 [02:05<01:08,  1.64it/s]
Eval test_n:  56%|█████▋    | 145/257 [02:05<01:11,  1.57it/s]
Eval test_n:  57%|█████▋    | 146/257 [02:06<01:09,  1.61it/s]
Eval test_n:  57%|█████▋    | 147/257 [02:07<01:15,  1.46it/s]
Eval test_n:  58%|█████▊    | 148/257 [02:07<01:07,  1.61it/s]
Eval test_n:  58%|█████▊    | 149/257 [02:08<01:09,  1.56it/s]
Eval test_n:  58%|█████▊    | 150/257 [02:09<01:10,  1.51it/s]
Eval test_n:  59%|█████▉    | 151/257 [02:10<01:21,  1.30it/s]
Eval test_n:  59%|█████▉    | 152/257 [02:10<01:19,  1.32it/s]
Eval test_n:  60%|█████▉    | 153/257 [02:11<01:24,  1.24it/s]
Eval test_n:  60%|█████▉    | 154/257 [02:13<01:41,  1.01it/s]
Eval test_n:  60%|██████    | 155/257 [02:13<01:31,  1.12it/s]
Eval test_n:  61%|██████    | 156/257 [02:15<01:48,  1.08s/it]
Eval test_n:  61%|██████    | 157/257 [02:15<01:34,  1.06it/s]
Eval test_n:  61%|██████▏   | 158/257 [02:16<01:29,  1.10it/s]
Eval test_n:  62%|██████▏   | 159/257 [02:17<01:32,  1.06it/s]
Eval test_n:  62%|██████▏   | 160/257 [02:18<01:23,  1.16it/s]
Eval test_n:  63%|██████▎   | 161/257 [02:19<01:19,  1.21it/s]
Eval test_n:  63%|██████▎   | 162/257 [02:19<01:14,  1.28it/s]
Eval test_n:  63%|██████▎   | 163/257 [02:20<01:15,  1.25it/s]
Eval test_n:  64%|██████▍   | 164/257 [02:21<01:20,  1.15it/s]
Eval test_n:  64%|██████▍   | 165/257 [02:22<01:13,  1.25it/s]
Eval test_n:  65%|██████▍   | 166/257 [02:22<01:03,  1.43it/s]
Eval test_n:  65%|██████▍   | 167/257 [02:23<01:08,  1.31it/s]
Eval test_n:  65%|██████▌   | 168/257 [02:24<01:13,  1.20it/s]
Eval test_n:  66%|██████▌   | 169/257 [02:25<01:09,  1.27it/s]
Eval test_n:  66%|██████▌   | 170/257 [02:25<01:00,  1.44it/s]
Eval test_n:  67%|██████▋   | 171/257 [02:26<01:04,  1.34it/s]
Eval test_n:  67%|██████▋   | 172/257 [02:27<01:02,  1.35it/s]
Eval test_n:  67%|██████▋   | 173/257 [02:28<01:01,  1.37it/s]
Eval test_n:  68%|██████▊   | 174/257 [02:28<01:00,  1.38it/s]
Eval test_n:  68%|██████▊   | 175/257 [02:29<00:59,  1.38it/s]
Eval test_n:  68%|██████▊   | 176/257 [02:30<01:02,  1.29it/s]
Eval test_n:  69%|██████▉   | 177/257 [02:31<01:05,  1.22it/s]
Eval test_n:  69%|██████▉   | 178/257 [02:32<01:00,  1.30it/s]
Eval test_n:  70%|██████▉   | 179/257 [02:33<01:02,  1.25it/s]
Eval test_n:  70%|███████   | 180/257 [02:34<01:10,  1.10it/s]
Eval test_n:  70%|███████   | 181/257 [02:35<01:07,  1.12it/s]
Eval test_n:  71%|███████   | 182/257 [02:35<00:57,  1.30it/s]
Eval test_n:  71%|███████   | 183/257 [02:36<00:50,  1.47it/s]
Eval test_n:  72%|███████▏  | 184/257 [02:37<00:59,  1.22it/s]
Eval test_n:  72%|███████▏  | 185/257 [02:38<01:00,  1.19it/s]
Eval test_n:  72%|███████▏  | 186/257 [02:39<01:02,  1.13it/s]
Eval test_n:  73%|███████▎  | 187/257 [02:39<00:58,  1.20it/s]
Eval test_n:  73%|███████▎  | 188/257 [02:40<00:49,  1.38it/s]
Eval test_n:  74%|███████▎  | 189/257 [02:40<00:43,  1.55it/s]
Eval test_n:  74%|███████▍  | 190/257 [02:41<00:48,  1.39it/s]
Eval test_n:  74%|███████▍  | 191/257 [02:42<00:47,  1.39it/s]
Eval test_n:  75%|███████▍  | 192/257 [02:42<00:41,  1.55it/s]
Eval test_n:  75%|███████▌  | 193/257 [02:43<00:42,  1.52it/s]
Eval test_n:  75%|███████▌  | 194/257 [02:44<00:46,  1.35it/s]
Eval test_n:  76%|███████▌  | 195/257 [02:45<00:45,  1.37it/s]
Eval test_n:  76%|███████▋  | 196/257 [02:45<00:40,  1.52it/s]
Eval test_n:  77%|███████▋  | 197/257 [02:46<00:36,  1.66it/s]
Eval test_n:  77%|███████▋  | 198/257 [02:46<00:36,  1.62it/s]
Eval test_n:  77%|███████▋  | 199/257 [02:47<00:40,  1.43it/s]
Eval test_n:  78%|███████▊  | 200/257 [02:48<00:39,  1.44it/s]
Eval test_n:  78%|███████▊  | 201/257 [02:48<00:37,  1.48it/s]
Eval test_n:  79%|███████▊  | 202/257 [02:49<00:33,  1.63it/s]
Eval test_n:  79%|███████▉  | 203/257 [02:50<00:41,  1.30it/s]
Eval test_n:  79%|███████▉  | 204/257 [02:50<00:35,  1.48it/s]
Eval test_n:  80%|███████▉  | 205/257 [02:51<00:35,  1.48it/s]
Eval test_n:  80%|████████  | 206/257 [02:52<00:34,  1.47it/s]
Eval test_n:  81%|████████  | 207/257 [02:53<00:40,  1.24it/s]
Eval test_n:  81%|████████  | 208/257 [02:53<00:34,  1.41it/s]
Eval test_n:  81%|████████▏ | 209/257 [02:54<00:30,  1.58it/s]
Eval test_n:  82%|████████▏ | 210/257 [02:55<00:33,  1.40it/s]
Eval test_n:  82%|████████▏ | 211/257 [02:55<00:32,  1.43it/s]
Eval test_n:  82%|████████▏ | 212/257 [02:58<00:51,  1.15s/it]
Eval test_n:  83%|████████▎ | 213/257 [02:58<00:41,  1.05it/s]
Eval test_n:  83%|████████▎ | 214/257 [02:59<00:34,  1.23it/s]
Eval test_n:  84%|████████▎ | 215/257 [02:59<00:32,  1.29it/s]
Eval test_n:  84%|████████▍ | 216/257 [03:00<00:28,  1.46it/s]
Eval test_n:  84%|████████▍ | 217/257 [03:00<00:24,  1.62it/s]
Eval test_n:  85%|████████▍ | 218/257 [03:01<00:24,  1.57it/s]
Eval test_n:  85%|████████▌ | 219/257 [03:05<01:02,  1.64s/it]
Eval test_n:  86%|████████▌ | 220/257 [03:05<00:49,  1.33s/it]
Eval test_n:  86%|████████▌ | 221/257 [03:06<00:38,  1.07s/it]
Eval test_n:  86%|████████▋ | 222/257 [03:06<00:31,  1.12it/s]
Eval test_n:  87%|████████▋ | 223/257 [03:08<00:32,  1.05it/s]
Eval test_n:  87%|████████▋ | 224/257 [03:08<00:26,  1.24it/s]
Eval test_n:  88%|████████▊ | 225/257 [03:09<00:26,  1.20it/s]
Eval test_n:  88%|████████▊ | 226/257 [03:10<00:26,  1.18it/s]
Eval test_n:  88%|████████▊ | 227/257 [03:10<00:21,  1.36it/s]
Eval test_n:  89%|████████▊ | 228/257 [03:11<00:18,  1.54it/s]
Eval test_n:  89%|████████▉ | 229/257 [03:12<00:21,  1.29it/s]
Eval test_n:  89%|████████▉ | 230/257 [03:13<00:22,  1.19it/s]
Eval test_n:  90%|████████▉ | 231/257 [03:13<00:19,  1.35it/s]
Eval test_n:  90%|█████████ | 232/257 [03:14<00:16,  1.53it/s]
Eval test_n:  91%|█████████ | 233/257 [03:14<00:14,  1.65it/s]
Eval test_n:  91%|█████████ | 234/257 [03:15<00:17,  1.33it/s]
Eval test_n:  91%|█████████▏| 235/257 [03:16<00:16,  1.37it/s]
Eval test_n:  92%|█████████▏| 236/257 [03:16<00:13,  1.54it/s]
Eval test_n:  92%|█████████▏| 237/257 [03:17<00:12,  1.55it/s]
Eval test_n:  93%|█████████▎| 238/257 [03:18<00:14,  1.31it/s]
Eval test_n:  93%|█████████▎| 239/257 [03:19<00:13,  1.29it/s]
Eval test_n:  93%|█████████▎| 240/257 [03:20<00:12,  1.38it/s]
Eval test_n:  94%|█████████▍| 241/257 [03:20<00:10,  1.55it/s]
Eval test_n:  94%|█████████▍| 242/257 [03:21<00:09,  1.50it/s]
Eval test_n:  95%|█████████▍| 243/257 [03:22<00:12,  1.14it/s]
Eval test_n:  95%|█████████▍| 244/257 [03:23<00:09,  1.32it/s]
Eval test_n:  95%|█████████▌| 245/257 [03:23<00:08,  1.36it/s]
Eval test_n:  96%|█████████▌| 246/257 [03:24<00:07,  1.39it/s]
Eval test_n:  96%|█████████▌| 247/257 [03:25<00:07,  1.33it/s]
Eval test_n:  96%|█████████▋| 248/257 [03:25<00:06,  1.50it/s]
Eval test_n:  97%|█████████▋| 249/257 [03:26<00:05,  1.47it/s]
Eval test_n:  97%|█████████▋| 250/257 [03:27<00:05,  1.28it/s]
Eval test_n:  98%|█████████▊| 251/257 [03:28<00:04,  1.33it/s]
Eval test_n:  98%|█████████▊| 252/257 [03:29<00:04,  1.21it/s]
Eval test_n:  98%|█████████▊| 253/257 [03:30<00:03,  1.18it/s]
Eval test_n:  99%|█████████▉| 254/257 [03:30<00:02,  1.36it/s]
Eval test_n:  99%|█████████▉| 255/257 [03:30<00:01,  1.54it/s]
Eval test_n: 100%|█████████▉| 256/257 [03:31<00:00,  1.68it/s]
Eval test_n: 100%|██████████| 257/257 [03:31<00:00,  1.79it/s]
                                                              
  [test_n]  Null_S=0.0050  null_tp=42/1028  null_fn=986/1028

Epoch 3/5:   0%|          | 0/1177 [00:00<?, ?it/s]
Epoch 3/5:   0%|          | 0/1177 [00:29<?, ?it/s, exist=0.3256, loss=0.6063, lr=3.75e-05]
Epoch 3/5:   0%|          | 1/1177 [00:29<9:35:15, 29.35s/it, exist=0.3256, loss=0.6063, lr=3.75e-05]
Epoch 3/5:   0%|          | 1/1177 [00:32<9:35:15, 29.35s/it, exist=0.2918, loss=0.5700, lr=3.75e-05]
Epoch 3/5:   0%|          | 2/1177 [00:32<4:30:30, 13.81s/it, exist=0.2918, loss=0.5700, lr=3.75e-05]
Epoch 3/5:   0%|          | 2/1177 [00:35<4:30:30, 13.81s/it, exist=0.3320, loss=0.6101, lr=3.75e-05]
Epoch 3/5:   0%|          | 3/1177 [00:35<2:55:06,  8.95s/it, exist=0.3320, loss=0.6101, lr=3.75e-05]
Epoch 3/5:   0%|          | 3/1177 [00:38<2:55:06,  8.95s/it, exist=0.4066, loss=0.6928, lr=3.74e-05]
Epoch 3/5:   0%|          | 4/1177 [00:38<2:06:13,  6.46s/it, exist=0.4066, loss=0.6928, lr=3.74e-05]
Epoch 3/5:   0%|          | 4/1177 [00:40<2:06:13,  6.46s/it, exist=0.4256, loss=0.6948, lr=3.74e-05]
Epoch 3/5:   0%|          | 5/1177 [00:40<1:39:17,  5.08s/it, exist=0.4256, loss=0.6948, lr=3.74e-05]
Epoch 3/5:   0%|          | 5/1177 [00:43<1:39:17,  5.08s/it, exist=0.3897, loss=0.6452, lr=3.74e-05]
Epoch 3/5:   1%|          | 6/1177 [00:43<1:21:31,  4.18s/it, exist=0.3897, loss=0.6452, lr=3.74e-05]
Epoch 3/5:   1%|          | 6/1177 [00:45<1:21:31,  4.18s/it, exist=0.3966, loss=0.6517, lr=3.74e-05]
Epoch 3/5:   1%|          | 7/1177 [00:45<1:12:44,  3.73s/it, exist=0.3966, loss=0.6517, lr=3.74e-05]
Epoch 3/5:   1%|          | 7/1177 [00:50<1:12:44,  3.73s/it, exist=0.4328, loss=0.6977, lr=3.74e-05]
Epoch 3/5:   1%|          | 8/1177 [00:50<1:15:44,  3.89s/it, exist=0.4328, loss=0.6977, lr=3.74e-05]
Epoch 3/5:   1%|          | 8/1177 [00:52<1:15:44,  3.89s/it, exist=0.4175, loss=0.6857, lr=3.74e-05]
Epoch 3/5:   1%|          | 9/1177 [00:52<1:07:03,  3.44s/it, exist=0.4175, loss=0.6857, lr=3.74e-05]
Epoch 3/5:   1%|          | 9/1177 [00:55<1:07:03,  3.44s/it, exist=0.4284, loss=0.6879, lr=3.74e-05]
Epoch 3/5:   1%|          | 10/1177 [00:55<1:05:10,  3.35s/it, exist=0.4284, loss=0.6879, lr=3.74e-05]
Epoch 3/5:   1%|          | 10/1177 [00:58<1:05:10,  3.35s/it, exist=0.4041, loss=0.6566, lr=3.74e-05]
Epoch 3/5:   1%|          | 11/1177 [00:58<1:00:38,  3.12s/it, exist=0.4041, loss=0.6566, lr=3.74e-05]
Epoch 3/5:   1%|          | 11/1177 [01:00<1:00:38,  3.12s/it, exist=0.3836, loss=0.6322, lr=3.73e-05]
Epoch 3/5:   1%|          | 12/1177 [01:00<57:05,  2.94s/it, exist=0.3836, loss=0.6322, lr=3.73e-05]  
Epoch 3/5:   1%|          | 12/1177 [01:03<57:05,  2.94s/it, exist=0.3701, loss=0.6204, lr=3.73e-05]
Epoch 3/5:   1%|          | 13/1177 [01:03<53:21,  2.75s/it, exist=0.3701, loss=0.6204, lr=3.73e-05]
Epoch 3/5:   1%|          | 13/1177 [01:05<53:21,  2.75s/it, exist=0.3814, loss=0.6303, lr=3.73e-05]
Epoch 3/5:   1%|          | 14/1177 [01:05<52:29,  2.71s/it, exist=0.3814, loss=0.6303, lr=3.73e-05]
Epoch 3/5:   1%|          | 14/1177 [01:09<52:29,  2.71s/it, exist=0.3658, loss=0.6186, lr=3.73e-05]
Epoch 3/5:   1%|▏         | 15/1177 [01:09<58:31,  3.02s/it, exist=0.3658, loss=0.6186, lr=3.73e-05]
Epoch 3/5:   1%|▏         | 15/1177 [01:11<58:31,  3.02s/it, exist=0.3519, loss=0.6019, lr=3.73e-05]
Epoch 3/5:   1%|▏         | 16/1177 [01:11<52:44,  2.73s/it, exist=0.3519, loss=0.6019, lr=3.73e-05]
Epoch 3/5:   1%|▏         | 16/1177 [01:14<52:44,  2.73s/it, exist=0.3515, loss=0.5988, lr=3.73e-05]
Epoch 3/5:   1%|▏         | 17/1177 [01:14<52:37,  2.72s/it, exist=0.3515, loss=0.5988, lr=3.73e-05]
Epoch 3/5:   1%|▏         | 17/1177 [01:17<52:37,  2.72s/it, exist=0.3481, loss=0.5938, lr=3.73e-05]
Epoch 3/5:   2%|▏         | 18/1177 [01:17<55:53,  2.89s/it, exist=0.3481, loss=0.5938, lr=3.73e-05]
Epoch 3/5:   2%|▏         | 18/1177 [01:19<55:53,  2.89s/it, exist=0.3484, loss=0.5915, lr=3.73e-05]
Epoch 3/5:   2%|▏         | 19/1177 [01:19<50:24,  2.61s/it, exist=0.3484, loss=0.5915, lr=3.73e-05]
Epoch 3/5:   2%|▏         | 19/1177 [01:23<50:24,  2.61s/it, exist=0.3444, loss=0.5865, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 20/1177 [01:23<58:38,  3.04s/it, exist=0.3444, loss=0.5865, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 20/1177 [01:26<58:38,  3.04s/it, exist=0.3427, loss=0.5812, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 21/1177 [01:26<57:05,  2.96s/it, exist=0.3427, loss=0.5812, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 21/1177 [01:29<57:05,  2.96s/it, exist=0.3388, loss=0.5749, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 22/1177 [01:29<55:30,  2.88s/it, exist=0.3388, loss=0.5749, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 22/1177 [01:31<55:30,  2.88s/it, exist=0.3412, loss=0.5776, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 23/1177 [01:31<50:05,  2.60s/it, exist=0.3412, loss=0.5776, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 23/1177 [01:34<50:05,  2.60s/it, exist=0.3357, loss=0.5708, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 24/1177 [01:34<56:04,  2.92s/it, exist=0.3357, loss=0.5708, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 24/1177 [01:37<56:04,  2.92s/it, exist=0.3332, loss=0.5664, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 25/1177 [01:37<54:13,  2.82s/it, exist=0.3332, loss=0.5664, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 25/1177 [01:39<54:13,  2.82s/it, exist=0.3360, loss=0.5732, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 26/1177 [01:39<48:58,  2.55s/it, exist=0.3360, loss=0.5732, lr=3.72e-05]
Epoch 3/5:   2%|▏         | 26/1177 [01:41<48:58,  2.55s/it, exist=0.3365, loss=0.5746, lr=3.71e-05]
Epoch 3/5:   2%|▏         | 27/1177 [01:41<48:38,  2.54s/it, exist=0.3365, loss=0.5746, lr=3.71e-05]
Epoch 3/5:   2%|▏         | 27/1177 [01:45<48:38,  2.54s/it, exist=0.3490, loss=0.5872, lr=3.71e-05]
Epoch 3/5:   2%|▏         | 28/1177 [01:45<53:31,  2.79s/it, exist=0.3490, loss=0.5872, lr=3.71e-05]
Epoch 3/5:   2%|▏         | 28/1177 [01:48<53:31,  2.79s/it, exist=0.3478, loss=0.5854, lr=3.71e-05]
Epoch 3/5:   2%|▏         | 29/1177 [01:48<53:56,  2.82s/it, exist=0.3478, loss=0.5854, lr=3.71e-05]
Epoch 3/5:   2%|▏         | 29/1177 [01:50<53:56,  2.82s/it, exist=0.3432, loss=0.5798, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 30/1177 [01:50<53:42,  2.81s/it, exist=0.3432, loss=0.5798, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 30/1177 [01:52<53:42,  2.81s/it, exist=0.3567, loss=0.5939, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 31/1177 [01:52<48:30,  2.54s/it, exist=0.3567, loss=0.5939, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 31/1177 [01:56<48:30,  2.54s/it, exist=0.3528, loss=0.5958, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 32/1177 [01:56<54:09,  2.84s/it, exist=0.3528, loss=0.5958, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 32/1177 [01:58<54:09,  2.84s/it, exist=0.3551, loss=0.5981, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 33/1177 [01:58<52:44,  2.77s/it, exist=0.3551, loss=0.5981, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 33/1177 [02:00<52:44,  2.77s/it, exist=0.3507, loss=0.5944, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 34/1177 [02:00<47:59,  2.52s/it, exist=0.3507, loss=0.5944, lr=3.71e-05]
Epoch 3/5:   3%|▎         | 34/1177 [02:03<47:59,  2.52s/it, exist=0.3489, loss=0.5930, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 35/1177 [02:03<48:21,  2.54s/it, exist=0.3489, loss=0.5930, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 35/1177 [02:07<48:21,  2.54s/it, exist=0.3522, loss=0.5950, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 36/1177 [02:07<55:53,  2.94s/it, exist=0.3522, loss=0.5950, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 36/1177 [02:09<55:53,  2.94s/it, exist=0.3537, loss=0.5958, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 37/1177 [02:09<54:25,  2.86s/it, exist=0.3537, loss=0.5958, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 37/1177 [02:13<54:25,  2.86s/it, exist=0.3491, loss=0.5909, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 38/1177 [02:13<56:27,  2.97s/it, exist=0.3491, loss=0.5909, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 38/1177 [02:15<56:27,  2.97s/it, exist=0.3574, loss=0.6000, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 39/1177 [02:15<53:11,  2.80s/it, exist=0.3574, loss=0.6000, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 39/1177 [02:17<53:11,  2.80s/it, exist=0.3553, loss=0.5982, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 40/1177 [02:17<49:09,  2.59s/it, exist=0.3553, loss=0.5982, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 40/1177 [02:21<49:09,  2.59s/it, exist=0.3504, loss=0.5926, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 41/1177 [02:21<56:04,  2.96s/it, exist=0.3504, loss=0.5926, lr=3.70e-05]
Epoch 3/5:   3%|▎         | 41/1177 [02:24<56:04,  2.96s/it, exist=0.3471, loss=0.5899, lr=3.70e-05]
Epoch 3/5:   4%|▎         | 42/1177 [02:24<53:37,  2.84s/it, exist=0.3471, loss=0.5899, lr=3.70e-05]
Epoch 3/5:   4%|▎         | 42/1177 [02:27<53:37,  2.84s/it, exist=0.3476, loss=0.5892, lr=3.69e-05]
Epoch 3/5:   4%|▎         | 43/1177 [02:27<58:48,  3.11s/it, exist=0.3476, loss=0.5892, lr=3.69e-05]
Epoch 3/5:   4%|▎         | 43/1177 [02:29<58:48,  3.11s/it, exist=0.3478, loss=0.5896, lr=3.69e-05]
Epoch 3/5:   4%|▎         | 44/1177 [02:29<52:28,  2.78s/it, exist=0.3478, loss=0.5896, lr=3.69e-05]
Epoch 3/5:   4%|▎         | 44/1177 [02:32<52:28,  2.78s/it, exist=0.3489, loss=0.5916, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 45/1177 [02:32<52:21,  2.78s/it, exist=0.3489, loss=0.5916, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 45/1177 [02:34<52:21,  2.78s/it, exist=0.3429, loss=0.5869, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 46/1177 [02:34<47:53,  2.54s/it, exist=0.3429, loss=0.5869, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 46/1177 [02:36<47:53,  2.54s/it, exist=0.3421, loss=0.5917, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 47/1177 [02:36<44:24,  2.36s/it, exist=0.3421, loss=0.5917, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 47/1177 [02:39<44:24,  2.36s/it, exist=0.3427, loss=0.5945, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 48/1177 [02:39<48:29,  2.58s/it, exist=0.3427, loss=0.5945, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 48/1177 [02:42<48:29,  2.58s/it, exist=0.3433, loss=0.5967, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 49/1177 [02:42<48:54,  2.60s/it, exist=0.3433, loss=0.5967, lr=3.69e-05]
Epoch 3/5:   4%|▍         | 49/1177 [02:44<48:54,  2.60s/it, exist=0.3412, loss=0.5941, lr=3.68e-05]
Epoch 3/5:   4%|▍         | 50/1177 [02:44<45:13,  2.41s/it, exist=0.3412, loss=0.5941, lr=3.68e-05]
Epoch 3/5:   4%|▍         | 50/1177 [02:48<45:13,  2.41s/it, exist=0.3399, loss=0.5918, lr=3.68e-05]
Epoch 3/5:   4%|▍         | 51/1177 [02:48<55:26,  2.95s/it, exist=0.3399, loss=0.5918, lr=3.68e-05]
Epoch 3/5:   4%|▍         | 51/1177 [02:51<55:26,  2.95s/it, exist=0.3373, loss=0.5903, lr=3.68e-05]
Epoch 3/5:   4%|▍         | 52/1177 [02:51<54:53,  2.93s/it, exist=0.3373, loss=0.5903, lr=3.68e-05]
Epoch 3/5:   4%|▍         | 52/1177 [02:53<54:53,  2.93s/it, exist=0.3368, loss=0.5885, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 53/1177 [02:53<49:35,  2.65s/it, exist=0.3368, loss=0.5885, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 53/1177 [02:55<49:35,  2.65s/it, exist=0.3336, loss=0.5839, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 54/1177 [02:55<49:49,  2.66s/it, exist=0.3336, loss=0.5839, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 54/1177 [02:59<49:49,  2.66s/it, exist=0.3340, loss=0.5836, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 55/1177 [02:59<53:31,  2.86s/it, exist=0.3340, loss=0.5836, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 55/1177 [03:01<53:31,  2.86s/it, exist=0.3339, loss=0.5834, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 56/1177 [03:01<52:27,  2.81s/it, exist=0.3339, loss=0.5834, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 56/1177 [03:03<52:27,  2.81s/it, exist=0.3292, loss=0.5798, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 57/1177 [03:03<47:45,  2.56s/it, exist=0.3292, loss=0.5798, lr=3.68e-05]
Epoch 3/5:   5%|▍         | 57/1177 [03:06<47:45,  2.56s/it, exist=0.3260, loss=0.5756, lr=3.67e-05]
Epoch 3/5:   5%|▍         | 58/1177 [03:06<48:21,  2.59s/it, exist=0.3260, loss=0.5756, lr=3.67e-05]
Epoch 3/5:   5%|▍         | 58/1177 [03:09<48:21,  2.59s/it, exist=0.3243, loss=0.5732, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 59/1177 [03:09<51:18,  2.75s/it, exist=0.3243, loss=0.5732, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 59/1177 [03:12<51:18,  2.75s/it, exist=0.3300, loss=0.5789, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 60/1177 [03:12<50:22,  2.71s/it, exist=0.3300, loss=0.5789, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 60/1177 [03:14<50:22,  2.71s/it, exist=0.3267, loss=0.5760, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 61/1177 [03:14<46:21,  2.49s/it, exist=0.3267, loss=0.5760, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 61/1177 [03:17<46:21,  2.49s/it, exist=0.3306, loss=0.5796, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 62/1177 [03:17<47:15,  2.54s/it, exist=0.3306, loss=0.5796, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 62/1177 [03:19<47:15,  2.54s/it, exist=0.3274, loss=0.5797, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 63/1177 [03:19<46:31,  2.51s/it, exist=0.3274, loss=0.5797, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 63/1177 [03:22<46:31,  2.51s/it, exist=0.3251, loss=0.5778, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 64/1177 [03:22<47:15,  2.55s/it, exist=0.3251, loss=0.5778, lr=3.67e-05]
Epoch 3/5:   5%|▌         | 64/1177 [03:25<47:15,  2.55s/it, exist=0.3271, loss=0.5785, lr=3.67e-05]
Epoch 3/5:   6%|▌         | 65/1177 [03:25<51:16,  2.77s/it, exist=0.3271, loss=0.5785, lr=3.67e-05]
Epoch 3/5:   6%|▌         | 65/1177 [03:27<51:16,  2.77s/it, exist=0.3279, loss=0.5803, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 66/1177 [03:27<46:53,  2.53s/it, exist=0.3279, loss=0.5803, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 66/1177 [03:29<46:53,  2.53s/it, exist=0.3245, loss=0.5763, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 67/1177 [03:29<46:08,  2.49s/it, exist=0.3245, loss=0.5763, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 67/1177 [03:33<46:08,  2.49s/it, exist=0.3245, loss=0.5759, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 68/1177 [03:33<50:47,  2.75s/it, exist=0.3245, loss=0.5759, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 68/1177 [03:35<50:47,  2.75s/it, exist=0.3245, loss=0.5756, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 69/1177 [03:35<46:23,  2.51s/it, exist=0.3245, loss=0.5756, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 69/1177 [03:38<46:23,  2.51s/it, exist=0.3278, loss=0.5795, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 70/1177 [03:38<48:57,  2.65s/it, exist=0.3278, loss=0.5795, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 70/1177 [03:40<48:57,  2.65s/it, exist=0.3277, loss=0.5796, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 71/1177 [03:40<48:40,  2.64s/it, exist=0.3277, loss=0.5796, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 71/1177 [03:42<48:40,  2.64s/it, exist=0.3281, loss=0.5795, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 72/1177 [03:42<44:46,  2.43s/it, exist=0.3281, loss=0.5795, lr=3.66e-05]
Epoch 3/5:   6%|▌         | 72/1177 [03:45<44:46,  2.43s/it, exist=0.3257, loss=0.5769, lr=3.65e-05]
Epoch 3/5:   6%|▌         | 73/1177 [03:45<49:07,  2.67s/it, exist=0.3257, loss=0.5769, lr=3.65e-05]
Epoch 3/5:   6%|▌         | 73/1177 [03:47<49:07,  2.67s/it, exist=0.3223, loss=0.5735, lr=3.65e-05]
Epoch 3/5:   6%|▋         | 74/1177 [03:47<45:00,  2.45s/it, exist=0.3223, loss=0.5735, lr=3.65e-05]
Epoch 3/5:   6%|▋         | 74/1177 [03:50<45:00,  2.45s/it, exist=0.3278, loss=0.5808, lr=3.65e-05]
Epoch 3/5:   6%|▋         | 75/1177 [03:50<44:39,  2.43s/it, exist=0.3278, loss=0.5808, lr=3.65e-05]
Epoch 3/5:   6%|▋         | 75/1177 [03:52<44:39,  2.43s/it, exist=0.3259, loss=0.5783, lr=3.65e-05]
Epoch 3/5:   6%|▋         | 76/1177 [03:52<45:37,  2.49s/it, exist=0.3259, loss=0.5783, lr=3.65e-05]
Epoch 3/5:   6%|▋         | 76/1177 [03:56<45:37,  2.49s/it, exist=0.3243, loss=0.5765, lr=3.65e-05]
Epoch 3/5:   7%|▋         | 77/1177 [03:56<50:36,  2.76s/it, exist=0.3243, loss=0.5765, lr=3.65e-05]
Epoch 3/5:   7%|▋         | 77/1177 [03:58<50:36,  2.76s/it, exist=0.3258, loss=0.5784, lr=3.65e-05]
Epoch 3/5:   7%|▋         | 78/1177 [03:58<45:56,  2.51s/it, exist=0.3258, loss=0.5784, lr=3.65e-05]
Epoch 3/5:   7%|▋         | 78/1177 [04:01<45:56,  2.51s/it, exist=0.3229, loss=0.5753, lr=3.65e-05]
Epoch 3/5:   7%|▋         | 79/1177 [04:01<52:46,  2.88s/it, exist=0.3229, loss=0.5753, lr=3.65e-05]
Epoch 3/5:   7%|▋         | 79/1177 [04:04<52:46,  2.88s/it, exist=0.3253, loss=0.5769, lr=3.65e-05]
Epoch 3/5:   7%|▋         | 80/1177 [04:04<50:25,  2.76s/it, exist=0.3253, loss=0.5769, lr=3.65e-05]
Epoch 3/5:   7%|▋         | 80/1177 [04:06<50:25,  2.76s/it, exist=0.3242, loss=0.5753, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 81/1177 [04:06<45:58,  2.52s/it, exist=0.3242, loss=0.5753, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 81/1177 [04:09<45:58,  2.52s/it, exist=0.3218, loss=0.5725, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 82/1177 [04:09<50:32,  2.77s/it, exist=0.3218, loss=0.5725, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 82/1177 [04:11<50:32,  2.77s/it, exist=0.3214, loss=0.5723, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 83/1177 [04:11<46:03,  2.53s/it, exist=0.3214, loss=0.5723, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 83/1177 [04:14<46:03,  2.53s/it, exist=0.3227, loss=0.5729, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 84/1177 [04:14<49:28,  2.72s/it, exist=0.3227, loss=0.5729, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 84/1177 [04:17<49:28,  2.72s/it, exist=0.3226, loss=0.5721, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 85/1177 [04:17<49:02,  2.69s/it, exist=0.3226, loss=0.5721, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 85/1177 [04:19<49:02,  2.69s/it, exist=0.3234, loss=0.5723, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 86/1177 [04:19<44:56,  2.47s/it, exist=0.3234, loss=0.5723, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 86/1177 [04:22<44:56,  2.47s/it, exist=0.3222, loss=0.5705, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 87/1177 [04:22<47:59,  2.64s/it, exist=0.3222, loss=0.5705, lr=3.64e-05]
Epoch 3/5:   7%|▋         | 87/1177 [04:24<47:59,  2.64s/it, exist=0.3217, loss=0.5696, lr=3.63e-05]
Epoch 3/5:   7%|▋         | 88/1177 [04:24<44:11,  2.43s/it, exist=0.3217, loss=0.5696, lr=3.63e-05]
Epoch 3/5:   7%|▋         | 88/1177 [04:27<44:11,  2.43s/it, exist=0.3228, loss=0.5701, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 89/1177 [04:27<49:16,  2.72s/it, exist=0.3228, loss=0.5701, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 89/1177 [04:30<49:16,  2.72s/it, exist=0.3209, loss=0.5682, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 90/1177 [04:30<47:47,  2.64s/it, exist=0.3209, loss=0.5682, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 90/1177 [04:32<47:47,  2.64s/it, exist=0.3207, loss=0.5676, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 91/1177 [04:32<44:09,  2.44s/it, exist=0.3207, loss=0.5676, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 91/1177 [04:35<44:09,  2.44s/it, exist=0.3186, loss=0.5651, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 92/1177 [04:35<47:14,  2.61s/it, exist=0.3186, loss=0.5651, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 92/1177 [04:38<47:14,  2.61s/it, exist=0.3177, loss=0.5634, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 93/1177 [04:38<50:14,  2.78s/it, exist=0.3177, loss=0.5634, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 93/1177 [04:40<50:14,  2.78s/it, exist=0.3164, loss=0.5614, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 94/1177 [04:40<45:43,  2.53s/it, exist=0.3164, loss=0.5614, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 94/1177 [04:43<45:43,  2.53s/it, exist=0.3198, loss=0.5660, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 95/1177 [04:43<50:02,  2.78s/it, exist=0.3198, loss=0.5660, lr=3.63e-05]
Epoch 3/5:   8%|▊         | 95/1177 [04:46<50:02,  2.78s/it, exist=0.3175, loss=0.5650, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 96/1177 [04:46<48:45,  2.71s/it, exist=0.3175, loss=0.5650, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 96/1177 [04:48<48:45,  2.71s/it, exist=0.3187, loss=0.5652, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 97/1177 [04:48<48:23,  2.69s/it, exist=0.3187, loss=0.5652, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 97/1177 [04:51<48:23,  2.69s/it, exist=0.3171, loss=0.5633, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 98/1177 [04:51<48:39,  2.71s/it, exist=0.3171, loss=0.5633, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 98/1177 [04:53<48:39,  2.71s/it, exist=0.3159, loss=0.5615, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 99/1177 [04:53<44:32,  2.48s/it, exist=0.3159, loss=0.5615, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 99/1177 [04:56<44:32,  2.48s/it, exist=0.3150, loss=0.5604, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 100/1177 [04:56<45:11,  2.52s/it, exist=0.3150, loss=0.5604, lr=3.62e-05]
Epoch 3/5:   8%|▊         | 100/1177 [04:59<45:11,  2.52s/it, exist=0.3136, loss=0.5593, lr=3.62e-05]
Epoch 3/5:   9%|▊         | 101/1177 [04:59<49:28,  2.76s/it, exist=0.3136, loss=0.5593, lr=3.62e-05]
Epoch 3/5:   9%|▊         | 101/1177 [05:01<49:28,  2.76s/it, exist=0.3124, loss=0.5573, lr=3.62e-05]
Epoch 3/5:   9%|▊         | 102/1177 [05:01<48:19,  2.70s/it, exist=0.3124, loss=0.5573, lr=3.62e-05]
Epoch 3/5:   9%|▊         | 102/1177 [05:04<48:19,  2.70s/it, exist=0.3117, loss=0.5560, lr=3.62e-05]
Epoch 3/5:   9%|▉         | 103/1177 [05:04<47:48,  2.67s/it, exist=0.3117, loss=0.5560, lr=3.62e-05]
Epoch 3/5:   9%|▉         | 103/1177 [05:07<47:48,  2.67s/it, exist=0.3100, loss=0.5545, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 104/1177 [05:07<47:53,  2.68s/it, exist=0.3100, loss=0.5545, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 104/1177 [05:09<47:53,  2.68s/it, exist=0.3081, loss=0.5548, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 105/1177 [05:09<46:46,  2.62s/it, exist=0.3081, loss=0.5548, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 105/1177 [05:12<46:46,  2.62s/it, exist=0.3081, loss=0.5543, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 106/1177 [05:12<46:29,  2.60s/it, exist=0.3081, loss=0.5543, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 106/1177 [05:14<46:29,  2.60s/it, exist=0.3078, loss=0.5544, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 107/1177 [05:14<43:02,  2.41s/it, exist=0.3078, loss=0.5544, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 107/1177 [05:16<43:02,  2.41s/it, exist=0.3063, loss=0.5525, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 108/1177 [05:16<43:53,  2.46s/it, exist=0.3063, loss=0.5525, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 108/1177 [05:20<43:53,  2.46s/it, exist=0.3062, loss=0.5518, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 109/1177 [05:20<47:41,  2.68s/it, exist=0.3062, loss=0.5518, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 109/1177 [05:21<47:41,  2.68s/it, exist=0.3049, loss=0.5506, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 110/1177 [05:21<43:33,  2.45s/it, exist=0.3049, loss=0.5506, lr=3.61e-05]
Epoch 3/5:   9%|▉         | 110/1177 [05:25<43:33,  2.45s/it, exist=0.3041, loss=0.5494, lr=3.60e-05]
Epoch 3/5:   9%|▉         | 111/1177 [05:25<47:26,  2.67s/it, exist=0.3041, loss=0.5494, lr=3.60e-05]
Epoch 3/5:   9%|▉         | 111/1177 [05:27<47:26,  2.67s/it, exist=0.3048, loss=0.5510, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 112/1177 [05:27<46:37,  2.63s/it, exist=0.3048, loss=0.5510, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 112/1177 [05:30<46:37,  2.63s/it, exist=0.3026, loss=0.5485, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 113/1177 [05:30<46:51,  2.64s/it, exist=0.3026, loss=0.5485, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 113/1177 [05:32<46:51,  2.64s/it, exist=0.3023, loss=0.5479, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 114/1177 [05:32<43:06,  2.43s/it, exist=0.3023, loss=0.5479, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 114/1177 [05:34<43:06,  2.43s/it, exist=0.3006, loss=0.5476, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 115/1177 [05:34<40:48,  2.31s/it, exist=0.3006, loss=0.5476, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 115/1177 [05:36<40:48,  2.31s/it, exist=0.2997, loss=0.5462, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 116/1177 [05:36<42:17,  2.39s/it, exist=0.2997, loss=0.5462, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 116/1177 [05:40<42:17,  2.39s/it, exist=0.2993, loss=0.5461, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 117/1177 [05:40<47:22,  2.68s/it, exist=0.2993, loss=0.5461, lr=3.60e-05]
Epoch 3/5:  10%|▉         | 117/1177 [05:42<47:22,  2.68s/it, exist=0.2982, loss=0.5454, lr=3.60e-05]
Epoch 3/5:  10%|█         | 118/1177 [05:42<43:22,  2.46s/it, exist=0.2982, loss=0.5454, lr=3.60e-05]
Epoch 3/5:  10%|█         | 118/1177 [05:44<43:22,  2.46s/it, exist=0.2971, loss=0.5438, lr=3.59e-05]
Epoch 3/5:  10%|█         | 119/1177 [05:44<44:39,  2.53s/it, exist=0.2971, loss=0.5438, lr=3.59e-05]
Epoch 3/5:  10%|█         | 119/1177 [05:48<44:39,  2.53s/it, exist=0.2994, loss=0.5463, lr=3.59e-05]
Epoch 3/5:  10%|█         | 120/1177 [05:48<51:37,  2.93s/it, exist=0.2994, loss=0.5463, lr=3.59e-05]
Epoch 3/5:  10%|█         | 120/1177 [05:50<51:37,  2.93s/it, exist=0.2994, loss=0.5461, lr=3.59e-05]
Epoch 3/5:  10%|█         | 121/1177 [05:50<46:20,  2.63s/it, exist=0.2994, loss=0.5461, lr=3.59e-05]
Epoch 3/5:  10%|█         | 121/1177 [05:52<46:20,  2.63s/it, exist=0.2983, loss=0.5451, lr=3.59e-05]
Epoch 3/5:  10%|█         | 122/1177 [05:52<42:36,  2.42s/it, exist=0.2983, loss=0.5451, lr=3.59e-05]
Epoch 3/5:  10%|█         | 122/1177 [05:55<42:36,  2.42s/it, exist=0.2981, loss=0.5446, lr=3.59e-05]
Epoch 3/5:  10%|█         | 123/1177 [05:55<42:45,  2.43s/it, exist=0.2981, loss=0.5446, lr=3.59e-05]
Epoch 3/5:  10%|█         | 123/1177 [05:58<42:45,  2.43s/it, exist=0.3004, loss=0.5478, lr=3.59e-05]
Epoch 3/5:  11%|█         | 124/1177 [05:58<50:24,  2.87s/it, exist=0.3004, loss=0.5478, lr=3.59e-05]
Epoch 3/5:  11%|█         | 124/1177 [06:00<50:24,  2.87s/it, exist=0.3007, loss=0.5476, lr=3.59e-05]
Epoch 3/5:  11%|█         | 125/1177 [06:00<45:22,  2.59s/it, exist=0.3007, loss=0.5476, lr=3.59e-05]
Epoch 3/5:  11%|█         | 125/1177 [06:04<45:22,  2.59s/it, exist=0.3021, loss=0.5487, lr=3.58e-05]
Epoch 3/5:  11%|█         | 126/1177 [06:04<49:06,  2.80s/it, exist=0.3021, loss=0.5487, lr=3.58e-05]
Epoch 3/5:  11%|█         | 126/1177 [06:06<49:06,  2.80s/it, exist=0.3009, loss=0.5475, lr=3.58e-05]
Epoch 3/5:  11%|█         | 127/1177 [06:06<48:39,  2.78s/it, exist=0.3009, loss=0.5475, lr=3.58e-05]
Epoch 3/5:  11%|█         | 127/1177 [06:09<48:39,  2.78s/it, exist=0.3036, loss=0.5502, lr=3.58e-05]
Epoch 3/5:  11%|█         | 128/1177 [06:09<47:37,  2.72s/it, exist=0.3036, loss=0.5502, lr=3.58e-05]
Epoch 3/5:  11%|█         | 128/1177 [06:12<47:37,  2.72s/it, exist=0.3036, loss=0.5503, lr=3.58e-05]
Epoch 3/5:  11%|█         | 129/1177 [06:12<46:58,  2.69s/it, exist=0.3036, loss=0.5503, lr=3.58e-05]
Epoch 3/5:  11%|█         | 129/1177 [06:14<46:58,  2.69s/it, exist=0.3035, loss=0.5507, lr=3.58e-05]
Epoch 3/5:  11%|█         | 130/1177 [06:14<46:34,  2.67s/it, exist=0.3035, loss=0.5507, lr=3.58e-05]
Epoch 3/5:  11%|█         | 130/1177 [06:16<46:34,  2.67s/it, exist=0.3027, loss=0.5498, lr=3.58e-05]
Epoch 3/5:  11%|█         | 131/1177 [06:16<42:55,  2.46s/it, exist=0.3027, loss=0.5498, lr=3.58e-05]
Epoch 3/5:  11%|█         | 131/1177 [06:20<42:55,  2.46s/it, exist=0.3030, loss=0.5500, lr=3.58e-05]
Epoch 3/5:  11%|█         | 132/1177 [06:20<49:05,  2.82s/it, exist=0.3030, loss=0.5500, lr=3.58e-05]
Epoch 3/5:  11%|█         | 132/1177 [06:22<49:05,  2.82s/it, exist=0.3038, loss=0.5509, lr=3.58e-05]
Epoch 3/5:  11%|█▏        | 133/1177 [06:22<47:26,  2.73s/it, exist=0.3038, loss=0.5509, lr=3.58e-05]
Epoch 3/5:  11%|█▏        | 133/1177 [06:24<47:26,  2.73s/it, exist=0.3026, loss=0.5498, lr=3.57e-05]
Epoch 3/5:  11%|█▏        | 134/1177 [06:24<43:14,  2.49s/it, exist=0.3026, loss=0.5498, lr=3.57e-05]
Epoch 3/5:  11%|█▏        | 134/1177 [06:26<43:14,  2.49s/it, exist=0.3015, loss=0.5485, lr=3.57e-05]
Epoch 3/5:  11%|█▏        | 135/1177 [06:26<40:22,  2.32s/it, exist=0.3015, loss=0.5485, lr=3.57e-05]
Epoch 3/5:  11%|█▏        | 135/1177 [06:30<40:22,  2.32s/it, exist=0.2999, loss=0.5474, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 136/1177 [06:30<45:23,  2.62s/it, exist=0.2999, loss=0.5474, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 136/1177 [06:33<45:23,  2.62s/it, exist=0.3028, loss=0.5499, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 137/1177 [06:33<48:37,  2.80s/it, exist=0.3028, loss=0.5499, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 137/1177 [06:35<48:37,  2.80s/it, exist=0.3027, loss=0.5495, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 138/1177 [06:35<44:02,  2.54s/it, exist=0.3027, loss=0.5495, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 138/1177 [06:37<44:02,  2.54s/it, exist=0.3011, loss=0.5479, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 139/1177 [06:37<43:58,  2.54s/it, exist=0.3011, loss=0.5479, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 139/1177 [06:40<43:58,  2.54s/it, exist=0.3008, loss=0.5475, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 140/1177 [06:40<44:53,  2.60s/it, exist=0.3008, loss=0.5475, lr=3.57e-05]
Epoch 3/5:  12%|█▏        | 140/1177 [06:43<44:53,  2.60s/it, exist=0.2999, loss=0.5463, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 141/1177 [06:43<48:33,  2.81s/it, exist=0.2999, loss=0.5463, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 141/1177 [06:46<48:33,  2.81s/it, exist=0.3011, loss=0.5474, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 142/1177 [06:46<46:57,  2.72s/it, exist=0.3011, loss=0.5474, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 142/1177 [06:49<46:57,  2.72s/it, exist=0.3016, loss=0.5476, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 143/1177 [06:49<51:15,  2.97s/it, exist=0.3016, loss=0.5476, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 143/1177 [06:52<51:15,  2.97s/it, exist=0.3049, loss=0.5519, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 144/1177 [06:52<50:08,  2.91s/it, exist=0.3049, loss=0.5519, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 144/1177 [06:54<50:08,  2.91s/it, exist=0.3046, loss=0.5512, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 145/1177 [06:54<45:01,  2.62s/it, exist=0.3046, loss=0.5512, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 145/1177 [06:56<45:01,  2.62s/it, exist=0.3033, loss=0.5499, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 146/1177 [06:56<41:39,  2.42s/it, exist=0.3033, loss=0.5499, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 146/1177 [06:59<41:39,  2.42s/it, exist=0.3023, loss=0.5488, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 147/1177 [06:59<45:21,  2.64s/it, exist=0.3023, loss=0.5488, lr=3.56e-05]
Epoch 3/5:  12%|█▏        | 147/1177 [07:03<45:21,  2.64s/it, exist=0.3023, loss=0.5485, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 148/1177 [07:03<49:01,  2.86s/it, exist=0.3023, loss=0.5485, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 148/1177 [07:05<49:01,  2.86s/it, exist=0.3006, loss=0.5467, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 149/1177 [07:05<44:33,  2.60s/it, exist=0.3006, loss=0.5467, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 149/1177 [07:07<44:33,  2.60s/it, exist=0.2995, loss=0.5453, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 150/1177 [07:07<44:31,  2.60s/it, exist=0.2995, loss=0.5453, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 150/1177 [07:10<44:31,  2.60s/it, exist=0.2983, loss=0.5440, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 151/1177 [07:10<47:21,  2.77s/it, exist=0.2983, loss=0.5440, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 151/1177 [07:13<47:21,  2.77s/it, exist=0.2974, loss=0.5430, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 152/1177 [07:13<46:41,  2.73s/it, exist=0.2974, loss=0.5430, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 152/1177 [07:16<46:41,  2.73s/it, exist=0.2965, loss=0.5431, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 153/1177 [07:16<45:48,  2.68s/it, exist=0.2965, loss=0.5431, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 153/1177 [07:18<45:48,  2.68s/it, exist=0.2952, loss=0.5414, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 154/1177 [07:18<45:03,  2.64s/it, exist=0.2952, loss=0.5414, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 154/1177 [07:21<45:03,  2.64s/it, exist=0.2964, loss=0.5420, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 155/1177 [07:21<43:49,  2.57s/it, exist=0.2964, loss=0.5420, lr=3.55e-05]
Epoch 3/5:  13%|█▎        | 155/1177 [07:23<43:49,  2.57s/it, exist=0.2968, loss=0.5424, lr=3.54e-05]
Epoch 3/5:  13%|█▎        | 156/1177 [07:23<44:03,  2.59s/it, exist=0.2968, loss=0.5424, lr=3.54e-05]
Epoch 3/5:  13%|█▎        | 156/1177 [07:25<44:03,  2.59s/it, exist=0.2959, loss=0.5416, lr=3.54e-05]
Epoch 3/5:  13%|█▎        | 157/1177 [07:25<40:41,  2.39s/it, exist=0.2959, loss=0.5416, lr=3.54e-05]
Epoch 3/5:  13%|█▎        | 157/1177 [07:28<40:41,  2.39s/it, exist=0.2975, loss=0.5433, lr=3.54e-05]
Epoch 3/5:  13%|█▎        | 158/1177 [07:28<41:55,  2.47s/it, exist=0.2975, loss=0.5433, lr=3.54e-05]
Epoch 3/5:  13%|█▎        | 158/1177 [07:31<41:55,  2.47s/it, exist=0.2972, loss=0.5435, lr=3.54e-05]
Epoch 3/5:  14%|█▎        | 159/1177 [07:31<44:52,  2.65s/it, exist=0.2972, loss=0.5435, lr=3.54e-05]
Epoch 3/5:  14%|█▎        | 159/1177 [07:33<44:52,  2.65s/it, exist=0.2962, loss=0.5423, lr=3.54e-05]
Epoch 3/5:  14%|█▎        | 160/1177 [07:33<41:22,  2.44s/it, exist=0.2962, loss=0.5423, lr=3.54e-05]
Epoch 3/5:  14%|█▎        | 160/1177 [07:35<41:22,  2.44s/it, exist=0.2947, loss=0.5408, lr=3.54e-05]
Epoch 3/5:  14%|█▎        | 161/1177 [07:35<42:30,  2.51s/it, exist=0.2947, loss=0.5408, lr=3.54e-05]
Epoch 3/5:  14%|█▎        | 161/1177 [07:39<42:30,  2.51s/it, exist=0.2946, loss=0.5408, lr=3.54e-05]
Epoch 3/5:  14%|█▍        | 162/1177 [07:39<46:17,  2.74s/it, exist=0.2946, loss=0.5408, lr=3.54e-05]
Epoch 3/5:  14%|█▍        | 162/1177 [07:41<46:17,  2.74s/it, exist=0.2934, loss=0.5392, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 163/1177 [07:41<42:14,  2.50s/it, exist=0.2934, loss=0.5392, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 163/1177 [07:44<42:14,  2.50s/it, exist=0.2956, loss=0.5409, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 164/1177 [07:44<45:55,  2.72s/it, exist=0.2956, loss=0.5409, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 164/1177 [07:46<45:55,  2.72s/it, exist=0.2947, loss=0.5397, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 165/1177 [07:46<45:09,  2.68s/it, exist=0.2947, loss=0.5397, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 165/1177 [07:49<45:09,  2.68s/it, exist=0.2942, loss=0.5389, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 166/1177 [07:49<44:35,  2.65s/it, exist=0.2942, loss=0.5389, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 166/1177 [07:51<44:35,  2.65s/it, exist=0.2942, loss=0.5393, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 167/1177 [07:51<40:58,  2.43s/it, exist=0.2942, loss=0.5393, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 167/1177 [07:54<40:58,  2.43s/it, exist=0.2936, loss=0.5385, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 168/1177 [07:54<41:59,  2.50s/it, exist=0.2936, loss=0.5385, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 168/1177 [07:56<41:59,  2.50s/it, exist=0.2943, loss=0.5393, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 169/1177 [07:56<42:44,  2.54s/it, exist=0.2943, loss=0.5393, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 169/1177 [07:59<42:44,  2.54s/it, exist=0.2950, loss=0.5396, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 170/1177 [07:59<43:14,  2.58s/it, exist=0.2950, loss=0.5396, lr=3.53e-05]
Epoch 3/5:  14%|█▍        | 170/1177 [08:02<43:14,  2.58s/it, exist=0.2959, loss=0.5405, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 171/1177 [08:02<43:22,  2.59s/it, exist=0.2959, loss=0.5405, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 171/1177 [08:05<43:22,  2.59s/it, exist=0.2951, loss=0.5394, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 172/1177 [08:05<48:50,  2.92s/it, exist=0.2951, loss=0.5394, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 172/1177 [08:08<48:50,  2.92s/it, exist=0.2959, loss=0.5399, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 173/1177 [08:08<47:00,  2.81s/it, exist=0.2959, loss=0.5399, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 173/1177 [08:10<47:00,  2.81s/it, exist=0.2961, loss=0.5407, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 174/1177 [08:10<45:12,  2.70s/it, exist=0.2961, loss=0.5407, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 174/1177 [08:13<45:12,  2.70s/it, exist=0.2947, loss=0.5391, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 175/1177 [08:13<44:29,  2.66s/it, exist=0.2947, loss=0.5391, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 175/1177 [08:15<44:29,  2.66s/it, exist=0.2940, loss=0.5392, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 176/1177 [08:15<44:30,  2.67s/it, exist=0.2940, loss=0.5392, lr=3.52e-05]
Epoch 3/5:  15%|█▍        | 176/1177 [08:18<44:30,  2.67s/it, exist=0.2928, loss=0.5380, lr=3.52e-05]
Epoch 3/5:  15%|█▌        | 177/1177 [08:18<45:07,  2.71s/it, exist=0.2928, loss=0.5380, lr=3.52e-05]
Epoch 3/5:  15%|█▌        | 177/1177 [08:21<45:07,  2.71s/it, exist=0.2930, loss=0.5380, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 178/1177 [08:21<44:19,  2.66s/it, exist=0.2930, loss=0.5380, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 178/1177 [08:23<44:19,  2.66s/it, exist=0.2929, loss=0.5374, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 179/1177 [08:23<43:50,  2.64s/it, exist=0.2929, loss=0.5374, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 179/1177 [08:25<43:50,  2.64s/it, exist=0.2920, loss=0.5364, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 180/1177 [08:25<40:29,  2.44s/it, exist=0.2920, loss=0.5364, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 180/1177 [08:28<40:29,  2.44s/it, exist=0.2941, loss=0.5393, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 181/1177 [08:28<43:33,  2.62s/it, exist=0.2941, loss=0.5393, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 181/1177 [08:30<43:33,  2.62s/it, exist=0.2941, loss=0.5392, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 182/1177 [08:30<40:15,  2.43s/it, exist=0.2941, loss=0.5392, lr=3.51e-05]
Epoch 3/5:  15%|█▌        | 182/1177 [08:32<40:15,  2.43s/it, exist=0.2956, loss=0.5404, lr=3.51e-05]
Epoch 3/5:  16%|█▌        | 183/1177 [08:32<37:28,  2.26s/it, exist=0.2956, loss=0.5404, lr=3.51e-05]
Epoch 3/5:  16%|█▌        | 183/1177 [08:36<37:28,  2.26s/it, exist=0.2967, loss=0.5411, lr=3.51e-05]
Epoch 3/5:  16%|█▌        | 184/1177 [08:36<42:39,  2.58s/it, exist=0.2967, loss=0.5411, lr=3.51e-05]
Epoch 3/5:  16%|█▌        | 184/1177 [08:39<42:39,  2.58s/it, exist=0.2978, loss=0.5423, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 185/1177 [08:39<46:32,  2.82s/it, exist=0.2978, loss=0.5423, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 185/1177 [08:41<46:32,  2.82s/it, exist=0.2979, loss=0.5422, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 186/1177 [08:41<44:23,  2.69s/it, exist=0.2979, loss=0.5422, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 186/1177 [08:44<44:23,  2.69s/it, exist=0.2971, loss=0.5415, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 187/1177 [08:44<44:06,  2.67s/it, exist=0.2971, loss=0.5415, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 187/1177 [08:47<44:06,  2.67s/it, exist=0.2965, loss=0.5412, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 188/1177 [08:47<44:06,  2.68s/it, exist=0.2965, loss=0.5412, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 188/1177 [08:49<44:06,  2.68s/it, exist=0.2958, loss=0.5403, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 189/1177 [08:49<40:43,  2.47s/it, exist=0.2958, loss=0.5403, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 189/1177 [08:51<40:43,  2.47s/it, exist=0.2952, loss=0.5394, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 190/1177 [08:51<38:09,  2.32s/it, exist=0.2952, loss=0.5394, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 190/1177 [08:55<38:09,  2.32s/it, exist=0.2967, loss=0.5414, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 191/1177 [08:55<46:05,  2.80s/it, exist=0.2967, loss=0.5414, lr=3.50e-05]
Epoch 3/5:  16%|█▌        | 191/1177 [08:57<46:05,  2.80s/it, exist=0.2971, loss=0.5432, lr=3.50e-05]
Epoch 3/5:  16%|█▋        | 192/1177 [08:57<45:16,  2.76s/it, exist=0.2971, loss=0.5432, lr=3.50e-05]
Epoch 3/5:  16%|█▋        | 192/1177 [09:00<45:16,  2.76s/it, exist=0.2976, loss=0.5434, lr=3.49e-05]
Epoch 3/5:  16%|█▋        | 193/1177 [09:00<44:17,  2.70s/it, exist=0.2976, loss=0.5434, lr=3.49e-05]
Epoch 3/5:  16%|█▋        | 193/1177 [09:02<44:17,  2.70s/it, exist=0.2977, loss=0.5434, lr=3.49e-05]
Epoch 3/5:  16%|█▋        | 194/1177 [09:02<40:45,  2.49s/it, exist=0.2977, loss=0.5434, lr=3.49e-05]
Epoch 3/5:  16%|█▋        | 194/1177 [09:05<40:45,  2.49s/it, exist=0.2973, loss=0.5438, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 195/1177 [09:05<45:23,  2.77s/it, exist=0.2973, loss=0.5438, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 195/1177 [09:07<45:23,  2.77s/it, exist=0.2969, loss=0.5436, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 196/1177 [09:07<41:17,  2.53s/it, exist=0.2969, loss=0.5436, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 196/1177 [09:10<41:17,  2.53s/it, exist=0.2963, loss=0.5429, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 197/1177 [09:10<44:23,  2.72s/it, exist=0.2963, loss=0.5429, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 197/1177 [09:13<44:23,  2.72s/it, exist=0.2967, loss=0.5433, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 198/1177 [09:13<43:40,  2.68s/it, exist=0.2967, loss=0.5433, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 198/1177 [09:15<43:40,  2.68s/it, exist=0.2957, loss=0.5424, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 199/1177 [09:15<40:25,  2.48s/it, exist=0.2957, loss=0.5424, lr=3.49e-05]
Epoch 3/5:  17%|█▋        | 199/1177 [09:18<40:25,  2.48s/it, exist=0.2948, loss=0.5416, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 200/1177 [09:18<44:14,  2.72s/it, exist=0.2948, loss=0.5416, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 200/1177 [09:21<44:14,  2.72s/it, exist=0.2943, loss=0.5410, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 201/1177 [09:21<43:40,  2.69s/it, exist=0.2943, loss=0.5410, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 201/1177 [09:23<43:40,  2.69s/it, exist=0.2932, loss=0.5396, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 202/1177 [09:23<42:56,  2.64s/it, exist=0.2932, loss=0.5396, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 202/1177 [09:26<42:56,  2.64s/it, exist=0.2921, loss=0.5386, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 203/1177 [09:26<43:03,  2.65s/it, exist=0.2921, loss=0.5386, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 203/1177 [09:29<43:03,  2.65s/it, exist=0.2925, loss=0.5388, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 204/1177 [09:29<43:04,  2.66s/it, exist=0.2925, loss=0.5388, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 204/1177 [09:31<43:04,  2.66s/it, exist=0.2923, loss=0.5391, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 205/1177 [09:31<39:41,  2.45s/it, exist=0.2923, loss=0.5391, lr=3.48e-05]
Epoch 3/5:  17%|█▋        | 205/1177 [09:33<39:41,  2.45s/it, exist=0.2937, loss=0.5404, lr=3.48e-05]
Epoch 3/5:  18%|█▊        | 206/1177 [09:33<37:12,  2.30s/it, exist=0.2937, loss=0.5404, lr=3.48e-05]
Epoch 3/5:  18%|█▊        | 206/1177 [09:36<37:12,  2.30s/it, exist=0.2928, loss=0.5393, lr=3.48e-05]
Epoch 3/5:  18%|█▊        | 207/1177 [09:36<41:40,  2.58s/it, exist=0.2928, loss=0.5393, lr=3.48e-05]
Epoch 3/5:  18%|█▊        | 207/1177 [09:39<41:40,  2.58s/it, exist=0.2922, loss=0.5385, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 208/1177 [09:39<44:52,  2.78s/it, exist=0.2922, loss=0.5385, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 208/1177 [09:41<44:52,  2.78s/it, exist=0.2931, loss=0.5391, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 209/1177 [09:41<42:47,  2.65s/it, exist=0.2931, loss=0.5391, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 209/1177 [09:44<42:47,  2.65s/it, exist=0.2944, loss=0.5402, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 210/1177 [09:44<41:57,  2.60s/it, exist=0.2944, loss=0.5402, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 210/1177 [09:47<41:57,  2.60s/it, exist=0.2937, loss=0.5395, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 211/1177 [09:47<41:55,  2.60s/it, exist=0.2937, loss=0.5395, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 211/1177 [09:49<41:55,  2.60s/it, exist=0.2927, loss=0.5383, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 212/1177 [09:49<38:39,  2.40s/it, exist=0.2927, loss=0.5383, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 212/1177 [09:51<38:39,  2.40s/it, exist=0.2924, loss=0.5384, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 213/1177 [09:51<39:00,  2.43s/it, exist=0.2924, loss=0.5384, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 213/1177 [09:54<39:00,  2.43s/it, exist=0.2914, loss=0.5371, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 214/1177 [09:54<42:31,  2.65s/it, exist=0.2914, loss=0.5371, lr=3.47e-05]
Epoch 3/5:  18%|█▊        | 214/1177 [09:56<42:31,  2.65s/it, exist=0.2907, loss=0.5362, lr=3.46e-05]
Epoch 3/5:  18%|█▊        | 215/1177 [09:56<39:25,  2.46s/it, exist=0.2907, loss=0.5362, lr=3.46e-05]
Epoch 3/5:  18%|█▊        | 215/1177 [09:59<39:25,  2.46s/it, exist=0.2915, loss=0.5368, lr=3.46e-05]
Epoch 3/5:  18%|█▊        | 216/1177 [09:59<39:56,  2.49s/it, exist=0.2915, loss=0.5368, lr=3.46e-05]
Epoch 3/5:  18%|█▊        | 216/1177 [10:02<39:56,  2.49s/it, exist=0.2909, loss=0.5361, lr=3.46e-05]
Epoch 3/5:  18%|█▊        | 217/1177 [10:02<44:06,  2.76s/it, exist=0.2909, loss=0.5361, lr=3.46e-05]
Epoch 3/5:  18%|█▊        | 217/1177 [10:05<44:06,  2.76s/it, exist=0.2899, loss=0.5354, lr=3.46e-05]
Epoch 3/5:  19%|█▊        | 218/1177 [10:05<43:02,  2.69s/it, exist=0.2899, loss=0.5354, lr=3.46e-05]
Epoch 3/5:  19%|█▊        | 218/1177 [10:07<43:02,  2.69s/it, exist=0.2903, loss=0.5358, lr=3.46e-05]
Epoch 3/5:  19%|█▊        | 219/1177 [10:07<42:46,  2.68s/it, exist=0.2903, loss=0.5358, lr=3.46e-05]
Epoch 3/5:  19%|█▊        | 219/1177 [10:10<42:46,  2.68s/it, exist=0.2901, loss=0.5355, lr=3.46e-05]
Epoch 3/5:  19%|█▊        | 220/1177 [10:10<43:12,  2.71s/it, exist=0.2901, loss=0.5355, lr=3.46e-05]
Epoch 3/5:  19%|█▊        | 220/1177 [10:13<43:12,  2.71s/it, exist=0.2897, loss=0.5353, lr=3.46e-05]
Epoch 3/5:  19%|█▉        | 221/1177 [10:13<42:49,  2.69s/it, exist=0.2897, loss=0.5353, lr=3.46e-05]
Epoch 3/5:  19%|█▉        | 221/1177 [10:15<42:49,  2.69s/it, exist=0.2887, loss=0.5342, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 222/1177 [10:15<41:44,  2.62s/it, exist=0.2887, loss=0.5342, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 222/1177 [10:18<41:44,  2.62s/it, exist=0.2882, loss=0.5340, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 223/1177 [10:18<43:10,  2.72s/it, exist=0.2882, loss=0.5340, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 223/1177 [10:21<43:10,  2.72s/it, exist=0.2885, loss=0.5342, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 224/1177 [10:21<42:27,  2.67s/it, exist=0.2885, loss=0.5342, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 224/1177 [10:23<42:27,  2.67s/it, exist=0.2884, loss=0.5341, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 225/1177 [10:23<42:24,  2.67s/it, exist=0.2884, loss=0.5341, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 225/1177 [10:25<42:24,  2.67s/it, exist=0.2879, loss=0.5335, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 226/1177 [10:25<38:51,  2.45s/it, exist=0.2879, loss=0.5335, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 226/1177 [10:28<38:51,  2.45s/it, exist=0.2871, loss=0.5327, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 227/1177 [10:28<39:12,  2.48s/it, exist=0.2871, loss=0.5327, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 227/1177 [10:31<39:12,  2.48s/it, exist=0.2872, loss=0.5331, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 228/1177 [10:31<43:00,  2.72s/it, exist=0.2872, loss=0.5331, lr=3.45e-05]
Epoch 3/5:  19%|█▉        | 228/1177 [10:33<43:00,  2.72s/it, exist=0.2866, loss=0.5323, lr=3.44e-05]
Epoch 3/5:  19%|█▉        | 229/1177 [10:33<39:20,  2.49s/it, exist=0.2866, loss=0.5323, lr=3.44e-05]
Epoch 3/5:  19%|█▉        | 229/1177 [10:35<39:20,  2.49s/it, exist=0.2860, loss=0.5314, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 230/1177 [10:35<36:48,  2.33s/it, exist=0.2860, loss=0.5314, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 230/1177 [10:38<36:48,  2.33s/it, exist=0.2855, loss=0.5310, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 231/1177 [10:38<40:48,  2.59s/it, exist=0.2855, loss=0.5310, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 231/1177 [10:41<40:48,  2.59s/it, exist=0.2859, loss=0.5315, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 232/1177 [10:41<40:46,  2.59s/it, exist=0.2859, loss=0.5315, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 232/1177 [10:43<40:46,  2.59s/it, exist=0.2853, loss=0.5309, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 233/1177 [10:43<40:53,  2.60s/it, exist=0.2853, loss=0.5309, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 233/1177 [10:47<40:53,  2.60s/it, exist=0.2851, loss=0.5310, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 234/1177 [10:47<43:16,  2.75s/it, exist=0.2851, loss=0.5310, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 234/1177 [10:49<43:16,  2.75s/it, exist=0.2848, loss=0.5312, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 235/1177 [10:49<42:37,  2.71s/it, exist=0.2848, loss=0.5312, lr=3.44e-05]
Epoch 3/5:  20%|█▉        | 235/1177 [10:51<42:37,  2.71s/it, exist=0.2839, loss=0.5306, lr=3.44e-05]
Epoch 3/5:  20%|██        | 236/1177 [10:51<39:00,  2.49s/it, exist=0.2839, loss=0.5306, lr=3.44e-05]
Epoch 3/5:  20%|██        | 236/1177 [10:54<39:00,  2.49s/it, exist=0.2836, loss=0.5304, lr=3.43e-05]
Epoch 3/5:  20%|██        | 237/1177 [10:54<42:57,  2.74s/it, exist=0.2836, loss=0.5304, lr=3.43e-05]
Epoch 3/5:  20%|██        | 237/1177 [10:57<42:57,  2.74s/it, exist=0.2836, loss=0.5306, lr=3.43e-05]
Epoch 3/5:  20%|██        | 238/1177 [10:57<41:20,  2.64s/it, exist=0.2836, loss=0.5306, lr=3.43e-05]
Epoch 3/5:  20%|██        | 238/1177 [11:00<41:20,  2.64s/it, exist=0.2834, loss=0.5307, lr=3.43e-05]
Epoch 3/5:  20%|██        | 239/1177 [11:00<41:26,  2.65s/it, exist=0.2834, loss=0.5307, lr=3.43e-05]
Epoch 3/5:  20%|██        | 239/1177 [11:02<41:26,  2.65s/it, exist=0.2836, loss=0.5307, lr=3.43e-05]
Epoch 3/5:  20%|██        | 240/1177 [11:02<38:17,  2.45s/it, exist=0.2836, loss=0.5307, lr=3.43e-05]
Epoch 3/5:  20%|██        | 240/1177 [11:05<38:17,  2.45s/it, exist=0.2835, loss=0.5305, lr=3.43e-05]
Epoch 3/5:  20%|██        | 241/1177 [11:05<42:13,  2.71s/it, exist=0.2835, loss=0.5305, lr=3.43e-05]
Epoch 3/5:  20%|██        | 241/1177 [11:07<42:13,  2.71s/it, exist=0.2849, loss=0.5318, lr=3.43e-05]
Epoch 3/5:  21%|██        | 242/1177 [11:07<40:55,  2.63s/it, exist=0.2849, loss=0.5318, lr=3.43e-05]
Epoch 3/5:  21%|██        | 242/1177 [11:10<40:55,  2.63s/it, exist=0.2842, loss=0.5310, lr=3.43e-05]
Epoch 3/5:  21%|██        | 243/1177 [11:10<41:00,  2.63s/it, exist=0.2842, loss=0.5310, lr=3.43e-05]
Epoch 3/5:  21%|██        | 243/1177 [11:13<41:00,  2.63s/it, exist=0.2852, loss=0.5332, lr=3.42e-05]
Epoch 3/5:  21%|██        | 244/1177 [11:13<40:49,  2.63s/it, exist=0.2852, loss=0.5332, lr=3.42e-05]
Epoch 3/5:  21%|██        | 244/1177 [11:15<40:49,  2.63s/it, exist=0.2874, loss=0.5350, lr=3.42e-05]
Epoch 3/5:  21%|██        | 245/1177 [11:15<39:40,  2.55s/it, exist=0.2874, loss=0.5350, lr=3.42e-05]
Epoch 3/5:  21%|██        | 245/1177 [11:18<39:40,  2.55s/it, exist=0.2866, loss=0.5341, lr=3.42e-05]
Epoch 3/5:  21%|██        | 246/1177 [11:18<41:12,  2.66s/it, exist=0.2866, loss=0.5341, lr=3.42e-05]
Epoch 3/5:  21%|██        | 246/1177 [11:20<41:12,  2.66s/it, exist=0.2860, loss=0.5335, lr=3.42e-05]
Epoch 3/5:  21%|██        | 247/1177 [11:20<37:56,  2.45s/it, exist=0.2860, loss=0.5335, lr=3.42e-05]
Epoch 3/5:  21%|██        | 247/1177 [11:22<37:56,  2.45s/it, exist=0.2859, loss=0.5341, lr=3.42e-05]
Epoch 3/5:  21%|██        | 248/1177 [11:22<38:31,  2.49s/it, exist=0.2859, loss=0.5341, lr=3.42e-05]
Epoch 3/5:  21%|██        | 248/1177 [11:26<38:31,  2.49s/it, exist=0.2856, loss=0.5340, lr=3.42e-05]
Epoch 3/5:  21%|██        | 249/1177 [11:26<41:50,  2.71s/it, exist=0.2856, loss=0.5340, lr=3.42e-05]
Epoch 3/5:  21%|██        | 249/1177 [11:28<41:50,  2.71s/it, exist=0.2847, loss=0.5336, lr=3.42e-05]
Epoch 3/5:  21%|██        | 250/1177 [11:28<38:30,  2.49s/it, exist=0.2847, loss=0.5336, lr=3.42e-05]
Epoch 3/5:  21%|██        | 250/1177 [11:30<38:30,  2.49s/it, exist=0.2841, loss=0.5328, lr=3.41e-05]
Epoch 3/5:  21%|██▏       | 251/1177 [11:30<38:59,  2.53s/it, exist=0.2841, loss=0.5328, lr=3.41e-05]
Epoch 3/5:  21%|██▏       | 251/1177 [11:33<38:59,  2.53s/it, exist=0.2838, loss=0.5325, lr=3.41e-05]
Epoch 3/5:  21%|██▏       | 252/1177 [11:33<41:49,  2.71s/it, exist=0.2838, loss=0.5325, lr=3.41e-05]
Epoch 3/5:  21%|██▏       | 252/1177 [11:36<41:49,  2.71s/it, exist=0.2836, loss=0.5327, lr=3.41e-05]
Epoch 3/5:  21%|██▏       | 253/1177 [11:36<40:52,  2.65s/it, exist=0.2836, loss=0.5327, lr=3.41e-05]
Epoch 3/5:  21%|██▏       | 253/1177 [11:38<40:52,  2.65s/it, exist=0.2831, loss=0.5323, lr=3.41e-05]
Epoch 3/5:  22%|██▏       | 254/1177 [11:38<37:46,  2.46s/it, exist=0.2831, loss=0.5323, lr=3.41e-05]
Epoch 3/5:  22%|██▏       | 254/1177 [11:40<37:46,  2.46s/it, exist=0.2824, loss=0.5316, lr=3.41e-05]
Epoch 3/5:  22%|██▏       | 255/1177 [11:40<37:47,  2.46s/it, exist=0.2824, loss=0.5316, lr=3.41e-05]
Epoch 3/5:  22%|██▏       | 255/1177 [11:43<37:47,  2.46s/it, exist=0.2817, loss=0.5307, lr=3.41e-05]
Epoch 3/5:  22%|██▏       | 256/1177 [11:43<41:05,  2.68s/it, exist=0.2817, loss=0.5307, lr=3.41e-05]
Epoch 3/5:  22%|██▏       | 256/1177 [11:46<41:05,  2.68s/it, exist=0.2816, loss=0.5304, lr=3.41e-05]
Epoch 3/5:  22%|██▏       | 257/1177 [11:46<40:33,  2.65s/it, exist=0.2816, loss=0.5304, lr=3.41e-05]
Epoch 3/5:  22%|██▏       | 257/1177 [11:49<40:33,  2.65s/it, exist=0.2828, loss=0.5314, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 258/1177 [11:49<39:59,  2.61s/it, exist=0.2828, loss=0.5314, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 258/1177 [11:51<39:59,  2.61s/it, exist=0.2821, loss=0.5307, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 259/1177 [11:51<40:13,  2.63s/it, exist=0.2821, loss=0.5307, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 259/1177 [11:54<40:13,  2.63s/it, exist=0.2817, loss=0.5300, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 260/1177 [11:54<40:29,  2.65s/it, exist=0.2817, loss=0.5300, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 260/1177 [11:57<40:29,  2.65s/it, exist=0.2823, loss=0.5307, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 261/1177 [11:57<40:27,  2.65s/it, exist=0.2823, loss=0.5307, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 261/1177 [11:59<40:27,  2.65s/it, exist=0.2834, loss=0.5316, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 262/1177 [11:59<37:11,  2.44s/it, exist=0.2834, loss=0.5316, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 262/1177 [12:02<37:11,  2.44s/it, exist=0.2830, loss=0.5315, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 263/1177 [12:02<40:05,  2.63s/it, exist=0.2830, loss=0.5315, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 263/1177 [12:04<40:05,  2.63s/it, exist=0.2830, loss=0.5314, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 264/1177 [12:04<40:01,  2.63s/it, exist=0.2830, loss=0.5314, lr=3.40e-05]
Epoch 3/5:  22%|██▏       | 264/1177 [12:06<40:01,  2.63s/it, exist=0.2836, loss=0.5322, lr=3.40e-05]
Epoch 3/5:  23%|██▎       | 265/1177 [12:06<37:09,  2.44s/it, exist=0.2836, loss=0.5322, lr=3.40e-05]
Epoch 3/5:  23%|██▎       | 265/1177 [12:08<37:09,  2.44s/it, exist=0.2833, loss=0.5319, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 266/1177 [12:08<34:44,  2.29s/it, exist=0.2833, loss=0.5319, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 266/1177 [12:11<34:44,  2.29s/it, exist=0.2840, loss=0.5325, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 267/1177 [12:11<36:22,  2.40s/it, exist=0.2840, loss=0.5325, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 267/1177 [12:15<36:22,  2.40s/it, exist=0.2834, loss=0.5316, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 268/1177 [12:15<42:50,  2.83s/it, exist=0.2834, loss=0.5316, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 268/1177 [12:17<42:50,  2.83s/it, exist=0.2847, loss=0.5336, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 269/1177 [12:17<38:49,  2.57s/it, exist=0.2847, loss=0.5336, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 269/1177 [12:20<38:49,  2.57s/it, exist=0.2845, loss=0.5333, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 270/1177 [12:20<42:19,  2.80s/it, exist=0.2845, loss=0.5333, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 270/1177 [12:23<42:19,  2.80s/it, exist=0.2839, loss=0.5328, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 271/1177 [12:23<41:47,  2.77s/it, exist=0.2839, loss=0.5328, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 271/1177 [12:25<41:47,  2.77s/it, exist=0.2832, loss=0.5318, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 272/1177 [12:25<40:56,  2.71s/it, exist=0.2832, loss=0.5318, lr=3.39e-05]
Epoch 3/5:  23%|██▎       | 272/1177 [12:27<40:56,  2.71s/it, exist=0.2827, loss=0.5313, lr=3.38e-05]
Epoch 3/5:  23%|██▎       | 273/1177 [12:27<37:15,  2.47s/it, exist=0.2827, loss=0.5313, lr=3.38e-05]
Epoch 3/5:  23%|██▎       | 273/1177 [12:30<37:15,  2.47s/it, exist=0.2829, loss=0.5315, lr=3.38e-05]
Epoch 3/5:  23%|██▎       | 274/1177 [12:30<37:34,  2.50s/it, exist=0.2829, loss=0.5315, lr=3.38e-05]
Epoch 3/5:  23%|██▎       | 274/1177 [12:32<37:34,  2.50s/it, exist=0.2837, loss=0.5322, lr=3.38e-05]
Epoch 3/5:  23%|██▎       | 275/1177 [12:32<37:56,  2.52s/it, exist=0.2837, loss=0.5322, lr=3.38e-05]
Epoch 3/5:  23%|██▎       | 275/1177 [12:35<37:56,  2.52s/it, exist=0.2849, loss=0.5333, lr=3.38e-05]
Epoch 3/5:  23%|██▎       | 276/1177 [12:35<38:02,  2.53s/it, exist=0.2849, loss=0.5333, lr=3.38e-05]
Epoch 3/5:  23%|██▎       | 276/1177 [12:38<38:02,  2.53s/it, exist=0.2842, loss=0.5326, lr=3.38e-05]
Epoch 3/5:  24%|██▎       | 277/1177 [12:38<41:42,  2.78s/it, exist=0.2842, loss=0.5326, lr=3.38e-05]
Epoch 3/5:  24%|██▎       | 277/1177 [12:41<41:42,  2.78s/it, exist=0.2851, loss=0.5332, lr=3.38e-05]
Epoch 3/5:  24%|██▎       | 278/1177 [12:41<41:07,  2.74s/it, exist=0.2851, loss=0.5332, lr=3.38e-05]
Epoch 3/5:  24%|██▎       | 278/1177 [12:43<41:07,  2.74s/it, exist=0.2848, loss=0.5328, lr=3.38e-05]
Epoch 3/5:  24%|██▎       | 279/1177 [12:43<37:42,  2.52s/it, exist=0.2848, loss=0.5328, lr=3.38e-05]
Epoch 3/5:  24%|██▎       | 279/1177 [12:46<37:42,  2.52s/it, exist=0.2853, loss=0.5336, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 280/1177 [12:46<38:27,  2.57s/it, exist=0.2853, loss=0.5336, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 280/1177 [12:49<38:27,  2.57s/it, exist=0.2849, loss=0.5328, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 281/1177 [12:49<40:36,  2.72s/it, exist=0.2849, loss=0.5328, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 281/1177 [12:51<40:36,  2.72s/it, exist=0.2852, loss=0.5332, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 282/1177 [12:51<37:02,  2.48s/it, exist=0.2852, loss=0.5332, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 282/1177 [12:53<37:02,  2.48s/it, exist=0.2846, loss=0.5327, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 283/1177 [12:53<37:43,  2.53s/it, exist=0.2846, loss=0.5327, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 283/1177 [12:56<37:43,  2.53s/it, exist=0.2842, loss=0.5321, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 284/1177 [12:56<40:41,  2.73s/it, exist=0.2842, loss=0.5321, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 284/1177 [12:58<40:41,  2.73s/it, exist=0.2850, loss=0.5329, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 285/1177 [12:58<37:10,  2.50s/it, exist=0.2850, loss=0.5329, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 285/1177 [13:01<37:10,  2.50s/it, exist=0.2846, loss=0.5324, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 286/1177 [13:01<37:39,  2.54s/it, exist=0.2846, loss=0.5324, lr=3.37e-05]
Epoch 3/5:  24%|██▍       | 286/1177 [13:04<37:39,  2.54s/it, exist=0.2858, loss=0.5337, lr=3.36e-05]
Epoch 3/5:  24%|██▍       | 287/1177 [13:04<38:20,  2.58s/it, exist=0.2858, loss=0.5337, lr=3.36e-05]
Epoch 3/5:  24%|██▍       | 287/1177 [13:06<38:20,  2.58s/it, exist=0.2859, loss=0.5337, lr=3.36e-05]
Epoch 3/5:  24%|██▍       | 288/1177 [13:06<35:27,  2.39s/it, exist=0.2859, loss=0.5337, lr=3.36e-05]
Epoch 3/5:  24%|██▍       | 288/1177 [13:09<35:27,  2.39s/it, exist=0.2855, loss=0.5334, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 289/1177 [13:09<39:25,  2.66s/it, exist=0.2855, loss=0.5334, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 289/1177 [13:12<39:25,  2.66s/it, exist=0.2853, loss=0.5332, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 290/1177 [13:12<41:48,  2.83s/it, exist=0.2853, loss=0.5332, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 290/1177 [13:15<41:48,  2.83s/it, exist=0.2855, loss=0.5336, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 291/1177 [13:15<39:52,  2.70s/it, exist=0.2855, loss=0.5336, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 291/1177 [13:17<39:52,  2.70s/it, exist=0.2854, loss=0.5332, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 292/1177 [13:17<39:19,  2.67s/it, exist=0.2854, loss=0.5332, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 292/1177 [13:20<39:19,  2.67s/it, exist=0.2856, loss=0.5340, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 293/1177 [13:20<38:20,  2.60s/it, exist=0.2856, loss=0.5340, lr=3.36e-05]
Epoch 3/5:  25%|██▍       | 293/1177 [13:22<38:20,  2.60s/it, exist=0.2862, loss=0.5345, lr=3.35e-05]
Epoch 3/5:  25%|██▍       | 294/1177 [13:22<35:26,  2.41s/it, exist=0.2862, loss=0.5345, lr=3.35e-05]
Epoch 3/5:  25%|██▍       | 294/1177 [13:24<35:26,  2.41s/it, exist=0.2871, loss=0.5356, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 295/1177 [13:24<36:28,  2.48s/it, exist=0.2871, loss=0.5356, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 295/1177 [13:27<36:28,  2.48s/it, exist=0.2871, loss=0.5354, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 296/1177 [13:27<38:00,  2.59s/it, exist=0.2871, loss=0.5354, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 296/1177 [13:30<38:00,  2.59s/it, exist=0.2870, loss=0.5354, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 297/1177 [13:30<40:51,  2.79s/it, exist=0.2870, loss=0.5354, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 297/1177 [13:34<40:51,  2.79s/it, exist=0.2867, loss=0.5350, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 298/1177 [13:34<42:43,  2.92s/it, exist=0.2867, loss=0.5350, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 298/1177 [13:36<42:43,  2.92s/it, exist=0.2867, loss=0.5348, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 299/1177 [13:36<40:12,  2.75s/it, exist=0.2867, loss=0.5348, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 299/1177 [13:38<40:12,  2.75s/it, exist=0.2863, loss=0.5341, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 300/1177 [13:38<36:41,  2.51s/it, exist=0.2863, loss=0.5341, lr=3.35e-05]
Epoch 3/5:  25%|██▌       | 300/1177 [13:42<36:41,  2.51s/it, exist=0.2860, loss=0.5338, lr=3.35e-05]
Epoch 3/5:  26%|██▌       | 301/1177 [13:42<42:02,  2.88s/it, exist=0.2860, loss=0.5338, lr=3.35e-05]
Epoch 3/5:  26%|██▌       | 301/1177 [13:44<42:02,  2.88s/it, exist=0.2857, loss=0.5333, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 302/1177 [13:44<38:18,  2.63s/it, exist=0.2857, loss=0.5333, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 302/1177 [13:47<38:18,  2.63s/it, exist=0.2856, loss=0.5333, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 303/1177 [13:47<43:23,  2.98s/it, exist=0.2856, loss=0.5333, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 303/1177 [13:50<43:23,  2.98s/it, exist=0.2851, loss=0.5325, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 304/1177 [13:50<40:48,  2.81s/it, exist=0.2851, loss=0.5325, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 304/1177 [13:52<40:48,  2.81s/it, exist=0.2866, loss=0.5338, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 305/1177 [13:52<37:09,  2.56s/it, exist=0.2866, loss=0.5338, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 305/1177 [13:54<37:09,  2.56s/it, exist=0.2863, loss=0.5337, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 306/1177 [13:54<37:31,  2.59s/it, exist=0.2863, loss=0.5337, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 306/1177 [13:56<37:31,  2.59s/it, exist=0.2859, loss=0.5333, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 307/1177 [13:56<34:44,  2.40s/it, exist=0.2859, loss=0.5333, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 307/1177 [13:59<34:44,  2.40s/it, exist=0.2863, loss=0.5335, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 308/1177 [13:59<37:39,  2.60s/it, exist=0.2863, loss=0.5335, lr=3.34e-05]
Epoch 3/5:  26%|██▌       | 308/1177 [14:01<37:39,  2.60s/it, exist=0.2859, loss=0.5332, lr=3.33e-05]
Epoch 3/5:  26%|██▋       | 309/1177 [14:01<34:46,  2.40s/it, exist=0.2859, loss=0.5332, lr=3.33e-05]
Epoch 3/5:  26%|██▋       | 309/1177 [14:03<34:46,  2.40s/it, exist=0.2862, loss=0.5336, lr=3.33e-05]
Epoch 3/5:  26%|██▋       | 310/1177 [14:03<32:51,  2.27s/it, exist=0.2862, loss=0.5336, lr=3.33e-05]
Epoch 3/5:  26%|██▋       | 310/1177 [14:07<32:51,  2.27s/it, exist=0.2856, loss=0.5330, lr=3.33e-05]
Epoch 3/5:  26%|██▋       | 311/1177 [14:07<36:51,  2.55s/it, exist=0.2856, loss=0.5330, lr=3.33e-05]
Epoch 3/5:  26%|██▋       | 311/1177 [14:10<36:51,  2.55s/it, exist=0.2852, loss=0.5323, lr=3.33e-05]
Epoch 3/5:  27%|██▋       | 312/1177 [14:10<40:20,  2.80s/it, exist=0.2852, loss=0.5323, lr=3.33e-05]
Epoch 3/5:  27%|██▋       | 312/1177 [14:13<40:20,  2.80s/it, exist=0.2853, loss=0.5324, lr=3.33e-05]
Epoch 3/5:  27%|██▋       | 313/1177 [14:13<39:39,  2.75s/it, exist=0.2853, loss=0.5324, lr=3.33e-05]
Epoch 3/5:  27%|██▋       | 313/1177 [14:15<39:39,  2.75s/it, exist=0.2854, loss=0.5323, lr=3.33e-05]
Epoch 3/5:  27%|██▋       | 314/1177 [14:15<39:31,  2.75s/it, exist=0.2854, loss=0.5323, lr=3.33e-05]
Epoch 3/5:  27%|██▋       | 314/1177 [14:18<39:31,  2.75s/it, exist=0.2850, loss=0.5321, lr=3.33e-05]
Epoch 3/5:  27%|██▋       | 315/1177 [14:18<38:47,  2.70s/it, exist=0.2850, loss=0.5321, lr=3.33e-05]
Epoch 3/5:  27%|██▋       | 315/1177 [14:21<38:47,  2.70s/it, exist=0.2865, loss=0.5334, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 316/1177 [14:21<38:35,  2.69s/it, exist=0.2865, loss=0.5334, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 316/1177 [14:23<38:35,  2.69s/it, exist=0.2870, loss=0.5338, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 317/1177 [14:23<35:33,  2.48s/it, exist=0.2870, loss=0.5338, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 317/1177 [14:25<35:33,  2.48s/it, exist=0.2881, loss=0.5359, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 318/1177 [14:25<36:23,  2.54s/it, exist=0.2881, loss=0.5359, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 318/1177 [14:28<36:23,  2.54s/it, exist=0.2894, loss=0.5372, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 319/1177 [14:28<36:34,  2.56s/it, exist=0.2894, loss=0.5372, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 319/1177 [14:31<36:34,  2.56s/it, exist=0.2907, loss=0.5387, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 320/1177 [14:31<38:59,  2.73s/it, exist=0.2907, loss=0.5387, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 320/1177 [14:33<38:59,  2.73s/it, exist=0.2912, loss=0.5391, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 321/1177 [14:33<35:39,  2.50s/it, exist=0.2912, loss=0.5391, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 321/1177 [14:35<35:39,  2.50s/it, exist=0.2907, loss=0.5384, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 322/1177 [14:35<33:25,  2.35s/it, exist=0.2907, loss=0.5384, lr=3.32e-05]
Epoch 3/5:  27%|██▋       | 322/1177 [14:38<33:25,  2.35s/it, exist=0.2906, loss=0.5381, lr=3.31e-05]
Epoch 3/5:  27%|██▋       | 323/1177 [14:38<34:28,  2.42s/it, exist=0.2906, loss=0.5381, lr=3.31e-05]
Epoch 3/5:  27%|██▋       | 323/1177 [14:41<34:28,  2.42s/it, exist=0.2904, loss=0.5377, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 324/1177 [14:41<38:39,  2.72s/it, exist=0.2904, loss=0.5377, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 324/1177 [14:44<38:39,  2.72s/it, exist=0.2905, loss=0.5376, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 325/1177 [14:44<41:37,  2.93s/it, exist=0.2905, loss=0.5376, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 325/1177 [14:46<41:37,  2.93s/it, exist=0.2901, loss=0.5370, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 326/1177 [14:46<37:26,  2.64s/it, exist=0.2901, loss=0.5370, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 326/1177 [14:50<37:26,  2.64s/it, exist=0.2901, loss=0.5369, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 327/1177 [14:50<40:48,  2.88s/it, exist=0.2901, loss=0.5369, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 327/1177 [14:52<40:48,  2.88s/it, exist=0.2898, loss=0.5366, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 328/1177 [14:52<39:39,  2.80s/it, exist=0.2898, loss=0.5366, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 328/1177 [14:55<39:39,  2.80s/it, exist=0.2897, loss=0.5364, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 329/1177 [14:55<39:20,  2.78s/it, exist=0.2897, loss=0.5364, lr=3.31e-05]
Epoch 3/5:  28%|██▊       | 329/1177 [14:58<39:20,  2.78s/it, exist=0.2908, loss=0.5385, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 330/1177 [14:58<38:13,  2.71s/it, exist=0.2908, loss=0.5385, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 330/1177 [15:00<38:13,  2.71s/it, exist=0.2914, loss=0.5389, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 331/1177 [15:00<34:55,  2.48s/it, exist=0.2914, loss=0.5389, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 331/1177 [15:03<34:55,  2.48s/it, exist=0.2911, loss=0.5385, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 332/1177 [15:03<38:10,  2.71s/it, exist=0.2911, loss=0.5385, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 332/1177 [15:05<38:10,  2.71s/it, exist=0.2927, loss=0.5399, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 333/1177 [15:05<34:28,  2.45s/it, exist=0.2927, loss=0.5399, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 333/1177 [15:07<34:28,  2.45s/it, exist=0.2930, loss=0.5400, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 334/1177 [15:07<34:49,  2.48s/it, exist=0.2930, loss=0.5400, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 334/1177 [15:11<34:49,  2.48s/it, exist=0.2934, loss=0.5403, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 335/1177 [15:11<38:13,  2.72s/it, exist=0.2934, loss=0.5403, lr=3.30e-05]
Epoch 3/5:  28%|██▊       | 335/1177 [15:13<38:13,  2.72s/it, exist=0.2935, loss=0.5406, lr=3.30e-05]
Epoch 3/5:  29%|██▊       | 336/1177 [15:13<37:46,  2.69s/it, exist=0.2935, loss=0.5406, lr=3.30e-05]
Epoch 3/5:  29%|██▊       | 336/1177 [15:16<37:46,  2.69s/it, exist=0.2936, loss=0.5408, lr=3.29e-05]
Epoch 3/5:  29%|██▊       | 337/1177 [15:16<36:50,  2.63s/it, exist=0.2936, loss=0.5408, lr=3.29e-05]
Epoch 3/5:  29%|██▊       | 337/1177 [15:18<36:50,  2.63s/it, exist=0.2932, loss=0.5405, lr=3.29e-05]
Epoch 3/5:  29%|██▊       | 338/1177 [15:18<36:38,  2.62s/it, exist=0.2932, loss=0.5405, lr=3.29e-05]
Epoch 3/5:  29%|██▊       | 338/1177 [15:20<36:38,  2.62s/it, exist=0.2928, loss=0.5403, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 339/1177 [15:20<33:50,  2.42s/it, exist=0.2928, loss=0.5403, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 339/1177 [15:23<33:50,  2.42s/it, exist=0.2926, loss=0.5401, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 340/1177 [15:23<34:24,  2.47s/it, exist=0.2926, loss=0.5401, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 340/1177 [15:26<34:24,  2.47s/it, exist=0.2922, loss=0.5397, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 341/1177 [15:26<38:19,  2.75s/it, exist=0.2922, loss=0.5397, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 341/1177 [15:29<38:19,  2.75s/it, exist=0.2919, loss=0.5393, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 342/1177 [15:29<37:32,  2.70s/it, exist=0.2919, loss=0.5393, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 342/1177 [15:31<37:32,  2.70s/it, exist=0.2919, loss=0.5393, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 343/1177 [15:31<34:18,  2.47s/it, exist=0.2919, loss=0.5393, lr=3.29e-05]
Epoch 3/5:  29%|██▉       | 343/1177 [15:33<34:18,  2.47s/it, exist=0.2923, loss=0.5394, lr=3.28e-05]
Epoch 3/5:  29%|██▉       | 344/1177 [15:33<34:44,  2.50s/it, exist=0.2923, loss=0.5394, lr=3.28e-05]
Epoch 3/5:  29%|██▉       | 344/1177 [15:37<34:44,  2.50s/it, exist=0.2926, loss=0.5398, lr=3.28e-05]
Epoch 3/5:  29%|██▉       | 345/1177 [15:37<38:21,  2.77s/it, exist=0.2926, loss=0.5398, lr=3.28e-05]
Epoch 3/5:  29%|██▉       | 345/1177 [15:39<38:21,  2.77s/it, exist=0.2923, loss=0.5394, lr=3.28e-05]
Epoch 3/5:  29%|██▉       | 346/1177 [15:39<37:05,  2.68s/it, exist=0.2923, loss=0.5394, lr=3.28e-05]
Epoch 3/5:  29%|██▉       | 346/1177 [15:42<37:05,  2.68s/it, exist=0.2917, loss=0.5387, lr=3.28e-05]
Epoch 3/5:  29%|██▉       | 347/1177 [15:42<39:14,  2.84s/it, exist=0.2917, loss=0.5387, lr=3.28e-05]
Epoch 3/5:  29%|██▉       | 347/1177 [15:44<39:14,  2.84s/it, exist=0.2912, loss=0.5382, lr=3.28e-05]
Epoch 3/5:  30%|██▉       | 348/1177 [15:44<35:30,  2.57s/it, exist=0.2912, loss=0.5382, lr=3.28e-05]
Epoch 3/5:  30%|██▉       | 348/1177 [15:47<35:30,  2.57s/it, exist=0.2906, loss=0.5375, lr=3.28e-05]
Epoch 3/5:  30%|██▉       | 349/1177 [15:47<35:14,  2.55s/it, exist=0.2906, loss=0.5375, lr=3.28e-05]
Epoch 3/5:  30%|██▉       | 349/1177 [15:49<35:14,  2.55s/it, exist=0.2901, loss=0.5370, lr=3.28e-05]
Epoch 3/5:  30%|██▉       | 350/1177 [15:49<32:39,  2.37s/it, exist=0.2901, loss=0.5370, lr=3.28e-05]
Epoch 3/5:  30%|██▉       | 350/1177 [15:51<32:39,  2.37s/it, exist=0.2899, loss=0.5367, lr=3.28e-05]
Epoch 3/5:  30%|██▉       | 351/1177 [15:51<30:48,  2.24s/it, exist=0.2899, loss=0.5367, lr=3.28e-05]
Epoch 3/5:  30%|██▉       | 351/1177 [15:53<30:48,  2.24s/it, exist=0.2893, loss=0.5363, lr=3.27e-05]
Epoch 3/5:  30%|██▉       | 352/1177 [15:53<31:53,  2.32s/it, exist=0.2893, loss=0.5363, lr=3.27e-05]
Epoch 3/5:  30%|██▉       | 352/1177 [15:56<31:53,  2.32s/it, exist=0.2896, loss=0.5367, lr=3.27e-05]
Epoch 3/5:  30%|██▉       | 353/1177 [15:56<35:37,  2.59s/it, exist=0.2896, loss=0.5367, lr=3.27e-05]
Epoch 3/5:  30%|██▉       | 353/1177 [15:58<35:37,  2.59s/it, exist=0.2893, loss=0.5369, lr=3.27e-05]
Epoch 3/5:  30%|███       | 354/1177 [15:58<32:59,  2.41s/it, exist=0.2893, loss=0.5369, lr=3.27e-05]
Epoch 3/5:  30%|███       | 354/1177 [16:01<32:59,  2.41s/it, exist=0.2892, loss=0.5368, lr=3.27e-05]
Epoch 3/5:  30%|███       | 355/1177 [16:01<34:05,  2.49s/it, exist=0.2892, loss=0.5368, lr=3.27e-05]
Epoch 3/5:  30%|███       | 355/1177 [16:05<34:05,  2.49s/it, exist=0.2885, loss=0.5363, lr=3.27e-05]
Epoch 3/5:  30%|███       | 356/1177 [16:05<40:11,  2.94s/it, exist=0.2885, loss=0.5363, lr=3.27e-05]
Epoch 3/5:  30%|███       | 356/1177 [16:08<40:11,  2.94s/it, exist=0.2887, loss=0.5365, lr=3.27e-05]
Epoch 3/5:  30%|███       | 357/1177 [16:08<38:25,  2.81s/it, exist=0.2887, loss=0.5365, lr=3.27e-05]
Epoch 3/5:  30%|███       | 357/1177 [16:10<38:25,  2.81s/it, exist=0.2883, loss=0.5361, lr=3.27e-05]
Epoch 3/5:  30%|███       | 358/1177 [16:10<37:48,  2.77s/it, exist=0.2883, loss=0.5361, lr=3.27e-05]
Epoch 3/5:  30%|███       | 358/1177 [16:12<37:48,  2.77s/it, exist=0.2878, loss=0.5354, lr=3.26e-05]
Epoch 3/5:  31%|███       | 359/1177 [16:12<34:31,  2.53s/it, exist=0.2878, loss=0.5354, lr=3.26e-05]
Epoch 3/5:  31%|███       | 359/1177 [16:16<34:31,  2.53s/it, exist=0.2873, loss=0.5353, lr=3.26e-05]
Epoch 3/5:  31%|███       | 360/1177 [16:16<38:20,  2.82s/it, exist=0.2873, loss=0.5353, lr=3.26e-05]
Epoch 3/5:  31%|███       | 360/1177 [16:18<38:20,  2.82s/it, exist=0.2874, loss=0.5356, lr=3.26e-05]
Epoch 3/5:  31%|███       | 361/1177 [16:18<37:43,  2.77s/it, exist=0.2874, loss=0.5356, lr=3.26e-05]
Epoch 3/5:  31%|███       | 361/1177 [16:21<37:43,  2.77s/it, exist=0.2873, loss=0.5358, lr=3.26e-05]
Epoch 3/5:  31%|███       | 362/1177 [16:21<37:07,  2.73s/it, exist=0.2873, loss=0.5358, lr=3.26e-05]
Epoch 3/5:  31%|███       | 362/1177 [16:24<37:07,  2.73s/it, exist=0.2869, loss=0.5354, lr=3.26e-05]
Epoch 3/5:  31%|███       | 363/1177 [16:24<36:37,  2.70s/it, exist=0.2869, loss=0.5354, lr=3.26e-05]
Epoch 3/5:  31%|███       | 363/1177 [16:26<36:37,  2.70s/it, exist=0.2871, loss=0.5359, lr=3.26e-05]
Epoch 3/5:  31%|███       | 364/1177 [16:26<35:52,  2.65s/it, exist=0.2871, loss=0.5359, lr=3.26e-05]
Epoch 3/5:  31%|███       | 364/1177 [16:29<35:52,  2.65s/it, exist=0.2865, loss=0.5351, lr=3.26e-05]
Epoch 3/5:  31%|███       | 365/1177 [16:29<35:56,  2.66s/it, exist=0.2865, loss=0.5351, lr=3.26e-05]
Epoch 3/5:  31%|███       | 365/1177 [16:31<35:56,  2.66s/it, exist=0.2863, loss=0.5350, lr=3.25e-05]
Epoch 3/5:  31%|███       | 366/1177 [16:31<33:03,  2.45s/it, exist=0.2863, loss=0.5350, lr=3.25e-05]
Epoch 3/5:  31%|███       | 366/1177 [16:33<33:03,  2.45s/it, exist=0.2857, loss=0.5343, lr=3.25e-05]
Epoch 3/5:  31%|███       | 367/1177 [16:33<31:03,  2.30s/it, exist=0.2857, loss=0.5343, lr=3.25e-05]
Epoch 3/5:  31%|███       | 367/1177 [16:36<31:03,  2.30s/it, exist=0.2855, loss=0.5341, lr=3.25e-05]
Epoch 3/5:  31%|███▏      | 368/1177 [16:36<36:43,  2.72s/it, exist=0.2855, loss=0.5341, lr=3.25e-05]
Epoch 3/5:  31%|███▏      | 368/1177 [16:39<36:43,  2.72s/it, exist=0.2860, loss=0.5345, lr=3.25e-05]
Epoch 3/5:  31%|███▏      | 369/1177 [16:39<36:21,  2.70s/it, exist=0.2860, loss=0.5345, lr=3.25e-05]
Epoch 3/5:  31%|███▏      | 369/1177 [16:41<36:21,  2.70s/it, exist=0.2853, loss=0.5341, lr=3.25e-05]
Epoch 3/5:  31%|███▏      | 370/1177 [16:41<33:30,  2.49s/it, exist=0.2853, loss=0.5341, lr=3.25e-05]
Epoch 3/5:  31%|███▏      | 370/1177 [16:44<33:30,  2.49s/it, exist=0.2847, loss=0.5339, lr=3.25e-05]
Epoch 3/5:  32%|███▏      | 371/1177 [16:44<36:13,  2.70s/it, exist=0.2847, loss=0.5339, lr=3.25e-05]
Epoch 3/5:  32%|███▏      | 371/1177 [16:46<36:13,  2.70s/it, exist=0.2850, loss=0.5341, lr=3.25e-05]
Epoch 3/5:  32%|███▏      | 372/1177 [16:46<33:03,  2.46s/it, exist=0.2850, loss=0.5341, lr=3.25e-05]
Epoch 3/5:  32%|███▏      | 372/1177 [16:50<33:03,  2.46s/it, exist=0.2847, loss=0.5340, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 373/1177 [16:50<36:26,  2.72s/it, exist=0.2847, loss=0.5340, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 373/1177 [16:52<36:26,  2.72s/it, exist=0.2858, loss=0.5351, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 374/1177 [16:52<34:55,  2.61s/it, exist=0.2858, loss=0.5351, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 374/1177 [16:54<34:55,  2.61s/it, exist=0.2861, loss=0.5354, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 375/1177 [16:54<32:17,  2.42s/it, exist=0.2861, loss=0.5354, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 375/1177 [16:57<32:17,  2.42s/it, exist=0.2862, loss=0.5356, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 376/1177 [16:57<36:02,  2.70s/it, exist=0.2862, loss=0.5356, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 376/1177 [17:00<36:02,  2.70s/it, exist=0.2861, loss=0.5356, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 377/1177 [17:00<35:05,  2.63s/it, exist=0.2861, loss=0.5356, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 377/1177 [17:02<35:05,  2.63s/it, exist=0.2857, loss=0.5350, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 378/1177 [17:02<32:26,  2.44s/it, exist=0.2857, loss=0.5350, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 378/1177 [17:04<32:26,  2.44s/it, exist=0.2867, loss=0.5359, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 379/1177 [17:04<33:01,  2.48s/it, exist=0.2867, loss=0.5359, lr=3.24e-05]
Epoch 3/5:  32%|███▏      | 379/1177 [17:06<33:01,  2.48s/it, exist=0.2872, loss=0.5362, lr=3.23e-05]
Epoch 3/5:  32%|███▏      | 380/1177 [17:06<31:05,  2.34s/it, exist=0.2872, loss=0.5362, lr=3.23e-05]
Epoch 3/5:  32%|███▏      | 380/1177 [17:09<31:05,  2.34s/it, exist=0.2866, loss=0.5357, lr=3.23e-05]
Epoch 3/5:  32%|███▏      | 381/1177 [17:09<32:26,  2.45s/it, exist=0.2866, loss=0.5357, lr=3.23e-05]
Epoch 3/5:  32%|███▏      | 381/1177 [17:12<32:26,  2.45s/it, exist=0.2863, loss=0.5354, lr=3.23e-05]
Epoch 3/5:  32%|███▏      | 382/1177 [17:12<35:13,  2.66s/it, exist=0.2863, loss=0.5354, lr=3.23e-05]
Epoch 3/5:  32%|███▏      | 382/1177 [17:15<35:13,  2.66s/it, exist=0.2868, loss=0.5362, lr=3.23e-05]
Epoch 3/5:  33%|███▎      | 383/1177 [17:15<35:17,  2.67s/it, exist=0.2868, loss=0.5362, lr=3.23e-05]
Epoch 3/5:  33%|███▎      | 383/1177 [17:17<35:17,  2.67s/it, exist=0.2865, loss=0.5358, lr=3.23e-05]
Epoch 3/5:  33%|███▎      | 384/1177 [17:17<34:53,  2.64s/it, exist=0.2865, loss=0.5358, lr=3.23e-05]
Epoch 3/5:  33%|███▎      | 384/1177 [17:20<34:53,  2.64s/it, exist=0.2860, loss=0.5354, lr=3.23e-05]
Epoch 3/5:  33%|███▎      | 385/1177 [17:20<34:18,  2.60s/it, exist=0.2860, loss=0.5354, lr=3.23e-05]
Epoch 3/5:  33%|███▎      | 385/1177 [17:23<34:18,  2.60s/it, exist=0.2854, loss=0.5347, lr=3.23e-05]
Epoch 3/5:  33%|███▎      | 386/1177 [17:23<34:41,  2.63s/it, exist=0.2854, loss=0.5347, lr=3.23e-05]
Epoch 3/5:  33%|███▎      | 386/1177 [17:25<34:41,  2.63s/it, exist=0.2855, loss=0.5348, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 387/1177 [17:25<34:44,  2.64s/it, exist=0.2855, loss=0.5348, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 387/1177 [17:28<34:44,  2.64s/it, exist=0.2861, loss=0.5353, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 388/1177 [17:28<36:44,  2.79s/it, exist=0.2861, loss=0.5353, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 388/1177 [17:31<36:44,  2.79s/it, exist=0.2862, loss=0.5355, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 389/1177 [17:31<35:20,  2.69s/it, exist=0.2862, loss=0.5355, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 389/1177 [17:34<35:20,  2.69s/it, exist=0.2862, loss=0.5354, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 390/1177 [17:34<35:40,  2.72s/it, exist=0.2862, loss=0.5354, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 390/1177 [17:36<35:40,  2.72s/it, exist=0.2859, loss=0.5351, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 391/1177 [17:36<35:16,  2.69s/it, exist=0.2859, loss=0.5351, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 391/1177 [17:39<35:16,  2.69s/it, exist=0.2853, loss=0.5346, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 392/1177 [17:39<35:05,  2.68s/it, exist=0.2853, loss=0.5346, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 392/1177 [17:41<35:05,  2.68s/it, exist=0.2859, loss=0.5351, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 393/1177 [17:41<32:13,  2.47s/it, exist=0.2859, loss=0.5351, lr=3.22e-05]
Epoch 3/5:  33%|███▎      | 393/1177 [17:44<32:13,  2.47s/it, exist=0.2856, loss=0.5349, lr=3.21e-05]
Epoch 3/5:  33%|███▎      | 394/1177 [17:44<34:29,  2.64s/it, exist=0.2856, loss=0.5349, lr=3.21e-05]
Epoch 3/5:  33%|███▎      | 394/1177 [17:46<34:29,  2.64s/it, exist=0.2852, loss=0.5345, lr=3.21e-05]
Epoch 3/5:  34%|███▎      | 395/1177 [17:46<33:37,  2.58s/it, exist=0.2852, loss=0.5345, lr=3.21e-05]
Epoch 3/5:  34%|███▎      | 395/1177 [17:49<33:37,  2.58s/it, exist=0.2846, loss=0.5339, lr=3.21e-05]
Epoch 3/5:  34%|███▎      | 396/1177 [17:49<32:59,  2.53s/it, exist=0.2846, loss=0.5339, lr=3.21e-05]
Epoch 3/5:  34%|███▎      | 396/1177 [17:51<32:59,  2.53s/it, exist=0.2843, loss=0.5336, lr=3.21e-05]
Epoch 3/5:  34%|███▎      | 397/1177 [17:51<30:40,  2.36s/it, exist=0.2843, loss=0.5336, lr=3.21e-05]
Epoch 3/5:  34%|███▎      | 397/1177 [17:54<30:40,  2.36s/it, exist=0.2838, loss=0.5330, lr=3.21e-05]
Epoch 3/5:  34%|███▍      | 398/1177 [17:54<33:43,  2.60s/it, exist=0.2838, loss=0.5330, lr=3.21e-05]
Epoch 3/5:  34%|███▍      | 398/1177 [17:56<33:43,  2.60s/it, exist=0.2845, loss=0.5339, lr=3.21e-05]
Epoch 3/5:  34%|███▍      | 399/1177 [17:56<31:06,  2.40s/it, exist=0.2845, loss=0.5339, lr=3.21e-05]
Epoch 3/5:  34%|███▍      | 399/1177 [17:58<31:06,  2.40s/it, exist=0.2842, loss=0.5335, lr=3.21e-05]
Epoch 3/5:  34%|███▍      | 400/1177 [17:58<31:10,  2.41s/it, exist=0.2842, loss=0.5335, lr=3.21e-05]
Epoch 3/5:  34%|███▍      | 400/1177 [18:01<31:10,  2.41s/it, exist=0.2847, loss=0.5345, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 401/1177 [18:01<32:08,  2.49s/it, exist=0.2847, loss=0.5345, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 401/1177 [18:03<32:08,  2.49s/it, exist=0.2844, loss=0.5342, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 402/1177 [18:03<30:00,  2.32s/it, exist=0.2844, loss=0.5342, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 402/1177 [18:06<30:00,  2.32s/it, exist=0.2839, loss=0.5336, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 403/1177 [18:06<34:29,  2.67s/it, exist=0.2839, loss=0.5336, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 403/1177 [18:09<34:29,  2.67s/it, exist=0.2840, loss=0.5337, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 404/1177 [18:09<34:45,  2.70s/it, exist=0.2840, loss=0.5337, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 404/1177 [18:12<34:45,  2.70s/it, exist=0.2838, loss=0.5334, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 405/1177 [18:12<37:07,  2.89s/it, exist=0.2838, loss=0.5334, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 405/1177 [18:15<37:07,  2.89s/it, exist=0.2834, loss=0.5331, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 406/1177 [18:15<36:16,  2.82s/it, exist=0.2834, loss=0.5331, lr=3.20e-05]
Epoch 3/5:  34%|███▍      | 406/1177 [18:17<36:16,  2.82s/it, exist=0.2833, loss=0.5330, lr=3.20e-05]
Epoch 3/5:  35%|███▍      | 407/1177 [18:17<33:00,  2.57s/it, exist=0.2833, loss=0.5330, lr=3.20e-05]
Epoch 3/5:  35%|███▍      | 407/1177 [18:21<33:00,  2.57s/it, exist=0.2830, loss=0.5325, lr=3.19e-05]
Epoch 3/5:  35%|███▍      | 408/1177 [18:21<36:58,  2.89s/it, exist=0.2830, loss=0.5325, lr=3.19e-05]
Epoch 3/5:  35%|███▍      | 408/1177 [18:25<36:58,  2.89s/it, exist=0.2825, loss=0.5320, lr=3.19e-05]
Epoch 3/5:  35%|███▍      | 409/1177 [18:25<44:06,  3.45s/it, exist=0.2825, loss=0.5320, lr=3.19e-05]
Epoch 3/5:  35%|███▍      | 409/1177 [18:30<44:06,  3.45s/it, exist=0.2824, loss=0.5321, lr=3.19e-05]
Epoch 3/5:  35%|███▍      | 410/1177 [18:30<48:16,  3.78s/it, exist=0.2824, loss=0.5321, lr=3.19e-05]
Epoch 3/5:  35%|███▍      | 410/1177 [18:32<48:16,  3.78s/it, exist=0.2824, loss=0.5321, lr=3.19e-05]
Epoch 3/5:  35%|███▍      | 411/1177 [18:32<41:15,  3.23s/it, exist=0.2824, loss=0.5321, lr=3.19e-05]
Epoch 3/5:  35%|███▍      | 411/1177 [18:34<41:15,  3.23s/it, exist=0.2822, loss=0.5320, lr=3.19e-05]
Epoch 3/5:  35%|███▌      | 412/1177 [18:34<36:13,  2.84s/it, exist=0.2822, loss=0.5320, lr=3.19e-05]
Epoch 3/5:  35%|███▌      | 412/1177 [18:37<36:13,  2.84s/it, exist=0.2825, loss=0.5323, lr=3.19e-05]
Epoch 3/5:  35%|███▌      | 413/1177 [18:37<35:14,  2.77s/it, exist=0.2825, loss=0.5323, lr=3.19e-05]
Epoch 3/5:  35%|███▌      | 413/1177 [18:38<35:14,  2.77s/it, exist=0.2827, loss=0.5326, lr=3.19e-05]
Epoch 3/5:  35%|███▌      | 414/1177 [18:38<32:08,  2.53s/it, exist=0.2827, loss=0.5326, lr=3.19e-05]
Epoch 3/5:  35%|███▌      | 414/1177 [18:41<32:08,  2.53s/it, exist=0.2827, loss=0.5325, lr=3.18e-05]
Epoch 3/5:  35%|███▌      | 415/1177 [18:41<32:26,  2.55s/it, exist=0.2827, loss=0.5325, lr=3.18e-05]
Epoch 3/5:  35%|███▌      | 415/1177 [18:44<32:26,  2.55s/it, exist=0.2826, loss=0.5325, lr=3.18e-05]
Epoch 3/5:  35%|███▌      | 416/1177 [18:44<32:23,  2.55s/it, exist=0.2826, loss=0.5325, lr=3.18e-05]
Epoch 3/5:  35%|███▌      | 416/1177 [18:47<32:23,  2.55s/it, exist=0.2828, loss=0.5324, lr=3.18e-05]
Epoch 3/5:  35%|███▌      | 417/1177 [18:47<34:59,  2.76s/it, exist=0.2828, loss=0.5324, lr=3.18e-05]
Epoch 3/5:  35%|███▌      | 417/1177 [18:49<34:59,  2.76s/it, exist=0.2829, loss=0.5324, lr=3.18e-05]
Epoch 3/5:  36%|███▌      | 418/1177 [18:49<31:54,  2.52s/it, exist=0.2829, loss=0.5324, lr=3.18e-05]
Epoch 3/5:  36%|███▌      | 418/1177 [18:51<31:54,  2.52s/it, exist=0.2831, loss=0.5323, lr=3.18e-05]
Epoch 3/5:  36%|███▌      | 419/1177 [18:51<31:45,  2.51s/it, exist=0.2831, loss=0.5323, lr=3.18e-05]
Epoch 3/5:  36%|███▌      | 419/1177 [18:53<31:45,  2.51s/it, exist=0.2826, loss=0.5320, lr=3.18e-05]
Epoch 3/5:  36%|███▌      | 420/1177 [18:53<30:02,  2.38s/it, exist=0.2826, loss=0.5320, lr=3.18e-05]
Epoch 3/5:  36%|███▌      | 420/1177 [18:57<30:02,  2.38s/it, exist=0.2825, loss=0.5318, lr=3.18e-05]
Epoch 3/5:  36%|███▌      | 421/1177 [18:57<33:49,  2.69s/it, exist=0.2825, loss=0.5318, lr=3.18e-05]
Epoch 3/5:  36%|███▌      | 421/1177 [19:00<33:49,  2.69s/it, exist=0.2825, loss=0.5321, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 422/1177 [19:00<35:34,  2.83s/it, exist=0.2825, loss=0.5321, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 422/1177 [19:02<35:34,  2.83s/it, exist=0.2825, loss=0.5319, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 423/1177 [19:02<34:08,  2.72s/it, exist=0.2825, loss=0.5319, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 423/1177 [19:04<34:08,  2.72s/it, exist=0.2824, loss=0.5317, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 424/1177 [19:04<31:22,  2.50s/it, exist=0.2824, loss=0.5317, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 424/1177 [19:08<31:22,  2.50s/it, exist=0.2823, loss=0.5315, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 425/1177 [19:08<34:13,  2.73s/it, exist=0.2823, loss=0.5315, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 425/1177 [19:10<34:13,  2.73s/it, exist=0.2818, loss=0.5311, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 426/1177 [19:10<33:41,  2.69s/it, exist=0.2818, loss=0.5311, lr=3.17e-05]
Epoch 3/5:  36%|███▌      | 426/1177 [19:13<33:41,  2.69s/it, exist=0.2820, loss=0.5315, lr=3.17e-05]
Epoch 3/5:  36%|███▋      | 427/1177 [19:13<33:34,  2.69s/it, exist=0.2820, loss=0.5315, lr=3.17e-05]
Epoch 3/5:  36%|███▋      | 427/1177 [19:16<33:34,  2.69s/it, exist=0.2815, loss=0.5309, lr=3.17e-05]
Epoch 3/5:  36%|███▋      | 428/1177 [19:16<33:21,  2.67s/it, exist=0.2815, loss=0.5309, lr=3.17e-05]
Epoch 3/5:  36%|███▋      | 428/1177 [19:18<33:21,  2.67s/it, exist=0.2815, loss=0.5307, lr=3.16e-05]
Epoch 3/5:  36%|███▋      | 429/1177 [19:18<33:13,  2.66s/it, exist=0.2815, loss=0.5307, lr=3.16e-05]
Epoch 3/5:  36%|███▋      | 429/1177 [19:20<33:13,  2.66s/it, exist=0.2814, loss=0.5310, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 430/1177 [19:20<30:34,  2.46s/it, exist=0.2814, loss=0.5310, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 430/1177 [19:23<30:34,  2.46s/it, exist=0.2809, loss=0.5306, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 431/1177 [19:23<33:21,  2.68s/it, exist=0.2809, loss=0.5306, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 431/1177 [19:26<33:21,  2.68s/it, exist=0.2810, loss=0.5304, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 432/1177 [19:26<32:54,  2.65s/it, exist=0.2810, loss=0.5304, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 432/1177 [19:29<32:54,  2.65s/it, exist=0.2813, loss=0.5311, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 433/1177 [19:29<33:32,  2.71s/it, exist=0.2813, loss=0.5311, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 433/1177 [19:31<33:32,  2.71s/it, exist=0.2812, loss=0.5308, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 434/1177 [19:31<33:03,  2.67s/it, exist=0.2812, loss=0.5308, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 434/1177 [19:33<33:03,  2.67s/it, exist=0.2808, loss=0.5310, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 435/1177 [19:33<30:35,  2.47s/it, exist=0.2808, loss=0.5310, lr=3.16e-05]
Epoch 3/5:  37%|███▋      | 435/1177 [19:37<30:35,  2.47s/it, exist=0.2809, loss=0.5310, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 436/1177 [19:37<33:21,  2.70s/it, exist=0.2809, loss=0.5310, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 436/1177 [19:39<33:21,  2.70s/it, exist=0.2806, loss=0.5306, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 437/1177 [19:39<32:22,  2.63s/it, exist=0.2806, loss=0.5306, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 437/1177 [19:41<32:22,  2.63s/it, exist=0.2807, loss=0.5308, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 438/1177 [19:41<29:53,  2.43s/it, exist=0.2807, loss=0.5308, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 438/1177 [19:44<29:53,  2.43s/it, exist=0.2806, loss=0.5305, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 439/1177 [19:44<32:54,  2.68s/it, exist=0.2806, loss=0.5305, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 439/1177 [19:47<32:54,  2.68s/it, exist=0.2801, loss=0.5298, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 440/1177 [19:47<32:45,  2.67s/it, exist=0.2801, loss=0.5298, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 440/1177 [19:49<32:45,  2.67s/it, exist=0.2800, loss=0.5299, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 441/1177 [19:49<30:06,  2.45s/it, exist=0.2800, loss=0.5299, lr=3.15e-05]
Epoch 3/5:  37%|███▋      | 441/1177 [19:52<30:06,  2.45s/it, exist=0.2797, loss=0.5298, lr=3.15e-05]
Epoch 3/5:  38%|███▊      | 442/1177 [19:52<32:16,  2.64s/it, exist=0.2797, loss=0.5298, lr=3.15e-05]
Epoch 3/5:  38%|███▊      | 442/1177 [19:54<32:16,  2.64s/it, exist=0.2794, loss=0.5296, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 443/1177 [19:54<29:46,  2.43s/it, exist=0.2794, loss=0.5296, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 443/1177 [19:57<29:46,  2.43s/it, exist=0.2792, loss=0.5295, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 444/1177 [19:57<32:11,  2.63s/it, exist=0.2792, loss=0.5295, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 444/1177 [20:00<32:11,  2.63s/it, exist=0.2789, loss=0.5292, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 445/1177 [20:00<31:59,  2.62s/it, exist=0.2789, loss=0.5292, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 445/1177 [20:02<31:59,  2.62s/it, exist=0.2790, loss=0.5294, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 446/1177 [20:02<29:30,  2.42s/it, exist=0.2790, loss=0.5294, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 446/1177 [20:04<29:30,  2.42s/it, exist=0.2795, loss=0.5298, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 447/1177 [20:04<30:08,  2.48s/it, exist=0.2795, loss=0.5298, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 447/1177 [20:07<30:08,  2.48s/it, exist=0.2791, loss=0.5296, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 448/1177 [20:07<30:45,  2.53s/it, exist=0.2791, loss=0.5296, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 448/1177 [20:10<30:45,  2.53s/it, exist=0.2797, loss=0.5302, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 449/1177 [20:10<31:12,  2.57s/it, exist=0.2797, loss=0.5302, lr=3.14e-05]
Epoch 3/5:  38%|███▊      | 449/1177 [20:13<31:12,  2.57s/it, exist=0.2798, loss=0.5302, lr=3.13e-05]
Epoch 3/5:  38%|███▊      | 450/1177 [20:13<33:44,  2.78s/it, exist=0.2798, loss=0.5302, lr=3.13e-05]
Epoch 3/5:  38%|███▊      | 450/1177 [20:16<33:44,  2.78s/it, exist=0.2799, loss=0.5302, lr=3.13e-05]
Epoch 3/5:  38%|███▊      | 451/1177 [20:16<33:31,  2.77s/it, exist=0.2799, loss=0.5302, lr=3.13e-05]
Epoch 3/5:  38%|███▊      | 451/1177 [20:18<33:31,  2.77s/it, exist=0.2801, loss=0.5304, lr=3.13e-05]
Epoch 3/5:  38%|███▊      | 452/1177 [20:18<32:53,  2.72s/it, exist=0.2801, loss=0.5304, lr=3.13e-05]
Epoch 3/5:  38%|███▊      | 452/1177 [20:20<32:53,  2.72s/it, exist=0.2798, loss=0.5305, lr=3.13e-05]
Epoch 3/5:  38%|███▊      | 453/1177 [20:20<30:10,  2.50s/it, exist=0.2798, loss=0.5305, lr=3.13e-05]
Epoch 3/5:  38%|███▊      | 453/1177 [20:23<30:10,  2.50s/it, exist=0.2800, loss=0.5307, lr=3.13e-05]
Epoch 3/5:  39%|███▊      | 454/1177 [20:23<32:52,  2.73s/it, exist=0.2800, loss=0.5307, lr=3.13e-05]
Epoch 3/5:  39%|███▊      | 454/1177 [20:25<32:52,  2.73s/it, exist=0.2805, loss=0.5313, lr=3.13e-05]
Epoch 3/5:  39%|███▊      | 455/1177 [20:25<30:01,  2.49s/it, exist=0.2805, loss=0.5313, lr=3.13e-05]
Epoch 3/5:  39%|███▊      | 455/1177 [20:28<30:01,  2.49s/it, exist=0.2801, loss=0.5312, lr=3.13e-05]
Epoch 3/5:  39%|███▊      | 456/1177 [20:28<29:52,  2.49s/it, exist=0.2801, loss=0.5312, lr=3.13e-05]
Epoch 3/5:  39%|███▊      | 456/1177 [20:31<29:52,  2.49s/it, exist=0.2798, loss=0.5309, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 457/1177 [20:31<30:44,  2.56s/it, exist=0.2798, loss=0.5309, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 457/1177 [20:33<30:44,  2.56s/it, exist=0.2794, loss=0.5305, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 458/1177 [20:33<31:14,  2.61s/it, exist=0.2794, loss=0.5305, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 458/1177 [20:35<31:14,  2.61s/it, exist=0.2795, loss=0.5304, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 459/1177 [20:35<28:52,  2.41s/it, exist=0.2795, loss=0.5304, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 459/1177 [20:39<28:52,  2.41s/it, exist=0.2798, loss=0.5306, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 460/1177 [20:39<34:02,  2.85s/it, exist=0.2798, loss=0.5306, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 460/1177 [20:42<34:02,  2.85s/it, exist=0.2805, loss=0.5313, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 461/1177 [20:42<34:38,  2.90s/it, exist=0.2805, loss=0.5313, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 461/1177 [20:45<34:38,  2.90s/it, exist=0.2804, loss=0.5311, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 462/1177 [20:45<33:46,  2.83s/it, exist=0.2804, loss=0.5311, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 462/1177 [20:47<33:46,  2.83s/it, exist=0.2800, loss=0.5305, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 463/1177 [20:47<32:51,  2.76s/it, exist=0.2800, loss=0.5305, lr=3.12e-05]
Epoch 3/5:  39%|███▉      | 463/1177 [20:49<32:51,  2.76s/it, exist=0.2798, loss=0.5302, lr=3.11e-05]
Epoch 3/5:  39%|███▉      | 464/1177 [20:49<30:07,  2.54s/it, exist=0.2798, loss=0.5302, lr=3.11e-05]
Epoch 3/5:  39%|███▉      | 464/1177 [20:53<30:07,  2.54s/it, exist=0.2796, loss=0.5299, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 465/1177 [20:53<32:35,  2.75s/it, exist=0.2796, loss=0.5299, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 465/1177 [20:55<32:35,  2.75s/it, exist=0.2795, loss=0.5296, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 466/1177 [20:55<32:17,  2.73s/it, exist=0.2795, loss=0.5296, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 466/1177 [20:57<32:17,  2.73s/it, exist=0.2793, loss=0.5294, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 467/1177 [20:57<29:29,  2.49s/it, exist=0.2793, loss=0.5294, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 467/1177 [21:01<29:29,  2.49s/it, exist=0.2789, loss=0.5289, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 468/1177 [21:01<31:58,  2.71s/it, exist=0.2789, loss=0.5289, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 468/1177 [21:03<31:58,  2.71s/it, exist=0.2786, loss=0.5287, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 469/1177 [21:03<29:25,  2.49s/it, exist=0.2786, loss=0.5287, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 469/1177 [21:05<29:25,  2.49s/it, exist=0.2782, loss=0.5282, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 470/1177 [21:05<29:21,  2.49s/it, exist=0.2782, loss=0.5282, lr=3.11e-05]
Epoch 3/5:  40%|███▉      | 470/1177 [21:08<29:21,  2.49s/it, exist=0.2795, loss=0.5293, lr=3.10e-05]
Epoch 3/5:  40%|████      | 471/1177 [21:08<31:58,  2.72s/it, exist=0.2795, loss=0.5293, lr=3.10e-05]
Epoch 3/5:  40%|████      | 471/1177 [21:11<31:58,  2.72s/it, exist=0.2793, loss=0.5292, lr=3.10e-05]
Epoch 3/5:  40%|████      | 472/1177 [21:11<31:50,  2.71s/it, exist=0.2793, loss=0.5292, lr=3.10e-05]
Epoch 3/5:  40%|████      | 472/1177 [21:13<31:50,  2.71s/it, exist=0.2791, loss=0.5290, lr=3.10e-05]
Epoch 3/5:  40%|████      | 473/1177 [21:13<29:14,  2.49s/it, exist=0.2791, loss=0.5290, lr=3.10e-05]
Epoch 3/5:  40%|████      | 473/1177 [21:15<29:14,  2.49s/it, exist=0.2786, loss=0.5285, lr=3.10e-05]
Epoch 3/5:  40%|████      | 474/1177 [21:15<27:21,  2.33s/it, exist=0.2786, loss=0.5285, lr=3.10e-05]
Epoch 3/5:  40%|████      | 474/1177 [21:18<27:21,  2.33s/it, exist=0.2782, loss=0.5281, lr=3.10e-05]
Epoch 3/5:  40%|████      | 475/1177 [21:18<31:03,  2.66s/it, exist=0.2782, loss=0.5281, lr=3.10e-05]
Epoch 3/5:  40%|████      | 475/1177 [21:21<31:03,  2.66s/it, exist=0.2785, loss=0.5284, lr=3.10e-05]
Epoch 3/5:  40%|████      | 476/1177 [21:21<30:50,  2.64s/it, exist=0.2785, loss=0.5284, lr=3.10e-05]
Epoch 3/5:  40%|████      | 476/1177 [21:24<30:50,  2.64s/it, exist=0.2787, loss=0.5285, lr=3.10e-05]
Epoch 3/5:  41%|████      | 477/1177 [21:24<32:19,  2.77s/it, exist=0.2787, loss=0.5285, lr=3.10e-05]
Epoch 3/5:  41%|████      | 477/1177 [21:27<32:19,  2.77s/it, exist=0.2785, loss=0.5284, lr=3.09e-05]
Epoch 3/5:  41%|████      | 478/1177 [21:27<32:00,  2.75s/it, exist=0.2785, loss=0.5284, lr=3.09e-05]
Epoch 3/5:  41%|████      | 478/1177 [21:29<32:00,  2.75s/it, exist=0.2785, loss=0.5283, lr=3.09e-05]
Epoch 3/5:  41%|████      | 479/1177 [21:29<29:19,  2.52s/it, exist=0.2785, loss=0.5283, lr=3.09e-05]
Epoch 3/5:  41%|████      | 479/1177 [21:32<29:19,  2.52s/it, exist=0.2783, loss=0.5281, lr=3.09e-05]
Epoch 3/5:  41%|████      | 480/1177 [21:32<32:33,  2.80s/it, exist=0.2783, loss=0.5281, lr=3.09e-05]
Epoch 3/5:  41%|████      | 480/1177 [21:35<32:33,  2.80s/it, exist=0.2792, loss=0.5288, lr=3.09e-05]
Epoch 3/5:  41%|████      | 481/1177 [21:35<31:53,  2.75s/it, exist=0.2792, loss=0.5288, lr=3.09e-05]
Epoch 3/5:  41%|████      | 481/1177 [21:37<31:53,  2.75s/it, exist=0.2792, loss=0.5287, lr=3.09e-05]
Epoch 3/5:  41%|████      | 482/1177 [21:37<31:24,  2.71s/it, exist=0.2792, loss=0.5287, lr=3.09e-05]
Epoch 3/5:  41%|████      | 482/1177 [21:39<31:24,  2.71s/it, exist=0.2790, loss=0.5286, lr=3.09e-05]
Epoch 3/5:  41%|████      | 483/1177 [21:39<28:53,  2.50s/it, exist=0.2790, loss=0.5286, lr=3.09e-05]
Epoch 3/5:  41%|████      | 483/1177 [21:42<28:53,  2.50s/it, exist=0.2795, loss=0.5290, lr=3.09e-05]
Epoch 3/5:  41%|████      | 484/1177 [21:42<30:33,  2.65s/it, exist=0.2795, loss=0.5290, lr=3.09e-05]
Epoch 3/5:  41%|████      | 484/1177 [21:44<30:33,  2.65s/it, exist=0.2795, loss=0.5288, lr=3.08e-05]
Epoch 3/5:  41%|████      | 485/1177 [21:44<27:57,  2.42s/it, exist=0.2795, loss=0.5288, lr=3.08e-05]
Epoch 3/5:  41%|████      | 485/1177 [21:47<27:57,  2.42s/it, exist=0.2792, loss=0.5286, lr=3.08e-05]
Epoch 3/5:  41%|████▏     | 486/1177 [21:47<29:41,  2.58s/it, exist=0.2792, loss=0.5286, lr=3.08e-05]
Epoch 3/5:  41%|████▏     | 486/1177 [21:50<29:41,  2.58s/it, exist=0.2788, loss=0.5282, lr=3.08e-05]
Epoch 3/5:  41%|████▏     | 487/1177 [21:50<29:37,  2.58s/it, exist=0.2788, loss=0.5282, lr=3.08e-05]
Epoch 3/5:  41%|████▏     | 487/1177 [21:52<29:37,  2.58s/it, exist=0.2785, loss=0.5279, lr=3.08e-05]
Epoch 3/5:  41%|████▏     | 488/1177 [21:52<29:50,  2.60s/it, exist=0.2785, loss=0.5279, lr=3.08e-05]
Epoch 3/5:  41%|████▏     | 488/1177 [21:55<29:50,  2.60s/it, exist=0.2781, loss=0.5274, lr=3.08e-05]
Epoch 3/5:  42%|████▏     | 489/1177 [21:55<29:52,  2.61s/it, exist=0.2781, loss=0.5274, lr=3.08e-05]
Epoch 3/5:  42%|████▏     | 489/1177 [21:58<29:52,  2.61s/it, exist=0.2777, loss=0.5270, lr=3.08e-05]
Epoch 3/5:  42%|████▏     | 490/1177 [21:58<29:54,  2.61s/it, exist=0.2777, loss=0.5270, lr=3.08e-05]
Epoch 3/5:  42%|████▏     | 490/1177 [22:00<29:54,  2.61s/it, exist=0.2775, loss=0.5267, lr=3.08e-05]
Epoch 3/5:  42%|████▏     | 491/1177 [22:00<27:49,  2.43s/it, exist=0.2775, loss=0.5267, lr=3.08e-05]
Epoch 3/5:  42%|████▏     | 491/1177 [22:03<27:49,  2.43s/it, exist=0.2780, loss=0.5274, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 492/1177 [22:03<30:38,  2.68s/it, exist=0.2780, loss=0.5274, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 492/1177 [22:05<30:38,  2.68s/it, exist=0.2781, loss=0.5273, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 493/1177 [22:05<29:45,  2.61s/it, exist=0.2781, loss=0.5273, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 493/1177 [22:08<29:45,  2.61s/it, exist=0.2778, loss=0.5270, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 494/1177 [22:08<29:07,  2.56s/it, exist=0.2778, loss=0.5270, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 494/1177 [22:10<29:07,  2.56s/it, exist=0.2789, loss=0.5281, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 495/1177 [22:10<26:54,  2.37s/it, exist=0.2789, loss=0.5281, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 495/1177 [22:13<26:54,  2.37s/it, exist=0.2789, loss=0.5280, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 496/1177 [22:13<30:04,  2.65s/it, exist=0.2789, loss=0.5280, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 496/1177 [22:15<30:04,  2.65s/it, exist=0.2790, loss=0.5281, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 497/1177 [22:15<29:11,  2.58s/it, exist=0.2790, loss=0.5281, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 497/1177 [22:18<29:11,  2.58s/it, exist=0.2786, loss=0.5276, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 498/1177 [22:18<29:18,  2.59s/it, exist=0.2786, loss=0.5276, lr=3.07e-05]
Epoch 3/5:  42%|████▏     | 498/1177 [22:20<29:18,  2.59s/it, exist=0.2781, loss=0.5271, lr=3.06e-05]
Epoch 3/5:  42%|████▏     | 499/1177 [22:20<27:05,  2.40s/it, exist=0.2781, loss=0.5271, lr=3.06e-05]
Epoch 3/5:  42%|████▏     | 499/1177 [22:24<27:05,  2.40s/it, exist=0.2778, loss=0.5266, lr=3.06e-05]
Epoch 3/5:  42%|████▏     | 500/1177 [22:24<31:22,  2.78s/it, exist=0.2778, loss=0.5266, lr=3.06e-05]
Epoch 3/5:  42%|████▏     | 500/1177 [22:27<31:22,  2.78s/it, exist=0.2779, loss=0.5267, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 501/1177 [22:27<34:22,  3.05s/it, exist=0.2779, loss=0.5267, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 501/1177 [22:32<34:22,  3.05s/it, exist=0.2780, loss=0.5269, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 502/1177 [22:32<40:18,  3.58s/it, exist=0.2780, loss=0.5269, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 502/1177 [22:35<40:18,  3.58s/it, exist=0.2776, loss=0.5266, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 503/1177 [22:35<37:51,  3.37s/it, exist=0.2776, loss=0.5266, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 503/1177 [22:38<37:51,  3.37s/it, exist=0.2772, loss=0.5263, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 504/1177 [22:38<36:31,  3.26s/it, exist=0.2772, loss=0.5263, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 504/1177 [22:40<36:31,  3.26s/it, exist=0.2771, loss=0.5260, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 505/1177 [22:40<32:07,  2.87s/it, exist=0.2771, loss=0.5260, lr=3.06e-05]
Epoch 3/5:  43%|████▎     | 505/1177 [22:42<32:07,  2.87s/it, exist=0.2775, loss=0.5266, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 506/1177 [22:42<29:00,  2.59s/it, exist=0.2775, loss=0.5266, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 506/1177 [22:46<29:00,  2.59s/it, exist=0.2776, loss=0.5267, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 507/1177 [22:46<33:00,  2.96s/it, exist=0.2776, loss=0.5267, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 507/1177 [22:48<33:00,  2.96s/it, exist=0.2773, loss=0.5264, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 508/1177 [22:48<31:48,  2.85s/it, exist=0.2773, loss=0.5264, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 508/1177 [22:50<31:48,  2.85s/it, exist=0.2774, loss=0.5264, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 509/1177 [22:50<28:39,  2.57s/it, exist=0.2774, loss=0.5264, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 509/1177 [22:53<28:39,  2.57s/it, exist=0.2771, loss=0.5261, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 510/1177 [22:53<28:15,  2.54s/it, exist=0.2771, loss=0.5261, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 510/1177 [22:56<28:15,  2.54s/it, exist=0.2769, loss=0.5261, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 511/1177 [22:56<30:41,  2.76s/it, exist=0.2769, loss=0.5261, lr=3.05e-05]
Epoch 3/5:  43%|████▎     | 511/1177 [23:00<30:41,  2.76s/it, exist=0.2770, loss=0.5266, lr=3.04e-05]
Epoch 3/5:  44%|████▎     | 512/1177 [23:00<34:55,  3.15s/it, exist=0.2770, loss=0.5266, lr=3.04e-05]
Epoch 3/5:  44%|████▎     | 512/1177 [23:03<34:55,  3.15s/it, exist=0.2767, loss=0.5263, lr=3.04e-05]
Epoch 3/5:  44%|████▎     | 513/1177 [23:03<33:00,  2.98s/it, exist=0.2767, loss=0.5263, lr=3.04e-05]
Epoch 3/5:  44%|████▎     | 513/1177 [23:05<33:00,  2.98s/it, exist=0.2776, loss=0.5272, lr=3.04e-05]
Epoch 3/5:  44%|████▎     | 514/1177 [23:05<29:27,  2.67s/it, exist=0.2776, loss=0.5272, lr=3.04e-05]
Epoch 3/5:  44%|████▎     | 514/1177 [23:07<29:27,  2.67s/it, exist=0.2777, loss=0.5275, lr=3.04e-05]
Epoch 3/5:  44%|████▍     | 515/1177 [23:07<27:02,  2.45s/it, exist=0.2777, loss=0.5275, lr=3.04e-05]
Epoch 3/5:  44%|████▍     | 515/1177 [23:10<27:02,  2.45s/it, exist=0.2778, loss=0.5276, lr=3.04e-05]
Epoch 3/5:  44%|████▍     | 516/1177 [23:10<28:44,  2.61s/it, exist=0.2778, loss=0.5276, lr=3.04e-05]
Epoch 3/5:  44%|████▍     | 516/1177 [23:12<28:44,  2.61s/it, exist=0.2778, loss=0.5275, lr=3.04e-05]
Epoch 3/5:  44%|████▍     | 517/1177 [23:12<26:28,  2.41s/it, exist=0.2778, loss=0.5275, lr=3.04e-05]
Epoch 3/5:  44%|████▍     | 517/1177 [23:15<26:28,  2.41s/it, exist=0.2782, loss=0.5278, lr=3.04e-05]
Epoch 3/5:  44%|████▍     | 518/1177 [23:15<31:36,  2.88s/it, exist=0.2782, loss=0.5278, lr=3.04e-05]
Epoch 3/5:  44%|████▍     | 518/1177 [23:19<31:36,  2.88s/it, exist=0.2792, loss=0.5290, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 519/1177 [23:19<34:09,  3.12s/it, exist=0.2792, loss=0.5290, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 519/1177 [23:22<34:09,  3.12s/it, exist=0.2788, loss=0.5285, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 520/1177 [23:22<32:03,  2.93s/it, exist=0.2788, loss=0.5285, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 520/1177 [23:24<32:03,  2.93s/it, exist=0.2789, loss=0.5285, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 521/1177 [23:24<28:53,  2.64s/it, exist=0.2789, loss=0.5285, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 521/1177 [23:27<28:53,  2.64s/it, exist=0.2792, loss=0.5287, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 522/1177 [23:27<30:13,  2.77s/it, exist=0.2792, loss=0.5287, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 522/1177 [23:30<30:13,  2.77s/it, exist=0.2790, loss=0.5287, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 523/1177 [23:30<31:30,  2.89s/it, exist=0.2790, loss=0.5287, lr=3.03e-05]
Epoch 3/5:  44%|████▍     | 523/1177 [23:32<31:30,  2.89s/it, exist=0.2792, loss=0.5290, lr=3.03e-05]
Epoch 3/5:  45%|████▍     | 524/1177 [23:32<30:25,  2.80s/it, exist=0.2792, loss=0.5290, lr=3.03e-05]
Epoch 3/5:  45%|████▍     | 524/1177 [23:35<30:25,  2.80s/it, exist=0.2790, loss=0.5290, lr=3.03e-05]
Epoch 3/5:  45%|████▍     | 525/1177 [23:35<29:23,  2.70s/it, exist=0.2790, loss=0.5290, lr=3.03e-05]
Epoch 3/5:  45%|████▍     | 525/1177 [23:38<29:23,  2.70s/it, exist=0.2788, loss=0.5288, lr=3.02e-05]
Epoch 3/5:  45%|████▍     | 526/1177 [23:38<28:59,  2.67s/it, exist=0.2788, loss=0.5288, lr=3.02e-05]
Epoch 3/5:  45%|████▍     | 526/1177 [23:40<28:59,  2.67s/it, exist=0.2785, loss=0.5286, lr=3.02e-05]
Epoch 3/5:  45%|████▍     | 527/1177 [23:40<28:18,  2.61s/it, exist=0.2785, loss=0.5286, lr=3.02e-05]
Epoch 3/5:  45%|████▍     | 527/1177 [23:43<28:18,  2.61s/it, exist=0.2787, loss=0.5289, lr=3.02e-05]
Epoch 3/5:  45%|████▍     | 528/1177 [23:43<28:25,  2.63s/it, exist=0.2787, loss=0.5289, lr=3.02e-05]
Epoch 3/5:  45%|████▍     | 528/1177 [23:45<28:25,  2.63s/it, exist=0.2789, loss=0.5289, lr=3.02e-05]
Epoch 3/5:  45%|████▍     | 529/1177 [23:45<26:11,  2.43s/it, exist=0.2789, loss=0.5289, lr=3.02e-05]
Epoch 3/5:  45%|████▍     | 529/1177 [23:47<26:11,  2.43s/it, exist=0.2787, loss=0.5289, lr=3.02e-05]
Epoch 3/5:  45%|████▌     | 530/1177 [23:47<24:27,  2.27s/it, exist=0.2787, loss=0.5289, lr=3.02e-05]
Epoch 3/5:  45%|████▌     | 530/1177 [23:50<24:27,  2.27s/it, exist=0.2788, loss=0.5290, lr=3.02e-05]
Epoch 3/5:  45%|████▌     | 531/1177 [23:50<27:58,  2.60s/it, exist=0.2788, loss=0.5290, lr=3.02e-05]
Epoch 3/5:  45%|████▌     | 531/1177 [23:53<27:58,  2.60s/it, exist=0.2789, loss=0.5293, lr=3.02e-05]
Epoch 3/5:  45%|████▌     | 532/1177 [23:53<27:59,  2.60s/it, exist=0.2789, loss=0.5293, lr=3.02e-05]
Epoch 3/5:  45%|████▌     | 532/1177 [23:56<27:59,  2.60s/it, exist=0.2787, loss=0.5290, lr=3.01e-05]
Epoch 3/5:  45%|████▌     | 533/1177 [23:56<29:27,  2.74s/it, exist=0.2787, loss=0.5290, lr=3.01e-05]
Epoch 3/5:  45%|████▌     | 533/1177 [24:00<29:27,  2.74s/it, exist=0.2786, loss=0.5290, lr=3.01e-05]
Epoch 3/5:  45%|████▌     | 534/1177 [24:00<35:08,  3.28s/it, exist=0.2786, loss=0.5290, lr=3.01e-05]
Epoch 3/5:  45%|████▌     | 534/1177 [24:03<35:08,  3.28s/it, exist=0.2796, loss=0.5299, lr=3.01e-05]
Epoch 3/5:  45%|████▌     | 535/1177 [24:03<33:23,  3.12s/it, exist=0.2796, loss=0.5299, lr=3.01e-05]
Epoch 3/5:  45%|████▌     | 535/1177 [24:06<33:23,  3.12s/it, exist=0.2793, loss=0.5295, lr=3.01e-05]
Epoch 3/5:  46%|████▌     | 536/1177 [24:06<34:30,  3.23s/it, exist=0.2793, loss=0.5295, lr=3.01e-05]
Epoch 3/5:  46%|████▌     | 536/1177 [24:09<34:30,  3.23s/it, exist=0.2793, loss=0.5294, lr=3.01e-05]
Epoch 3/5:  46%|████▌     | 537/1177 [24:09<33:13,  3.12s/it, exist=0.2793, loss=0.5294, lr=3.01e-05]
Epoch 3/5:  46%|████▌     | 537/1177 [24:12<33:13,  3.12s/it, exist=0.2795, loss=0.5297, lr=3.01e-05]
Epoch 3/5:  46%|████▌     | 538/1177 [24:12<31:05,  2.92s/it, exist=0.2795, loss=0.5297, lr=3.01e-05]
Epoch 3/5:  46%|████▌     | 538/1177 [24:14<31:05,  2.92s/it, exist=0.2793, loss=0.5297, lr=3.01e-05]
Epoch 3/5:  46%|████▌     | 539/1177 [24:14<29:58,  2.82s/it, exist=0.2793, loss=0.5297, lr=3.01e-05]
Epoch 3/5:  46%|████▌     | 539/1177 [24:17<29:58,  2.82s/it, exist=0.2792, loss=0.5295, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 540/1177 [24:17<29:23,  2.77s/it, exist=0.2792, loss=0.5295, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 540/1177 [24:19<29:23,  2.77s/it, exist=0.2791, loss=0.5295, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 541/1177 [24:19<26:55,  2.54s/it, exist=0.2791, loss=0.5295, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 541/1177 [24:22<26:55,  2.54s/it, exist=0.2790, loss=0.5293, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 542/1177 [24:22<28:36,  2.70s/it, exist=0.2790, loss=0.5293, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 542/1177 [24:25<28:36,  2.70s/it, exist=0.2789, loss=0.5292, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 543/1177 [24:25<28:13,  2.67s/it, exist=0.2789, loss=0.5292, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 543/1177 [24:27<28:13,  2.67s/it, exist=0.2788, loss=0.5290, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 544/1177 [24:27<27:35,  2.61s/it, exist=0.2788, loss=0.5290, lr=3.00e-05]
Epoch 3/5:  46%|████▌     | 544/1177 [24:30<27:35,  2.61s/it, exist=0.2788, loss=0.5290, lr=3.00e-05]
Epoch 3/5:  46%|████▋     | 545/1177 [24:30<27:21,  2.60s/it, exist=0.2788, loss=0.5290, lr=3.00e-05]
Epoch 3/5:  46%|████▋     | 545/1177 [24:32<27:21,  2.60s/it, exist=0.2785, loss=0.5286, lr=3.00e-05]
Epoch 3/5:  46%|████▋     | 546/1177 [24:32<27:22,  2.60s/it, exist=0.2785, loss=0.5286, lr=3.00e-05]
Epoch 3/5:  46%|████▋     | 546/1177 [24:35<27:22,  2.60s/it, exist=0.2784, loss=0.5288, lr=2.99e-05]
Epoch 3/5:  46%|████▋     | 547/1177 [24:35<27:24,  2.61s/it, exist=0.2784, loss=0.5288, lr=2.99e-05]
Epoch 3/5:  46%|████▋     | 547/1177 [24:37<27:24,  2.61s/it, exist=0.2786, loss=0.5289, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 548/1177 [24:37<25:19,  2.42s/it, exist=0.2786, loss=0.5289, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 548/1177 [24:40<25:19,  2.42s/it, exist=0.2789, loss=0.5292, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 549/1177 [24:40<28:18,  2.70s/it, exist=0.2789, loss=0.5292, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 549/1177 [24:42<28:18,  2.70s/it, exist=0.2793, loss=0.5294, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 550/1177 [24:42<26:20,  2.52s/it, exist=0.2793, loss=0.5294, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 550/1177 [24:45<26:20,  2.52s/it, exist=0.2793, loss=0.5295, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 551/1177 [24:45<25:53,  2.48s/it, exist=0.2793, loss=0.5295, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 551/1177 [24:48<25:53,  2.48s/it, exist=0.2791, loss=0.5296, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 552/1177 [24:48<28:29,  2.73s/it, exist=0.2791, loss=0.5296, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 552/1177 [24:51<28:29,  2.73s/it, exist=0.2793, loss=0.5299, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 553/1177 [24:51<28:14,  2.72s/it, exist=0.2793, loss=0.5299, lr=2.99e-05]
Epoch 3/5:  47%|████▋     | 553/1177 [24:53<28:14,  2.72s/it, exist=0.2793, loss=0.5299, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 554/1177 [24:53<27:13,  2.62s/it, exist=0.2793, loss=0.5299, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 554/1177 [24:56<27:13,  2.62s/it, exist=0.2794, loss=0.5299, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 555/1177 [24:56<26:48,  2.59s/it, exist=0.2794, loss=0.5299, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 555/1177 [24:58<26:48,  2.59s/it, exist=0.2792, loss=0.5297, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 556/1177 [24:58<26:45,  2.58s/it, exist=0.2792, loss=0.5297, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 556/1177 [25:01<26:45,  2.58s/it, exist=0.2789, loss=0.5294, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 557/1177 [25:01<26:09,  2.53s/it, exist=0.2789, loss=0.5294, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 557/1177 [25:03<26:09,  2.53s/it, exist=0.2786, loss=0.5295, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 558/1177 [25:03<26:22,  2.56s/it, exist=0.2786, loss=0.5295, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 558/1177 [25:05<26:22,  2.56s/it, exist=0.2783, loss=0.5291, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 559/1177 [25:05<24:30,  2.38s/it, exist=0.2783, loss=0.5291, lr=2.98e-05]
Epoch 3/5:  47%|████▋     | 559/1177 [25:08<24:30,  2.38s/it, exist=0.2780, loss=0.5289, lr=2.98e-05]
Epoch 3/5:  48%|████▊     | 560/1177 [25:08<25:11,  2.45s/it, exist=0.2780, loss=0.5289, lr=2.98e-05]
Epoch 3/5:  48%|████▊     | 560/1177 [25:11<25:11,  2.45s/it, exist=0.2777, loss=0.5287, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 561/1177 [25:11<27:23,  2.67s/it, exist=0.2777, loss=0.5287, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 561/1177 [25:14<27:23,  2.67s/it, exist=0.2775, loss=0.5284, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 562/1177 [25:14<27:10,  2.65s/it, exist=0.2775, loss=0.5284, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 562/1177 [25:16<27:10,  2.65s/it, exist=0.2772, loss=0.5281, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 563/1177 [25:16<26:49,  2.62s/it, exist=0.2772, loss=0.5281, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 563/1177 [25:20<26:49,  2.62s/it, exist=0.2771, loss=0.5279, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 564/1177 [25:20<29:21,  2.87s/it, exist=0.2771, loss=0.5279, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 564/1177 [25:23<29:21,  2.87s/it, exist=0.2771, loss=0.5279, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 565/1177 [25:23<30:57,  3.03s/it, exist=0.2771, loss=0.5279, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 565/1177 [25:25<30:57,  3.03s/it, exist=0.2775, loss=0.5282, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 566/1177 [25:25<27:40,  2.72s/it, exist=0.2775, loss=0.5282, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 566/1177 [25:27<27:40,  2.72s/it, exist=0.2772, loss=0.5278, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 567/1177 [25:27<26:39,  2.62s/it, exist=0.2772, loss=0.5278, lr=2.97e-05]
Epoch 3/5:  48%|████▊     | 567/1177 [25:30<26:39,  2.62s/it, exist=0.2777, loss=0.5285, lr=2.96e-05]
Epoch 3/5:  48%|████▊     | 568/1177 [25:30<26:42,  2.63s/it, exist=0.2777, loss=0.5285, lr=2.96e-05]
Epoch 3/5:  48%|████▊     | 568/1177 [25:32<26:42,  2.63s/it, exist=0.2773, loss=0.5282, lr=2.96e-05]
Epoch 3/5:  48%|████▊     | 569/1177 [25:32<24:32,  2.42s/it, exist=0.2773, loss=0.5282, lr=2.96e-05]
Epoch 3/5:  48%|████▊     | 569/1177 [25:34<24:32,  2.42s/it, exist=0.2775, loss=0.5290, lr=2.96e-05]
Epoch 3/5:  48%|████▊     | 570/1177 [25:34<24:30,  2.42s/it, exist=0.2775, loss=0.5290, lr=2.96e-05]
Epoch 3/5:  48%|████▊     | 570/1177 [25:37<24:30,  2.42s/it, exist=0.2772, loss=0.5288, lr=2.96e-05]
Epoch 3/5:  49%|████▊     | 571/1177 [25:37<25:00,  2.48s/it, exist=0.2772, loss=0.5288, lr=2.96e-05]
Epoch 3/5:  49%|████▊     | 571/1177 [25:40<25:00,  2.48s/it, exist=0.2770, loss=0.5285, lr=2.96e-05]
Epoch 3/5:  49%|████▊     | 572/1177 [25:40<25:11,  2.50s/it, exist=0.2770, loss=0.5285, lr=2.96e-05]
Epoch 3/5:  49%|████▊     | 572/1177 [25:43<25:11,  2.50s/it, exist=0.2772, loss=0.5288, lr=2.96e-05]
Epoch 3/5:  49%|████▊     | 573/1177 [25:43<27:18,  2.71s/it, exist=0.2772, loss=0.5288, lr=2.96e-05]
Epoch 3/5:  49%|████▊     | 573/1177 [25:45<27:18,  2.71s/it, exist=0.2777, loss=0.5293, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 574/1177 [25:45<26:43,  2.66s/it, exist=0.2777, loss=0.5293, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 574/1177 [25:47<26:43,  2.66s/it, exist=0.2778, loss=0.5293, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 575/1177 [25:47<24:36,  2.45s/it, exist=0.2778, loss=0.5293, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 575/1177 [25:50<24:36,  2.45s/it, exist=0.2776, loss=0.5293, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 576/1177 [25:50<25:14,  2.52s/it, exist=0.2776, loss=0.5293, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 576/1177 [25:53<25:14,  2.52s/it, exist=0.2777, loss=0.5294, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 577/1177 [25:53<27:22,  2.74s/it, exist=0.2777, loss=0.5294, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 577/1177 [25:56<27:22,  2.74s/it, exist=0.2775, loss=0.5292, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 578/1177 [25:56<26:48,  2.69s/it, exist=0.2775, loss=0.5292, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 578/1177 [25:58<26:48,  2.69s/it, exist=0.2777, loss=0.5294, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 579/1177 [25:58<24:32,  2.46s/it, exist=0.2777, loss=0.5294, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 579/1177 [26:01<24:32,  2.46s/it, exist=0.2779, loss=0.5295, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 580/1177 [26:01<26:33,  2.67s/it, exist=0.2779, loss=0.5295, lr=2.95e-05]
Epoch 3/5:  49%|████▉     | 580/1177 [26:03<26:33,  2.67s/it, exist=0.2776, loss=0.5292, lr=2.94e-05]
Epoch 3/5:  49%|████▉     | 581/1177 [26:03<25:45,  2.59s/it, exist=0.2776, loss=0.5292, lr=2.94e-05]
Epoch 3/5:  49%|████▉     | 581/1177 [26:05<25:45,  2.59s/it, exist=0.2779, loss=0.5294, lr=2.94e-05]
Epoch 3/5:  49%|████▉     | 582/1177 [26:05<23:52,  2.41s/it, exist=0.2779, loss=0.5294, lr=2.94e-05]
Epoch 3/5:  49%|████▉     | 582/1177 [26:07<23:52,  2.41s/it, exist=0.2776, loss=0.5293, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 583/1177 [26:07<22:22,  2.26s/it, exist=0.2776, loss=0.5293, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 583/1177 [26:10<22:22,  2.26s/it, exist=0.2777, loss=0.5294, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 584/1177 [26:10<25:35,  2.59s/it, exist=0.2777, loss=0.5294, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 584/1177 [26:14<25:35,  2.59s/it, exist=0.2782, loss=0.5300, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 585/1177 [26:14<27:07,  2.75s/it, exist=0.2782, loss=0.5300, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 585/1177 [26:16<27:07,  2.75s/it, exist=0.2780, loss=0.5299, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 586/1177 [26:16<24:41,  2.51s/it, exist=0.2780, loss=0.5299, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 586/1177 [26:19<24:41,  2.51s/it, exist=0.2780, loss=0.5298, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 587/1177 [26:19<27:01,  2.75s/it, exist=0.2780, loss=0.5298, lr=2.94e-05]
Epoch 3/5:  50%|████▉     | 587/1177 [26:22<27:01,  2.75s/it, exist=0.2780, loss=0.5298, lr=2.93e-05]
Epoch 3/5:  50%|████▉     | 588/1177 [26:22<26:44,  2.72s/it, exist=0.2780, loss=0.5298, lr=2.93e-05]
Epoch 3/5:  50%|████▉     | 588/1177 [26:24<26:44,  2.72s/it, exist=0.2783, loss=0.5305, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 589/1177 [26:24<26:41,  2.72s/it, exist=0.2783, loss=0.5305, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 589/1177 [26:27<26:41,  2.72s/it, exist=0.2780, loss=0.5303, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 590/1177 [26:27<28:09,  2.88s/it, exist=0.2780, loss=0.5303, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 590/1177 [26:31<28:09,  2.88s/it, exist=0.2779, loss=0.5302, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 591/1177 [26:31<30:53,  3.16s/it, exist=0.2779, loss=0.5302, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 591/1177 [26:34<30:53,  3.16s/it, exist=0.2778, loss=0.5303, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 592/1177 [26:34<29:59,  3.08s/it, exist=0.2778, loss=0.5303, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 592/1177 [26:36<29:59,  3.08s/it, exist=0.2784, loss=0.5308, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 593/1177 [26:36<26:39,  2.74s/it, exist=0.2784, loss=0.5308, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 593/1177 [26:39<26:39,  2.74s/it, exist=0.2785, loss=0.5309, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 594/1177 [26:39<26:15,  2.70s/it, exist=0.2785, loss=0.5309, lr=2.93e-05]
Epoch 3/5:  50%|█████     | 594/1177 [26:41<26:15,  2.70s/it, exist=0.2785, loss=0.5307, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 595/1177 [26:41<25:46,  2.66s/it, exist=0.2785, loss=0.5307, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 595/1177 [26:43<25:46,  2.66s/it, exist=0.2783, loss=0.5305, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 596/1177 [26:43<23:36,  2.44s/it, exist=0.2783, loss=0.5305, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 596/1177 [26:46<23:36,  2.44s/it, exist=0.2781, loss=0.5303, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 597/1177 [26:46<23:54,  2.47s/it, exist=0.2781, loss=0.5303, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 597/1177 [26:49<23:54,  2.47s/it, exist=0.2783, loss=0.5305, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 598/1177 [26:49<26:13,  2.72s/it, exist=0.2783, loss=0.5305, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 598/1177 [26:51<26:13,  2.72s/it, exist=0.2780, loss=0.5302, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 599/1177 [26:51<23:52,  2.48s/it, exist=0.2780, loss=0.5302, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 599/1177 [26:54<23:52,  2.48s/it, exist=0.2782, loss=0.5306, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 600/1177 [26:54<26:17,  2.73s/it, exist=0.2782, loss=0.5306, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 600/1177 [26:56<26:17,  2.73s/it, exist=0.2781, loss=0.5304, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 601/1177 [26:56<23:58,  2.50s/it, exist=0.2781, loss=0.5304, lr=2.92e-05]
Epoch 3/5:  51%|█████     | 601/1177 [26:59<23:58,  2.50s/it, exist=0.2779, loss=0.5302, lr=2.91e-05]
Epoch 3/5:  51%|█████     | 602/1177 [26:59<25:52,  2.70s/it, exist=0.2779, loss=0.5302, lr=2.91e-05]
Epoch 3/5:  51%|█████     | 602/1177 [27:02<25:52,  2.70s/it, exist=0.2777, loss=0.5300, lr=2.91e-05]
Epoch 3/5:  51%|█████     | 603/1177 [27:02<24:54,  2.60s/it, exist=0.2777, loss=0.5300, lr=2.91e-05]
Epoch 3/5:  51%|█████     | 603/1177 [27:05<24:54,  2.60s/it, exist=0.2774, loss=0.5296, lr=2.91e-05]
Epoch 3/5:  51%|█████▏    | 604/1177 [27:05<25:39,  2.69s/it, exist=0.2774, loss=0.5296, lr=2.91e-05]
Epoch 3/5:  51%|█████▏    | 604/1177 [27:07<25:39,  2.69s/it, exist=0.2774, loss=0.5295, lr=2.91e-05]
Epoch 3/5:  51%|█████▏    | 605/1177 [27:07<24:54,  2.61s/it, exist=0.2774, loss=0.5295, lr=2.91e-05]
Epoch 3/5:  51%|█████▏    | 605/1177 [27:10<24:54,  2.61s/it, exist=0.2774, loss=0.5296, lr=2.91e-05]
Epoch 3/5:  51%|█████▏    | 606/1177 [27:10<24:57,  2.62s/it, exist=0.2774, loss=0.5296, lr=2.91e-05]
Epoch 3/5:  51%|█████▏    | 606/1177 [27:12<24:57,  2.62s/it, exist=0.2773, loss=0.5294, lr=2.91e-05]
Epoch 3/5:  52%|█████▏    | 607/1177 [27:12<23:02,  2.43s/it, exist=0.2773, loss=0.5294, lr=2.91e-05]
Epoch 3/5:  52%|█████▏    | 607/1177 [27:15<23:02,  2.43s/it, exist=0.2770, loss=0.5291, lr=2.91e-05]
Epoch 3/5:  52%|█████▏    | 608/1177 [27:15<25:08,  2.65s/it, exist=0.2770, loss=0.5291, lr=2.91e-05]
Epoch 3/5:  52%|█████▏    | 608/1177 [27:18<25:08,  2.65s/it, exist=0.2771, loss=0.5293, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 609/1177 [27:18<25:08,  2.66s/it, exist=0.2771, loss=0.5293, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 609/1177 [27:19<25:08,  2.66s/it, exist=0.2776, loss=0.5296, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 610/1177 [27:19<22:55,  2.43s/it, exist=0.2776, loss=0.5296, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 610/1177 [27:23<22:55,  2.43s/it, exist=0.2777, loss=0.5297, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 611/1177 [27:23<25:08,  2.67s/it, exist=0.2777, loss=0.5297, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 611/1177 [27:25<25:08,  2.67s/it, exist=0.2776, loss=0.5297, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 612/1177 [27:25<23:10,  2.46s/it, exist=0.2776, loss=0.5297, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 612/1177 [27:27<23:10,  2.46s/it, exist=0.2777, loss=0.5297, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 613/1177 [27:27<23:40,  2.52s/it, exist=0.2777, loss=0.5297, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 613/1177 [27:30<23:40,  2.52s/it, exist=0.2783, loss=0.5302, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 614/1177 [27:30<23:46,  2.53s/it, exist=0.2783, loss=0.5302, lr=2.90e-05]
Epoch 3/5:  52%|█████▏    | 614/1177 [27:33<23:46,  2.53s/it, exist=0.2782, loss=0.5301, lr=2.89e-05]
Epoch 3/5:  52%|█████▏    | 615/1177 [27:33<25:37,  2.73s/it, exist=0.2782, loss=0.5301, lr=2.89e-05]
Epoch 3/5:  52%|█████▏    | 615/1177 [27:36<25:37,  2.73s/it, exist=0.2793, loss=0.5313, lr=2.89e-05]
Epoch 3/5:  52%|█████▏    | 616/1177 [27:36<24:59,  2.67s/it, exist=0.2793, loss=0.5313, lr=2.89e-05]
Epoch 3/5:  52%|█████▏    | 616/1177 [27:38<24:59,  2.67s/it, exist=0.2790, loss=0.5310, lr=2.89e-05]
Epoch 3/5:  52%|█████▏    | 617/1177 [27:38<24:47,  2.66s/it, exist=0.2790, loss=0.5310, lr=2.89e-05]
Epoch 3/5:  52%|█████▏    | 617/1177 [27:41<24:47,  2.66s/it, exist=0.2787, loss=0.5308, lr=2.89e-05]
Epoch 3/5:  53%|█████▎    | 618/1177 [27:41<24:41,  2.65s/it, exist=0.2787, loss=0.5308, lr=2.89e-05]
Epoch 3/5:  53%|█████▎    | 618/1177 [27:44<24:41,  2.65s/it, exist=0.2785, loss=0.5307, lr=2.89e-05]
Epoch 3/5:  53%|█████▎    | 619/1177 [27:44<24:40,  2.65s/it, exist=0.2785, loss=0.5307, lr=2.89e-05]
Epoch 3/5:  53%|█████▎    | 619/1177 [27:46<24:40,  2.65s/it, exist=0.2785, loss=0.5306, lr=2.89e-05]
Epoch 3/5:  53%|█████▎    | 620/1177 [27:46<24:34,  2.65s/it, exist=0.2785, loss=0.5306, lr=2.89e-05]
Epoch 3/5:  53%|█████▎    | 620/1177 [27:49<24:34,  2.65s/it, exist=0.2783, loss=0.5305, lr=2.89e-05]
Epoch 3/5:  53%|█████▎    | 621/1177 [27:49<24:33,  2.65s/it, exist=0.2783, loss=0.5305, lr=2.89e-05]
Epoch 3/5:  53%|█████▎    | 621/1177 [27:52<24:33,  2.65s/it, exist=0.2783, loss=0.5305, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 622/1177 [27:52<24:31,  2.65s/it, exist=0.2783, loss=0.5305, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 622/1177 [27:54<24:31,  2.65s/it, exist=0.2780, loss=0.5302, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 623/1177 [27:54<22:39,  2.45s/it, exist=0.2780, loss=0.5302, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 623/1177 [27:56<22:39,  2.45s/it, exist=0.2778, loss=0.5300, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 624/1177 [27:56<22:40,  2.46s/it, exist=0.2778, loss=0.5300, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 624/1177 [27:59<22:40,  2.46s/it, exist=0.2775, loss=0.5299, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 625/1177 [27:59<24:52,  2.70s/it, exist=0.2775, loss=0.5299, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 625/1177 [28:02<24:52,  2.70s/it, exist=0.2773, loss=0.5297, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 626/1177 [28:02<24:03,  2.62s/it, exist=0.2773, loss=0.5297, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 626/1177 [28:04<24:03,  2.62s/it, exist=0.2770, loss=0.5293, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 627/1177 [28:04<22:21,  2.44s/it, exist=0.2770, loss=0.5293, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 627/1177 [28:07<22:21,  2.44s/it, exist=0.2768, loss=0.5291, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 628/1177 [28:07<24:34,  2.69s/it, exist=0.2768, loss=0.5291, lr=2.88e-05]
Epoch 3/5:  53%|█████▎    | 628/1177 [28:09<24:34,  2.69s/it, exist=0.2770, loss=0.5294, lr=2.87e-05]
Epoch 3/5:  53%|█████▎    | 629/1177 [28:09<24:06,  2.64s/it, exist=0.2770, loss=0.5294, lr=2.87e-05]
Epoch 3/5:  53%|█████▎    | 629/1177 [28:11<24:06,  2.64s/it, exist=0.2768, loss=0.5292, lr=2.87e-05]
Epoch 3/5:  54%|█████▎    | 630/1177 [28:11<22:08,  2.43s/it, exist=0.2768, loss=0.5292, lr=2.87e-05]
Epoch 3/5:  54%|█████▎    | 630/1177 [28:15<22:08,  2.43s/it, exist=0.2774, loss=0.5298, lr=2.87e-05]
Epoch 3/5:  54%|█████▎    | 631/1177 [28:15<23:56,  2.63s/it, exist=0.2774, loss=0.5298, lr=2.87e-05]
Epoch 3/5:  54%|█████▎    | 631/1177 [28:17<23:56,  2.63s/it, exist=0.2777, loss=0.5301, lr=2.87e-05]
Epoch 3/5:  54%|█████▎    | 632/1177 [28:17<23:59,  2.64s/it, exist=0.2777, loss=0.5301, lr=2.87e-05]
Epoch 3/5:  54%|█████▎    | 632/1177 [28:19<23:59,  2.64s/it, exist=0.2774, loss=0.5296, lr=2.87e-05]
Epoch 3/5:  54%|█████▍    | 633/1177 [28:19<22:02,  2.43s/it, exist=0.2774, loss=0.5296, lr=2.87e-05]
Epoch 3/5:  54%|█████▍    | 633/1177 [28:22<22:02,  2.43s/it, exist=0.2776, loss=0.5298, lr=2.87e-05]
Epoch 3/5:  54%|█████▍    | 634/1177 [28:22<23:46,  2.63s/it, exist=0.2776, loss=0.5298, lr=2.87e-05]
Epoch 3/5:  54%|█████▍    | 634/1177 [28:25<23:46,  2.63s/it, exist=0.2775, loss=0.5296, lr=2.87e-05]
Epoch 3/5:  54%|█████▍    | 635/1177 [28:25<23:25,  2.59s/it, exist=0.2775, loss=0.5296, lr=2.87e-05]
Epoch 3/5:  54%|█████▍    | 635/1177 [28:27<23:25,  2.59s/it, exist=0.2772, loss=0.5294, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 636/1177 [28:27<23:06,  2.56s/it, exist=0.2772, loss=0.5294, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 636/1177 [28:30<23:06,  2.56s/it, exist=0.2771, loss=0.5293, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 637/1177 [28:30<23:18,  2.59s/it, exist=0.2771, loss=0.5293, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 637/1177 [28:32<23:18,  2.59s/it, exist=0.2769, loss=0.5292, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 638/1177 [28:32<22:39,  2.52s/it, exist=0.2769, loss=0.5292, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 638/1177 [28:35<22:39,  2.52s/it, exist=0.2767, loss=0.5291, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 639/1177 [28:35<22:43,  2.53s/it, exist=0.2767, loss=0.5291, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 639/1177 [28:37<22:43,  2.53s/it, exist=0.2768, loss=0.5291, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 640/1177 [28:37<23:00,  2.57s/it, exist=0.2768, loss=0.5291, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 640/1177 [28:39<23:00,  2.57s/it, exist=0.2766, loss=0.5289, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 641/1177 [28:39<21:22,  2.39s/it, exist=0.2766, loss=0.5289, lr=2.86e-05]
Epoch 3/5:  54%|█████▍    | 641/1177 [28:42<21:22,  2.39s/it, exist=0.2764, loss=0.5286, lr=2.86e-05]
Epoch 3/5:  55%|█████▍    | 642/1177 [28:42<21:57,  2.46s/it, exist=0.2764, loss=0.5286, lr=2.86e-05]
Epoch 3/5:  55%|█████▍    | 642/1177 [28:46<21:57,  2.46s/it, exist=0.2764, loss=0.5286, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 643/1177 [28:46<25:18,  2.84s/it, exist=0.2764, loss=0.5286, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 643/1177 [28:48<25:18,  2.84s/it, exist=0.2765, loss=0.5287, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 644/1177 [28:48<24:31,  2.76s/it, exist=0.2765, loss=0.5287, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 644/1177 [28:51<24:31,  2.76s/it, exist=0.2770, loss=0.5292, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 645/1177 [28:51<23:56,  2.70s/it, exist=0.2770, loss=0.5292, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 645/1177 [28:54<23:56,  2.70s/it, exist=0.2769, loss=0.5290, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 646/1177 [28:54<25:22,  2.87s/it, exist=0.2769, loss=0.5290, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 646/1177 [28:58<25:22,  2.87s/it, exist=0.2768, loss=0.5290, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 647/1177 [28:58<28:19,  3.21s/it, exist=0.2768, loss=0.5290, lr=2.85e-05]
Epoch 3/5:  55%|█████▍    | 647/1177 [29:01<28:19,  3.21s/it, exist=0.2770, loss=0.5293, lr=2.85e-05]
Epoch 3/5:  55%|█████▌    | 648/1177 [29:01<26:16,  2.98s/it, exist=0.2770, loss=0.5293, lr=2.85e-05]
Epoch 3/5:  55%|█████▌    | 648/1177 [29:03<26:16,  2.98s/it, exist=0.2769, loss=0.5291, lr=2.85e-05]
Epoch 3/5:  55%|█████▌    | 649/1177 [29:03<24:31,  2.79s/it, exist=0.2769, loss=0.5291, lr=2.85e-05]
Epoch 3/5:  55%|█████▌    | 649/1177 [29:06<24:31,  2.79s/it, exist=0.2767, loss=0.5288, lr=2.84e-05]
Epoch 3/5:  55%|█████▌    | 650/1177 [29:06<26:15,  2.99s/it, exist=0.2767, loss=0.5288, lr=2.84e-05]
Epoch 3/5:  55%|█████▌    | 650/1177 [29:10<26:15,  2.99s/it, exist=0.2772, loss=0.5294, lr=2.84e-05]
Epoch 3/5:  55%|█████▌    | 651/1177 [29:10<29:00,  3.31s/it, exist=0.2772, loss=0.5294, lr=2.84e-05]
Epoch 3/5:  55%|█████▌    | 651/1177 [29:12<29:00,  3.31s/it, exist=0.2770, loss=0.5293, lr=2.84e-05]
Epoch 3/5:  55%|█████▌    | 652/1177 [29:12<25:33,  2.92s/it, exist=0.2770, loss=0.5293, lr=2.84e-05]
Epoch 3/5:  55%|█████▌    | 652/1177 [29:15<25:33,  2.92s/it, exist=0.2776, loss=0.5298, lr=2.84e-05]
Epoch 3/5:  55%|█████▌    | 653/1177 [29:15<24:05,  2.76s/it, exist=0.2776, loss=0.5298, lr=2.84e-05]
Epoch 3/5:  55%|█████▌    | 653/1177 [29:18<24:05,  2.76s/it, exist=0.2772, loss=0.5294, lr=2.84e-05]
Epoch 3/5:  56%|█████▌    | 654/1177 [29:18<26:09,  3.00s/it, exist=0.2772, loss=0.5294, lr=2.84e-05]
Epoch 3/5:  56%|█████▌    | 654/1177 [29:22<26:09,  3.00s/it, exist=0.2775, loss=0.5297, lr=2.84e-05]
Epoch 3/5:  56%|█████▌    | 655/1177 [29:22<26:49,  3.08s/it, exist=0.2775, loss=0.5297, lr=2.84e-05]
Epoch 3/5:  56%|█████▌    | 655/1177 [29:24<26:49,  3.08s/it, exist=0.2776, loss=0.5297, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 656/1177 [29:24<25:09,  2.90s/it, exist=0.2776, loss=0.5297, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 656/1177 [29:26<25:09,  2.90s/it, exist=0.2775, loss=0.5295, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 657/1177 [29:26<22:46,  2.63s/it, exist=0.2775, loss=0.5295, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 657/1177 [29:29<22:46,  2.63s/it, exist=0.2777, loss=0.5299, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 658/1177 [29:29<23:26,  2.71s/it, exist=0.2777, loss=0.5299, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 658/1177 [29:32<23:26,  2.71s/it, exist=0.2777, loss=0.5298, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 659/1177 [29:32<23:07,  2.68s/it, exist=0.2777, loss=0.5298, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 659/1177 [29:34<23:07,  2.68s/it, exist=0.2775, loss=0.5296, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 660/1177 [29:34<21:14,  2.47s/it, exist=0.2775, loss=0.5296, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 660/1177 [29:37<21:14,  2.47s/it, exist=0.2776, loss=0.5297, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 661/1177 [29:37<23:24,  2.72s/it, exist=0.2776, loss=0.5297, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 661/1177 [29:39<23:24,  2.72s/it, exist=0.2775, loss=0.5296, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 662/1177 [29:39<21:20,  2.49s/it, exist=0.2775, loss=0.5296, lr=2.83e-05]
Epoch 3/5:  56%|█████▌    | 662/1177 [29:42<21:20,  2.49s/it, exist=0.2775, loss=0.5296, lr=2.82e-05]
Epoch 3/5:  56%|█████▋    | 663/1177 [29:42<23:08,  2.70s/it, exist=0.2775, loss=0.5296, lr=2.82e-05]
Epoch 3/5:  56%|█████▋    | 663/1177 [29:45<23:08,  2.70s/it, exist=0.2774, loss=0.5297, lr=2.82e-05]
Epoch 3/5:  56%|█████▋    | 664/1177 [29:45<24:45,  2.90s/it, exist=0.2774, loss=0.5297, lr=2.82e-05]
Epoch 3/5:  56%|█████▋    | 664/1177 [29:48<24:45,  2.90s/it, exist=0.2773, loss=0.5296, lr=2.82e-05]
Epoch 3/5:  56%|█████▋    | 665/1177 [29:48<23:59,  2.81s/it, exist=0.2773, loss=0.5296, lr=2.82e-05]
Epoch 3/5:  56%|█████▋    | 665/1177 [29:52<23:59,  2.81s/it, exist=0.2771, loss=0.5297, lr=2.82e-05]
Epoch 3/5:  57%|█████▋    | 666/1177 [29:52<27:20,  3.21s/it, exist=0.2771, loss=0.5297, lr=2.82e-05]
Epoch 3/5:  57%|█████▋    | 666/1177 [29:54<27:20,  3.21s/it, exist=0.2769, loss=0.5295, lr=2.82e-05]
Epoch 3/5:  57%|█████▋    | 667/1177 [29:54<24:53,  2.93s/it, exist=0.2769, loss=0.5295, lr=2.82e-05]
Epoch 3/5:  57%|█████▋    | 667/1177 [29:57<24:53,  2.93s/it, exist=0.2769, loss=0.5294, lr=2.82e-05]
Epoch 3/5:  57%|█████▋    | 668/1177 [29:57<24:06,  2.84s/it, exist=0.2769, loss=0.5294, lr=2.82e-05]
Epoch 3/5:  57%|█████▋    | 668/1177 [30:00<24:06,  2.84s/it, exist=0.2767, loss=0.5291, lr=2.82e-05]
Epoch 3/5:  57%|█████▋    | 669/1177 [30:00<24:47,  2.93s/it, exist=0.2767, loss=0.5291, lr=2.82e-05]
Epoch 3/5:  57%|█████▋    | 669/1177 [30:02<24:47,  2.93s/it, exist=0.2765, loss=0.5288, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 670/1177 [30:02<22:42,  2.69s/it, exist=0.2765, loss=0.5288, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 670/1177 [30:05<22:42,  2.69s/it, exist=0.2766, loss=0.5289, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 671/1177 [30:05<22:26,  2.66s/it, exist=0.2766, loss=0.5289, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 671/1177 [30:09<22:26,  2.66s/it, exist=0.2770, loss=0.5293, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 672/1177 [30:09<25:24,  3.02s/it, exist=0.2770, loss=0.5293, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 672/1177 [30:12<25:24,  3.02s/it, exist=0.2767, loss=0.5289, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 673/1177 [30:12<24:49,  2.96s/it, exist=0.2767, loss=0.5289, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 673/1177 [30:14<24:49,  2.96s/it, exist=0.2774, loss=0.5296, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 674/1177 [30:14<23:19,  2.78s/it, exist=0.2774, loss=0.5296, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 674/1177 [30:17<23:19,  2.78s/it, exist=0.2771, loss=0.5292, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 675/1177 [30:17<24:37,  2.94s/it, exist=0.2771, loss=0.5292, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 675/1177 [30:20<24:37,  2.94s/it, exist=0.2771, loss=0.5291, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 676/1177 [30:20<23:53,  2.86s/it, exist=0.2771, loss=0.5291, lr=2.81e-05]
Epoch 3/5:  57%|█████▋    | 676/1177 [30:23<23:53,  2.86s/it, exist=0.2769, loss=0.5289, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 677/1177 [30:23<25:01,  3.00s/it, exist=0.2769, loss=0.5289, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 677/1177 [30:27<25:01,  3.00s/it, exist=0.2772, loss=0.5292, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 678/1177 [30:27<26:30,  3.19s/it, exist=0.2772, loss=0.5292, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 678/1177 [30:30<26:30,  3.19s/it, exist=0.2769, loss=0.5289, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 679/1177 [30:30<25:08,  3.03s/it, exist=0.2769, loss=0.5289, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 679/1177 [30:32<25:08,  3.03s/it, exist=0.2767, loss=0.5286, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 680/1177 [30:32<22:37,  2.73s/it, exist=0.2767, loss=0.5286, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 680/1177 [30:34<22:37,  2.73s/it, exist=0.2767, loss=0.5285, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 681/1177 [30:34<22:15,  2.69s/it, exist=0.2767, loss=0.5285, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 681/1177 [30:36<22:15,  2.69s/it, exist=0.2766, loss=0.5283, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 682/1177 [30:36<20:24,  2.47s/it, exist=0.2766, loss=0.5283, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 682/1177 [30:39<20:24,  2.47s/it, exist=0.2764, loss=0.5280, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 683/1177 [30:39<20:29,  2.49s/it, exist=0.2764, loss=0.5280, lr=2.80e-05]
Epoch 3/5:  58%|█████▊    | 683/1177 [30:41<20:29,  2.49s/it, exist=0.2763, loss=0.5279, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 684/1177 [30:41<20:56,  2.55s/it, exist=0.2763, loss=0.5279, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 684/1177 [30:44<20:56,  2.55s/it, exist=0.2763, loss=0.5280, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 685/1177 [30:44<21:19,  2.60s/it, exist=0.2763, loss=0.5280, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 685/1177 [30:46<21:19,  2.60s/it, exist=0.2762, loss=0.5280, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 686/1177 [30:46<19:40,  2.40s/it, exist=0.2762, loss=0.5280, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 686/1177 [30:49<19:40,  2.40s/it, exist=0.2762, loss=0.5280, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 687/1177 [30:49<21:57,  2.69s/it, exist=0.2762, loss=0.5280, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 687/1177 [30:52<21:57,  2.69s/it, exist=0.2762, loss=0.5278, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 688/1177 [30:52<21:48,  2.68s/it, exist=0.2762, loss=0.5278, lr=2.79e-05]
Epoch 3/5:  58%|█████▊    | 688/1177 [30:56<21:48,  2.68s/it, exist=0.2760, loss=0.5276, lr=2.79e-05]
Epoch 3/5:  59%|█████▊    | 689/1177 [30:56<23:33,  2.90s/it, exist=0.2760, loss=0.5276, lr=2.79e-05]
Epoch 3/5:  59%|█████▊    | 689/1177 [30:59<23:33,  2.90s/it, exist=0.2759, loss=0.5274, lr=2.78e-05]
Epoch 3/5:  59%|█████▊    | 690/1177 [30:59<24:14,  2.99s/it, exist=0.2759, loss=0.5274, lr=2.78e-05]
Epoch 3/5:  59%|█████▊    | 690/1177 [31:01<24:14,  2.99s/it, exist=0.2758, loss=0.5272, lr=2.78e-05]
Epoch 3/5:  59%|█████▊    | 691/1177 [31:01<21:52,  2.70s/it, exist=0.2758, loss=0.5272, lr=2.78e-05]
Epoch 3/5:  59%|█████▊    | 691/1177 [31:03<21:52,  2.70s/it, exist=0.2757, loss=0.5272, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 692/1177 [31:03<21:39,  2.68s/it, exist=0.2757, loss=0.5272, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 692/1177 [31:06<21:39,  2.68s/it, exist=0.2755, loss=0.5270, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 693/1177 [31:06<21:32,  2.67s/it, exist=0.2755, loss=0.5270, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 693/1177 [31:08<21:32,  2.67s/it, exist=0.2761, loss=0.5277, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 694/1177 [31:08<19:40,  2.44s/it, exist=0.2761, loss=0.5277, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 694/1177 [31:10<19:40,  2.44s/it, exist=0.2760, loss=0.5276, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 695/1177 [31:10<19:36,  2.44s/it, exist=0.2760, loss=0.5276, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 695/1177 [31:14<19:36,  2.44s/it, exist=0.2762, loss=0.5277, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 696/1177 [31:14<21:47,  2.72s/it, exist=0.2762, loss=0.5277, lr=2.78e-05]
Epoch 3/5:  59%|█████▉    | 696/1177 [31:16<21:47,  2.72s/it, exist=0.2761, loss=0.5278, lr=2.77e-05]
Epoch 3/5:  59%|█████▉    | 697/1177 [31:16<21:14,  2.65s/it, exist=0.2761, loss=0.5278, lr=2.77e-05]
Epoch 3/5:  59%|█████▉    | 697/1177 [31:19<21:14,  2.65s/it, exist=0.2759, loss=0.5275, lr=2.77e-05]
Epoch 3/5:  59%|█████▉    | 698/1177 [31:19<21:39,  2.71s/it, exist=0.2759, loss=0.5275, lr=2.77e-05]
Epoch 3/5:  59%|█████▉    | 698/1177 [31:22<21:39,  2.71s/it, exist=0.2763, loss=0.5278, lr=2.77e-05]
Epoch 3/5:  59%|█████▉    | 699/1177 [31:22<21:49,  2.74s/it, exist=0.2763, loss=0.5278, lr=2.77e-05]
Epoch 3/5:  59%|█████▉    | 699/1177 [31:24<21:49,  2.74s/it, exist=0.2767, loss=0.5282, lr=2.77e-05]
Epoch 3/5:  59%|█████▉    | 700/1177 [31:24<19:59,  2.51s/it, exist=0.2767, loss=0.5282, lr=2.77e-05]
Epoch 3/5:  59%|█████▉    | 700/1177 [31:27<19:59,  2.51s/it, exist=0.2766, loss=0.5281, lr=2.77e-05]
Epoch 3/5:  60%|█████▉    | 701/1177 [31:27<22:17,  2.81s/it, exist=0.2766, loss=0.5281, lr=2.77e-05]
Epoch 3/5:  60%|█████▉    | 701/1177 [31:29<22:17,  2.81s/it, exist=0.2763, loss=0.5278, lr=2.77e-05]
Epoch 3/5:  60%|█████▉    | 702/1177 [31:29<20:17,  2.56s/it, exist=0.2763, loss=0.5278, lr=2.77e-05]
Epoch 3/5:  60%|█████▉    | 702/1177 [31:33<20:17,  2.56s/it, exist=0.2764, loss=0.5281, lr=2.77e-05]
Epoch 3/5:  60%|█████▉    | 703/1177 [31:33<23:36,  2.99s/it, exist=0.2764, loss=0.5281, lr=2.77e-05]
Epoch 3/5:  60%|█████▉    | 703/1177 [31:36<23:36,  2.99s/it, exist=0.2765, loss=0.5282, lr=2.76e-05]
Epoch 3/5:  60%|█████▉    | 704/1177 [31:36<22:33,  2.86s/it, exist=0.2765, loss=0.5282, lr=2.76e-05]
Epoch 3/5:  60%|█████▉    | 704/1177 [31:39<22:33,  2.86s/it, exist=0.2767, loss=0.5284, lr=2.76e-05]
Epoch 3/5:  60%|█████▉    | 705/1177 [31:39<23:27,  2.98s/it, exist=0.2767, loss=0.5284, lr=2.76e-05]
Epoch 3/5:  60%|█████▉    | 705/1177 [31:43<23:27,  2.98s/it, exist=0.2768, loss=0.5286, lr=2.76e-05]
Epoch 3/5:  60%|█████▉    | 706/1177 [31:43<24:33,  3.13s/it, exist=0.2768, loss=0.5286, lr=2.76e-05]
Epoch 3/5:  60%|█████▉    | 706/1177 [31:45<24:33,  3.13s/it, exist=0.2767, loss=0.5284, lr=2.76e-05]
Epoch 3/5:  60%|██████    | 707/1177 [31:45<22:59,  2.94s/it, exist=0.2767, loss=0.5284, lr=2.76e-05]
Epoch 3/5:  60%|██████    | 707/1177 [31:47<22:59,  2.94s/it, exist=0.2768, loss=0.5285, lr=2.76e-05]
Epoch 3/5:  60%|██████    | 708/1177 [31:47<20:39,  2.64s/it, exist=0.2768, loss=0.5285, lr=2.76e-05]
Epoch 3/5:  60%|██████    | 708/1177 [31:50<20:39,  2.64s/it, exist=0.2766, loss=0.5281, lr=2.76e-05]
Epoch 3/5:  60%|██████    | 709/1177 [31:50<21:56,  2.81s/it, exist=0.2766, loss=0.5281, lr=2.76e-05]
Epoch 3/5:  60%|██████    | 709/1177 [31:53<21:56,  2.81s/it, exist=0.2765, loss=0.5280, lr=2.76e-05]
Epoch 3/5:  60%|██████    | 710/1177 [31:53<21:11,  2.72s/it, exist=0.2765, loss=0.5280, lr=2.76e-05]
Epoch 3/5:  60%|██████    | 710/1177 [31:55<21:11,  2.72s/it, exist=0.2762, loss=0.5278, lr=2.75e-05]
Epoch 3/5:  60%|██████    | 711/1177 [31:55<20:48,  2.68s/it, exist=0.2762, loss=0.5278, lr=2.75e-05]
Epoch 3/5:  60%|██████    | 711/1177 [31:57<20:48,  2.68s/it, exist=0.2767, loss=0.5282, lr=2.75e-05]
Epoch 3/5:  60%|██████    | 712/1177 [31:57<19:06,  2.47s/it, exist=0.2767, loss=0.5282, lr=2.75e-05]
Epoch 3/5:  60%|██████    | 712/1177 [32:01<19:06,  2.47s/it, exist=0.2767, loss=0.5285, lr=2.75e-05]
Epoch 3/5:  61%|██████    | 713/1177 [32:01<21:09,  2.74s/it, exist=0.2767, loss=0.5285, lr=2.75e-05]
Epoch 3/5:  61%|██████    | 713/1177 [32:03<21:09,  2.74s/it, exist=0.2770, loss=0.5288, lr=2.75e-05]
Epoch 3/5:  61%|██████    | 714/1177 [32:03<20:22,  2.64s/it, exist=0.2770, loss=0.5288, lr=2.75e-05]
Epoch 3/5:  61%|██████    | 714/1177 [32:07<20:22,  2.64s/it, exist=0.2768, loss=0.5288, lr=2.75e-05]
Epoch 3/5:  61%|██████    | 715/1177 [32:07<22:26,  2.91s/it, exist=0.2768, loss=0.5288, lr=2.75e-05]
Epoch 3/5:  61%|██████    | 715/1177 [32:09<22:26,  2.91s/it, exist=0.2766, loss=0.5285, lr=2.75e-05]
Epoch 3/5:  61%|██████    | 716/1177 [32:09<20:13,  2.63s/it, exist=0.2766, loss=0.5285, lr=2.75e-05]
Epoch 3/5:  61%|██████    | 716/1177 [32:11<20:13,  2.63s/it, exist=0.2763, loss=0.5282, lr=2.74e-05]
Epoch 3/5:  61%|██████    | 717/1177 [32:11<20:06,  2.62s/it, exist=0.2763, loss=0.5282, lr=2.74e-05]
Epoch 3/5:  61%|██████    | 717/1177 [32:14<20:06,  2.62s/it, exist=0.2760, loss=0.5281, lr=2.74e-05]
Epoch 3/5:  61%|██████    | 718/1177 [32:14<20:36,  2.69s/it, exist=0.2760, loss=0.5281, lr=2.74e-05]
Epoch 3/5:  61%|██████    | 718/1177 [32:18<20:36,  2.69s/it, exist=0.2762, loss=0.5282, lr=2.74e-05]
Epoch 3/5:  61%|██████    | 719/1177 [32:18<24:05,  3.16s/it, exist=0.2762, loss=0.5282, lr=2.74e-05]
Epoch 3/5:  61%|██████    | 719/1177 [32:20<24:05,  3.16s/it, exist=0.2764, loss=0.5286, lr=2.74e-05]
Epoch 3/5:  61%|██████    | 720/1177 [32:20<21:15,  2.79s/it, exist=0.2764, loss=0.5286, lr=2.74e-05]
Epoch 3/5:  61%|██████    | 720/1177 [32:22<21:15,  2.79s/it, exist=0.2769, loss=0.5292, lr=2.74e-05]
Epoch 3/5:  61%|██████▏   | 721/1177 [32:22<19:14,  2.53s/it, exist=0.2769, loss=0.5292, lr=2.74e-05]
Epoch 3/5:  61%|██████▏   | 721/1177 [32:25<19:14,  2.53s/it, exist=0.2767, loss=0.5290, lr=2.74e-05]
Epoch 3/5:  61%|██████▏   | 722/1177 [32:25<18:59,  2.51s/it, exist=0.2767, loss=0.5290, lr=2.74e-05]
Epoch 3/5:  61%|██████▏   | 722/1177 [32:28<18:59,  2.51s/it, exist=0.2765, loss=0.5290, lr=2.74e-05]
Epoch 3/5:  61%|██████▏   | 723/1177 [32:28<20:27,  2.70s/it, exist=0.2765, loss=0.5290, lr=2.74e-05]
Epoch 3/5:  61%|██████▏   | 723/1177 [32:30<20:27,  2.70s/it, exist=0.2762, loss=0.5287, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 724/1177 [32:30<20:13,  2.68s/it, exist=0.2762, loss=0.5287, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 724/1177 [32:32<20:13,  2.68s/it, exist=0.2760, loss=0.5284, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 725/1177 [32:32<18:30,  2.46s/it, exist=0.2760, loss=0.5284, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 725/1177 [32:35<18:30,  2.46s/it, exist=0.2766, loss=0.5289, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 726/1177 [32:35<18:33,  2.47s/it, exist=0.2766, loss=0.5289, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 726/1177 [32:38<18:33,  2.47s/it, exist=0.2763, loss=0.5287, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 727/1177 [32:38<20:20,  2.71s/it, exist=0.2763, loss=0.5287, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 727/1177 [32:41<20:20,  2.71s/it, exist=0.2762, loss=0.5285, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 728/1177 [32:41<20:12,  2.70s/it, exist=0.2762, loss=0.5285, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 728/1177 [32:44<20:12,  2.70s/it, exist=0.2759, loss=0.5282, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 729/1177 [32:44<20:29,  2.74s/it, exist=0.2759, loss=0.5282, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 729/1177 [32:46<20:29,  2.74s/it, exist=0.2758, loss=0.5282, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 730/1177 [32:46<20:04,  2.69s/it, exist=0.2758, loss=0.5282, lr=2.73e-05]
Epoch 3/5:  62%|██████▏   | 730/1177 [32:48<20:04,  2.69s/it, exist=0.2755, loss=0.5278, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 731/1177 [32:48<18:24,  2.48s/it, exist=0.2755, loss=0.5278, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 731/1177 [32:51<18:24,  2.48s/it, exist=0.2756, loss=0.5280, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 732/1177 [32:51<18:42,  2.52s/it, exist=0.2756, loss=0.5280, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 732/1177 [32:54<18:42,  2.52s/it, exist=0.2765, loss=0.5288, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 733/1177 [32:54<20:27,  2.77s/it, exist=0.2765, loss=0.5288, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 733/1177 [32:57<20:27,  2.77s/it, exist=0.2765, loss=0.5288, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 734/1177 [32:57<20:20,  2.76s/it, exist=0.2765, loss=0.5288, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 734/1177 [33:00<20:20,  2.76s/it, exist=0.2762, loss=0.5284, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 735/1177 [33:00<21:53,  2.97s/it, exist=0.2762, loss=0.5284, lr=2.72e-05]
Epoch 3/5:  62%|██████▏   | 735/1177 [33:02<21:53,  2.97s/it, exist=0.2763, loss=0.5285, lr=2.72e-05]
Epoch 3/5:  63%|██████▎   | 736/1177 [33:02<19:32,  2.66s/it, exist=0.2763, loss=0.5285, lr=2.72e-05]
Epoch 3/5:  63%|██████▎   | 736/1177 [33:05<19:32,  2.66s/it, exist=0.2763, loss=0.5284, lr=2.72e-05]
Epoch 3/5:  63%|██████▎   | 737/1177 [33:05<19:42,  2.69s/it, exist=0.2763, loss=0.5284, lr=2.72e-05]
Epoch 3/5:  63%|██████▎   | 737/1177 [33:08<19:42,  2.69s/it, exist=0.2764, loss=0.5286, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 738/1177 [33:08<19:57,  2.73s/it, exist=0.2764, loss=0.5286, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 738/1177 [33:11<19:57,  2.73s/it, exist=0.2766, loss=0.5287, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 739/1177 [33:11<20:14,  2.77s/it, exist=0.2766, loss=0.5287, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 739/1177 [33:13<20:14,  2.77s/it, exist=0.2765, loss=0.5286, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 740/1177 [33:13<19:54,  2.73s/it, exist=0.2765, loss=0.5286, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 740/1177 [33:16<19:54,  2.73s/it, exist=0.2769, loss=0.5291, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 741/1177 [33:16<19:44,  2.72s/it, exist=0.2769, loss=0.5291, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 741/1177 [33:19<19:44,  2.72s/it, exist=0.2767, loss=0.5288, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 742/1177 [33:19<20:08,  2.78s/it, exist=0.2767, loss=0.5288, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 742/1177 [33:22<20:08,  2.78s/it, exist=0.2772, loss=0.5294, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 743/1177 [33:22<19:40,  2.72s/it, exist=0.2772, loss=0.5294, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 743/1177 [33:24<19:40,  2.72s/it, exist=0.2770, loss=0.5292, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 744/1177 [33:24<19:31,  2.71s/it, exist=0.2770, loss=0.5292, lr=2.71e-05]
Epoch 3/5:  63%|██████▎   | 744/1177 [33:26<19:31,  2.71s/it, exist=0.2771, loss=0.5294, lr=2.70e-05]
Epoch 3/5:  63%|██████▎   | 745/1177 [33:26<17:49,  2.48s/it, exist=0.2771, loss=0.5294, lr=2.70e-05]
Epoch 3/5:  63%|██████▎   | 745/1177 [33:30<17:49,  2.48s/it, exist=0.2771, loss=0.5293, lr=2.70e-05]
Epoch 3/5:  63%|██████▎   | 746/1177 [33:30<21:20,  2.97s/it, exist=0.2771, loss=0.5293, lr=2.70e-05]
Epoch 3/5:  63%|██████▎   | 746/1177 [33:33<21:20,  2.97s/it, exist=0.2768, loss=0.5290, lr=2.70e-05]
Epoch 3/5:  63%|██████▎   | 747/1177 [33:33<20:17,  2.83s/it, exist=0.2768, loss=0.5290, lr=2.70e-05]
Epoch 3/5:  63%|██████▎   | 747/1177 [33:36<20:17,  2.83s/it, exist=0.2771, loss=0.5294, lr=2.70e-05]
Epoch 3/5:  64%|██████▎   | 748/1177 [33:36<19:59,  2.80s/it, exist=0.2771, loss=0.5294, lr=2.70e-05]
Epoch 3/5:  64%|██████▎   | 748/1177 [33:38<19:59,  2.80s/it, exist=0.2769, loss=0.5291, lr=2.70e-05]
Epoch 3/5:  64%|██████▎   | 749/1177 [33:38<18:05,  2.54s/it, exist=0.2769, loss=0.5291, lr=2.70e-05]
Epoch 3/5:  64%|██████▎   | 749/1177 [33:40<18:05,  2.54s/it, exist=0.2775, loss=0.5297, lr=2.70e-05]
Epoch 3/5:  64%|██████▎   | 750/1177 [33:40<18:24,  2.59s/it, exist=0.2775, loss=0.5297, lr=2.70e-05]
Epoch 3/5:  64%|██████▎   | 750/1177 [33:43<18:24,  2.59s/it, exist=0.2778, loss=0.5299, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 751/1177 [33:43<19:24,  2.73s/it, exist=0.2778, loss=0.5299, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 751/1177 [33:46<19:24,  2.73s/it, exist=0.2778, loss=0.5299, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 752/1177 [33:46<19:58,  2.82s/it, exist=0.2778, loss=0.5299, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 752/1177 [33:49<19:58,  2.82s/it, exist=0.2778, loss=0.5299, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 753/1177 [33:49<19:20,  2.74s/it, exist=0.2778, loss=0.5299, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 753/1177 [33:52<19:20,  2.74s/it, exist=0.2778, loss=0.5298, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 754/1177 [33:52<19:23,  2.75s/it, exist=0.2778, loss=0.5298, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 754/1177 [33:56<19:23,  2.75s/it, exist=0.2776, loss=0.5295, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 755/1177 [33:56<22:20,  3.18s/it, exist=0.2776, loss=0.5295, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 755/1177 [33:59<22:20,  3.18s/it, exist=0.2773, loss=0.5292, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 756/1177 [33:59<21:30,  3.06s/it, exist=0.2773, loss=0.5292, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 756/1177 [34:02<21:30,  3.06s/it, exist=0.2771, loss=0.5292, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 757/1177 [34:02<23:03,  3.29s/it, exist=0.2771, loss=0.5292, lr=2.69e-05]
Epoch 3/5:  64%|██████▍   | 757/1177 [34:08<23:03,  3.29s/it, exist=0.2774, loss=0.5295, lr=2.68e-05]
Epoch 3/5:  64%|██████▍   | 758/1177 [34:08<28:28,  4.08s/it, exist=0.2774, loss=0.5295, lr=2.68e-05]
Epoch 3/5:  64%|██████▍   | 758/1177 [34:10<28:28,  4.08s/it, exist=0.2772, loss=0.5293, lr=2.68e-05]
Epoch 3/5:  64%|██████▍   | 759/1177 [34:10<24:06,  3.46s/it, exist=0.2772, loss=0.5293, lr=2.68e-05]
Epoch 3/5:  64%|██████▍   | 759/1177 [34:12<24:06,  3.46s/it, exist=0.2772, loss=0.5293, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 760/1177 [34:12<20:58,  3.02s/it, exist=0.2772, loss=0.5293, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 760/1177 [34:16<20:58,  3.02s/it, exist=0.2773, loss=0.5293, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 761/1177 [34:16<22:05,  3.19s/it, exist=0.2773, loss=0.5293, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 761/1177 [34:18<22:05,  3.19s/it, exist=0.2776, loss=0.5295, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 762/1177 [34:18<20:26,  2.96s/it, exist=0.2776, loss=0.5295, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 762/1177 [34:22<20:26,  2.96s/it, exist=0.2774, loss=0.5292, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 763/1177 [34:22<21:43,  3.15s/it, exist=0.2774, loss=0.5292, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 763/1177 [34:25<21:43,  3.15s/it, exist=0.2774, loss=0.5293, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 764/1177 [34:25<20:37,  3.00s/it, exist=0.2774, loss=0.5293, lr=2.68e-05]
Epoch 3/5:  65%|██████▍   | 764/1177 [34:27<20:37,  3.00s/it, exist=0.2773, loss=0.5292, lr=2.67e-05]
Epoch 3/5:  65%|██████▍   | 765/1177 [34:27<18:26,  2.69s/it, exist=0.2773, loss=0.5292, lr=2.67e-05]
Epoch 3/5:  65%|██████▍   | 765/1177 [34:31<18:26,  2.69s/it, exist=0.2774, loss=0.5294, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 766/1177 [34:31<21:17,  3.11s/it, exist=0.2774, loss=0.5294, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 766/1177 [34:33<21:17,  3.11s/it, exist=0.2773, loss=0.5291, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 767/1177 [34:33<20:39,  3.02s/it, exist=0.2773, loss=0.5291, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 767/1177 [34:36<20:39,  3.02s/it, exist=0.2773, loss=0.5295, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 768/1177 [34:36<19:55,  2.92s/it, exist=0.2773, loss=0.5295, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 768/1177 [34:39<19:55,  2.92s/it, exist=0.2775, loss=0.5298, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 769/1177 [34:39<19:46,  2.91s/it, exist=0.2775, loss=0.5298, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 769/1177 [34:43<19:46,  2.91s/it, exist=0.2774, loss=0.5296, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 770/1177 [34:43<22:10,  3.27s/it, exist=0.2774, loss=0.5296, lr=2.67e-05]
Epoch 3/5:  65%|██████▌   | 770/1177 [34:45<22:10,  3.27s/it, exist=0.2772, loss=0.5294, lr=2.67e-05]
Epoch 3/5:  66%|██████▌   | 771/1177 [34:45<20:04,  2.97s/it, exist=0.2772, loss=0.5294, lr=2.67e-05]
Epoch 3/5:  66%|██████▌   | 771/1177 [34:47<20:04,  2.97s/it, exist=0.2771, loss=0.5294, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 772/1177 [34:47<18:03,  2.68s/it, exist=0.2771, loss=0.5294, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 772/1177 [34:51<18:03,  2.68s/it, exist=0.2772, loss=0.5294, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 773/1177 [34:51<20:17,  3.01s/it, exist=0.2772, loss=0.5294, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 773/1177 [34:54<20:17,  3.01s/it, exist=0.2774, loss=0.5297, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 774/1177 [34:54<19:40,  2.93s/it, exist=0.2774, loss=0.5297, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 774/1177 [34:56<19:40,  2.93s/it, exist=0.2778, loss=0.5306, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 775/1177 [34:56<18:32,  2.77s/it, exist=0.2778, loss=0.5306, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 775/1177 [34:59<18:32,  2.77s/it, exist=0.2781, loss=0.5307, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 776/1177 [34:59<18:03,  2.70s/it, exist=0.2781, loss=0.5307, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 776/1177 [35:01<18:03,  2.70s/it, exist=0.2781, loss=0.5307, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 777/1177 [35:01<17:47,  2.67s/it, exist=0.2781, loss=0.5307, lr=2.66e-05]
Epoch 3/5:  66%|██████▌   | 777/1177 [35:04<17:47,  2.67s/it, exist=0.2780, loss=0.5307, lr=2.65e-05]
Epoch 3/5:  66%|██████▌   | 778/1177 [35:04<17:42,  2.66s/it, exist=0.2780, loss=0.5307, lr=2.65e-05]
Epoch 3/5:  66%|██████▌   | 778/1177 [35:07<17:42,  2.66s/it, exist=0.2779, loss=0.5306, lr=2.65e-05]
Epoch 3/5:  66%|██████▌   | 779/1177 [35:07<18:23,  2.77s/it, exist=0.2779, loss=0.5306, lr=2.65e-05]
Epoch 3/5:  66%|██████▌   | 779/1177 [35:10<18:23,  2.77s/it, exist=0.2779, loss=0.5305, lr=2.65e-05]
Epoch 3/5:  66%|██████▋   | 780/1177 [35:10<18:55,  2.86s/it, exist=0.2779, loss=0.5305, lr=2.65e-05]
Epoch 3/5:  66%|██████▋   | 780/1177 [35:13<18:55,  2.86s/it, exist=0.2779, loss=0.5305, lr=2.65e-05]
Epoch 3/5:  66%|██████▋   | 781/1177 [35:13<18:32,  2.81s/it, exist=0.2779, loss=0.5305, lr=2.65e-05]
Epoch 3/5:  66%|██████▋   | 781/1177 [35:15<18:32,  2.81s/it, exist=0.2777, loss=0.5303, lr=2.65e-05]
Epoch 3/5:  66%|██████▋   | 782/1177 [35:15<17:53,  2.72s/it, exist=0.2777, loss=0.5303, lr=2.65e-05]
Epoch 3/5:  66%|██████▋   | 782/1177 [35:18<17:53,  2.72s/it, exist=0.2777, loss=0.5303, lr=2.65e-05]
Epoch 3/5:  67%|██████▋   | 783/1177 [35:18<18:00,  2.74s/it, exist=0.2777, loss=0.5303, lr=2.65e-05]
Epoch 3/5:  67%|██████▋   | 783/1177 [35:21<18:00,  2.74s/it, exist=0.2778, loss=0.5303, lr=2.65e-05]
Epoch 3/5:  67%|██████▋   | 784/1177 [35:21<17:52,  2.73s/it, exist=0.2778, loss=0.5303, lr=2.65e-05]
Epoch 3/5:  67%|██████▋   | 784/1177 [35:23<17:52,  2.73s/it, exist=0.2775, loss=0.5301, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 785/1177 [35:23<17:20,  2.65s/it, exist=0.2775, loss=0.5301, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 785/1177 [35:26<17:20,  2.65s/it, exist=0.2772, loss=0.5298, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 786/1177 [35:26<16:53,  2.59s/it, exist=0.2772, loss=0.5298, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 786/1177 [35:28<16:53,  2.59s/it, exist=0.2770, loss=0.5299, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 787/1177 [35:28<16:53,  2.60s/it, exist=0.2770, loss=0.5299, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 787/1177 [35:31<16:53,  2.60s/it, exist=0.2769, loss=0.5298, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 788/1177 [35:31<16:58,  2.62s/it, exist=0.2769, loss=0.5298, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 788/1177 [35:33<16:58,  2.62s/it, exist=0.2767, loss=0.5297, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 789/1177 [35:33<15:34,  2.41s/it, exist=0.2767, loss=0.5297, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 789/1177 [35:36<15:34,  2.41s/it, exist=0.2770, loss=0.5301, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 790/1177 [35:36<17:03,  2.65s/it, exist=0.2770, loss=0.5301, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 790/1177 [35:39<17:03,  2.65s/it, exist=0.2767, loss=0.5299, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 791/1177 [35:39<16:46,  2.61s/it, exist=0.2767, loss=0.5299, lr=2.64e-05]
Epoch 3/5:  67%|██████▋   | 791/1177 [35:41<16:46,  2.61s/it, exist=0.2768, loss=0.5300, lr=2.63e-05]
Epoch 3/5:  67%|██████▋   | 792/1177 [35:41<16:30,  2.57s/it, exist=0.2768, loss=0.5300, lr=2.63e-05]
Epoch 3/5:  67%|██████▋   | 792/1177 [35:44<16:30,  2.57s/it, exist=0.2770, loss=0.5301, lr=2.63e-05]
Epoch 3/5:  67%|██████▋   | 793/1177 [35:44<17:04,  2.67s/it, exist=0.2770, loss=0.5301, lr=2.63e-05]
Epoch 3/5:  67%|██████▋   | 793/1177 [35:47<17:04,  2.67s/it, exist=0.2770, loss=0.5301, lr=2.63e-05]
Epoch 3/5:  67%|██████▋   | 794/1177 [35:47<16:30,  2.59s/it, exist=0.2770, loss=0.5301, lr=2.63e-05]
Epoch 3/5:  67%|██████▋   | 794/1177 [35:49<16:30,  2.59s/it, exist=0.2768, loss=0.5300, lr=2.63e-05]
Epoch 3/5:  68%|██████▊   | 795/1177 [35:49<16:29,  2.59s/it, exist=0.2768, loss=0.5300, lr=2.63e-05]
Epoch 3/5:  68%|██████▊   | 795/1177 [35:51<16:29,  2.59s/it, exist=0.2769, loss=0.5301, lr=2.63e-05]
Epoch 3/5:  68%|██████▊   | 796/1177 [35:51<15:15,  2.40s/it, exist=0.2769, loss=0.5301, lr=2.63e-05]
Epoch 3/5:  68%|██████▊   | 796/1177 [35:54<15:15,  2.40s/it, exist=0.2767, loss=0.5300, lr=2.63e-05]
Epoch 3/5:  68%|██████▊   | 797/1177 [35:54<15:48,  2.50s/it, exist=0.2767, loss=0.5300, lr=2.63e-05]
Epoch 3/5:  68%|██████▊   | 797/1177 [35:56<15:48,  2.50s/it, exist=0.2765, loss=0.5297, lr=2.63e-05]
Epoch 3/5:  68%|██████▊   | 798/1177 [35:56<16:08,  2.55s/it, exist=0.2765, loss=0.5297, lr=2.63e-05]
Epoch 3/5:  68%|██████▊   | 798/1177 [35:59<16:08,  2.55s/it, exist=0.2764, loss=0.5296, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 799/1177 [35:59<16:06,  2.56s/it, exist=0.2764, loss=0.5296, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 799/1177 [36:03<16:06,  2.56s/it, exist=0.2769, loss=0.5300, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 800/1177 [36:03<18:49,  2.99s/it, exist=0.2769, loss=0.5300, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 800/1177 [36:05<18:49,  2.99s/it, exist=0.2771, loss=0.5302, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 801/1177 [36:05<16:47,  2.68s/it, exist=0.2771, loss=0.5302, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 801/1177 [36:08<16:47,  2.68s/it, exist=0.2772, loss=0.5302, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 802/1177 [36:08<16:30,  2.64s/it, exist=0.2772, loss=0.5302, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 802/1177 [36:10<16:30,  2.64s/it, exist=0.2771, loss=0.5301, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 803/1177 [36:10<16:29,  2.65s/it, exist=0.2771, loss=0.5301, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 803/1177 [36:12<16:29,  2.65s/it, exist=0.2770, loss=0.5299, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 804/1177 [36:12<15:14,  2.45s/it, exist=0.2770, loss=0.5299, lr=2.62e-05]
Epoch 3/5:  68%|██████▊   | 804/1177 [36:15<15:14,  2.45s/it, exist=0.2770, loss=0.5298, lr=2.61e-05]
Epoch 3/5:  68%|██████▊   | 805/1177 [36:15<16:27,  2.65s/it, exist=0.2770, loss=0.5298, lr=2.61e-05]
Epoch 3/5:  68%|██████▊   | 805/1177 [36:17<16:27,  2.65s/it, exist=0.2770, loss=0.5300, lr=2.61e-05]
Epoch 3/5:  68%|██████▊   | 806/1177 [36:17<15:06,  2.44s/it, exist=0.2770, loss=0.5300, lr=2.61e-05]
Epoch 3/5:  68%|██████▊   | 806/1177 [36:21<15:06,  2.44s/it, exist=0.2770, loss=0.5300, lr=2.61e-05]
Epoch 3/5:  69%|██████▊   | 807/1177 [36:21<17:09,  2.78s/it, exist=0.2770, loss=0.5300, lr=2.61e-05]
Epoch 3/5:  69%|██████▊   | 807/1177 [36:24<17:09,  2.78s/it, exist=0.2770, loss=0.5299, lr=2.61e-05]
Epoch 3/5:  69%|██████▊   | 808/1177 [36:24<18:34,  3.02s/it, exist=0.2770, loss=0.5299, lr=2.61e-05]
Epoch 3/5:  69%|██████▊   | 808/1177 [36:29<18:34,  3.02s/it, exist=0.2770, loss=0.5300, lr=2.61e-05]
Epoch 3/5:  69%|██████▊   | 809/1177 [36:29<21:18,  3.47s/it, exist=0.2770, loss=0.5300, lr=2.61e-05]
Epoch 3/5:  69%|██████▊   | 809/1177 [36:31<21:18,  3.47s/it, exist=0.2769, loss=0.5298, lr=2.61e-05]
Epoch 3/5:  69%|██████▉   | 810/1177 [36:31<19:11,  3.14s/it, exist=0.2769, loss=0.5298, lr=2.61e-05]
Epoch 3/5:  69%|██████▉   | 810/1177 [36:35<19:11,  3.14s/it, exist=0.2769, loss=0.5298, lr=2.61e-05]
Epoch 3/5:  69%|██████▉   | 811/1177 [36:35<19:34,  3.21s/it, exist=0.2769, loss=0.5298, lr=2.61e-05]
Epoch 3/5:  69%|██████▉   | 811/1177 [36:37<19:34,  3.21s/it, exist=0.2768, loss=0.5297, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 812/1177 [36:37<17:33,  2.89s/it, exist=0.2768, loss=0.5297, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 812/1177 [36:39<17:33,  2.89s/it, exist=0.2767, loss=0.5297, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 813/1177 [36:39<16:56,  2.79s/it, exist=0.2767, loss=0.5297, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 813/1177 [36:43<16:56,  2.79s/it, exist=0.2769, loss=0.5298, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 814/1177 [36:43<17:36,  2.91s/it, exist=0.2769, loss=0.5298, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 814/1177 [36:45<17:36,  2.91s/it, exist=0.2767, loss=0.5295, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 815/1177 [36:45<15:55,  2.64s/it, exist=0.2767, loss=0.5295, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 815/1177 [36:47<15:55,  2.64s/it, exist=0.2771, loss=0.5298, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 816/1177 [36:47<16:18,  2.71s/it, exist=0.2771, loss=0.5298, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 816/1177 [36:50<16:18,  2.71s/it, exist=0.2771, loss=0.5298, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 817/1177 [36:50<16:01,  2.67s/it, exist=0.2771, loss=0.5298, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 817/1177 [36:52<16:01,  2.67s/it, exist=0.2772, loss=0.5298, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 818/1177 [36:52<14:39,  2.45s/it, exist=0.2772, loss=0.5298, lr=2.60e-05]
Epoch 3/5:  69%|██████▉   | 818/1177 [36:55<14:39,  2.45s/it, exist=0.2773, loss=0.5300, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 819/1177 [36:55<16:07,  2.70s/it, exist=0.2773, loss=0.5300, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 819/1177 [36:57<16:07,  2.70s/it, exist=0.2774, loss=0.5300, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 820/1177 [36:57<14:43,  2.48s/it, exist=0.2774, loss=0.5300, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 820/1177 [37:00<14:43,  2.48s/it, exist=0.2776, loss=0.5302, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 821/1177 [37:00<14:51,  2.50s/it, exist=0.2776, loss=0.5302, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 821/1177 [37:04<14:51,  2.50s/it, exist=0.2775, loss=0.5300, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 822/1177 [37:04<17:23,  2.94s/it, exist=0.2775, loss=0.5300, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 822/1177 [37:06<17:23,  2.94s/it, exist=0.2775, loss=0.5300, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 823/1177 [37:06<16:29,  2.80s/it, exist=0.2775, loss=0.5300, lr=2.59e-05]
Epoch 3/5:  70%|██████▉   | 823/1177 [37:09<16:29,  2.80s/it, exist=0.2780, loss=0.5306, lr=2.59e-05]
Epoch 3/5:  70%|███████   | 824/1177 [37:09<15:43,  2.67s/it, exist=0.2780, loss=0.5306, lr=2.59e-05]
Epoch 3/5:  70%|███████   | 824/1177 [37:11<15:43,  2.67s/it, exist=0.2780, loss=0.5305, lr=2.59e-05]
Epoch 3/5:  70%|███████   | 825/1177 [37:11<15:41,  2.67s/it, exist=0.2780, loss=0.5305, lr=2.59e-05]
Epoch 3/5:  70%|███████   | 825/1177 [37:13<15:41,  2.67s/it, exist=0.2781, loss=0.5308, lr=2.58e-05]
Epoch 3/5:  70%|███████   | 826/1177 [37:13<14:36,  2.50s/it, exist=0.2781, loss=0.5308, lr=2.58e-05]
Epoch 3/5:  70%|███████   | 826/1177 [37:17<14:36,  2.50s/it, exist=0.2779, loss=0.5306, lr=2.58e-05]
Epoch 3/5:  70%|███████   | 827/1177 [37:17<17:13,  2.95s/it, exist=0.2779, loss=0.5306, lr=2.58e-05]
Epoch 3/5:  70%|███████   | 827/1177 [37:23<17:13,  2.95s/it, exist=0.2778, loss=0.5303, lr=2.58e-05]
Epoch 3/5:  70%|███████   | 828/1177 [37:23<21:59,  3.78s/it, exist=0.2778, loss=0.5303, lr=2.58e-05]
Epoch 3/5:  70%|███████   | 828/1177 [37:27<21:59,  3.78s/it, exist=0.2779, loss=0.5305, lr=2.58e-05]
Epoch 3/5:  70%|███████   | 829/1177 [37:27<21:54,  3.78s/it, exist=0.2779, loss=0.5305, lr=2.58e-05]
Epoch 3/5:  70%|███████   | 829/1177 [37:29<21:54,  3.78s/it, exist=0.2780, loss=0.5307, lr=2.58e-05]
Epoch 3/5:  71%|███████   | 830/1177 [37:29<18:39,  3.23s/it, exist=0.2780, loss=0.5307, lr=2.58e-05]
Epoch 3/5:  71%|███████   | 830/1177 [37:31<18:39,  3.23s/it, exist=0.2780, loss=0.5307, lr=2.58e-05]
Epoch 3/5:  71%|███████   | 831/1177 [37:31<16:27,  2.86s/it, exist=0.2780, loss=0.5307, lr=2.58e-05]
Epoch 3/5:  71%|███████   | 831/1177 [37:33<16:27,  2.86s/it, exist=0.2779, loss=0.5306, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 832/1177 [37:33<15:47,  2.75s/it, exist=0.2779, loss=0.5306, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 832/1177 [37:35<15:47,  2.75s/it, exist=0.2783, loss=0.5311, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 833/1177 [37:35<14:17,  2.49s/it, exist=0.2783, loss=0.5311, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 833/1177 [37:37<14:17,  2.49s/it, exist=0.2781, loss=0.5308, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 834/1177 [37:37<13:27,  2.35s/it, exist=0.2781, loss=0.5308, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 834/1177 [37:41<13:27,  2.35s/it, exist=0.2781, loss=0.5307, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 835/1177 [37:41<16:07,  2.83s/it, exist=0.2781, loss=0.5307, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 835/1177 [37:44<16:07,  2.83s/it, exist=0.2779, loss=0.5308, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 836/1177 [37:44<15:24,  2.71s/it, exist=0.2779, loss=0.5308, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 836/1177 [37:46<15:24,  2.71s/it, exist=0.2777, loss=0.5305, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 837/1177 [37:46<14:03,  2.48s/it, exist=0.2777, loss=0.5305, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 837/1177 [37:49<14:03,  2.48s/it, exist=0.2777, loss=0.5305, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 838/1177 [37:49<15:30,  2.74s/it, exist=0.2777, loss=0.5305, lr=2.57e-05]
Epoch 3/5:  71%|███████   | 838/1177 [37:51<15:30,  2.74s/it, exist=0.2776, loss=0.5303, lr=2.56e-05]
Epoch 3/5:  71%|███████▏  | 839/1177 [37:51<14:08,  2.51s/it, exist=0.2776, loss=0.5303, lr=2.56e-05]
Epoch 3/5:  71%|███████▏  | 839/1177 [37:53<14:08,  2.51s/it, exist=0.2776, loss=0.5302, lr=2.56e-05]
Epoch 3/5:  71%|███████▏  | 840/1177 [37:53<14:16,  2.54s/it, exist=0.2776, loss=0.5302, lr=2.56e-05]
Epoch 3/5:  71%|███████▏  | 840/1177 [37:56<14:16,  2.54s/it, exist=0.2774, loss=0.5301, lr=2.56e-05]
Epoch 3/5:  71%|███████▏  | 841/1177 [37:56<14:18,  2.55s/it, exist=0.2774, loss=0.5301, lr=2.56e-05]
Epoch 3/5:  71%|███████▏  | 841/1177 [37:59<14:18,  2.55s/it, exist=0.2776, loss=0.5302, lr=2.56e-05]
Epoch 3/5:  72%|███████▏  | 842/1177 [37:59<14:13,  2.55s/it, exist=0.2776, loss=0.5302, lr=2.56e-05]
Epoch 3/5:  72%|███████▏  | 842/1177 [38:01<14:13,  2.55s/it, exist=0.2775, loss=0.5301, lr=2.56e-05]
Epoch 3/5:  72%|███████▏  | 843/1177 [38:01<13:59,  2.51s/it, exist=0.2775, loss=0.5301, lr=2.56e-05]
Epoch 3/5:  72%|███████▏  | 843/1177 [38:04<13:59,  2.51s/it, exist=0.2774, loss=0.5299, lr=2.56e-05]
Epoch 3/5:  72%|███████▏  | 844/1177 [38:04<15:11,  2.74s/it, exist=0.2774, loss=0.5299, lr=2.56e-05]
Epoch 3/5:  72%|███████▏  | 844/1177 [38:07<15:11,  2.74s/it, exist=0.2772, loss=0.5296, lr=2.56e-05]
Epoch 3/5:  72%|███████▏  | 845/1177 [38:07<14:51,  2.69s/it, exist=0.2772, loss=0.5296, lr=2.56e-05]
Epoch 3/5:  72%|███████▏  | 845/1177 [38:11<14:51,  2.69s/it, exist=0.2770, loss=0.5294, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 846/1177 [38:11<16:45,  3.04s/it, exist=0.2770, loss=0.5294, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 846/1177 [38:13<16:45,  3.04s/it, exist=0.2768, loss=0.5292, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 847/1177 [38:13<14:59,  2.73s/it, exist=0.2768, loss=0.5292, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 847/1177 [38:15<14:59,  2.73s/it, exist=0.2769, loss=0.5293, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 848/1177 [38:15<13:35,  2.48s/it, exist=0.2769, loss=0.5293, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 848/1177 [38:18<13:35,  2.48s/it, exist=0.2769, loss=0.5292, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 849/1177 [38:18<15:08,  2.77s/it, exist=0.2769, loss=0.5292, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 849/1177 [38:22<15:08,  2.77s/it, exist=0.2771, loss=0.5295, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 850/1177 [38:22<16:47,  3.08s/it, exist=0.2771, loss=0.5295, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 850/1177 [38:24<16:47,  3.08s/it, exist=0.2771, loss=0.5295, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 851/1177 [38:24<14:54,  2.75s/it, exist=0.2771, loss=0.5295, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 851/1177 [38:27<14:54,  2.75s/it, exist=0.2769, loss=0.5296, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 852/1177 [38:27<14:56,  2.76s/it, exist=0.2769, loss=0.5296, lr=2.55e-05]
Epoch 3/5:  72%|███████▏  | 852/1177 [38:29<14:56,  2.76s/it, exist=0.2771, loss=0.5299, lr=2.54e-05]
Epoch 3/5:  72%|███████▏  | 853/1177 [38:29<14:55,  2.76s/it, exist=0.2771, loss=0.5299, lr=2.54e-05]
Epoch 3/5:  72%|███████▏  | 853/1177 [38:33<14:55,  2.76s/it, exist=0.2774, loss=0.5303, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 854/1177 [38:33<16:03,  2.98s/it, exist=0.2774, loss=0.5303, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 854/1177 [38:36<16:03,  2.98s/it, exist=0.2780, loss=0.5308, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 855/1177 [38:36<15:27,  2.88s/it, exist=0.2780, loss=0.5308, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 855/1177 [38:38<15:27,  2.88s/it, exist=0.2782, loss=0.5309, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 856/1177 [38:38<15:24,  2.88s/it, exist=0.2782, loss=0.5309, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 856/1177 [38:41<15:24,  2.88s/it, exist=0.2780, loss=0.5307, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 857/1177 [38:41<15:02,  2.82s/it, exist=0.2780, loss=0.5307, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 857/1177 [38:43<15:02,  2.82s/it, exist=0.2779, loss=0.5306, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 858/1177 [38:43<13:37,  2.56s/it, exist=0.2779, loss=0.5306, lr=2.54e-05]
Epoch 3/5:  73%|███████▎  | 858/1177 [38:46<13:37,  2.56s/it, exist=0.2777, loss=0.5304, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 859/1177 [38:46<13:35,  2.57s/it, exist=0.2777, loss=0.5304, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 859/1177 [38:49<13:35,  2.57s/it, exist=0.2776, loss=0.5302, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 860/1177 [38:49<15:31,  2.94s/it, exist=0.2776, loss=0.5302, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 860/1177 [38:52<15:31,  2.94s/it, exist=0.2776, loss=0.5302, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 861/1177 [38:52<14:57,  2.84s/it, exist=0.2776, loss=0.5302, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 861/1177 [38:55<14:57,  2.84s/it, exist=0.2780, loss=0.5306, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 862/1177 [38:55<15:10,  2.89s/it, exist=0.2780, loss=0.5306, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 862/1177 [38:57<15:10,  2.89s/it, exist=0.2779, loss=0.5305, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 863/1177 [38:57<13:45,  2.63s/it, exist=0.2779, loss=0.5305, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 863/1177 [38:59<13:45,  2.63s/it, exist=0.2780, loss=0.5304, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 864/1177 [38:59<12:41,  2.43s/it, exist=0.2780, loss=0.5304, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 864/1177 [39:02<12:41,  2.43s/it, exist=0.2778, loss=0.5304, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 865/1177 [39:02<13:52,  2.67s/it, exist=0.2778, loss=0.5304, lr=2.53e-05]
Epoch 3/5:  73%|███████▎  | 865/1177 [39:04<13:52,  2.67s/it, exist=0.2776, loss=0.5301, lr=2.52e-05]
Epoch 3/5:  74%|███████▎  | 866/1177 [39:04<12:44,  2.46s/it, exist=0.2776, loss=0.5301, lr=2.52e-05]
Epoch 3/5:  74%|███████▎  | 866/1177 [39:07<12:44,  2.46s/it, exist=0.2775, loss=0.5302, lr=2.52e-05]
Epoch 3/5:  74%|███████▎  | 867/1177 [39:07<13:54,  2.69s/it, exist=0.2775, loss=0.5302, lr=2.52e-05]
Epoch 3/5:  74%|███████▎  | 867/1177 [39:10<13:54,  2.69s/it, exist=0.2774, loss=0.5300, lr=2.52e-05]
Epoch 3/5:  74%|███████▎  | 868/1177 [39:10<13:45,  2.67s/it, exist=0.2774, loss=0.5300, lr=2.52e-05]
Epoch 3/5:  74%|███████▎  | 868/1177 [39:13<13:45,  2.67s/it, exist=0.2773, loss=0.5300, lr=2.52e-05]
Epoch 3/5:  74%|███████▍  | 869/1177 [39:13<14:45,  2.87s/it, exist=0.2773, loss=0.5300, lr=2.52e-05]
Epoch 3/5:  74%|███████▍  | 869/1177 [39:16<14:45,  2.87s/it, exist=0.2775, loss=0.5300, lr=2.52e-05]
Epoch 3/5:  74%|███████▍  | 870/1177 [39:16<13:59,  2.74s/it, exist=0.2775, loss=0.5300, lr=2.52e-05]
Epoch 3/5:  74%|███████▍  | 870/1177 [39:18<13:59,  2.74s/it, exist=0.2776, loss=0.5304, lr=2.52e-05]
Epoch 3/5:  74%|███████▍  | 871/1177 [39:18<13:29,  2.64s/it, exist=0.2776, loss=0.5304, lr=2.52e-05]
Epoch 3/5:  74%|███████▍  | 871/1177 [39:20<13:29,  2.64s/it, exist=0.2775, loss=0.5302, lr=2.52e-05]
Epoch 3/5:  74%|███████▍  | 872/1177 [39:20<12:25,  2.44s/it, exist=0.2775, loss=0.5302, lr=2.52e-05]
Epoch 3/5:  74%|███████▍  | 872/1177 [39:24<12:25,  2.44s/it, exist=0.2774, loss=0.5301, lr=2.51e-05]
Epoch 3/5:  74%|███████▍  | 873/1177 [39:24<14:10,  2.80s/it, exist=0.2774, loss=0.5301, lr=2.51e-05]
Epoch 3/5:  74%|███████▍  | 873/1177 [39:27<14:10,  2.80s/it, exist=0.2774, loss=0.5301, lr=2.51e-05]
Epoch 3/5:  74%|███████▍  | 874/1177 [39:27<14:21,  2.84s/it, exist=0.2774, loss=0.5301, lr=2.51e-05]
Epoch 3/5:  74%|███████▍  | 874/1177 [39:30<14:21,  2.84s/it, exist=0.2775, loss=0.5302, lr=2.51e-05]
Epoch 3/5:  74%|███████▍  | 875/1177 [39:30<15:00,  2.98s/it, exist=0.2775, loss=0.5302, lr=2.51e-05]
Epoch 3/5:  74%|███████▍  | 875/1177 [39:33<15:00,  2.98s/it, exist=0.2777, loss=0.5304, lr=2.51e-05]
Epoch 3/5:  74%|███████▍  | 876/1177 [39:33<14:12,  2.83s/it, exist=0.2777, loss=0.5304, lr=2.51e-05]
Epoch 3/5:  74%|███████▍  | 876/1177 [39:35<14:12,  2.83s/it, exist=0.2777, loss=0.5304, lr=2.51e-05]
Epoch 3/5:  75%|███████▍  | 877/1177 [39:35<13:51,  2.77s/it, exist=0.2777, loss=0.5304, lr=2.51e-05]
Epoch 3/5:  75%|███████▍  | 877/1177 [39:38<13:51,  2.77s/it, exist=0.2777, loss=0.5304, lr=2.51e-05]
Epoch 3/5:  75%|███████▍  | 878/1177 [39:38<14:25,  2.89s/it, exist=0.2777, loss=0.5304, lr=2.51e-05]
Epoch 3/5:  75%|███████▍  | 878/1177 [39:40<14:25,  2.89s/it, exist=0.2776, loss=0.5303, lr=2.51e-05]
Epoch 3/5:  75%|███████▍  | 879/1177 [39:40<13:00,  2.62s/it, exist=0.2776, loss=0.5303, lr=2.51e-05]
Epoch 3/5:  75%|███████▍  | 879/1177 [39:43<13:00,  2.62s/it, exist=0.2774, loss=0.5301, lr=2.50e-05]
Epoch 3/5:  75%|███████▍  | 880/1177 [39:43<12:52,  2.60s/it, exist=0.2774, loss=0.5301, lr=2.50e-05]
Epoch 3/5:  75%|███████▍  | 880/1177 [39:47<12:52,  2.60s/it, exist=0.2772, loss=0.5298, lr=2.50e-05]
Epoch 3/5:  75%|███████▍  | 881/1177 [39:47<14:48,  3.00s/it, exist=0.2772, loss=0.5298, lr=2.50e-05]
Epoch 3/5:  75%|███████▍  | 881/1177 [39:51<14:48,  3.00s/it, exist=0.2775, loss=0.5301, lr=2.50e-05]
Epoch 3/5:  75%|███████▍  | 882/1177 [39:51<16:18,  3.32s/it, exist=0.2775, loss=0.5301, lr=2.50e-05]
Epoch 3/5:  75%|███████▍  | 882/1177 [39:54<16:18,  3.32s/it, exist=0.2773, loss=0.5300, lr=2.50e-05]
Epoch 3/5:  75%|███████▌  | 883/1177 [39:54<15:08,  3.09s/it, exist=0.2773, loss=0.5300, lr=2.50e-05]
Epoch 3/5:  75%|███████▌  | 883/1177 [39:56<15:08,  3.09s/it, exist=0.2771, loss=0.5298, lr=2.50e-05]
Epoch 3/5:  75%|███████▌  | 884/1177 [39:56<13:29,  2.76s/it, exist=0.2771, loss=0.5298, lr=2.50e-05]
Epoch 3/5:  75%|███████▌  | 884/1177 [39:58<13:29,  2.76s/it, exist=0.2773, loss=0.5299, lr=2.50e-05]
Epoch 3/5:  75%|███████▌  | 885/1177 [39:58<12:19,  2.53s/it, exist=0.2773, loss=0.5299, lr=2.50e-05]
Epoch 3/5:  75%|███████▌  | 885/1177 [40:00<12:19,  2.53s/it, exist=0.2776, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  75%|███████▌  | 886/1177 [40:00<12:33,  2.59s/it, exist=0.2776, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  75%|███████▌  | 886/1177 [40:04<12:33,  2.59s/it, exist=0.2776, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  75%|███████▌  | 887/1177 [40:04<13:49,  2.86s/it, exist=0.2776, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  75%|███████▌  | 887/1177 [40:06<13:49,  2.86s/it, exist=0.2774, loss=0.5304, lr=2.49e-05]
Epoch 3/5:  75%|███████▌  | 888/1177 [40:06<12:28,  2.59s/it, exist=0.2774, loss=0.5304, lr=2.49e-05]
Epoch 3/5:  75%|███████▌  | 888/1177 [40:09<12:28,  2.59s/it, exist=0.2773, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  76%|███████▌  | 889/1177 [40:09<13:50,  2.88s/it, exist=0.2773, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  76%|███████▌  | 889/1177 [40:11<13:50,  2.88s/it, exist=0.2773, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  76%|███████▌  | 890/1177 [40:11<12:30,  2.61s/it, exist=0.2773, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  76%|███████▌  | 890/1177 [40:16<12:30,  2.61s/it, exist=0.2772, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  76%|███████▌  | 891/1177 [40:16<15:03,  3.16s/it, exist=0.2772, loss=0.5302, lr=2.49e-05]
Epoch 3/5:  76%|███████▌  | 891/1177 [40:19<15:03,  3.16s/it, exist=0.2770, loss=0.5301, lr=2.49e-05]
Epoch 3/5:  76%|███████▌  | 892/1177 [40:19<15:32,  3.27s/it, exist=0.2770, loss=0.5301, lr=2.49e-05]
Epoch 3/5:  76%|███████▌  | 892/1177 [40:23<15:32,  3.27s/it, exist=0.2769, loss=0.5299, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 893/1177 [40:23<15:45,  3.33s/it, exist=0.2769, loss=0.5299, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 893/1177 [40:26<15:45,  3.33s/it, exist=0.2767, loss=0.5299, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 894/1177 [40:26<15:47,  3.35s/it, exist=0.2767, loss=0.5299, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 894/1177 [40:28<15:47,  3.35s/it, exist=0.2767, loss=0.5298, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 895/1177 [40:28<13:52,  2.95s/it, exist=0.2767, loss=0.5298, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 895/1177 [40:30<13:52,  2.95s/it, exist=0.2766, loss=0.5299, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 896/1177 [40:30<12:31,  2.67s/it, exist=0.2766, loss=0.5299, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 896/1177 [40:33<12:31,  2.67s/it, exist=0.2765, loss=0.5297, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 897/1177 [40:33<12:36,  2.70s/it, exist=0.2765, loss=0.5297, lr=2.48e-05]
Epoch 3/5:  76%|███████▌  | 897/1177 [40:38<12:36,  2.70s/it, exist=0.2765, loss=0.5298, lr=2.48e-05]
Epoch 3/5:  76%|███████▋  | 898/1177 [40:38<15:40,  3.37s/it, exist=0.2765, loss=0.5298, lr=2.48e-05]
Epoch 3/5:  76%|███████▋  | 898/1177 [40:41<15:40,  3.37s/it, exist=0.2764, loss=0.5297, lr=2.48e-05]
Epoch 3/5:  76%|███████▋  | 899/1177 [40:41<15:41,  3.39s/it, exist=0.2764, loss=0.5297, lr=2.48e-05]
Epoch 3/5:  76%|███████▋  | 899/1177 [40:45<15:41,  3.39s/it, exist=0.2763, loss=0.5296, lr=2.47e-05]
Epoch 3/5:  76%|███████▋  | 900/1177 [40:45<16:22,  3.55s/it, exist=0.2763, loss=0.5296, lr=2.47e-05]
Epoch 3/5:  76%|███████▋  | 900/1177 [40:48<16:22,  3.55s/it, exist=0.2765, loss=0.5299, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 901/1177 [40:48<15:16,  3.32s/it, exist=0.2765, loss=0.5299, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 901/1177 [40:51<15:16,  3.32s/it, exist=0.2766, loss=0.5300, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 902/1177 [40:51<14:50,  3.24s/it, exist=0.2766, loss=0.5300, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 902/1177 [40:53<14:50,  3.24s/it, exist=0.2764, loss=0.5298, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 903/1177 [40:53<13:08,  2.88s/it, exist=0.2764, loss=0.5298, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 903/1177 [40:56<13:08,  2.88s/it, exist=0.2764, loss=0.5298, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 904/1177 [40:56<12:54,  2.84s/it, exist=0.2764, loss=0.5298, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 904/1177 [40:59<12:54,  2.84s/it, exist=0.2763, loss=0.5297, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 905/1177 [40:59<13:43,  3.03s/it, exist=0.2763, loss=0.5297, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 905/1177 [41:03<13:43,  3.03s/it, exist=0.2766, loss=0.5299, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 906/1177 [41:03<14:19,  3.17s/it, exist=0.2766, loss=0.5299, lr=2.47e-05]
Epoch 3/5:  77%|███████▋  | 906/1177 [41:07<14:19,  3.17s/it, exist=0.2764, loss=0.5299, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 907/1177 [41:07<15:21,  3.41s/it, exist=0.2764, loss=0.5299, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 907/1177 [41:09<15:21,  3.41s/it, exist=0.2763, loss=0.5297, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 908/1177 [41:09<14:10,  3.16s/it, exist=0.2763, loss=0.5297, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 908/1177 [41:13<14:10,  3.16s/it, exist=0.2761, loss=0.5296, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 909/1177 [41:13<14:28,  3.24s/it, exist=0.2761, loss=0.5296, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 909/1177 [41:16<14:28,  3.24s/it, exist=0.2761, loss=0.5296, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 910/1177 [41:16<14:53,  3.35s/it, exist=0.2761, loss=0.5296, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 910/1177 [41:19<14:53,  3.35s/it, exist=0.2764, loss=0.5297, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 911/1177 [41:19<13:44,  3.10s/it, exist=0.2764, loss=0.5297, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 911/1177 [41:21<13:44,  3.10s/it, exist=0.2763, loss=0.5296, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 912/1177 [41:21<12:08,  2.75s/it, exist=0.2763, loss=0.5296, lr=2.46e-05]
Epoch 3/5:  77%|███████▋  | 912/1177 [41:23<12:08,  2.75s/it, exist=0.2762, loss=0.5296, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 913/1177 [41:23<11:05,  2.52s/it, exist=0.2762, loss=0.5296, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 913/1177 [41:25<11:05,  2.52s/it, exist=0.2761, loss=0.5300, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 914/1177 [41:25<11:19,  2.59s/it, exist=0.2761, loss=0.5300, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 914/1177 [41:30<11:19,  2.59s/it, exist=0.2761, loss=0.5299, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 915/1177 [41:30<13:13,  3.03s/it, exist=0.2761, loss=0.5299, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 915/1177 [41:33<13:13,  3.03s/it, exist=0.2759, loss=0.5297, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 916/1177 [41:33<13:47,  3.17s/it, exist=0.2759, loss=0.5297, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 916/1177 [41:36<13:47,  3.17s/it, exist=0.2758, loss=0.5295, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 917/1177 [41:36<13:25,  3.10s/it, exist=0.2758, loss=0.5295, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 917/1177 [41:39<13:25,  3.10s/it, exist=0.2758, loss=0.5295, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 918/1177 [41:39<13:42,  3.17s/it, exist=0.2758, loss=0.5295, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 918/1177 [41:41<13:42,  3.17s/it, exist=0.2757, loss=0.5294, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 919/1177 [41:41<12:08,  2.82s/it, exist=0.2757, loss=0.5294, lr=2.45e-05]
Epoch 3/5:  78%|███████▊  | 919/1177 [41:45<12:08,  2.82s/it, exist=0.2757, loss=0.5294, lr=2.44e-05]
Epoch 3/5:  78%|███████▊  | 920/1177 [41:45<12:32,  2.93s/it, exist=0.2757, loss=0.5294, lr=2.44e-05]
Epoch 3/5:  78%|███████▊  | 920/1177 [41:47<12:32,  2.93s/it, exist=0.2758, loss=0.5296, lr=2.44e-05]
Epoch 3/5:  78%|███████▊  | 921/1177 [41:47<12:09,  2.85s/it, exist=0.2758, loss=0.5296, lr=2.44e-05]
Epoch 3/5:  78%|███████▊  | 921/1177 [41:51<12:09,  2.85s/it, exist=0.2756, loss=0.5296, lr=2.44e-05]
Epoch 3/5:  78%|███████▊  | 922/1177 [41:51<13:02,  3.07s/it, exist=0.2756, loss=0.5296, lr=2.44e-05]
Epoch 3/5:  78%|███████▊  | 922/1177 [41:53<13:02,  3.07s/it, exist=0.2756, loss=0.5296, lr=2.44e-05]
Epoch 3/5:  78%|███████▊  | 923/1177 [41:53<11:34,  2.73s/it, exist=0.2756, loss=0.5296, lr=2.44e-05]
Epoch 3/5:  78%|███████▊  | 923/1177 [41:56<11:34,  2.73s/it, exist=0.2755, loss=0.5295, lr=2.44e-05]
Epoch 3/5:  79%|███████▊  | 924/1177 [41:56<12:16,  2.91s/it, exist=0.2755, loss=0.5295, lr=2.44e-05]
Epoch 3/5:  79%|███████▊  | 924/1177 [41:59<12:16,  2.91s/it, exist=0.2753, loss=0.5293, lr=2.44e-05]
Epoch 3/5:  79%|███████▊  | 925/1177 [41:59<11:54,  2.84s/it, exist=0.2753, loss=0.5293, lr=2.44e-05]
Epoch 3/5:  79%|███████▊  | 925/1177 [42:02<11:54,  2.84s/it, exist=0.2753, loss=0.5292, lr=2.44e-05]
Epoch 3/5:  79%|███████▊  | 926/1177 [42:02<12:58,  3.10s/it, exist=0.2753, loss=0.5292, lr=2.44e-05]
Epoch 3/5:  79%|███████▊  | 926/1177 [42:05<12:58,  3.10s/it, exist=0.2751, loss=0.5291, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 927/1177 [42:05<12:32,  3.01s/it, exist=0.2751, loss=0.5291, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 927/1177 [42:08<12:32,  3.01s/it, exist=0.2750, loss=0.5289, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 928/1177 [42:08<12:04,  2.91s/it, exist=0.2750, loss=0.5289, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 928/1177 [42:10<12:04,  2.91s/it, exist=0.2748, loss=0.5287, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 929/1177 [42:10<11:33,  2.80s/it, exist=0.2748, loss=0.5287, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 929/1177 [42:14<11:33,  2.80s/it, exist=0.2748, loss=0.5287, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 930/1177 [42:14<12:27,  3.03s/it, exist=0.2748, loss=0.5287, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 930/1177 [42:18<12:27,  3.03s/it, exist=0.2751, loss=0.5289, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 931/1177 [42:18<13:11,  3.22s/it, exist=0.2751, loss=0.5289, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 931/1177 [42:20<13:11,  3.22s/it, exist=0.2754, loss=0.5291, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 932/1177 [42:20<12:12,  2.99s/it, exist=0.2754, loss=0.5291, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 932/1177 [42:23<12:12,  2.99s/it, exist=0.2753, loss=0.5291, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 933/1177 [42:23<11:42,  2.88s/it, exist=0.2753, loss=0.5291, lr=2.43e-05]
Epoch 3/5:  79%|███████▉  | 933/1177 [42:26<11:42,  2.88s/it, exist=0.2751, loss=0.5288, lr=2.42e-05]
Epoch 3/5:  79%|███████▉  | 934/1177 [42:26<12:37,  3.12s/it, exist=0.2751, loss=0.5288, lr=2.42e-05]
Epoch 3/5:  79%|███████▉  | 934/1177 [42:28<12:37,  3.12s/it, exist=0.2752, loss=0.5289, lr=2.42e-05]
Epoch 3/5:  79%|███████▉  | 935/1177 [42:28<11:12,  2.78s/it, exist=0.2752, loss=0.5289, lr=2.42e-05]
Epoch 3/5:  79%|███████▉  | 935/1177 [42:30<11:12,  2.78s/it, exist=0.2750, loss=0.5287, lr=2.42e-05]
Epoch 3/5:  80%|███████▉  | 936/1177 [42:30<10:11,  2.54s/it, exist=0.2750, loss=0.5287, lr=2.42e-05]
Epoch 3/5:  80%|███████▉  | 936/1177 [42:34<10:11,  2.54s/it, exist=0.2750, loss=0.5288, lr=2.42e-05]
Epoch 3/5:  80%|███████▉  | 937/1177 [42:34<11:41,  2.92s/it, exist=0.2750, loss=0.5288, lr=2.42e-05]
Epoch 3/5:  80%|███████▉  | 937/1177 [42:38<11:41,  2.92s/it, exist=0.2754, loss=0.5291, lr=2.42e-05]
Epoch 3/5:  80%|███████▉  | 938/1177 [42:38<12:39,  3.18s/it, exist=0.2754, loss=0.5291, lr=2.42e-05]
Epoch 3/5:  80%|███████▉  | 938/1177 [42:41<12:39,  3.18s/it, exist=0.2753, loss=0.5290, lr=2.42e-05]
Epoch 3/5:  80%|███████▉  | 939/1177 [42:41<12:04,  3.05s/it, exist=0.2753, loss=0.5290, lr=2.42e-05]
Epoch 3/5:  80%|███████▉  | 939/1177 [42:43<12:04,  3.05s/it, exist=0.2755, loss=0.5292, lr=2.41e-05]
Epoch 3/5:  80%|███████▉  | 940/1177 [42:43<11:18,  2.86s/it, exist=0.2755, loss=0.5292, lr=2.41e-05]
Epoch 3/5:  80%|███████▉  | 940/1177 [42:46<11:18,  2.86s/it, exist=0.2755, loss=0.5292, lr=2.41e-05]
Epoch 3/5:  80%|███████▉  | 941/1177 [42:46<11:33,  2.94s/it, exist=0.2755, loss=0.5292, lr=2.41e-05]
Epoch 3/5:  80%|███████▉  | 941/1177 [42:50<11:33,  2.94s/it, exist=0.2753, loss=0.5290, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 942/1177 [42:50<11:53,  3.04s/it, exist=0.2753, loss=0.5290, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 942/1177 [42:51<11:53,  3.04s/it, exist=0.2753, loss=0.5292, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 943/1177 [42:51<10:36,  2.72s/it, exist=0.2753, loss=0.5292, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 943/1177 [42:55<10:36,  2.72s/it, exist=0.2753, loss=0.5292, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 944/1177 [42:55<11:12,  2.89s/it, exist=0.2753, loss=0.5292, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 944/1177 [42:59<11:12,  2.89s/it, exist=0.2750, loss=0.5289, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 945/1177 [42:59<12:15,  3.17s/it, exist=0.2750, loss=0.5289, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 945/1177 [43:01<12:15,  3.17s/it, exist=0.2749, loss=0.5287, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 946/1177 [43:01<11:38,  3.03s/it, exist=0.2749, loss=0.5287, lr=2.41e-05]
Epoch 3/5:  80%|████████  | 946/1177 [43:04<11:38,  3.03s/it, exist=0.2749, loss=0.5288, lr=2.40e-05]
Epoch 3/5:  80%|████████  | 947/1177 [43:04<11:10,  2.92s/it, exist=0.2749, loss=0.5288, lr=2.40e-05]
Epoch 3/5:  80%|████████  | 947/1177 [43:07<11:10,  2.92s/it, exist=0.2757, loss=0.5295, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 948/1177 [43:07<10:58,  2.88s/it, exist=0.2757, loss=0.5295, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 948/1177 [43:10<10:58,  2.88s/it, exist=0.2756, loss=0.5293, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 949/1177 [43:10<10:55,  2.88s/it, exist=0.2756, loss=0.5293, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 949/1177 [43:14<10:55,  2.88s/it, exist=0.2755, loss=0.5292, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 950/1177 [43:14<12:08,  3.21s/it, exist=0.2755, loss=0.5292, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 950/1177 [43:16<12:08,  3.21s/it, exist=0.2756, loss=0.5292, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 951/1177 [43:16<10:41,  2.84s/it, exist=0.2756, loss=0.5292, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 951/1177 [43:19<10:41,  2.84s/it, exist=0.2758, loss=0.5294, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 952/1177 [43:19<10:50,  2.89s/it, exist=0.2758, loss=0.5294, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 952/1177 [43:21<10:50,  2.89s/it, exist=0.2758, loss=0.5294, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 953/1177 [43:21<09:46,  2.62s/it, exist=0.2758, loss=0.5294, lr=2.40e-05]
Epoch 3/5:  81%|████████  | 953/1177 [43:23<09:46,  2.62s/it, exist=0.2756, loss=0.5295, lr=2.39e-05]
Epoch 3/5:  81%|████████  | 954/1177 [43:23<09:00,  2.42s/it, exist=0.2756, loss=0.5295, lr=2.39e-05]
Epoch 3/5:  81%|████████  | 954/1177 [43:25<09:00,  2.42s/it, exist=0.2755, loss=0.5293, lr=2.39e-05]
Epoch 3/5:  81%|████████  | 955/1177 [43:25<09:08,  2.47s/it, exist=0.2755, loss=0.5293, lr=2.39e-05]
Epoch 3/5:  81%|████████  | 955/1177 [43:28<09:08,  2.47s/it, exist=0.2755, loss=0.5293, lr=2.39e-05]
Epoch 3/5:  81%|████████  | 956/1177 [43:28<09:52,  2.68s/it, exist=0.2755, loss=0.5293, lr=2.39e-05]
Epoch 3/5:  81%|████████  | 956/1177 [43:31<09:52,  2.68s/it, exist=0.2753, loss=0.5291, lr=2.39e-05]
Epoch 3/5:  81%|████████▏ | 957/1177 [43:31<09:42,  2.65s/it, exist=0.2753, loss=0.5291, lr=2.39e-05]
Epoch 3/5:  81%|████████▏ | 957/1177 [43:33<09:42,  2.65s/it, exist=0.2755, loss=0.5292, lr=2.39e-05]
Epoch 3/5:  81%|████████▏ | 958/1177 [43:33<08:53,  2.44s/it, exist=0.2755, loss=0.5292, lr=2.39e-05]
Epoch 3/5:  81%|████████▏ | 958/1177 [43:36<08:53,  2.44s/it, exist=0.2754, loss=0.5291, lr=2.39e-05]
Epoch 3/5:  81%|████████▏ | 959/1177 [43:36<09:50,  2.71s/it, exist=0.2754, loss=0.5291, lr=2.39e-05]
Epoch 3/5:  81%|████████▏ | 959/1177 [43:39<09:50,  2.71s/it, exist=0.2755, loss=0.5294, lr=2.39e-05]
Epoch 3/5:  82%|████████▏ | 960/1177 [43:39<09:40,  2.68s/it, exist=0.2755, loss=0.5294, lr=2.39e-05]
Epoch 3/5:  82%|████████▏ | 960/1177 [43:41<09:40,  2.68s/it, exist=0.2753, loss=0.5291, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 961/1177 [43:41<09:35,  2.66s/it, exist=0.2753, loss=0.5291, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 961/1177 [43:43<09:35,  2.66s/it, exist=0.2752, loss=0.5289, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 962/1177 [43:43<08:46,  2.45s/it, exist=0.2752, loss=0.5289, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 962/1177 [43:47<08:46,  2.45s/it, exist=0.2751, loss=0.5289, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 963/1177 [43:47<09:34,  2.68s/it, exist=0.2751, loss=0.5289, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 963/1177 [43:49<09:34,  2.68s/it, exist=0.2750, loss=0.5287, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 964/1177 [43:49<09:11,  2.59s/it, exist=0.2750, loss=0.5287, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 964/1177 [43:51<09:11,  2.59s/it, exist=0.2749, loss=0.5285, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 965/1177 [43:51<08:32,  2.42s/it, exist=0.2749, loss=0.5285, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 965/1177 [43:53<08:32,  2.42s/it, exist=0.2749, loss=0.5286, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 966/1177 [43:53<08:00,  2.28s/it, exist=0.2749, loss=0.5286, lr=2.38e-05]
Epoch 3/5:  82%|████████▏ | 966/1177 [43:57<08:00,  2.28s/it, exist=0.2751, loss=0.5287, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 967/1177 [43:57<09:56,  2.84s/it, exist=0.2751, loss=0.5287, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 967/1177 [44:00<09:56,  2.84s/it, exist=0.2750, loss=0.5286, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 968/1177 [44:00<09:50,  2.82s/it, exist=0.2750, loss=0.5286, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 968/1177 [44:03<09:50,  2.82s/it, exist=0.2747, loss=0.5283, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 969/1177 [44:03<09:59,  2.88s/it, exist=0.2747, loss=0.5283, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 969/1177 [44:07<09:59,  2.88s/it, exist=0.2748, loss=0.5284, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 970/1177 [44:07<11:05,  3.21s/it, exist=0.2748, loss=0.5284, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 970/1177 [44:10<11:05,  3.21s/it, exist=0.2746, loss=0.5282, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 971/1177 [44:10<10:34,  3.08s/it, exist=0.2746, loss=0.5282, lr=2.37e-05]
Epoch 3/5:  82%|████████▏ | 971/1177 [44:12<10:34,  3.08s/it, exist=0.2749, loss=0.5284, lr=2.37e-05]
Epoch 3/5:  83%|████████▎ | 972/1177 [44:12<09:20,  2.74s/it, exist=0.2749, loss=0.5284, lr=2.37e-05]
Epoch 3/5:  83%|████████▎ | 972/1177 [44:14<09:20,  2.74s/it, exist=0.2749, loss=0.5284, lr=2.37e-05]
Epoch 3/5:  83%|████████▎ | 973/1177 [44:14<09:28,  2.79s/it, exist=0.2749, loss=0.5284, lr=2.37e-05]
Epoch 3/5:  83%|████████▎ | 973/1177 [44:17<09:28,  2.79s/it, exist=0.2750, loss=0.5286, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 974/1177 [44:17<09:13,  2.73s/it, exist=0.2750, loss=0.5286, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 974/1177 [44:20<09:13,  2.73s/it, exist=0.2753, loss=0.5288, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 975/1177 [44:20<09:01,  2.68s/it, exist=0.2753, loss=0.5288, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 975/1177 [44:22<09:01,  2.68s/it, exist=0.2752, loss=0.5287, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 976/1177 [44:22<08:54,  2.66s/it, exist=0.2752, loss=0.5287, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 976/1177 [44:25<08:54,  2.66s/it, exist=0.2752, loss=0.5288, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 977/1177 [44:25<08:51,  2.66s/it, exist=0.2752, loss=0.5288, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 977/1177 [44:28<08:51,  2.66s/it, exist=0.2756, loss=0.5291, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 978/1177 [44:28<09:23,  2.83s/it, exist=0.2756, loss=0.5291, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 978/1177 [44:30<09:23,  2.83s/it, exist=0.2754, loss=0.5288, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 979/1177 [44:30<08:30,  2.58s/it, exist=0.2754, loss=0.5288, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 979/1177 [44:32<08:30,  2.58s/it, exist=0.2754, loss=0.5289, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 980/1177 [44:32<07:52,  2.40s/it, exist=0.2754, loss=0.5289, lr=2.36e-05]
Epoch 3/5:  83%|████████▎ | 980/1177 [44:35<07:52,  2.40s/it, exist=0.2756, loss=0.5291, lr=2.35e-05]
Epoch 3/5:  83%|████████▎ | 981/1177 [44:35<08:41,  2.66s/it, exist=0.2756, loss=0.5291, lr=2.35e-05]
Epoch 3/5:  83%|████████▎ | 981/1177 [44:37<08:41,  2.66s/it, exist=0.2756, loss=0.5290, lr=2.35e-05]
Epoch 3/5:  83%|████████▎ | 982/1177 [44:37<07:57,  2.45s/it, exist=0.2756, loss=0.5290, lr=2.35e-05]
Epoch 3/5:  83%|████████▎ | 982/1177 [44:40<07:57,  2.45s/it, exist=0.2756, loss=0.5291, lr=2.35e-05]
Epoch 3/5:  84%|████████▎ | 983/1177 [44:40<08:33,  2.64s/it, exist=0.2756, loss=0.5291, lr=2.35e-05]
Epoch 3/5:  84%|████████▎ | 983/1177 [44:42<08:33,  2.64s/it, exist=0.2758, loss=0.5292, lr=2.35e-05]
Epoch 3/5:  84%|████████▎ | 984/1177 [44:42<07:49,  2.43s/it, exist=0.2758, loss=0.5292, lr=2.35e-05]
Epoch 3/5:  84%|████████▎ | 984/1177 [44:46<07:49,  2.43s/it, exist=0.2757, loss=0.5291, lr=2.35e-05]
Epoch 3/5:  84%|████████▎ | 985/1177 [44:46<08:53,  2.78s/it, exist=0.2757, loss=0.5291, lr=2.35e-05]
Epoch 3/5:  84%|████████▎ | 985/1177 [44:49<08:53,  2.78s/it, exist=0.2755, loss=0.5288, lr=2.35e-05]
Epoch 3/5:  84%|████████▍ | 986/1177 [44:49<08:41,  2.73s/it, exist=0.2755, loss=0.5288, lr=2.35e-05]
Epoch 3/5:  84%|████████▍ | 986/1177 [44:52<08:41,  2.73s/it, exist=0.2756, loss=0.5289, lr=2.35e-05]
Epoch 3/5:  84%|████████▍ | 987/1177 [44:52<09:02,  2.86s/it, exist=0.2756, loss=0.5289, lr=2.35e-05]
Epoch 3/5:  84%|████████▍ | 987/1177 [44:54<09:02,  2.86s/it, exist=0.2754, loss=0.5290, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 988/1177 [44:54<08:12,  2.61s/it, exist=0.2754, loss=0.5290, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 988/1177 [44:56<08:12,  2.61s/it, exist=0.2752, loss=0.5289, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 989/1177 [44:56<08:11,  2.62s/it, exist=0.2752, loss=0.5289, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 989/1177 [44:58<08:11,  2.62s/it, exist=0.2750, loss=0.5287, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 990/1177 [44:58<07:34,  2.43s/it, exist=0.2750, loss=0.5287, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 990/1177 [45:01<07:34,  2.43s/it, exist=0.2750, loss=0.5287, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 991/1177 [45:01<08:08,  2.63s/it, exist=0.2750, loss=0.5287, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 991/1177 [45:04<08:08,  2.63s/it, exist=0.2749, loss=0.5287, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 992/1177 [45:04<08:08,  2.64s/it, exist=0.2749, loss=0.5287, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 992/1177 [45:06<08:08,  2.64s/it, exist=0.2750, loss=0.5287, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 993/1177 [45:06<07:28,  2.44s/it, exist=0.2750, loss=0.5287, lr=2.34e-05]
Epoch 3/5:  84%|████████▍ | 993/1177 [45:09<07:28,  2.44s/it, exist=0.2752, loss=0.5289, lr=2.33e-05]
Epoch 3/5:  84%|████████▍ | 994/1177 [45:09<07:33,  2.48s/it, exist=0.2752, loss=0.5289, lr=2.33e-05]
Epoch 3/5:  84%|████████▍ | 994/1177 [45:12<07:33,  2.48s/it, exist=0.2753, loss=0.5290, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 995/1177 [45:12<08:21,  2.75s/it, exist=0.2753, loss=0.5290, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 995/1177 [45:15<08:21,  2.75s/it, exist=0.2754, loss=0.5290, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 996/1177 [45:15<08:06,  2.69s/it, exist=0.2754, loss=0.5290, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 996/1177 [45:17<08:06,  2.69s/it, exist=0.2758, loss=0.5293, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 997/1177 [45:17<07:47,  2.60s/it, exist=0.2758, loss=0.5293, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 997/1177 [45:20<07:47,  2.60s/it, exist=0.2759, loss=0.5294, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 998/1177 [45:20<07:49,  2.62s/it, exist=0.2759, loss=0.5294, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 998/1177 [45:22<07:49,  2.62s/it, exist=0.2759, loss=0.5294, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 999/1177 [45:22<07:55,  2.67s/it, exist=0.2759, loss=0.5294, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 999/1177 [45:25<07:55,  2.67s/it, exist=0.2759, loss=0.5294, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 1000/1177 [45:25<07:50,  2.66s/it, exist=0.2759, loss=0.5294, lr=2.33e-05]
Epoch 3/5:  85%|████████▍ | 1000/1177 [45:27<07:50,  2.66s/it, exist=0.2761, loss=0.5297, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1001/1177 [45:27<07:35,  2.59s/it, exist=0.2761, loss=0.5297, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1001/1177 [45:29<07:35,  2.59s/it, exist=0.2759, loss=0.5295, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1002/1177 [45:29<07:01,  2.41s/it, exist=0.2759, loss=0.5295, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1002/1177 [45:32<07:01,  2.41s/it, exist=0.2760, loss=0.5297, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1003/1177 [45:32<07:01,  2.42s/it, exist=0.2760, loss=0.5297, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1003/1177 [45:36<07:01,  2.42s/it, exist=0.2760, loss=0.5297, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1004/1177 [45:36<08:10,  2.84s/it, exist=0.2760, loss=0.5297, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1004/1177 [45:38<08:10,  2.84s/it, exist=0.2759, loss=0.5297, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1005/1177 [45:38<07:48,  2.72s/it, exist=0.2759, loss=0.5297, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1005/1177 [45:41<07:48,  2.72s/it, exist=0.2757, loss=0.5296, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1006/1177 [45:41<07:30,  2.63s/it, exist=0.2757, loss=0.5296, lr=2.32e-05]
Epoch 3/5:  85%|████████▌ | 1006/1177 [45:43<07:30,  2.63s/it, exist=0.2759, loss=0.5298, lr=2.32e-05]
Epoch 3/5:  86%|████████▌ | 1007/1177 [45:43<07:29,  2.65s/it, exist=0.2759, loss=0.5298, lr=2.32e-05]
Epoch 3/5:  86%|████████▌ | 1007/1177 [45:46<07:29,  2.65s/it, exist=0.2759, loss=0.5298, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1008/1177 [45:46<07:29,  2.66s/it, exist=0.2759, loss=0.5298, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1008/1177 [45:49<07:29,  2.66s/it, exist=0.2758, loss=0.5298, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1009/1177 [45:49<07:26,  2.66s/it, exist=0.2758, loss=0.5298, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1009/1177 [45:51<07:26,  2.66s/it, exist=0.2757, loss=0.5297, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1010/1177 [45:51<06:48,  2.45s/it, exist=0.2757, loss=0.5297, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1010/1177 [45:53<06:48,  2.45s/it, exist=0.2757, loss=0.5297, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1011/1177 [45:53<06:57,  2.52s/it, exist=0.2757, loss=0.5297, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1011/1177 [45:57<06:57,  2.52s/it, exist=0.2756, loss=0.5296, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1012/1177 [45:57<07:52,  2.86s/it, exist=0.2756, loss=0.5296, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1012/1177 [45:59<07:52,  2.86s/it, exist=0.2755, loss=0.5295, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1013/1177 [45:59<07:32,  2.76s/it, exist=0.2755, loss=0.5295, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1013/1177 [46:02<07:32,  2.76s/it, exist=0.2755, loss=0.5294, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1014/1177 [46:02<07:19,  2.70s/it, exist=0.2755, loss=0.5294, lr=2.31e-05]
Epoch 3/5:  86%|████████▌ | 1014/1177 [46:05<07:19,  2.70s/it, exist=0.2754, loss=0.5293, lr=2.30e-05]
Epoch 3/5:  86%|████████▌ | 1015/1177 [46:05<07:52,  2.92s/it, exist=0.2754, loss=0.5293, lr=2.30e-05]
Epoch 3/5:  86%|████████▌ | 1015/1177 [46:07<07:52,  2.92s/it, exist=0.2753, loss=0.5291, lr=2.30e-05]
Epoch 3/5:  86%|████████▋ | 1016/1177 [46:07<07:04,  2.64s/it, exist=0.2753, loss=0.5291, lr=2.30e-05]
Epoch 3/5:  86%|████████▋ | 1016/1177 [46:09<07:04,  2.64s/it, exist=0.2754, loss=0.5292, lr=2.30e-05]
Epoch 3/5:  86%|████████▋ | 1017/1177 [46:09<06:30,  2.44s/it, exist=0.2754, loss=0.5292, lr=2.30e-05]
Epoch 3/5:  86%|████████▋ | 1017/1177 [46:13<06:30,  2.44s/it, exist=0.2753, loss=0.5291, lr=2.30e-05]
Epoch 3/5:  86%|████████▋ | 1018/1177 [46:13<07:08,  2.70s/it, exist=0.2753, loss=0.5291, lr=2.30e-05]
Epoch 3/5:  86%|████████▋ | 1018/1177 [46:15<07:08,  2.70s/it, exist=0.2751, loss=0.5288, lr=2.30e-05]
Epoch 3/5:  87%|████████▋ | 1019/1177 [46:15<07:04,  2.69s/it, exist=0.2751, loss=0.5288, lr=2.30e-05]
Epoch 3/5:  87%|████████▋ | 1019/1177 [46:18<07:04,  2.69s/it, exist=0.2751, loss=0.5289, lr=2.30e-05]
Epoch 3/5:  87%|████████▋ | 1020/1177 [46:18<06:58,  2.67s/it, exist=0.2751, loss=0.5289, lr=2.30e-05]
Epoch 3/5:  87%|████████▋ | 1020/1177 [46:20<06:58,  2.67s/it, exist=0.2751, loss=0.5288, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1021/1177 [46:20<06:21,  2.45s/it, exist=0.2751, loss=0.5288, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1021/1177 [46:23<06:21,  2.45s/it, exist=0.2750, loss=0.5289, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1022/1177 [46:23<07:02,  2.72s/it, exist=0.2750, loss=0.5289, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1022/1177 [46:26<07:02,  2.72s/it, exist=0.2749, loss=0.5289, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1023/1177 [46:26<06:54,  2.69s/it, exist=0.2749, loss=0.5289, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1023/1177 [46:29<06:54,  2.69s/it, exist=0.2748, loss=0.5289, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1024/1177 [46:29<06:52,  2.70s/it, exist=0.2748, loss=0.5289, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1024/1177 [46:32<06:52,  2.70s/it, exist=0.2749, loss=0.5290, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1025/1177 [46:32<07:27,  2.94s/it, exist=0.2749, loss=0.5290, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1025/1177 [46:36<07:27,  2.94s/it, exist=0.2748, loss=0.5289, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1026/1177 [46:36<07:58,  3.17s/it, exist=0.2748, loss=0.5289, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1026/1177 [46:38<07:58,  3.17s/it, exist=0.2747, loss=0.5287, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1027/1177 [46:38<07:22,  2.95s/it, exist=0.2747, loss=0.5287, lr=2.29e-05]
Epoch 3/5:  87%|████████▋ | 1027/1177 [46:40<07:22,  2.95s/it, exist=0.2746, loss=0.5286, lr=2.28e-05]
Epoch 3/5:  87%|████████▋ | 1028/1177 [46:40<06:35,  2.66s/it, exist=0.2746, loss=0.5286, lr=2.28e-05]
Epoch 3/5:  87%|████████▋ | 1028/1177 [46:42<06:35,  2.66s/it, exist=0.2745, loss=0.5285, lr=2.28e-05]
Epoch 3/5:  87%|████████▋ | 1029/1177 [46:42<06:03,  2.46s/it, exist=0.2745, loss=0.5285, lr=2.28e-05]
Epoch 3/5:  87%|████████▋ | 1029/1177 [46:45<06:03,  2.46s/it, exist=0.2744, loss=0.5283, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1030/1177 [46:45<06:34,  2.68s/it, exist=0.2744, loss=0.5283, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1030/1177 [46:49<06:34,  2.68s/it, exist=0.2745, loss=0.5285, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1031/1177 [46:49<07:10,  2.95s/it, exist=0.2745, loss=0.5285, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1031/1177 [46:52<07:10,  2.95s/it, exist=0.2744, loss=0.5284, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1032/1177 [46:52<06:55,  2.87s/it, exist=0.2744, loss=0.5284, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1032/1177 [46:56<06:55,  2.87s/it, exist=0.2744, loss=0.5284, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1033/1177 [46:56<08:10,  3.41s/it, exist=0.2744, loss=0.5284, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1033/1177 [47:00<08:10,  3.41s/it, exist=0.2746, loss=0.5286, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1034/1177 [47:00<08:15,  3.46s/it, exist=0.2746, loss=0.5286, lr=2.28e-05]
Epoch 3/5:  88%|████████▊ | 1034/1177 [47:03<08:15,  3.46s/it, exist=0.2747, loss=0.5287, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1035/1177 [47:03<07:39,  3.23s/it, exist=0.2747, loss=0.5287, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1035/1177 [47:05<07:39,  3.23s/it, exist=0.2746, loss=0.5286, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1036/1177 [47:05<06:42,  2.85s/it, exist=0.2746, loss=0.5286, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1036/1177 [47:08<06:42,  2.85s/it, exist=0.2746, loss=0.5285, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1037/1177 [47:08<06:43,  2.88s/it, exist=0.2746, loss=0.5285, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1037/1177 [47:11<06:43,  2.88s/it, exist=0.2746, loss=0.5286, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1038/1177 [47:11<06:44,  2.91s/it, exist=0.2746, loss=0.5286, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1038/1177 [47:13<06:44,  2.91s/it, exist=0.2747, loss=0.5287, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1039/1177 [47:13<06:25,  2.80s/it, exist=0.2747, loss=0.5287, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1039/1177 [47:15<06:25,  2.80s/it, exist=0.2748, loss=0.5288, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1040/1177 [47:15<05:48,  2.54s/it, exist=0.2748, loss=0.5288, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1040/1177 [47:19<05:48,  2.54s/it, exist=0.2751, loss=0.5290, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1041/1177 [47:19<06:44,  2.98s/it, exist=0.2751, loss=0.5290, lr=2.27e-05]
Epoch 3/5:  88%|████████▊ | 1041/1177 [47:21<06:44,  2.98s/it, exist=0.2754, loss=0.5293, lr=2.26e-05]
Epoch 3/5:  89%|████████▊ | 1042/1177 [47:21<05:59,  2.67s/it, exist=0.2754, loss=0.5293, lr=2.26e-05]
Epoch 3/5:  89%|████████▊ | 1042/1177 [47:24<05:59,  2.67s/it, exist=0.2753, loss=0.5292, lr=2.26e-05]
Epoch 3/5:  89%|████████▊ | 1043/1177 [47:24<06:30,  2.92s/it, exist=0.2753, loss=0.5292, lr=2.26e-05]
Epoch 3/5:  89%|████████▊ | 1043/1177 [47:27<06:30,  2.92s/it, exist=0.2751, loss=0.5290, lr=2.26e-05]
Epoch 3/5:  89%|████████▊ | 1044/1177 [47:27<06:11,  2.80s/it, exist=0.2751, loss=0.5290, lr=2.26e-05]
Epoch 3/5:  89%|████████▊ | 1044/1177 [47:30<06:11,  2.80s/it, exist=0.2749, loss=0.5287, lr=2.26e-05]
Epoch 3/5:  89%|████████▉ | 1045/1177 [47:30<06:10,  2.81s/it, exist=0.2749, loss=0.5287, lr=2.26e-05]
Epoch 3/5:  89%|████████▉ | 1045/1177 [47:33<06:10,  2.81s/it, exist=0.2749, loss=0.5287, lr=2.26e-05]
Epoch 3/5:  89%|████████▉ | 1046/1177 [47:33<06:12,  2.84s/it, exist=0.2749, loss=0.5287, lr=2.26e-05]
Epoch 3/5:  89%|████████▉ | 1046/1177 [47:35<06:12,  2.84s/it, exist=0.2748, loss=0.5286, lr=2.26e-05]
Epoch 3/5:  89%|████████▉ | 1047/1177 [47:35<05:54,  2.73s/it, exist=0.2748, loss=0.5286, lr=2.26e-05]
Epoch 3/5:  89%|████████▉ | 1047/1177 [47:38<05:54,  2.73s/it, exist=0.2750, loss=0.5289, lr=2.26e-05]
Epoch 3/5:  89%|████████▉ | 1048/1177 [47:38<06:10,  2.87s/it, exist=0.2750, loss=0.5289, lr=2.26e-05]
Epoch 3/5:  89%|████████▉ | 1048/1177 [47:41<06:10,  2.87s/it, exist=0.2749, loss=0.5287, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1049/1177 [47:41<05:51,  2.75s/it, exist=0.2749, loss=0.5287, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1049/1177 [47:44<05:51,  2.75s/it, exist=0.2752, loss=0.5291, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1050/1177 [47:44<05:52,  2.77s/it, exist=0.2752, loss=0.5291, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1050/1177 [47:46<05:52,  2.77s/it, exist=0.2752, loss=0.5292, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1051/1177 [47:46<05:44,  2.74s/it, exist=0.2752, loss=0.5292, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1051/1177 [47:48<05:44,  2.74s/it, exist=0.2751, loss=0.5291, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1052/1177 [47:48<05:12,  2.50s/it, exist=0.2751, loss=0.5291, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1052/1177 [47:50<05:12,  2.50s/it, exist=0.2751, loss=0.5290, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1053/1177 [47:50<04:49,  2.33s/it, exist=0.2751, loss=0.5290, lr=2.25e-05]
Epoch 3/5:  89%|████████▉ | 1053/1177 [47:55<04:49,  2.33s/it, exist=0.2752, loss=0.5292, lr=2.25e-05]
Epoch 3/5:  90%|████████▉ | 1054/1177 [47:55<06:09,  3.00s/it, exist=0.2752, loss=0.5292, lr=2.25e-05]
Epoch 3/5:  90%|████████▉ | 1054/1177 [47:58<06:09,  3.00s/it, exist=0.2751, loss=0.5289, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1055/1177 [47:58<05:57,  2.93s/it, exist=0.2751, loss=0.5289, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1055/1177 [48:01<05:57,  2.93s/it, exist=0.2756, loss=0.5295, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1056/1177 [48:01<06:21,  3.16s/it, exist=0.2756, loss=0.5295, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1056/1177 [48:05<06:21,  3.16s/it, exist=0.2757, loss=0.5296, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1057/1177 [48:05<06:32,  3.27s/it, exist=0.2757, loss=0.5296, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1057/1177 [48:09<06:32,  3.27s/it, exist=0.2756, loss=0.5295, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1058/1177 [48:09<06:57,  3.51s/it, exist=0.2756, loss=0.5295, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1058/1177 [48:11<06:57,  3.51s/it, exist=0.2755, loss=0.5294, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1059/1177 [48:11<06:23,  3.25s/it, exist=0.2755, loss=0.5294, lr=2.24e-05]
Epoch 3/5:  90%|████████▉ | 1059/1177 [48:14<06:23,  3.25s/it, exist=0.2755, loss=0.5295, lr=2.24e-05]
Epoch 3/5:  90%|█████████ | 1060/1177 [48:14<05:57,  3.06s/it, exist=0.2755, loss=0.5295, lr=2.24e-05]
Epoch 3/5:  90%|█████████ | 1060/1177 [48:17<05:57,  3.06s/it, exist=0.2753, loss=0.5293, lr=2.24e-05]
Epoch 3/5:  90%|█████████ | 1061/1177 [48:17<05:59,  3.10s/it, exist=0.2753, loss=0.5293, lr=2.24e-05]
Epoch 3/5:  90%|█████████ | 1061/1177 [48:21<05:59,  3.10s/it, exist=0.2753, loss=0.5293, lr=2.23e-05]
Epoch 3/5:  90%|█████████ | 1062/1177 [48:21<06:18,  3.29s/it, exist=0.2753, loss=0.5293, lr=2.23e-05]
Epoch 3/5:  90%|█████████ | 1062/1177 [48:23<06:18,  3.29s/it, exist=0.2755, loss=0.5294, lr=2.23e-05]
Epoch 3/5:  90%|█████████ | 1063/1177 [48:23<05:29,  2.89s/it, exist=0.2755, loss=0.5294, lr=2.23e-05]
Epoch 3/5:  90%|█████████ | 1063/1177 [48:26<05:29,  2.89s/it, exist=0.2755, loss=0.5295, lr=2.23e-05]
Epoch 3/5:  90%|█████████ | 1064/1177 [48:26<05:48,  3.08s/it, exist=0.2755, loss=0.5295, lr=2.23e-05]
Epoch 3/5:  90%|█████████ | 1064/1177 [48:28<05:48,  3.08s/it, exist=0.2755, loss=0.5294, lr=2.23e-05]
Epoch 3/5:  90%|█████████ | 1065/1177 [48:28<05:06,  2.74s/it, exist=0.2755, loss=0.5294, lr=2.23e-05]
Epoch 3/5:  90%|█████████ | 1065/1177 [48:31<05:06,  2.74s/it, exist=0.2753, loss=0.5292, lr=2.23e-05]
Epoch 3/5:  91%|█████████ | 1066/1177 [48:31<05:12,  2.82s/it, exist=0.2753, loss=0.5292, lr=2.23e-05]
Epoch 3/5:  91%|█████████ | 1066/1177 [48:34<05:12,  2.82s/it, exist=0.2754, loss=0.5292, lr=2.23e-05]
Epoch 3/5:  91%|█████████ | 1067/1177 [48:34<05:02,  2.75s/it, exist=0.2754, loss=0.5292, lr=2.23e-05]
Epoch 3/5:  91%|█████████ | 1067/1177 [48:37<05:02,  2.75s/it, exist=0.2754, loss=0.5291, lr=2.23e-05]
Epoch 3/5:  91%|█████████ | 1068/1177 [48:37<05:16,  2.90s/it, exist=0.2754, loss=0.5291, lr=2.23e-05]
Epoch 3/5:  91%|█████████ | 1068/1177 [48:40<05:16,  2.90s/it, exist=0.2754, loss=0.5292, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1069/1177 [48:40<04:57,  2.76s/it, exist=0.2754, loss=0.5292, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1069/1177 [48:42<04:57,  2.76s/it, exist=0.2753, loss=0.5296, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1070/1177 [48:42<04:55,  2.76s/it, exist=0.2753, loss=0.5296, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1070/1177 [48:45<04:55,  2.76s/it, exist=0.2753, loss=0.5295, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1071/1177 [48:45<04:46,  2.70s/it, exist=0.2753, loss=0.5295, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1071/1177 [48:48<04:46,  2.70s/it, exist=0.2753, loss=0.5295, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1072/1177 [48:48<04:42,  2.70s/it, exist=0.2753, loss=0.5295, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1072/1177 [48:50<04:42,  2.70s/it, exist=0.2754, loss=0.5297, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1073/1177 [48:50<04:37,  2.67s/it, exist=0.2754, loss=0.5297, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1073/1177 [48:53<04:37,  2.67s/it, exist=0.2754, loss=0.5297, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1074/1177 [48:53<04:49,  2.81s/it, exist=0.2754, loss=0.5297, lr=2.22e-05]
Epoch 3/5:  91%|█████████ | 1074/1177 [48:57<04:49,  2.81s/it, exist=0.2754, loss=0.5296, lr=2.22e-05]
Epoch 3/5:  91%|█████████▏| 1075/1177 [48:57<05:16,  3.10s/it, exist=0.2754, loss=0.5296, lr=2.22e-05]
Epoch 3/5:  91%|█████████▏| 1075/1177 [49:00<05:16,  3.10s/it, exist=0.2753, loss=0.5297, lr=2.21e-05]
Epoch 3/5:  91%|█████████▏| 1076/1177 [49:00<04:57,  2.94s/it, exist=0.2753, loss=0.5297, lr=2.21e-05]
Epoch 3/5:  91%|█████████▏| 1076/1177 [49:04<04:57,  2.94s/it, exist=0.2753, loss=0.5297, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1077/1177 [49:04<05:20,  3.20s/it, exist=0.2753, loss=0.5297, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1077/1177 [49:08<05:20,  3.20s/it, exist=0.2752, loss=0.5295, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1078/1177 [49:08<05:46,  3.50s/it, exist=0.2752, loss=0.5295, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1078/1177 [49:10<05:46,  3.50s/it, exist=0.2750, loss=0.5294, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1079/1177 [49:10<05:17,  3.24s/it, exist=0.2750, loss=0.5294, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1079/1177 [49:14<05:17,  3.24s/it, exist=0.2749, loss=0.5293, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1080/1177 [49:14<05:11,  3.21s/it, exist=0.2749, loss=0.5293, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1080/1177 [49:16<05:11,  3.21s/it, exist=0.2749, loss=0.5295, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1081/1177 [49:16<04:58,  3.11s/it, exist=0.2749, loss=0.5295, lr=2.21e-05]
Epoch 3/5:  92%|█████████▏| 1081/1177 [49:21<04:58,  3.11s/it, exist=0.2751, loss=0.5298, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1082/1177 [49:21<05:35,  3.53s/it, exist=0.2751, loss=0.5298, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1082/1177 [49:23<05:35,  3.53s/it, exist=0.2750, loss=0.5297, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1083/1177 [49:23<05:01,  3.21s/it, exist=0.2750, loss=0.5297, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1083/1177 [49:25<05:01,  3.21s/it, exist=0.2748, loss=0.5295, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1084/1177 [49:25<04:23,  2.84s/it, exist=0.2748, loss=0.5295, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1084/1177 [49:28<04:23,  2.84s/it, exist=0.2747, loss=0.5294, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1085/1177 [49:28<04:16,  2.79s/it, exist=0.2747, loss=0.5294, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1085/1177 [49:30<04:16,  2.79s/it, exist=0.2749, loss=0.5296, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1086/1177 [49:30<04:00,  2.65s/it, exist=0.2749, loss=0.5296, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1086/1177 [49:34<04:00,  2.65s/it, exist=0.2749, loss=0.5297, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1087/1177 [49:34<04:20,  2.90s/it, exist=0.2749, loss=0.5297, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1087/1177 [49:36<04:20,  2.90s/it, exist=0.2747, loss=0.5295, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1088/1177 [49:36<04:08,  2.79s/it, exist=0.2747, loss=0.5295, lr=2.20e-05]
Epoch 3/5:  92%|█████████▏| 1088/1177 [49:39<04:08,  2.79s/it, exist=0.2746, loss=0.5293, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1089/1177 [49:39<04:12,  2.87s/it, exist=0.2746, loss=0.5293, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1089/1177 [49:41<04:12,  2.87s/it, exist=0.2744, loss=0.5292, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1090/1177 [49:41<03:45,  2.59s/it, exist=0.2744, loss=0.5292, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1090/1177 [49:44<03:45,  2.59s/it, exist=0.2744, loss=0.5291, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1091/1177 [49:44<03:42,  2.59s/it, exist=0.2744, loss=0.5291, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1091/1177 [49:47<03:42,  2.59s/it, exist=0.2742, loss=0.5289, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1092/1177 [49:47<03:39,  2.58s/it, exist=0.2742, loss=0.5289, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1092/1177 [49:49<03:39,  2.58s/it, exist=0.2744, loss=0.5290, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1093/1177 [49:49<03:32,  2.53s/it, exist=0.2744, loss=0.5290, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1093/1177 [49:51<03:32,  2.53s/it, exist=0.2742, loss=0.5288, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1094/1177 [49:51<03:28,  2.51s/it, exist=0.2742, loss=0.5288, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1094/1177 [49:54<03:28,  2.51s/it, exist=0.2740, loss=0.5286, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1095/1177 [49:54<03:25,  2.50s/it, exist=0.2740, loss=0.5286, lr=2.19e-05]
Epoch 3/5:  93%|█████████▎| 1095/1177 [49:57<03:25,  2.50s/it, exist=0.2742, loss=0.5288, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1096/1177 [49:57<03:26,  2.55s/it, exist=0.2742, loss=0.5288, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1096/1177 [50:00<03:26,  2.55s/it, exist=0.2740, loss=0.5287, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1097/1177 [50:00<03:47,  2.84s/it, exist=0.2740, loss=0.5287, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1097/1177 [50:03<03:47,  2.84s/it, exist=0.2739, loss=0.5285, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1098/1177 [50:03<03:42,  2.81s/it, exist=0.2739, loss=0.5285, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1098/1177 [50:06<03:42,  2.81s/it, exist=0.2742, loss=0.5288, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1099/1177 [50:06<03:45,  2.90s/it, exist=0.2742, loss=0.5288, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1099/1177 [50:09<03:45,  2.90s/it, exist=0.2742, loss=0.5287, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1100/1177 [50:09<03:39,  2.85s/it, exist=0.2742, loss=0.5287, lr=2.18e-05]
Epoch 3/5:  93%|█████████▎| 1100/1177 [50:11<03:39,  2.85s/it, exist=0.2742, loss=0.5288, lr=2.18e-05]
Epoch 3/5:  94%|█████████▎| 1101/1177 [50:11<03:32,  2.80s/it, exist=0.2742, loss=0.5288, lr=2.18e-05]
Epoch 3/5:  94%|█████████▎| 1101/1177 [50:13<03:32,  2.80s/it, exist=0.2742, loss=0.5288, lr=2.18e-05]
Epoch 3/5:  94%|█████████▎| 1102/1177 [50:13<03:11,  2.55s/it, exist=0.2742, loss=0.5288, lr=2.18e-05]
Epoch 3/5:  94%|█████████▎| 1102/1177 [50:16<03:11,  2.55s/it, exist=0.2740, loss=0.5287, lr=2.17e-05]
Epoch 3/5:  94%|█████████▎| 1103/1177 [50:16<03:09,  2.56s/it, exist=0.2740, loss=0.5287, lr=2.17e-05]
Epoch 3/5:  94%|█████████▎| 1103/1177 [50:18<03:09,  2.56s/it, exist=0.2739, loss=0.5285, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1104/1177 [50:18<03:06,  2.56s/it, exist=0.2739, loss=0.5285, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1104/1177 [50:21<03:06,  2.56s/it, exist=0.2737, loss=0.5284, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1105/1177 [50:21<03:02,  2.54s/it, exist=0.2737, loss=0.5284, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1105/1177 [50:24<03:02,  2.54s/it, exist=0.2739, loss=0.5287, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1106/1177 [50:24<03:01,  2.55s/it, exist=0.2739, loss=0.5287, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1106/1177 [50:26<03:01,  2.55s/it, exist=0.2741, loss=0.5289, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1107/1177 [50:26<02:46,  2.37s/it, exist=0.2741, loss=0.5289, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1107/1177 [50:28<02:46,  2.37s/it, exist=0.2741, loss=0.5288, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1108/1177 [50:28<02:46,  2.42s/it, exist=0.2741, loss=0.5288, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1108/1177 [50:31<02:46,  2.42s/it, exist=0.2739, loss=0.5286, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1109/1177 [50:31<02:49,  2.49s/it, exist=0.2739, loss=0.5286, lr=2.17e-05]
Epoch 3/5:  94%|█████████▍| 1109/1177 [50:35<02:49,  2.49s/it, exist=0.2738, loss=0.5285, lr=2.16e-05]
Epoch 3/5:  94%|█████████▍| 1110/1177 [50:35<03:13,  2.89s/it, exist=0.2738, loss=0.5285, lr=2.16e-05]
Epoch 3/5:  94%|█████████▍| 1110/1177 [50:37<03:13,  2.89s/it, exist=0.2741, loss=0.5288, lr=2.16e-05]
Epoch 3/5:  94%|█████████▍| 1111/1177 [50:37<03:08,  2.86s/it, exist=0.2741, loss=0.5288, lr=2.16e-05]
Epoch 3/5:  94%|█████████▍| 1111/1177 [50:40<03:08,  2.86s/it, exist=0.2740, loss=0.5286, lr=2.16e-05]
Epoch 3/5:  94%|█████████▍| 1112/1177 [50:40<03:10,  2.93s/it, exist=0.2740, loss=0.5286, lr=2.16e-05]
Epoch 3/5:  94%|█████████▍| 1112/1177 [50:42<03:10,  2.93s/it, exist=0.2740, loss=0.5288, lr=2.16e-05]
Epoch 3/5:  95%|█████████▍| 1113/1177 [50:42<02:48,  2.64s/it, exist=0.2740, loss=0.5288, lr=2.16e-05]
Epoch 3/5:  95%|█████████▍| 1113/1177 [50:46<02:48,  2.64s/it, exist=0.2738, loss=0.5287, lr=2.16e-05]
Epoch 3/5:  95%|█████████▍| 1114/1177 [50:46<03:11,  3.04s/it, exist=0.2738, loss=0.5287, lr=2.16e-05]
Epoch 3/5:  95%|█████████▍| 1114/1177 [50:49<03:11,  3.04s/it, exist=0.2739, loss=0.5289, lr=2.16e-05]
Epoch 3/5:  95%|█████████▍| 1115/1177 [50:49<03:03,  2.97s/it, exist=0.2739, loss=0.5289, lr=2.16e-05]
Epoch 3/5:  95%|█████████▍| 1115/1177 [50:52<03:03,  2.97s/it, exist=0.2738, loss=0.5289, lr=2.15e-05]
Epoch 3/5:  95%|█████████▍| 1116/1177 [50:52<02:55,  2.87s/it, exist=0.2738, loss=0.5289, lr=2.15e-05]
Epoch 3/5:  95%|█████████▍| 1116/1177 [50:55<02:55,  2.87s/it, exist=0.2739, loss=0.5290, lr=2.15e-05]
Epoch 3/5:  95%|█████████▍| 1117/1177 [50:55<02:56,  2.94s/it, exist=0.2739, loss=0.5290, lr=2.15e-05]
Epoch 3/5:  95%|█████████▍| 1117/1177 [50:59<02:56,  2.94s/it, exist=0.2738, loss=0.5289, lr=2.15e-05]
Epoch 3/5:  95%|█████████▍| 1118/1177 [50:59<03:06,  3.16s/it, exist=0.2738, loss=0.5289, lr=2.15e-05]
Epoch 3/5:  95%|█████████▍| 1118/1177 [51:01<03:06,  3.16s/it, exist=0.2737, loss=0.5287, lr=2.15e-05]
Epoch 3/5:  95%|█████████▌| 1119/1177 [51:01<02:49,  2.93s/it, exist=0.2737, loss=0.5287, lr=2.15e-05]
Epoch 3/5:  95%|█████████▌| 1119/1177 [51:03<02:49,  2.93s/it, exist=0.2735, loss=0.5285, lr=2.15e-05]
Epoch 3/5:  95%|█████████▌| 1120/1177 [51:03<02:31,  2.66s/it, exist=0.2735, loss=0.5285, lr=2.15e-05]
Epoch 3/5:  95%|█████████▌| 1120/1177 [51:06<02:31,  2.66s/it, exist=0.2734, loss=0.5285, lr=2.15e-05]
Epoch 3/5:  95%|█████████▌| 1121/1177 [51:06<02:33,  2.74s/it, exist=0.2734, loss=0.5285, lr=2.15e-05]
Epoch 3/5:  95%|█████████▌| 1121/1177 [51:08<02:33,  2.74s/it, exist=0.2733, loss=0.5284, lr=2.15e-05]
Epoch 3/5:  95%|█████████▌| 1122/1177 [51:08<02:27,  2.69s/it, exist=0.2733, loss=0.5284, lr=2.15e-05]
Epoch 3/5:  95%|█████████▌| 1122/1177 [51:11<02:27,  2.69s/it, exist=0.2734, loss=0.5286, lr=2.14e-05]
Epoch 3/5:  95%|█████████▌| 1123/1177 [51:11<02:23,  2.66s/it, exist=0.2734, loss=0.5286, lr=2.14e-05]
Epoch 3/5:  95%|█████████▌| 1123/1177 [51:14<02:23,  2.66s/it, exist=0.2739, loss=0.5291, lr=2.14e-05]
Epoch 3/5:  95%|█████████▌| 1124/1177 [51:14<02:24,  2.72s/it, exist=0.2739, loss=0.5291, lr=2.14e-05]
Epoch 3/5:  95%|█████████▌| 1124/1177 [51:17<02:24,  2.72s/it, exist=0.2739, loss=0.5291, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1125/1177 [51:17<02:29,  2.88s/it, exist=0.2739, loss=0.5291, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1125/1177 [51:20<02:29,  2.88s/it, exist=0.2737, loss=0.5289, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1126/1177 [51:20<02:27,  2.89s/it, exist=0.2737, loss=0.5289, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1126/1177 [51:23<02:27,  2.89s/it, exist=0.2736, loss=0.5287, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1127/1177 [51:23<02:21,  2.83s/it, exist=0.2736, loss=0.5287, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1127/1177 [51:25<02:21,  2.83s/it, exist=0.2736, loss=0.5287, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1128/1177 [51:25<02:13,  2.72s/it, exist=0.2736, loss=0.5287, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1128/1177 [51:28<02:13,  2.72s/it, exist=0.2736, loss=0.5286, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1129/1177 [51:28<02:14,  2.81s/it, exist=0.2736, loss=0.5286, lr=2.14e-05]
Epoch 3/5:  96%|█████████▌| 1129/1177 [51:31<02:14,  2.81s/it, exist=0.2734, loss=0.5285, lr=2.13e-05]
Epoch 3/5:  96%|█████████▌| 1130/1177 [51:31<02:08,  2.74s/it, exist=0.2734, loss=0.5285, lr=2.13e-05]
Epoch 3/5:  96%|█████████▌| 1130/1177 [51:33<02:08,  2.74s/it, exist=0.2734, loss=0.5283, lr=2.13e-05]
Epoch 3/5:  96%|█████████▌| 1131/1177 [51:33<02:02,  2.66s/it, exist=0.2734, loss=0.5283, lr=2.13e-05]
Epoch 3/5:  96%|█████████▌| 1131/1177 [51:36<02:02,  2.66s/it, exist=0.2735, loss=0.5284, lr=2.13e-05]
Epoch 3/5:  96%|█████████▌| 1132/1177 [51:36<01:58,  2.64s/it, exist=0.2735, loss=0.5284, lr=2.13e-05]
Epoch 3/5:  96%|█████████▌| 1132/1177 [51:38<01:58,  2.64s/it, exist=0.2735, loss=0.5284, lr=2.13e-05]
Epoch 3/5:  96%|█████████▋| 1133/1177 [51:38<01:53,  2.58s/it, exist=0.2735, loss=0.5284, lr=2.13e-05]
Epoch 3/5:  96%|█████████▋| 1133/1177 [51:41<01:53,  2.58s/it, exist=0.2738, loss=0.5287, lr=2.13e-05]
Epoch 3/5:  96%|█████████▋| 1134/1177 [51:41<01:50,  2.57s/it, exist=0.2738, loss=0.5287, lr=2.13e-05]
Epoch 3/5:  96%|█████████▋| 1134/1177 [51:44<01:50,  2.57s/it, exist=0.2738, loss=0.5287, lr=2.13e-05]
Epoch 3/5:  96%|█████████▋| 1135/1177 [51:44<01:48,  2.59s/it, exist=0.2738, loss=0.5287, lr=2.13e-05]
Epoch 3/5:  96%|█████████▋| 1135/1177 [51:46<01:48,  2.59s/it, exist=0.2736, loss=0.5285, lr=2.13e-05]
Epoch 3/5:  97%|█████████▋| 1136/1177 [51:46<01:48,  2.65s/it, exist=0.2736, loss=0.5285, lr=2.13e-05]
Epoch 3/5:  97%|█████████▋| 1136/1177 [51:49<01:48,  2.65s/it, exist=0.2736, loss=0.5286, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1137/1177 [51:49<01:47,  2.70s/it, exist=0.2736, loss=0.5286, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1137/1177 [51:52<01:47,  2.70s/it, exist=0.2738, loss=0.5289, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1138/1177 [51:52<01:49,  2.80s/it, exist=0.2738, loss=0.5289, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1138/1177 [51:54<01:49,  2.80s/it, exist=0.2736, loss=0.5287, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1139/1177 [51:54<01:36,  2.54s/it, exist=0.2736, loss=0.5287, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1139/1177 [51:57<01:36,  2.54s/it, exist=0.2737, loss=0.5288, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1140/1177 [51:57<01:35,  2.59s/it, exist=0.2737, loss=0.5288, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1140/1177 [52:00<01:35,  2.59s/it, exist=0.2738, loss=0.5289, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1141/1177 [52:00<01:36,  2.67s/it, exist=0.2738, loss=0.5289, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1141/1177 [52:02<01:36,  2.67s/it, exist=0.2736, loss=0.5288, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1142/1177 [52:02<01:26,  2.46s/it, exist=0.2736, loss=0.5288, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1142/1177 [52:05<01:26,  2.46s/it, exist=0.2736, loss=0.5290, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1143/1177 [52:05<01:34,  2.78s/it, exist=0.2736, loss=0.5290, lr=2.12e-05]
Epoch 3/5:  97%|█████████▋| 1143/1177 [52:07<01:34,  2.78s/it, exist=0.2736, loss=0.5289, lr=2.11e-05]
Epoch 3/5:  97%|█████████▋| 1144/1177 [52:07<01:24,  2.56s/it, exist=0.2736, loss=0.5289, lr=2.11e-05]
Epoch 3/5:  97%|█████████▋| 1144/1177 [52:10<01:24,  2.56s/it, exist=0.2736, loss=0.5288, lr=2.11e-05]
Epoch 3/5:  97%|█████████▋| 1145/1177 [52:10<01:23,  2.61s/it, exist=0.2736, loss=0.5288, lr=2.11e-05]
Epoch 3/5:  97%|█████████▋| 1145/1177 [52:14<01:23,  2.61s/it, exist=0.2735, loss=0.5289, lr=2.11e-05]
Epoch 3/5:  97%|█████████▋| 1146/1177 [52:14<01:33,  3.00s/it, exist=0.2735, loss=0.5289, lr=2.11e-05]
Epoch 3/5:  97%|█████████▋| 1146/1177 [52:17<01:33,  3.00s/it, exist=0.2733, loss=0.5288, lr=2.11e-05]
Epoch 3/5:  97%|█████████▋| 1147/1177 [52:17<01:35,  3.18s/it, exist=0.2733, loss=0.5288, lr=2.11e-05]
Epoch 3/5:  97%|█████████▋| 1147/1177 [52:20<01:35,  3.18s/it, exist=0.2735, loss=0.5291, lr=2.11e-05]
Epoch 3/5:  98%|█████████▊| 1148/1177 [52:20<01:29,  3.09s/it, exist=0.2735, loss=0.5291, lr=2.11e-05]
Epoch 3/5:  98%|█████████▊| 1148/1177 [52:24<01:29,  3.09s/it, exist=0.2735, loss=0.5290, lr=2.11e-05]
Epoch 3/5:  98%|█████████▊| 1149/1177 [52:24<01:28,  3.17s/it, exist=0.2735, loss=0.5290, lr=2.11e-05]
Epoch 3/5:  98%|█████████▊| 1149/1177 [52:27<01:28,  3.17s/it, exist=0.2734, loss=0.5289, lr=2.11e-05]
Epoch 3/5:  98%|█████████▊| 1150/1177 [52:27<01:25,  3.17s/it, exist=0.2734, loss=0.5289, lr=2.11e-05]
Epoch 3/5:  98%|█████████▊| 1150/1177 [52:29<01:25,  3.17s/it, exist=0.2737, loss=0.5292, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1151/1177 [52:29<01:14,  2.86s/it, exist=0.2737, loss=0.5292, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1151/1177 [52:32<01:14,  2.86s/it, exist=0.2736, loss=0.5291, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1152/1177 [52:32<01:09,  2.78s/it, exist=0.2736, loss=0.5291, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1152/1177 [52:35<01:09,  2.78s/it, exist=0.2737, loss=0.5291, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1153/1177 [52:35<01:08,  2.87s/it, exist=0.2737, loss=0.5291, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1153/1177 [52:38<01:08,  2.87s/it, exist=0.2737, loss=0.5293, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1154/1177 [52:38<01:08,  2.99s/it, exist=0.2737, loss=0.5293, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1154/1177 [52:40<01:08,  2.99s/it, exist=0.2738, loss=0.5293, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1155/1177 [52:40<00:59,  2.69s/it, exist=0.2738, loss=0.5293, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1155/1177 [52:43<00:59,  2.69s/it, exist=0.2741, loss=0.5297, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1156/1177 [52:43<00:55,  2.66s/it, exist=0.2741, loss=0.5297, lr=2.10e-05]
Epoch 3/5:  98%|█████████▊| 1156/1177 [52:46<00:55,  2.66s/it, exist=0.2740, loss=0.5295, lr=2.09e-05]
Epoch 3/5:  98%|█████████▊| 1157/1177 [52:46<00:56,  2.83s/it, exist=0.2740, loss=0.5295, lr=2.09e-05]
Epoch 3/5:  98%|█████████▊| 1157/1177 [52:48<00:56,  2.83s/it, exist=0.2738, loss=0.5293, lr=2.09e-05]
Epoch 3/5:  98%|█████████▊| 1158/1177 [52:48<00:51,  2.72s/it, exist=0.2738, loss=0.5293, lr=2.09e-05]
Epoch 3/5:  98%|█████████▊| 1158/1177 [52:51<00:51,  2.72s/it, exist=0.2739, loss=0.5294, lr=2.09e-05]
Epoch 3/5:  98%|█████████▊| 1159/1177 [52:51<00:50,  2.81s/it, exist=0.2739, loss=0.5294, lr=2.09e-05]
Epoch 3/5:  98%|█████████▊| 1159/1177 [52:53<00:50,  2.81s/it, exist=0.2739, loss=0.5294, lr=2.09e-05]
Epoch 3/5:  99%|█████████▊| 1160/1177 [52:53<00:43,  2.57s/it, exist=0.2739, loss=0.5294, lr=2.09e-05]
Epoch 3/5:  99%|█████████▊| 1160/1177 [52:56<00:43,  2.57s/it, exist=0.2737, loss=0.5292, lr=2.09e-05]
Epoch 3/5:  99%|█████████▊| 1161/1177 [52:56<00:40,  2.56s/it, exist=0.2737, loss=0.5292, lr=2.09e-05]
Epoch 3/5:  99%|█████████▊| 1161/1177 [52:58<00:40,  2.56s/it, exist=0.2738, loss=0.5292, lr=2.09e-05]
Epoch 3/5:  99%|█████████▊| 1162/1177 [52:58<00:38,  2.57s/it, exist=0.2738, loss=0.5292, lr=2.09e-05]
Epoch 3/5:  99%|█████████▊| 1162/1177 [53:01<00:38,  2.57s/it, exist=0.2736, loss=0.5291, lr=2.09e-05]
Epoch 3/5:  99%|█████████▉| 1163/1177 [53:01<00:36,  2.59s/it, exist=0.2736, loss=0.5291, lr=2.09e-05]
Epoch 3/5:  99%|█████████▉| 1163/1177 [53:04<00:36,  2.59s/it, exist=0.2735, loss=0.5290, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1164/1177 [53:04<00:33,  2.59s/it, exist=0.2735, loss=0.5290, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1164/1177 [53:06<00:33,  2.59s/it, exist=0.2735, loss=0.5288, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1165/1177 [53:06<00:28,  2.41s/it, exist=0.2735, loss=0.5288, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1165/1177 [53:08<00:28,  2.41s/it, exist=0.2733, loss=0.5287, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1166/1177 [53:08<00:25,  2.28s/it, exist=0.2733, loss=0.5287, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1166/1177 [53:11<00:25,  2.28s/it, exist=0.2732, loss=0.5286, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1167/1177 [53:11<00:26,  2.60s/it, exist=0.2732, loss=0.5286, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1167/1177 [53:14<00:26,  2.60s/it, exist=0.2732, loss=0.5285, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1168/1177 [53:14<00:23,  2.61s/it, exist=0.2732, loss=0.5285, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1168/1177 [53:17<00:23,  2.61s/it, exist=0.2733, loss=0.5286, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1169/1177 [53:17<00:22,  2.80s/it, exist=0.2733, loss=0.5286, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1169/1177 [53:20<00:22,  2.80s/it, exist=0.2733, loss=0.5286, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1170/1177 [53:20<00:19,  2.83s/it, exist=0.2733, loss=0.5286, lr=2.08e-05]
Epoch 3/5:  99%|█████████▉| 1170/1177 [53:23<00:19,  2.83s/it, exist=0.2734, loss=0.5286, lr=2.07e-05]
Epoch 3/5:  99%|█████████▉| 1171/1177 [53:23<00:17,  2.89s/it, exist=0.2734, loss=0.5286, lr=2.07e-05]
Epoch 3/5:  99%|█████████▉| 1171/1177 [53:25<00:17,  2.89s/it, exist=0.2734, loss=0.5287, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1172/1177 [53:25<00:13,  2.61s/it, exist=0.2734, loss=0.5287, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1172/1177 [53:27<00:13,  2.61s/it, exist=0.2734, loss=0.5288, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1173/1177 [53:27<00:09,  2.44s/it, exist=0.2734, loss=0.5288, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1173/1177 [53:29<00:09,  2.44s/it, exist=0.2733, loss=0.5287, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1174/1177 [53:29<00:06,  2.31s/it, exist=0.2733, loss=0.5287, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1174/1177 [53:31<00:06,  2.31s/it, exist=0.2734, loss=0.5289, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1175/1177 [53:31<00:04,  2.21s/it, exist=0.2734, loss=0.5289, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1175/1177 [53:33<00:04,  2.21s/it, exist=0.2733, loss=0.5287, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1176/1177 [53:33<00:02,  2.14s/it, exist=0.2733, loss=0.5287, lr=2.07e-05]
Epoch 3/5: 100%|█████████▉| 1176/1177 [53:33<00:02,  2.14s/it, exist=0.2732, loss=0.5286, lr=2.07e-05]
Epoch 3/5: 100%|██████████| 1177/1177 [53:33<00:00,  1.56s/it, exist=0.2732, loss=0.5286, lr=2.07e-05]
Epoch 3/5: 100%|██████████| 1177/1177 [53:34<00:00,  2.73s/it, exist=0.2732, loss=0.5286, lr=2.07e-05]
Epoch 3  loss=0.5286  ce=0.0000  mask=0.1199  exist=0.2732  lr=2.07e-05
Saved: checkpoints/ec_simtoken/ec_simtoken_v1_ep3.pth
Epoch 3: skipping eval (scheduled at [2, 5, 7, 10])

Epoch 4/5:   0%|          | 0/1177 [00:00<?, ?it/s]
Epoch 4/5:   0%|          | 0/1177 [00:26<?, ?it/s, exist=0.3121, loss=0.5917, lr=2.06e-05]
Epoch 4/5:   0%|          | 1/1177 [00:26<8:48:45, 26.98s/it, exist=0.3121, loss=0.5917, lr=2.06e-05]
Epoch 4/5:   0%|          | 1/1177 [00:29<8:48:45, 26.98s/it, exist=0.3296, loss=0.5772, lr=2.06e-05]
Epoch 4/5:   0%|          | 2/1177 [00:29<4:06:37, 12.59s/it, exist=0.3296, loss=0.5772, lr=2.06e-05]
Epoch 4/5:   0%|          | 2/1177 [00:32<4:06:37, 12.59s/it, exist=0.2507, loss=0.5025, lr=2.06e-05]
Epoch 4/5:   0%|          | 3/1177 [00:32<2:37:40,  8.06s/it, exist=0.2507, loss=0.5025, lr=2.06e-05]
Epoch 4/5:   0%|          | 3/1177 [00:36<2:37:40,  8.06s/it, exist=0.2505, loss=0.5081, lr=2.06e-05]
Epoch 4/5:   0%|          | 4/1177 [00:36<2:05:22,  6.41s/it, exist=0.2505, loss=0.5081, lr=2.06e-05]
Epoch 4/5:   0%|          | 4/1177 [00:38<2:05:22,  6.41s/it, exist=0.2211, loss=0.4765, lr=2.06e-05]
Epoch 4/5:   0%|          | 5/1177 [00:38<1:34:10,  4.82s/it, exist=0.2211, loss=0.4765, lr=2.06e-05]
Epoch 4/5:   0%|          | 5/1177 [00:41<1:34:10,  4.82s/it, exist=0.2541, loss=0.4982, lr=2.06e-05]
Epoch 4/5:   1%|          | 6/1177 [00:41<1:21:40,  4.19s/it, exist=0.2541, loss=0.4982, lr=2.06e-05]
Epoch 4/5:   1%|          | 6/1177 [00:44<1:21:40,  4.19s/it, exist=0.2948, loss=0.5350, lr=2.06e-05]
Epoch 4/5:   1%|          | 7/1177 [00:44<1:14:43,  3.83s/it, exist=0.2948, loss=0.5350, lr=2.06e-05]
Epoch 4/5:   1%|          | 7/1177 [00:46<1:14:43,  3.83s/it, exist=0.2930, loss=0.5280, lr=2.05e-05]
Epoch 4/5:   1%|          | 8/1177 [00:46<1:06:03,  3.39s/it, exist=0.2930, loss=0.5280, lr=2.05e-05]
Epoch 4/5:   1%|          | 8/1177 [00:49<1:06:03,  3.39s/it, exist=0.2703, loss=0.5099, lr=2.05e-05]
Epoch 4/5:   1%|          | 9/1177 [00:49<1:00:52,  3.13s/it, exist=0.2703, loss=0.5099, lr=2.05e-05]
Epoch 4/5:   1%|          | 9/1177 [00:51<1:00:52,  3.13s/it, exist=0.2520, loss=0.4911, lr=2.05e-05]
Epoch 4/5:   1%|          | 10/1177 [00:51<57:27,  2.95s/it, exist=0.2520, loss=0.4911, lr=2.05e-05] 
Epoch 4/5:   1%|          | 10/1177 [00:54<57:27,  2.95s/it, exist=0.2521, loss=0.4931, lr=2.05e-05]
Epoch 4/5:   1%|          | 11/1177 [00:54<58:14,  3.00s/it, exist=0.2521, loss=0.4931, lr=2.05e-05]
Epoch 4/5:   1%|          | 11/1177 [00:58<58:14,  3.00s/it, exist=0.2380, loss=0.4777, lr=2.05e-05]
Epoch 4/5:   1%|          | 12/1177 [00:58<1:00:26,  3.11s/it, exist=0.2380, loss=0.4777, lr=2.05e-05]
Epoch 4/5:   1%|          | 12/1177 [01:00<1:00:26,  3.11s/it, exist=0.2589, loss=0.4982, lr=2.05e-05]
Epoch 4/5:   1%|          | 13/1177 [01:00<54:27,  2.81s/it, exist=0.2589, loss=0.4982, lr=2.05e-05]  
Epoch 4/5:   1%|          | 13/1177 [01:03<54:27,  2.81s/it, exist=0.2562, loss=0.4933, lr=2.05e-05]
Epoch 4/5:   1%|          | 14/1177 [01:03<54:27,  2.81s/it, exist=0.2562, loss=0.4933, lr=2.05e-05]
Epoch 4/5:   1%|          | 14/1177 [01:05<54:27,  2.81s/it, exist=0.2742, loss=0.5104, lr=2.04e-05]
Epoch 4/5:   1%|▏         | 15/1177 [01:05<53:19,  2.75s/it, exist=0.2742, loss=0.5104, lr=2.04e-05]
Epoch 4/5:   1%|▏         | 15/1177 [01:08<53:19,  2.75s/it, exist=0.2743, loss=0.5122, lr=2.04e-05]
Epoch 4/5:   1%|▏         | 16/1177 [01:08<51:05,  2.64s/it, exist=0.2743, loss=0.5122, lr=2.04e-05]
Epoch 4/5:   1%|▏         | 16/1177 [01:10<51:05,  2.64s/it, exist=0.2633, loss=0.5030, lr=2.04e-05]
Epoch 4/5:   1%|▏         | 17/1177 [01:10<47:23,  2.45s/it, exist=0.2633, loss=0.5030, lr=2.04e-05]
Epoch 4/5:   1%|▏         | 17/1177 [01:13<47:23,  2.45s/it, exist=0.2542, loss=0.4945, lr=2.04e-05]
Epoch 4/5:   2%|▏         | 18/1177 [01:13<53:57,  2.79s/it, exist=0.2542, loss=0.4945, lr=2.04e-05]
Epoch 4/5:   2%|▏         | 18/1177 [01:16<53:57,  2.79s/it, exist=0.2525, loss=0.4906, lr=2.04e-05]
Epoch 4/5:   2%|▏         | 19/1177 [01:16<55:40,  2.88s/it, exist=0.2525, loss=0.4906, lr=2.04e-05]
Epoch 4/5:   2%|▏         | 19/1177 [01:18<55:40,  2.88s/it, exist=0.2501, loss=0.4877, lr=2.04e-05]
Epoch 4/5:   2%|▏         | 20/1177 [01:18<50:15,  2.61s/it, exist=0.2501, loss=0.4877, lr=2.04e-05]
Epoch 4/5:   2%|▏         | 20/1177 [01:21<50:15,  2.61s/it, exist=0.2484, loss=0.4859, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 21/1177 [01:21<53:25,  2.77s/it, exist=0.2484, loss=0.4859, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 21/1177 [01:24<53:25,  2.77s/it, exist=0.2502, loss=0.4900, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 22/1177 [01:24<54:22,  2.82s/it, exist=0.2502, loss=0.4900, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 22/1177 [01:27<54:22,  2.82s/it, exist=0.2443, loss=0.4858, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 23/1177 [01:27<55:23,  2.88s/it, exist=0.2443, loss=0.4858, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 23/1177 [01:29<55:23,  2.88s/it, exist=0.2412, loss=0.4828, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 24/1177 [01:29<50:04,  2.61s/it, exist=0.2412, loss=0.4828, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 24/1177 [01:33<50:04,  2.61s/it, exist=0.2337, loss=0.4756, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 25/1177 [01:33<53:40,  2.80s/it, exist=0.2337, loss=0.4756, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 25/1177 [01:35<53:40,  2.80s/it, exist=0.2306, loss=0.4713, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 26/1177 [01:35<48:54,  2.55s/it, exist=0.2306, loss=0.4713, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 26/1177 [01:37<48:54,  2.55s/it, exist=0.2266, loss=0.4706, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 27/1177 [01:37<49:49,  2.60s/it, exist=0.2266, loss=0.4706, lr=2.03e-05]
Epoch 4/5:   2%|▏         | 27/1177 [01:40<49:49,  2.60s/it, exist=0.2245, loss=0.4682, lr=2.02e-05]
Epoch 4/5:   2%|▏         | 28/1177 [01:40<53:32,  2.80s/it, exist=0.2245, loss=0.4682, lr=2.02e-05]
Epoch 4/5:   2%|▏         | 28/1177 [01:43<53:32,  2.80s/it, exist=0.2217, loss=0.4630, lr=2.02e-05]
Epoch 4/5:   2%|▏         | 29/1177 [01:43<52:16,  2.73s/it, exist=0.2217, loss=0.4630, lr=2.02e-05]
Epoch 4/5:   2%|▏         | 29/1177 [01:46<52:16,  2.73s/it, exist=0.2219, loss=0.4662, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 30/1177 [01:46<54:19,  2.84s/it, exist=0.2219, loss=0.4662, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 30/1177 [01:49<54:19,  2.84s/it, exist=0.2238, loss=0.4683, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 31/1177 [01:49<52:22,  2.74s/it, exist=0.2238, loss=0.4683, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 31/1177 [01:51<52:22,  2.74s/it, exist=0.2200, loss=0.4642, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 32/1177 [01:51<47:58,  2.51s/it, exist=0.2200, loss=0.4642, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 32/1177 [01:53<47:58,  2.51s/it, exist=0.2158, loss=0.4597, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 33/1177 [01:53<47:43,  2.50s/it, exist=0.2158, loss=0.4597, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 33/1177 [01:57<47:43,  2.50s/it, exist=0.2119, loss=0.4543, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 34/1177 [01:57<53:37,  2.81s/it, exist=0.2119, loss=0.4543, lr=2.02e-05]
Epoch 4/5:   3%|▎         | 34/1177 [02:00<53:37,  2.81s/it, exist=0.2099, loss=0.4537, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 35/1177 [02:00<53:41,  2.82s/it, exist=0.2099, loss=0.4537, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 35/1177 [02:01<53:41,  2.82s/it, exist=0.2175, loss=0.4610, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 36/1177 [02:01<48:36,  2.56s/it, exist=0.2175, loss=0.4610, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 36/1177 [02:04<48:36,  2.56s/it, exist=0.2222, loss=0.4698, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 37/1177 [02:04<50:48,  2.67s/it, exist=0.2222, loss=0.4698, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 37/1177 [02:07<50:48,  2.67s/it, exist=0.2210, loss=0.4682, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 38/1177 [02:07<48:25,  2.55s/it, exist=0.2210, loss=0.4682, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 38/1177 [02:10<48:25,  2.55s/it, exist=0.2201, loss=0.4664, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 39/1177 [02:10<52:34,  2.77s/it, exist=0.2201, loss=0.4664, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 39/1177 [02:13<52:34,  2.77s/it, exist=0.2431, loss=0.4883, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 40/1177 [02:13<56:54,  3.00s/it, exist=0.2431, loss=0.4883, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 40/1177 [02:17<56:54,  3.00s/it, exist=0.2519, loss=0.4973, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 41/1177 [02:17<58:34,  3.09s/it, exist=0.2519, loss=0.4973, lr=2.01e-05]
Epoch 4/5:   3%|▎         | 41/1177 [02:19<58:34,  3.09s/it, exist=0.2489, loss=0.4952, lr=2.00e-05]
Epoch 4/5:   4%|▎         | 42/1177 [02:19<52:16,  2.76s/it, exist=0.2489, loss=0.4952, lr=2.00e-05]
Epoch 4/5:   4%|▎         | 42/1177 [02:21<52:16,  2.76s/it, exist=0.2449, loss=0.4908, lr=2.00e-05]
Epoch 4/5:   4%|▎         | 43/1177 [02:21<47:40,  2.52s/it, exist=0.2449, loss=0.4908, lr=2.00e-05]
Epoch 4/5:   4%|▎         | 43/1177 [02:24<47:40,  2.52s/it, exist=0.2441, loss=0.4914, lr=2.00e-05]
Epoch 4/5:   4%|▎         | 44/1177 [02:24<52:50,  2.80s/it, exist=0.2441, loss=0.4914, lr=2.00e-05]
Epoch 4/5:   4%|▎         | 44/1177 [02:28<52:50,  2.80s/it, exist=0.2414, loss=0.4881, lr=2.00e-05]
Epoch 4/5:   4%|▍         | 45/1177 [02:28<56:12,  2.98s/it, exist=0.2414, loss=0.4881, lr=2.00e-05]
Epoch 4/5:   4%|▍         | 45/1177 [02:30<56:12,  2.98s/it, exist=0.2381, loss=0.4862, lr=2.00e-05]
Epoch 4/5:   4%|▍         | 46/1177 [02:30<50:32,  2.68s/it, exist=0.2381, loss=0.4862, lr=2.00e-05]
Epoch 4/5:   4%|▍         | 46/1177 [02:32<50:32,  2.68s/it, exist=0.2428, loss=0.4905, lr=2.00e-05]
Epoch 4/5:   4%|▍         | 47/1177 [02:32<49:12,  2.61s/it, exist=0.2428, loss=0.4905, lr=2.00e-05]
Epoch 4/5:   4%|▍         | 47/1177 [02:35<49:12,  2.61s/it, exist=0.2404, loss=0.4898, lr=2.00e-05]
Epoch 4/5:   4%|▍         | 48/1177 [02:35<52:47,  2.81s/it, exist=0.2404, loss=0.4898, lr=2.00e-05]
Epoch 4/5:   4%|▍         | 48/1177 [02:38<52:47,  2.81s/it, exist=0.2417, loss=0.4920, lr=1.99e-05]
Epoch 4/5:   4%|▍         | 49/1177 [02:38<50:04,  2.66s/it, exist=0.2417, loss=0.4920, lr=1.99e-05]
Epoch 4/5:   4%|▍         | 49/1177 [02:40<50:04,  2.66s/it, exist=0.2394, loss=0.4888, lr=1.99e-05]
Epoch 4/5:   4%|▍         | 50/1177 [02:40<49:52,  2.66s/it, exist=0.2394, loss=0.4888, lr=1.99e-05]
Epoch 4/5:   4%|▍         | 50/1177 [02:42<49:52,  2.66s/it, exist=0.2387, loss=0.4889, lr=1.99e-05]
Epoch 4/5:   4%|▍         | 51/1177 [02:42<46:06,  2.46s/it, exist=0.2387, loss=0.4889, lr=1.99e-05]
Epoch 4/5:   4%|▍         | 51/1177 [02:45<46:06,  2.46s/it, exist=0.2410, loss=0.4933, lr=1.99e-05]
Epoch 4/5:   4%|▍         | 52/1177 [02:45<48:44,  2.60s/it, exist=0.2410, loss=0.4933, lr=1.99e-05]
Epoch 4/5:   4%|▍         | 52/1177 [02:49<48:44,  2.60s/it, exist=0.2378, loss=0.4898, lr=1.99e-05]
Epoch 4/5:   5%|▍         | 53/1177 [02:49<52:45,  2.82s/it, exist=0.2378, loss=0.4898, lr=1.99e-05]
Epoch 4/5:   5%|▍         | 53/1177 [02:51<52:45,  2.82s/it, exist=0.2370, loss=0.4889, lr=1.99e-05]
Epoch 4/5:   5%|▍         | 54/1177 [02:51<51:03,  2.73s/it, exist=0.2370, loss=0.4889, lr=1.99e-05]
Epoch 4/5:   5%|▍         | 54/1177 [02:54<51:03,  2.73s/it, exist=0.2413, loss=0.4938, lr=1.99e-05]
Epoch 4/5:   5%|▍         | 55/1177 [02:54<50:07,  2.68s/it, exist=0.2413, loss=0.4938, lr=1.99e-05]
Epoch 4/5:   5%|▍         | 55/1177 [02:57<50:07,  2.68s/it, exist=0.2383, loss=0.4914, lr=1.98e-05]
Epoch 4/5:   5%|▍         | 56/1177 [02:57<54:21,  2.91s/it, exist=0.2383, loss=0.4914, lr=1.98e-05]
Epoch 4/5:   5%|▍         | 56/1177 [03:00<54:21,  2.91s/it, exist=0.2482, loss=0.5002, lr=1.98e-05]
Epoch 4/5:   5%|▍         | 57/1177 [03:00<54:48,  2.94s/it, exist=0.2482, loss=0.5002, lr=1.98e-05]
Epoch 4/5:   5%|▍         | 57/1177 [03:02<54:48,  2.94s/it, exist=0.2460, loss=0.4989, lr=1.98e-05]
Epoch 4/5:   5%|▍         | 58/1177 [03:02<49:23,  2.65s/it, exist=0.2460, loss=0.4989, lr=1.98e-05]
Epoch 4/5:   5%|▍         | 58/1177 [03:05<49:23,  2.65s/it, exist=0.2431, loss=0.4960, lr=1.98e-05]
Epoch 4/5:   5%|▌         | 59/1177 [03:05<48:52,  2.62s/it, exist=0.2431, loss=0.4960, lr=1.98e-05]
Epoch 4/5:   5%|▌         | 59/1177 [03:07<48:52,  2.62s/it, exist=0.2443, loss=0.4965, lr=1.98e-05]
Epoch 4/5:   5%|▌         | 60/1177 [03:07<45:01,  2.42s/it, exist=0.2443, loss=0.4965, lr=1.98e-05]
Epoch 4/5:   5%|▌         | 60/1177 [03:09<45:01,  2.42s/it, exist=0.2417, loss=0.4933, lr=1.98e-05]
Epoch 4/5:   5%|▌         | 61/1177 [03:09<46:05,  2.48s/it, exist=0.2417, loss=0.4933, lr=1.98e-05]
Epoch 4/5:   5%|▌         | 61/1177 [03:12<46:05,  2.48s/it, exist=0.2391, loss=0.4901, lr=1.98e-05]
Epoch 4/5:   5%|▌         | 62/1177 [03:12<50:08,  2.70s/it, exist=0.2391, loss=0.4901, lr=1.98e-05]
Epoch 4/5:   5%|▌         | 62/1177 [03:14<50:08,  2.70s/it, exist=0.2365, loss=0.4876, lr=1.97e-05]
Epoch 4/5:   5%|▌         | 63/1177 [03:14<46:05,  2.48s/it, exist=0.2365, loss=0.4876, lr=1.97e-05]
Epoch 4/5:   5%|▌         | 63/1177 [03:18<46:05,  2.48s/it, exist=0.2352, loss=0.4855, lr=1.97e-05]
Epoch 4/5:   5%|▌         | 64/1177 [03:18<50:08,  2.70s/it, exist=0.2352, loss=0.4855, lr=1.97e-05]
Epoch 4/5:   5%|▌         | 64/1177 [03:19<50:08,  2.70s/it, exist=0.2354, loss=0.4884, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 65/1177 [03:19<45:51,  2.47s/it, exist=0.2354, loss=0.4884, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 65/1177 [03:22<45:51,  2.47s/it, exist=0.2332, loss=0.4872, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 66/1177 [03:22<47:11,  2.55s/it, exist=0.2332, loss=0.4872, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 66/1177 [03:25<47:11,  2.55s/it, exist=0.2320, loss=0.4859, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 67/1177 [03:25<50:28,  2.73s/it, exist=0.2320, loss=0.4859, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 67/1177 [03:27<50:28,  2.73s/it, exist=0.2304, loss=0.4845, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 68/1177 [03:27<46:08,  2.50s/it, exist=0.2304, loss=0.4845, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 68/1177 [03:30<46:08,  2.50s/it, exist=0.2283, loss=0.4818, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 69/1177 [03:30<46:28,  2.52s/it, exist=0.2283, loss=0.4818, lr=1.97e-05]
Epoch 4/5:   6%|▌         | 69/1177 [03:33<46:28,  2.52s/it, exist=0.2263, loss=0.4792, lr=1.96e-05]
Epoch 4/5:   6%|▌         | 70/1177 [03:33<51:57,  2.82s/it, exist=0.2263, loss=0.4792, lr=1.96e-05]
Epoch 4/5:   6%|▌         | 70/1177 [03:36<51:57,  2.82s/it, exist=0.2265, loss=0.4787, lr=1.96e-05]
Epoch 4/5:   6%|▌         | 71/1177 [03:36<51:46,  2.81s/it, exist=0.2265, loss=0.4787, lr=1.96e-05]
Epoch 4/5:   6%|▌         | 71/1177 [03:39<51:46,  2.81s/it, exist=0.2261, loss=0.4779, lr=1.96e-05]
Epoch 4/5:   6%|▌         | 72/1177 [03:39<50:09,  2.72s/it, exist=0.2261, loss=0.4779, lr=1.96e-05]
Epoch 4/5:   6%|▌         | 72/1177 [03:42<50:09,  2.72s/it, exist=0.2355, loss=0.4868, lr=1.96e-05]
Epoch 4/5:   6%|▌         | 73/1177 [03:42<54:52,  2.98s/it, exist=0.2355, loss=0.4868, lr=1.96e-05]
Epoch 4/5:   6%|▌         | 73/1177 [03:44<54:52,  2.98s/it, exist=0.2378, loss=0.4883, lr=1.96e-05]
Epoch 4/5:   6%|▋         | 74/1177 [03:44<49:23,  2.69s/it, exist=0.2378, loss=0.4883, lr=1.96e-05]
Epoch 4/5:   6%|▋         | 74/1177 [03:46<49:23,  2.69s/it, exist=0.2362, loss=0.4857, lr=1.96e-05]
Epoch 4/5:   6%|▋         | 75/1177 [03:46<45:33,  2.48s/it, exist=0.2362, loss=0.4857, lr=1.96e-05]
Epoch 4/5:   6%|▋         | 75/1177 [03:50<45:33,  2.48s/it, exist=0.2347, loss=0.4836, lr=1.96e-05]
Epoch 4/5:   6%|▋         | 76/1177 [03:50<52:16,  2.85s/it, exist=0.2347, loss=0.4836, lr=1.96e-05]
Epoch 4/5:   6%|▋         | 76/1177 [03:53<52:16,  2.85s/it, exist=0.2375, loss=0.4865, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 77/1177 [03:53<51:09,  2.79s/it, exist=0.2375, loss=0.4865, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 77/1177 [03:55<51:09,  2.79s/it, exist=0.2353, loss=0.4850, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 78/1177 [03:55<49:49,  2.72s/it, exist=0.2353, loss=0.4850, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 78/1177 [03:58<49:49,  2.72s/it, exist=0.2363, loss=0.4872, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 79/1177 [03:58<48:04,  2.63s/it, exist=0.2363, loss=0.4872, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 79/1177 [04:00<48:04,  2.63s/it, exist=0.2355, loss=0.4860, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 80/1177 [04:00<44:27,  2.43s/it, exist=0.2355, loss=0.4860, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 80/1177 [04:02<44:27,  2.43s/it, exist=0.2359, loss=0.4860, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 81/1177 [04:02<42:09,  2.31s/it, exist=0.2359, loss=0.4860, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 81/1177 [04:05<42:09,  2.31s/it, exist=0.2368, loss=0.4866, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 82/1177 [04:05<47:40,  2.61s/it, exist=0.2368, loss=0.4866, lr=1.95e-05]
Epoch 4/5:   7%|▋         | 82/1177 [04:07<47:40,  2.61s/it, exist=0.2382, loss=0.4875, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 83/1177 [04:07<47:09,  2.59s/it, exist=0.2382, loss=0.4875, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 83/1177 [04:10<47:09,  2.59s/it, exist=0.2380, loss=0.4876, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 84/1177 [04:10<47:03,  2.58s/it, exist=0.2380, loss=0.4876, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 84/1177 [04:14<47:03,  2.58s/it, exist=0.2387, loss=0.4878, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 85/1177 [04:14<52:22,  2.88s/it, exist=0.2387, loss=0.4878, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 85/1177 [04:16<52:22,  2.88s/it, exist=0.2370, loss=0.4858, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 86/1177 [04:16<47:24,  2.61s/it, exist=0.2370, loss=0.4858, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 86/1177 [04:18<47:24,  2.61s/it, exist=0.2357, loss=0.4841, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 87/1177 [04:18<43:47,  2.41s/it, exist=0.2357, loss=0.4841, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 87/1177 [04:20<43:47,  2.41s/it, exist=0.2341, loss=0.4821, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 88/1177 [04:20<44:52,  2.47s/it, exist=0.2341, loss=0.4821, lr=1.94e-05]
Epoch 4/5:   7%|▋         | 88/1177 [04:23<44:52,  2.47s/it, exist=0.2338, loss=0.4826, lr=1.94e-05]
Epoch 4/5:   8%|▊         | 89/1177 [04:23<48:00,  2.65s/it, exist=0.2338, loss=0.4826, lr=1.94e-05]
Epoch 4/5:   8%|▊         | 89/1177 [04:26<48:00,  2.65s/it, exist=0.2325, loss=0.4807, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 90/1177 [04:26<47:38,  2.63s/it, exist=0.2325, loss=0.4807, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 90/1177 [04:28<47:38,  2.63s/it, exist=0.2312, loss=0.4797, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 91/1177 [04:28<44:02,  2.43s/it, exist=0.2312, loss=0.4797, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 91/1177 [04:30<44:02,  2.43s/it, exist=0.2320, loss=0.4807, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 92/1177 [04:30<41:50,  2.31s/it, exist=0.2320, loss=0.4807, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 92/1177 [04:33<41:50,  2.31s/it, exist=0.2318, loss=0.4801, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 93/1177 [04:33<48:21,  2.68s/it, exist=0.2318, loss=0.4801, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 93/1177 [04:37<48:21,  2.68s/it, exist=0.2301, loss=0.4783, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 94/1177 [04:37<51:30,  2.85s/it, exist=0.2301, loss=0.4783, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 94/1177 [04:39<51:30,  2.85s/it, exist=0.2317, loss=0.4794, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 95/1177 [04:39<50:42,  2.81s/it, exist=0.2317, loss=0.4794, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 95/1177 [04:41<50:42,  2.81s/it, exist=0.2325, loss=0.4807, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 96/1177 [04:41<46:06,  2.56s/it, exist=0.2325, loss=0.4807, lr=1.93e-05]
Epoch 4/5:   8%|▊         | 96/1177 [04:46<46:06,  2.56s/it, exist=0.2327, loss=0.4803, lr=1.92e-05]
Epoch 4/5:   8%|▊         | 97/1177 [04:46<55:16,  3.07s/it, exist=0.2327, loss=0.4803, lr=1.92e-05]
Epoch 4/5:   8%|▊         | 97/1177 [04:48<55:16,  3.07s/it, exist=0.2344, loss=0.4816, lr=1.92e-05]
Epoch 4/5:   8%|▊         | 98/1177 [04:48<49:19,  2.74s/it, exist=0.2344, loss=0.4816, lr=1.92e-05]
Epoch 4/5:   8%|▊         | 98/1177 [04:50<49:19,  2.74s/it, exist=0.2343, loss=0.4828, lr=1.92e-05]
Epoch 4/5:   8%|▊         | 99/1177 [04:50<48:24,  2.69s/it, exist=0.2343, loss=0.4828, lr=1.92e-05]
Epoch 4/5:   8%|▊         | 99/1177 [04:53<48:24,  2.69s/it, exist=0.2341, loss=0.4826, lr=1.92e-05]
Epoch 4/5:   8%|▊         | 100/1177 [04:53<51:30,  2.87s/it, exist=0.2341, loss=0.4826, lr=1.92e-05]
Epoch 4/5:   8%|▊         | 100/1177 [04:57<51:30,  2.87s/it, exist=0.2347, loss=0.4831, lr=1.92e-05]
Epoch 4/5:   9%|▊         | 101/1177 [04:57<54:04,  3.02s/it, exist=0.2347, loss=0.4831, lr=1.92e-05]
Epoch 4/5:   9%|▊         | 101/1177 [04:59<54:04,  3.02s/it, exist=0.2351, loss=0.4833, lr=1.92e-05]
Epoch 4/5:   9%|▊         | 102/1177 [04:59<48:19,  2.70s/it, exist=0.2351, loss=0.4833, lr=1.92e-05]
Epoch 4/5:   9%|▊         | 102/1177 [05:02<48:19,  2.70s/it, exist=0.2337, loss=0.4822, lr=1.92e-05]
Epoch 4/5:   9%|▉         | 103/1177 [05:02<49:21,  2.76s/it, exist=0.2337, loss=0.4822, lr=1.92e-05]
Epoch 4/5:   9%|▉         | 103/1177 [05:04<49:21,  2.76s/it, exist=0.2330, loss=0.4823, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 104/1177 [05:04<47:58,  2.68s/it, exist=0.2330, loss=0.4823, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 104/1177 [05:07<47:58,  2.68s/it, exist=0.2350, loss=0.4840, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 105/1177 [05:07<47:08,  2.64s/it, exist=0.2350, loss=0.4840, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 105/1177 [05:10<47:08,  2.64s/it, exist=0.2368, loss=0.4853, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 106/1177 [05:10<50:39,  2.84s/it, exist=0.2368, loss=0.4853, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 106/1177 [05:12<50:39,  2.84s/it, exist=0.2387, loss=0.4877, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 107/1177 [05:12<45:45,  2.57s/it, exist=0.2387, loss=0.4877, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 107/1177 [05:16<45:45,  2.57s/it, exist=0.2377, loss=0.4864, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 108/1177 [05:16<52:07,  2.93s/it, exist=0.2377, loss=0.4864, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 108/1177 [05:19<52:07,  2.93s/it, exist=0.2398, loss=0.4888, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 109/1177 [05:19<52:34,  2.95s/it, exist=0.2398, loss=0.4888, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 109/1177 [05:21<52:34,  2.95s/it, exist=0.2383, loss=0.4874, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 110/1177 [05:21<47:33,  2.67s/it, exist=0.2383, loss=0.4874, lr=1.91e-05]
Epoch 4/5:   9%|▉         | 110/1177 [05:23<47:33,  2.67s/it, exist=0.2378, loss=0.4867, lr=1.90e-05]
Epoch 4/5:   9%|▉         | 111/1177 [05:23<43:47,  2.47s/it, exist=0.2378, loss=0.4867, lr=1.90e-05]
Epoch 4/5:   9%|▉         | 111/1177 [05:25<43:47,  2.47s/it, exist=0.2392, loss=0.4880, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 112/1177 [05:25<44:55,  2.53s/it, exist=0.2392, loss=0.4880, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 112/1177 [05:29<44:55,  2.53s/it, exist=0.2397, loss=0.4879, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 113/1177 [05:29<50:33,  2.85s/it, exist=0.2397, loss=0.4879, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 113/1177 [05:31<50:33,  2.85s/it, exist=0.2384, loss=0.4862, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 114/1177 [05:31<45:43,  2.58s/it, exist=0.2384, loss=0.4862, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 114/1177 [05:33<45:43,  2.58s/it, exist=0.2380, loss=0.4862, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 115/1177 [05:33<42:14,  2.39s/it, exist=0.2380, loss=0.4862, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 115/1177 [05:36<42:14,  2.39s/it, exist=0.2369, loss=0.4848, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 116/1177 [05:36<46:31,  2.63s/it, exist=0.2369, loss=0.4848, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 116/1177 [05:38<46:31,  2.63s/it, exist=0.2370, loss=0.4852, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 117/1177 [05:38<45:25,  2.57s/it, exist=0.2370, loss=0.4852, lr=1.90e-05]
Epoch 4/5:  10%|▉         | 117/1177 [05:40<45:25,  2.57s/it, exist=0.2363, loss=0.4843, lr=1.89e-05]
Epoch 4/5:  10%|█         | 118/1177 [05:40<42:05,  2.38s/it, exist=0.2363, loss=0.4843, lr=1.89e-05]
Epoch 4/5:  10%|█         | 118/1177 [05:43<42:05,  2.38s/it, exist=0.2348, loss=0.4825, lr=1.89e-05]
Epoch 4/5:  10%|█         | 119/1177 [05:43<43:02,  2.44s/it, exist=0.2348, loss=0.4825, lr=1.89e-05]
Epoch 4/5:  10%|█         | 119/1177 [05:46<43:02,  2.44s/it, exist=0.2365, loss=0.4841, lr=1.89e-05]
Epoch 4/5:  10%|█         | 120/1177 [05:46<46:41,  2.65s/it, exist=0.2365, loss=0.4841, lr=1.89e-05]
Epoch 4/5:  10%|█         | 120/1177 [05:49<46:41,  2.65s/it, exist=0.2350, loss=0.4829, lr=1.89e-05]
Epoch 4/5:  10%|█         | 121/1177 [05:49<45:18,  2.57s/it, exist=0.2350, loss=0.4829, lr=1.89e-05]
Epoch 4/5:  10%|█         | 121/1177 [05:51<45:18,  2.57s/it, exist=0.2353, loss=0.4835, lr=1.89e-05]
Epoch 4/5:  10%|█         | 122/1177 [05:51<45:58,  2.61s/it, exist=0.2353, loss=0.4835, lr=1.89e-05]
Epoch 4/5:  10%|█         | 122/1177 [05:54<45:58,  2.61s/it, exist=0.2357, loss=0.4839, lr=1.89e-05]
Epoch 4/5:  10%|█         | 123/1177 [05:54<45:36,  2.60s/it, exist=0.2357, loss=0.4839, lr=1.89e-05]
Epoch 4/5:  10%|█         | 123/1177 [05:57<45:36,  2.60s/it, exist=0.2362, loss=0.4841, lr=1.89e-05]
Epoch 4/5:  11%|█         | 124/1177 [05:57<49:05,  2.80s/it, exist=0.2362, loss=0.4841, lr=1.89e-05]
Epoch 4/5:  11%|█         | 124/1177 [06:00<49:05,  2.80s/it, exist=0.2375, loss=0.4857, lr=1.88e-05]
Epoch 4/5:  11%|█         | 125/1177 [06:00<50:03,  2.86s/it, exist=0.2375, loss=0.4857, lr=1.88e-05]
Epoch 4/5:  11%|█         | 125/1177 [06:02<50:03,  2.86s/it, exist=0.2408, loss=0.4889, lr=1.88e-05]
Epoch 4/5:  11%|█         | 126/1177 [06:02<45:16,  2.59s/it, exist=0.2408, loss=0.4889, lr=1.88e-05]
Epoch 4/5:  11%|█         | 126/1177 [06:05<45:16,  2.59s/it, exist=0.2398, loss=0.4885, lr=1.88e-05]
Epoch 4/5:  11%|█         | 127/1177 [06:05<45:20,  2.59s/it, exist=0.2398, loss=0.4885, lr=1.88e-05]
Epoch 4/5:  11%|█         | 127/1177 [06:07<45:20,  2.59s/it, exist=0.2391, loss=0.4873, lr=1.88e-05]
Epoch 4/5:  11%|█         | 128/1177 [06:07<42:41,  2.44s/it, exist=0.2391, loss=0.4873, lr=1.88e-05]
Epoch 4/5:  11%|█         | 128/1177 [06:10<42:41,  2.44s/it, exist=0.2392, loss=0.4885, lr=1.88e-05]
Epoch 4/5:  11%|█         | 129/1177 [06:10<46:11,  2.64s/it, exist=0.2392, loss=0.4885, lr=1.88e-05]
Epoch 4/5:  11%|█         | 129/1177 [06:12<46:11,  2.64s/it, exist=0.2384, loss=0.4880, lr=1.88e-05]
Epoch 4/5:  11%|█         | 130/1177 [06:12<46:09,  2.65s/it, exist=0.2384, loss=0.4880, lr=1.88e-05]
Epoch 4/5:  11%|█         | 130/1177 [06:14<46:09,  2.65s/it, exist=0.2387, loss=0.4878, lr=1.88e-05]
Epoch 4/5:  11%|█         | 131/1177 [06:14<42:33,  2.44s/it, exist=0.2387, loss=0.4878, lr=1.88e-05]
Epoch 4/5:  11%|█         | 131/1177 [06:17<42:33,  2.44s/it, exist=0.2383, loss=0.4870, lr=1.87e-05]
Epoch 4/5:  11%|█         | 132/1177 [06:17<43:36,  2.50s/it, exist=0.2383, loss=0.4870, lr=1.87e-05]
Epoch 4/5:  11%|█         | 132/1177 [06:20<43:36,  2.50s/it, exist=0.2388, loss=0.4871, lr=1.87e-05]
Epoch 4/5:  11%|█▏        | 133/1177 [06:20<44:41,  2.57s/it, exist=0.2388, loss=0.4871, lr=1.87e-05]
Epoch 4/5:  11%|█▏        | 133/1177 [06:22<44:41,  2.57s/it, exist=0.2381, loss=0.4863, lr=1.87e-05]
Epoch 4/5:  11%|█▏        | 134/1177 [06:22<44:46,  2.58s/it, exist=0.2381, loss=0.4863, lr=1.87e-05]
Epoch 4/5:  11%|█▏        | 134/1177 [06:26<44:46,  2.58s/it, exist=0.2387, loss=0.4865, lr=1.87e-05]
Epoch 4/5:  11%|█▏        | 135/1177 [06:26<48:22,  2.79s/it, exist=0.2387, loss=0.4865, lr=1.87e-05]
Epoch 4/5:  11%|█▏        | 135/1177 [06:30<48:22,  2.79s/it, exist=0.2402, loss=0.4875, lr=1.87e-05]
Epoch 4/5:  12%|█▏        | 136/1177 [06:30<56:44,  3.27s/it, exist=0.2402, loss=0.4875, lr=1.87e-05]
Epoch 4/5:  12%|█▏        | 136/1177 [06:33<56:44,  3.27s/it, exist=0.2411, loss=0.4882, lr=1.87e-05]
Epoch 4/5:  12%|█▏        | 137/1177 [06:33<54:02,  3.12s/it, exist=0.2411, loss=0.4882, lr=1.87e-05]
Epoch 4/5:  12%|█▏        | 137/1177 [06:37<54:02,  3.12s/it, exist=0.2407, loss=0.4878, lr=1.87e-05]
Epoch 4/5:  12%|█▏        | 138/1177 [06:37<57:27,  3.32s/it, exist=0.2407, loss=0.4878, lr=1.87e-05]
Epoch 4/5:  12%|█▏        | 138/1177 [06:39<57:27,  3.32s/it, exist=0.2396, loss=0.4867, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 139/1177 [06:39<50:32,  2.92s/it, exist=0.2396, loss=0.4867, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 139/1177 [06:41<50:32,  2.92s/it, exist=0.2392, loss=0.4869, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 140/1177 [06:41<49:04,  2.84s/it, exist=0.2392, loss=0.4869, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 140/1177 [06:44<49:04,  2.84s/it, exist=0.2395, loss=0.4871, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 141/1177 [06:44<47:57,  2.78s/it, exist=0.2395, loss=0.4871, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 141/1177 [06:46<47:57,  2.78s/it, exist=0.2384, loss=0.4859, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 142/1177 [06:46<43:59,  2.55s/it, exist=0.2384, loss=0.4859, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 142/1177 [06:49<43:59,  2.55s/it, exist=0.2396, loss=0.4870, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 143/1177 [06:49<45:58,  2.67s/it, exist=0.2396, loss=0.4870, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 143/1177 [06:52<45:58,  2.67s/it, exist=0.2420, loss=0.4904, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 144/1177 [06:52<46:03,  2.68s/it, exist=0.2420, loss=0.4904, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 144/1177 [06:54<46:03,  2.68s/it, exist=0.2428, loss=0.4912, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 145/1177 [06:54<42:25,  2.47s/it, exist=0.2428, loss=0.4912, lr=1.86e-05]
Epoch 4/5:  12%|█▏        | 145/1177 [06:57<42:25,  2.47s/it, exist=0.2437, loss=0.4925, lr=1.85e-05]
Epoch 4/5:  12%|█▏        | 146/1177 [06:57<45:39,  2.66s/it, exist=0.2437, loss=0.4925, lr=1.85e-05]
Epoch 4/5:  12%|█▏        | 146/1177 [06:59<45:39,  2.66s/it, exist=0.2426, loss=0.4911, lr=1.85e-05]
Epoch 4/5:  12%|█▏        | 147/1177 [06:59<44:26,  2.59s/it, exist=0.2426, loss=0.4911, lr=1.85e-05]
Epoch 4/5:  12%|█▏        | 147/1177 [07:02<44:26,  2.59s/it, exist=0.2428, loss=0.4910, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 148/1177 [07:02<44:06,  2.57s/it, exist=0.2428, loss=0.4910, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 148/1177 [07:04<44:06,  2.57s/it, exist=0.2425, loss=0.4912, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 149/1177 [07:04<40:56,  2.39s/it, exist=0.2425, loss=0.4912, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 149/1177 [07:07<40:56,  2.39s/it, exist=0.2424, loss=0.4908, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 150/1177 [07:07<44:40,  2.61s/it, exist=0.2424, loss=0.4908, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 150/1177 [07:09<44:40,  2.61s/it, exist=0.2425, loss=0.4913, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 151/1177 [07:09<41:22,  2.42s/it, exist=0.2425, loss=0.4913, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 151/1177 [07:11<41:22,  2.42s/it, exist=0.2427, loss=0.4923, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 152/1177 [07:11<41:49,  2.45s/it, exist=0.2427, loss=0.4923, lr=1.85e-05]
Epoch 4/5:  13%|█▎        | 152/1177 [07:14<41:49,  2.45s/it, exist=0.2427, loss=0.4919, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 153/1177 [07:14<45:40,  2.68s/it, exist=0.2427, loss=0.4919, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 153/1177 [07:17<45:40,  2.68s/it, exist=0.2442, loss=0.4935, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 154/1177 [07:17<44:55,  2.63s/it, exist=0.2442, loss=0.4935, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 154/1177 [07:19<44:55,  2.63s/it, exist=0.2433, loss=0.4922, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 155/1177 [07:19<44:25,  2.61s/it, exist=0.2433, loss=0.4922, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 155/1177 [07:21<44:25,  2.61s/it, exist=0.2428, loss=0.4913, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 156/1177 [07:21<41:01,  2.41s/it, exist=0.2428, loss=0.4913, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 156/1177 [07:25<41:01,  2.41s/it, exist=0.2422, loss=0.4907, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 157/1177 [07:25<45:57,  2.70s/it, exist=0.2422, loss=0.4907, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 157/1177 [07:27<45:57,  2.70s/it, exist=0.2420, loss=0.4906, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 158/1177 [07:27<45:54,  2.70s/it, exist=0.2420, loss=0.4906, lr=1.84e-05]
Epoch 4/5:  13%|█▎        | 158/1177 [07:30<45:54,  2.70s/it, exist=0.2409, loss=0.4898, lr=1.84e-05]
Epoch 4/5:  14%|█▎        | 159/1177 [07:30<45:34,  2.69s/it, exist=0.2409, loss=0.4898, lr=1.84e-05]
Epoch 4/5:  14%|█▎        | 159/1177 [07:32<45:34,  2.69s/it, exist=0.2401, loss=0.4891, lr=1.83e-05]
Epoch 4/5:  14%|█▎        | 160/1177 [07:32<41:55,  2.47s/it, exist=0.2401, loss=0.4891, lr=1.83e-05]
Epoch 4/5:  14%|█▎        | 160/1177 [07:35<41:55,  2.47s/it, exist=0.2402, loss=0.4889, lr=1.83e-05]
Epoch 4/5:  14%|█▎        | 161/1177 [07:35<46:05,  2.72s/it, exist=0.2402, loss=0.4889, lr=1.83e-05]
Epoch 4/5:  14%|█▎        | 161/1177 [07:38<46:05,  2.72s/it, exist=0.2391, loss=0.4875, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 162/1177 [07:38<47:43,  2.82s/it, exist=0.2391, loss=0.4875, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 162/1177 [07:41<47:43,  2.82s/it, exist=0.2399, loss=0.4889, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 163/1177 [07:41<46:15,  2.74s/it, exist=0.2399, loss=0.4889, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 163/1177 [07:44<46:15,  2.74s/it, exist=0.2395, loss=0.4884, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 164/1177 [07:44<45:27,  2.69s/it, exist=0.2395, loss=0.4884, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 164/1177 [07:46<45:27,  2.69s/it, exist=0.2391, loss=0.4881, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 165/1177 [07:46<44:47,  2.66s/it, exist=0.2391, loss=0.4881, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 165/1177 [07:49<44:47,  2.66s/it, exist=0.2386, loss=0.4873, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 166/1177 [07:49<44:23,  2.63s/it, exist=0.2386, loss=0.4873, lr=1.83e-05]
Epoch 4/5:  14%|█▍        | 166/1177 [07:51<44:23,  2.63s/it, exist=0.2418, loss=0.4903, lr=1.82e-05]
Epoch 4/5:  14%|█▍        | 167/1177 [07:51<41:01,  2.44s/it, exist=0.2418, loss=0.4903, lr=1.82e-05]
Epoch 4/5:  14%|█▍        | 167/1177 [07:53<41:01,  2.44s/it, exist=0.2417, loss=0.4899, lr=1.82e-05]
Epoch 4/5:  14%|█▍        | 168/1177 [07:53<38:28,  2.29s/it, exist=0.2417, loss=0.4899, lr=1.82e-05]
Epoch 4/5:  14%|█▍        | 168/1177 [07:56<38:28,  2.29s/it, exist=0.2406, loss=0.4889, lr=1.82e-05]
Epoch 4/5:  14%|█▍        | 169/1177 [07:56<45:45,  2.72s/it, exist=0.2406, loss=0.4889, lr=1.82e-05]
Epoch 4/5:  14%|█▍        | 169/1177 [07:58<45:45,  2.72s/it, exist=0.2395, loss=0.4877, lr=1.82e-05]
Epoch 4/5:  14%|█▍        | 170/1177 [07:58<42:00,  2.50s/it, exist=0.2395, loss=0.4877, lr=1.82e-05]
Epoch 4/5:  14%|█▍        | 170/1177 [08:00<42:00,  2.50s/it, exist=0.2399, loss=0.4880, lr=1.82e-05]
Epoch 4/5:  15%|█▍        | 171/1177 [08:00<39:02,  2.33s/it, exist=0.2399, loss=0.4880, lr=1.82e-05]
Epoch 4/5:  15%|█▍        | 171/1177 [08:03<39:02,  2.33s/it, exist=0.2402, loss=0.4884, lr=1.82e-05]
Epoch 4/5:  15%|█▍        | 172/1177 [08:03<43:09,  2.58s/it, exist=0.2402, loss=0.4884, lr=1.82e-05]
Epoch 4/5:  15%|█▍        | 172/1177 [08:07<43:09,  2.58s/it, exist=0.2413, loss=0.4892, lr=1.82e-05]
Epoch 4/5:  15%|█▍        | 173/1177 [08:07<46:11,  2.76s/it, exist=0.2413, loss=0.4892, lr=1.82e-05]
Epoch 4/5:  15%|█▍        | 173/1177 [08:09<46:11,  2.76s/it, exist=0.2407, loss=0.4888, lr=1.81e-05]
Epoch 4/5:  15%|█▍        | 174/1177 [08:09<42:14,  2.53s/it, exist=0.2407, loss=0.4888, lr=1.81e-05]
Epoch 4/5:  15%|█▍        | 174/1177 [08:11<42:14,  2.53s/it, exist=0.2409, loss=0.4889, lr=1.81e-05]
Epoch 4/5:  15%|█▍        | 175/1177 [08:11<42:14,  2.53s/it, exist=0.2409, loss=0.4889, lr=1.81e-05]
Epoch 4/5:  15%|█▍        | 175/1177 [08:13<42:14,  2.53s/it, exist=0.2403, loss=0.4885, lr=1.81e-05]
Epoch 4/5:  15%|█▍        | 176/1177 [08:13<39:28,  2.37s/it, exist=0.2403, loss=0.4885, lr=1.81e-05]
Epoch 4/5:  15%|█▍        | 176/1177 [08:15<39:28,  2.37s/it, exist=0.2402, loss=0.4883, lr=1.81e-05]
Epoch 4/5:  15%|█▌        | 177/1177 [08:15<37:29,  2.25s/it, exist=0.2402, loss=0.4883, lr=1.81e-05]
Epoch 4/5:  15%|█▌        | 177/1177 [08:20<37:29,  2.25s/it, exist=0.2401, loss=0.4886, lr=1.81e-05]
Epoch 4/5:  15%|█▌        | 178/1177 [08:20<49:55,  3.00s/it, exist=0.2401, loss=0.4886, lr=1.81e-05]
Epoch 4/5:  15%|█▌        | 178/1177 [08:22<49:55,  3.00s/it, exist=0.2408, loss=0.4891, lr=1.81e-05]
Epoch 4/5:  15%|█▌        | 179/1177 [08:22<47:23,  2.85s/it, exist=0.2408, loss=0.4891, lr=1.81e-05]
Epoch 4/5:  15%|█▌        | 179/1177 [08:26<47:23,  2.85s/it, exist=0.2404, loss=0.4884, lr=1.81e-05]
Epoch 4/5:  15%|█▌        | 180/1177 [08:26<48:51,  2.94s/it, exist=0.2404, loss=0.4884, lr=1.81e-05]
Epoch 4/5:  15%|█▌        | 180/1177 [08:28<48:51,  2.94s/it, exist=0.2413, loss=0.4891, lr=1.80e-05]
Epoch 4/5:  15%|█▌        | 181/1177 [08:28<44:02,  2.65s/it, exist=0.2413, loss=0.4891, lr=1.80e-05]
Epoch 4/5:  15%|█▌        | 181/1177 [08:30<44:02,  2.65s/it, exist=0.2403, loss=0.4880, lr=1.80e-05]
Epoch 4/5:  15%|█▌        | 182/1177 [08:30<43:20,  2.61s/it, exist=0.2403, loss=0.4880, lr=1.80e-05]
Epoch 4/5:  15%|█▌        | 182/1177 [08:32<43:20,  2.61s/it, exist=0.2402, loss=0.4877, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 183/1177 [08:32<40:08,  2.42s/it, exist=0.2402, loss=0.4877, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 183/1177 [08:35<40:08,  2.42s/it, exist=0.2402, loss=0.4882, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 184/1177 [08:35<41:03,  2.48s/it, exist=0.2402, loss=0.4882, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 184/1177 [08:38<41:03,  2.48s/it, exist=0.2392, loss=0.4873, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 185/1177 [08:38<44:07,  2.67s/it, exist=0.2392, loss=0.4873, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 185/1177 [08:40<44:07,  2.67s/it, exist=0.2385, loss=0.4868, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 186/1177 [08:40<43:30,  2.63s/it, exist=0.2385, loss=0.4868, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 186/1177 [08:43<43:30,  2.63s/it, exist=0.2381, loss=0.4863, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 187/1177 [08:43<42:59,  2.61s/it, exist=0.2381, loss=0.4863, lr=1.80e-05]
Epoch 4/5:  16%|█▌        | 187/1177 [08:45<42:59,  2.61s/it, exist=0.2370, loss=0.4852, lr=1.79e-05]
Epoch 4/5:  16%|█▌        | 188/1177 [08:45<43:09,  2.62s/it, exist=0.2370, loss=0.4852, lr=1.79e-05]
Epoch 4/5:  16%|█▌        | 188/1177 [08:47<43:09,  2.62s/it, exist=0.2374, loss=0.4856, lr=1.79e-05]
Epoch 4/5:  16%|█▌        | 189/1177 [08:47<39:41,  2.41s/it, exist=0.2374, loss=0.4856, lr=1.79e-05]
Epoch 4/5:  16%|█▌        | 189/1177 [08:51<39:41,  2.41s/it, exist=0.2376, loss=0.4859, lr=1.79e-05]
Epoch 4/5:  16%|█▌        | 190/1177 [08:51<45:22,  2.76s/it, exist=0.2376, loss=0.4859, lr=1.79e-05]
Epoch 4/5:  16%|█▌        | 190/1177 [08:54<45:22,  2.76s/it, exist=0.2374, loss=0.4857, lr=1.79e-05]
Epoch 4/5:  16%|█▌        | 191/1177 [08:54<44:17,  2.70s/it, exist=0.2374, loss=0.4857, lr=1.79e-05]
Epoch 4/5:  16%|█▌        | 191/1177 [08:57<44:17,  2.70s/it, exist=0.2378, loss=0.4859, lr=1.79e-05]
Epoch 4/5:  16%|█▋        | 192/1177 [08:57<46:05,  2.81s/it, exist=0.2378, loss=0.4859, lr=1.79e-05]
Epoch 4/5:  16%|█▋        | 192/1177 [08:59<46:05,  2.81s/it, exist=0.2373, loss=0.4854, lr=1.79e-05]
Epoch 4/5:  16%|█▋        | 193/1177 [08:59<42:11,  2.57s/it, exist=0.2373, loss=0.4854, lr=1.79e-05]
Epoch 4/5:  16%|█▋        | 193/1177 [09:01<42:11,  2.57s/it, exist=0.2369, loss=0.4851, lr=1.79e-05]
Epoch 4/5:  16%|█▋        | 194/1177 [09:01<42:09,  2.57s/it, exist=0.2369, loss=0.4851, lr=1.79e-05]
Epoch 4/5:  16%|█▋        | 194/1177 [09:03<42:09,  2.57s/it, exist=0.2363, loss=0.4846, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 195/1177 [09:03<39:05,  2.39s/it, exist=0.2363, loss=0.4846, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 195/1177 [09:05<39:05,  2.39s/it, exist=0.2371, loss=0.4853, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 196/1177 [09:05<36:51,  2.25s/it, exist=0.2371, loss=0.4853, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 196/1177 [09:08<36:51,  2.25s/it, exist=0.2365, loss=0.4847, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 197/1177 [09:08<37:57,  2.32s/it, exist=0.2365, loss=0.4847, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 197/1177 [09:11<37:57,  2.32s/it, exist=0.2360, loss=0.4842, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 198/1177 [09:11<43:20,  2.66s/it, exist=0.2360, loss=0.4842, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 198/1177 [09:13<43:20,  2.66s/it, exist=0.2359, loss=0.4838, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 199/1177 [09:13<42:23,  2.60s/it, exist=0.2359, loss=0.4838, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 199/1177 [09:15<42:23,  2.60s/it, exist=0.2353, loss=0.4831, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 200/1177 [09:15<39:23,  2.42s/it, exist=0.2353, loss=0.4831, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 200/1177 [09:20<39:23,  2.42s/it, exist=0.2348, loss=0.4825, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 201/1177 [09:20<47:33,  2.92s/it, exist=0.2348, loss=0.4825, lr=1.78e-05]
Epoch 4/5:  17%|█▋        | 201/1177 [09:22<47:33,  2.92s/it, exist=0.2340, loss=0.4815, lr=1.77e-05]
Epoch 4/5:  17%|█▋        | 202/1177 [09:22<43:11,  2.66s/it, exist=0.2340, loss=0.4815, lr=1.77e-05]
Epoch 4/5:  17%|█▋        | 202/1177 [09:25<43:11,  2.66s/it, exist=0.2344, loss=0.4817, lr=1.77e-05]
Epoch 4/5:  17%|█▋        | 203/1177 [09:25<45:45,  2.82s/it, exist=0.2344, loss=0.4817, lr=1.77e-05]
Epoch 4/5:  17%|█▋        | 203/1177 [09:27<45:45,  2.82s/it, exist=0.2341, loss=0.4813, lr=1.77e-05]
Epoch 4/5:  17%|█▋        | 204/1177 [09:27<45:06,  2.78s/it, exist=0.2341, loss=0.4813, lr=1.77e-05]
Epoch 4/5:  17%|█▋        | 204/1177 [09:30<45:06,  2.78s/it, exist=0.2344, loss=0.4822, lr=1.77e-05]
Epoch 4/5:  17%|█▋        | 205/1177 [09:30<41:26,  2.56s/it, exist=0.2344, loss=0.4822, lr=1.77e-05]
Epoch 4/5:  17%|█▋        | 205/1177 [09:33<41:26,  2.56s/it, exist=0.2349, loss=0.4831, lr=1.77e-05]
Epoch 4/5:  18%|█▊        | 206/1177 [09:33<44:53,  2.77s/it, exist=0.2349, loss=0.4831, lr=1.77e-05]
Epoch 4/5:  18%|█▊        | 206/1177 [09:35<44:53,  2.77s/it, exist=0.2342, loss=0.4821, lr=1.77e-05]
Epoch 4/5:  18%|█▊        | 207/1177 [09:35<44:19,  2.74s/it, exist=0.2342, loss=0.4821, lr=1.77e-05]
Epoch 4/5:  18%|█▊        | 207/1177 [09:37<44:19,  2.74s/it, exist=0.2342, loss=0.4820, lr=1.77e-05]
Epoch 4/5:  18%|█▊        | 208/1177 [09:37<40:25,  2.50s/it, exist=0.2342, loss=0.4820, lr=1.77e-05]
Epoch 4/5:  18%|█▊        | 208/1177 [09:41<40:25,  2.50s/it, exist=0.2347, loss=0.4822, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 209/1177 [09:41<44:32,  2.76s/it, exist=0.2347, loss=0.4822, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 209/1177 [09:43<44:32,  2.76s/it, exist=0.2355, loss=0.4827, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 210/1177 [09:43<40:26,  2.51s/it, exist=0.2355, loss=0.4827, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 210/1177 [09:45<40:26,  2.51s/it, exist=0.2357, loss=0.4828, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 211/1177 [09:45<40:05,  2.49s/it, exist=0.2357, loss=0.4828, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 211/1177 [09:48<40:05,  2.49s/it, exist=0.2361, loss=0.4835, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 212/1177 [09:48<40:15,  2.50s/it, exist=0.2361, loss=0.4835, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 212/1177 [09:50<40:15,  2.50s/it, exist=0.2365, loss=0.4836, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 213/1177 [09:50<39:46,  2.48s/it, exist=0.2365, loss=0.4836, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 213/1177 [09:53<39:46,  2.48s/it, exist=0.2361, loss=0.4837, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 214/1177 [09:53<44:03,  2.75s/it, exist=0.2361, loss=0.4837, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 214/1177 [09:56<44:03,  2.75s/it, exist=0.2357, loss=0.4832, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 215/1177 [09:56<42:46,  2.67s/it, exist=0.2357, loss=0.4832, lr=1.76e-05]
Epoch 4/5:  18%|█▊        | 215/1177 [09:59<42:46,  2.67s/it, exist=0.2358, loss=0.4832, lr=1.75e-05]
Epoch 4/5:  18%|█▊        | 216/1177 [09:59<45:46,  2.86s/it, exist=0.2358, loss=0.4832, lr=1.75e-05]
Epoch 4/5:  18%|█▊        | 216/1177 [10:01<45:46,  2.86s/it, exist=0.2353, loss=0.4828, lr=1.75e-05]
Epoch 4/5:  18%|█▊        | 217/1177 [10:01<41:33,  2.60s/it, exist=0.2353, loss=0.4828, lr=1.75e-05]
Epoch 4/5:  18%|█▊        | 217/1177 [10:04<41:33,  2.60s/it, exist=0.2376, loss=0.4854, lr=1.75e-05]
Epoch 4/5:  19%|█▊        | 218/1177 [10:04<41:42,  2.61s/it, exist=0.2376, loss=0.4854, lr=1.75e-05]
Epoch 4/5:  19%|█▊        | 218/1177 [10:07<41:42,  2.61s/it, exist=0.2389, loss=0.4865, lr=1.75e-05]
Epoch 4/5:  19%|█▊        | 219/1177 [10:07<42:16,  2.65s/it, exist=0.2389, loss=0.4865, lr=1.75e-05]
Epoch 4/5:  19%|█▊        | 219/1177 [10:09<42:16,  2.65s/it, exist=0.2403, loss=0.4884, lr=1.75e-05]
Epoch 4/5:  19%|█▊        | 220/1177 [10:09<39:13,  2.46s/it, exist=0.2403, loss=0.4884, lr=1.75e-05]
Epoch 4/5:  19%|█▊        | 220/1177 [10:11<39:13,  2.46s/it, exist=0.2403, loss=0.4883, lr=1.75e-05]
Epoch 4/5:  19%|█▉        | 221/1177 [10:11<37:35,  2.36s/it, exist=0.2403, loss=0.4883, lr=1.75e-05]
Epoch 4/5:  19%|█▉        | 221/1177 [10:15<37:35,  2.36s/it, exist=0.2397, loss=0.4877, lr=1.75e-05]
Epoch 4/5:  19%|█▉        | 222/1177 [10:15<44:50,  2.82s/it, exist=0.2397, loss=0.4877, lr=1.75e-05]
Epoch 4/5:  19%|█▉        | 222/1177 [10:17<44:50,  2.82s/it, exist=0.2395, loss=0.4876, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 223/1177 [10:17<43:10,  2.72s/it, exist=0.2395, loss=0.4876, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 223/1177 [10:20<43:10,  2.72s/it, exist=0.2413, loss=0.4894, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 224/1177 [10:20<41:53,  2.64s/it, exist=0.2413, loss=0.4894, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 224/1177 [10:22<41:53,  2.64s/it, exist=0.2407, loss=0.4889, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 225/1177 [10:22<42:01,  2.65s/it, exist=0.2407, loss=0.4889, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 225/1177 [10:25<42:01,  2.65s/it, exist=0.2404, loss=0.4884, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 226/1177 [10:25<41:30,  2.62s/it, exist=0.2404, loss=0.4884, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 226/1177 [10:27<41:30,  2.62s/it, exist=0.2398, loss=0.4876, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 227/1177 [10:27<38:34,  2.44s/it, exist=0.2398, loss=0.4876, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 227/1177 [10:30<38:34,  2.44s/it, exist=0.2391, loss=0.4869, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 228/1177 [10:30<42:43,  2.70s/it, exist=0.2391, loss=0.4869, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 228/1177 [10:33<42:43,  2.70s/it, exist=0.2398, loss=0.4876, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 229/1177 [10:33<44:32,  2.82s/it, exist=0.2398, loss=0.4876, lr=1.74e-05]
Epoch 4/5:  19%|█▉        | 229/1177 [10:35<44:32,  2.82s/it, exist=0.2396, loss=0.4875, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 230/1177 [10:35<40:21,  2.56s/it, exist=0.2396, loss=0.4875, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 230/1177 [10:37<40:21,  2.56s/it, exist=0.2397, loss=0.4874, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 231/1177 [10:37<37:33,  2.38s/it, exist=0.2397, loss=0.4874, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 231/1177 [10:41<37:33,  2.38s/it, exist=0.2392, loss=0.4867, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 232/1177 [10:41<43:12,  2.74s/it, exist=0.2392, loss=0.4867, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 232/1177 [10:43<43:12,  2.74s/it, exist=0.2390, loss=0.4863, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 233/1177 [10:43<42:41,  2.71s/it, exist=0.2390, loss=0.4863, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 233/1177 [10:46<42:41,  2.71s/it, exist=0.2385, loss=0.4856, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 234/1177 [10:46<41:45,  2.66s/it, exist=0.2385, loss=0.4856, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 234/1177 [10:49<41:45,  2.66s/it, exist=0.2385, loss=0.4858, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 235/1177 [10:49<41:40,  2.65s/it, exist=0.2385, loss=0.4858, lr=1.73e-05]
Epoch 4/5:  20%|█▉        | 235/1177 [10:51<41:40,  2.65s/it, exist=0.2380, loss=0.4852, lr=1.73e-05]
Epoch 4/5:  20%|██        | 236/1177 [10:51<40:37,  2.59s/it, exist=0.2380, loss=0.4852, lr=1.73e-05]
Epoch 4/5:  20%|██        | 236/1177 [10:54<40:37,  2.59s/it, exist=0.2400, loss=0.4869, lr=1.72e-05]
Epoch 4/5:  20%|██        | 237/1177 [10:54<43:04,  2.75s/it, exist=0.2400, loss=0.4869, lr=1.72e-05]
Epoch 4/5:  20%|██        | 237/1177 [10:56<43:04,  2.75s/it, exist=0.2397, loss=0.4867, lr=1.72e-05]
Epoch 4/5:  20%|██        | 238/1177 [10:56<39:22,  2.52s/it, exist=0.2397, loss=0.4867, lr=1.72e-05]
Epoch 4/5:  20%|██        | 238/1177 [10:58<39:22,  2.52s/it, exist=0.2393, loss=0.4865, lr=1.72e-05]
Epoch 4/5:  20%|██        | 239/1177 [10:58<36:38,  2.34s/it, exist=0.2393, loss=0.4865, lr=1.72e-05]
Epoch 4/5:  20%|██        | 239/1177 [11:01<36:38,  2.34s/it, exist=0.2396, loss=0.4865, lr=1.72e-05]
Epoch 4/5:  20%|██        | 240/1177 [11:01<39:53,  2.55s/it, exist=0.2396, loss=0.4865, lr=1.72e-05]
Epoch 4/5:  20%|██        | 240/1177 [11:04<39:53,  2.55s/it, exist=0.2401, loss=0.4870, lr=1.72e-05]
Epoch 4/5:  20%|██        | 241/1177 [11:04<39:59,  2.56s/it, exist=0.2401, loss=0.4870, lr=1.72e-05]
Epoch 4/5:  20%|██        | 241/1177 [11:06<39:59,  2.56s/it, exist=0.2396, loss=0.4863, lr=1.72e-05]
Epoch 4/5:  21%|██        | 242/1177 [11:06<39:45,  2.55s/it, exist=0.2396, loss=0.4863, lr=1.72e-05]
Epoch 4/5:  21%|██        | 242/1177 [11:09<39:45,  2.55s/it, exist=0.2403, loss=0.4869, lr=1.72e-05]
Epoch 4/5:  21%|██        | 243/1177 [11:09<39:24,  2.53s/it, exist=0.2403, loss=0.4869, lr=1.72e-05]
Epoch 4/5:  21%|██        | 243/1177 [11:11<39:24,  2.53s/it, exist=0.2403, loss=0.4866, lr=1.72e-05]
Epoch 4/5:  21%|██        | 244/1177 [11:11<39:01,  2.51s/it, exist=0.2403, loss=0.4866, lr=1.72e-05]
Epoch 4/5:  21%|██        | 244/1177 [11:13<39:01,  2.51s/it, exist=0.2412, loss=0.4879, lr=1.71e-05]
Epoch 4/5:  21%|██        | 245/1177 [11:13<37:13,  2.40s/it, exist=0.2412, loss=0.4879, lr=1.71e-05]
Epoch 4/5:  21%|██        | 245/1177 [11:16<37:13,  2.40s/it, exist=0.2410, loss=0.4876, lr=1.71e-05]
Epoch 4/5:  21%|██        | 246/1177 [11:16<39:03,  2.52s/it, exist=0.2410, loss=0.4876, lr=1.71e-05]
Epoch 4/5:  21%|██        | 246/1177 [11:19<39:03,  2.52s/it, exist=0.2412, loss=0.4881, lr=1.71e-05]
Epoch 4/5:  21%|██        | 247/1177 [11:19<40:55,  2.64s/it, exist=0.2412, loss=0.4881, lr=1.71e-05]
Epoch 4/5:  21%|██        | 247/1177 [11:22<40:55,  2.64s/it, exist=0.2420, loss=0.4887, lr=1.71e-05]
Epoch 4/5:  21%|██        | 248/1177 [11:22<40:39,  2.63s/it, exist=0.2420, loss=0.4887, lr=1.71e-05]
Epoch 4/5:  21%|██        | 248/1177 [11:24<40:39,  2.63s/it, exist=0.2429, loss=0.4896, lr=1.71e-05]
Epoch 4/5:  21%|██        | 249/1177 [11:24<41:13,  2.67s/it, exist=0.2429, loss=0.4896, lr=1.71e-05]
Epoch 4/5:  21%|██        | 249/1177 [11:26<41:13,  2.67s/it, exist=0.2432, loss=0.4899, lr=1.71e-05]
Epoch 4/5:  21%|██        | 250/1177 [11:26<37:59,  2.46s/it, exist=0.2432, loss=0.4899, lr=1.71e-05]
Epoch 4/5:  21%|██        | 250/1177 [11:29<37:59,  2.46s/it, exist=0.2437, loss=0.4907, lr=1.71e-05]
Epoch 4/5:  21%|██▏       | 251/1177 [11:29<41:09,  2.67s/it, exist=0.2437, loss=0.4907, lr=1.71e-05]
Epoch 4/5:  21%|██▏       | 251/1177 [11:32<41:09,  2.67s/it, exist=0.2451, loss=0.4919, lr=1.70e-05]
Epoch 4/5:  21%|██▏       | 252/1177 [11:32<40:53,  2.65s/it, exist=0.2451, loss=0.4919, lr=1.70e-05]
Epoch 4/5:  21%|██▏       | 252/1177 [11:34<40:53,  2.65s/it, exist=0.2451, loss=0.4919, lr=1.70e-05]
Epoch 4/5:  21%|██▏       | 253/1177 [11:34<37:38,  2.44s/it, exist=0.2451, loss=0.4919, lr=1.70e-05]
Epoch 4/5:  21%|██▏       | 253/1177 [11:37<37:38,  2.44s/it, exist=0.2445, loss=0.4911, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 254/1177 [11:37<41:10,  2.68s/it, exist=0.2445, loss=0.4911, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 254/1177 [11:39<41:10,  2.68s/it, exist=0.2443, loss=0.4909, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 255/1177 [11:39<37:56,  2.47s/it, exist=0.2443, loss=0.4909, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 255/1177 [11:42<37:56,  2.47s/it, exist=0.2437, loss=0.4906, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 256/1177 [11:42<38:49,  2.53s/it, exist=0.2437, loss=0.4906, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 256/1177 [11:45<38:49,  2.53s/it, exist=0.2442, loss=0.4912, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 257/1177 [11:45<41:47,  2.73s/it, exist=0.2442, loss=0.4912, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 257/1177 [11:49<41:47,  2.73s/it, exist=0.2439, loss=0.4909, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 258/1177 [11:49<46:31,  3.04s/it, exist=0.2439, loss=0.4909, lr=1.70e-05]
Epoch 4/5:  22%|██▏       | 258/1177 [11:51<46:31,  3.04s/it, exist=0.2435, loss=0.4904, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 259/1177 [11:51<41:38,  2.72s/it, exist=0.2435, loss=0.4904, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 259/1177 [11:53<41:38,  2.72s/it, exist=0.2432, loss=0.4900, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 260/1177 [11:53<38:11,  2.50s/it, exist=0.2432, loss=0.4900, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 260/1177 [11:56<38:11,  2.50s/it, exist=0.2430, loss=0.4904, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 261/1177 [11:56<42:06,  2.76s/it, exist=0.2430, loss=0.4904, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 261/1177 [11:59<42:06,  2.76s/it, exist=0.2429, loss=0.4901, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 262/1177 [11:59<40:11,  2.64s/it, exist=0.2429, loss=0.4901, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 262/1177 [12:01<40:11,  2.64s/it, exist=0.2423, loss=0.4902, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 263/1177 [12:01<37:01,  2.43s/it, exist=0.2423, loss=0.4902, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 263/1177 [12:04<37:01,  2.43s/it, exist=0.2431, loss=0.4909, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 264/1177 [12:04<41:07,  2.70s/it, exist=0.2431, loss=0.4909, lr=1.69e-05]
Epoch 4/5:  22%|██▏       | 264/1177 [12:06<41:07,  2.70s/it, exist=0.2432, loss=0.4910, lr=1.69e-05]
Epoch 4/5:  23%|██▎       | 265/1177 [12:06<40:51,  2.69s/it, exist=0.2432, loss=0.4910, lr=1.69e-05]
Epoch 4/5:  23%|██▎       | 265/1177 [12:09<40:51,  2.69s/it, exist=0.2429, loss=0.4907, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 266/1177 [12:09<39:04,  2.57s/it, exist=0.2429, loss=0.4907, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 266/1177 [12:11<39:04,  2.57s/it, exist=0.2424, loss=0.4902, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 267/1177 [12:11<38:28,  2.54s/it, exist=0.2424, loss=0.4902, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 267/1177 [12:14<38:28,  2.54s/it, exist=0.2427, loss=0.4905, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 268/1177 [12:14<38:15,  2.52s/it, exist=0.2427, loss=0.4905, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 268/1177 [12:16<38:15,  2.52s/it, exist=0.2437, loss=0.4913, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 269/1177 [12:16<38:29,  2.54s/it, exist=0.2437, loss=0.4913, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 269/1177 [12:18<38:29,  2.54s/it, exist=0.2432, loss=0.4908, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 270/1177 [12:18<35:52,  2.37s/it, exist=0.2432, loss=0.4908, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 270/1177 [12:21<35:52,  2.37s/it, exist=0.2430, loss=0.4905, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 271/1177 [12:21<36:23,  2.41s/it, exist=0.2430, loss=0.4905, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 271/1177 [12:24<36:23,  2.41s/it, exist=0.2434, loss=0.4908, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 272/1177 [12:24<39:17,  2.60s/it, exist=0.2434, loss=0.4908, lr=1.68e-05]
Epoch 4/5:  23%|██▎       | 272/1177 [12:27<39:17,  2.60s/it, exist=0.2434, loss=0.4909, lr=1.67e-05]
Epoch 4/5:  23%|██▎       | 273/1177 [12:27<39:32,  2.62s/it, exist=0.2434, loss=0.4909, lr=1.67e-05]
Epoch 4/5:  23%|██▎       | 273/1177 [12:29<39:32,  2.62s/it, exist=0.2428, loss=0.4909, lr=1.67e-05]
Epoch 4/5:  23%|██▎       | 274/1177 [12:29<39:16,  2.61s/it, exist=0.2428, loss=0.4909, lr=1.67e-05]
Epoch 4/5:  23%|██▎       | 274/1177 [12:32<39:16,  2.61s/it, exist=0.2422, loss=0.4901, lr=1.67e-05]
Epoch 4/5:  23%|██▎       | 275/1177 [12:32<39:38,  2.64s/it, exist=0.2422, loss=0.4901, lr=1.67e-05]
Epoch 4/5:  23%|██▎       | 275/1177 [12:34<39:38,  2.64s/it, exist=0.2434, loss=0.4912, lr=1.67e-05]
Epoch 4/5:  23%|██▎       | 276/1177 [12:34<39:22,  2.62s/it, exist=0.2434, loss=0.4912, lr=1.67e-05]
Epoch 4/5:  23%|██▎       | 276/1177 [12:37<39:22,  2.62s/it, exist=0.2428, loss=0.4909, lr=1.67e-05]
Epoch 4/5:  24%|██▎       | 277/1177 [12:37<39:56,  2.66s/it, exist=0.2428, loss=0.4909, lr=1.67e-05]
Epoch 4/5:  24%|██▎       | 277/1177 [12:40<39:56,  2.66s/it, exist=0.2436, loss=0.4915, lr=1.67e-05]
Epoch 4/5:  24%|██▎       | 278/1177 [12:40<39:09,  2.61s/it, exist=0.2436, loss=0.4915, lr=1.67e-05]
Epoch 4/5:  24%|██▎       | 278/1177 [12:42<39:09,  2.61s/it, exist=0.2432, loss=0.4910, lr=1.67e-05]
Epoch 4/5:  24%|██▎       | 279/1177 [12:42<36:18,  2.43s/it, exist=0.2432, loss=0.4910, lr=1.67e-05]
Epoch 4/5:  24%|██▎       | 279/1177 [12:44<36:18,  2.43s/it, exist=0.2427, loss=0.4904, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 280/1177 [12:44<37:02,  2.48s/it, exist=0.2427, loss=0.4904, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 280/1177 [12:47<37:02,  2.48s/it, exist=0.2436, loss=0.4912, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 281/1177 [12:47<37:31,  2.51s/it, exist=0.2436, loss=0.4912, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 281/1177 [12:50<37:31,  2.51s/it, exist=0.2429, loss=0.4905, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 282/1177 [12:50<40:30,  2.72s/it, exist=0.2429, loss=0.4905, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 282/1177 [12:52<40:30,  2.72s/it, exist=0.2426, loss=0.4905, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 283/1177 [12:52<37:31,  2.52s/it, exist=0.2426, loss=0.4905, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 283/1177 [12:55<37:31,  2.52s/it, exist=0.2425, loss=0.4902, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 284/1177 [12:55<41:06,  2.76s/it, exist=0.2425, loss=0.4902, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 284/1177 [12:58<41:06,  2.76s/it, exist=0.2422, loss=0.4899, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 285/1177 [12:58<40:23,  2.72s/it, exist=0.2422, loss=0.4899, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 285/1177 [13:01<40:23,  2.72s/it, exist=0.2421, loss=0.4897, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 286/1177 [13:01<39:43,  2.68s/it, exist=0.2421, loss=0.4897, lr=1.66e-05]
Epoch 4/5:  24%|██▍       | 286/1177 [13:03<39:43,  2.68s/it, exist=0.2429, loss=0.4908, lr=1.65e-05]
Epoch 4/5:  24%|██▍       | 287/1177 [13:03<36:23,  2.45s/it, exist=0.2429, loss=0.4908, lr=1.65e-05]
Epoch 4/5:  24%|██▍       | 287/1177 [13:05<36:23,  2.45s/it, exist=0.2425, loss=0.4904, lr=1.65e-05]
Epoch 4/5:  24%|██▍       | 288/1177 [13:05<34:12,  2.31s/it, exist=0.2425, loss=0.4904, lr=1.65e-05]
Epoch 4/5:  24%|██▍       | 288/1177 [13:08<34:12,  2.31s/it, exist=0.2419, loss=0.4898, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 289/1177 [13:08<38:46,  2.62s/it, exist=0.2419, loss=0.4898, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 289/1177 [13:11<38:46,  2.62s/it, exist=0.2415, loss=0.4894, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 290/1177 [13:11<41:50,  2.83s/it, exist=0.2415, loss=0.4894, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 290/1177 [13:13<41:50,  2.83s/it, exist=0.2412, loss=0.4895, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 291/1177 [13:13<37:59,  2.57s/it, exist=0.2412, loss=0.4895, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 291/1177 [13:16<37:59,  2.57s/it, exist=0.2408, loss=0.4890, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 292/1177 [13:16<38:27,  2.61s/it, exist=0.2408, loss=0.4890, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 292/1177 [13:19<38:27,  2.61s/it, exist=0.2408, loss=0.4890, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 293/1177 [13:19<42:09,  2.86s/it, exist=0.2408, loss=0.4890, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 293/1177 [13:22<42:09,  2.86s/it, exist=0.2413, loss=0.4899, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 294/1177 [13:22<40:29,  2.75s/it, exist=0.2413, loss=0.4899, lr=1.65e-05]
Epoch 4/5:  25%|██▍       | 294/1177 [13:24<40:29,  2.75s/it, exist=0.2422, loss=0.4907, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 295/1177 [13:24<39:47,  2.71s/it, exist=0.2422, loss=0.4907, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 295/1177 [13:26<39:47,  2.71s/it, exist=0.2425, loss=0.4909, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 296/1177 [13:26<36:28,  2.48s/it, exist=0.2425, loss=0.4909, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 296/1177 [13:29<36:28,  2.48s/it, exist=0.2422, loss=0.4912, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 297/1177 [13:29<37:24,  2.55s/it, exist=0.2422, loss=0.4912, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 297/1177 [13:32<37:24,  2.55s/it, exist=0.2427, loss=0.4915, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 298/1177 [13:32<37:29,  2.56s/it, exist=0.2427, loss=0.4915, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 298/1177 [13:35<37:29,  2.56s/it, exist=0.2429, loss=0.4916, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 299/1177 [13:35<40:36,  2.78s/it, exist=0.2429, loss=0.4916, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 299/1177 [13:38<40:36,  2.78s/it, exist=0.2425, loss=0.4918, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 300/1177 [13:38<40:17,  2.76s/it, exist=0.2425, loss=0.4918, lr=1.64e-05]
Epoch 4/5:  25%|██▌       | 300/1177 [13:40<40:17,  2.76s/it, exist=0.2421, loss=0.4912, lr=1.64e-05]
Epoch 4/5:  26%|██▌       | 301/1177 [13:40<39:54,  2.73s/it, exist=0.2421, loss=0.4912, lr=1.64e-05]
Epoch 4/5:  26%|██▌       | 301/1177 [13:42<39:54,  2.73s/it, exist=0.2418, loss=0.4908, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 302/1177 [13:42<36:33,  2.51s/it, exist=0.2418, loss=0.4908, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 302/1177 [13:46<36:33,  2.51s/it, exist=0.2413, loss=0.4901, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 303/1177 [13:46<40:03,  2.75s/it, exist=0.2413, loss=0.4901, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 303/1177 [13:48<40:03,  2.75s/it, exist=0.2413, loss=0.4899, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 304/1177 [13:48<39:33,  2.72s/it, exist=0.2413, loss=0.4899, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 304/1177 [13:50<39:33,  2.72s/it, exist=0.2408, loss=0.4895, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 305/1177 [13:50<36:03,  2.48s/it, exist=0.2408, loss=0.4895, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 305/1177 [13:54<36:03,  2.48s/it, exist=0.2411, loss=0.4900, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 306/1177 [13:54<39:54,  2.75s/it, exist=0.2411, loss=0.4900, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 306/1177 [13:56<39:54,  2.75s/it, exist=0.2418, loss=0.4909, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 307/1177 [13:56<36:32,  2.52s/it, exist=0.2418, loss=0.4909, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 307/1177 [13:58<36:32,  2.52s/it, exist=0.2413, loss=0.4903, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 308/1177 [13:58<36:34,  2.53s/it, exist=0.2413, loss=0.4903, lr=1.63e-05]
Epoch 4/5:  26%|██▌       | 308/1177 [14:01<36:34,  2.53s/it, exist=0.2412, loss=0.4900, lr=1.62e-05]
Epoch 4/5:  26%|██▋       | 309/1177 [14:01<36:41,  2.54s/it, exist=0.2412, loss=0.4900, lr=1.62e-05]
Epoch 4/5:  26%|██▋       | 309/1177 [14:04<36:41,  2.54s/it, exist=0.2417, loss=0.4906, lr=1.62e-05]
Epoch 4/5:  26%|██▋       | 310/1177 [14:04<40:50,  2.83s/it, exist=0.2417, loss=0.4906, lr=1.62e-05]
Epoch 4/5:  26%|██▋       | 310/1177 [14:06<40:50,  2.83s/it, exist=0.2417, loss=0.4904, lr=1.62e-05]
Epoch 4/5:  26%|██▋       | 311/1177 [14:06<37:00,  2.56s/it, exist=0.2417, loss=0.4904, lr=1.62e-05]
Epoch 4/5:  26%|██▋       | 311/1177 [14:09<37:00,  2.56s/it, exist=0.2417, loss=0.4903, lr=1.62e-05]
Epoch 4/5:  27%|██▋       | 312/1177 [14:09<36:56,  2.56s/it, exist=0.2417, loss=0.4903, lr=1.62e-05]
Epoch 4/5:  27%|██▋       | 312/1177 [14:12<36:56,  2.56s/it, exist=0.2416, loss=0.4906, lr=1.62e-05]
Epoch 4/5:  27%|██▋       | 313/1177 [14:12<41:23,  2.87s/it, exist=0.2416, loss=0.4906, lr=1.62e-05]
Epoch 4/5:  27%|██▋       | 313/1177 [14:15<41:23,  2.87s/it, exist=0.2423, loss=0.4911, lr=1.62e-05]
Epoch 4/5:  27%|██▋       | 314/1177 [14:15<39:58,  2.78s/it, exist=0.2423, loss=0.4911, lr=1.62e-05]
Epoch 4/5:  27%|██▋       | 314/1177 [14:17<39:58,  2.78s/it, exist=0.2425, loss=0.4911, lr=1.62e-05]
Epoch 4/5:  27%|██▋       | 315/1177 [14:17<36:18,  2.53s/it, exist=0.2425, loss=0.4911, lr=1.62e-05]
Epoch 4/5:  27%|██▋       | 315/1177 [14:20<36:18,  2.53s/it, exist=0.2419, loss=0.4905, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 316/1177 [14:20<39:56,  2.78s/it, exist=0.2419, loss=0.4905, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 316/1177 [14:22<39:56,  2.78s/it, exist=0.2419, loss=0.4910, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 317/1177 [14:22<36:21,  2.54s/it, exist=0.2419, loss=0.4910, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 317/1177 [14:26<36:21,  2.54s/it, exist=0.2414, loss=0.4905, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 318/1177 [14:26<40:22,  2.82s/it, exist=0.2414, loss=0.4905, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 318/1177 [14:28<40:22,  2.82s/it, exist=0.2413, loss=0.4907, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 319/1177 [14:28<36:44,  2.57s/it, exist=0.2413, loss=0.4907, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 319/1177 [14:31<36:44,  2.57s/it, exist=0.2408, loss=0.4901, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 320/1177 [14:31<39:35,  2.77s/it, exist=0.2408, loss=0.4901, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 320/1177 [14:33<39:35,  2.77s/it, exist=0.2407, loss=0.4899, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 321/1177 [14:33<38:06,  2.67s/it, exist=0.2407, loss=0.4899, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 321/1177 [14:35<38:06,  2.67s/it, exist=0.2401, loss=0.4896, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 322/1177 [14:35<35:05,  2.46s/it, exist=0.2401, loss=0.4896, lr=1.61e-05]
Epoch 4/5:  27%|██▋       | 322/1177 [14:38<35:05,  2.46s/it, exist=0.2403, loss=0.4899, lr=1.60e-05]
Epoch 4/5:  27%|██▋       | 323/1177 [14:38<38:32,  2.71s/it, exist=0.2403, loss=0.4899, lr=1.60e-05]
Epoch 4/5:  27%|██▋       | 323/1177 [14:40<38:32,  2.71s/it, exist=0.2407, loss=0.4904, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 324/1177 [14:40<35:20,  2.49s/it, exist=0.2407, loss=0.4904, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 324/1177 [14:44<35:20,  2.49s/it, exist=0.2403, loss=0.4900, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 325/1177 [14:44<40:59,  2.89s/it, exist=0.2403, loss=0.4900, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 325/1177 [14:47<40:59,  2.89s/it, exist=0.2401, loss=0.4897, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 326/1177 [14:47<39:25,  2.78s/it, exist=0.2401, loss=0.4897, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 326/1177 [14:49<39:25,  2.78s/it, exist=0.2400, loss=0.4895, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 327/1177 [14:49<38:17,  2.70s/it, exist=0.2400, loss=0.4895, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 327/1177 [14:53<38:17,  2.70s/it, exist=0.2396, loss=0.4890, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 328/1177 [14:53<40:30,  2.86s/it, exist=0.2396, loss=0.4890, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 328/1177 [14:55<40:30,  2.86s/it, exist=0.2398, loss=0.4895, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 329/1177 [14:55<39:27,  2.79s/it, exist=0.2398, loss=0.4895, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 329/1177 [14:58<39:27,  2.79s/it, exist=0.2398, loss=0.4896, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 330/1177 [14:58<38:52,  2.75s/it, exist=0.2398, loss=0.4896, lr=1.60e-05]
Epoch 4/5:  28%|██▊       | 330/1177 [15:01<38:52,  2.75s/it, exist=0.2393, loss=0.4900, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 331/1177 [15:01<38:57,  2.76s/it, exist=0.2393, loss=0.4900, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 331/1177 [15:03<38:57,  2.76s/it, exist=0.2388, loss=0.4895, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 332/1177 [15:03<35:19,  2.51s/it, exist=0.2388, loss=0.4895, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 332/1177 [15:06<35:19,  2.51s/it, exist=0.2389, loss=0.4896, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 333/1177 [15:06<38:10,  2.71s/it, exist=0.2389, loss=0.4896, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 333/1177 [15:09<38:10,  2.71s/it, exist=0.2400, loss=0.4906, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 334/1177 [15:09<38:20,  2.73s/it, exist=0.2400, loss=0.4906, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 334/1177 [15:11<38:20,  2.73s/it, exist=0.2402, loss=0.4907, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 335/1177 [15:11<37:17,  2.66s/it, exist=0.2402, loss=0.4907, lr=1.59e-05]
Epoch 4/5:  28%|██▊       | 335/1177 [15:13<37:17,  2.66s/it, exist=0.2397, loss=0.4903, lr=1.59e-05]
Epoch 4/5:  29%|██▊       | 336/1177 [15:13<36:29,  2.60s/it, exist=0.2397, loss=0.4903, lr=1.59e-05]
Epoch 4/5:  29%|██▊       | 336/1177 [15:16<36:29,  2.60s/it, exist=0.2391, loss=0.4898, lr=1.59e-05]
Epoch 4/5:  29%|██▊       | 337/1177 [15:16<37:03,  2.65s/it, exist=0.2391, loss=0.4898, lr=1.59e-05]
Epoch 4/5:  29%|██▊       | 337/1177 [15:18<37:03,  2.65s/it, exist=0.2386, loss=0.4893, lr=1.58e-05]
Epoch 4/5:  29%|██▊       | 338/1177 [15:18<34:07,  2.44s/it, exist=0.2386, loss=0.4893, lr=1.58e-05]
Epoch 4/5:  29%|██▊       | 338/1177 [15:21<34:07,  2.44s/it, exist=0.2384, loss=0.4890, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 339/1177 [15:21<35:09,  2.52s/it, exist=0.2384, loss=0.4890, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 339/1177 [15:23<35:09,  2.52s/it, exist=0.2380, loss=0.4885, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 340/1177 [15:23<35:23,  2.54s/it, exist=0.2380, loss=0.4885, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 340/1177 [15:26<35:23,  2.54s/it, exist=0.2376, loss=0.4879, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 341/1177 [15:26<35:45,  2.57s/it, exist=0.2376, loss=0.4879, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 341/1177 [15:29<35:45,  2.57s/it, exist=0.2372, loss=0.4877, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 342/1177 [15:29<38:38,  2.78s/it, exist=0.2372, loss=0.4877, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 342/1177 [15:32<38:38,  2.78s/it, exist=0.2372, loss=0.4876, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 343/1177 [15:32<37:55,  2.73s/it, exist=0.2372, loss=0.4876, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 343/1177 [15:34<37:55,  2.73s/it, exist=0.2369, loss=0.4875, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 344/1177 [15:34<36:43,  2.65s/it, exist=0.2369, loss=0.4875, lr=1.58e-05]
Epoch 4/5:  29%|██▉       | 344/1177 [15:37<36:43,  2.65s/it, exist=0.2368, loss=0.4875, lr=1.57e-05]
Epoch 4/5:  29%|██▉       | 345/1177 [15:37<36:46,  2.65s/it, exist=0.2368, loss=0.4875, lr=1.57e-05]
Epoch 4/5:  29%|██▉       | 345/1177 [15:39<36:46,  2.65s/it, exist=0.2364, loss=0.4874, lr=1.57e-05]
Epoch 4/5:  29%|██▉       | 346/1177 [15:39<34:05,  2.46s/it, exist=0.2364, loss=0.4874, lr=1.57e-05]
Epoch 4/5:  29%|██▉       | 346/1177 [15:42<34:05,  2.46s/it, exist=0.2359, loss=0.4869, lr=1.57e-05]
Epoch 4/5:  29%|██▉       | 347/1177 [15:42<37:34,  2.72s/it, exist=0.2359, loss=0.4869, lr=1.57e-05]
Epoch 4/5:  29%|██▉       | 347/1177 [15:45<37:34,  2.72s/it, exist=0.2356, loss=0.4866, lr=1.57e-05]
Epoch 4/5:  30%|██▉       | 348/1177 [15:45<37:10,  2.69s/it, exist=0.2356, loss=0.4866, lr=1.57e-05]
Epoch 4/5:  30%|██▉       | 348/1177 [15:47<37:10,  2.69s/it, exist=0.2356, loss=0.4865, lr=1.57e-05]
Epoch 4/5:  30%|██▉       | 349/1177 [15:47<34:04,  2.47s/it, exist=0.2356, loss=0.4865, lr=1.57e-05]
Epoch 4/5:  30%|██▉       | 349/1177 [15:50<34:04,  2.47s/it, exist=0.2352, loss=0.4863, lr=1.57e-05]
Epoch 4/5:  30%|██▉       | 350/1177 [15:50<35:07,  2.55s/it, exist=0.2352, loss=0.4863, lr=1.57e-05]
Epoch 4/5:  30%|██▉       | 350/1177 [15:53<35:07,  2.55s/it, exist=0.2350, loss=0.4860, lr=1.57e-05]
Epoch 4/5:  30%|██▉       | 351/1177 [15:53<36:06,  2.62s/it, exist=0.2350, loss=0.4860, lr=1.57e-05]
Epoch 4/5:  30%|██▉       | 351/1177 [15:55<36:06,  2.62s/it, exist=0.2347, loss=0.4856, lr=1.56e-05]
Epoch 4/5:  30%|██▉       | 352/1177 [15:55<35:17,  2.57s/it, exist=0.2347, loss=0.4856, lr=1.56e-05]
Epoch 4/5:  30%|██▉       | 352/1177 [15:58<35:17,  2.57s/it, exist=0.2363, loss=0.4872, lr=1.56e-05]
Epoch 4/5:  30%|██▉       | 353/1177 [15:58<35:48,  2.61s/it, exist=0.2363, loss=0.4872, lr=1.56e-05]
Epoch 4/5:  30%|██▉       | 353/1177 [16:01<35:48,  2.61s/it, exist=0.2366, loss=0.4876, lr=1.56e-05]
Epoch 4/5:  30%|███       | 354/1177 [16:01<36:35,  2.67s/it, exist=0.2366, loss=0.4876, lr=1.56e-05]
Epoch 4/5:  30%|███       | 354/1177 [16:04<36:35,  2.67s/it, exist=0.2370, loss=0.4881, lr=1.56e-05]
Epoch 4/5:  30%|███       | 355/1177 [16:04<38:35,  2.82s/it, exist=0.2370, loss=0.4881, lr=1.56e-05]
Epoch 4/5:  30%|███       | 355/1177 [16:07<38:35,  2.82s/it, exist=0.2366, loss=0.4877, lr=1.56e-05]
Epoch 4/5:  30%|███       | 356/1177 [16:07<40:57,  2.99s/it, exist=0.2366, loss=0.4877, lr=1.56e-05]
Epoch 4/5:  30%|███       | 356/1177 [16:09<40:57,  2.99s/it, exist=0.2361, loss=0.4872, lr=1.56e-05]
Epoch 4/5:  30%|███       | 357/1177 [16:09<36:42,  2.69s/it, exist=0.2361, loss=0.4872, lr=1.56e-05]
Epoch 4/5:  30%|███       | 357/1177 [16:11<36:42,  2.69s/it, exist=0.2358, loss=0.4868, lr=1.56e-05]
Epoch 4/5:  30%|███       | 358/1177 [16:11<33:43,  2.47s/it, exist=0.2358, loss=0.4868, lr=1.56e-05]
Epoch 4/5:  30%|███       | 358/1177 [16:13<33:43,  2.47s/it, exist=0.2360, loss=0.4870, lr=1.56e-05]
Epoch 4/5:  31%|███       | 359/1177 [16:13<31:51,  2.34s/it, exist=0.2360, loss=0.4870, lr=1.56e-05]
Epoch 4/5:  31%|███       | 359/1177 [16:17<31:51,  2.34s/it, exist=0.2362, loss=0.4871, lr=1.55e-05]
Epoch 4/5:  31%|███       | 360/1177 [16:17<39:35,  2.91s/it, exist=0.2362, loss=0.4871, lr=1.55e-05]
Epoch 4/5:  31%|███       | 360/1177 [16:20<39:35,  2.91s/it, exist=0.2369, loss=0.4879, lr=1.55e-05]
Epoch 4/5:  31%|███       | 361/1177 [16:20<38:01,  2.80s/it, exist=0.2369, loss=0.4879, lr=1.55e-05]
Epoch 4/5:  31%|███       | 361/1177 [16:22<38:01,  2.80s/it, exist=0.2375, loss=0.4890, lr=1.55e-05]
Epoch 4/5:  31%|███       | 362/1177 [16:22<34:30,  2.54s/it, exist=0.2375, loss=0.4890, lr=1.55e-05]
Epoch 4/5:  31%|███       | 362/1177 [16:25<34:30,  2.54s/it, exist=0.2371, loss=0.4887, lr=1.55e-05]
Epoch 4/5:  31%|███       | 363/1177 [16:25<37:59,  2.80s/it, exist=0.2371, loss=0.4887, lr=1.55e-05]
Epoch 4/5:  31%|███       | 363/1177 [16:28<37:59,  2.80s/it, exist=0.2368, loss=0.4885, lr=1.55e-05]
Epoch 4/5:  31%|███       | 364/1177 [16:28<38:34,  2.85s/it, exist=0.2368, loss=0.4885, lr=1.55e-05]
Epoch 4/5:  31%|███       | 364/1177 [16:31<38:34,  2.85s/it, exist=0.2371, loss=0.4889, lr=1.55e-05]
Epoch 4/5:  31%|███       | 365/1177 [16:31<38:01,  2.81s/it, exist=0.2371, loss=0.4889, lr=1.55e-05]
Epoch 4/5:  31%|███       | 365/1177 [16:33<38:01,  2.81s/it, exist=0.2375, loss=0.4892, lr=1.55e-05]
Epoch 4/5:  31%|███       | 366/1177 [16:33<34:28,  2.55s/it, exist=0.2375, loss=0.4892, lr=1.55e-05]
Epoch 4/5:  31%|███       | 366/1177 [16:35<34:28,  2.55s/it, exist=0.2378, loss=0.4898, lr=1.54e-05]
Epoch 4/5:  31%|███       | 367/1177 [16:35<34:25,  2.55s/it, exist=0.2378, loss=0.4898, lr=1.54e-05]
Epoch 4/5:  31%|███       | 367/1177 [16:37<34:25,  2.55s/it, exist=0.2381, loss=0.4900, lr=1.54e-05]
Epoch 4/5:  31%|███▏      | 368/1177 [16:37<31:51,  2.36s/it, exist=0.2381, loss=0.4900, lr=1.54e-05]
Epoch 4/5:  31%|███▏      | 368/1177 [16:41<31:51,  2.36s/it, exist=0.2376, loss=0.4896, lr=1.54e-05]
Epoch 4/5:  31%|███▏      | 369/1177 [16:41<36:15,  2.69s/it, exist=0.2376, loss=0.4896, lr=1.54e-05]
Epoch 4/5:  31%|███▏      | 369/1177 [16:44<36:15,  2.69s/it, exist=0.2378, loss=0.4897, lr=1.54e-05]
Epoch 4/5:  31%|███▏      | 370/1177 [16:44<39:03,  2.90s/it, exist=0.2378, loss=0.4897, lr=1.54e-05]
Epoch 4/5:  31%|███▏      | 370/1177 [16:47<39:03,  2.90s/it, exist=0.2378, loss=0.4897, lr=1.54e-05]
Epoch 4/5:  32%|███▏      | 371/1177 [16:47<38:09,  2.84s/it, exist=0.2378, loss=0.4897, lr=1.54e-05]
Epoch 4/5:  32%|███▏      | 371/1177 [16:49<38:09,  2.84s/it, exist=0.2387, loss=0.4904, lr=1.54e-05]
Epoch 4/5:  32%|███▏      | 372/1177 [16:49<34:43,  2.59s/it, exist=0.2387, loss=0.4904, lr=1.54e-05]
Epoch 4/5:  32%|███▏      | 372/1177 [16:52<34:43,  2.59s/it, exist=0.2390, loss=0.4906, lr=1.54e-05]
Epoch 4/5:  32%|███▏      | 373/1177 [16:52<38:09,  2.85s/it, exist=0.2390, loss=0.4906, lr=1.54e-05]
Epoch 4/5:  32%|███▏      | 373/1177 [16:54<38:09,  2.85s/it, exist=0.2386, loss=0.4902, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 374/1177 [16:54<34:32,  2.58s/it, exist=0.2386, loss=0.4902, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 374/1177 [16:57<34:32,  2.58s/it, exist=0.2395, loss=0.4910, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 375/1177 [16:57<33:55,  2.54s/it, exist=0.2395, loss=0.4910, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 375/1177 [17:00<33:55,  2.54s/it, exist=0.2398, loss=0.4917, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 376/1177 [17:00<36:58,  2.77s/it, exist=0.2398, loss=0.4917, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 376/1177 [17:03<36:58,  2.77s/it, exist=0.2399, loss=0.4917, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 377/1177 [17:03<36:33,  2.74s/it, exist=0.2399, loss=0.4917, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 377/1177 [17:05<36:33,  2.74s/it, exist=0.2397, loss=0.4915, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 378/1177 [17:05<36:38,  2.75s/it, exist=0.2397, loss=0.4915, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 378/1177 [17:08<36:38,  2.75s/it, exist=0.2403, loss=0.4923, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 379/1177 [17:08<36:19,  2.73s/it, exist=0.2403, loss=0.4923, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 379/1177 [17:11<36:19,  2.73s/it, exist=0.2402, loss=0.4920, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 380/1177 [17:11<35:59,  2.71s/it, exist=0.2402, loss=0.4920, lr=1.53e-05]
Epoch 4/5:  32%|███▏      | 380/1177 [17:14<35:59,  2.71s/it, exist=0.2407, loss=0.4925, lr=1.52e-05]
Epoch 4/5:  32%|███▏      | 381/1177 [17:14<36:04,  2.72s/it, exist=0.2407, loss=0.4925, lr=1.52e-05]
Epoch 4/5:  32%|███▏      | 381/1177 [17:15<36:04,  2.72s/it, exist=0.2402, loss=0.4920, lr=1.52e-05]
Epoch 4/5:  32%|███▏      | 382/1177 [17:15<33:00,  2.49s/it, exist=0.2402, loss=0.4920, lr=1.52e-05]
Epoch 4/5:  32%|███▏      | 382/1177 [17:19<33:00,  2.49s/it, exist=0.2404, loss=0.4923, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 383/1177 [17:19<36:31,  2.76s/it, exist=0.2404, loss=0.4923, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 383/1177 [17:21<36:31,  2.76s/it, exist=0.2403, loss=0.4924, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 384/1177 [17:21<33:21,  2.52s/it, exist=0.2403, loss=0.4924, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 384/1177 [17:24<33:21,  2.52s/it, exist=0.2400, loss=0.4920, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 385/1177 [17:24<35:39,  2.70s/it, exist=0.2400, loss=0.4920, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 385/1177 [17:26<35:39,  2.70s/it, exist=0.2399, loss=0.4918, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 386/1177 [17:26<32:31,  2.47s/it, exist=0.2399, loss=0.4918, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 386/1177 [17:29<32:31,  2.47s/it, exist=0.2406, loss=0.4925, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 387/1177 [17:29<35:12,  2.67s/it, exist=0.2406, loss=0.4925, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 387/1177 [17:31<35:12,  2.67s/it, exist=0.2405, loss=0.4923, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 388/1177 [17:31<32:26,  2.47s/it, exist=0.2405, loss=0.4923, lr=1.52e-05]
Epoch 4/5:  33%|███▎      | 388/1177 [17:34<32:26,  2.47s/it, exist=0.2415, loss=0.4932, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 389/1177 [17:34<32:46,  2.50s/it, exist=0.2415, loss=0.4932, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 389/1177 [17:37<32:46,  2.50s/it, exist=0.2411, loss=0.4929, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 390/1177 [17:37<35:35,  2.71s/it, exist=0.2411, loss=0.4929, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 390/1177 [17:39<35:35,  2.71s/it, exist=0.2409, loss=0.4927, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 391/1177 [17:39<32:44,  2.50s/it, exist=0.2409, loss=0.4927, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 391/1177 [17:42<32:44,  2.50s/it, exist=0.2410, loss=0.4926, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 392/1177 [17:42<35:56,  2.75s/it, exist=0.2410, loss=0.4926, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 392/1177 [17:45<35:56,  2.75s/it, exist=0.2411, loss=0.4927, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 393/1177 [17:45<35:40,  2.73s/it, exist=0.2411, loss=0.4927, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 393/1177 [17:47<35:40,  2.73s/it, exist=0.2408, loss=0.4924, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 394/1177 [17:47<32:46,  2.51s/it, exist=0.2408, loss=0.4924, lr=1.51e-05]
Epoch 4/5:  33%|███▎      | 394/1177 [17:50<32:46,  2.51s/it, exist=0.2405, loss=0.4921, lr=1.51e-05]
Epoch 4/5:  34%|███▎      | 395/1177 [17:50<36:01,  2.76s/it, exist=0.2405, loss=0.4921, lr=1.51e-05]
Epoch 4/5:  34%|███▎      | 395/1177 [17:53<36:01,  2.76s/it, exist=0.2402, loss=0.4917, lr=1.50e-05]
Epoch 4/5:  34%|███▎      | 396/1177 [17:53<35:38,  2.74s/it, exist=0.2402, loss=0.4917, lr=1.50e-05]
Epoch 4/5:  34%|███▎      | 396/1177 [17:55<35:38,  2.74s/it, exist=0.2405, loss=0.4919, lr=1.50e-05]
Epoch 4/5:  34%|███▎      | 397/1177 [17:55<32:33,  2.51s/it, exist=0.2405, loss=0.4919, lr=1.50e-05]
Epoch 4/5:  34%|███▎      | 397/1177 [17:58<32:33,  2.51s/it, exist=0.2408, loss=0.4921, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 398/1177 [17:58<35:32,  2.74s/it, exist=0.2408, loss=0.4921, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 398/1177 [18:01<35:32,  2.74s/it, exist=0.2405, loss=0.4920, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 399/1177 [18:01<35:11,  2.71s/it, exist=0.2405, loss=0.4920, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 399/1177 [18:03<35:11,  2.71s/it, exist=0.2402, loss=0.4917, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 400/1177 [18:03<34:57,  2.70s/it, exist=0.2402, loss=0.4917, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 400/1177 [18:06<34:57,  2.70s/it, exist=0.2398, loss=0.4912, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 401/1177 [18:06<35:06,  2.71s/it, exist=0.2398, loss=0.4912, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 401/1177 [18:09<35:06,  2.71s/it, exist=0.2394, loss=0.4907, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 402/1177 [18:09<34:30,  2.67s/it, exist=0.2394, loss=0.4907, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 402/1177 [18:11<34:30,  2.67s/it, exist=0.2409, loss=0.4922, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 403/1177 [18:11<31:30,  2.44s/it, exist=0.2409, loss=0.4922, lr=1.50e-05]
Epoch 4/5:  34%|███▍      | 403/1177 [18:13<31:30,  2.44s/it, exist=0.2409, loss=0.4924, lr=1.49e-05]
Epoch 4/5:  34%|███▍      | 404/1177 [18:13<31:28,  2.44s/it, exist=0.2409, loss=0.4924, lr=1.49e-05]
Epoch 4/5:  34%|███▍      | 404/1177 [18:16<31:28,  2.44s/it, exist=0.2405, loss=0.4920, lr=1.49e-05]
Epoch 4/5:  34%|███▍      | 405/1177 [18:16<34:06,  2.65s/it, exist=0.2405, loss=0.4920, lr=1.49e-05]
Epoch 4/5:  34%|███▍      | 405/1177 [18:19<34:06,  2.65s/it, exist=0.2403, loss=0.4918, lr=1.49e-05]
Epoch 4/5:  34%|███▍      | 406/1177 [18:19<33:39,  2.62s/it, exist=0.2403, loss=0.4918, lr=1.49e-05]
Epoch 4/5:  34%|███▍      | 406/1177 [18:21<33:39,  2.62s/it, exist=0.2400, loss=0.4914, lr=1.49e-05]
Epoch 4/5:  35%|███▍      | 407/1177 [18:21<33:46,  2.63s/it, exist=0.2400, loss=0.4914, lr=1.49e-05]
Epoch 4/5:  35%|███▍      | 407/1177 [18:24<33:46,  2.63s/it, exist=0.2396, loss=0.4912, lr=1.49e-05]
Epoch 4/5:  35%|███▍      | 408/1177 [18:24<33:47,  2.64s/it, exist=0.2396, loss=0.4912, lr=1.49e-05]
Epoch 4/5:  35%|███▍      | 408/1177 [18:27<33:47,  2.64s/it, exist=0.2398, loss=0.4915, lr=1.49e-05]
Epoch 4/5:  35%|███▍      | 409/1177 [18:27<33:38,  2.63s/it, exist=0.2398, loss=0.4915, lr=1.49e-05]
Epoch 4/5:  35%|███▍      | 409/1177 [18:29<33:38,  2.63s/it, exist=0.2402, loss=0.4918, lr=1.49e-05]
Epoch 4/5:  35%|███▍      | 410/1177 [18:29<32:46,  2.56s/it, exist=0.2402, loss=0.4918, lr=1.49e-05]
Epoch 4/5:  35%|███▍      | 410/1177 [18:31<32:46,  2.56s/it, exist=0.2403, loss=0.4919, lr=1.48e-05]
Epoch 4/5:  35%|███▍      | 411/1177 [18:31<30:41,  2.40s/it, exist=0.2403, loss=0.4919, lr=1.48e-05]
Epoch 4/5:  35%|███▍      | 411/1177 [18:34<30:41,  2.40s/it, exist=0.2408, loss=0.4925, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 412/1177 [18:34<31:47,  2.49s/it, exist=0.2408, loss=0.4925, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 412/1177 [18:37<31:47,  2.49s/it, exist=0.2404, loss=0.4920, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 413/1177 [18:37<34:36,  2.72s/it, exist=0.2404, loss=0.4920, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 413/1177 [18:39<34:36,  2.72s/it, exist=0.2403, loss=0.4921, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 414/1177 [18:39<31:55,  2.51s/it, exist=0.2403, loss=0.4921, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 414/1177 [18:42<31:55,  2.51s/it, exist=0.2399, loss=0.4916, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 415/1177 [18:42<34:14,  2.70s/it, exist=0.2399, loss=0.4916, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 415/1177 [18:44<34:14,  2.70s/it, exist=0.2400, loss=0.4923, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 416/1177 [18:44<31:25,  2.48s/it, exist=0.2400, loss=0.4923, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 416/1177 [18:47<31:25,  2.48s/it, exist=0.2397, loss=0.4920, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 417/1177 [18:47<31:35,  2.49s/it, exist=0.2397, loss=0.4920, lr=1.48e-05]
Epoch 4/5:  35%|███▌      | 417/1177 [18:49<31:35,  2.49s/it, exist=0.2394, loss=0.4918, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 418/1177 [18:49<31:51,  2.52s/it, exist=0.2394, loss=0.4918, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 418/1177 [18:52<31:51,  2.52s/it, exist=0.2394, loss=0.4918, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 419/1177 [18:52<34:20,  2.72s/it, exist=0.2394, loss=0.4918, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 419/1177 [18:55<34:20,  2.72s/it, exist=0.2404, loss=0.4928, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 420/1177 [18:55<33:37,  2.67s/it, exist=0.2404, loss=0.4928, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 420/1177 [18:57<33:37,  2.67s/it, exist=0.2405, loss=0.4927, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 421/1177 [18:57<31:03,  2.46s/it, exist=0.2405, loss=0.4927, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 421/1177 [19:00<31:03,  2.46s/it, exist=0.2407, loss=0.4931, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 422/1177 [19:00<34:36,  2.75s/it, exist=0.2407, loss=0.4931, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 422/1177 [19:02<34:36,  2.75s/it, exist=0.2406, loss=0.4931, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 423/1177 [19:02<31:32,  2.51s/it, exist=0.2406, loss=0.4931, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 423/1177 [19:04<31:32,  2.51s/it, exist=0.2415, loss=0.4941, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 424/1177 [19:04<29:17,  2.33s/it, exist=0.2415, loss=0.4941, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 424/1177 [19:08<29:17,  2.33s/it, exist=0.2415, loss=0.4940, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 425/1177 [19:08<32:38,  2.60s/it, exist=0.2415, loss=0.4940, lr=1.47e-05]
Epoch 4/5:  36%|███▌      | 425/1177 [19:10<32:38,  2.60s/it, exist=0.2416, loss=0.4944, lr=1.46e-05]
Epoch 4/5:  36%|███▌      | 426/1177 [19:10<32:44,  2.62s/it, exist=0.2416, loss=0.4944, lr=1.46e-05]
Epoch 4/5:  36%|███▌      | 426/1177 [19:13<32:44,  2.62s/it, exist=0.2415, loss=0.4942, lr=1.46e-05]
Epoch 4/5:  36%|███▋      | 427/1177 [19:13<32:17,  2.58s/it, exist=0.2415, loss=0.4942, lr=1.46e-05]
Epoch 4/5:  36%|███▋      | 427/1177 [19:15<32:17,  2.58s/it, exist=0.2411, loss=0.4937, lr=1.46e-05]
Epoch 4/5:  36%|███▋      | 428/1177 [19:15<32:34,  2.61s/it, exist=0.2411, loss=0.4937, lr=1.46e-05]
Epoch 4/5:  36%|███▋      | 428/1177 [19:19<32:34,  2.61s/it, exist=0.2411, loss=0.4936, lr=1.46e-05]
Epoch 4/5:  36%|███▋      | 429/1177 [19:19<35:32,  2.85s/it, exist=0.2411, loss=0.4936, lr=1.46e-05]
Epoch 4/5:  36%|███▋      | 429/1177 [19:21<35:32,  2.85s/it, exist=0.2408, loss=0.4931, lr=1.46e-05]
Epoch 4/5:  37%|███▋      | 430/1177 [19:21<34:11,  2.75s/it, exist=0.2408, loss=0.4931, lr=1.46e-05]
Epoch 4/5:  37%|███▋      | 430/1177 [19:24<34:11,  2.75s/it, exist=0.2405, loss=0.4929, lr=1.46e-05]
Epoch 4/5:  37%|███▋      | 431/1177 [19:24<32:58,  2.65s/it, exist=0.2405, loss=0.4929, lr=1.46e-05]
Epoch 4/5:  37%|███▋      | 431/1177 [19:26<32:58,  2.65s/it, exist=0.2402, loss=0.4926, lr=1.46e-05]
Epoch 4/5:  37%|███▋      | 432/1177 [19:26<33:05,  2.66s/it, exist=0.2402, loss=0.4926, lr=1.46e-05]
Epoch 4/5:  37%|███▋      | 432/1177 [19:28<33:05,  2.66s/it, exist=0.2399, loss=0.4925, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 433/1177 [19:28<30:31,  2.46s/it, exist=0.2399, loss=0.4925, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 433/1177 [19:31<30:31,  2.46s/it, exist=0.2397, loss=0.4922, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 434/1177 [19:31<30:55,  2.50s/it, exist=0.2397, loss=0.4922, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 434/1177 [19:34<30:55,  2.50s/it, exist=0.2394, loss=0.4922, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 435/1177 [19:34<32:30,  2.63s/it, exist=0.2394, loss=0.4922, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 435/1177 [19:37<32:30,  2.63s/it, exist=0.2392, loss=0.4920, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 436/1177 [19:37<32:24,  2.62s/it, exist=0.2392, loss=0.4920, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 436/1177 [19:39<32:24,  2.62s/it, exist=0.2389, loss=0.4918, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 437/1177 [19:39<32:35,  2.64s/it, exist=0.2389, loss=0.4918, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 437/1177 [19:42<32:35,  2.64s/it, exist=0.2392, loss=0.4921, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 438/1177 [19:42<31:51,  2.59s/it, exist=0.2392, loss=0.4921, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 438/1177 [19:45<31:51,  2.59s/it, exist=0.2389, loss=0.4917, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 439/1177 [19:45<32:47,  2.67s/it, exist=0.2389, loss=0.4917, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 439/1177 [19:47<32:47,  2.67s/it, exist=0.2386, loss=0.4913, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 440/1177 [19:47<30:22,  2.47s/it, exist=0.2386, loss=0.4913, lr=1.45e-05]
Epoch 4/5:  37%|███▋      | 440/1177 [19:50<30:22,  2.47s/it, exist=0.2384, loss=0.4911, lr=1.44e-05]
Epoch 4/5:  37%|███▋      | 441/1177 [19:50<33:16,  2.71s/it, exist=0.2384, loss=0.4911, lr=1.44e-05]
Epoch 4/5:  37%|███▋      | 441/1177 [19:52<33:16,  2.71s/it, exist=0.2384, loss=0.4910, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 442/1177 [19:52<30:33,  2.49s/it, exist=0.2384, loss=0.4910, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 442/1177 [19:55<30:33,  2.49s/it, exist=0.2382, loss=0.4910, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 443/1177 [19:55<33:39,  2.75s/it, exist=0.2382, loss=0.4910, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 443/1177 [19:58<33:39,  2.75s/it, exist=0.2381, loss=0.4909, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 444/1177 [19:58<32:19,  2.65s/it, exist=0.2381, loss=0.4909, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 444/1177 [19:59<32:19,  2.65s/it, exist=0.2382, loss=0.4910, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 445/1177 [19:59<29:43,  2.44s/it, exist=0.2382, loss=0.4910, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 445/1177 [20:03<29:43,  2.44s/it, exist=0.2379, loss=0.4907, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 446/1177 [20:03<32:12,  2.64s/it, exist=0.2379, loss=0.4907, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 446/1177 [20:05<32:12,  2.64s/it, exist=0.2380, loss=0.4907, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 447/1177 [20:05<31:57,  2.63s/it, exist=0.2380, loss=0.4907, lr=1.44e-05]
Epoch 4/5:  38%|███▊      | 447/1177 [20:08<31:57,  2.63s/it, exist=0.2379, loss=0.4906, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 448/1177 [20:08<31:20,  2.58s/it, exist=0.2379, loss=0.4906, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 448/1177 [20:10<31:20,  2.58s/it, exist=0.2376, loss=0.4906, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 449/1177 [20:10<31:01,  2.56s/it, exist=0.2376, loss=0.4906, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 449/1177 [20:12<31:01,  2.56s/it, exist=0.2373, loss=0.4903, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 450/1177 [20:12<28:50,  2.38s/it, exist=0.2373, loss=0.4903, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 450/1177 [20:14<28:50,  2.38s/it, exist=0.2377, loss=0.4906, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 451/1177 [20:14<27:14,  2.25s/it, exist=0.2377, loss=0.4906, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 451/1177 [20:17<27:14,  2.25s/it, exist=0.2375, loss=0.4904, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 452/1177 [20:17<30:30,  2.52s/it, exist=0.2375, loss=0.4904, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 452/1177 [20:20<30:30,  2.52s/it, exist=0.2375, loss=0.4903, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 453/1177 [20:20<32:37,  2.70s/it, exist=0.2375, loss=0.4903, lr=1.43e-05]
Epoch 4/5:  38%|███▊      | 453/1177 [20:22<32:37,  2.70s/it, exist=0.2375, loss=0.4905, lr=1.43e-05]
Epoch 4/5:  39%|███▊      | 454/1177 [20:22<29:52,  2.48s/it, exist=0.2375, loss=0.4905, lr=1.43e-05]
Epoch 4/5:  39%|███▊      | 454/1177 [20:26<29:52,  2.48s/it, exist=0.2371, loss=0.4902, lr=1.42e-05]
Epoch 4/5:  39%|███▊      | 455/1177 [20:26<32:47,  2.73s/it, exist=0.2371, loss=0.4902, lr=1.42e-05]
Epoch 4/5:  39%|███▊      | 455/1177 [20:28<32:47,  2.73s/it, exist=0.2367, loss=0.4897, lr=1.42e-05]
Epoch 4/5:  39%|███▊      | 456/1177 [20:28<32:35,  2.71s/it, exist=0.2367, loss=0.4897, lr=1.42e-05]
Epoch 4/5:  39%|███▊      | 456/1177 [20:32<32:35,  2.71s/it, exist=0.2365, loss=0.4899, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 457/1177 [20:32<34:19,  2.86s/it, exist=0.2365, loss=0.4899, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 457/1177 [20:33<34:19,  2.86s/it, exist=0.2366, loss=0.4899, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 458/1177 [20:33<30:59,  2.59s/it, exist=0.2366, loss=0.4899, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 458/1177 [20:35<30:59,  2.59s/it, exist=0.2362, loss=0.4894, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 459/1177 [20:35<28:46,  2.41s/it, exist=0.2362, loss=0.4894, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 459/1177 [20:38<28:46,  2.41s/it, exist=0.2368, loss=0.4900, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 460/1177 [20:38<30:05,  2.52s/it, exist=0.2368, loss=0.4900, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 460/1177 [20:41<30:05,  2.52s/it, exist=0.2379, loss=0.4908, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 461/1177 [20:41<30:18,  2.54s/it, exist=0.2379, loss=0.4908, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 461/1177 [20:43<30:18,  2.54s/it, exist=0.2381, loss=0.4912, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 462/1177 [20:43<30:22,  2.55s/it, exist=0.2381, loss=0.4912, lr=1.42e-05]
Epoch 4/5:  39%|███▉      | 462/1177 [20:46<30:22,  2.55s/it, exist=0.2384, loss=0.4914, lr=1.41e-05]
Epoch 4/5:  39%|███▉      | 463/1177 [20:46<30:44,  2.58s/it, exist=0.2384, loss=0.4914, lr=1.41e-05]
Epoch 4/5:  39%|███▉      | 463/1177 [20:49<30:44,  2.58s/it, exist=0.2383, loss=0.4915, lr=1.41e-05]
Epoch 4/5:  39%|███▉      | 464/1177 [20:49<31:13,  2.63s/it, exist=0.2383, loss=0.4915, lr=1.41e-05]
Epoch 4/5:  39%|███▉      | 464/1177 [20:51<31:13,  2.63s/it, exist=0.2380, loss=0.4911, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 465/1177 [20:51<30:32,  2.57s/it, exist=0.2380, loss=0.4911, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 465/1177 [20:54<30:32,  2.57s/it, exist=0.2382, loss=0.4913, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 466/1177 [20:54<31:11,  2.63s/it, exist=0.2382, loss=0.4913, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 466/1177 [20:57<31:11,  2.63s/it, exist=0.2379, loss=0.4909, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 467/1177 [20:57<33:17,  2.81s/it, exist=0.2379, loss=0.4909, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 467/1177 [20:59<33:17,  2.81s/it, exist=0.2382, loss=0.4913, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 468/1177 [20:59<30:13,  2.56s/it, exist=0.2382, loss=0.4913, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 468/1177 [21:03<30:13,  2.56s/it, exist=0.2383, loss=0.4914, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 469/1177 [21:03<33:05,  2.80s/it, exist=0.2383, loss=0.4914, lr=1.41e-05]
Epoch 4/5:  40%|███▉      | 469/1177 [21:05<33:05,  2.80s/it, exist=0.2385, loss=0.4918, lr=1.40e-05]
Epoch 4/5:  40%|███▉      | 470/1177 [21:05<32:03,  2.72s/it, exist=0.2385, loss=0.4918, lr=1.40e-05]
Epoch 4/5:  40%|███▉      | 470/1177 [21:08<32:03,  2.72s/it, exist=0.2382, loss=0.4915, lr=1.40e-05]
Epoch 4/5:  40%|████      | 471/1177 [21:08<31:46,  2.70s/it, exist=0.2382, loss=0.4915, lr=1.40e-05]
Epoch 4/5:  40%|████      | 471/1177 [21:10<31:46,  2.70s/it, exist=0.2379, loss=0.4912, lr=1.40e-05]
Epoch 4/5:  40%|████      | 472/1177 [21:10<29:37,  2.52s/it, exist=0.2379, loss=0.4912, lr=1.40e-05]
Epoch 4/5:  40%|████      | 472/1177 [21:13<29:37,  2.52s/it, exist=0.2382, loss=0.4915, lr=1.40e-05]
Epoch 4/5:  40%|████      | 473/1177 [21:13<32:29,  2.77s/it, exist=0.2382, loss=0.4915, lr=1.40e-05]
Epoch 4/5:  40%|████      | 473/1177 [21:15<32:29,  2.77s/it, exist=0.2378, loss=0.4910, lr=1.40e-05]
Epoch 4/5:  40%|████      | 474/1177 [21:15<29:31,  2.52s/it, exist=0.2378, loss=0.4910, lr=1.40e-05]
Epoch 4/5:  40%|████      | 474/1177 [21:18<29:31,  2.52s/it, exist=0.2375, loss=0.4909, lr=1.40e-05]
Epoch 4/5:  40%|████      | 475/1177 [21:18<31:35,  2.70s/it, exist=0.2375, loss=0.4909, lr=1.40e-05]
Epoch 4/5:  40%|████      | 475/1177 [21:21<31:35,  2.70s/it, exist=0.2373, loss=0.4907, lr=1.40e-05]
Epoch 4/5:  40%|████      | 476/1177 [21:21<31:28,  2.69s/it, exist=0.2373, loss=0.4907, lr=1.40e-05]
Epoch 4/5:  40%|████      | 476/1177 [21:24<31:28,  2.69s/it, exist=0.2373, loss=0.4907, lr=1.40e-05]
Epoch 4/5:  41%|████      | 477/1177 [21:24<31:16,  2.68s/it, exist=0.2373, loss=0.4907, lr=1.40e-05]
Epoch 4/5:  41%|████      | 477/1177 [21:26<31:16,  2.68s/it, exist=0.2370, loss=0.4905, lr=1.39e-05]
Epoch 4/5:  41%|████      | 478/1177 [21:26<28:55,  2.48s/it, exist=0.2370, loss=0.4905, lr=1.39e-05]
Epoch 4/5:  41%|████      | 478/1177 [21:28<28:55,  2.48s/it, exist=0.2374, loss=0.4910, lr=1.39e-05]
Epoch 4/5:  41%|████      | 479/1177 [21:28<29:13,  2.51s/it, exist=0.2374, loss=0.4910, lr=1.39e-05]
Epoch 4/5:  41%|████      | 479/1177 [21:31<29:13,  2.51s/it, exist=0.2372, loss=0.4906, lr=1.39e-05]
Epoch 4/5:  41%|████      | 480/1177 [21:31<31:28,  2.71s/it, exist=0.2372, loss=0.4906, lr=1.39e-05]
Epoch 4/5:  41%|████      | 480/1177 [21:35<31:28,  2.71s/it, exist=0.2375, loss=0.4910, lr=1.39e-05]
Epoch 4/5:  41%|████      | 481/1177 [21:35<33:15,  2.87s/it, exist=0.2375, loss=0.4910, lr=1.39e-05]
Epoch 4/5:  41%|████      | 481/1177 [21:37<33:15,  2.87s/it, exist=0.2378, loss=0.4912, lr=1.39e-05]
Epoch 4/5:  41%|████      | 482/1177 [21:37<30:02,  2.59s/it, exist=0.2378, loss=0.4912, lr=1.39e-05]
Epoch 4/5:  41%|████      | 482/1177 [21:39<30:02,  2.59s/it, exist=0.2377, loss=0.4910, lr=1.39e-05]
Epoch 4/5:  41%|████      | 483/1177 [21:39<30:12,  2.61s/it, exist=0.2377, loss=0.4910, lr=1.39e-05]
Epoch 4/5:  41%|████      | 483/1177 [21:41<30:12,  2.61s/it, exist=0.2376, loss=0.4910, lr=1.39e-05]
Epoch 4/5:  41%|████      | 484/1177 [21:41<27:52,  2.41s/it, exist=0.2376, loss=0.4910, lr=1.39e-05]
Epoch 4/5:  41%|████      | 484/1177 [21:45<27:52,  2.41s/it, exist=0.2380, loss=0.4914, lr=1.38e-05]
Epoch 4/5:  41%|████      | 485/1177 [21:45<31:48,  2.76s/it, exist=0.2380, loss=0.4914, lr=1.38e-05]
Epoch 4/5:  41%|████      | 485/1177 [21:47<31:48,  2.76s/it, exist=0.2378, loss=0.4912, lr=1.38e-05]
Epoch 4/5:  41%|████▏     | 486/1177 [21:47<31:09,  2.71s/it, exist=0.2378, loss=0.4912, lr=1.38e-05]
Epoch 4/5:  41%|████▏     | 486/1177 [21:50<31:09,  2.71s/it, exist=0.2374, loss=0.4908, lr=1.38e-05]
Epoch 4/5:  41%|████▏     | 487/1177 [21:50<30:51,  2.68s/it, exist=0.2374, loss=0.4908, lr=1.38e-05]
Epoch 4/5:  41%|████▏     | 487/1177 [21:53<30:51,  2.68s/it, exist=0.2374, loss=0.4907, lr=1.38e-05]
Epoch 4/5:  41%|████▏     | 488/1177 [21:53<30:50,  2.69s/it, exist=0.2374, loss=0.4907, lr=1.38e-05]
Epoch 4/5:  41%|████▏     | 488/1177 [21:55<30:50,  2.69s/it, exist=0.2371, loss=0.4905, lr=1.38e-05]
Epoch 4/5:  42%|████▏     | 489/1177 [21:55<31:11,  2.72s/it, exist=0.2371, loss=0.4905, lr=1.38e-05]
Epoch 4/5:  42%|████▏     | 489/1177 [21:57<31:11,  2.72s/it, exist=0.2372, loss=0.4906, lr=1.38e-05]
Epoch 4/5:  42%|████▏     | 490/1177 [21:57<28:32,  2.49s/it, exist=0.2372, loss=0.4906, lr=1.38e-05]
Epoch 4/5:  42%|████▏     | 490/1177 [22:00<28:32,  2.49s/it, exist=0.2371, loss=0.4904, lr=1.38e-05]
Epoch 4/5:  42%|████▏     | 491/1177 [22:00<28:19,  2.48s/it, exist=0.2371, loss=0.4904, lr=1.38e-05]
Epoch 4/5:  42%|████▏     | 491/1177 [22:03<28:19,  2.48s/it, exist=0.2368, loss=0.4902, lr=1.38e-05]
Epoch 4/5:  42%|████▏     | 492/1177 [22:03<31:19,  2.74s/it, exist=0.2368, loss=0.4902, lr=1.38e-05]
Epoch 4/5:  42%|████▏     | 492/1177 [22:06<31:19,  2.74s/it, exist=0.2365, loss=0.4899, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 493/1177 [22:06<31:17,  2.74s/it, exist=0.2365, loss=0.4899, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 493/1177 [22:08<31:17,  2.74s/it, exist=0.2364, loss=0.4896, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 494/1177 [22:08<28:29,  2.50s/it, exist=0.2364, loss=0.4896, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 494/1177 [22:10<28:29,  2.50s/it, exist=0.2360, loss=0.4893, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 495/1177 [22:10<28:09,  2.48s/it, exist=0.2360, loss=0.4893, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 495/1177 [22:13<28:09,  2.48s/it, exist=0.2360, loss=0.4893, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 496/1177 [22:13<28:26,  2.51s/it, exist=0.2360, loss=0.4893, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 496/1177 [22:16<28:26,  2.51s/it, exist=0.2358, loss=0.4889, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 497/1177 [22:16<31:34,  2.79s/it, exist=0.2358, loss=0.4889, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 497/1177 [22:19<31:34,  2.79s/it, exist=0.2362, loss=0.4892, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 498/1177 [22:19<30:57,  2.73s/it, exist=0.2362, loss=0.4892, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 498/1177 [22:22<30:57,  2.73s/it, exist=0.2361, loss=0.4891, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 499/1177 [22:22<30:49,  2.73s/it, exist=0.2361, loss=0.4891, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 499/1177 [22:25<30:49,  2.73s/it, exist=0.2365, loss=0.4894, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 500/1177 [22:25<32:51,  2.91s/it, exist=0.2365, loss=0.4894, lr=1.37e-05]
Epoch 4/5:  42%|████▏     | 500/1177 [22:27<32:51,  2.91s/it, exist=0.2362, loss=0.4893, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 501/1177 [22:27<29:39,  2.63s/it, exist=0.2362, loss=0.4893, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 501/1177 [22:29<29:39,  2.63s/it, exist=0.2366, loss=0.4897, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 502/1177 [22:29<29:12,  2.60s/it, exist=0.2366, loss=0.4897, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 502/1177 [22:32<29:12,  2.60s/it, exist=0.2371, loss=0.4909, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 503/1177 [22:32<28:58,  2.58s/it, exist=0.2371, loss=0.4909, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 503/1177 [22:34<28:58,  2.58s/it, exist=0.2369, loss=0.4906, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 504/1177 [22:34<26:50,  2.39s/it, exist=0.2369, loss=0.4906, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 504/1177 [22:37<26:50,  2.39s/it, exist=0.2377, loss=0.4913, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 505/1177 [22:37<29:45,  2.66s/it, exist=0.2377, loss=0.4913, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 505/1177 [22:40<29:45,  2.66s/it, exist=0.2382, loss=0.4916, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 506/1177 [22:40<28:21,  2.54s/it, exist=0.2382, loss=0.4916, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 506/1177 [22:41<28:21,  2.54s/it, exist=0.2379, loss=0.4913, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 507/1177 [22:41<26:28,  2.37s/it, exist=0.2379, loss=0.4913, lr=1.36e-05]
Epoch 4/5:  43%|████▎     | 507/1177 [22:46<26:28,  2.37s/it, exist=0.2376, loss=0.4912, lr=1.35e-05]
Epoch 4/5:  43%|████▎     | 508/1177 [22:46<34:39,  3.11s/it, exist=0.2376, loss=0.4912, lr=1.35e-05]
Epoch 4/5:  43%|████▎     | 508/1177 [22:48<34:39,  3.11s/it, exist=0.2375, loss=0.4909, lr=1.35e-05]
Epoch 4/5:  43%|████▎     | 509/1177 [22:48<30:37,  2.75s/it, exist=0.2375, loss=0.4909, lr=1.35e-05]
Epoch 4/5:  43%|████▎     | 509/1177 [22:51<30:37,  2.75s/it, exist=0.2376, loss=0.4910, lr=1.35e-05]
Epoch 4/5:  43%|████▎     | 510/1177 [22:51<28:57,  2.60s/it, exist=0.2376, loss=0.4910, lr=1.35e-05]
Epoch 4/5:  43%|████▎     | 510/1177 [22:53<28:57,  2.60s/it, exist=0.2374, loss=0.4907, lr=1.35e-05]
Epoch 4/5:  43%|████▎     | 511/1177 [22:53<29:36,  2.67s/it, exist=0.2374, loss=0.4907, lr=1.35e-05]
Epoch 4/5:  43%|████▎     | 511/1177 [22:55<29:36,  2.67s/it, exist=0.2370, loss=0.4903, lr=1.35e-05]
Epoch 4/5:  44%|████▎     | 512/1177 [22:55<27:19,  2.46s/it, exist=0.2370, loss=0.4903, lr=1.35e-05]
Epoch 4/5:  44%|████▎     | 512/1177 [22:58<27:19,  2.46s/it, exist=0.2373, loss=0.4905, lr=1.35e-05]
Epoch 4/5:  44%|████▎     | 513/1177 [22:58<27:46,  2.51s/it, exist=0.2373, loss=0.4905, lr=1.35e-05]
Epoch 4/5:  44%|████▎     | 513/1177 [23:01<27:46,  2.51s/it, exist=0.2375, loss=0.4908, lr=1.35e-05]
Epoch 4/5:  44%|████▎     | 514/1177 [23:01<30:02,  2.72s/it, exist=0.2375, loss=0.4908, lr=1.35e-05]
Epoch 4/5:  44%|████▎     | 514/1177 [23:03<30:02,  2.72s/it, exist=0.2375, loss=0.4908, lr=1.35e-05]
Epoch 4/5:  44%|████▍     | 515/1177 [23:03<27:33,  2.50s/it, exist=0.2375, loss=0.4908, lr=1.35e-05]
Epoch 4/5:  44%|████▍     | 515/1177 [23:05<27:33,  2.50s/it, exist=0.2375, loss=0.4907, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 516/1177 [23:05<25:41,  2.33s/it, exist=0.2375, loss=0.4907, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 516/1177 [23:09<25:41,  2.33s/it, exist=0.2376, loss=0.4907, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 517/1177 [23:09<31:01,  2.82s/it, exist=0.2376, loss=0.4907, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 517/1177 [23:12<31:01,  2.82s/it, exist=0.2373, loss=0.4905, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 518/1177 [23:12<30:37,  2.79s/it, exist=0.2373, loss=0.4905, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 518/1177 [23:15<30:37,  2.79s/it, exist=0.2372, loss=0.4903, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 519/1177 [23:15<31:39,  2.89s/it, exist=0.2372, loss=0.4903, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 519/1177 [23:17<31:39,  2.89s/it, exist=0.2375, loss=0.4907, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 520/1177 [23:17<29:28,  2.69s/it, exist=0.2375, loss=0.4907, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 520/1177 [23:19<29:28,  2.69s/it, exist=0.2373, loss=0.4903, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 521/1177 [23:19<27:04,  2.48s/it, exist=0.2373, loss=0.4903, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 521/1177 [23:22<27:04,  2.48s/it, exist=0.2376, loss=0.4906, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 522/1177 [23:22<27:47,  2.55s/it, exist=0.2376, loss=0.4906, lr=1.34e-05]
Epoch 4/5:  44%|████▍     | 522/1177 [23:24<27:47,  2.55s/it, exist=0.2374, loss=0.4904, lr=1.33e-05]
Epoch 4/5:  44%|████▍     | 523/1177 [23:24<25:45,  2.36s/it, exist=0.2374, loss=0.4904, lr=1.33e-05]
Epoch 4/5:  44%|████▍     | 523/1177 [23:27<25:45,  2.36s/it, exist=0.2374, loss=0.4902, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 524/1177 [23:27<30:09,  2.77s/it, exist=0.2374, loss=0.4902, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 524/1177 [23:30<30:09,  2.77s/it, exist=0.2374, loss=0.4902, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 525/1177 [23:30<29:35,  2.72s/it, exist=0.2374, loss=0.4902, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 525/1177 [23:32<29:35,  2.72s/it, exist=0.2371, loss=0.4901, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 526/1177 [23:32<27:10,  2.50s/it, exist=0.2371, loss=0.4901, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 526/1177 [23:35<27:10,  2.50s/it, exist=0.2369, loss=0.4897, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 527/1177 [23:35<27:44,  2.56s/it, exist=0.2369, loss=0.4897, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 527/1177 [23:38<27:44,  2.56s/it, exist=0.2368, loss=0.4899, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 528/1177 [23:38<30:03,  2.78s/it, exist=0.2368, loss=0.4899, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 528/1177 [23:40<30:03,  2.78s/it, exist=0.2370, loss=0.4900, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 529/1177 [23:40<27:16,  2.53s/it, exist=0.2370, loss=0.4900, lr=1.33e-05]
Epoch 4/5:  45%|████▍     | 529/1177 [23:42<27:16,  2.53s/it, exist=0.2370, loss=0.4899, lr=1.33e-05]
Epoch 4/5:  45%|████▌     | 530/1177 [23:42<25:17,  2.35s/it, exist=0.2370, loss=0.4899, lr=1.33e-05]
Epoch 4/5:  45%|████▌     | 530/1177 [23:46<25:17,  2.35s/it, exist=0.2367, loss=0.4896, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 531/1177 [23:46<32:00,  2.97s/it, exist=0.2367, loss=0.4896, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 531/1177 [23:48<32:00,  2.97s/it, exist=0.2367, loss=0.4896, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 532/1177 [23:48<28:47,  2.68s/it, exist=0.2367, loss=0.4896, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 532/1177 [23:52<28:47,  2.68s/it, exist=0.2367, loss=0.4895, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 533/1177 [23:52<30:37,  2.85s/it, exist=0.2367, loss=0.4895, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 533/1177 [23:54<30:37,  2.85s/it, exist=0.2367, loss=0.4897, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 534/1177 [23:54<27:51,  2.60s/it, exist=0.2367, loss=0.4897, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 534/1177 [23:57<27:51,  2.60s/it, exist=0.2365, loss=0.4896, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 535/1177 [23:57<30:26,  2.84s/it, exist=0.2365, loss=0.4896, lr=1.32e-05]
Epoch 4/5:  45%|████▌     | 535/1177 [23:59<30:26,  2.84s/it, exist=0.2366, loss=0.4896, lr=1.32e-05]
Epoch 4/5:  46%|████▌     | 536/1177 [23:59<27:28,  2.57s/it, exist=0.2366, loss=0.4896, lr=1.32e-05]
Epoch 4/5:  46%|████▌     | 536/1177 [24:01<27:28,  2.57s/it, exist=0.2366, loss=0.4895, lr=1.32e-05]
Epoch 4/5:  46%|████▌     | 537/1177 [24:01<27:26,  2.57s/it, exist=0.2366, loss=0.4895, lr=1.32e-05]
Epoch 4/5:  46%|████▌     | 537/1177 [24:03<27:26,  2.57s/it, exist=0.2365, loss=0.4893, lr=1.32e-05]
Epoch 4/5:  46%|████▌     | 538/1177 [24:03<25:22,  2.38s/it, exist=0.2365, loss=0.4893, lr=1.32e-05]
Epoch 4/5:  46%|████▌     | 538/1177 [24:07<25:22,  2.38s/it, exist=0.2362, loss=0.4890, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 539/1177 [24:07<28:50,  2.71s/it, exist=0.2362, loss=0.4890, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 539/1177 [24:10<28:50,  2.71s/it, exist=0.2362, loss=0.4889, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 540/1177 [24:10<28:24,  2.68s/it, exist=0.2362, loss=0.4889, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 540/1177 [24:11<28:24,  2.68s/it, exist=0.2363, loss=0.4890, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 541/1177 [24:11<26:11,  2.47s/it, exist=0.2363, loss=0.4890, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 541/1177 [24:15<26:11,  2.47s/it, exist=0.2361, loss=0.4886, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 542/1177 [24:15<28:23,  2.68s/it, exist=0.2361, loss=0.4886, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 542/1177 [24:18<28:23,  2.68s/it, exist=0.2360, loss=0.4888, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 543/1177 [24:18<30:06,  2.85s/it, exist=0.2360, loss=0.4888, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 543/1177 [24:20<30:06,  2.85s/it, exist=0.2362, loss=0.4890, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 544/1177 [24:20<28:59,  2.75s/it, exist=0.2362, loss=0.4890, lr=1.31e-05]
Epoch 4/5:  46%|████▌     | 544/1177 [24:22<28:59,  2.75s/it, exist=0.2366, loss=0.4894, lr=1.31e-05]
Epoch 4/5:  46%|████▋     | 545/1177 [24:22<26:33,  2.52s/it, exist=0.2366, loss=0.4894, lr=1.31e-05]
Epoch 4/5:  46%|████▋     | 545/1177 [24:26<26:33,  2.52s/it, exist=0.2364, loss=0.4891, lr=1.30e-05]
Epoch 4/5:  46%|████▋     | 546/1177 [24:26<29:37,  2.82s/it, exist=0.2364, loss=0.4891, lr=1.30e-05]
Epoch 4/5:  46%|████▋     | 546/1177 [24:28<29:37,  2.82s/it, exist=0.2363, loss=0.4891, lr=1.30e-05]
Epoch 4/5:  46%|████▋     | 547/1177 [24:28<26:50,  2.56s/it, exist=0.2363, loss=0.4891, lr=1.30e-05]
Epoch 4/5:  46%|████▋     | 547/1177 [24:32<26:50,  2.56s/it, exist=0.2367, loss=0.4894, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 548/1177 [24:32<31:49,  3.04s/it, exist=0.2367, loss=0.4894, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 548/1177 [24:34<31:49,  3.04s/it, exist=0.2369, loss=0.4895, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 549/1177 [24:34<28:13,  2.70s/it, exist=0.2369, loss=0.4895, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 549/1177 [24:36<28:13,  2.70s/it, exist=0.2368, loss=0.4898, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 550/1177 [24:36<27:32,  2.63s/it, exist=0.2368, loss=0.4898, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 550/1177 [24:39<27:32,  2.63s/it, exist=0.2365, loss=0.4895, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 551/1177 [24:39<27:15,  2.61s/it, exist=0.2365, loss=0.4895, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 551/1177 [24:41<27:15,  2.61s/it, exist=0.2373, loss=0.4902, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 552/1177 [24:41<25:01,  2.40s/it, exist=0.2373, loss=0.4902, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 552/1177 [24:44<25:01,  2.40s/it, exist=0.2371, loss=0.4902, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 553/1177 [24:44<28:27,  2.74s/it, exist=0.2371, loss=0.4902, lr=1.30e-05]
Epoch 4/5:  47%|████▋     | 553/1177 [24:46<28:27,  2.74s/it, exist=0.2372, loss=0.4903, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 554/1177 [24:46<26:10,  2.52s/it, exist=0.2372, loss=0.4903, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 554/1177 [24:50<26:10,  2.52s/it, exist=0.2374, loss=0.4904, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 555/1177 [24:50<28:24,  2.74s/it, exist=0.2374, loss=0.4904, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 555/1177 [24:52<28:24,  2.74s/it, exist=0.2374, loss=0.4903, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 556/1177 [24:52<28:03,  2.71s/it, exist=0.2374, loss=0.4903, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 556/1177 [24:55<28:03,  2.71s/it, exist=0.2372, loss=0.4900, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 557/1177 [24:55<28:04,  2.72s/it, exist=0.2372, loss=0.4900, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 557/1177 [24:58<28:04,  2.72s/it, exist=0.2375, loss=0.4904, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 558/1177 [24:58<27:32,  2.67s/it, exist=0.2375, loss=0.4904, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 558/1177 [25:00<27:32,  2.67s/it, exist=0.2373, loss=0.4901, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 559/1177 [25:00<26:58,  2.62s/it, exist=0.2373, loss=0.4901, lr=1.29e-05]
Epoch 4/5:  47%|████▋     | 559/1177 [25:03<26:58,  2.62s/it, exist=0.2372, loss=0.4901, lr=1.29e-05]
Epoch 4/5:  48%|████▊     | 560/1177 [25:03<27:19,  2.66s/it, exist=0.2372, loss=0.4901, lr=1.29e-05]
Epoch 4/5:  48%|████▊     | 560/1177 [25:06<27:19,  2.66s/it, exist=0.2371, loss=0.4899, lr=1.29e-05]
Epoch 4/5:  48%|████▊     | 561/1177 [25:06<30:17,  2.95s/it, exist=0.2371, loss=0.4899, lr=1.29e-05]
Epoch 4/5:  48%|████▊     | 561/1177 [25:11<30:17,  2.95s/it, exist=0.2370, loss=0.4899, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 562/1177 [25:11<34:22,  3.35s/it, exist=0.2370, loss=0.4899, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 562/1177 [25:14<34:22,  3.35s/it, exist=0.2373, loss=0.4902, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 563/1177 [25:14<33:54,  3.31s/it, exist=0.2373, loss=0.4902, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 563/1177 [25:16<33:54,  3.31s/it, exist=0.2375, loss=0.4904, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 564/1177 [25:16<29:44,  2.91s/it, exist=0.2375, loss=0.4904, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 564/1177 [25:19<29:44,  2.91s/it, exist=0.2373, loss=0.4902, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 565/1177 [25:19<28:59,  2.84s/it, exist=0.2373, loss=0.4902, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 565/1177 [25:21<28:59,  2.84s/it, exist=0.2371, loss=0.4899, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 566/1177 [25:21<27:55,  2.74s/it, exist=0.2371, loss=0.4899, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 566/1177 [25:23<27:55,  2.74s/it, exist=0.2376, loss=0.4903, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 567/1177 [25:23<25:32,  2.51s/it, exist=0.2376, loss=0.4903, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 567/1177 [25:26<25:32,  2.51s/it, exist=0.2375, loss=0.4903, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 568/1177 [25:26<25:38,  2.53s/it, exist=0.2375, loss=0.4903, lr=1.28e-05]
Epoch 4/5:  48%|████▊     | 568/1177 [25:30<25:38,  2.53s/it, exist=0.2375, loss=0.4903, lr=1.27e-05]
Epoch 4/5:  48%|████▊     | 569/1177 [25:30<29:50,  2.94s/it, exist=0.2375, loss=0.4903, lr=1.27e-05]
Epoch 4/5:  48%|████▊     | 569/1177 [25:32<29:50,  2.94s/it, exist=0.2375, loss=0.4905, lr=1.27e-05]
Epoch 4/5:  48%|████▊     | 570/1177 [25:32<26:46,  2.65s/it, exist=0.2375, loss=0.4905, lr=1.27e-05]
Epoch 4/5:  48%|████▊     | 570/1177 [25:34<26:46,  2.65s/it, exist=0.2376, loss=0.4907, lr=1.27e-05]
Epoch 4/5:  49%|████▊     | 571/1177 [25:34<24:33,  2.43s/it, exist=0.2376, loss=0.4907, lr=1.27e-05]
Epoch 4/5:  49%|████▊     | 571/1177 [25:35<24:33,  2.43s/it, exist=0.2375, loss=0.4907, lr=1.27e-05]
Epoch 4/5:  49%|████▊     | 572/1177 [25:35<23:08,  2.30s/it, exist=0.2375, loss=0.4907, lr=1.27e-05]
Epoch 4/5:  49%|████▊     | 572/1177 [25:39<23:08,  2.30s/it, exist=0.2373, loss=0.4905, lr=1.27e-05]
Epoch 4/5:  49%|████▊     | 573/1177 [25:39<26:10,  2.60s/it, exist=0.2373, loss=0.4905, lr=1.27e-05]
Epoch 4/5:  49%|████▊     | 573/1177 [25:42<26:10,  2.60s/it, exist=0.2371, loss=0.4903, lr=1.27e-05]
Epoch 4/5:  49%|████▉     | 574/1177 [25:42<26:51,  2.67s/it, exist=0.2371, loss=0.4903, lr=1.27e-05]
Epoch 4/5:  49%|████▉     | 574/1177 [25:44<26:51,  2.67s/it, exist=0.2372, loss=0.4902, lr=1.27e-05]
Epoch 4/5:  49%|████▉     | 575/1177 [25:44<24:33,  2.45s/it, exist=0.2372, loss=0.4902, lr=1.27e-05]
Epoch 4/5:  49%|████▉     | 575/1177 [25:47<24:33,  2.45s/it, exist=0.2372, loss=0.4902, lr=1.27e-05]
Epoch 4/5:  49%|████▉     | 576/1177 [25:47<28:49,  2.88s/it, exist=0.2372, loss=0.4902, lr=1.27e-05]
Epoch 4/5:  49%|████▉     | 576/1177 [25:49<28:49,  2.88s/it, exist=0.2371, loss=0.4900, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 577/1177 [25:49<26:01,  2.60s/it, exist=0.2371, loss=0.4900, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 577/1177 [25:53<26:01,  2.60s/it, exist=0.2374, loss=0.4903, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 578/1177 [25:53<28:17,  2.83s/it, exist=0.2374, loss=0.4903, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 578/1177 [25:55<28:17,  2.83s/it, exist=0.2372, loss=0.4900, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 579/1177 [25:55<27:09,  2.72s/it, exist=0.2372, loss=0.4900, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 579/1177 [25:57<27:09,  2.72s/it, exist=0.2370, loss=0.4899, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 580/1177 [25:57<24:49,  2.50s/it, exist=0.2370, loss=0.4899, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 580/1177 [26:01<24:49,  2.50s/it, exist=0.2370, loss=0.4898, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 581/1177 [26:01<27:54,  2.81s/it, exist=0.2370, loss=0.4898, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 581/1177 [26:03<27:54,  2.81s/it, exist=0.2370, loss=0.4898, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 582/1177 [26:03<26:56,  2.72s/it, exist=0.2370, loss=0.4898, lr=1.26e-05]
Epoch 4/5:  49%|████▉     | 582/1177 [26:06<26:56,  2.72s/it, exist=0.2371, loss=0.4897, lr=1.26e-05]
Epoch 4/5:  50%|████▉     | 583/1177 [26:06<26:39,  2.69s/it, exist=0.2371, loss=0.4897, lr=1.26e-05]
Epoch 4/5:  50%|████▉     | 583/1177 [26:08<26:39,  2.69s/it, exist=0.2372, loss=0.4898, lr=1.26e-05]
Epoch 4/5:  50%|████▉     | 584/1177 [26:08<26:18,  2.66s/it, exist=0.2372, loss=0.4898, lr=1.26e-05]
Epoch 4/5:  50%|████▉     | 584/1177 [26:10<26:18,  2.66s/it, exist=0.2370, loss=0.4896, lr=1.25e-05]
Epoch 4/5:  50%|████▉     | 585/1177 [26:10<24:08,  2.45s/it, exist=0.2370, loss=0.4896, lr=1.25e-05]
Epoch 4/5:  50%|████▉     | 585/1177 [26:14<24:08,  2.45s/it, exist=0.2368, loss=0.4895, lr=1.25e-05]
Epoch 4/5:  50%|████▉     | 586/1177 [26:14<26:31,  2.69s/it, exist=0.2368, loss=0.4895, lr=1.25e-05]
Epoch 4/5:  50%|████▉     | 586/1177 [26:16<26:31,  2.69s/it, exist=0.2369, loss=0.4898, lr=1.25e-05]
Epoch 4/5:  50%|████▉     | 587/1177 [26:16<24:25,  2.48s/it, exist=0.2369, loss=0.4898, lr=1.25e-05]
Epoch 4/5:  50%|████▉     | 587/1177 [26:18<24:25,  2.48s/it, exist=0.2375, loss=0.4905, lr=1.25e-05]
Epoch 4/5:  50%|████▉     | 588/1177 [26:18<22:44,  2.32s/it, exist=0.2375, loss=0.4905, lr=1.25e-05]
Epoch 4/5:  50%|████▉     | 588/1177 [26:22<22:44,  2.32s/it, exist=0.2380, loss=0.4910, lr=1.25e-05]
Epoch 4/5:  50%|█████     | 589/1177 [26:22<27:23,  2.80s/it, exist=0.2380, loss=0.4910, lr=1.25e-05]
Epoch 4/5:  50%|█████     | 589/1177 [26:24<27:23,  2.80s/it, exist=0.2378, loss=0.4907, lr=1.25e-05]
Epoch 4/5:  50%|█████     | 590/1177 [26:24<25:06,  2.57s/it, exist=0.2378, loss=0.4907, lr=1.25e-05]
Epoch 4/5:  50%|█████     | 590/1177 [26:26<25:06,  2.57s/it, exist=0.2376, loss=0.4904, lr=1.25e-05]
Epoch 4/5:  50%|█████     | 591/1177 [26:26<24:24,  2.50s/it, exist=0.2376, loss=0.4904, lr=1.25e-05]
Epoch 4/5:  50%|█████     | 591/1177 [26:30<24:24,  2.50s/it, exist=0.2377, loss=0.4904, lr=1.25e-05]
Epoch 4/5:  50%|█████     | 592/1177 [26:30<28:30,  2.92s/it, exist=0.2377, loss=0.4904, lr=1.25e-05]
Epoch 4/5:  50%|█████     | 592/1177 [26:33<28:30,  2.92s/it, exist=0.2375, loss=0.4901, lr=1.24e-05]
Epoch 4/5:  50%|█████     | 593/1177 [26:33<27:47,  2.86s/it, exist=0.2375, loss=0.4901, lr=1.24e-05]
Epoch 4/5:  50%|█████     | 593/1177 [26:35<27:47,  2.86s/it, exist=0.2372, loss=0.4898, lr=1.24e-05]
Epoch 4/5:  50%|█████     | 594/1177 [26:35<27:11,  2.80s/it, exist=0.2372, loss=0.4898, lr=1.24e-05]
Epoch 4/5:  50%|█████     | 594/1177 [26:38<27:11,  2.80s/it, exist=0.2376, loss=0.4901, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 595/1177 [26:38<26:40,  2.75s/it, exist=0.2376, loss=0.4901, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 595/1177 [26:40<26:40,  2.75s/it, exist=0.2382, loss=0.4908, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 596/1177 [26:40<25:49,  2.67s/it, exist=0.2382, loss=0.4908, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 596/1177 [26:43<25:49,  2.67s/it, exist=0.2381, loss=0.4906, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 597/1177 [26:43<25:20,  2.62s/it, exist=0.2381, loss=0.4906, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 597/1177 [26:45<25:20,  2.62s/it, exist=0.2383, loss=0.4907, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 598/1177 [26:45<23:20,  2.42s/it, exist=0.2383, loss=0.4907, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 598/1177 [26:47<23:20,  2.42s/it, exist=0.2384, loss=0.4908, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 599/1177 [26:47<24:09,  2.51s/it, exist=0.2384, loss=0.4908, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 599/1177 [26:50<24:09,  2.51s/it, exist=0.2386, loss=0.4910, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 600/1177 [26:50<24:21,  2.53s/it, exist=0.2386, loss=0.4910, lr=1.24e-05]
Epoch 4/5:  51%|█████     | 600/1177 [26:53<24:21,  2.53s/it, exist=0.2384, loss=0.4907, lr=1.23e-05]
Epoch 4/5:  51%|█████     | 601/1177 [26:53<24:19,  2.53s/it, exist=0.2384, loss=0.4907, lr=1.23e-05]
Epoch 4/5:  51%|█████     | 601/1177 [26:55<24:19,  2.53s/it, exist=0.2381, loss=0.4905, lr=1.23e-05]
Epoch 4/5:  51%|█████     | 602/1177 [26:55<24:52,  2.60s/it, exist=0.2381, loss=0.4905, lr=1.23e-05]
Epoch 4/5:  51%|█████     | 602/1177 [26:59<24:52,  2.60s/it, exist=0.2385, loss=0.4908, lr=1.23e-05]
Epoch 4/5:  51%|█████     | 603/1177 [26:59<26:42,  2.79s/it, exist=0.2385, loss=0.4908, lr=1.23e-05]
Epoch 4/5:  51%|█████     | 603/1177 [27:01<26:42,  2.79s/it, exist=0.2383, loss=0.4906, lr=1.23e-05]
Epoch 4/5:  51%|█████▏    | 604/1177 [27:01<24:09,  2.53s/it, exist=0.2383, loss=0.4906, lr=1.23e-05]
Epoch 4/5:  51%|█████▏    | 604/1177 [27:04<24:09,  2.53s/it, exist=0.2381, loss=0.4905, lr=1.23e-05]
Epoch 4/5:  51%|█████▏    | 605/1177 [27:04<26:19,  2.76s/it, exist=0.2381, loss=0.4905, lr=1.23e-05]
Epoch 4/5:  51%|█████▏    | 605/1177 [27:06<26:19,  2.76s/it, exist=0.2385, loss=0.4907, lr=1.23e-05]
Epoch 4/5:  51%|█████▏    | 606/1177 [27:06<23:58,  2.52s/it, exist=0.2385, loss=0.4907, lr=1.23e-05]
Epoch 4/5:  51%|█████▏    | 606/1177 [27:08<23:58,  2.52s/it, exist=0.2384, loss=0.4906, lr=1.23e-05]
Epoch 4/5:  52%|█████▏    | 607/1177 [27:08<24:17,  2.56s/it, exist=0.2384, loss=0.4906, lr=1.23e-05]
Epoch 4/5:  52%|█████▏    | 607/1177 [27:10<24:17,  2.56s/it, exist=0.2383, loss=0.4904, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 608/1177 [27:10<22:36,  2.38s/it, exist=0.2383, loss=0.4904, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 608/1177 [27:14<22:36,  2.38s/it, exist=0.2381, loss=0.4902, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 609/1177 [27:14<25:31,  2.70s/it, exist=0.2381, loss=0.4902, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 609/1177 [27:16<25:31,  2.70s/it, exist=0.2382, loss=0.4902, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 610/1177 [27:16<25:02,  2.65s/it, exist=0.2382, loss=0.4902, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 610/1177 [27:19<25:02,  2.65s/it, exist=0.2380, loss=0.4899, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 611/1177 [27:19<24:46,  2.63s/it, exist=0.2380, loss=0.4899, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 611/1177 [27:22<24:46,  2.63s/it, exist=0.2381, loss=0.4900, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 612/1177 [27:22<26:21,  2.80s/it, exist=0.2381, loss=0.4900, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 612/1177 [27:25<26:21,  2.80s/it, exist=0.2385, loss=0.4905, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 613/1177 [27:25<26:05,  2.78s/it, exist=0.2385, loss=0.4905, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 613/1177 [27:28<26:05,  2.78s/it, exist=0.2382, loss=0.4901, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 614/1177 [27:28<25:52,  2.76s/it, exist=0.2382, loss=0.4901, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 614/1177 [27:30<25:52,  2.76s/it, exist=0.2382, loss=0.4900, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 615/1177 [27:30<25:40,  2.74s/it, exist=0.2382, loss=0.4900, lr=1.22e-05]
Epoch 4/5:  52%|█████▏    | 615/1177 [27:33<25:40,  2.74s/it, exist=0.2380, loss=0.4898, lr=1.21e-05]
Epoch 4/5:  52%|█████▏    | 616/1177 [27:33<24:52,  2.66s/it, exist=0.2380, loss=0.4898, lr=1.21e-05]
Epoch 4/5:  52%|█████▏    | 616/1177 [27:35<24:52,  2.66s/it, exist=0.2378, loss=0.4895, lr=1.21e-05]
Epoch 4/5:  52%|█████▏    | 617/1177 [27:35<24:48,  2.66s/it, exist=0.2378, loss=0.4895, lr=1.21e-05]
Epoch 4/5:  52%|█████▏    | 617/1177 [27:38<24:48,  2.66s/it, exist=0.2376, loss=0.4893, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 618/1177 [27:38<24:09,  2.59s/it, exist=0.2376, loss=0.4893, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 618/1177 [27:40<24:09,  2.59s/it, exist=0.2375, loss=0.4892, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 619/1177 [27:40<23:49,  2.56s/it, exist=0.2375, loss=0.4892, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 619/1177 [27:43<23:49,  2.56s/it, exist=0.2375, loss=0.4892, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 620/1177 [27:43<24:05,  2.59s/it, exist=0.2375, loss=0.4892, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 620/1177 [27:45<24:05,  2.59s/it, exist=0.2373, loss=0.4890, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 621/1177 [27:45<22:23,  2.42s/it, exist=0.2373, loss=0.4890, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 621/1177 [27:48<22:23,  2.42s/it, exist=0.2370, loss=0.4888, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 622/1177 [27:48<23:21,  2.53s/it, exist=0.2370, loss=0.4888, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 622/1177 [27:50<23:21,  2.53s/it, exist=0.2371, loss=0.4889, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 623/1177 [27:50<23:42,  2.57s/it, exist=0.2371, loss=0.4889, lr=1.21e-05]
Epoch 4/5:  53%|█████▎    | 623/1177 [27:52<23:42,  2.57s/it, exist=0.2369, loss=0.4889, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 624/1177 [27:52<22:06,  2.40s/it, exist=0.2369, loss=0.4889, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 624/1177 [27:57<22:06,  2.40s/it, exist=0.2366, loss=0.4886, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 625/1177 [27:57<27:51,  3.03s/it, exist=0.2366, loss=0.4886, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 625/1177 [27:59<27:51,  3.03s/it, exist=0.2363, loss=0.4883, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 626/1177 [27:59<24:57,  2.72s/it, exist=0.2363, loss=0.4883, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 626/1177 [28:01<24:57,  2.72s/it, exist=0.2360, loss=0.4880, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 627/1177 [28:01<22:51,  2.49s/it, exist=0.2360, loss=0.4880, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 627/1177 [28:04<22:51,  2.49s/it, exist=0.2360, loss=0.4880, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 628/1177 [28:04<23:16,  2.54s/it, exist=0.2360, loss=0.4880, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 628/1177 [28:06<23:16,  2.54s/it, exist=0.2365, loss=0.4883, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 629/1177 [28:06<21:34,  2.36s/it, exist=0.2365, loss=0.4883, lr=1.20e-05]
Epoch 4/5:  53%|█████▎    | 629/1177 [28:09<21:34,  2.36s/it, exist=0.2363, loss=0.4881, lr=1.20e-05]
Epoch 4/5:  54%|█████▎    | 630/1177 [28:09<23:56,  2.63s/it, exist=0.2363, loss=0.4881, lr=1.20e-05]
Epoch 4/5:  54%|█████▎    | 630/1177 [28:12<23:56,  2.63s/it, exist=0.2361, loss=0.4879, lr=1.20e-05]
Epoch 4/5:  54%|█████▎    | 631/1177 [28:12<25:15,  2.77s/it, exist=0.2361, loss=0.4879, lr=1.20e-05]
Epoch 4/5:  54%|█████▎    | 631/1177 [28:14<25:15,  2.77s/it, exist=0.2358, loss=0.4878, lr=1.19e-05]
Epoch 4/5:  54%|█████▎    | 632/1177 [28:14<22:59,  2.53s/it, exist=0.2358, loss=0.4878, lr=1.19e-05]
Epoch 4/5:  54%|█████▎    | 632/1177 [28:17<22:59,  2.53s/it, exist=0.2357, loss=0.4878, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 633/1177 [28:17<25:04,  2.77s/it, exist=0.2357, loss=0.4878, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 633/1177 [28:20<25:04,  2.77s/it, exist=0.2357, loss=0.4877, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 634/1177 [28:20<24:08,  2.67s/it, exist=0.2357, loss=0.4877, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 634/1177 [28:22<24:08,  2.67s/it, exist=0.2357, loss=0.4877, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 635/1177 [28:22<22:13,  2.46s/it, exist=0.2357, loss=0.4877, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 635/1177 [28:24<22:13,  2.46s/it, exist=0.2359, loss=0.4880, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 636/1177 [28:24<22:33,  2.50s/it, exist=0.2359, loss=0.4880, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 636/1177 [28:27<22:33,  2.50s/it, exist=0.2359, loss=0.4880, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 637/1177 [28:27<23:00,  2.56s/it, exist=0.2359, loss=0.4880, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 637/1177 [28:30<23:00,  2.56s/it, exist=0.2358, loss=0.4884, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 638/1177 [28:30<23:27,  2.61s/it, exist=0.2358, loss=0.4884, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 638/1177 [28:32<23:27,  2.61s/it, exist=0.2360, loss=0.4887, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 639/1177 [28:32<21:42,  2.42s/it, exist=0.2360, loss=0.4887, lr=1.19e-05]
Epoch 4/5:  54%|█████▍    | 639/1177 [28:36<21:42,  2.42s/it, exist=0.2359, loss=0.4886, lr=1.18e-05]
Epoch 4/5:  54%|█████▍    | 640/1177 [28:36<26:04,  2.91s/it, exist=0.2359, loss=0.4886, lr=1.18e-05]
Epoch 4/5:  54%|█████▍    | 640/1177 [28:38<26:04,  2.91s/it, exist=0.2361, loss=0.4888, lr=1.18e-05]
Epoch 4/5:  54%|█████▍    | 641/1177 [28:38<25:15,  2.83s/it, exist=0.2361, loss=0.4888, lr=1.18e-05]
Epoch 4/5:  54%|█████▍    | 641/1177 [28:40<25:15,  2.83s/it, exist=0.2361, loss=0.4889, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 642/1177 [28:40<22:54,  2.57s/it, exist=0.2361, loss=0.4889, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 642/1177 [28:42<22:54,  2.57s/it, exist=0.2363, loss=0.4891, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 643/1177 [28:42<21:13,  2.39s/it, exist=0.2363, loss=0.4891, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 643/1177 [28:45<21:13,  2.39s/it, exist=0.2364, loss=0.4891, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 644/1177 [28:45<22:19,  2.51s/it, exist=0.2364, loss=0.4891, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 644/1177 [28:48<22:19,  2.51s/it, exist=0.2362, loss=0.4889, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 645/1177 [28:48<24:32,  2.77s/it, exist=0.2362, loss=0.4889, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 645/1177 [28:51<24:32,  2.77s/it, exist=0.2365, loss=0.4892, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 646/1177 [28:51<24:42,  2.79s/it, exist=0.2365, loss=0.4892, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 646/1177 [28:54<24:42,  2.79s/it, exist=0.2367, loss=0.4893, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 647/1177 [28:54<25:17,  2.86s/it, exist=0.2367, loss=0.4893, lr=1.18e-05]
Epoch 4/5:  55%|█████▍    | 647/1177 [28:57<25:17,  2.86s/it, exist=0.2365, loss=0.4892, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 648/1177 [28:57<24:50,  2.82s/it, exist=0.2365, loss=0.4892, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 648/1177 [29:00<24:50,  2.82s/it, exist=0.2363, loss=0.4890, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 649/1177 [29:00<24:33,  2.79s/it, exist=0.2363, loss=0.4890, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 649/1177 [29:02<24:33,  2.79s/it, exist=0.2361, loss=0.4888, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 650/1177 [29:02<24:00,  2.73s/it, exist=0.2361, loss=0.4888, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 650/1177 [29:05<24:00,  2.73s/it, exist=0.2359, loss=0.4886, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 651/1177 [29:05<23:20,  2.66s/it, exist=0.2359, loss=0.4886, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 651/1177 [29:07<23:20,  2.66s/it, exist=0.2356, loss=0.4883, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 652/1177 [29:07<21:32,  2.46s/it, exist=0.2356, loss=0.4883, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 652/1177 [29:10<21:32,  2.46s/it, exist=0.2355, loss=0.4883, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 653/1177 [29:10<23:39,  2.71s/it, exist=0.2355, loss=0.4883, lr=1.17e-05]
Epoch 4/5:  55%|█████▌    | 653/1177 [29:12<23:39,  2.71s/it, exist=0.2353, loss=0.4880, lr=1.17e-05]
Epoch 4/5:  56%|█████▌    | 654/1177 [29:12<22:54,  2.63s/it, exist=0.2353, loss=0.4880, lr=1.17e-05]
Epoch 4/5:  56%|█████▌    | 654/1177 [29:14<22:54,  2.63s/it, exist=0.2352, loss=0.4879, lr=1.17e-05]
Epoch 4/5:  56%|█████▌    | 655/1177 [29:14<21:08,  2.43s/it, exist=0.2352, loss=0.4879, lr=1.17e-05]
Epoch 4/5:  56%|█████▌    | 655/1177 [29:18<21:08,  2.43s/it, exist=0.2358, loss=0.4884, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 656/1177 [29:18<23:47,  2.74s/it, exist=0.2358, loss=0.4884, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 656/1177 [29:21<23:47,  2.74s/it, exist=0.2359, loss=0.4885, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 657/1177 [29:21<23:32,  2.72s/it, exist=0.2359, loss=0.4885, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 657/1177 [29:23<23:32,  2.72s/it, exist=0.2357, loss=0.4884, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 658/1177 [29:23<21:33,  2.49s/it, exist=0.2357, loss=0.4884, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 658/1177 [29:25<21:33,  2.49s/it, exist=0.2360, loss=0.4887, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 659/1177 [29:25<22:07,  2.56s/it, exist=0.2360, loss=0.4887, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 659/1177 [29:28<22:07,  2.56s/it, exist=0.2358, loss=0.4885, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 660/1177 [29:28<22:04,  2.56s/it, exist=0.2358, loss=0.4885, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 660/1177 [29:31<22:04,  2.56s/it, exist=0.2356, loss=0.4885, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 661/1177 [29:31<23:39,  2.75s/it, exist=0.2356, loss=0.4885, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 661/1177 [29:33<23:39,  2.75s/it, exist=0.2355, loss=0.4882, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 662/1177 [29:33<21:35,  2.52s/it, exist=0.2355, loss=0.4882, lr=1.16e-05]
Epoch 4/5:  56%|█████▌    | 662/1177 [29:36<21:35,  2.52s/it, exist=0.2354, loss=0.4882, lr=1.16e-05]
Epoch 4/5:  56%|█████▋    | 663/1177 [29:36<22:06,  2.58s/it, exist=0.2354, loss=0.4882, lr=1.16e-05]
Epoch 4/5:  56%|█████▋    | 663/1177 [29:39<22:06,  2.58s/it, exist=0.2354, loss=0.4881, lr=1.15e-05]
Epoch 4/5:  56%|█████▋    | 664/1177 [29:39<23:29,  2.75s/it, exist=0.2354, loss=0.4881, lr=1.15e-05]
Epoch 4/5:  56%|█████▋    | 664/1177 [29:41<23:29,  2.75s/it, exist=0.2354, loss=0.4880, lr=1.15e-05]
Epoch 4/5:  56%|█████▋    | 665/1177 [29:41<21:29,  2.52s/it, exist=0.2354, loss=0.4880, lr=1.15e-05]
Epoch 4/5:  56%|█████▋    | 665/1177 [29:43<21:29,  2.52s/it, exist=0.2352, loss=0.4877, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 666/1177 [29:43<21:35,  2.53s/it, exist=0.2352, loss=0.4877, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 666/1177 [29:47<21:35,  2.53s/it, exist=0.2350, loss=0.4876, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 667/1177 [29:47<23:41,  2.79s/it, exist=0.2350, loss=0.4876, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 667/1177 [29:49<23:41,  2.79s/it, exist=0.2352, loss=0.4878, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 668/1177 [29:49<21:32,  2.54s/it, exist=0.2352, loss=0.4878, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 668/1177 [29:52<21:32,  2.54s/it, exist=0.2353, loss=0.4878, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 669/1177 [29:52<23:36,  2.79s/it, exist=0.2353, loss=0.4878, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 669/1177 [29:54<23:36,  2.79s/it, exist=0.2354, loss=0.4878, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 670/1177 [29:54<21:30,  2.55s/it, exist=0.2354, loss=0.4878, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 670/1177 [29:57<21:30,  2.55s/it, exist=0.2355, loss=0.4879, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 671/1177 [29:57<22:02,  2.61s/it, exist=0.2355, loss=0.4879, lr=1.15e-05]
Epoch 4/5:  57%|█████▋    | 671/1177 [29:59<22:02,  2.61s/it, exist=0.2353, loss=0.4877, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 672/1177 [29:59<21:29,  2.55s/it, exist=0.2353, loss=0.4877, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 672/1177 [30:03<21:29,  2.55s/it, exist=0.2352, loss=0.4879, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 673/1177 [30:03<23:45,  2.83s/it, exist=0.2352, loss=0.4879, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 673/1177 [30:05<23:45,  2.83s/it, exist=0.2350, loss=0.4878, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 674/1177 [30:05<23:22,  2.79s/it, exist=0.2350, loss=0.4878, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 674/1177 [30:07<23:22,  2.79s/it, exist=0.2355, loss=0.4883, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 675/1177 [30:07<21:17,  2.55s/it, exist=0.2355, loss=0.4883, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 675/1177 [30:09<21:17,  2.55s/it, exist=0.2353, loss=0.4881, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 676/1177 [30:09<19:52,  2.38s/it, exist=0.2353, loss=0.4881, lr=1.14e-05]
Epoch 4/5:  57%|█████▋    | 676/1177 [30:12<19:52,  2.38s/it, exist=0.2353, loss=0.4881, lr=1.14e-05]
Epoch 4/5:  58%|█████▊    | 677/1177 [30:12<20:34,  2.47s/it, exist=0.2353, loss=0.4881, lr=1.14e-05]
Epoch 4/5:  58%|█████▊    | 677/1177 [30:15<20:34,  2.47s/it, exist=0.2356, loss=0.4885, lr=1.14e-05]
Epoch 4/5:  58%|█████▊    | 678/1177 [30:15<20:39,  2.48s/it, exist=0.2356, loss=0.4885, lr=1.14e-05]
Epoch 4/5:  58%|█████▊    | 678/1177 [30:19<20:39,  2.48s/it, exist=0.2353, loss=0.4882, lr=1.14e-05]
Epoch 4/5:  58%|█████▊    | 679/1177 [30:19<24:21,  2.93s/it, exist=0.2353, loss=0.4882, lr=1.14e-05]
Epoch 4/5:  58%|█████▊    | 679/1177 [30:21<24:21,  2.93s/it, exist=0.2354, loss=0.4886, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 680/1177 [30:21<21:57,  2.65s/it, exist=0.2354, loss=0.4886, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 680/1177 [30:24<21:57,  2.65s/it, exist=0.2355, loss=0.4886, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 681/1177 [30:24<24:54,  3.01s/it, exist=0.2355, loss=0.4886, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 681/1177 [30:26<24:54,  3.01s/it, exist=0.2359, loss=0.4892, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 682/1177 [30:26<22:11,  2.69s/it, exist=0.2359, loss=0.4892, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 682/1177 [30:28<22:11,  2.69s/it, exist=0.2360, loss=0.4893, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 683/1177 [30:28<20:17,  2.46s/it, exist=0.2360, loss=0.4893, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 683/1177 [30:32<20:17,  2.46s/it, exist=0.2360, loss=0.4892, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 684/1177 [30:32<22:21,  2.72s/it, exist=0.2360, loss=0.4892, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 684/1177 [30:34<22:21,  2.72s/it, exist=0.2365, loss=0.4898, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 685/1177 [30:34<21:54,  2.67s/it, exist=0.2365, loss=0.4898, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 685/1177 [30:37<21:54,  2.67s/it, exist=0.2368, loss=0.4900, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 686/1177 [30:37<21:46,  2.66s/it, exist=0.2368, loss=0.4900, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 686/1177 [30:40<21:46,  2.66s/it, exist=0.2365, loss=0.4898, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 687/1177 [30:40<21:50,  2.67s/it, exist=0.2365, loss=0.4898, lr=1.13e-05]
Epoch 4/5:  58%|█████▊    | 687/1177 [30:42<21:50,  2.67s/it, exist=0.2365, loss=0.4898, lr=1.12e-05]
Epoch 4/5:  58%|█████▊    | 688/1177 [30:42<20:10,  2.47s/it, exist=0.2365, loss=0.4898, lr=1.12e-05]
Epoch 4/5:  58%|█████▊    | 688/1177 [30:45<20:10,  2.47s/it, exist=0.2362, loss=0.4895, lr=1.12e-05]
Epoch 4/5:  59%|█████▊    | 689/1177 [30:45<22:05,  2.72s/it, exist=0.2362, loss=0.4895, lr=1.12e-05]
Epoch 4/5:  59%|█████▊    | 689/1177 [30:47<22:05,  2.72s/it, exist=0.2360, loss=0.4894, lr=1.12e-05]
Epoch 4/5:  59%|█████▊    | 690/1177 [30:47<20:12,  2.49s/it, exist=0.2360, loss=0.4894, lr=1.12e-05]
Epoch 4/5:  59%|█████▊    | 690/1177 [30:49<20:12,  2.49s/it, exist=0.2362, loss=0.4898, lr=1.12e-05]
Epoch 4/5:  59%|█████▊    | 691/1177 [30:49<20:34,  2.54s/it, exist=0.2362, loss=0.4898, lr=1.12e-05]
Epoch 4/5:  59%|█████▊    | 691/1177 [30:52<20:34,  2.54s/it, exist=0.2360, loss=0.4895, lr=1.12e-05]
Epoch 4/5:  59%|█████▉    | 692/1177 [30:52<20:48,  2.57s/it, exist=0.2360, loss=0.4895, lr=1.12e-05]
Epoch 4/5:  59%|█████▉    | 692/1177 [30:55<20:48,  2.57s/it, exist=0.2362, loss=0.4896, lr=1.12e-05]
Epoch 4/5:  59%|█████▉    | 693/1177 [30:55<22:27,  2.78s/it, exist=0.2362, loss=0.4896, lr=1.12e-05]
Epoch 4/5:  59%|█████▉    | 693/1177 [30:57<22:27,  2.78s/it, exist=0.2360, loss=0.4894, lr=1.12e-05]
Epoch 4/5:  59%|█████▉    | 694/1177 [30:57<20:23,  2.53s/it, exist=0.2360, loss=0.4894, lr=1.12e-05]
Epoch 4/5:  59%|█████▉    | 694/1177 [31:00<20:23,  2.53s/it, exist=0.2362, loss=0.4895, lr=1.12e-05]
Epoch 4/5:  59%|█████▉    | 695/1177 [31:00<20:48,  2.59s/it, exist=0.2362, loss=0.4895, lr=1.12e-05]
Epoch 4/5:  59%|█████▉    | 695/1177 [31:04<20:48,  2.59s/it, exist=0.2363, loss=0.4896, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 696/1177 [31:04<23:00,  2.87s/it, exist=0.2363, loss=0.4896, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 696/1177 [31:06<23:00,  2.87s/it, exist=0.2364, loss=0.4897, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 697/1177 [31:06<22:33,  2.82s/it, exist=0.2364, loss=0.4897, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 697/1177 [31:09<22:33,  2.82s/it, exist=0.2365, loss=0.4899, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 698/1177 [31:09<21:36,  2.71s/it, exist=0.2365, loss=0.4899, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 698/1177 [31:11<21:36,  2.71s/it, exist=0.2364, loss=0.4897, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 699/1177 [31:11<21:19,  2.68s/it, exist=0.2364, loss=0.4897, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 699/1177 [31:14<21:19,  2.68s/it, exist=0.2362, loss=0.4895, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 700/1177 [31:14<21:17,  2.68s/it, exist=0.2362, loss=0.4895, lr=1.11e-05]
Epoch 4/5:  59%|█████▉    | 700/1177 [31:16<21:17,  2.68s/it, exist=0.2364, loss=0.4897, lr=1.11e-05]
Epoch 4/5:  60%|█████▉    | 701/1177 [31:16<19:26,  2.45s/it, exist=0.2364, loss=0.4897, lr=1.11e-05]
Epoch 4/5:  60%|█████▉    | 701/1177 [31:18<19:26,  2.45s/it, exist=0.2363, loss=0.4896, lr=1.11e-05]
Epoch 4/5:  60%|█████▉    | 702/1177 [31:18<18:14,  2.30s/it, exist=0.2363, loss=0.4896, lr=1.11e-05]
Epoch 4/5:  60%|█████▉    | 702/1177 [31:22<18:14,  2.30s/it, exist=0.2366, loss=0.4899, lr=1.11e-05]
Epoch 4/5:  60%|█████▉    | 703/1177 [31:22<22:15,  2.82s/it, exist=0.2366, loss=0.4899, lr=1.11e-05]
Epoch 4/5:  60%|█████▉    | 703/1177 [31:24<22:15,  2.82s/it, exist=0.2367, loss=0.4899, lr=1.10e-05]
Epoch 4/5:  60%|█████▉    | 704/1177 [31:24<21:36,  2.74s/it, exist=0.2367, loss=0.4899, lr=1.10e-05]
Epoch 4/5:  60%|█████▉    | 704/1177 [31:28<21:36,  2.74s/it, exist=0.2364, loss=0.4900, lr=1.10e-05]
Epoch 4/5:  60%|█████▉    | 705/1177 [31:28<22:37,  2.88s/it, exist=0.2364, loss=0.4900, lr=1.10e-05]
Epoch 4/5:  60%|█████▉    | 705/1177 [31:30<22:37,  2.88s/it, exist=0.2364, loss=0.4899, lr=1.10e-05]
Epoch 4/5:  60%|█████▉    | 706/1177 [31:30<20:19,  2.59s/it, exist=0.2364, loss=0.4899, lr=1.10e-05]
Epoch 4/5:  60%|█████▉    | 706/1177 [31:32<20:19,  2.59s/it, exist=0.2366, loss=0.4901, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 707/1177 [31:32<19:57,  2.55s/it, exist=0.2366, loss=0.4901, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 707/1177 [31:34<19:57,  2.55s/it, exist=0.2368, loss=0.4903, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 708/1177 [31:34<18:24,  2.36s/it, exist=0.2368, loss=0.4903, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 708/1177 [31:37<18:24,  2.36s/it, exist=0.2365, loss=0.4900, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 709/1177 [31:37<19:10,  2.46s/it, exist=0.2365, loss=0.4900, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 709/1177 [31:39<19:10,  2.46s/it, exist=0.2364, loss=0.4899, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 710/1177 [31:39<19:21,  2.49s/it, exist=0.2364, loss=0.4899, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 710/1177 [31:42<19:21,  2.49s/it, exist=0.2364, loss=0.4899, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 711/1177 [31:42<19:40,  2.53s/it, exist=0.2364, loss=0.4899, lr=1.10e-05]
Epoch 4/5:  60%|██████    | 711/1177 [31:44<19:40,  2.53s/it, exist=0.2362, loss=0.4900, lr=1.09e-05]
Epoch 4/5:  60%|██████    | 712/1177 [31:44<19:23,  2.50s/it, exist=0.2362, loss=0.4900, lr=1.09e-05]
Epoch 4/5:  60%|██████    | 712/1177 [31:47<19:23,  2.50s/it, exist=0.2360, loss=0.4899, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 713/1177 [31:47<19:39,  2.54s/it, exist=0.2360, loss=0.4899, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 713/1177 [31:50<19:39,  2.54s/it, exist=0.2362, loss=0.4902, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 714/1177 [31:50<21:05,  2.73s/it, exist=0.2362, loss=0.4902, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 714/1177 [31:53<21:05,  2.73s/it, exist=0.2361, loss=0.4901, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 715/1177 [31:53<20:34,  2.67s/it, exist=0.2361, loss=0.4901, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 715/1177 [31:55<20:34,  2.67s/it, exist=0.2359, loss=0.4899, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 716/1177 [31:55<20:26,  2.66s/it, exist=0.2359, loss=0.4899, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 716/1177 [31:58<20:26,  2.66s/it, exist=0.2358, loss=0.4898, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 717/1177 [31:58<20:38,  2.69s/it, exist=0.2358, loss=0.4898, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 717/1177 [32:01<20:38,  2.69s/it, exist=0.2356, loss=0.4895, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 718/1177 [32:01<20:20,  2.66s/it, exist=0.2356, loss=0.4895, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 718/1177 [32:03<20:20,  2.66s/it, exist=0.2360, loss=0.4900, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 719/1177 [32:03<18:37,  2.44s/it, exist=0.2360, loss=0.4900, lr=1.09e-05]
Epoch 4/5:  61%|██████    | 719/1177 [32:05<18:37,  2.44s/it, exist=0.2362, loss=0.4901, lr=1.08e-05]
Epoch 4/5:  61%|██████    | 720/1177 [32:05<19:47,  2.60s/it, exist=0.2362, loss=0.4901, lr=1.08e-05]
Epoch 4/5:  61%|██████    | 720/1177 [32:08<19:47,  2.60s/it, exist=0.2364, loss=0.4903, lr=1.08e-05]
Epoch 4/5:  61%|██████▏   | 721/1177 [32:08<19:30,  2.57s/it, exist=0.2364, loss=0.4903, lr=1.08e-05]
Epoch 4/5:  61%|██████▏   | 721/1177 [32:11<19:30,  2.57s/it, exist=0.2366, loss=0.4904, lr=1.08e-05]
Epoch 4/5:  61%|██████▏   | 722/1177 [32:11<19:58,  2.63s/it, exist=0.2366, loss=0.4904, lr=1.08e-05]
Epoch 4/5:  61%|██████▏   | 722/1177 [32:13<19:58,  2.63s/it, exist=0.2368, loss=0.4907, lr=1.08e-05]
Epoch 4/5:  61%|██████▏   | 723/1177 [32:13<18:24,  2.43s/it, exist=0.2368, loss=0.4907, lr=1.08e-05]
Epoch 4/5:  61%|██████▏   | 723/1177 [32:16<18:24,  2.43s/it, exist=0.2369, loss=0.4908, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 724/1177 [32:16<19:51,  2.63s/it, exist=0.2369, loss=0.4908, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 724/1177 [32:18<19:51,  2.63s/it, exist=0.2368, loss=0.4909, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 725/1177 [32:18<18:17,  2.43s/it, exist=0.2368, loss=0.4909, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 725/1177 [32:21<18:17,  2.43s/it, exist=0.2366, loss=0.4907, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 726/1177 [32:21<18:57,  2.52s/it, exist=0.2366, loss=0.4907, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 726/1177 [32:24<18:57,  2.52s/it, exist=0.2368, loss=0.4912, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 727/1177 [32:24<20:42,  2.76s/it, exist=0.2368, loss=0.4912, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 727/1177 [32:26<20:42,  2.76s/it, exist=0.2374, loss=0.4918, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 728/1177 [32:26<18:52,  2.52s/it, exist=0.2374, loss=0.4918, lr=1.08e-05]
Epoch 4/5:  62%|██████▏   | 728/1177 [32:28<18:52,  2.52s/it, exist=0.2380, loss=0.4928, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 729/1177 [32:28<19:01,  2.55s/it, exist=0.2380, loss=0.4928, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 729/1177 [32:32<19:01,  2.55s/it, exist=0.2380, loss=0.4928, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 730/1177 [32:32<20:46,  2.79s/it, exist=0.2380, loss=0.4928, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 730/1177 [32:34<20:46,  2.79s/it, exist=0.2379, loss=0.4929, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 731/1177 [32:34<19:52,  2.67s/it, exist=0.2379, loss=0.4929, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 731/1177 [32:36<19:52,  2.67s/it, exist=0.2380, loss=0.4929, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 732/1177 [32:36<18:22,  2.48s/it, exist=0.2380, loss=0.4929, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 732/1177 [32:39<18:22,  2.48s/it, exist=0.2379, loss=0.4928, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 733/1177 [32:39<20:08,  2.72s/it, exist=0.2379, loss=0.4928, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 733/1177 [32:42<20:08,  2.72s/it, exist=0.2379, loss=0.4929, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 734/1177 [32:42<19:56,  2.70s/it, exist=0.2379, loss=0.4929, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 734/1177 [32:44<19:56,  2.70s/it, exist=0.2380, loss=0.4929, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 735/1177 [32:44<18:18,  2.48s/it, exist=0.2380, loss=0.4929, lr=1.07e-05]
Epoch 4/5:  62%|██████▏   | 735/1177 [32:47<18:18,  2.48s/it, exist=0.2377, loss=0.4928, lr=1.07e-05]
Epoch 4/5:  63%|██████▎   | 736/1177 [32:47<19:51,  2.70s/it, exist=0.2377, loss=0.4928, lr=1.07e-05]
Epoch 4/5:  63%|██████▎   | 736/1177 [32:49<19:51,  2.70s/it, exist=0.2379, loss=0.4929, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 737/1177 [32:49<18:18,  2.50s/it, exist=0.2379, loss=0.4929, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 737/1177 [32:52<18:18,  2.50s/it, exist=0.2377, loss=0.4927, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 738/1177 [32:52<18:50,  2.58s/it, exist=0.2377, loss=0.4927, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 738/1177 [32:55<18:50,  2.58s/it, exist=0.2375, loss=0.4924, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 739/1177 [32:55<20:22,  2.79s/it, exist=0.2375, loss=0.4924, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 739/1177 [32:57<20:22,  2.79s/it, exist=0.2374, loss=0.4922, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 740/1177 [32:57<18:33,  2.55s/it, exist=0.2374, loss=0.4922, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 740/1177 [33:00<18:33,  2.55s/it, exist=0.2376, loss=0.4925, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 741/1177 [33:00<18:49,  2.59s/it, exist=0.2376, loss=0.4925, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 741/1177 [33:03<18:49,  2.59s/it, exist=0.2376, loss=0.4926, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 742/1177 [33:03<20:12,  2.79s/it, exist=0.2376, loss=0.4926, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 742/1177 [33:05<20:12,  2.79s/it, exist=0.2377, loss=0.4926, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 743/1177 [33:05<18:16,  2.53s/it, exist=0.2377, loss=0.4926, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 743/1177 [33:08<18:16,  2.53s/it, exist=0.2378, loss=0.4926, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 744/1177 [33:08<18:27,  2.56s/it, exist=0.2378, loss=0.4926, lr=1.06e-05]
Epoch 4/5:  63%|██████▎   | 744/1177 [33:10<18:27,  2.56s/it, exist=0.2376, loss=0.4924, lr=1.05e-05]
Epoch 4/5:  63%|██████▎   | 745/1177 [33:10<17:11,  2.39s/it, exist=0.2376, loss=0.4924, lr=1.05e-05]
Epoch 4/5:  63%|██████▎   | 745/1177 [33:13<17:11,  2.39s/it, exist=0.2374, loss=0.4922, lr=1.05e-05]
Epoch 4/5:  63%|██████▎   | 746/1177 [33:13<19:03,  2.65s/it, exist=0.2374, loss=0.4922, lr=1.05e-05]
Epoch 4/5:  63%|██████▎   | 746/1177 [33:16<19:03,  2.65s/it, exist=0.2374, loss=0.4921, lr=1.05e-05]
Epoch 4/5:  63%|██████▎   | 747/1177 [33:16<19:06,  2.67s/it, exist=0.2374, loss=0.4921, lr=1.05e-05]
Epoch 4/5:  63%|██████▎   | 747/1177 [33:18<19:06,  2.67s/it, exist=0.2373, loss=0.4920, lr=1.05e-05]
Epoch 4/5:  64%|██████▎   | 748/1177 [33:18<18:43,  2.62s/it, exist=0.2373, loss=0.4920, lr=1.05e-05]
Epoch 4/5:  64%|██████▎   | 748/1177 [33:20<18:43,  2.62s/it, exist=0.2371, loss=0.4918, lr=1.05e-05]
Epoch 4/5:  64%|██████▎   | 749/1177 [33:20<17:19,  2.43s/it, exist=0.2371, loss=0.4918, lr=1.05e-05]
Epoch 4/5:  64%|██████▎   | 749/1177 [33:23<17:19,  2.43s/it, exist=0.2369, loss=0.4915, lr=1.05e-05]
Epoch 4/5:  64%|██████▎   | 750/1177 [33:23<17:52,  2.51s/it, exist=0.2369, loss=0.4915, lr=1.05e-05]
Epoch 4/5:  64%|██████▎   | 750/1177 [33:27<17:52,  2.51s/it, exist=0.2374, loss=0.4920, lr=1.05e-05]
Epoch 4/5:  64%|██████▍   | 751/1177 [33:27<21:07,  2.97s/it, exist=0.2374, loss=0.4920, lr=1.05e-05]
Epoch 4/5:  64%|██████▍   | 751/1177 [33:29<21:07,  2.97s/it, exist=0.2372, loss=0.4918, lr=1.05e-05]
Epoch 4/5:  64%|██████▍   | 752/1177 [33:29<19:01,  2.69s/it, exist=0.2372, loss=0.4918, lr=1.05e-05]
Epoch 4/5:  64%|██████▍   | 752/1177 [33:33<19:01,  2.69s/it, exist=0.2370, loss=0.4916, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 753/1177 [33:33<21:20,  3.02s/it, exist=0.2370, loss=0.4916, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 753/1177 [33:36<21:20,  3.02s/it, exist=0.2372, loss=0.4918, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 754/1177 [33:36<20:40,  2.93s/it, exist=0.2372, loss=0.4918, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 754/1177 [33:38<20:40,  2.93s/it, exist=0.2372, loss=0.4918, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 755/1177 [33:38<18:36,  2.65s/it, exist=0.2372, loss=0.4918, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 755/1177 [33:40<18:36,  2.65s/it, exist=0.2371, loss=0.4917, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 756/1177 [33:40<18:48,  2.68s/it, exist=0.2371, loss=0.4917, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 756/1177 [33:43<18:48,  2.68s/it, exist=0.2371, loss=0.4916, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 757/1177 [33:43<18:48,  2.69s/it, exist=0.2371, loss=0.4916, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 757/1177 [33:46<18:48,  2.69s/it, exist=0.2373, loss=0.4918, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 758/1177 [33:46<20:12,  2.89s/it, exist=0.2373, loss=0.4918, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 758/1177 [33:49<20:12,  2.89s/it, exist=0.2374, loss=0.4919, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 759/1177 [33:49<19:20,  2.78s/it, exist=0.2374, loss=0.4919, lr=1.04e-05]
Epoch 4/5:  64%|██████▍   | 759/1177 [33:51<19:20,  2.78s/it, exist=0.2379, loss=0.4925, lr=1.04e-05]
Epoch 4/5:  65%|██████▍   | 760/1177 [33:51<18:36,  2.68s/it, exist=0.2379, loss=0.4925, lr=1.04e-05]
Epoch 4/5:  65%|██████▍   | 760/1177 [33:54<18:36,  2.68s/it, exist=0.2378, loss=0.4924, lr=1.04e-05]
Epoch 4/5:  65%|██████▍   | 761/1177 [33:54<18:33,  2.68s/it, exist=0.2378, loss=0.4924, lr=1.04e-05]
Epoch 4/5:  65%|██████▍   | 761/1177 [33:57<18:33,  2.68s/it, exist=0.2379, loss=0.4925, lr=1.03e-05]
Epoch 4/5:  65%|██████▍   | 762/1177 [33:57<18:29,  2.67s/it, exist=0.2379, loss=0.4925, lr=1.03e-05]
Epoch 4/5:  65%|██████▍   | 762/1177 [33:59<18:29,  2.67s/it, exist=0.2377, loss=0.4923, lr=1.03e-05]
Epoch 4/5:  65%|██████▍   | 763/1177 [33:59<18:00,  2.61s/it, exist=0.2377, loss=0.4923, lr=1.03e-05]
Epoch 4/5:  65%|██████▍   | 763/1177 [34:01<18:00,  2.61s/it, exist=0.2376, loss=0.4921, lr=1.03e-05]
Epoch 4/5:  65%|██████▍   | 764/1177 [34:01<16:38,  2.42s/it, exist=0.2376, loss=0.4921, lr=1.03e-05]
Epoch 4/5:  65%|██████▍   | 764/1177 [34:04<16:38,  2.42s/it, exist=0.2375, loss=0.4920, lr=1.03e-05]
Epoch 4/5:  65%|██████▍   | 765/1177 [34:04<18:25,  2.68s/it, exist=0.2375, loss=0.4920, lr=1.03e-05]
Epoch 4/5:  65%|██████▍   | 765/1177 [34:06<18:25,  2.68s/it, exist=0.2375, loss=0.4920, lr=1.03e-05]
Epoch 4/5:  65%|██████▌   | 766/1177 [34:06<17:03,  2.49s/it, exist=0.2375, loss=0.4920, lr=1.03e-05]
Epoch 4/5:  65%|██████▌   | 766/1177 [34:09<17:03,  2.49s/it, exist=0.2373, loss=0.4919, lr=1.03e-05]
Epoch 4/5:  65%|██████▌   | 767/1177 [34:09<17:06,  2.50s/it, exist=0.2373, loss=0.4919, lr=1.03e-05]
Epoch 4/5:  65%|██████▌   | 767/1177 [34:12<17:06,  2.50s/it, exist=0.2372, loss=0.4917, lr=1.03e-05]
Epoch 4/5:  65%|██████▌   | 768/1177 [34:12<17:23,  2.55s/it, exist=0.2372, loss=0.4917, lr=1.03e-05]
Epoch 4/5:  65%|██████▌   | 768/1177 [34:15<17:23,  2.55s/it, exist=0.2373, loss=0.4917, lr=1.03e-05]
Epoch 4/5:  65%|██████▌   | 769/1177 [34:15<18:52,  2.78s/it, exist=0.2373, loss=0.4917, lr=1.03e-05]
Epoch 4/5:  65%|██████▌   | 769/1177 [34:18<18:52,  2.78s/it, exist=0.2373, loss=0.4919, lr=1.02e-05]
Epoch 4/5:  65%|██████▌   | 770/1177 [34:18<18:35,  2.74s/it, exist=0.2373, loss=0.4919, lr=1.02e-05]
Epoch 4/5:  65%|██████▌   | 770/1177 [34:20<18:35,  2.74s/it, exist=0.2373, loss=0.4918, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 771/1177 [34:20<18:23,  2.72s/it, exist=0.2373, loss=0.4918, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 771/1177 [34:22<18:23,  2.72s/it, exist=0.2374, loss=0.4921, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 772/1177 [34:22<16:48,  2.49s/it, exist=0.2374, loss=0.4921, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 772/1177 [34:25<16:48,  2.49s/it, exist=0.2377, loss=0.4923, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 773/1177 [34:25<16:57,  2.52s/it, exist=0.2377, loss=0.4923, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 773/1177 [34:27<16:57,  2.52s/it, exist=0.2378, loss=0.4924, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 774/1177 [34:27<17:06,  2.55s/it, exist=0.2378, loss=0.4924, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 774/1177 [34:30<17:06,  2.55s/it, exist=0.2377, loss=0.4928, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 775/1177 [34:30<17:14,  2.57s/it, exist=0.2377, loss=0.4928, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 775/1177 [34:33<17:14,  2.57s/it, exist=0.2376, loss=0.4927, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 776/1177 [34:33<17:13,  2.58s/it, exist=0.2376, loss=0.4927, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 776/1177 [34:36<17:13,  2.58s/it, exist=0.2377, loss=0.4928, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 777/1177 [34:36<18:45,  2.81s/it, exist=0.2377, loss=0.4928, lr=1.02e-05]
Epoch 4/5:  66%|██████▌   | 777/1177 [34:39<18:45,  2.81s/it, exist=0.2379, loss=0.4929, lr=1.01e-05]
Epoch 4/5:  66%|██████▌   | 778/1177 [34:39<18:44,  2.82s/it, exist=0.2379, loss=0.4929, lr=1.01e-05]
Epoch 4/5:  66%|██████▌   | 778/1177 [34:42<18:44,  2.82s/it, exist=0.2382, loss=0.4931, lr=1.01e-05]
Epoch 4/5:  66%|██████▌   | 779/1177 [34:42<18:21,  2.77s/it, exist=0.2382, loss=0.4931, lr=1.01e-05]
Epoch 4/5:  66%|██████▌   | 779/1177 [34:44<18:21,  2.77s/it, exist=0.2383, loss=0.4932, lr=1.01e-05]
Epoch 4/5:  66%|██████▋   | 780/1177 [34:44<18:03,  2.73s/it, exist=0.2383, loss=0.4932, lr=1.01e-05]
Epoch 4/5:  66%|██████▋   | 780/1177 [34:46<18:03,  2.73s/it, exist=0.2384, loss=0.4933, lr=1.01e-05]
Epoch 4/5:  66%|██████▋   | 781/1177 [34:46<16:26,  2.49s/it, exist=0.2384, loss=0.4933, lr=1.01e-05]
Epoch 4/5:  66%|██████▋   | 781/1177 [34:50<16:26,  2.49s/it, exist=0.2386, loss=0.4937, lr=1.01e-05]
Epoch 4/5:  66%|██████▋   | 782/1177 [34:50<18:26,  2.80s/it, exist=0.2386, loss=0.4937, lr=1.01e-05]
Epoch 4/5:  66%|██████▋   | 782/1177 [34:52<18:26,  2.80s/it, exist=0.2388, loss=0.4938, lr=1.01e-05]
Epoch 4/5:  67%|██████▋   | 783/1177 [34:52<16:38,  2.53s/it, exist=0.2388, loss=0.4938, lr=1.01e-05]
Epoch 4/5:  67%|██████▋   | 783/1177 [34:54<16:38,  2.53s/it, exist=0.2386, loss=0.4935, lr=1.01e-05]
Epoch 4/5:  67%|██████▋   | 784/1177 [34:54<15:37,  2.38s/it, exist=0.2386, loss=0.4935, lr=1.01e-05]
Epoch 4/5:  67%|██████▋   | 784/1177 [34:57<15:37,  2.38s/it, exist=0.2386, loss=0.4938, lr=1.01e-05]
Epoch 4/5:  67%|██████▋   | 785/1177 [34:57<17:18,  2.65s/it, exist=0.2386, loss=0.4938, lr=1.01e-05]
Epoch 4/5:  67%|██████▋   | 785/1177 [35:00<17:18,  2.65s/it, exist=0.2385, loss=0.4938, lr=1.01e-05]
Epoch 4/5:  67%|██████▋   | 786/1177 [35:00<18:47,  2.88s/it, exist=0.2385, loss=0.4938, lr=1.01e-05]
Epoch 4/5:  67%|██████▋   | 786/1177 [35:02<18:47,  2.88s/it, exist=0.2383, loss=0.4936, lr=1.00e-05]
Epoch 4/5:  67%|██████▋   | 787/1177 [35:02<16:57,  2.61s/it, exist=0.2383, loss=0.4936, lr=1.00e-05]
Epoch 4/5:  67%|██████▋   | 787/1177 [35:05<16:57,  2.61s/it, exist=0.2387, loss=0.4939, lr=1.00e-05]
Epoch 4/5:  67%|██████▋   | 788/1177 [35:05<16:59,  2.62s/it, exist=0.2387, loss=0.4939, lr=1.00e-05]
Epoch 4/5:  67%|██████▋   | 788/1177 [35:07<16:59,  2.62s/it, exist=0.2395, loss=0.4948, lr=1.00e-05]
Epoch 4/5:  67%|██████▋   | 789/1177 [35:07<15:37,  2.42s/it, exist=0.2395, loss=0.4948, lr=1.00e-05]
Epoch 4/5:  67%|██████▋   | 789/1177 [35:10<15:37,  2.42s/it, exist=0.2398, loss=0.4951, lr=1.00e-05]
Epoch 4/5:  67%|██████▋   | 790/1177 [35:10<17:14,  2.67s/it, exist=0.2398, loss=0.4951, lr=1.00e-05]
Epoch 4/5:  67%|██████▋   | 790/1177 [35:13<17:14,  2.67s/it, exist=0.2396, loss=0.4948, lr=9.99e-06]
Epoch 4/5:  67%|██████▋   | 791/1177 [35:13<17:34,  2.73s/it, exist=0.2396, loss=0.4948, lr=9.99e-06]
Epoch 4/5:  67%|██████▋   | 791/1177 [35:16<17:34,  2.73s/it, exist=0.2395, loss=0.4949, lr=9.98e-06]
Epoch 4/5:  67%|██████▋   | 792/1177 [35:16<17:28,  2.72s/it, exist=0.2395, loss=0.4949, lr=9.98e-06]
Epoch 4/5:  67%|██████▋   | 792/1177 [35:18<17:28,  2.72s/it, exist=0.2400, loss=0.4954, lr=9.97e-06]
Epoch 4/5:  67%|██████▋   | 793/1177 [35:18<17:12,  2.69s/it, exist=0.2400, loss=0.4954, lr=9.97e-06]
Epoch 4/5:  67%|██████▋   | 793/1177 [35:22<17:12,  2.69s/it, exist=0.2398, loss=0.4953, lr=9.96e-06]
Epoch 4/5:  67%|██████▋   | 794/1177 [35:22<18:15,  2.86s/it, exist=0.2398, loss=0.4953, lr=9.96e-06]
Epoch 4/5:  67%|██████▋   | 794/1177 [35:24<18:15,  2.86s/it, exist=0.2402, loss=0.4958, lr=9.95e-06]
Epoch 4/5:  68%|██████▊   | 795/1177 [35:24<17:40,  2.78s/it, exist=0.2402, loss=0.4958, lr=9.95e-06]
Epoch 4/5:  68%|██████▊   | 795/1177 [35:26<17:40,  2.78s/it, exist=0.2404, loss=0.4960, lr=9.93e-06]
Epoch 4/5:  68%|██████▊   | 796/1177 [35:26<16:06,  2.54s/it, exist=0.2404, loss=0.4960, lr=9.93e-06]
Epoch 4/5:  68%|██████▊   | 796/1177 [35:29<16:06,  2.54s/it, exist=0.2402, loss=0.4957, lr=9.92e-06]
Epoch 4/5:  68%|██████▊   | 797/1177 [35:29<17:34,  2.78s/it, exist=0.2402, loss=0.4957, lr=9.92e-06]
Epoch 4/5:  68%|██████▊   | 797/1177 [35:32<17:34,  2.78s/it, exist=0.2402, loss=0.4957, lr=9.91e-06]
Epoch 4/5:  68%|██████▊   | 798/1177 [35:32<17:02,  2.70s/it, exist=0.2402, loss=0.4957, lr=9.91e-06]
Epoch 4/5:  68%|██████▊   | 798/1177 [35:34<17:02,  2.70s/it, exist=0.2400, loss=0.4955, lr=9.90e-06]
Epoch 4/5:  68%|██████▊   | 799/1177 [35:34<15:39,  2.49s/it, exist=0.2400, loss=0.4955, lr=9.90e-06]
Epoch 4/5:  68%|██████▊   | 799/1177 [35:37<15:39,  2.49s/it, exist=0.2399, loss=0.4954, lr=9.89e-06]
Epoch 4/5:  68%|██████▊   | 800/1177 [35:37<16:57,  2.70s/it, exist=0.2399, loss=0.4954, lr=9.89e-06]
Epoch 4/5:  68%|██████▊   | 800/1177 [35:40<16:57,  2.70s/it, exist=0.2400, loss=0.4954, lr=9.88e-06]
Epoch 4/5:  68%|██████▊   | 801/1177 [35:40<16:51,  2.69s/it, exist=0.2400, loss=0.4954, lr=9.88e-06]
Epoch 4/5:  68%|██████▊   | 801/1177 [35:42<16:51,  2.69s/it, exist=0.2398, loss=0.4954, lr=9.86e-06]
Epoch 4/5:  68%|██████▊   | 802/1177 [35:42<15:26,  2.47s/it, exist=0.2398, loss=0.4954, lr=9.86e-06]
Epoch 4/5:  68%|██████▊   | 802/1177 [35:44<15:26,  2.47s/it, exist=0.2396, loss=0.4953, lr=9.85e-06]
Epoch 4/5:  68%|██████▊   | 803/1177 [35:44<14:37,  2.35s/it, exist=0.2396, loss=0.4953, lr=9.85e-06]
Epoch 4/5:  68%|██████▊   | 803/1177 [35:48<14:37,  2.35s/it, exist=0.2395, loss=0.4952, lr=9.84e-06]
Epoch 4/5:  68%|██████▊   | 804/1177 [35:48<17:57,  2.89s/it, exist=0.2395, loss=0.4952, lr=9.84e-06]
Epoch 4/5:  68%|██████▊   | 804/1177 [35:51<17:57,  2.89s/it, exist=0.2395, loss=0.4953, lr=9.83e-06]
Epoch 4/5:  68%|██████▊   | 805/1177 [35:51<18:23,  2.97s/it, exist=0.2395, loss=0.4953, lr=9.83e-06]
Epoch 4/5:  68%|██████▊   | 805/1177 [35:54<18:23,  2.97s/it, exist=0.2395, loss=0.4954, lr=9.82e-06]
Epoch 4/5:  68%|██████▊   | 806/1177 [35:54<17:23,  2.81s/it, exist=0.2395, loss=0.4954, lr=9.82e-06]
Epoch 4/5:  68%|██████▊   | 806/1177 [35:56<17:23,  2.81s/it, exist=0.2393, loss=0.4952, lr=9.80e-06]
Epoch 4/5:  69%|██████▊   | 807/1177 [35:56<15:49,  2.56s/it, exist=0.2393, loss=0.4952, lr=9.80e-06]
Epoch 4/5:  69%|██████▊   | 807/1177 [35:58<15:49,  2.56s/it, exist=0.2395, loss=0.4953, lr=9.79e-06]
Epoch 4/5:  69%|██████▊   | 808/1177 [35:58<15:41,  2.55s/it, exist=0.2395, loss=0.4953, lr=9.79e-06]
Epoch 4/5:  69%|██████▊   | 808/1177 [36:01<15:41,  2.55s/it, exist=0.2396, loss=0.4954, lr=9.78e-06]
Epoch 4/5:  69%|██████▊   | 809/1177 [36:01<15:34,  2.54s/it, exist=0.2396, loss=0.4954, lr=9.78e-06]
Epoch 4/5:  69%|██████▊   | 809/1177 [36:03<15:34,  2.54s/it, exist=0.2395, loss=0.4953, lr=9.77e-06]
Epoch 4/5:  69%|██████▉   | 810/1177 [36:03<14:26,  2.36s/it, exist=0.2395, loss=0.4953, lr=9.77e-06]
Epoch 4/5:  69%|██████▉   | 810/1177 [36:05<14:26,  2.36s/it, exist=0.2396, loss=0.4954, lr=9.76e-06]
Epoch 4/5:  69%|██████▉   | 811/1177 [36:05<13:42,  2.25s/it, exist=0.2396, loss=0.4954, lr=9.76e-06]
Epoch 4/5:  69%|██████▉   | 811/1177 [36:08<13:42,  2.25s/it, exist=0.2394, loss=0.4953, lr=9.75e-06]
Epoch 4/5:  69%|██████▉   | 812/1177 [36:08<16:38,  2.74s/it, exist=0.2394, loss=0.4953, lr=9.75e-06]
Epoch 4/5:  69%|██████▉   | 812/1177 [36:10<16:38,  2.74s/it, exist=0.2400, loss=0.4961, lr=9.73e-06]
Epoch 4/5:  69%|██████▉   | 813/1177 [36:10<15:09,  2.50s/it, exist=0.2400, loss=0.4961, lr=9.73e-06]
Epoch 4/5:  69%|██████▉   | 813/1177 [36:12<15:09,  2.50s/it, exist=0.2403, loss=0.4962, lr=9.72e-06]
Epoch 4/5:  69%|██████▉   | 814/1177 [36:12<14:09,  2.34s/it, exist=0.2403, loss=0.4962, lr=9.72e-06]
Epoch 4/5:  69%|██████▉   | 814/1177 [36:16<14:09,  2.34s/it, exist=0.2403, loss=0.4962, lr=9.71e-06]
Epoch 4/5:  69%|██████▉   | 815/1177 [36:16<16:01,  2.65s/it, exist=0.2403, loss=0.4962, lr=9.71e-06]
Epoch 4/5:  69%|██████▉   | 815/1177 [36:19<16:01,  2.65s/it, exist=0.2402, loss=0.4960, lr=9.70e-06]
Epoch 4/5:  69%|██████▉   | 816/1177 [36:19<17:00,  2.83s/it, exist=0.2402, loss=0.4960, lr=9.70e-06]
Epoch 4/5:  69%|██████▉   | 816/1177 [36:22<17:00,  2.83s/it, exist=0.2403, loss=0.4961, lr=9.69e-06]
Epoch 4/5:  69%|██████▉   | 817/1177 [36:22<17:50,  2.97s/it, exist=0.2403, loss=0.4961, lr=9.69e-06]
Epoch 4/5:  69%|██████▉   | 817/1177 [36:24<17:50,  2.97s/it, exist=0.2401, loss=0.4960, lr=9.68e-06]
Epoch 4/5:  69%|██████▉   | 818/1177 [36:24<16:01,  2.68s/it, exist=0.2401, loss=0.4960, lr=9.68e-06]
Epoch 4/5:  69%|██████▉   | 818/1177 [36:27<16:01,  2.68s/it, exist=0.2400, loss=0.4960, lr=9.66e-06]
Epoch 4/5:  70%|██████▉   | 819/1177 [36:27<15:50,  2.66s/it, exist=0.2400, loss=0.4960, lr=9.66e-06]
Epoch 4/5:  70%|██████▉   | 819/1177 [36:29<15:50,  2.66s/it, exist=0.2400, loss=0.4960, lr=9.65e-06]
Epoch 4/5:  70%|██████▉   | 820/1177 [36:29<15:43,  2.64s/it, exist=0.2400, loss=0.4960, lr=9.65e-06]
Epoch 4/5:  70%|██████▉   | 820/1177 [36:32<15:43,  2.64s/it, exist=0.2400, loss=0.4961, lr=9.64e-06]
Epoch 4/5:  70%|██████▉   | 821/1177 [36:32<15:36,  2.63s/it, exist=0.2400, loss=0.4961, lr=9.64e-06]
Epoch 4/5:  70%|██████▉   | 821/1177 [36:35<15:36,  2.63s/it, exist=0.2399, loss=0.4960, lr=9.63e-06]
Epoch 4/5:  70%|██████▉   | 822/1177 [36:35<15:17,  2.59s/it, exist=0.2399, loss=0.4960, lr=9.63e-06]
Epoch 4/5:  70%|██████▉   | 822/1177 [36:37<15:17,  2.59s/it, exist=0.2399, loss=0.4959, lr=9.62e-06]
Epoch 4/5:  70%|██████▉   | 823/1177 [36:37<15:10,  2.57s/it, exist=0.2399, loss=0.4959, lr=9.62e-06]
Epoch 4/5:  70%|██████▉   | 823/1177 [36:39<15:10,  2.57s/it, exist=0.2401, loss=0.4961, lr=9.61e-06]
Epoch 4/5:  70%|███████   | 824/1177 [36:39<14:00,  2.38s/it, exist=0.2401, loss=0.4961, lr=9.61e-06]
Epoch 4/5:  70%|███████   | 824/1177 [36:42<14:00,  2.38s/it, exist=0.2399, loss=0.4958, lr=9.59e-06]
Epoch 4/5:  70%|███████   | 825/1177 [36:42<15:14,  2.60s/it, exist=0.2399, loss=0.4958, lr=9.59e-06]
Epoch 4/5:  70%|███████   | 825/1177 [36:44<15:14,  2.60s/it, exist=0.2397, loss=0.4957, lr=9.58e-06]
Epoch 4/5:  70%|███████   | 826/1177 [36:44<14:03,  2.40s/it, exist=0.2397, loss=0.4957, lr=9.58e-06]
Epoch 4/5:  70%|███████   | 826/1177 [36:47<14:03,  2.40s/it, exist=0.2396, loss=0.4956, lr=9.57e-06]
Epoch 4/5:  70%|███████   | 827/1177 [36:47<14:30,  2.49s/it, exist=0.2396, loss=0.4956, lr=9.57e-06]
Epoch 4/5:  70%|███████   | 827/1177 [36:50<14:30,  2.49s/it, exist=0.2396, loss=0.4955, lr=9.56e-06]
Epoch 4/5:  70%|███████   | 828/1177 [36:50<15:36,  2.68s/it, exist=0.2396, loss=0.4955, lr=9.56e-06]
Epoch 4/5:  70%|███████   | 828/1177 [36:53<15:36,  2.68s/it, exist=0.2398, loss=0.4956, lr=9.55e-06]
Epoch 4/5:  70%|███████   | 829/1177 [36:53<15:28,  2.67s/it, exist=0.2398, loss=0.4956, lr=9.55e-06]
Epoch 4/5:  70%|███████   | 829/1177 [36:55<15:28,  2.67s/it, exist=0.2396, loss=0.4954, lr=9.54e-06]
Epoch 4/5:  71%|███████   | 830/1177 [36:55<15:31,  2.68s/it, exist=0.2396, loss=0.4954, lr=9.54e-06]
Epoch 4/5:  71%|███████   | 830/1177 [36:57<15:31,  2.68s/it, exist=0.2396, loss=0.4955, lr=9.52e-06]
Epoch 4/5:  71%|███████   | 831/1177 [36:57<14:08,  2.45s/it, exist=0.2396, loss=0.4955, lr=9.52e-06]
Epoch 4/5:  71%|███████   | 831/1177 [37:01<14:08,  2.45s/it, exist=0.2396, loss=0.4954, lr=9.51e-06]
Epoch 4/5:  71%|███████   | 832/1177 [37:01<15:39,  2.72s/it, exist=0.2396, loss=0.4954, lr=9.51e-06]
Epoch 4/5:  71%|███████   | 832/1177 [37:03<15:39,  2.72s/it, exist=0.2394, loss=0.4952, lr=9.50e-06]
Epoch 4/5:  71%|███████   | 833/1177 [37:03<15:31,  2.71s/it, exist=0.2394, loss=0.4952, lr=9.50e-06]
Epoch 4/5:  71%|███████   | 833/1177 [37:05<15:31,  2.71s/it, exist=0.2393, loss=0.4952, lr=9.49e-06]
Epoch 4/5:  71%|███████   | 834/1177 [37:05<14:09,  2.48s/it, exist=0.2393, loss=0.4952, lr=9.49e-06]
Epoch 4/5:  71%|███████   | 834/1177 [37:08<14:09,  2.48s/it, exist=0.2392, loss=0.4951, lr=9.48e-06]
Epoch 4/5:  71%|███████   | 835/1177 [37:08<14:34,  2.56s/it, exist=0.2392, loss=0.4951, lr=9.48e-06]
Epoch 4/5:  71%|███████   | 835/1177 [37:10<14:34,  2.56s/it, exist=0.2389, loss=0.4948, lr=9.47e-06]
Epoch 4/5:  71%|███████   | 836/1177 [37:10<14:28,  2.55s/it, exist=0.2389, loss=0.4948, lr=9.47e-06]
Epoch 4/5:  71%|███████   | 836/1177 [37:12<14:28,  2.55s/it, exist=0.2388, loss=0.4947, lr=9.45e-06]
Epoch 4/5:  71%|███████   | 837/1177 [37:12<13:26,  2.37s/it, exist=0.2388, loss=0.4947, lr=9.45e-06]
Epoch 4/5:  71%|███████   | 837/1177 [37:15<13:26,  2.37s/it, exist=0.2386, loss=0.4944, lr=9.44e-06]
Epoch 4/5:  71%|███████   | 838/1177 [37:15<13:45,  2.43s/it, exist=0.2386, loss=0.4944, lr=9.44e-06]
Epoch 4/5:  71%|███████   | 838/1177 [37:19<13:45,  2.43s/it, exist=0.2384, loss=0.4943, lr=9.43e-06]
Epoch 4/5:  71%|███████▏  | 839/1177 [37:19<16:03,  2.85s/it, exist=0.2384, loss=0.4943, lr=9.43e-06]
Epoch 4/5:  71%|███████▏  | 839/1177 [37:21<16:03,  2.85s/it, exist=0.2382, loss=0.4941, lr=9.42e-06]
Epoch 4/5:  71%|███████▏  | 840/1177 [37:21<14:32,  2.59s/it, exist=0.2382, loss=0.4941, lr=9.42e-06]
Epoch 4/5:  71%|███████▏  | 840/1177 [37:24<14:32,  2.59s/it, exist=0.2382, loss=0.4940, lr=9.41e-06]
Epoch 4/5:  71%|███████▏  | 841/1177 [37:24<15:25,  2.75s/it, exist=0.2382, loss=0.4940, lr=9.41e-06]
Epoch 4/5:  71%|███████▏  | 841/1177 [37:27<15:25,  2.75s/it, exist=0.2383, loss=0.4942, lr=9.40e-06]
Epoch 4/5:  72%|███████▏  | 842/1177 [37:27<15:11,  2.72s/it, exist=0.2383, loss=0.4942, lr=9.40e-06]
Epoch 4/5:  72%|███████▏  | 842/1177 [37:28<15:11,  2.72s/it, exist=0.2382, loss=0.4941, lr=9.38e-06]
Epoch 4/5:  72%|███████▏  | 843/1177 [37:28<13:54,  2.50s/it, exist=0.2382, loss=0.4941, lr=9.38e-06]
Epoch 4/5:  72%|███████▏  | 843/1177 [37:31<13:54,  2.50s/it, exist=0.2382, loss=0.4940, lr=9.37e-06]
Epoch 4/5:  72%|███████▏  | 844/1177 [37:31<14:06,  2.54s/it, exist=0.2382, loss=0.4940, lr=9.37e-06]
Epoch 4/5:  72%|███████▏  | 844/1177 [37:34<14:06,  2.54s/it, exist=0.2383, loss=0.4942, lr=9.36e-06]
Epoch 4/5:  72%|███████▏  | 845/1177 [37:34<15:10,  2.74s/it, exist=0.2383, loss=0.4942, lr=9.36e-06]
Epoch 4/5:  72%|███████▏  | 845/1177 [37:37<15:10,  2.74s/it, exist=0.2381, loss=0.4939, lr=9.35e-06]
Epoch 4/5:  72%|███████▏  | 846/1177 [37:37<14:55,  2.70s/it, exist=0.2381, loss=0.4939, lr=9.35e-06]
Epoch 4/5:  72%|███████▏  | 846/1177 [37:39<14:55,  2.70s/it, exist=0.2384, loss=0.4942, lr=9.34e-06]
Epoch 4/5:  72%|███████▏  | 847/1177 [37:39<14:25,  2.62s/it, exist=0.2384, loss=0.4942, lr=9.34e-06]
Epoch 4/5:  72%|███████▏  | 847/1177 [37:42<14:25,  2.62s/it, exist=0.2382, loss=0.4940, lr=9.33e-06]
Epoch 4/5:  72%|███████▏  | 848/1177 [37:42<14:20,  2.62s/it, exist=0.2382, loss=0.4940, lr=9.33e-06]
Epoch 4/5:  72%|███████▏  | 848/1177 [37:45<14:20,  2.62s/it, exist=0.2380, loss=0.4938, lr=9.32e-06]
Epoch 4/5:  72%|███████▏  | 849/1177 [37:45<14:26,  2.64s/it, exist=0.2380, loss=0.4938, lr=9.32e-06]
Epoch 4/5:  72%|███████▏  | 849/1177 [37:47<14:26,  2.64s/it, exist=0.2383, loss=0.4941, lr=9.30e-06]
Epoch 4/5:  72%|███████▏  | 850/1177 [37:47<14:25,  2.65s/it, exist=0.2383, loss=0.4941, lr=9.30e-06]
Epoch 4/5:  72%|███████▏  | 850/1177 [37:50<14:25,  2.65s/it, exist=0.2384, loss=0.4942, lr=9.29e-06]
Epoch 4/5:  72%|███████▏  | 851/1177 [37:50<14:02,  2.58s/it, exist=0.2384, loss=0.4942, lr=9.29e-06]
Epoch 4/5:  72%|███████▏  | 851/1177 [37:52<14:02,  2.58s/it, exist=0.2382, loss=0.4942, lr=9.28e-06]
Epoch 4/5:  72%|███████▏  | 852/1177 [37:52<13:49,  2.55s/it, exist=0.2382, loss=0.4942, lr=9.28e-06]
Epoch 4/5:  72%|███████▏  | 852/1177 [37:55<13:49,  2.55s/it, exist=0.2381, loss=0.4941, lr=9.27e-06]
Epoch 4/5:  72%|███████▏  | 853/1177 [37:55<13:53,  2.57s/it, exist=0.2381, loss=0.4941, lr=9.27e-06]
Epoch 4/5:  72%|███████▏  | 853/1177 [37:57<13:53,  2.57s/it, exist=0.2383, loss=0.4942, lr=9.26e-06]
Epoch 4/5:  73%|███████▎  | 854/1177 [37:57<12:53,  2.39s/it, exist=0.2383, loss=0.4942, lr=9.26e-06]
Epoch 4/5:  73%|███████▎  | 854/1177 [37:59<12:53,  2.39s/it, exist=0.2381, loss=0.4940, lr=9.25e-06]
Epoch 4/5:  73%|███████▎  | 855/1177 [37:59<12:11,  2.27s/it, exist=0.2381, loss=0.4940, lr=9.25e-06]
Epoch 4/5:  73%|███████▎  | 855/1177 [38:03<12:11,  2.27s/it, exist=0.2381, loss=0.4940, lr=9.23e-06]
Epoch 4/5:  73%|███████▎  | 856/1177 [38:03<14:37,  2.73s/it, exist=0.2381, loss=0.4940, lr=9.23e-06]
Epoch 4/5:  73%|███████▎  | 856/1177 [38:05<14:37,  2.73s/it, exist=0.2380, loss=0.4938, lr=9.22e-06]
Epoch 4/5:  73%|███████▎  | 857/1177 [38:05<14:22,  2.70s/it, exist=0.2380, loss=0.4938, lr=9.22e-06]
Epoch 4/5:  73%|███████▎  | 857/1177 [38:08<14:22,  2.70s/it, exist=0.2379, loss=0.4939, lr=9.21e-06]
Epoch 4/5:  73%|███████▎  | 858/1177 [38:08<14:04,  2.65s/it, exist=0.2379, loss=0.4939, lr=9.21e-06]
Epoch 4/5:  73%|███████▎  | 858/1177 [38:10<14:04,  2.65s/it, exist=0.2381, loss=0.4941, lr=9.20e-06]
Epoch 4/5:  73%|███████▎  | 859/1177 [38:10<13:55,  2.63s/it, exist=0.2381, loss=0.4941, lr=9.20e-06]
Epoch 4/5:  73%|███████▎  | 859/1177 [38:12<13:55,  2.63s/it, exist=0.2380, loss=0.4939, lr=9.19e-06]
Epoch 4/5:  73%|███████▎  | 860/1177 [38:12<12:48,  2.42s/it, exist=0.2380, loss=0.4939, lr=9.19e-06]
Epoch 4/5:  73%|███████▎  | 860/1177 [38:15<12:48,  2.42s/it, exist=0.2378, loss=0.4937, lr=9.18e-06]
Epoch 4/5:  73%|███████▎  | 861/1177 [38:15<12:51,  2.44s/it, exist=0.2378, loss=0.4937, lr=9.18e-06]
Epoch 4/5:  73%|███████▎  | 861/1177 [38:17<12:51,  2.44s/it, exist=0.2382, loss=0.4941, lr=9.17e-06]
Epoch 4/5:  73%|███████▎  | 862/1177 [38:17<12:19,  2.35s/it, exist=0.2382, loss=0.4941, lr=9.17e-06]
Epoch 4/5:  73%|███████▎  | 862/1177 [38:21<12:19,  2.35s/it, exist=0.2382, loss=0.4940, lr=9.15e-06]
Epoch 4/5:  73%|███████▎  | 863/1177 [38:21<14:55,  2.85s/it, exist=0.2382, loss=0.4940, lr=9.15e-06]
Epoch 4/5:  73%|███████▎  | 863/1177 [38:23<14:55,  2.85s/it, exist=0.2381, loss=0.4940, lr=9.14e-06]
Epoch 4/5:  73%|███████▎  | 864/1177 [38:23<13:31,  2.59s/it, exist=0.2381, loss=0.4940, lr=9.14e-06]
Epoch 4/5:  73%|███████▎  | 864/1177 [38:27<13:31,  2.59s/it, exist=0.2381, loss=0.4938, lr=9.13e-06]
Epoch 4/5:  73%|███████▎  | 865/1177 [38:27<15:23,  2.96s/it, exist=0.2381, loss=0.4938, lr=9.13e-06]
Epoch 4/5:  73%|███████▎  | 865/1177 [38:29<15:23,  2.96s/it, exist=0.2380, loss=0.4937, lr=9.12e-06]
Epoch 4/5:  74%|███████▎  | 866/1177 [38:29<13:49,  2.67s/it, exist=0.2380, loss=0.4937, lr=9.12e-06]
Epoch 4/5:  74%|███████▎  | 866/1177 [38:31<13:49,  2.67s/it, exist=0.2378, loss=0.4935, lr=9.11e-06]
Epoch 4/5:  74%|███████▎  | 867/1177 [38:31<12:42,  2.46s/it, exist=0.2378, loss=0.4935, lr=9.11e-06]
Epoch 4/5:  74%|███████▎  | 867/1177 [38:33<12:42,  2.46s/it, exist=0.2379, loss=0.4936, lr=9.10e-06]
Epoch 4/5:  74%|███████▎  | 868/1177 [38:33<11:54,  2.31s/it, exist=0.2379, loss=0.4936, lr=9.10e-06]
Epoch 4/5:  74%|███████▎  | 868/1177 [38:37<11:54,  2.31s/it, exist=0.2381, loss=0.4938, lr=9.09e-06]
Epoch 4/5:  74%|███████▍  | 869/1177 [38:37<14:18,  2.79s/it, exist=0.2381, loss=0.4938, lr=9.09e-06]
Epoch 4/5:  74%|███████▍  | 869/1177 [38:39<14:18,  2.79s/it, exist=0.2381, loss=0.4937, lr=9.07e-06]
Epoch 4/5:  74%|███████▍  | 870/1177 [38:39<12:58,  2.54s/it, exist=0.2381, loss=0.4937, lr=9.07e-06]
Epoch 4/5:  74%|███████▍  | 870/1177 [38:42<12:58,  2.54s/it, exist=0.2381, loss=0.4937, lr=9.06e-06]
Epoch 4/5:  74%|███████▍  | 871/1177 [38:42<14:01,  2.75s/it, exist=0.2381, loss=0.4937, lr=9.06e-06]
Epoch 4/5:  74%|███████▍  | 871/1177 [38:44<14:01,  2.75s/it, exist=0.2380, loss=0.4937, lr=9.05e-06]
Epoch 4/5:  74%|███████▍  | 872/1177 [38:44<12:49,  2.52s/it, exist=0.2380, loss=0.4937, lr=9.05e-06]
Epoch 4/5:  74%|███████▍  | 872/1177 [38:47<12:49,  2.52s/it, exist=0.2382, loss=0.4938, lr=9.04e-06]
Epoch 4/5:  74%|███████▍  | 873/1177 [38:47<13:58,  2.76s/it, exist=0.2382, loss=0.4938, lr=9.04e-06]
Epoch 4/5:  74%|███████▍  | 873/1177 [38:50<13:58,  2.76s/it, exist=0.2382, loss=0.4937, lr=9.03e-06]
Epoch 4/5:  74%|███████▍  | 874/1177 [38:50<13:46,  2.73s/it, exist=0.2382, loss=0.4937, lr=9.03e-06]
Epoch 4/5:  74%|███████▍  | 874/1177 [38:52<13:46,  2.73s/it, exist=0.2380, loss=0.4937, lr=9.02e-06]
Epoch 4/5:  74%|███████▍  | 875/1177 [38:52<13:18,  2.64s/it, exist=0.2380, loss=0.4937, lr=9.02e-06]
Epoch 4/5:  74%|███████▍  | 875/1177 [38:55<13:18,  2.64s/it, exist=0.2383, loss=0.4939, lr=9.01e-06]
Epoch 4/5:  74%|███████▍  | 876/1177 [38:55<13:11,  2.63s/it, exist=0.2383, loss=0.4939, lr=9.01e-06]
Epoch 4/5:  74%|███████▍  | 876/1177 [38:57<13:11,  2.63s/it, exist=0.2384, loss=0.4942, lr=8.99e-06]
Epoch 4/5:  75%|███████▍  | 877/1177 [38:57<12:10,  2.43s/it, exist=0.2384, loss=0.4942, lr=8.99e-06]
Epoch 4/5:  75%|███████▍  | 877/1177 [38:59<12:10,  2.43s/it, exist=0.2382, loss=0.4942, lr=8.98e-06]
Epoch 4/5:  75%|███████▍  | 878/1177 [38:59<12:17,  2.47s/it, exist=0.2382, loss=0.4942, lr=8.98e-06]
Epoch 4/5:  75%|███████▍  | 878/1177 [39:03<12:17,  2.47s/it, exist=0.2383, loss=0.4942, lr=8.97e-06]
Epoch 4/5:  75%|███████▍  | 879/1177 [39:03<13:27,  2.71s/it, exist=0.2383, loss=0.4942, lr=8.97e-06]
Epoch 4/5:  75%|███████▍  | 879/1177 [39:05<13:27,  2.71s/it, exist=0.2381, loss=0.4942, lr=8.96e-06]
Epoch 4/5:  75%|███████▍  | 880/1177 [39:05<13:04,  2.64s/it, exist=0.2381, loss=0.4942, lr=8.96e-06]
Epoch 4/5:  75%|███████▍  | 880/1177 [39:08<13:04,  2.64s/it, exist=0.2380, loss=0.4941, lr=8.95e-06]
Epoch 4/5:  75%|███████▍  | 881/1177 [39:08<13:05,  2.65s/it, exist=0.2380, loss=0.4941, lr=8.95e-06]
Epoch 4/5:  75%|███████▍  | 881/1177 [39:10<13:05,  2.65s/it, exist=0.2379, loss=0.4940, lr=8.94e-06]
Epoch 4/5:  75%|███████▍  | 882/1177 [39:10<12:00,  2.44s/it, exist=0.2379, loss=0.4940, lr=8.94e-06]
Epoch 4/5:  75%|███████▍  | 882/1177 [39:12<12:00,  2.44s/it, exist=0.2380, loss=0.4941, lr=8.93e-06]
Epoch 4/5:  75%|███████▌  | 883/1177 [39:12<11:19,  2.31s/it, exist=0.2380, loss=0.4941, lr=8.93e-06]
Epoch 4/5:  75%|███████▌  | 883/1177 [39:15<11:19,  2.31s/it, exist=0.2380, loss=0.4941, lr=8.91e-06]
Epoch 4/5:  75%|███████▌  | 884/1177 [39:15<12:49,  2.63s/it, exist=0.2380, loss=0.4941, lr=8.91e-06]
Epoch 4/5:  75%|███████▌  | 884/1177 [39:18<12:49,  2.63s/it, exist=0.2380, loss=0.4943, lr=8.90e-06]
Epoch 4/5:  75%|███████▌  | 885/1177 [39:18<13:43,  2.82s/it, exist=0.2380, loss=0.4943, lr=8.90e-06]
Epoch 4/5:  75%|███████▌  | 885/1177 [39:20<13:43,  2.82s/it, exist=0.2383, loss=0.4946, lr=8.89e-06]
Epoch 4/5:  75%|███████▌  | 886/1177 [39:20<12:20,  2.55s/it, exist=0.2383, loss=0.4946, lr=8.89e-06]
Epoch 4/5:  75%|███████▌  | 886/1177 [39:23<12:20,  2.55s/it, exist=0.2382, loss=0.4945, lr=8.88e-06]
Epoch 4/5:  75%|███████▌  | 887/1177 [39:23<12:30,  2.59s/it, exist=0.2382, loss=0.4945, lr=8.88e-06]
Epoch 4/5:  75%|███████▌  | 887/1177 [39:26<12:30,  2.59s/it, exist=0.2381, loss=0.4945, lr=8.87e-06]
Epoch 4/5:  75%|███████▌  | 888/1177 [39:26<13:45,  2.86s/it, exist=0.2381, loss=0.4945, lr=8.87e-06]
Epoch 4/5:  75%|███████▌  | 888/1177 [39:28<13:45,  2.86s/it, exist=0.2379, loss=0.4943, lr=8.86e-06]
Epoch 4/5:  76%|███████▌  | 889/1177 [39:28<12:24,  2.58s/it, exist=0.2379, loss=0.4943, lr=8.86e-06]
Epoch 4/5:  76%|███████▌  | 889/1177 [39:32<12:24,  2.58s/it, exist=0.2380, loss=0.4943, lr=8.85e-06]
Epoch 4/5:  76%|███████▌  | 890/1177 [39:32<13:23,  2.80s/it, exist=0.2380, loss=0.4943, lr=8.85e-06]
Epoch 4/5:  76%|███████▌  | 890/1177 [39:34<13:23,  2.80s/it, exist=0.2379, loss=0.4942, lr=8.84e-06]
Epoch 4/5:  76%|███████▌  | 891/1177 [39:34<13:10,  2.77s/it, exist=0.2379, loss=0.4942, lr=8.84e-06]
Epoch 4/5:  76%|███████▌  | 891/1177 [39:36<13:10,  2.77s/it, exist=0.2380, loss=0.4943, lr=8.82e-06]
Epoch 4/5:  76%|███████▌  | 892/1177 [39:36<12:00,  2.53s/it, exist=0.2380, loss=0.4943, lr=8.82e-06]
Epoch 4/5:  76%|███████▌  | 892/1177 [39:39<12:00,  2.53s/it, exist=0.2378, loss=0.4941, lr=8.81e-06]
Epoch 4/5:  76%|███████▌  | 893/1177 [39:39<12:05,  2.56s/it, exist=0.2378, loss=0.4941, lr=8.81e-06]
Epoch 4/5:  76%|███████▌  | 893/1177 [39:42<12:05,  2.56s/it, exist=0.2377, loss=0.4939, lr=8.80e-06]
Epoch 4/5:  76%|███████▌  | 894/1177 [39:42<13:08,  2.78s/it, exist=0.2377, loss=0.4939, lr=8.80e-06]
Epoch 4/5:  76%|███████▌  | 894/1177 [39:45<13:08,  2.78s/it, exist=0.2375, loss=0.4938, lr=8.79e-06]
Epoch 4/5:  76%|███████▌  | 895/1177 [39:45<12:44,  2.71s/it, exist=0.2375, loss=0.4938, lr=8.79e-06]
Epoch 4/5:  76%|███████▌  | 895/1177 [39:47<12:44,  2.71s/it, exist=0.2375, loss=0.4938, lr=8.78e-06]
Epoch 4/5:  76%|███████▌  | 896/1177 [39:47<11:47,  2.52s/it, exist=0.2375, loss=0.4938, lr=8.78e-06]
Epoch 4/5:  76%|███████▌  | 896/1177 [39:50<11:47,  2.52s/it, exist=0.2375, loss=0.4940, lr=8.77e-06]
Epoch 4/5:  76%|███████▌  | 897/1177 [39:50<12:46,  2.74s/it, exist=0.2375, loss=0.4940, lr=8.77e-06]
Epoch 4/5:  76%|███████▌  | 897/1177 [39:53<12:46,  2.74s/it, exist=0.2374, loss=0.4939, lr=8.76e-06]
Epoch 4/5:  76%|███████▋  | 898/1177 [39:53<12:19,  2.65s/it, exist=0.2374, loss=0.4939, lr=8.76e-06]
Epoch 4/5:  76%|███████▋  | 898/1177 [39:55<12:19,  2.65s/it, exist=0.2373, loss=0.4938, lr=8.74e-06]
Epoch 4/5:  76%|███████▋  | 899/1177 [39:55<11:21,  2.45s/it, exist=0.2373, loss=0.4938, lr=8.74e-06]
Epoch 4/5:  76%|███████▋  | 899/1177 [39:57<11:21,  2.45s/it, exist=0.2375, loss=0.4939, lr=8.73e-06]
Epoch 4/5:  76%|███████▋  | 900/1177 [39:57<10:42,  2.32s/it, exist=0.2375, loss=0.4939, lr=8.73e-06]
Epoch 4/5:  76%|███████▋  | 900/1177 [40:01<10:42,  2.32s/it, exist=0.2377, loss=0.4941, lr=8.72e-06]
Epoch 4/5:  77%|███████▋  | 901/1177 [40:01<13:12,  2.87s/it, exist=0.2377, loss=0.4941, lr=8.72e-06]
Epoch 4/5:  77%|███████▋  | 901/1177 [40:05<13:12,  2.87s/it, exist=0.2380, loss=0.4945, lr=8.71e-06]
Epoch 4/5:  77%|███████▋  | 902/1177 [40:05<14:22,  3.14s/it, exist=0.2380, loss=0.4945, lr=8.71e-06]
Epoch 4/5:  77%|███████▋  | 902/1177 [40:08<14:22,  3.14s/it, exist=0.2381, loss=0.4946, lr=8.70e-06]
Epoch 4/5:  77%|███████▋  | 903/1177 [40:08<15:09,  3.32s/it, exist=0.2381, loss=0.4946, lr=8.70e-06]
Epoch 4/5:  77%|███████▋  | 903/1177 [40:11<15:09,  3.32s/it, exist=0.2380, loss=0.4944, lr=8.69e-06]
Epoch 4/5:  77%|███████▋  | 904/1177 [40:11<14:16,  3.14s/it, exist=0.2380, loss=0.4944, lr=8.69e-06]
Epoch 4/5:  77%|███████▋  | 904/1177 [40:15<14:16,  3.14s/it, exist=0.2378, loss=0.4942, lr=8.68e-06]
Epoch 4/5:  77%|███████▋  | 905/1177 [40:15<15:41,  3.46s/it, exist=0.2378, loss=0.4942, lr=8.68e-06]
Epoch 4/5:  77%|███████▋  | 905/1177 [40:17<15:41,  3.46s/it, exist=0.2377, loss=0.4940, lr=8.67e-06]
Epoch 4/5:  77%|███████▋  | 906/1177 [40:17<13:38,  3.02s/it, exist=0.2377, loss=0.4940, lr=8.67e-06]
Epoch 4/5:  77%|███████▋  | 906/1177 [40:19<13:38,  3.02s/it, exist=0.2377, loss=0.4941, lr=8.65e-06]
Epoch 4/5:  77%|███████▋  | 907/1177 [40:19<12:10,  2.71s/it, exist=0.2377, loss=0.4941, lr=8.65e-06]
Epoch 4/5:  77%|███████▋  | 907/1177 [40:22<12:10,  2.71s/it, exist=0.2376, loss=0.4939, lr=8.64e-06]
Epoch 4/5:  77%|███████▋  | 908/1177 [40:22<12:42,  2.84s/it, exist=0.2376, loss=0.4939, lr=8.64e-06]
Epoch 4/5:  77%|███████▋  | 908/1177 [40:24<12:42,  2.84s/it, exist=0.2376, loss=0.4940, lr=8.63e-06]
Epoch 4/5:  77%|███████▋  | 909/1177 [40:24<11:31,  2.58s/it, exist=0.2376, loss=0.4940, lr=8.63e-06]
Epoch 4/5:  77%|███████▋  | 909/1177 [40:28<11:31,  2.58s/it, exist=0.2378, loss=0.4942, lr=8.62e-06]
Epoch 4/5:  77%|███████▋  | 910/1177 [40:28<12:29,  2.81s/it, exist=0.2378, loss=0.4942, lr=8.62e-06]
Epoch 4/5:  77%|███████▋  | 910/1177 [40:31<12:29,  2.81s/it, exist=0.2379, loss=0.4942, lr=8.61e-06]
Epoch 4/5:  77%|███████▋  | 911/1177 [40:31<12:44,  2.87s/it, exist=0.2379, loss=0.4942, lr=8.61e-06]
Epoch 4/5:  77%|███████▋  | 911/1177 [40:33<12:44,  2.87s/it, exist=0.2381, loss=0.4944, lr=8.60e-06]
Epoch 4/5:  77%|███████▋  | 912/1177 [40:33<12:23,  2.80s/it, exist=0.2381, loss=0.4944, lr=8.60e-06]
Epoch 4/5:  77%|███████▋  | 912/1177 [40:35<12:23,  2.80s/it, exist=0.2383, loss=0.4947, lr=8.59e-06]
Epoch 4/5:  78%|███████▊  | 913/1177 [40:35<11:13,  2.55s/it, exist=0.2383, loss=0.4947, lr=8.59e-06]
Epoch 4/5:  78%|███████▊  | 913/1177 [40:38<11:13,  2.55s/it, exist=0.2382, loss=0.4945, lr=8.58e-06]
Epoch 4/5:  78%|███████▊  | 914/1177 [40:38<11:01,  2.52s/it, exist=0.2382, loss=0.4945, lr=8.58e-06]
Epoch 4/5:  78%|███████▊  | 914/1177 [40:40<11:01,  2.52s/it, exist=0.2380, loss=0.4943, lr=8.57e-06]
Epoch 4/5:  78%|███████▊  | 915/1177 [40:40<11:05,  2.54s/it, exist=0.2380, loss=0.4943, lr=8.57e-06]
Epoch 4/5:  78%|███████▊  | 915/1177 [40:42<11:05,  2.54s/it, exist=0.2379, loss=0.4942, lr=8.55e-06]
Epoch 4/5:  78%|███████▊  | 916/1177 [40:42<10:21,  2.38s/it, exist=0.2379, loss=0.4942, lr=8.55e-06]
Epoch 4/5:  78%|███████▊  | 916/1177 [40:46<10:21,  2.38s/it, exist=0.2379, loss=0.4942, lr=8.54e-06]
Epoch 4/5:  78%|███████▊  | 917/1177 [40:46<11:52,  2.74s/it, exist=0.2379, loss=0.4942, lr=8.54e-06]
Epoch 4/5:  78%|███████▊  | 917/1177 [40:49<11:52,  2.74s/it, exist=0.2380, loss=0.4943, lr=8.53e-06]
Epoch 4/5:  78%|███████▊  | 918/1177 [40:49<12:06,  2.80s/it, exist=0.2380, loss=0.4943, lr=8.53e-06]
Epoch 4/5:  78%|███████▊  | 918/1177 [40:51<12:06,  2.80s/it, exist=0.2378, loss=0.4940, lr=8.52e-06]
Epoch 4/5:  78%|███████▊  | 919/1177 [40:51<10:58,  2.55s/it, exist=0.2378, loss=0.4940, lr=8.52e-06]
Epoch 4/5:  78%|███████▊  | 919/1177 [40:54<10:58,  2.55s/it, exist=0.2376, loss=0.4938, lr=8.51e-06]
Epoch 4/5:  78%|███████▊  | 920/1177 [40:54<11:51,  2.77s/it, exist=0.2376, loss=0.4938, lr=8.51e-06]
Epoch 4/5:  78%|███████▊  | 920/1177 [40:57<11:51,  2.77s/it, exist=0.2381, loss=0.4942, lr=8.50e-06]
Epoch 4/5:  78%|███████▊  | 921/1177 [40:57<11:38,  2.73s/it, exist=0.2381, loss=0.4942, lr=8.50e-06]
Epoch 4/5:  78%|███████▊  | 921/1177 [40:59<11:38,  2.73s/it, exist=0.2381, loss=0.4944, lr=8.49e-06]
Epoch 4/5:  78%|███████▊  | 922/1177 [40:59<11:32,  2.72s/it, exist=0.2381, loss=0.4944, lr=8.49e-06]
Epoch 4/5:  78%|███████▊  | 922/1177 [41:04<11:32,  2.72s/it, exist=0.2381, loss=0.4943, lr=8.48e-06]
Epoch 4/5:  78%|███████▊  | 923/1177 [41:04<13:33,  3.20s/it, exist=0.2381, loss=0.4943, lr=8.48e-06]
Epoch 4/5:  78%|███████▊  | 923/1177 [41:07<13:33,  3.20s/it, exist=0.2379, loss=0.4941, lr=8.47e-06]
Epoch 4/5:  79%|███████▊  | 924/1177 [41:07<13:03,  3.10s/it, exist=0.2379, loss=0.4941, lr=8.47e-06]
Epoch 4/5:  79%|███████▊  | 924/1177 [41:09<13:03,  3.10s/it, exist=0.2377, loss=0.4939, lr=8.45e-06]
Epoch 4/5:  79%|███████▊  | 925/1177 [41:09<11:35,  2.76s/it, exist=0.2377, loss=0.4939, lr=8.45e-06]
Epoch 4/5:  79%|███████▊  | 925/1177 [41:11<11:35,  2.76s/it, exist=0.2378, loss=0.4939, lr=8.44e-06]
Epoch 4/5:  79%|███████▊  | 926/1177 [41:11<11:40,  2.79s/it, exist=0.2378, loss=0.4939, lr=8.44e-06]
Epoch 4/5:  79%|███████▊  | 926/1177 [41:15<11:40,  2.79s/it, exist=0.2376, loss=0.4939, lr=8.43e-06]
Epoch 4/5:  79%|███████▉  | 927/1177 [41:15<12:25,  2.98s/it, exist=0.2376, loss=0.4939, lr=8.43e-06]
Epoch 4/5:  79%|███████▉  | 927/1177 [41:17<12:25,  2.98s/it, exist=0.2375, loss=0.4938, lr=8.42e-06]
Epoch 4/5:  79%|███████▉  | 928/1177 [41:17<11:07,  2.68s/it, exist=0.2375, loss=0.4938, lr=8.42e-06]
Epoch 4/5:  79%|███████▉  | 928/1177 [41:20<11:07,  2.68s/it, exist=0.2378, loss=0.4942, lr=8.41e-06]
Epoch 4/5:  79%|███████▉  | 929/1177 [41:20<11:57,  2.89s/it, exist=0.2378, loss=0.4942, lr=8.41e-06]
Epoch 4/5:  79%|███████▉  | 929/1177 [41:23<11:57,  2.89s/it, exist=0.2381, loss=0.4944, lr=8.40e-06]
Epoch 4/5:  79%|███████▉  | 930/1177 [41:23<11:40,  2.84s/it, exist=0.2381, loss=0.4944, lr=8.40e-06]
Epoch 4/5:  79%|███████▉  | 930/1177 [41:26<11:40,  2.84s/it, exist=0.2379, loss=0.4943, lr=8.39e-06]
Epoch 4/5:  79%|███████▉  | 931/1177 [41:26<12:10,  2.97s/it, exist=0.2379, loss=0.4943, lr=8.39e-06]
Epoch 4/5:  79%|███████▉  | 931/1177 [41:29<12:10,  2.97s/it, exist=0.2379, loss=0.4942, lr=8.38e-06]
Epoch 4/5:  79%|███████▉  | 932/1177 [41:29<11:40,  2.86s/it, exist=0.2379, loss=0.4942, lr=8.38e-06]
Epoch 4/5:  79%|███████▉  | 932/1177 [41:31<11:40,  2.86s/it, exist=0.2383, loss=0.4946, lr=8.37e-06]
Epoch 4/5:  79%|███████▉  | 933/1177 [41:31<10:32,  2.59s/it, exist=0.2383, loss=0.4946, lr=8.37e-06]
Epoch 4/5:  79%|███████▉  | 933/1177 [41:33<10:32,  2.59s/it, exist=0.2381, loss=0.4944, lr=8.35e-06]
Epoch 4/5:  79%|███████▉  | 934/1177 [41:33<10:37,  2.63s/it, exist=0.2381, loss=0.4944, lr=8.35e-06]
Epoch 4/5:  79%|███████▉  | 934/1177 [41:35<10:37,  2.63s/it, exist=0.2380, loss=0.4942, lr=8.34e-06]
Epoch 4/5:  79%|███████▉  | 935/1177 [41:35<09:51,  2.44s/it, exist=0.2380, loss=0.4942, lr=8.34e-06]
Epoch 4/5:  79%|███████▉  | 935/1177 [41:38<09:51,  2.44s/it, exist=0.2380, loss=0.4942, lr=8.33e-06]
Epoch 4/5:  80%|███████▉  | 936/1177 [41:38<10:04,  2.51s/it, exist=0.2380, loss=0.4942, lr=8.33e-06]
Epoch 4/5:  80%|███████▉  | 936/1177 [41:42<10:04,  2.51s/it, exist=0.2378, loss=0.4940, lr=8.32e-06]
Epoch 4/5:  80%|███████▉  | 937/1177 [41:42<11:05,  2.77s/it, exist=0.2378, loss=0.4940, lr=8.32e-06]
Epoch 4/5:  80%|███████▉  | 937/1177 [41:43<11:05,  2.77s/it, exist=0.2379, loss=0.4940, lr=8.31e-06]
Epoch 4/5:  80%|███████▉  | 938/1177 [41:43<10:02,  2.52s/it, exist=0.2379, loss=0.4940, lr=8.31e-06]
Epoch 4/5:  80%|███████▉  | 938/1177 [41:47<10:02,  2.52s/it, exist=0.2379, loss=0.4941, lr=8.30e-06]
Epoch 4/5:  80%|███████▉  | 939/1177 [41:47<10:49,  2.73s/it, exist=0.2379, loss=0.4941, lr=8.30e-06]
Epoch 4/5:  80%|███████▉  | 939/1177 [41:49<10:49,  2.73s/it, exist=0.2382, loss=0.4943, lr=8.29e-06]
Epoch 4/5:  80%|███████▉  | 940/1177 [41:49<10:30,  2.66s/it, exist=0.2382, loss=0.4943, lr=8.29e-06]
Epoch 4/5:  80%|███████▉  | 940/1177 [41:51<10:30,  2.66s/it, exist=0.2380, loss=0.4942, lr=8.28e-06]
Epoch 4/5:  80%|███████▉  | 941/1177 [41:51<09:40,  2.46s/it, exist=0.2380, loss=0.4942, lr=8.28e-06]
Epoch 4/5:  80%|███████▉  | 941/1177 [41:54<09:40,  2.46s/it, exist=0.2382, loss=0.4943, lr=8.27e-06]
Epoch 4/5:  80%|████████  | 942/1177 [41:54<09:56,  2.54s/it, exist=0.2382, loss=0.4943, lr=8.27e-06]
Epoch 4/5:  80%|████████  | 942/1177 [41:57<09:56,  2.54s/it, exist=0.2380, loss=0.4941, lr=8.25e-06]
Epoch 4/5:  80%|████████  | 943/1177 [41:57<10:47,  2.77s/it, exist=0.2380, loss=0.4941, lr=8.25e-06]
Epoch 4/5:  80%|████████  | 943/1177 [42:00<10:47,  2.77s/it, exist=0.2378, loss=0.4939, lr=8.24e-06]
Epoch 4/5:  80%|████████  | 944/1177 [42:00<10:38,  2.74s/it, exist=0.2378, loss=0.4939, lr=8.24e-06]
Epoch 4/5:  80%|████████  | 944/1177 [42:02<10:38,  2.74s/it, exist=0.2380, loss=0.4941, lr=8.23e-06]
Epoch 4/5:  80%|████████  | 945/1177 [42:02<10:28,  2.71s/it, exist=0.2380, loss=0.4941, lr=8.23e-06]
Epoch 4/5:  80%|████████  | 945/1177 [42:05<10:28,  2.71s/it, exist=0.2380, loss=0.4942, lr=8.22e-06]
Epoch 4/5:  80%|████████  | 946/1177 [42:05<10:22,  2.70s/it, exist=0.2380, loss=0.4942, lr=8.22e-06]
Epoch 4/5:  80%|████████  | 946/1177 [42:07<10:22,  2.70s/it, exist=0.2379, loss=0.4943, lr=8.21e-06]
Epoch 4/5:  80%|████████  | 947/1177 [42:07<09:29,  2.48s/it, exist=0.2379, loss=0.4943, lr=8.21e-06]
Epoch 4/5:  80%|████████  | 947/1177 [42:10<09:29,  2.48s/it, exist=0.2377, loss=0.4941, lr=8.20e-06]
Epoch 4/5:  81%|████████  | 948/1177 [42:10<10:10,  2.67s/it, exist=0.2377, loss=0.4941, lr=8.20e-06]
Epoch 4/5:  81%|████████  | 948/1177 [42:12<10:10,  2.67s/it, exist=0.2378, loss=0.4941, lr=8.19e-06]
Epoch 4/5:  81%|████████  | 949/1177 [42:12<09:17,  2.45s/it, exist=0.2378, loss=0.4941, lr=8.19e-06]
Epoch 4/5:  81%|████████  | 949/1177 [42:16<09:17,  2.45s/it, exist=0.2376, loss=0.4939, lr=8.18e-06]
Epoch 4/5:  81%|████████  | 950/1177 [42:16<10:27,  2.76s/it, exist=0.2376, loss=0.4939, lr=8.18e-06]
Epoch 4/5:  81%|████████  | 950/1177 [42:18<10:27,  2.76s/it, exist=0.2376, loss=0.4939, lr=8.17e-06]
Epoch 4/5:  81%|████████  | 951/1177 [42:18<10:11,  2.71s/it, exist=0.2376, loss=0.4939, lr=8.17e-06]
Epoch 4/5:  81%|████████  | 951/1177 [42:21<10:11,  2.71s/it, exist=0.2374, loss=0.4938, lr=8.16e-06]
Epoch 4/5:  81%|████████  | 952/1177 [42:21<10:38,  2.84s/it, exist=0.2374, loss=0.4938, lr=8.16e-06]
Epoch 4/5:  81%|████████  | 952/1177 [42:23<10:38,  2.84s/it, exist=0.2373, loss=0.4936, lr=8.15e-06]
Epoch 4/5:  81%|████████  | 953/1177 [42:23<09:38,  2.58s/it, exist=0.2373, loss=0.4936, lr=8.15e-06]
Epoch 4/5:  81%|████████  | 953/1177 [42:25<09:38,  2.58s/it, exist=0.2372, loss=0.4935, lr=8.13e-06]
Epoch 4/5:  81%|████████  | 954/1177 [42:25<08:58,  2.41s/it, exist=0.2372, loss=0.4935, lr=8.13e-06]
Epoch 4/5:  81%|████████  | 954/1177 [42:28<08:58,  2.41s/it, exist=0.2370, loss=0.4933, lr=8.12e-06]
Epoch 4/5:  81%|████████  | 955/1177 [42:28<08:57,  2.42s/it, exist=0.2370, loss=0.4933, lr=8.12e-06]
Epoch 4/5:  81%|████████  | 955/1177 [42:31<08:57,  2.42s/it, exist=0.2370, loss=0.4933, lr=8.11e-06]
Epoch 4/5:  81%|████████  | 956/1177 [42:31<09:55,  2.69s/it, exist=0.2370, loss=0.4933, lr=8.11e-06]
Epoch 4/5:  81%|████████  | 956/1177 [42:33<09:55,  2.69s/it, exist=0.2371, loss=0.4933, lr=8.10e-06]
Epoch 4/5:  81%|████████▏ | 957/1177 [42:33<09:03,  2.47s/it, exist=0.2371, loss=0.4933, lr=8.10e-06]
Epoch 4/5:  81%|████████▏ | 957/1177 [42:36<09:03,  2.47s/it, exist=0.2369, loss=0.4932, lr=8.09e-06]
Epoch 4/5:  81%|████████▏ | 958/1177 [42:36<09:57,  2.73s/it, exist=0.2369, loss=0.4932, lr=8.09e-06]
Epoch 4/5:  81%|████████▏ | 958/1177 [42:39<09:57,  2.73s/it, exist=0.2368, loss=0.4931, lr=8.08e-06]
Epoch 4/5:  81%|████████▏ | 959/1177 [42:39<09:51,  2.71s/it, exist=0.2368, loss=0.4931, lr=8.08e-06]
Epoch 4/5:  81%|████████▏ | 959/1177 [42:42<09:51,  2.71s/it, exist=0.2367, loss=0.4930, lr=8.07e-06]
Epoch 4/5:  82%|████████▏ | 960/1177 [42:42<09:40,  2.68s/it, exist=0.2367, loss=0.4930, lr=8.07e-06]
Epoch 4/5:  82%|████████▏ | 960/1177 [42:44<09:40,  2.68s/it, exist=0.2366, loss=0.4927, lr=8.06e-06]
Epoch 4/5:  82%|████████▏ | 961/1177 [42:44<09:38,  2.68s/it, exist=0.2366, loss=0.4927, lr=8.06e-06]
Epoch 4/5:  82%|████████▏ | 961/1177 [42:47<09:38,  2.68s/it, exist=0.2364, loss=0.4926, lr=8.05e-06]
Epoch 4/5:  82%|████████▏ | 962/1177 [42:47<09:35,  2.68s/it, exist=0.2364, loss=0.4926, lr=8.05e-06]
Epoch 4/5:  82%|████████▏ | 962/1177 [42:50<09:35,  2.68s/it, exist=0.2364, loss=0.4925, lr=8.04e-06]
Epoch 4/5:  82%|████████▏ | 963/1177 [42:50<09:20,  2.62s/it, exist=0.2364, loss=0.4925, lr=8.04e-06]
Epoch 4/5:  82%|████████▏ | 963/1177 [42:52<09:20,  2.62s/it, exist=0.2364, loss=0.4925, lr=8.02e-06]
Epoch 4/5:  82%|████████▏ | 964/1177 [42:52<09:14,  2.61s/it, exist=0.2364, loss=0.4925, lr=8.02e-06]
Epoch 4/5:  82%|████████▏ | 964/1177 [42:55<09:14,  2.61s/it, exist=0.2367, loss=0.4927, lr=8.01e-06]
Epoch 4/5:  82%|████████▏ | 965/1177 [42:55<09:14,  2.62s/it, exist=0.2367, loss=0.4927, lr=8.01e-06]
Epoch 4/5:  82%|████████▏ | 965/1177 [42:57<09:14,  2.62s/it, exist=0.2366, loss=0.4926, lr=8.00e-06]
Epoch 4/5:  82%|████████▏ | 966/1177 [42:57<08:33,  2.43s/it, exist=0.2366, loss=0.4926, lr=8.00e-06]
Epoch 4/5:  82%|████████▏ | 966/1177 [42:59<08:33,  2.43s/it, exist=0.2367, loss=0.4926, lr=7.99e-06]
Epoch 4/5:  82%|████████▏ | 967/1177 [42:59<08:44,  2.50s/it, exist=0.2367, loss=0.4926, lr=7.99e-06]
Epoch 4/5:  82%|████████▏ | 967/1177 [43:03<08:44,  2.50s/it, exist=0.2370, loss=0.4929, lr=7.98e-06]
Epoch 4/5:  82%|████████▏ | 968/1177 [43:03<09:21,  2.69s/it, exist=0.2370, loss=0.4929, lr=7.98e-06]
Epoch 4/5:  82%|████████▏ | 968/1177 [43:05<09:21,  2.69s/it, exist=0.2368, loss=0.4928, lr=7.97e-06]
Epoch 4/5:  82%|████████▏ | 969/1177 [43:05<09:18,  2.68s/it, exist=0.2368, loss=0.4928, lr=7.97e-06]
Epoch 4/5:  82%|████████▏ | 969/1177 [43:07<09:18,  2.68s/it, exist=0.2367, loss=0.4926, lr=7.96e-06]
Epoch 4/5:  82%|████████▏ | 970/1177 [43:07<08:31,  2.47s/it, exist=0.2367, loss=0.4926, lr=7.96e-06]
Epoch 4/5:  82%|████████▏ | 970/1177 [43:10<08:31,  2.47s/it, exist=0.2365, loss=0.4923, lr=7.95e-06]
Epoch 4/5:  82%|████████▏ | 971/1177 [43:10<09:16,  2.70s/it, exist=0.2365, loss=0.4923, lr=7.95e-06]
Epoch 4/5:  82%|████████▏ | 971/1177 [43:14<09:16,  2.70s/it, exist=0.2364, loss=0.4922, lr=7.94e-06]
Epoch 4/5:  83%|████████▎ | 972/1177 [43:14<09:50,  2.88s/it, exist=0.2364, loss=0.4922, lr=7.94e-06]
Epoch 4/5:  83%|████████▎ | 972/1177 [43:17<09:50,  2.88s/it, exist=0.2363, loss=0.4921, lr=7.93e-06]
Epoch 4/5:  83%|████████▎ | 973/1177 [43:17<10:26,  3.07s/it, exist=0.2363, loss=0.4921, lr=7.93e-06]
Epoch 4/5:  83%|████████▎ | 973/1177 [43:21<10:26,  3.07s/it, exist=0.2368, loss=0.4925, lr=7.92e-06]
Epoch 4/5:  83%|████████▎ | 974/1177 [43:21<10:35,  3.13s/it, exist=0.2368, loss=0.4925, lr=7.92e-06]
Epoch 4/5:  83%|████████▎ | 974/1177 [43:22<10:35,  3.13s/it, exist=0.2367, loss=0.4923, lr=7.91e-06]
Epoch 4/5:  83%|████████▎ | 975/1177 [43:22<09:19,  2.77s/it, exist=0.2367, loss=0.4923, lr=7.91e-06]
Epoch 4/5:  83%|████████▎ | 975/1177 [43:26<09:19,  2.77s/it, exist=0.2368, loss=0.4924, lr=7.89e-06]
Epoch 4/5:  83%|████████▎ | 976/1177 [43:26<09:47,  2.92s/it, exist=0.2368, loss=0.4924, lr=7.89e-06]
Epoch 4/5:  83%|████████▎ | 976/1177 [43:28<09:47,  2.92s/it, exist=0.2366, loss=0.4922, lr=7.88e-06]
Epoch 4/5:  83%|████████▎ | 977/1177 [43:28<08:45,  2.63s/it, exist=0.2366, loss=0.4922, lr=7.88e-06]
Epoch 4/5:  83%|████████▎ | 977/1177 [43:30<08:45,  2.63s/it, exist=0.2364, loss=0.4921, lr=7.87e-06]
Epoch 4/5:  83%|████████▎ | 978/1177 [43:30<08:07,  2.45s/it, exist=0.2364, loss=0.4921, lr=7.87e-06]
Epoch 4/5:  83%|████████▎ | 978/1177 [43:33<08:07,  2.45s/it, exist=0.2363, loss=0.4920, lr=7.86e-06]
Epoch 4/5:  83%|████████▎ | 979/1177 [43:33<08:44,  2.65s/it, exist=0.2363, loss=0.4920, lr=7.86e-06]
Epoch 4/5:  83%|████████▎ | 979/1177 [43:35<08:44,  2.65s/it, exist=0.2364, loss=0.4920, lr=7.85e-06]
Epoch 4/5:  83%|████████▎ | 980/1177 [43:35<08:37,  2.63s/it, exist=0.2364, loss=0.4920, lr=7.85e-06]
Epoch 4/5:  83%|████████▎ | 980/1177 [43:38<08:37,  2.63s/it, exist=0.2366, loss=0.4922, lr=7.84e-06]
Epoch 4/5:  83%|████████▎ | 981/1177 [43:38<08:31,  2.61s/it, exist=0.2366, loss=0.4922, lr=7.84e-06]
Epoch 4/5:  83%|████████▎ | 981/1177 [43:41<08:31,  2.61s/it, exist=0.2365, loss=0.4921, lr=7.83e-06]
Epoch 4/5:  83%|████████▎ | 982/1177 [43:41<08:37,  2.65s/it, exist=0.2365, loss=0.4921, lr=7.83e-06]
Epoch 4/5:  83%|████████▎ | 982/1177 [43:43<08:37,  2.65s/it, exist=0.2364, loss=0.4920, lr=7.82e-06]
Epoch 4/5:  84%|████████▎ | 983/1177 [43:43<08:37,  2.67s/it, exist=0.2364, loss=0.4920, lr=7.82e-06]
Epoch 4/5:  84%|████████▎ | 983/1177 [43:47<08:37,  2.67s/it, exist=0.2362, loss=0.4919, lr=7.81e-06]
Epoch 4/5:  84%|████████▎ | 984/1177 [43:47<09:05,  2.83s/it, exist=0.2362, loss=0.4919, lr=7.81e-06]
Epoch 4/5:  84%|████████▎ | 984/1177 [43:49<09:05,  2.83s/it, exist=0.2363, loss=0.4919, lr=7.80e-06]
Epoch 4/5:  84%|████████▎ | 985/1177 [43:49<08:11,  2.56s/it, exist=0.2363, loss=0.4919, lr=7.80e-06]
Epoch 4/5:  84%|████████▎ | 985/1177 [43:51<08:11,  2.56s/it, exist=0.2363, loss=0.4920, lr=7.79e-06]
Epoch 4/5:  84%|████████▍ | 986/1177 [43:51<07:34,  2.38s/it, exist=0.2363, loss=0.4920, lr=7.79e-06]
Epoch 4/5:  84%|████████▍ | 986/1177 [43:54<07:34,  2.38s/it, exist=0.2363, loss=0.4919, lr=7.78e-06]
Epoch 4/5:  84%|████████▍ | 987/1177 [43:54<08:19,  2.63s/it, exist=0.2363, loss=0.4919, lr=7.78e-06]
Epoch 4/5:  84%|████████▍ | 987/1177 [43:56<08:19,  2.63s/it, exist=0.2361, loss=0.4919, lr=7.77e-06]
Epoch 4/5:  84%|████████▍ | 988/1177 [43:56<07:41,  2.44s/it, exist=0.2361, loss=0.4919, lr=7.77e-06]
Epoch 4/5:  84%|████████▍ | 988/1177 [43:59<07:41,  2.44s/it, exist=0.2360, loss=0.4917, lr=7.75e-06]
Epoch 4/5:  84%|████████▍ | 989/1177 [43:59<08:35,  2.74s/it, exist=0.2360, loss=0.4917, lr=7.75e-06]
Epoch 4/5:  84%|████████▍ | 989/1177 [44:02<08:35,  2.74s/it, exist=0.2362, loss=0.4920, lr=7.74e-06]
Epoch 4/5:  84%|████████▍ | 990/1177 [44:02<08:21,  2.68s/it, exist=0.2362, loss=0.4920, lr=7.74e-06]
Epoch 4/5:  84%|████████▍ | 990/1177 [44:06<08:21,  2.68s/it, exist=0.2360, loss=0.4918, lr=7.73e-06]
Epoch 4/5:  84%|████████▍ | 991/1177 [44:06<09:29,  3.06s/it, exist=0.2360, loss=0.4918, lr=7.73e-06]
Epoch 4/5:  84%|████████▍ | 991/1177 [44:09<09:29,  3.06s/it, exist=0.2363, loss=0.4920, lr=7.72e-06]
Epoch 4/5:  84%|████████▍ | 992/1177 [44:09<09:48,  3.18s/it, exist=0.2363, loss=0.4920, lr=7.72e-06]
Epoch 4/5:  84%|████████▍ | 992/1177 [44:13<09:48,  3.18s/it, exist=0.2364, loss=0.4921, lr=7.71e-06]
Epoch 4/5:  84%|████████▍ | 993/1177 [44:13<10:15,  3.34s/it, exist=0.2364, loss=0.4921, lr=7.71e-06]
Epoch 4/5:  84%|████████▍ | 993/1177 [44:15<10:15,  3.34s/it, exist=0.2365, loss=0.4922, lr=7.70e-06]
Epoch 4/5:  84%|████████▍ | 994/1177 [44:15<08:57,  2.94s/it, exist=0.2365, loss=0.4922, lr=7.70e-06]
Epoch 4/5:  84%|████████▍ | 994/1177 [44:17<08:57,  2.94s/it, exist=0.2368, loss=0.4925, lr=7.69e-06]
Epoch 4/5:  85%|████████▍ | 995/1177 [44:17<08:01,  2.64s/it, exist=0.2368, loss=0.4925, lr=7.69e-06]
Epoch 4/5:  85%|████████▍ | 995/1177 [44:20<08:01,  2.64s/it, exist=0.2370, loss=0.4927, lr=7.68e-06]
Epoch 4/5:  85%|████████▍ | 996/1177 [44:20<08:28,  2.81s/it, exist=0.2370, loss=0.4927, lr=7.68e-06]
Epoch 4/5:  85%|████████▍ | 996/1177 [44:23<08:28,  2.81s/it, exist=0.2370, loss=0.4927, lr=7.67e-06]
Epoch 4/5:  85%|████████▍ | 997/1177 [44:23<08:11,  2.73s/it, exist=0.2370, loss=0.4927, lr=7.67e-06]
Epoch 4/5:  85%|████████▍ | 997/1177 [44:25<08:11,  2.73s/it, exist=0.2368, loss=0.4925, lr=7.66e-06]
Epoch 4/5:  85%|████████▍ | 998/1177 [44:25<07:29,  2.51s/it, exist=0.2368, loss=0.4925, lr=7.66e-06]
Epoch 4/5:  85%|████████▍ | 998/1177 [44:28<07:29,  2.51s/it, exist=0.2367, loss=0.4924, lr=7.65e-06]
Epoch 4/5:  85%|████████▍ | 999/1177 [44:28<08:09,  2.75s/it, exist=0.2367, loss=0.4924, lr=7.65e-06]
Epoch 4/5:  85%|████████▍ | 999/1177 [44:30<08:09,  2.75s/it, exist=0.2365, loss=0.4923, lr=7.64e-06]
Epoch 4/5:  85%|████████▍ | 1000/1177 [44:30<07:26,  2.52s/it, exist=0.2365, loss=0.4923, lr=7.64e-06]
Epoch 4/5:  85%|████████▍ | 1000/1177 [44:33<07:26,  2.52s/it, exist=0.2364, loss=0.4921, lr=7.63e-06]
Epoch 4/5:  85%|████████▌ | 1001/1177 [44:33<07:33,  2.58s/it, exist=0.2364, loss=0.4921, lr=7.63e-06]
Epoch 4/5:  85%|████████▌ | 1001/1177 [44:35<07:33,  2.58s/it, exist=0.2362, loss=0.4920, lr=7.62e-06]
Epoch 4/5:  85%|████████▌ | 1002/1177 [44:35<06:59,  2.40s/it, exist=0.2362, loss=0.4920, lr=7.62e-06]
Epoch 4/5:  85%|████████▌ | 1002/1177 [44:39<06:59,  2.40s/it, exist=0.2363, loss=0.4920, lr=7.61e-06]
Epoch 4/5:  85%|████████▌ | 1003/1177 [44:39<08:45,  3.02s/it, exist=0.2363, loss=0.4920, lr=7.61e-06]
Epoch 4/5:  85%|████████▌ | 1003/1177 [44:41<08:45,  3.02s/it, exist=0.2361, loss=0.4918, lr=7.59e-06]
Epoch 4/5:  85%|████████▌ | 1004/1177 [44:41<07:45,  2.69s/it, exist=0.2361, loss=0.4918, lr=7.59e-06]
Epoch 4/5:  85%|████████▌ | 1004/1177 [44:44<07:45,  2.69s/it, exist=0.2360, loss=0.4917, lr=7.58e-06]
Epoch 4/5:  85%|████████▌ | 1005/1177 [44:44<07:43,  2.69s/it, exist=0.2360, loss=0.4917, lr=7.58e-06]
Epoch 4/5:  85%|████████▌ | 1005/1177 [44:46<07:43,  2.69s/it, exist=0.2363, loss=0.4919, lr=7.57e-06]
Epoch 4/5:  85%|████████▌ | 1006/1177 [44:46<07:42,  2.71s/it, exist=0.2363, loss=0.4919, lr=7.57e-06]
Epoch 4/5:  85%|████████▌ | 1006/1177 [44:48<07:42,  2.71s/it, exist=0.2363, loss=0.4920, lr=7.56e-06]
Epoch 4/5:  86%|████████▌ | 1007/1177 [44:48<07:03,  2.49s/it, exist=0.2363, loss=0.4920, lr=7.56e-06]
Epoch 4/5:  86%|████████▌ | 1007/1177 [44:51<07:03,  2.49s/it, exist=0.2362, loss=0.4918, lr=7.55e-06]
Epoch 4/5:  86%|████████▌ | 1008/1177 [44:51<07:35,  2.70s/it, exist=0.2362, loss=0.4918, lr=7.55e-06]
Epoch 4/5:  86%|████████▌ | 1008/1177 [44:54<07:35,  2.70s/it, exist=0.2363, loss=0.4918, lr=7.54e-06]
Epoch 4/5:  86%|████████▌ | 1009/1177 [44:54<07:36,  2.72s/it, exist=0.2363, loss=0.4918, lr=7.54e-06]
Epoch 4/5:  86%|████████▌ | 1009/1177 [44:57<07:36,  2.72s/it, exist=0.2365, loss=0.4920, lr=7.53e-06]
Epoch 4/5:  86%|████████▌ | 1010/1177 [44:57<07:34,  2.72s/it, exist=0.2365, loss=0.4920, lr=7.53e-06]
Epoch 4/5:  86%|████████▌ | 1010/1177 [45:00<07:34,  2.72s/it, exist=0.2370, loss=0.4925, lr=7.52e-06]
Epoch 4/5:  86%|████████▌ | 1011/1177 [45:00<07:26,  2.69s/it, exist=0.2370, loss=0.4925, lr=7.52e-06]
Epoch 4/5:  86%|████████▌ | 1011/1177 [45:02<07:26,  2.69s/it, exist=0.2371, loss=0.4926, lr=7.51e-06]
Epoch 4/5:  86%|████████▌ | 1012/1177 [45:02<06:48,  2.47s/it, exist=0.2371, loss=0.4926, lr=7.51e-06]
Epoch 4/5:  86%|████████▌ | 1012/1177 [45:05<06:48,  2.47s/it, exist=0.2372, loss=0.4927, lr=7.50e-06]
Epoch 4/5:  86%|████████▌ | 1013/1177 [45:05<07:23,  2.71s/it, exist=0.2372, loss=0.4927, lr=7.50e-06]
Epoch 4/5:  86%|████████▌ | 1013/1177 [45:08<07:23,  2.71s/it, exist=0.2373, loss=0.4928, lr=7.49e-06]
Epoch 4/5:  86%|████████▌ | 1014/1177 [45:08<07:21,  2.71s/it, exist=0.2373, loss=0.4928, lr=7.49e-06]
Epoch 4/5:  86%|████████▌ | 1014/1177 [45:10<07:21,  2.71s/it, exist=0.2374, loss=0.4929, lr=7.48e-06]
Epoch 4/5:  86%|████████▌ | 1015/1177 [45:10<07:08,  2.65s/it, exist=0.2374, loss=0.4929, lr=7.48e-06]
Epoch 4/5:  86%|████████▌ | 1015/1177 [45:13<07:08,  2.65s/it, exist=0.2374, loss=0.4930, lr=7.47e-06]
Epoch 4/5:  86%|████████▋ | 1016/1177 [45:13<07:05,  2.65s/it, exist=0.2374, loss=0.4930, lr=7.47e-06]
Epoch 4/5:  86%|████████▋ | 1016/1177 [45:15<07:05,  2.65s/it, exist=0.2374, loss=0.4930, lr=7.46e-06]
Epoch 4/5:  86%|████████▋ | 1017/1177 [45:15<07:04,  2.65s/it, exist=0.2374, loss=0.4930, lr=7.46e-06]
Epoch 4/5:  86%|████████▋ | 1017/1177 [45:17<07:04,  2.65s/it, exist=0.2376, loss=0.4931, lr=7.45e-06]
Epoch 4/5:  86%|████████▋ | 1018/1177 [45:17<06:28,  2.44s/it, exist=0.2376, loss=0.4931, lr=7.45e-06]
Epoch 4/5:  86%|████████▋ | 1018/1177 [45:20<06:28,  2.44s/it, exist=0.2377, loss=0.4932, lr=7.44e-06]
Epoch 4/5:  87%|████████▋ | 1019/1177 [45:20<06:25,  2.44s/it, exist=0.2377, loss=0.4932, lr=7.44e-06]
Epoch 4/5:  87%|████████▋ | 1019/1177 [45:23<06:25,  2.44s/it, exist=0.2376, loss=0.4933, lr=7.42e-06]
Epoch 4/5:  87%|████████▋ | 1020/1177 [45:23<06:39,  2.54s/it, exist=0.2376, loss=0.4933, lr=7.42e-06]
Epoch 4/5:  87%|████████▋ | 1020/1177 [45:26<06:39,  2.54s/it, exist=0.2375, loss=0.4932, lr=7.41e-06]
Epoch 4/5:  87%|████████▋ | 1021/1177 [45:26<07:18,  2.81s/it, exist=0.2375, loss=0.4932, lr=7.41e-06]
Epoch 4/5:  87%|████████▋ | 1021/1177 [45:29<07:18,  2.81s/it, exist=0.2373, loss=0.4930, lr=7.40e-06]
Epoch 4/5:  87%|████████▋ | 1022/1177 [45:29<07:42,  2.99s/it, exist=0.2373, loss=0.4930, lr=7.40e-06]
Epoch 4/5:  87%|████████▋ | 1022/1177 [45:32<07:42,  2.99s/it, exist=0.2374, loss=0.4931, lr=7.39e-06]
Epoch 4/5:  87%|████████▋ | 1023/1177 [45:32<07:22,  2.88s/it, exist=0.2374, loss=0.4931, lr=7.39e-06]
Epoch 4/5:  87%|████████▋ | 1023/1177 [45:34<07:22,  2.88s/it, exist=0.2375, loss=0.4932, lr=7.38e-06]
Epoch 4/5:  87%|████████▋ | 1024/1177 [45:34<06:37,  2.60s/it, exist=0.2375, loss=0.4932, lr=7.38e-06]
Epoch 4/5:  87%|████████▋ | 1024/1177 [45:37<06:37,  2.60s/it, exist=0.2375, loss=0.4932, lr=7.37e-06]
Epoch 4/5:  87%|████████▋ | 1025/1177 [45:37<06:39,  2.63s/it, exist=0.2375, loss=0.4932, lr=7.37e-06]
Epoch 4/5:  87%|████████▋ | 1025/1177 [45:39<06:39,  2.63s/it, exist=0.2375, loss=0.4932, lr=7.36e-06]
Epoch 4/5:  87%|████████▋ | 1026/1177 [45:39<06:07,  2.43s/it, exist=0.2375, loss=0.4932, lr=7.36e-06]
Epoch 4/5:  87%|████████▋ | 1026/1177 [45:41<06:07,  2.43s/it, exist=0.2375, loss=0.4932, lr=7.35e-06]
Epoch 4/5:  87%|████████▋ | 1027/1177 [45:41<06:02,  2.42s/it, exist=0.2375, loss=0.4932, lr=7.35e-06]
Epoch 4/5:  87%|████████▋ | 1027/1177 [45:44<06:02,  2.42s/it, exist=0.2375, loss=0.4933, lr=7.34e-06]
Epoch 4/5:  87%|████████▋ | 1028/1177 [45:44<06:45,  2.72s/it, exist=0.2375, loss=0.4933, lr=7.34e-06]
Epoch 4/5:  87%|████████▋ | 1028/1177 [45:46<06:45,  2.72s/it, exist=0.2380, loss=0.4936, lr=7.33e-06]
Epoch 4/5:  87%|████████▋ | 1029/1177 [45:46<06:08,  2.49s/it, exist=0.2380, loss=0.4936, lr=7.33e-06]
Epoch 4/5:  87%|████████▋ | 1029/1177 [45:50<06:08,  2.49s/it, exist=0.2379, loss=0.4936, lr=7.32e-06]
Epoch 4/5:  88%|████████▊ | 1030/1177 [45:50<06:45,  2.76s/it, exist=0.2379, loss=0.4936, lr=7.32e-06]
Epoch 4/5:  88%|████████▊ | 1030/1177 [45:52<06:45,  2.76s/it, exist=0.2378, loss=0.4936, lr=7.31e-06]
Epoch 4/5:  88%|████████▊ | 1031/1177 [45:52<06:37,  2.72s/it, exist=0.2378, loss=0.4936, lr=7.31e-06]
Epoch 4/5:  88%|████████▊ | 1031/1177 [45:55<06:37,  2.72s/it, exist=0.2377, loss=0.4934, lr=7.30e-06]
Epoch 4/5:  88%|████████▊ | 1032/1177 [45:55<06:30,  2.69s/it, exist=0.2377, loss=0.4934, lr=7.30e-06]
Epoch 4/5:  88%|████████▊ | 1032/1177 [45:58<06:30,  2.69s/it, exist=0.2376, loss=0.4934, lr=7.29e-06]
Epoch 4/5:  88%|████████▊ | 1033/1177 [45:58<06:21,  2.65s/it, exist=0.2376, loss=0.4934, lr=7.29e-06]
Epoch 4/5:  88%|████████▊ | 1033/1177 [46:00<06:21,  2.65s/it, exist=0.2375, loss=0.4933, lr=7.28e-06]
Epoch 4/5:  88%|████████▊ | 1034/1177 [46:00<06:22,  2.68s/it, exist=0.2375, loss=0.4933, lr=7.28e-06]
Epoch 4/5:  88%|████████▊ | 1034/1177 [46:03<06:22,  2.68s/it, exist=0.2377, loss=0.4935, lr=7.27e-06]
Epoch 4/5:  88%|████████▊ | 1035/1177 [46:03<06:17,  2.66s/it, exist=0.2377, loss=0.4935, lr=7.27e-06]
Epoch 4/5:  88%|████████▊ | 1035/1177 [46:06<06:17,  2.66s/it, exist=0.2375, loss=0.4933, lr=7.26e-06]
Epoch 4/5:  88%|████████▊ | 1036/1177 [46:06<06:12,  2.64s/it, exist=0.2375, loss=0.4933, lr=7.26e-06]
Epoch 4/5:  88%|████████▊ | 1036/1177 [46:08<06:12,  2.64s/it, exist=0.2377, loss=0.4936, lr=7.25e-06]
Epoch 4/5:  88%|████████▊ | 1037/1177 [46:08<06:10,  2.65s/it, exist=0.2377, loss=0.4936, lr=7.25e-06]
Epoch 4/5:  88%|████████▊ | 1037/1177 [46:11<06:10,  2.65s/it, exist=0.2376, loss=0.4934, lr=7.24e-06]
Epoch 4/5:  88%|████████▊ | 1038/1177 [46:11<06:11,  2.67s/it, exist=0.2376, loss=0.4934, lr=7.24e-06]
Epoch 4/5:  88%|████████▊ | 1038/1177 [46:13<06:11,  2.67s/it, exist=0.2376, loss=0.4934, lr=7.23e-06]
Epoch 4/5:  88%|████████▊ | 1039/1177 [46:13<06:02,  2.63s/it, exist=0.2376, loss=0.4934, lr=7.23e-06]
Epoch 4/5:  88%|████████▊ | 1039/1177 [46:16<06:02,  2.63s/it, exist=0.2375, loss=0.4932, lr=7.22e-06]
Epoch 4/5:  88%|████████▊ | 1040/1177 [46:16<05:52,  2.57s/it, exist=0.2375, loss=0.4932, lr=7.22e-06]
Epoch 4/5:  88%|████████▊ | 1040/1177 [46:18<05:52,  2.57s/it, exist=0.2381, loss=0.4938, lr=7.20e-06]
Epoch 4/5:  88%|████████▊ | 1041/1177 [46:18<05:50,  2.58s/it, exist=0.2381, loss=0.4938, lr=7.20e-06]
Epoch 4/5:  88%|████████▊ | 1041/1177 [46:21<05:50,  2.58s/it, exist=0.2381, loss=0.4937, lr=7.19e-06]
Epoch 4/5:  89%|████████▊ | 1042/1177 [46:21<05:54,  2.63s/it, exist=0.2381, loss=0.4937, lr=7.19e-06]
Epoch 4/5:  89%|████████▊ | 1042/1177 [46:24<05:54,  2.63s/it, exist=0.2379, loss=0.4935, lr=7.18e-06]
Epoch 4/5:  89%|████████▊ | 1043/1177 [46:24<05:49,  2.61s/it, exist=0.2379, loss=0.4935, lr=7.18e-06]
Epoch 4/5:  89%|████████▊ | 1043/1177 [46:26<05:49,  2.61s/it, exist=0.2379, loss=0.4935, lr=7.17e-06]
Epoch 4/5:  89%|████████▊ | 1044/1177 [46:26<05:47,  2.61s/it, exist=0.2379, loss=0.4935, lr=7.17e-06]
Epoch 4/5:  89%|████████▊ | 1044/1177 [46:28<05:47,  2.61s/it, exist=0.2380, loss=0.4935, lr=7.16e-06]
Epoch 4/5:  89%|████████▉ | 1045/1177 [46:28<05:17,  2.41s/it, exist=0.2380, loss=0.4935, lr=7.16e-06]
Epoch 4/5:  89%|████████▉ | 1045/1177 [46:32<05:17,  2.41s/it, exist=0.2379, loss=0.4934, lr=7.15e-06]
Epoch 4/5:  89%|████████▉ | 1046/1177 [46:32<05:59,  2.74s/it, exist=0.2379, loss=0.4934, lr=7.15e-06]
Epoch 4/5:  89%|████████▉ | 1046/1177 [46:34<05:59,  2.74s/it, exist=0.2378, loss=0.4932, lr=7.14e-06]
Epoch 4/5:  89%|████████▉ | 1047/1177 [46:34<05:52,  2.71s/it, exist=0.2378, loss=0.4932, lr=7.14e-06]
Epoch 4/5:  89%|████████▉ | 1047/1177 [46:36<05:52,  2.71s/it, exist=0.2377, loss=0.4932, lr=7.13e-06]
Epoch 4/5:  89%|████████▉ | 1048/1177 [46:36<05:19,  2.47s/it, exist=0.2377, loss=0.4932, lr=7.13e-06]
Epoch 4/5:  89%|████████▉ | 1048/1177 [46:40<05:19,  2.47s/it, exist=0.2376, loss=0.4929, lr=7.12e-06]
Epoch 4/5:  89%|████████▉ | 1049/1177 [46:40<05:47,  2.72s/it, exist=0.2376, loss=0.4929, lr=7.12e-06]
Epoch 4/5:  89%|████████▉ | 1049/1177 [46:42<05:47,  2.72s/it, exist=0.2374, loss=0.4928, lr=7.11e-06]
Epoch 4/5:  89%|████████▉ | 1050/1177 [46:42<05:17,  2.50s/it, exist=0.2374, loss=0.4928, lr=7.11e-06]
Epoch 4/5:  89%|████████▉ | 1050/1177 [46:46<05:17,  2.50s/it, exist=0.2374, loss=0.4927, lr=7.10e-06]
Epoch 4/5:  89%|████████▉ | 1051/1177 [46:46<06:07,  2.92s/it, exist=0.2374, loss=0.4927, lr=7.10e-06]
Epoch 4/5:  89%|████████▉ | 1051/1177 [46:48<06:07,  2.92s/it, exist=0.2373, loss=0.4926, lr=7.09e-06]
Epoch 4/5:  89%|████████▉ | 1052/1177 [46:48<05:50,  2.81s/it, exist=0.2373, loss=0.4926, lr=7.09e-06]
Epoch 4/5:  89%|████████▉ | 1052/1177 [46:51<05:50,  2.81s/it, exist=0.2371, loss=0.4924, lr=7.08e-06]
Epoch 4/5:  89%|████████▉ | 1053/1177 [46:51<05:48,  2.81s/it, exist=0.2371, loss=0.4924, lr=7.08e-06]
Epoch 4/5:  89%|████████▉ | 1053/1177 [46:56<05:48,  2.81s/it, exist=0.2370, loss=0.4923, lr=7.07e-06]
Epoch 4/5:  90%|████████▉ | 1054/1177 [46:56<06:50,  3.34s/it, exist=0.2370, loss=0.4923, lr=7.07e-06]
Epoch 4/5:  90%|████████▉ | 1054/1177 [46:58<06:50,  3.34s/it, exist=0.2370, loss=0.4923, lr=7.06e-06]
Epoch 4/5:  90%|████████▉ | 1055/1177 [46:58<06:15,  3.08s/it, exist=0.2370, loss=0.4923, lr=7.06e-06]
Epoch 4/5:  90%|████████▉ | 1055/1177 [47:00<06:15,  3.08s/it, exist=0.2369, loss=0.4921, lr=7.05e-06]
Epoch 4/5:  90%|████████▉ | 1056/1177 [47:00<05:32,  2.75s/it, exist=0.2369, loss=0.4921, lr=7.05e-06]
Epoch 4/5:  90%|████████▉ | 1056/1177 [47:03<05:32,  2.75s/it, exist=0.2369, loss=0.4921, lr=7.04e-06]
Epoch 4/5:  90%|████████▉ | 1057/1177 [47:03<05:27,  2.73s/it, exist=0.2369, loss=0.4921, lr=7.04e-06]
Epoch 4/5:  90%|████████▉ | 1057/1177 [47:05<05:27,  2.73s/it, exist=0.2371, loss=0.4923, lr=7.03e-06]
Epoch 4/5:  90%|████████▉ | 1058/1177 [47:05<04:58,  2.50s/it, exist=0.2371, loss=0.4923, lr=7.03e-06]
Epoch 4/5:  90%|████████▉ | 1058/1177 [47:07<04:58,  2.50s/it, exist=0.2370, loss=0.4921, lr=7.02e-06]
Epoch 4/5:  90%|████████▉ | 1059/1177 [47:07<04:55,  2.51s/it, exist=0.2370, loss=0.4921, lr=7.02e-06]
Epoch 4/5:  90%|████████▉ | 1059/1177 [47:10<04:55,  2.51s/it, exist=0.2368, loss=0.4919, lr=7.01e-06]
Epoch 4/5:  90%|█████████ | 1060/1177 [47:10<05:13,  2.68s/it, exist=0.2368, loss=0.4919, lr=7.01e-06]
Epoch 4/5:  90%|█████████ | 1060/1177 [47:13<05:13,  2.68s/it, exist=0.2368, loss=0.4920, lr=7.00e-06]
Epoch 4/5:  90%|█████████ | 1061/1177 [47:13<05:10,  2.68s/it, exist=0.2368, loss=0.4920, lr=7.00e-06]
Epoch 4/5:  90%|█████████ | 1061/1177 [47:16<05:10,  2.68s/it, exist=0.2367, loss=0.4919, lr=6.99e-06]
Epoch 4/5:  90%|█████████ | 1062/1177 [47:16<05:05,  2.66s/it, exist=0.2367, loss=0.4919, lr=6.99e-06]
Epoch 4/5:  90%|█████████ | 1062/1177 [47:18<05:05,  2.66s/it, exist=0.2367, loss=0.4918, lr=6.98e-06]
Epoch 4/5:  90%|█████████ | 1063/1177 [47:18<05:03,  2.66s/it, exist=0.2367, loss=0.4918, lr=6.98e-06]
Epoch 4/5:  90%|█████████ | 1063/1177 [47:20<05:03,  2.66s/it, exist=0.2366, loss=0.4918, lr=6.97e-06]
Epoch 4/5:  90%|█████████ | 1064/1177 [47:20<04:39,  2.48s/it, exist=0.2366, loss=0.4918, lr=6.97e-06]
Epoch 4/5:  90%|█████████ | 1064/1177 [47:24<04:39,  2.48s/it, exist=0.2367, loss=0.4919, lr=6.96e-06]
Epoch 4/5:  90%|█████████ | 1065/1177 [47:24<05:22,  2.88s/it, exist=0.2367, loss=0.4919, lr=6.96e-06]
Epoch 4/5:  90%|█████████ | 1065/1177 [47:29<05:22,  2.88s/it, exist=0.2367, loss=0.4920, lr=6.95e-06]
Epoch 4/5:  91%|█████████ | 1066/1177 [47:29<06:20,  3.43s/it, exist=0.2367, loss=0.4920, lr=6.95e-06]
Epoch 4/5:  91%|█████████ | 1066/1177 [47:31<06:20,  3.43s/it, exist=0.2372, loss=0.4929, lr=6.94e-06]
Epoch 4/5:  91%|█████████ | 1067/1177 [47:31<05:52,  3.21s/it, exist=0.2372, loss=0.4929, lr=6.94e-06]
Epoch 4/5:  91%|█████████ | 1067/1177 [47:34<05:52,  3.21s/it, exist=0.2373, loss=0.4930, lr=6.93e-06]
Epoch 4/5:  91%|█████████ | 1068/1177 [47:34<05:29,  3.03s/it, exist=0.2373, loss=0.4930, lr=6.93e-06]
Epoch 4/5:  91%|█████████ | 1068/1177 [47:36<05:29,  3.03s/it, exist=0.2372, loss=0.4928, lr=6.92e-06]
Epoch 4/5:  91%|█████████ | 1069/1177 [47:36<04:52,  2.71s/it, exist=0.2372, loss=0.4928, lr=6.92e-06]
Epoch 4/5:  91%|█████████ | 1069/1177 [47:38<04:52,  2.71s/it, exist=0.2372, loss=0.4929, lr=6.91e-06]
Epoch 4/5:  91%|█████████ | 1070/1177 [47:38<04:28,  2.51s/it, exist=0.2372, loss=0.4929, lr=6.91e-06]
Epoch 4/5:  91%|█████████ | 1070/1177 [47:41<04:28,  2.51s/it, exist=0.2373, loss=0.4930, lr=6.90e-06]
Epoch 4/5:  91%|█████████ | 1071/1177 [47:41<04:32,  2.57s/it, exist=0.2373, loss=0.4930, lr=6.90e-06]
Epoch 4/5:  91%|█████████ | 1071/1177 [47:44<04:32,  2.57s/it, exist=0.2373, loss=0.4929, lr=6.88e-06]
Epoch 4/5:  91%|█████████ | 1072/1177 [47:44<05:03,  2.89s/it, exist=0.2373, loss=0.4929, lr=6.88e-06]
Epoch 4/5:  91%|█████████ | 1072/1177 [47:46<05:03,  2.89s/it, exist=0.2373, loss=0.4930, lr=6.87e-06]
Epoch 4/5:  91%|█████████ | 1073/1177 [47:46<04:31,  2.61s/it, exist=0.2373, loss=0.4930, lr=6.87e-06]
Epoch 4/5:  91%|█████████ | 1073/1177 [47:48<04:31,  2.61s/it, exist=0.2372, loss=0.4929, lr=6.86e-06]
Epoch 4/5:  91%|█████████ | 1074/1177 [47:48<04:07,  2.41s/it, exist=0.2372, loss=0.4929, lr=6.86e-06]
Epoch 4/5:  91%|█████████ | 1074/1177 [47:52<04:07,  2.41s/it, exist=0.2373, loss=0.4930, lr=6.85e-06]
Epoch 4/5:  91%|█████████▏| 1075/1177 [47:52<04:29,  2.64s/it, exist=0.2373, loss=0.4930, lr=6.85e-06]
Epoch 4/5:  91%|█████████▏| 1075/1177 [47:53<04:29,  2.64s/it, exist=0.2373, loss=0.4929, lr=6.84e-06]
Epoch 4/5:  91%|█████████▏| 1076/1177 [47:53<04:05,  2.43s/it, exist=0.2373, loss=0.4929, lr=6.84e-06]
Epoch 4/5:  91%|█████████▏| 1076/1177 [47:56<04:05,  2.43s/it, exist=0.2373, loss=0.4929, lr=6.83e-06]
Epoch 4/5:  92%|█████████▏| 1077/1177 [47:56<04:19,  2.60s/it, exist=0.2373, loss=0.4929, lr=6.83e-06]
Epoch 4/5:  92%|█████████▏| 1077/1177 [47:59<04:19,  2.60s/it, exist=0.2375, loss=0.4931, lr=6.82e-06]
Epoch 4/5:  92%|█████████▏| 1078/1177 [47:59<04:14,  2.57s/it, exist=0.2375, loss=0.4931, lr=6.82e-06]
Epoch 4/5:  92%|█████████▏| 1078/1177 [48:01<04:14,  2.57s/it, exist=0.2376, loss=0.4931, lr=6.81e-06]
Epoch 4/5:  92%|█████████▏| 1079/1177 [48:01<04:10,  2.56s/it, exist=0.2376, loss=0.4931, lr=6.81e-06]
Epoch 4/5:  92%|█████████▏| 1079/1177 [48:03<04:10,  2.56s/it, exist=0.2375, loss=0.4930, lr=6.80e-06]
Epoch 4/5:  92%|█████████▏| 1080/1177 [48:03<03:50,  2.38s/it, exist=0.2375, loss=0.4930, lr=6.80e-06]
Epoch 4/5:  92%|█████████▏| 1080/1177 [48:07<03:50,  2.38s/it, exist=0.2374, loss=0.4930, lr=6.79e-06]
Epoch 4/5:  92%|█████████▏| 1081/1177 [48:07<04:20,  2.71s/it, exist=0.2374, loss=0.4930, lr=6.79e-06]
Epoch 4/5:  92%|█████████▏| 1081/1177 [48:09<04:20,  2.71s/it, exist=0.2373, loss=0.4929, lr=6.78e-06]
Epoch 4/5:  92%|█████████▏| 1082/1177 [48:09<04:01,  2.55s/it, exist=0.2373, loss=0.4929, lr=6.78e-06]
Epoch 4/5:  92%|█████████▏| 1082/1177 [48:12<04:01,  2.55s/it, exist=0.2373, loss=0.4929, lr=6.77e-06]
Epoch 4/5:  92%|█████████▏| 1083/1177 [48:12<04:10,  2.67s/it, exist=0.2373, loss=0.4929, lr=6.77e-06]
Epoch 4/5:  92%|█████████▏| 1083/1177 [48:15<04:10,  2.67s/it, exist=0.2373, loss=0.4929, lr=6.76e-06]
Epoch 4/5:  92%|█████████▏| 1084/1177 [48:15<04:11,  2.70s/it, exist=0.2373, loss=0.4929, lr=6.76e-06]
Epoch 4/5:  92%|█████████▏| 1084/1177 [48:19<04:11,  2.70s/it, exist=0.2371, loss=0.4927, lr=6.75e-06]
Epoch 4/5:  92%|█████████▏| 1085/1177 [48:19<04:56,  3.22s/it, exist=0.2371, loss=0.4927, lr=6.75e-06]
Epoch 4/5:  92%|█████████▏| 1085/1177 [48:23<04:56,  3.22s/it, exist=0.2370, loss=0.4926, lr=6.74e-06]
Epoch 4/5:  92%|█████████▏| 1086/1177 [48:23<05:16,  3.48s/it, exist=0.2370, loss=0.4926, lr=6.74e-06]
Epoch 4/5:  92%|█████████▏| 1086/1177 [48:26<05:16,  3.48s/it, exist=0.2370, loss=0.4926, lr=6.73e-06]
Epoch 4/5:  92%|█████████▏| 1087/1177 [48:26<04:45,  3.17s/it, exist=0.2370, loss=0.4926, lr=6.73e-06]
Epoch 4/5:  92%|█████████▏| 1087/1177 [48:28<04:45,  3.17s/it, exist=0.2373, loss=0.4928, lr=6.72e-06]
Epoch 4/5:  92%|█████████▏| 1088/1177 [48:28<04:11,  2.83s/it, exist=0.2373, loss=0.4928, lr=6.72e-06]
Epoch 4/5:  92%|█████████▏| 1088/1177 [48:30<04:11,  2.83s/it, exist=0.2371, loss=0.4928, lr=6.71e-06]
Epoch 4/5:  93%|█████████▎| 1089/1177 [48:30<04:04,  2.78s/it, exist=0.2371, loss=0.4928, lr=6.71e-06]
Epoch 4/5:  93%|█████████▎| 1089/1177 [48:32<04:04,  2.78s/it, exist=0.2370, loss=0.4928, lr=6.70e-06]
Epoch 4/5:  93%|█████████▎| 1090/1177 [48:32<03:42,  2.55s/it, exist=0.2370, loss=0.4928, lr=6.70e-06]
Epoch 4/5:  93%|█████████▎| 1090/1177 [48:36<03:42,  2.55s/it, exist=0.2370, loss=0.4927, lr=6.69e-06]
Epoch 4/5:  93%|█████████▎| 1091/1177 [48:36<03:51,  2.69s/it, exist=0.2370, loss=0.4927, lr=6.69e-06]
Epoch 4/5:  93%|█████████▎| 1091/1177 [48:38<03:51,  2.69s/it, exist=0.2369, loss=0.4926, lr=6.68e-06]
Epoch 4/5:  93%|█████████▎| 1092/1177 [48:38<03:45,  2.66s/it, exist=0.2369, loss=0.4926, lr=6.68e-06]
Epoch 4/5:  93%|█████████▎| 1092/1177 [48:41<03:45,  2.66s/it, exist=0.2368, loss=0.4925, lr=6.67e-06]
Epoch 4/5:  93%|█████████▎| 1093/1177 [48:41<03:42,  2.65s/it, exist=0.2368, loss=0.4925, lr=6.67e-06]
Epoch 4/5:  93%|█████████▎| 1093/1177 [48:43<03:42,  2.65s/it, exist=0.2369, loss=0.4925, lr=6.66e-06]
Epoch 4/5:  93%|█████████▎| 1094/1177 [48:43<03:22,  2.44s/it, exist=0.2369, loss=0.4925, lr=6.66e-06]
Epoch 4/5:  93%|█████████▎| 1094/1177 [48:46<03:22,  2.44s/it, exist=0.2369, loss=0.4926, lr=6.65e-06]
Epoch 4/5:  93%|█████████▎| 1095/1177 [48:46<03:39,  2.68s/it, exist=0.2369, loss=0.4926, lr=6.65e-06]
Epoch 4/5:  93%|█████████▎| 1095/1177 [48:48<03:39,  2.68s/it, exist=0.2368, loss=0.4924, lr=6.64e-06]
Epoch 4/5:  93%|█████████▎| 1096/1177 [48:48<03:34,  2.65s/it, exist=0.2368, loss=0.4924, lr=6.64e-06]
Epoch 4/5:  93%|█████████▎| 1096/1177 [48:50<03:34,  2.65s/it, exist=0.2367, loss=0.4924, lr=6.63e-06]
Epoch 4/5:  93%|█████████▎| 1097/1177 [48:50<03:16,  2.46s/it, exist=0.2367, loss=0.4924, lr=6.63e-06]
Epoch 4/5:  93%|█████████▎| 1097/1177 [48:54<03:16,  2.46s/it, exist=0.2367, loss=0.4925, lr=6.62e-06]
Epoch 4/5:  93%|█████████▎| 1098/1177 [48:54<03:34,  2.72s/it, exist=0.2367, loss=0.4925, lr=6.62e-06]
Epoch 4/5:  93%|█████████▎| 1098/1177 [48:56<03:34,  2.72s/it, exist=0.2371, loss=0.4928, lr=6.61e-06]
Epoch 4/5:  93%|█████████▎| 1099/1177 [48:56<03:29,  2.68s/it, exist=0.2371, loss=0.4928, lr=6.61e-06]
Epoch 4/5:  93%|█████████▎| 1099/1177 [48:59<03:29,  2.68s/it, exist=0.2371, loss=0.4929, lr=6.60e-06]
Epoch 4/5:  93%|█████████▎| 1100/1177 [48:59<03:25,  2.67s/it, exist=0.2371, loss=0.4929, lr=6.60e-06]
Epoch 4/5:  93%|█████████▎| 1100/1177 [49:02<03:25,  2.67s/it, exist=0.2372, loss=0.4929, lr=6.59e-06]
Epoch 4/5:  94%|█████████▎| 1101/1177 [49:02<03:19,  2.63s/it, exist=0.2372, loss=0.4929, lr=6.59e-06]
Epoch 4/5:  94%|█████████▎| 1101/1177 [49:04<03:19,  2.63s/it, exist=0.2372, loss=0.4930, lr=6.58e-06]
Epoch 4/5:  94%|█████████▎| 1102/1177 [49:04<03:15,  2.60s/it, exist=0.2372, loss=0.4930, lr=6.58e-06]
Epoch 4/5:  94%|█████████▎| 1102/1177 [49:07<03:15,  2.60s/it, exist=0.2374, loss=0.4931, lr=6.57e-06]
Epoch 4/5:  94%|█████████▎| 1103/1177 [49:07<03:11,  2.59s/it, exist=0.2374, loss=0.4931, lr=6.57e-06]
Epoch 4/5:  94%|█████████▎| 1103/1177 [49:09<03:11,  2.59s/it, exist=0.2375, loss=0.4933, lr=6.56e-06]
Epoch 4/5:  94%|█████████▍| 1104/1177 [49:09<03:09,  2.60s/it, exist=0.2375, loss=0.4933, lr=6.56e-06]
Epoch 4/5:  94%|█████████▍| 1104/1177 [49:11<03:09,  2.60s/it, exist=0.2377, loss=0.4935, lr=6.55e-06]
Epoch 4/5:  94%|█████████▍| 1105/1177 [49:11<02:54,  2.42s/it, exist=0.2377, loss=0.4935, lr=6.55e-06]
Epoch 4/5:  94%|█████████▍| 1105/1177 [49:15<02:54,  2.42s/it, exist=0.2375, loss=0.4933, lr=6.54e-06]
Epoch 4/5:  94%|█████████▍| 1106/1177 [49:15<03:08,  2.65s/it, exist=0.2375, loss=0.4933, lr=6.54e-06]
Epoch 4/5:  94%|█████████▍| 1106/1177 [49:17<03:08,  2.65s/it, exist=0.2376, loss=0.4935, lr=6.53e-06]
Epoch 4/5:  94%|█████████▍| 1107/1177 [49:17<03:04,  2.63s/it, exist=0.2376, loss=0.4935, lr=6.53e-06]
Epoch 4/5:  94%|█████████▍| 1107/1177 [49:19<03:04,  2.63s/it, exist=0.2378, loss=0.4937, lr=6.52e-06]
Epoch 4/5:  94%|█████████▍| 1108/1177 [49:19<02:47,  2.43s/it, exist=0.2378, loss=0.4937, lr=6.52e-06]
Epoch 4/5:  94%|█████████▍| 1108/1177 [49:22<02:47,  2.43s/it, exist=0.2377, loss=0.4936, lr=6.51e-06]
Epoch 4/5:  94%|█████████▍| 1109/1177 [49:22<02:50,  2.50s/it, exist=0.2377, loss=0.4936, lr=6.51e-06]
Epoch 4/5:  94%|█████████▍| 1109/1177 [49:24<02:50,  2.50s/it, exist=0.2379, loss=0.4938, lr=6.50e-06]
Epoch 4/5:  94%|█████████▍| 1110/1177 [49:24<02:48,  2.51s/it, exist=0.2379, loss=0.4938, lr=6.50e-06]
Epoch 4/5:  94%|█████████▍| 1110/1177 [49:28<02:48,  2.51s/it, exist=0.2380, loss=0.4938, lr=6.49e-06]
Epoch 4/5:  94%|█████████▍| 1111/1177 [49:28<03:02,  2.76s/it, exist=0.2380, loss=0.4938, lr=6.49e-06]
Epoch 4/5:  94%|█████████▍| 1111/1177 [49:31<03:02,  2.76s/it, exist=0.2379, loss=0.4936, lr=6.48e-06]
Epoch 4/5:  94%|█████████▍| 1112/1177 [49:31<03:11,  2.95s/it, exist=0.2379, loss=0.4936, lr=6.48e-06]
Epoch 4/5:  94%|█████████▍| 1112/1177 [49:33<03:11,  2.95s/it, exist=0.2379, loss=0.4936, lr=6.47e-06]
Epoch 4/5:  95%|█████████▍| 1113/1177 [49:33<02:51,  2.68s/it, exist=0.2379, loss=0.4936, lr=6.47e-06]
Epoch 4/5:  95%|█████████▍| 1113/1177 [49:36<02:51,  2.68s/it, exist=0.2377, loss=0.4934, lr=6.46e-06]
Epoch 4/5:  95%|█████████▍| 1114/1177 [49:36<02:49,  2.69s/it, exist=0.2377, loss=0.4934, lr=6.46e-06]
Epoch 4/5:  95%|█████████▍| 1114/1177 [49:38<02:49,  2.69s/it, exist=0.2376, loss=0.4933, lr=6.45e-06]
Epoch 4/5:  95%|█████████▍| 1115/1177 [49:38<02:45,  2.66s/it, exist=0.2376, loss=0.4933, lr=6.45e-06]
Epoch 4/5:  95%|█████████▍| 1115/1177 [49:41<02:45,  2.66s/it, exist=0.2376, loss=0.4932, lr=6.44e-06]
Epoch 4/5:  95%|█████████▍| 1116/1177 [49:41<02:42,  2.66s/it, exist=0.2376, loss=0.4932, lr=6.44e-06]
Epoch 4/5:  95%|█████████▍| 1116/1177 [49:44<02:42,  2.66s/it, exist=0.2376, loss=0.4931, lr=6.43e-06]
Epoch 4/5:  95%|█████████▍| 1117/1177 [49:44<02:37,  2.63s/it, exist=0.2376, loss=0.4931, lr=6.43e-06]
Epoch 4/5:  95%|█████████▍| 1117/1177 [49:46<02:37,  2.63s/it, exist=0.2375, loss=0.4931, lr=6.42e-06]
Epoch 4/5:  95%|█████████▍| 1118/1177 [49:46<02:23,  2.43s/it, exist=0.2375, loss=0.4931, lr=6.42e-06]
Epoch 4/5:  95%|█████████▍| 1118/1177 [49:48<02:23,  2.43s/it, exist=0.2374, loss=0.4930, lr=6.41e-06]
Epoch 4/5:  95%|█████████▌| 1119/1177 [49:48<02:25,  2.50s/it, exist=0.2374, loss=0.4930, lr=6.41e-06]
Epoch 4/5:  95%|█████████▌| 1119/1177 [49:52<02:25,  2.50s/it, exist=0.2374, loss=0.4931, lr=6.40e-06]
Epoch 4/5:  95%|█████████▌| 1120/1177 [49:52<02:45,  2.90s/it, exist=0.2374, loss=0.4931, lr=6.40e-06]
Epoch 4/5:  95%|█████████▌| 1120/1177 [49:54<02:45,  2.90s/it, exist=0.2373, loss=0.4930, lr=6.39e-06]
Epoch 4/5:  95%|█████████▌| 1121/1177 [49:54<02:26,  2.61s/it, exist=0.2373, loss=0.4930, lr=6.39e-06]
Epoch 4/5:  95%|█████████▌| 1121/1177 [49:56<02:26,  2.61s/it, exist=0.2372, loss=0.4929, lr=6.38e-06]
Epoch 4/5:  95%|█████████▌| 1122/1177 [49:56<02:22,  2.59s/it, exist=0.2372, loss=0.4929, lr=6.38e-06]
Epoch 4/5:  95%|█████████▌| 1122/1177 [49:59<02:22,  2.59s/it, exist=0.2372, loss=0.4928, lr=6.37e-06]
Epoch 4/5:  95%|█████████▌| 1123/1177 [49:59<02:20,  2.60s/it, exist=0.2372, loss=0.4928, lr=6.37e-06]
Epoch 4/5:  95%|█████████▌| 1123/1177 [50:01<02:20,  2.60s/it, exist=0.2372, loss=0.4929, lr=6.36e-06]
Epoch 4/5:  95%|█████████▌| 1124/1177 [50:01<02:07,  2.41s/it, exist=0.2372, loss=0.4929, lr=6.36e-06]
Epoch 4/5:  95%|█████████▌| 1124/1177 [50:04<02:07,  2.41s/it, exist=0.2371, loss=0.4929, lr=6.35e-06]
Epoch 4/5:  96%|█████████▌| 1125/1177 [50:04<02:05,  2.42s/it, exist=0.2371, loss=0.4929, lr=6.35e-06]
Epoch 4/5:  96%|█████████▌| 1125/1177 [50:06<02:05,  2.42s/it, exist=0.2369, loss=0.4928, lr=6.34e-06]
Epoch 4/5:  96%|█████████▌| 1126/1177 [50:06<02:08,  2.52s/it, exist=0.2369, loss=0.4928, lr=6.34e-06]
Epoch 4/5:  96%|█████████▌| 1126/1177 [50:10<02:08,  2.52s/it, exist=0.2368, loss=0.4926, lr=6.33e-06]
Epoch 4/5:  96%|█████████▌| 1127/1177 [50:10<02:16,  2.73s/it, exist=0.2368, loss=0.4926, lr=6.33e-06]
Epoch 4/5:  96%|█████████▌| 1127/1177 [50:11<02:16,  2.73s/it, exist=0.2367, loss=0.4926, lr=6.32e-06]
Epoch 4/5:  96%|█████████▌| 1128/1177 [50:11<02:02,  2.50s/it, exist=0.2367, loss=0.4926, lr=6.32e-06]
Epoch 4/5:  96%|█████████▌| 1128/1177 [50:15<02:02,  2.50s/it, exist=0.2368, loss=0.4927, lr=6.31e-06]
Epoch 4/5:  96%|█████████▌| 1129/1177 [50:15<02:10,  2.71s/it, exist=0.2368, loss=0.4927, lr=6.31e-06]
Epoch 4/5:  96%|█████████▌| 1129/1177 [50:17<02:10,  2.71s/it, exist=0.2366, loss=0.4925, lr=6.30e-06]
Epoch 4/5:  96%|█████████▌| 1130/1177 [50:17<01:57,  2.50s/it, exist=0.2366, loss=0.4925, lr=6.30e-06]
Epoch 4/5:  96%|█████████▌| 1130/1177 [50:20<01:57,  2.50s/it, exist=0.2368, loss=0.4927, lr=6.29e-06]
Epoch 4/5:  96%|█████████▌| 1131/1177 [50:20<02:12,  2.88s/it, exist=0.2368, loss=0.4927, lr=6.29e-06]
Epoch 4/5:  96%|█████████▌| 1131/1177 [50:24<02:12,  2.88s/it, exist=0.2367, loss=0.4926, lr=6.28e-06]
Epoch 4/5:  96%|█████████▌| 1132/1177 [50:24<02:13,  2.96s/it, exist=0.2367, loss=0.4926, lr=6.28e-06]
Epoch 4/5:  96%|█████████▌| 1132/1177 [50:26<02:13,  2.96s/it, exist=0.2367, loss=0.4926, lr=6.27e-06]
Epoch 4/5:  96%|█████████▋| 1133/1177 [50:26<02:06,  2.88s/it, exist=0.2367, loss=0.4926, lr=6.27e-06]
Epoch 4/5:  96%|█████████▋| 1133/1177 [50:29<02:06,  2.88s/it, exist=0.2370, loss=0.4928, lr=6.26e-06]
Epoch 4/5:  96%|█████████▋| 1134/1177 [50:29<02:01,  2.82s/it, exist=0.2370, loss=0.4928, lr=6.26e-06]
Epoch 4/5:  96%|█████████▋| 1134/1177 [50:31<02:01,  2.82s/it, exist=0.2369, loss=0.4928, lr=6.25e-06]
Epoch 4/5:  96%|█████████▋| 1135/1177 [50:31<01:53,  2.71s/it, exist=0.2369, loss=0.4928, lr=6.25e-06]
Epoch 4/5:  96%|█████████▋| 1135/1177 [50:33<01:53,  2.71s/it, exist=0.2368, loss=0.4927, lr=6.24e-06]
Epoch 4/5:  97%|█████████▋| 1136/1177 [50:33<01:42,  2.50s/it, exist=0.2368, loss=0.4927, lr=6.24e-06]
Epoch 4/5:  97%|█████████▋| 1136/1177 [50:37<01:42,  2.50s/it, exist=0.2367, loss=0.4927, lr=6.23e-06]
Epoch 4/5:  97%|█████████▋| 1137/1177 [50:37<01:49,  2.75s/it, exist=0.2367, loss=0.4927, lr=6.23e-06]
Epoch 4/5:  97%|█████████▋| 1137/1177 [50:39<01:49,  2.75s/it, exist=0.2367, loss=0.4928, lr=6.22e-06]
Epoch 4/5:  97%|█████████▋| 1138/1177 [50:39<01:45,  2.70s/it, exist=0.2367, loss=0.4928, lr=6.22e-06]
Epoch 4/5:  97%|█████████▋| 1138/1177 [50:42<01:45,  2.70s/it, exist=0.2369, loss=0.4930, lr=6.21e-06]
Epoch 4/5:  97%|█████████▋| 1139/1177 [50:42<01:41,  2.68s/it, exist=0.2369, loss=0.4930, lr=6.21e-06]
Epoch 4/5:  97%|█████████▋| 1139/1177 [50:45<01:41,  2.68s/it, exist=0.2367, loss=0.4928, lr=6.21e-06]
Epoch 4/5:  97%|█████████▋| 1140/1177 [50:45<01:38,  2.67s/it, exist=0.2367, loss=0.4928, lr=6.21e-06]
Epoch 4/5:  97%|█████████▋| 1140/1177 [50:47<01:38,  2.67s/it, exist=0.2366, loss=0.4926, lr=6.20e-06]
Epoch 4/5:  97%|█████████▋| 1141/1177 [50:47<01:28,  2.47s/it, exist=0.2366, loss=0.4926, lr=6.20e-06]
Epoch 4/5:  97%|█████████▋| 1141/1177 [50:50<01:28,  2.47s/it, exist=0.2367, loss=0.4926, lr=6.19e-06]
Epoch 4/5:  97%|█████████▋| 1142/1177 [50:50<01:34,  2.71s/it, exist=0.2367, loss=0.4926, lr=6.19e-06]
Epoch 4/5:  97%|█████████▋| 1142/1177 [50:52<01:34,  2.71s/it, exist=0.2367, loss=0.4926, lr=6.18e-06]
Epoch 4/5:  97%|█████████▋| 1143/1177 [50:52<01:24,  2.49s/it, exist=0.2367, loss=0.4926, lr=6.18e-06]
Epoch 4/5:  97%|█████████▋| 1143/1177 [50:55<01:24,  2.49s/it, exist=0.2366, loss=0.4924, lr=6.17e-06]
Epoch 4/5:  97%|█████████▋| 1144/1177 [50:55<01:30,  2.73s/it, exist=0.2366, loss=0.4924, lr=6.17e-06]
Epoch 4/5:  97%|█████████▋| 1144/1177 [50:58<01:30,  2.73s/it, exist=0.2367, loss=0.4925, lr=6.16e-06]
Epoch 4/5:  97%|█████████▋| 1145/1177 [50:58<01:26,  2.72s/it, exist=0.2367, loss=0.4925, lr=6.16e-06]
Epoch 4/5:  97%|█████████▋| 1145/1177 [51:00<01:26,  2.72s/it, exist=0.2366, loss=0.4923, lr=6.15e-06]
Epoch 4/5:  97%|█████████▋| 1146/1177 [51:00<01:23,  2.70s/it, exist=0.2366, loss=0.4923, lr=6.15e-06]
Epoch 4/5:  97%|█████████▋| 1146/1177 [51:03<01:23,  2.70s/it, exist=0.2365, loss=0.4923, lr=6.14e-06]
Epoch 4/5:  97%|█████████▋| 1147/1177 [51:03<01:20,  2.67s/it, exist=0.2365, loss=0.4923, lr=6.14e-06]
Epoch 4/5:  97%|█████████▋| 1147/1177 [51:06<01:20,  2.67s/it, exist=0.2364, loss=0.4921, lr=6.13e-06]
Epoch 4/5:  98%|█████████▊| 1148/1177 [51:06<01:17,  2.66s/it, exist=0.2364, loss=0.4921, lr=6.13e-06]
Epoch 4/5:  98%|█████████▊| 1148/1177 [51:08<01:17,  2.66s/it, exist=0.2366, loss=0.4923, lr=6.12e-06]
Epoch 4/5:  98%|█████████▊| 1149/1177 [51:08<01:08,  2.46s/it, exist=0.2366, loss=0.4923, lr=6.12e-06]
Epoch 4/5:  98%|█████████▊| 1149/1177 [51:10<01:08,  2.46s/it, exist=0.2367, loss=0.4924, lr=6.11e-06]
Epoch 4/5:  98%|█████████▊| 1150/1177 [51:10<01:08,  2.54s/it, exist=0.2367, loss=0.4924, lr=6.11e-06]
Epoch 4/5:  98%|█████████▊| 1150/1177 [51:14<01:08,  2.54s/it, exist=0.2367, loss=0.4924, lr=6.10e-06]
Epoch 4/5:  98%|█████████▊| 1151/1177 [51:14<01:15,  2.90s/it, exist=0.2367, loss=0.4924, lr=6.10e-06]
Epoch 4/5:  98%|█████████▊| 1151/1177 [51:17<01:15,  2.90s/it, exist=0.2366, loss=0.4923, lr=6.09e-06]
Epoch 4/5:  98%|█████████▊| 1152/1177 [51:17<01:09,  2.79s/it, exist=0.2366, loss=0.4923, lr=6.09e-06]
Epoch 4/5:  98%|█████████▊| 1152/1177 [51:19<01:09,  2.79s/it, exist=0.2367, loss=0.4923, lr=6.08e-06]
Epoch 4/5:  98%|█████████▊| 1153/1177 [51:19<01:01,  2.55s/it, exist=0.2367, loss=0.4923, lr=6.08e-06]
Epoch 4/5:  98%|█████████▊| 1153/1177 [51:21<01:01,  2.55s/it, exist=0.2366, loss=0.4922, lr=6.07e-06]
Epoch 4/5:  98%|█████████▊| 1154/1177 [51:21<00:58,  2.55s/it, exist=0.2366, loss=0.4922, lr=6.07e-06]
Epoch 4/5:  98%|█████████▊| 1154/1177 [51:23<00:58,  2.55s/it, exist=0.2365, loss=0.4921, lr=6.06e-06]
Epoch 4/5:  98%|█████████▊| 1155/1177 [51:23<00:52,  2.39s/it, exist=0.2365, loss=0.4921, lr=6.06e-06]
Epoch 4/5:  98%|█████████▊| 1155/1177 [51:26<00:52,  2.39s/it, exist=0.2367, loss=0.4921, lr=6.05e-06]
Epoch 4/5:  98%|█████████▊| 1156/1177 [51:26<00:50,  2.42s/it, exist=0.2367, loss=0.4921, lr=6.05e-06]
Epoch 4/5:  98%|█████████▊| 1156/1177 [51:29<00:50,  2.42s/it, exist=0.2365, loss=0.4920, lr=6.04e-06]
Epoch 4/5:  98%|█████████▊| 1157/1177 [51:29<00:53,  2.68s/it, exist=0.2365, loss=0.4920, lr=6.04e-06]
Epoch 4/5:  98%|█████████▊| 1157/1177 [51:32<00:53,  2.68s/it, exist=0.2366, loss=0.4920, lr=6.03e-06]
Epoch 4/5:  98%|█████████▊| 1158/1177 [51:32<00:51,  2.69s/it, exist=0.2366, loss=0.4920, lr=6.03e-06]
Epoch 4/5:  98%|█████████▊| 1158/1177 [51:34<00:51,  2.69s/it, exist=0.2368, loss=0.4923, lr=6.02e-06]
Epoch 4/5:  98%|█████████▊| 1159/1177 [51:34<00:47,  2.63s/it, exist=0.2368, loss=0.4923, lr=6.02e-06]
Epoch 4/5:  98%|█████████▊| 1159/1177 [51:37<00:47,  2.63s/it, exist=0.2366, loss=0.4921, lr=6.01e-06]
Epoch 4/5:  99%|█████████▊| 1160/1177 [51:37<00:44,  2.62s/it, exist=0.2366, loss=0.4921, lr=6.01e-06]
Epoch 4/5:  99%|█████████▊| 1160/1177 [51:39<00:44,  2.62s/it, exist=0.2368, loss=0.4923, lr=6.00e-06]
Epoch 4/5:  99%|█████████▊| 1161/1177 [51:39<00:39,  2.46s/it, exist=0.2368, loss=0.4923, lr=6.00e-06]
Epoch 4/5:  99%|█████████▊| 1161/1177 [51:42<00:39,  2.46s/it, exist=0.2368, loss=0.4923, lr=5.99e-06]
Epoch 4/5:  99%|█████████▊| 1162/1177 [51:42<00:37,  2.49s/it, exist=0.2368, loss=0.4923, lr=5.99e-06]
Epoch 4/5:  99%|█████████▊| 1162/1177 [51:45<00:37,  2.49s/it, exist=0.2367, loss=0.4921, lr=5.98e-06]
Epoch 4/5:  99%|█████████▉| 1163/1177 [51:45<00:38,  2.73s/it, exist=0.2367, loss=0.4921, lr=5.98e-06]
Epoch 4/5:  99%|█████████▉| 1163/1177 [51:48<00:38,  2.73s/it, exist=0.2365, loss=0.4919, lr=5.97e-06]
Epoch 4/5:  99%|█████████▉| 1164/1177 [51:48<00:37,  2.86s/it, exist=0.2365, loss=0.4919, lr=5.97e-06]
Epoch 4/5:  99%|█████████▉| 1164/1177 [51:50<00:37,  2.86s/it, exist=0.2369, loss=0.4922, lr=5.96e-06]
Epoch 4/5:  99%|█████████▉| 1165/1177 [51:50<00:31,  2.60s/it, exist=0.2369, loss=0.4922, lr=5.96e-06]
Epoch 4/5:  99%|█████████▉| 1165/1177 [51:53<00:31,  2.60s/it, exist=0.2368, loss=0.4922, lr=5.95e-06]
Epoch 4/5:  99%|█████████▉| 1166/1177 [51:53<00:28,  2.59s/it, exist=0.2368, loss=0.4922, lr=5.95e-06]
Epoch 4/5:  99%|█████████▉| 1166/1177 [51:55<00:28,  2.59s/it, exist=0.2369, loss=0.4923, lr=5.94e-06]
Epoch 4/5:  99%|█████████▉| 1167/1177 [51:55<00:25,  2.56s/it, exist=0.2369, loss=0.4923, lr=5.94e-06]
Epoch 4/5:  99%|█████████▉| 1167/1177 [51:57<00:25,  2.56s/it, exist=0.2370, loss=0.4925, lr=5.93e-06]
Epoch 4/5:  99%|█████████▉| 1168/1177 [51:57<00:22,  2.53s/it, exist=0.2370, loss=0.4925, lr=5.93e-06]
Epoch 4/5:  99%|█████████▉| 1168/1177 [52:00<00:22,  2.53s/it, exist=0.2369, loss=0.4923, lr=5.92e-06]
Epoch 4/5:  99%|█████████▉| 1169/1177 [52:00<00:20,  2.58s/it, exist=0.2369, loss=0.4923, lr=5.92e-06]
Epoch 4/5:  99%|█████████▉| 1169/1177 [52:02<00:20,  2.58s/it, exist=0.2369, loss=0.4923, lr=5.91e-06]
Epoch 4/5:  99%|█████████▉| 1170/1177 [52:02<00:16,  2.40s/it, exist=0.2369, loss=0.4923, lr=5.91e-06]
Epoch 4/5:  99%|█████████▉| 1170/1177 [52:06<00:16,  2.40s/it, exist=0.2370, loss=0.4924, lr=5.91e-06]
Epoch 4/5:  99%|█████████▉| 1171/1177 [52:06<00:16,  2.70s/it, exist=0.2370, loss=0.4924, lr=5.91e-06]
Epoch 4/5:  99%|█████████▉| 1171/1177 [52:08<00:16,  2.70s/it, exist=0.2370, loss=0.4924, lr=5.90e-06]
Epoch 4/5: 100%|█████████▉| 1172/1177 [52:08<00:12,  2.49s/it, exist=0.2370, loss=0.4924, lr=5.90e-06]
Epoch 4/5: 100%|█████████▉| 1172/1177 [52:10<00:12,  2.49s/it, exist=0.2370, loss=0.4925, lr=5.89e-06]
Epoch 4/5: 100%|█████████▉| 1173/1177 [52:10<00:09,  2.34s/it, exist=0.2370, loss=0.4925, lr=5.89e-06]
Epoch 4/5: 100%|█████████▉| 1173/1177 [52:12<00:09,  2.34s/it, exist=0.2372, loss=0.4926, lr=5.88e-06]
Epoch 4/5: 100%|█████████▉| 1174/1177 [52:12<00:06,  2.25s/it, exist=0.2372, loss=0.4926, lr=5.88e-06]
Epoch 4/5: 100%|█████████▉| 1174/1177 [52:14<00:06,  2.25s/it, exist=0.2372, loss=0.4927, lr=5.87e-06]
Epoch 4/5: 100%|█████████▉| 1175/1177 [52:14<00:04,  2.18s/it, exist=0.2372, loss=0.4927, lr=5.87e-06]
Epoch 4/5: 100%|█████████▉| 1175/1177 [52:16<00:04,  2.18s/it, exist=0.2371, loss=0.4925, lr=5.86e-06]
Epoch 4/5: 100%|█████████▉| 1176/1177 [52:16<00:02,  2.13s/it, exist=0.2371, loss=0.4925, lr=5.86e-06]
Epoch 4/5: 100%|█████████▉| 1176/1177 [52:16<00:02,  2.13s/it, exist=0.2369, loss=0.4923, lr=5.85e-06]
Epoch 4/5: 100%|██████████| 1177/1177 [52:16<00:00,  1.56s/it, exist=0.2369, loss=0.4923, lr=5.85e-06]
Epoch 4/5: 100%|██████████| 1177/1177 [52:17<00:00,  2.67s/it, exist=0.2369, loss=0.4923, lr=5.85e-06]
Epoch 4  loss=0.4923  ce=0.0000  mask=0.1045  exist=0.2369  lr=5.85e-06
Saved: checkpoints/ec_simtoken/ec_simtoken_v1_ep4.pth
Epoch 4: skipping eval (scheduled at [2, 5, 7, 10])

Epoch 5/5:   0%|          | 0/1177 [00:00<?, ?it/s]
Epoch 5/5:   0%|          | 0/1177 [00:28<?, ?it/s, exist=0.2443, loss=0.4782, lr=5.84e-06]
Epoch 5/5:   0%|          | 1/1177 [00:28<9:23:31, 28.75s/it, exist=0.2443, loss=0.4782, lr=5.84e-06]
Epoch 5/5:   0%|          | 1/1177 [00:30<9:23:31, 28.75s/it, exist=0.2704, loss=0.5203, lr=5.83e-06]
Epoch 5/5:   0%|          | 2/1177 [00:30<4:15:02, 13.02s/it, exist=0.2704, loss=0.5203, lr=5.83e-06]
Epoch 5/5:   0%|          | 2/1177 [00:33<4:15:02, 13.02s/it, exist=0.2319, loss=0.4922, lr=5.82e-06]
Epoch 5/5:   0%|          | 3/1177 [00:33<2:42:21,  8.30s/it, exist=0.2319, loss=0.4922, lr=5.82e-06]
Epoch 5/5:   0%|          | 3/1177 [00:37<2:42:21,  8.30s/it, exist=0.2536, loss=0.5011, lr=5.81e-06]
Epoch 5/5:   0%|          | 4/1177 [00:37<2:07:14,  6.51s/it, exist=0.2536, loss=0.5011, lr=5.81e-06]
Epoch 5/5:   0%|          | 4/1177 [00:39<2:07:14,  6.51s/it, exist=0.2832, loss=0.5246, lr=5.80e-06]
Epoch 5/5:   0%|          | 5/1177 [00:39<1:35:24,  4.88s/it, exist=0.2832, loss=0.5246, lr=5.80e-06]
Epoch 5/5:   0%|          | 5/1177 [00:41<1:35:24,  4.88s/it, exist=0.2939, loss=0.5311, lr=5.79e-06]
Epoch 5/5:   1%|          | 6/1177 [00:41<1:19:14,  4.06s/it, exist=0.2939, loss=0.5311, lr=5.79e-06]
Epoch 5/5:   1%|          | 6/1177 [00:45<1:19:14,  4.06s/it, exist=0.2716, loss=0.5249, lr=5.78e-06]
Epoch 5/5:   1%|          | 7/1177 [00:45<1:18:16,  4.01s/it, exist=0.2716, loss=0.5249, lr=5.78e-06]
Epoch 5/5:   1%|          | 7/1177 [00:48<1:18:16,  4.01s/it, exist=0.2501, loss=0.5046, lr=5.77e-06]
Epoch 5/5:   1%|          | 8/1177 [00:48<1:08:51,  3.53s/it, exist=0.2501, loss=0.5046, lr=5.77e-06]
Epoch 5/5:   1%|          | 8/1177 [00:50<1:08:51,  3.53s/it, exist=0.2344, loss=0.4887, lr=5.76e-06]
Epoch 5/5:   1%|          | 9/1177 [00:50<59:57,  3.08s/it, exist=0.2344, loss=0.4887, lr=5.76e-06]  
Epoch 5/5:   1%|          | 9/1177 [00:53<59:57,  3.08s/it, exist=0.2370, loss=0.4933, lr=5.75e-06]
Epoch 5/5:   1%|          | 10/1177 [00:53<1:03:25,  3.26s/it, exist=0.2370, loss=0.4933, lr=5.75e-06]
Epoch 5/5:   1%|          | 10/1177 [00:56<1:03:25,  3.26s/it, exist=0.2326, loss=0.4957, lr=5.74e-06]
Epoch 5/5:   1%|          | 11/1177 [00:56<57:26,  2.96s/it, exist=0.2326, loss=0.4957, lr=5.74e-06]  
Epoch 5/5:   1%|          | 11/1177 [00:58<57:26,  2.96s/it, exist=0.2491, loss=0.5144, lr=5.73e-06]
Epoch 5/5:   1%|          | 12/1177 [00:58<51:32,  2.65s/it, exist=0.2491, loss=0.5144, lr=5.73e-06]
Epoch 5/5:   1%|          | 12/1177 [01:01<51:32,  2.65s/it, exist=0.2365, loss=0.4956, lr=5.72e-06]
Epoch 5/5:   1%|          | 13/1177 [01:01<54:31,  2.81s/it, exist=0.2365, loss=0.4956, lr=5.72e-06]
Epoch 5/5:   1%|          | 13/1177 [01:04<54:31,  2.81s/it, exist=0.2406, loss=0.4968, lr=5.72e-06]
Epoch 5/5:   1%|          | 14/1177 [01:04<57:02,  2.94s/it, exist=0.2406, loss=0.4968, lr=5.72e-06]
Epoch 5/5:   1%|          | 14/1177 [01:06<57:02,  2.94s/it, exist=0.2336, loss=0.4926, lr=5.71e-06]
Epoch 5/5:   1%|▏         | 15/1177 [01:06<51:19,  2.65s/it, exist=0.2336, loss=0.4926, lr=5.71e-06]
Epoch 5/5:   1%|▏         | 15/1177 [01:09<51:19,  2.65s/it, exist=0.2408, loss=0.5007, lr=5.70e-06]
Epoch 5/5:   1%|▏         | 16/1177 [01:09<53:57,  2.79s/it, exist=0.2408, loss=0.5007, lr=5.70e-06]
Epoch 5/5:   1%|▏         | 16/1177 [01:12<53:57,  2.79s/it, exist=0.2330, loss=0.4925, lr=5.69e-06]
Epoch 5/5:   1%|▏         | 17/1177 [01:12<52:38,  2.72s/it, exist=0.2330, loss=0.4925, lr=5.69e-06]
Epoch 5/5:   1%|▏         | 17/1177 [01:14<52:38,  2.72s/it, exist=0.2361, loss=0.4937, lr=5.68e-06]
Epoch 5/5:   2%|▏         | 18/1177 [01:14<48:37,  2.52s/it, exist=0.2361, loss=0.4937, lr=5.68e-06]
Epoch 5/5:   2%|▏         | 18/1177 [01:16<48:37,  2.52s/it, exist=0.2356, loss=0.4924, lr=5.67e-06]
Epoch 5/5:   2%|▏         | 19/1177 [01:16<49:10,  2.55s/it, exist=0.2356, loss=0.4924, lr=5.67e-06]
Epoch 5/5:   2%|▏         | 19/1177 [01:19<49:10,  2.55s/it, exist=0.2473, loss=0.5030, lr=5.66e-06]
Epoch 5/5:   2%|▏         | 20/1177 [01:19<49:25,  2.56s/it, exist=0.2473, loss=0.5030, lr=5.66e-06]
Epoch 5/5:   2%|▏         | 20/1177 [01:21<49:25,  2.56s/it, exist=0.2380, loss=0.4977, lr=5.65e-06]
Epoch 5/5:   2%|▏         | 21/1177 [01:21<46:08,  2.39s/it, exist=0.2380, loss=0.4977, lr=5.65e-06]
Epoch 5/5:   2%|▏         | 21/1177 [01:24<46:08,  2.39s/it, exist=0.2614, loss=0.5221, lr=5.64e-06]
Epoch 5/5:   2%|▏         | 22/1177 [01:24<49:57,  2.60s/it, exist=0.2614, loss=0.5221, lr=5.64e-06]
Epoch 5/5:   2%|▏         | 22/1177 [01:27<49:57,  2.60s/it, exist=0.2600, loss=0.5189, lr=5.63e-06]
Epoch 5/5:   2%|▏         | 23/1177 [01:27<50:03,  2.60s/it, exist=0.2600, loss=0.5189, lr=5.63e-06]
Epoch 5/5:   2%|▏         | 23/1177 [01:30<50:03,  2.60s/it, exist=0.2563, loss=0.5137, lr=5.62e-06]
Epoch 5/5:   2%|▏         | 24/1177 [01:30<56:35,  2.95s/it, exist=0.2563, loss=0.5137, lr=5.62e-06]
Epoch 5/5:   2%|▏         | 24/1177 [01:34<56:35,  2.95s/it, exist=0.2577, loss=0.5139, lr=5.61e-06]
Epoch 5/5:   2%|▏         | 25/1177 [01:34<58:36,  3.05s/it, exist=0.2577, loss=0.5139, lr=5.61e-06]
Epoch 5/5:   2%|▏         | 25/1177 [01:36<58:36,  3.05s/it, exist=0.2526, loss=0.5088, lr=5.60e-06]
Epoch 5/5:   2%|▏         | 26/1177 [01:36<52:43,  2.75s/it, exist=0.2526, loss=0.5088, lr=5.60e-06]
Epoch 5/5:   2%|▏         | 26/1177 [01:38<52:43,  2.75s/it, exist=0.2496, loss=0.5056, lr=5.59e-06]
Epoch 5/5:   2%|▏         | 27/1177 [01:38<51:53,  2.71s/it, exist=0.2496, loss=0.5056, lr=5.59e-06]
Epoch 5/5:   2%|▏         | 27/1177 [01:40<51:53,  2.71s/it, exist=0.2450, loss=0.4998, lr=5.58e-06]
Epoch 5/5:   2%|▏         | 28/1177 [01:40<47:23,  2.47s/it, exist=0.2450, loss=0.4998, lr=5.58e-06]
Epoch 5/5:   2%|▏         | 28/1177 [01:43<47:23,  2.47s/it, exist=0.2406, loss=0.4945, lr=5.57e-06]
Epoch 5/5:   2%|▏         | 29/1177 [01:43<48:14,  2.52s/it, exist=0.2406, loss=0.4945, lr=5.57e-06]
Epoch 5/5:   2%|▏         | 29/1177 [01:46<48:14,  2.52s/it, exist=0.2352, loss=0.4877, lr=5.56e-06]
Epoch 5/5:   3%|▎         | 30/1177 [01:46<52:22,  2.74s/it, exist=0.2352, loss=0.4877, lr=5.56e-06]
Epoch 5/5:   3%|▎         | 30/1177 [01:49<52:22,  2.74s/it, exist=0.2442, loss=0.5054, lr=5.56e-06]
Epoch 5/5:   3%|▎         | 31/1177 [01:49<51:25,  2.69s/it, exist=0.2442, loss=0.5054, lr=5.56e-06]
Epoch 5/5:   3%|▎         | 31/1177 [01:51<51:25,  2.69s/it, exist=0.2395, loss=0.5004, lr=5.55e-06]
Epoch 5/5:   3%|▎         | 32/1177 [01:51<50:30,  2.65s/it, exist=0.2395, loss=0.5004, lr=5.55e-06]
Epoch 5/5:   3%|▎         | 32/1177 [01:53<50:30,  2.65s/it, exist=0.2527, loss=0.5141, lr=5.54e-06]
Epoch 5/5:   3%|▎         | 33/1177 [01:53<46:13,  2.42s/it, exist=0.2527, loss=0.5141, lr=5.54e-06]
Epoch 5/5:   3%|▎         | 33/1177 [01:56<46:13,  2.42s/it, exist=0.2553, loss=0.5148, lr=5.53e-06]
Epoch 5/5:   3%|▎         | 34/1177 [01:56<47:06,  2.47s/it, exist=0.2553, loss=0.5148, lr=5.53e-06]
Epoch 5/5:   3%|▎         | 34/1177 [01:58<47:06,  2.47s/it, exist=0.2566, loss=0.5153, lr=5.52e-06]
Epoch 5/5:   3%|▎         | 35/1177 [01:58<47:51,  2.51s/it, exist=0.2566, loss=0.5153, lr=5.52e-06]
Epoch 5/5:   3%|▎         | 35/1177 [02:01<47:51,  2.51s/it, exist=0.2515, loss=0.5158, lr=5.51e-06]
Epoch 5/5:   3%|▎         | 36/1177 [02:01<50:57,  2.68s/it, exist=0.2515, loss=0.5158, lr=5.51e-06]
Epoch 5/5:   3%|▎         | 36/1177 [02:04<50:57,  2.68s/it, exist=0.2503, loss=0.5160, lr=5.50e-06]
Epoch 5/5:   3%|▎         | 37/1177 [02:04<50:28,  2.66s/it, exist=0.2503, loss=0.5160, lr=5.50e-06]
Epoch 5/5:   3%|▎         | 37/1177 [02:06<50:28,  2.66s/it, exist=0.2548, loss=0.5185, lr=5.49e-06]
Epoch 5/5:   3%|▎         | 38/1177 [02:06<47:13,  2.49s/it, exist=0.2548, loss=0.5185, lr=5.49e-06]
Epoch 5/5:   3%|▎         | 38/1177 [02:09<47:13,  2.49s/it, exist=0.2586, loss=0.5225, lr=5.48e-06]
Epoch 5/5:   3%|▎         | 39/1177 [02:09<47:31,  2.51s/it, exist=0.2586, loss=0.5225, lr=5.48e-06]
Epoch 5/5:   3%|▎         | 39/1177 [02:11<47:31,  2.51s/it, exist=0.2539, loss=0.5165, lr=5.47e-06]
Epoch 5/5:   3%|▎         | 40/1177 [02:11<44:22,  2.34s/it, exist=0.2539, loss=0.5165, lr=5.47e-06]
Epoch 5/5:   3%|▎         | 40/1177 [02:14<44:22,  2.34s/it, exist=0.2495, loss=0.5128, lr=5.46e-06]
Epoch 5/5:   3%|▎         | 41/1177 [02:14<50:31,  2.67s/it, exist=0.2495, loss=0.5128, lr=5.46e-06]
Epoch 5/5:   3%|▎         | 41/1177 [02:17<50:31,  2.67s/it, exist=0.2463, loss=0.5109, lr=5.45e-06]
Epoch 5/5:   4%|▎         | 42/1177 [02:17<50:10,  2.65s/it, exist=0.2463, loss=0.5109, lr=5.45e-06]
Epoch 5/5:   4%|▎         | 42/1177 [02:21<50:10,  2.65s/it, exist=0.2422, loss=0.5053, lr=5.44e-06]
Epoch 5/5:   4%|▎         | 43/1177 [02:21<57:09,  3.02s/it, exist=0.2422, loss=0.5053, lr=5.44e-06]
Epoch 5/5:   4%|▎         | 43/1177 [02:23<57:09,  3.02s/it, exist=0.2419, loss=0.5041, lr=5.44e-06]
Epoch 5/5:   4%|▎         | 44/1177 [02:23<51:23,  2.72s/it, exist=0.2419, loss=0.5041, lr=5.44e-06]
Epoch 5/5:   4%|▎         | 44/1177 [02:25<51:23,  2.72s/it, exist=0.2468, loss=0.5075, lr=5.43e-06]
Epoch 5/5:   4%|▍         | 45/1177 [02:25<47:25,  2.51s/it, exist=0.2468, loss=0.5075, lr=5.43e-06]
Epoch 5/5:   4%|▍         | 45/1177 [02:27<47:25,  2.51s/it, exist=0.2431, loss=0.5042, lr=5.42e-06]
Epoch 5/5:   4%|▍         | 46/1177 [02:27<44:38,  2.37s/it, exist=0.2431, loss=0.5042, lr=5.42e-06]
Epoch 5/5:   4%|▍         | 46/1177 [02:30<44:38,  2.37s/it, exist=0.2393, loss=0.4996, lr=5.41e-06]
Epoch 5/5:   4%|▍         | 47/1177 [02:30<49:41,  2.64s/it, exist=0.2393, loss=0.4996, lr=5.41e-06]
Epoch 5/5:   4%|▍         | 47/1177 [02:32<49:41,  2.64s/it, exist=0.2362, loss=0.4949, lr=5.40e-06]
Epoch 5/5:   4%|▍         | 48/1177 [02:32<45:58,  2.44s/it, exist=0.2362, loss=0.4949, lr=5.40e-06]
Epoch 5/5:   4%|▍         | 48/1177 [02:35<45:58,  2.44s/it, exist=0.2347, loss=0.4947, lr=5.39e-06]
Epoch 5/5:   4%|▍         | 49/1177 [02:35<50:15,  2.67s/it, exist=0.2347, loss=0.4947, lr=5.39e-06]
Epoch 5/5:   4%|▍         | 49/1177 [02:38<50:15,  2.67s/it, exist=0.2375, loss=0.4967, lr=5.38e-06]
Epoch 5/5:   4%|▍         | 50/1177 [02:38<54:05,  2.88s/it, exist=0.2375, loss=0.4967, lr=5.38e-06]
Epoch 5/5:   4%|▍         | 50/1177 [02:42<54:05,  2.88s/it, exist=0.2375, loss=0.4957, lr=5.37e-06]
Epoch 5/5:   4%|▍         | 51/1177 [02:42<56:19,  3.00s/it, exist=0.2375, loss=0.4957, lr=5.37e-06]
Epoch 5/5:   4%|▍         | 51/1177 [02:44<56:19,  3.00s/it, exist=0.2358, loss=0.4959, lr=5.36e-06]
Epoch 5/5:   4%|▍         | 52/1177 [02:44<50:48,  2.71s/it, exist=0.2358, loss=0.4959, lr=5.36e-06]
Epoch 5/5:   4%|▍         | 52/1177 [02:46<50:48,  2.71s/it, exist=0.2370, loss=0.4977, lr=5.35e-06]
Epoch 5/5:   5%|▍         | 53/1177 [02:46<49:17,  2.63s/it, exist=0.2370, loss=0.4977, lr=5.35e-06]
Epoch 5/5:   5%|▍         | 53/1177 [02:48<49:17,  2.63s/it, exist=0.2353, loss=0.4951, lr=5.34e-06]
Epoch 5/5:   5%|▍         | 54/1177 [02:48<46:16,  2.47s/it, exist=0.2353, loss=0.4951, lr=5.34e-06]
Epoch 5/5:   5%|▍         | 54/1177 [02:50<46:16,  2.47s/it, exist=0.2326, loss=0.4928, lr=5.33e-06]
Epoch 5/5:   5%|▍         | 55/1177 [02:50<43:24,  2.32s/it, exist=0.2326, loss=0.4928, lr=5.33e-06]
Epoch 5/5:   5%|▍         | 55/1177 [02:54<43:24,  2.32s/it, exist=0.2304, loss=0.4907, lr=5.32e-06]
Epoch 5/5:   5%|▍         | 56/1177 [02:54<48:52,  2.62s/it, exist=0.2304, loss=0.4907, lr=5.32e-06]
Epoch 5/5:   5%|▍         | 56/1177 [02:56<48:52,  2.62s/it, exist=0.2352, loss=0.4950, lr=5.32e-06]
Epoch 5/5:   5%|▍         | 57/1177 [02:56<47:21,  2.54s/it, exist=0.2352, loss=0.4950, lr=5.32e-06]
Epoch 5/5:   5%|▍         | 57/1177 [02:59<47:21,  2.54s/it, exist=0.2323, loss=0.4928, lr=5.31e-06]
Epoch 5/5:   5%|▍         | 58/1177 [02:59<51:14,  2.75s/it, exist=0.2323, loss=0.4928, lr=5.31e-06]
Epoch 5/5:   5%|▍         | 58/1177 [03:02<51:14,  2.75s/it, exist=0.2325, loss=0.4923, lr=5.30e-06]
Epoch 5/5:   5%|▌         | 59/1177 [03:02<50:45,  2.72s/it, exist=0.2325, loss=0.4923, lr=5.30e-06]
Epoch 5/5:   5%|▌         | 59/1177 [03:04<50:45,  2.72s/it, exist=0.2381, loss=0.4972, lr=5.29e-06]
Epoch 5/5:   5%|▌         | 60/1177 [03:04<46:18,  2.49s/it, exist=0.2381, loss=0.4972, lr=5.29e-06]
Epoch 5/5:   5%|▌         | 60/1177 [03:06<46:18,  2.49s/it, exist=0.2371, loss=0.4964, lr=5.28e-06]
Epoch 5/5:   5%|▌         | 61/1177 [03:06<47:20,  2.55s/it, exist=0.2371, loss=0.4964, lr=5.28e-06]
Epoch 5/5:   5%|▌         | 61/1177 [03:09<47:20,  2.55s/it, exist=0.2355, loss=0.4955, lr=5.27e-06]
Epoch 5/5:   5%|▌         | 62/1177 [03:09<47:52,  2.58s/it, exist=0.2355, loss=0.4955, lr=5.27e-06]
Epoch 5/5:   5%|▌         | 62/1177 [03:12<47:52,  2.58s/it, exist=0.2350, loss=0.4948, lr=5.26e-06]
Epoch 5/5:   5%|▌         | 63/1177 [03:12<47:30,  2.56s/it, exist=0.2350, loss=0.4948, lr=5.26e-06]
Epoch 5/5:   5%|▌         | 63/1177 [03:15<47:30,  2.56s/it, exist=0.2384, loss=0.4985, lr=5.25e-06]
Epoch 5/5:   5%|▌         | 64/1177 [03:15<50:40,  2.73s/it, exist=0.2384, loss=0.4985, lr=5.25e-06]
Epoch 5/5:   5%|▌         | 64/1177 [03:17<50:40,  2.73s/it, exist=0.2446, loss=0.5041, lr=5.24e-06]
Epoch 5/5:   6%|▌         | 65/1177 [03:17<49:13,  2.66s/it, exist=0.2446, loss=0.5041, lr=5.24e-06]
Epoch 5/5:   6%|▌         | 65/1177 [03:20<49:13,  2.66s/it, exist=0.2418, loss=0.5012, lr=5.23e-06]
Epoch 5/5:   6%|▌         | 66/1177 [03:20<50:25,  2.72s/it, exist=0.2418, loss=0.5012, lr=5.23e-06]
Epoch 5/5:   6%|▌         | 66/1177 [03:23<50:25,  2.72s/it, exist=0.2410, loss=0.4999, lr=5.22e-06]
Epoch 5/5:   6%|▌         | 67/1177 [03:23<49:58,  2.70s/it, exist=0.2410, loss=0.4999, lr=5.22e-06]
Epoch 5/5:   6%|▌         | 67/1177 [03:25<49:58,  2.70s/it, exist=0.2420, loss=0.5014, lr=5.22e-06]
Epoch 5/5:   6%|▌         | 68/1177 [03:25<49:33,  2.68s/it, exist=0.2420, loss=0.5014, lr=5.22e-06]
Epoch 5/5:   6%|▌         | 68/1177 [03:27<49:33,  2.68s/it, exist=0.2422, loss=0.5034, lr=5.21e-06]
Epoch 5/5:   6%|▌         | 69/1177 [03:27<45:48,  2.48s/it, exist=0.2422, loss=0.5034, lr=5.21e-06]
Epoch 5/5:   6%|▌         | 69/1177 [03:29<45:48,  2.48s/it, exist=0.2458, loss=0.5061, lr=5.20e-06]
Epoch 5/5:   6%|▌         | 70/1177 [03:29<42:51,  2.32s/it, exist=0.2458, loss=0.5061, lr=5.20e-06]
Epoch 5/5:   6%|▌         | 70/1177 [03:33<42:51,  2.32s/it, exist=0.2443, loss=0.5044, lr=5.19e-06]
Epoch 5/5:   6%|▌         | 71/1177 [03:33<50:42,  2.75s/it, exist=0.2443, loss=0.5044, lr=5.19e-06]
Epoch 5/5:   6%|▌         | 71/1177 [03:36<50:42,  2.75s/it, exist=0.2473, loss=0.5064, lr=5.18e-06]
Epoch 5/5:   6%|▌         | 72/1177 [03:36<50:11,  2.73s/it, exist=0.2473, loss=0.5064, lr=5.18e-06]
Epoch 5/5:   6%|▌         | 72/1177 [03:38<50:11,  2.73s/it, exist=0.2481, loss=0.5068, lr=5.17e-06]
Epoch 5/5:   6%|▌         | 73/1177 [03:38<46:05,  2.50s/it, exist=0.2481, loss=0.5068, lr=5.17e-06]
Epoch 5/5:   6%|▌         | 73/1177 [03:41<46:05,  2.50s/it, exist=0.2528, loss=0.5116, lr=5.16e-06]
Epoch 5/5:   6%|▋         | 74/1177 [03:41<50:47,  2.76s/it, exist=0.2528, loss=0.5116, lr=5.16e-06]
Epoch 5/5:   6%|▋         | 74/1177 [03:43<50:47,  2.76s/it, exist=0.2552, loss=0.5137, lr=5.15e-06]
Epoch 5/5:   6%|▋         | 75/1177 [03:43<46:22,  2.52s/it, exist=0.2552, loss=0.5137, lr=5.15e-06]
Epoch 5/5:   6%|▋         | 75/1177 [03:46<46:22,  2.52s/it, exist=0.2527, loss=0.5111, lr=5.14e-06]
Epoch 5/5:   6%|▋         | 76/1177 [03:46<46:28,  2.53s/it, exist=0.2527, loss=0.5111, lr=5.14e-06]
Epoch 5/5:   6%|▋         | 76/1177 [03:49<46:28,  2.53s/it, exist=0.2536, loss=0.5118, lr=5.13e-06]
Epoch 5/5:   7%|▋         | 77/1177 [03:49<50:52,  2.78s/it, exist=0.2536, loss=0.5118, lr=5.13e-06]
Epoch 5/5:   7%|▋         | 77/1177 [03:51<50:52,  2.78s/it, exist=0.2549, loss=0.5124, lr=5.13e-06]
Epoch 5/5:   7%|▋         | 78/1177 [03:51<49:04,  2.68s/it, exist=0.2549, loss=0.5124, lr=5.13e-06]
Epoch 5/5:   7%|▋         | 78/1177 [03:53<49:04,  2.68s/it, exist=0.2534, loss=0.5103, lr=5.12e-06]
Epoch 5/5:   7%|▋         | 79/1177 [03:53<45:11,  2.47s/it, exist=0.2534, loss=0.5103, lr=5.12e-06]
Epoch 5/5:   7%|▋         | 79/1177 [03:57<45:11,  2.47s/it, exist=0.2510, loss=0.5072, lr=5.11e-06]
Epoch 5/5:   7%|▋         | 80/1177 [03:57<49:47,  2.72s/it, exist=0.2510, loss=0.5072, lr=5.11e-06]
Epoch 5/5:   7%|▋         | 80/1177 [03:59<49:47,  2.72s/it, exist=0.2504, loss=0.5060, lr=5.10e-06]
Epoch 5/5:   7%|▋         | 81/1177 [03:59<49:53,  2.73s/it, exist=0.2504, loss=0.5060, lr=5.10e-06]
Epoch 5/5:   7%|▋         | 81/1177 [04:02<49:53,  2.73s/it, exist=0.2497, loss=0.5072, lr=5.09e-06]
Epoch 5/5:   7%|▋         | 82/1177 [04:02<45:59,  2.52s/it, exist=0.2497, loss=0.5072, lr=5.09e-06]
Epoch 5/5:   7%|▋         | 82/1177 [04:05<45:59,  2.52s/it, exist=0.2475, loss=0.5045, lr=5.08e-06]
Epoch 5/5:   7%|▋         | 83/1177 [04:05<50:13,  2.75s/it, exist=0.2475, loss=0.5045, lr=5.08e-06]
Epoch 5/5:   7%|▋         | 83/1177 [04:07<50:13,  2.75s/it, exist=0.2470, loss=0.5039, lr=5.07e-06]
Epoch 5/5:   7%|▋         | 84/1177 [04:07<45:48,  2.51s/it, exist=0.2470, loss=0.5039, lr=5.07e-06]
Epoch 5/5:   7%|▋         | 84/1177 [04:09<45:48,  2.51s/it, exist=0.2478, loss=0.5057, lr=5.06e-06]
Epoch 5/5:   7%|▋         | 85/1177 [04:09<45:48,  2.52s/it, exist=0.2478, loss=0.5057, lr=5.06e-06]
Epoch 5/5:   7%|▋         | 85/1177 [04:12<45:48,  2.52s/it, exist=0.2469, loss=0.5046, lr=5.05e-06]
Epoch 5/5:   7%|▋         | 86/1177 [04:12<46:02,  2.53s/it, exist=0.2469, loss=0.5046, lr=5.05e-06]
Epoch 5/5:   7%|▋         | 86/1177 [04:15<46:02,  2.53s/it, exist=0.2447, loss=0.5036, lr=5.04e-06]
Epoch 5/5:   7%|▋         | 87/1177 [04:15<51:31,  2.84s/it, exist=0.2447, loss=0.5036, lr=5.04e-06]
Epoch 5/5:   7%|▋         | 87/1177 [04:17<51:31,  2.84s/it, exist=0.2494, loss=0.5081, lr=5.04e-06]
Epoch 5/5:   7%|▋         | 88/1177 [04:17<46:54,  2.58s/it, exist=0.2494, loss=0.5081, lr=5.04e-06]
Epoch 5/5:   7%|▋         | 88/1177 [04:21<46:54,  2.58s/it, exist=0.2494, loss=0.5079, lr=5.03e-06]
Epoch 5/5:   8%|▊         | 89/1177 [04:21<50:37,  2.79s/it, exist=0.2494, loss=0.5079, lr=5.03e-06]
Epoch 5/5:   8%|▊         | 89/1177 [04:23<50:37,  2.79s/it, exist=0.2483, loss=0.5065, lr=5.02e-06]
Epoch 5/5:   8%|▊         | 90/1177 [04:23<49:48,  2.75s/it, exist=0.2483, loss=0.5065, lr=5.02e-06]
Epoch 5/5:   8%|▊         | 90/1177 [04:26<49:48,  2.75s/it, exist=0.2535, loss=0.5123, lr=5.01e-06]
Epoch 5/5:   8%|▊         | 91/1177 [04:26<49:07,  2.71s/it, exist=0.2535, loss=0.5123, lr=5.01e-06]
Epoch 5/5:   8%|▊         | 91/1177 [04:29<49:07,  2.71s/it, exist=0.2516, loss=0.5101, lr=5.00e-06]
Epoch 5/5:   8%|▊         | 92/1177 [04:29<48:43,  2.69s/it, exist=0.2516, loss=0.5101, lr=5.00e-06]
Epoch 5/5:   8%|▊         | 92/1177 [04:31<48:43,  2.69s/it, exist=0.2518, loss=0.5104, lr=4.99e-06]
Epoch 5/5:   8%|▊         | 93/1177 [04:31<48:25,  2.68s/it, exist=0.2518, loss=0.5104, lr=4.99e-06]
Epoch 5/5:   8%|▊         | 93/1177 [04:34<48:25,  2.68s/it, exist=0.2513, loss=0.5097, lr=4.98e-06]
Epoch 5/5:   8%|▊         | 94/1177 [04:34<47:51,  2.65s/it, exist=0.2513, loss=0.5097, lr=4.98e-06]
Epoch 5/5:   8%|▊         | 94/1177 [04:36<47:51,  2.65s/it, exist=0.2520, loss=0.5099, lr=4.97e-06]
Epoch 5/5:   8%|▊         | 95/1177 [04:36<47:17,  2.62s/it, exist=0.2520, loss=0.5099, lr=4.97e-06]
Epoch 5/5:   8%|▊         | 95/1177 [04:38<47:17,  2.62s/it, exist=0.2512, loss=0.5092, lr=4.96e-06]
Epoch 5/5:   8%|▊         | 96/1177 [04:38<43:49,  2.43s/it, exist=0.2512, loss=0.5092, lr=4.96e-06]
Epoch 5/5:   8%|▊         | 96/1177 [04:41<43:49,  2.43s/it, exist=0.2512, loss=0.5104, lr=4.96e-06]
Epoch 5/5:   8%|▊         | 97/1177 [04:41<45:12,  2.51s/it, exist=0.2512, loss=0.5104, lr=4.96e-06]
Epoch 5/5:   8%|▊         | 97/1177 [04:44<45:12,  2.51s/it, exist=0.2493, loss=0.5080, lr=4.95e-06]
Epoch 5/5:   8%|▊         | 98/1177 [04:44<49:32,  2.75s/it, exist=0.2493, loss=0.5080, lr=4.95e-06]
Epoch 5/5:   8%|▊         | 98/1177 [04:46<49:32,  2.75s/it, exist=0.2489, loss=0.5078, lr=4.94e-06]
Epoch 5/5:   8%|▊         | 99/1177 [04:46<45:31,  2.53s/it, exist=0.2489, loss=0.5078, lr=4.94e-06]
Epoch 5/5:   8%|▊         | 99/1177 [04:50<45:31,  2.53s/it, exist=0.2483, loss=0.5069, lr=4.93e-06]
Epoch 5/5:   8%|▊         | 100/1177 [04:50<50:25,  2.81s/it, exist=0.2483, loss=0.5069, lr=4.93e-06]
Epoch 5/5:   8%|▊         | 100/1177 [04:53<50:25,  2.81s/it, exist=0.2479, loss=0.5061, lr=4.92e-06]
Epoch 5/5:   9%|▊         | 101/1177 [04:53<49:25,  2.76s/it, exist=0.2479, loss=0.5061, lr=4.92e-06]
Epoch 5/5:   9%|▊         | 101/1177 [04:55<49:25,  2.76s/it, exist=0.2468, loss=0.5046, lr=4.91e-06]
Epoch 5/5:   9%|▊         | 102/1177 [04:55<49:22,  2.76s/it, exist=0.2468, loss=0.5046, lr=4.91e-06]
Epoch 5/5:   9%|▊         | 102/1177 [04:58<49:22,  2.76s/it, exist=0.2473, loss=0.5047, lr=4.90e-06]
Epoch 5/5:   9%|▉         | 103/1177 [04:58<50:00,  2.79s/it, exist=0.2473, loss=0.5047, lr=4.90e-06]
Epoch 5/5:   9%|▉         | 103/1177 [05:01<50:00,  2.79s/it, exist=0.2459, loss=0.5027, lr=4.89e-06]
Epoch 5/5:   9%|▉         | 104/1177 [05:01<49:01,  2.74s/it, exist=0.2459, loss=0.5027, lr=4.89e-06]
Epoch 5/5:   9%|▉         | 104/1177 [05:03<49:01,  2.74s/it, exist=0.2446, loss=0.5009, lr=4.88e-06]
Epoch 5/5:   9%|▉         | 105/1177 [05:03<48:41,  2.72s/it, exist=0.2446, loss=0.5009, lr=4.88e-06]
Epoch 5/5:   9%|▉         | 105/1177 [05:05<48:41,  2.72s/it, exist=0.2427, loss=0.4989, lr=4.88e-06]
Epoch 5/5:   9%|▉         | 106/1177 [05:05<44:40,  2.50s/it, exist=0.2427, loss=0.4989, lr=4.88e-06]
Epoch 5/5:   9%|▉         | 106/1177 [05:09<44:40,  2.50s/it, exist=0.2431, loss=0.4993, lr=4.87e-06]
Epoch 5/5:   9%|▉         | 107/1177 [05:09<48:38,  2.73s/it, exist=0.2431, loss=0.4993, lr=4.87e-06]
Epoch 5/5:   9%|▉         | 107/1177 [05:11<48:38,  2.73s/it, exist=0.2416, loss=0.4979, lr=4.86e-06]
Epoch 5/5:   9%|▉         | 108/1177 [05:11<48:14,  2.71s/it, exist=0.2416, loss=0.4979, lr=4.86e-06]
Epoch 5/5:   9%|▉         | 108/1177 [05:13<48:14,  2.71s/it, exist=0.2403, loss=0.4971, lr=4.85e-06]
Epoch 5/5:   9%|▉         | 109/1177 [05:13<44:19,  2.49s/it, exist=0.2403, loss=0.4971, lr=4.85e-06]
Epoch 5/5:   9%|▉         | 109/1177 [05:16<44:19,  2.49s/it, exist=0.2411, loss=0.4987, lr=4.84e-06]
Epoch 5/5:   9%|▉         | 110/1177 [05:16<47:41,  2.68s/it, exist=0.2411, loss=0.4987, lr=4.84e-06]
Epoch 5/5:   9%|▉         | 110/1177 [05:19<47:41,  2.68s/it, exist=0.2420, loss=0.4990, lr=4.83e-06]
Epoch 5/5:   9%|▉         | 111/1177 [05:19<48:46,  2.75s/it, exist=0.2420, loss=0.4990, lr=4.83e-06]
Epoch 5/5:   9%|▉         | 111/1177 [05:22<48:46,  2.75s/it, exist=0.2409, loss=0.4975, lr=4.82e-06]
Epoch 5/5:  10%|▉         | 112/1177 [05:22<48:18,  2.72s/it, exist=0.2409, loss=0.4975, lr=4.82e-06]
Epoch 5/5:  10%|▉         | 112/1177 [05:25<48:18,  2.72s/it, exist=0.2416, loss=0.4985, lr=4.81e-06]
Epoch 5/5:  10%|▉         | 113/1177 [05:25<48:35,  2.74s/it, exist=0.2416, loss=0.4985, lr=4.81e-06]
Epoch 5/5:  10%|▉         | 113/1177 [05:27<48:35,  2.74s/it, exist=0.2401, loss=0.4974, lr=4.81e-06]
Epoch 5/5:  10%|▉         | 114/1177 [05:27<44:04,  2.49s/it, exist=0.2401, loss=0.4974, lr=4.81e-06]
Epoch 5/5:  10%|▉         | 114/1177 [05:31<44:04,  2.49s/it, exist=0.2409, loss=0.4981, lr=4.80e-06]
Epoch 5/5:  10%|▉         | 115/1177 [05:31<53:25,  3.02s/it, exist=0.2409, loss=0.4981, lr=4.80e-06]
Epoch 5/5:  10%|▉         | 115/1177 [05:33<53:25,  3.02s/it, exist=0.2401, loss=0.4997, lr=4.79e-06]
Epoch 5/5:  10%|▉         | 116/1177 [05:33<48:04,  2.72s/it, exist=0.2401, loss=0.4997, lr=4.79e-06]
Epoch 5/5:  10%|▉         | 116/1177 [05:35<48:04,  2.72s/it, exist=0.2388, loss=0.4984, lr=4.78e-06]
Epoch 5/5:  10%|▉         | 117/1177 [05:35<44:09,  2.50s/it, exist=0.2388, loss=0.4984, lr=4.78e-06]
Epoch 5/5:  10%|▉         | 117/1177 [05:38<44:09,  2.50s/it, exist=0.2387, loss=0.4985, lr=4.77e-06]
Epoch 5/5:  10%|█         | 118/1177 [05:38<48:58,  2.77s/it, exist=0.2387, loss=0.4985, lr=4.77e-06]
Epoch 5/5:  10%|█         | 118/1177 [05:40<48:58,  2.77s/it, exist=0.2385, loss=0.4985, lr=4.76e-06]
Epoch 5/5:  10%|█         | 119/1177 [05:40<44:33,  2.53s/it, exist=0.2385, loss=0.4985, lr=4.76e-06]
Epoch 5/5:  10%|█         | 119/1177 [05:43<44:33,  2.53s/it, exist=0.2373, loss=0.4974, lr=4.75e-06]
Epoch 5/5:  10%|█         | 120/1177 [05:43<44:58,  2.55s/it, exist=0.2373, loss=0.4974, lr=4.75e-06]
Epoch 5/5:  10%|█         | 120/1177 [05:45<44:58,  2.55s/it, exist=0.2387, loss=0.4991, lr=4.74e-06]
Epoch 5/5:  10%|█         | 121/1177 [05:45<41:58,  2.39s/it, exist=0.2387, loss=0.4991, lr=4.74e-06]
Epoch 5/5:  10%|█         | 121/1177 [05:49<41:58,  2.39s/it, exist=0.2396, loss=0.5010, lr=4.74e-06]
Epoch 5/5:  10%|█         | 122/1177 [05:49<49:02,  2.79s/it, exist=0.2396, loss=0.5010, lr=4.74e-06]
Epoch 5/5:  10%|█         | 122/1177 [05:51<49:02,  2.79s/it, exist=0.2400, loss=0.5017, lr=4.73e-06]
Epoch 5/5:  10%|█         | 123/1177 [05:51<48:02,  2.73s/it, exist=0.2400, loss=0.5017, lr=4.73e-06]
Epoch 5/5:  10%|█         | 123/1177 [05:54<48:02,  2.73s/it, exist=0.2409, loss=0.5022, lr=4.72e-06]
Epoch 5/5:  11%|█         | 124/1177 [05:54<47:29,  2.71s/it, exist=0.2409, loss=0.5022, lr=4.72e-06]
Epoch 5/5:  11%|█         | 124/1177 [05:56<47:29,  2.71s/it, exist=0.2416, loss=0.5028, lr=4.71e-06]
Epoch 5/5:  11%|█         | 125/1177 [05:56<43:34,  2.48s/it, exist=0.2416, loss=0.5028, lr=4.71e-06]
Epoch 5/5:  11%|█         | 125/1177 [05:58<43:34,  2.48s/it, exist=0.2417, loss=0.5026, lr=4.70e-06]
Epoch 5/5:  11%|█         | 126/1177 [05:58<43:44,  2.50s/it, exist=0.2417, loss=0.5026, lr=4.70e-06]
Epoch 5/5:  11%|█         | 126/1177 [06:00<43:44,  2.50s/it, exist=0.2415, loss=0.5019, lr=4.69e-06]
Epoch 5/5:  11%|█         | 127/1177 [06:00<40:47,  2.33s/it, exist=0.2415, loss=0.5019, lr=4.69e-06]
Epoch 5/5:  11%|█         | 127/1177 [06:03<40:47,  2.33s/it, exist=0.2412, loss=0.5021, lr=4.68e-06]
Epoch 5/5:  11%|█         | 128/1177 [06:03<42:40,  2.44s/it, exist=0.2412, loss=0.5021, lr=4.68e-06]
Epoch 5/5:  11%|█         | 128/1177 [06:07<42:40,  2.44s/it, exist=0.2417, loss=0.5029, lr=4.68e-06]
Epoch 5/5:  11%|█         | 129/1177 [06:07<50:04,  2.87s/it, exist=0.2417, loss=0.5029, lr=4.68e-06]
Epoch 5/5:  11%|█         | 129/1177 [06:09<50:04,  2.87s/it, exist=0.2404, loss=0.5013, lr=4.67e-06]
Epoch 5/5:  11%|█         | 130/1177 [06:09<45:24,  2.60s/it, exist=0.2404, loss=0.5013, lr=4.67e-06]
Epoch 5/5:  11%|█         | 130/1177 [06:11<45:24,  2.60s/it, exist=0.2402, loss=0.5012, lr=4.66e-06]
Epoch 5/5:  11%|█         | 131/1177 [06:11<42:09,  2.42s/it, exist=0.2402, loss=0.5012, lr=4.66e-06]
Epoch 5/5:  11%|█         | 131/1177 [06:15<42:09,  2.42s/it, exist=0.2407, loss=0.5015, lr=4.65e-06]
Epoch 5/5:  11%|█         | 132/1177 [06:15<50:04,  2.88s/it, exist=0.2407, loss=0.5015, lr=4.65e-06]
Epoch 5/5:  11%|█         | 132/1177 [06:17<50:04,  2.88s/it, exist=0.2405, loss=0.5012, lr=4.64e-06]
Epoch 5/5:  11%|█▏        | 133/1177 [06:17<47:27,  2.73s/it, exist=0.2405, loss=0.5012, lr=4.64e-06]
Epoch 5/5:  11%|█▏        | 133/1177 [06:20<47:27,  2.73s/it, exist=0.2396, loss=0.5007, lr=4.63e-06]
Epoch 5/5:  11%|█▏        | 134/1177 [06:20<46:06,  2.65s/it, exist=0.2396, loss=0.5007, lr=4.63e-06]
Epoch 5/5:  11%|█▏        | 134/1177 [06:22<46:06,  2.65s/it, exist=0.2385, loss=0.4994, lr=4.62e-06]
Epoch 5/5:  11%|█▏        | 135/1177 [06:22<46:50,  2.70s/it, exist=0.2385, loss=0.4994, lr=4.62e-06]
Epoch 5/5:  11%|█▏        | 135/1177 [06:24<46:50,  2.70s/it, exist=0.2375, loss=0.4982, lr=4.62e-06]
Epoch 5/5:  12%|█▏        | 136/1177 [06:24<43:04,  2.48s/it, exist=0.2375, loss=0.4982, lr=4.62e-06]
Epoch 5/5:  12%|█▏        | 136/1177 [06:27<43:04,  2.48s/it, exist=0.2362, loss=0.4968, lr=4.61e-06]
Epoch 5/5:  12%|█▏        | 137/1177 [06:27<43:09,  2.49s/it, exist=0.2362, loss=0.4968, lr=4.61e-06]
Epoch 5/5:  12%|█▏        | 137/1177 [06:30<43:09,  2.49s/it, exist=0.2354, loss=0.4956, lr=4.60e-06]
Epoch 5/5:  12%|█▏        | 138/1177 [06:30<43:52,  2.53s/it, exist=0.2354, loss=0.4956, lr=4.60e-06]
Epoch 5/5:  12%|█▏        | 138/1177 [06:32<43:52,  2.53s/it, exist=0.2350, loss=0.4950, lr=4.59e-06]
Epoch 5/5:  12%|█▏        | 139/1177 [06:32<40:53,  2.36s/it, exist=0.2350, loss=0.4950, lr=4.59e-06]
Epoch 5/5:  12%|█▏        | 139/1177 [06:35<40:53,  2.36s/it, exist=0.2346, loss=0.4944, lr=4.58e-06]
Epoch 5/5:  12%|█▏        | 140/1177 [06:35<45:16,  2.62s/it, exist=0.2346, loss=0.4944, lr=4.58e-06]
Epoch 5/5:  12%|█▏        | 140/1177 [06:37<45:16,  2.62s/it, exist=0.2354, loss=0.4956, lr=4.57e-06]
Epoch 5/5:  12%|█▏        | 141/1177 [06:37<41:46,  2.42s/it, exist=0.2354, loss=0.4956, lr=4.57e-06]
Epoch 5/5:  12%|█▏        | 141/1177 [06:40<41:46,  2.42s/it, exist=0.2343, loss=0.4943, lr=4.56e-06]
Epoch 5/5:  12%|█▏        | 142/1177 [06:40<45:55,  2.66s/it, exist=0.2343, loss=0.4943, lr=4.56e-06]
Epoch 5/5:  12%|█▏        | 142/1177 [06:43<45:55,  2.66s/it, exist=0.2343, loss=0.4939, lr=4.56e-06]
Epoch 5/5:  12%|█▏        | 143/1177 [06:43<48:44,  2.83s/it, exist=0.2343, loss=0.4939, lr=4.56e-06]
Epoch 5/5:  12%|█▏        | 143/1177 [06:45<48:44,  2.83s/it, exist=0.2345, loss=0.4936, lr=4.55e-06]
Epoch 5/5:  12%|█▏        | 144/1177 [06:45<44:19,  2.57s/it, exist=0.2345, loss=0.4936, lr=4.55e-06]
Epoch 5/5:  12%|█▏        | 144/1177 [06:48<44:19,  2.57s/it, exist=0.2334, loss=0.4923, lr=4.54e-06]
Epoch 5/5:  12%|█▏        | 145/1177 [06:48<44:07,  2.57s/it, exist=0.2334, loss=0.4923, lr=4.54e-06]
Epoch 5/5:  12%|█▏        | 145/1177 [06:51<44:07,  2.57s/it, exist=0.2330, loss=0.4914, lr=4.53e-06]
Epoch 5/5:  12%|█▏        | 146/1177 [06:51<49:11,  2.86s/it, exist=0.2330, loss=0.4914, lr=4.53e-06]
Epoch 5/5:  12%|█▏        | 146/1177 [06:54<49:11,  2.86s/it, exist=0.2323, loss=0.4908, lr=4.52e-06]
Epoch 5/5:  12%|█▏        | 147/1177 [06:54<48:31,  2.83s/it, exist=0.2323, loss=0.4908, lr=4.52e-06]
Epoch 5/5:  12%|█▏        | 147/1177 [06:57<48:31,  2.83s/it, exist=0.2333, loss=0.4914, lr=4.51e-06]
Epoch 5/5:  13%|█▎        | 148/1177 [06:57<47:45,  2.78s/it, exist=0.2333, loss=0.4914, lr=4.51e-06]
Epoch 5/5:  13%|█▎        | 148/1177 [06:59<47:45,  2.78s/it, exist=0.2351, loss=0.4929, lr=4.50e-06]
Epoch 5/5:  13%|█▎        | 149/1177 [06:59<46:02,  2.69s/it, exist=0.2351, loss=0.4929, lr=4.50e-06]
Epoch 5/5:  13%|█▎        | 149/1177 [07:01<46:02,  2.69s/it, exist=0.2342, loss=0.4917, lr=4.50e-06]
Epoch 5/5:  13%|█▎        | 150/1177 [07:01<42:15,  2.47s/it, exist=0.2342, loss=0.4917, lr=4.50e-06]
Epoch 5/5:  13%|█▎        | 150/1177 [07:04<42:15,  2.47s/it, exist=0.2332, loss=0.4907, lr=4.49e-06]
Epoch 5/5:  13%|█▎        | 151/1177 [07:04<42:50,  2.51s/it, exist=0.2332, loss=0.4907, lr=4.49e-06]
Epoch 5/5:  13%|█▎        | 151/1177 [07:06<42:50,  2.51s/it, exist=0.2333, loss=0.4911, lr=4.48e-06]
Epoch 5/5:  13%|█▎        | 152/1177 [07:06<40:02,  2.34s/it, exist=0.2333, loss=0.4911, lr=4.48e-06]
Epoch 5/5:  13%|█▎        | 152/1177 [07:10<40:02,  2.34s/it, exist=0.2330, loss=0.4910, lr=4.47e-06]
Epoch 5/5:  13%|█▎        | 153/1177 [07:10<48:11,  2.82s/it, exist=0.2330, loss=0.4910, lr=4.47e-06]
Epoch 5/5:  13%|█▎        | 153/1177 [07:12<48:11,  2.82s/it, exist=0.2322, loss=0.4904, lr=4.46e-06]
Epoch 5/5:  13%|█▎        | 154/1177 [07:12<47:07,  2.76s/it, exist=0.2322, loss=0.4904, lr=4.46e-06]
Epoch 5/5:  13%|█▎        | 154/1177 [07:15<47:07,  2.76s/it, exist=0.2314, loss=0.4895, lr=4.45e-06]
Epoch 5/5:  13%|█▎        | 155/1177 [07:15<46:36,  2.74s/it, exist=0.2314, loss=0.4895, lr=4.45e-06]
Epoch 5/5:  13%|█▎        | 155/1177 [07:18<46:36,  2.74s/it, exist=0.2334, loss=0.4917, lr=4.45e-06]
Epoch 5/5:  13%|█▎        | 156/1177 [07:18<46:30,  2.73s/it, exist=0.2334, loss=0.4917, lr=4.45e-06]
Epoch 5/5:  13%|█▎        | 156/1177 [07:20<46:30,  2.73s/it, exist=0.2338, loss=0.4922, lr=4.44e-06]
Epoch 5/5:  13%|█▎        | 157/1177 [07:20<46:21,  2.73s/it, exist=0.2338, loss=0.4922, lr=4.44e-06]
Epoch 5/5:  13%|█▎        | 157/1177 [07:22<46:21,  2.73s/it, exist=0.2333, loss=0.4918, lr=4.43e-06]
Epoch 5/5:  13%|█▎        | 158/1177 [07:22<42:22,  2.49s/it, exist=0.2333, loss=0.4918, lr=4.43e-06]
Epoch 5/5:  13%|█▎        | 158/1177 [07:24<42:22,  2.49s/it, exist=0.2348, loss=0.4932, lr=4.42e-06]
Epoch 5/5:  14%|█▎        | 159/1177 [07:24<39:18,  2.32s/it, exist=0.2348, loss=0.4932, lr=4.42e-06]
Epoch 5/5:  14%|█▎        | 159/1177 [07:28<39:18,  2.32s/it, exist=0.2376, loss=0.4957, lr=4.41e-06]
Epoch 5/5:  14%|█▎        | 160/1177 [07:28<48:25,  2.86s/it, exist=0.2376, loss=0.4957, lr=4.41e-06]
Epoch 5/5:  14%|█▎        | 160/1177 [07:31<48:25,  2.86s/it, exist=0.2368, loss=0.4950, lr=4.40e-06]
Epoch 5/5:  14%|█▎        | 161/1177 [07:31<47:09,  2.79s/it, exist=0.2368, loss=0.4950, lr=4.40e-06]
Epoch 5/5:  14%|█▎        | 161/1177 [07:33<47:09,  2.79s/it, exist=0.2375, loss=0.4956, lr=4.39e-06]
Epoch 5/5:  14%|█▍        | 162/1177 [07:33<42:57,  2.54s/it, exist=0.2375, loss=0.4956, lr=4.39e-06]
Epoch 5/5:  14%|█▍        | 162/1177 [07:36<42:57,  2.54s/it, exist=0.2368, loss=0.4945, lr=4.39e-06]
Epoch 5/5:  14%|█▍        | 163/1177 [07:36<47:42,  2.82s/it, exist=0.2368, loss=0.4945, lr=4.39e-06]
Epoch 5/5:  14%|█▍        | 163/1177 [07:39<47:42,  2.82s/it, exist=0.2360, loss=0.4933, lr=4.38e-06]
Epoch 5/5:  14%|█▍        | 164/1177 [07:39<46:51,  2.78s/it, exist=0.2360, loss=0.4933, lr=4.38e-06]
Epoch 5/5:  14%|█▍        | 164/1177 [07:42<46:51,  2.78s/it, exist=0.2373, loss=0.4950, lr=4.37e-06]
Epoch 5/5:  14%|█▍        | 165/1177 [07:42<45:54,  2.72s/it, exist=0.2373, loss=0.4950, lr=4.37e-06]
Epoch 5/5:  14%|█▍        | 165/1177 [07:44<45:54,  2.72s/it, exist=0.2392, loss=0.4968, lr=4.36e-06]
Epoch 5/5:  14%|█▍        | 166/1177 [07:44<45:09,  2.68s/it, exist=0.2392, loss=0.4968, lr=4.36e-06]
Epoch 5/5:  14%|█▍        | 166/1177 [07:47<45:09,  2.68s/it, exist=0.2387, loss=0.4965, lr=4.35e-06]
Epoch 5/5:  14%|█▍        | 167/1177 [07:47<46:17,  2.75s/it, exist=0.2387, loss=0.4965, lr=4.35e-06]
Epoch 5/5:  14%|█▍        | 167/1177 [07:50<46:17,  2.75s/it, exist=0.2379, loss=0.4956, lr=4.34e-06]
Epoch 5/5:  14%|█▍        | 168/1177 [07:50<46:02,  2.74s/it, exist=0.2379, loss=0.4956, lr=4.34e-06]
Epoch 5/5:  14%|█▍        | 168/1177 [07:52<46:02,  2.74s/it, exist=0.2383, loss=0.4960, lr=4.34e-06]
Epoch 5/5:  14%|█▍        | 169/1177 [07:52<42:10,  2.51s/it, exist=0.2383, loss=0.4960, lr=4.34e-06]
Epoch 5/5:  14%|█▍        | 169/1177 [07:55<42:10,  2.51s/it, exist=0.2407, loss=0.4983, lr=4.33e-06]
Epoch 5/5:  14%|█▍        | 170/1177 [07:55<44:54,  2.68s/it, exist=0.2407, loss=0.4983, lr=4.33e-06]
Epoch 5/5:  14%|█▍        | 170/1177 [07:57<44:54,  2.68s/it, exist=0.2418, loss=0.5004, lr=4.32e-06]
Epoch 5/5:  15%|█▍        | 171/1177 [07:57<44:23,  2.65s/it, exist=0.2418, loss=0.5004, lr=4.32e-06]
Epoch 5/5:  15%|█▍        | 171/1177 [08:00<44:23,  2.65s/it, exist=0.2420, loss=0.5010, lr=4.31e-06]
Epoch 5/5:  15%|█▍        | 172/1177 [08:00<44:02,  2.63s/it, exist=0.2420, loss=0.5010, lr=4.31e-06]
Epoch 5/5:  15%|█▍        | 172/1177 [08:03<44:02,  2.63s/it, exist=0.2431, loss=0.5025, lr=4.30e-06]
Epoch 5/5:  15%|█▍        | 173/1177 [08:03<44:05,  2.63s/it, exist=0.2431, loss=0.5025, lr=4.30e-06]
Epoch 5/5:  15%|█▍        | 173/1177 [08:05<44:05,  2.63s/it, exist=0.2437, loss=0.5030, lr=4.29e-06]
Epoch 5/5:  15%|█▍        | 174/1177 [08:05<44:06,  2.64s/it, exist=0.2437, loss=0.5030, lr=4.29e-06]
Epoch 5/5:  15%|█▍        | 174/1177 [08:07<44:06,  2.64s/it, exist=0.2449, loss=0.5042, lr=4.29e-06]
Epoch 5/5:  15%|█▍        | 175/1177 [08:07<40:38,  2.43s/it, exist=0.2449, loss=0.5042, lr=4.29e-06]
Epoch 5/5:  15%|█▍        | 175/1177 [08:11<40:38,  2.43s/it, exist=0.2452, loss=0.5053, lr=4.28e-06]
Epoch 5/5:  15%|█▍        | 176/1177 [08:11<45:36,  2.73s/it, exist=0.2452, loss=0.5053, lr=4.28e-06]
Epoch 5/5:  15%|█▍        | 176/1177 [08:13<45:36,  2.73s/it, exist=0.2441, loss=0.5040, lr=4.27e-06]
Epoch 5/5:  15%|█▌        | 177/1177 [08:13<41:31,  2.49s/it, exist=0.2441, loss=0.5040, lr=4.27e-06]
Epoch 5/5:  15%|█▌        | 177/1177 [08:16<41:31,  2.49s/it, exist=0.2451, loss=0.5059, lr=4.26e-06]
Epoch 5/5:  15%|█▌        | 178/1177 [08:16<44:08,  2.65s/it, exist=0.2451, loss=0.5059, lr=4.26e-06]
Epoch 5/5:  15%|█▌        | 178/1177 [08:18<44:08,  2.65s/it, exist=0.2457, loss=0.5064, lr=4.25e-06]
Epoch 5/5:  15%|█▌        | 179/1177 [08:18<43:22,  2.61s/it, exist=0.2457, loss=0.5064, lr=4.25e-06]
Epoch 5/5:  15%|█▌        | 179/1177 [08:21<43:22,  2.61s/it, exist=0.2451, loss=0.5056, lr=4.24e-06]
Epoch 5/5:  15%|█▌        | 180/1177 [08:21<42:41,  2.57s/it, exist=0.2451, loss=0.5056, lr=4.24e-06]
Epoch 5/5:  15%|█▌        | 180/1177 [08:23<42:41,  2.57s/it, exist=0.2442, loss=0.5047, lr=4.24e-06]
Epoch 5/5:  15%|█▌        | 181/1177 [08:23<43:02,  2.59s/it, exist=0.2442, loss=0.5047, lr=4.24e-06]
Epoch 5/5:  15%|█▌        | 181/1177 [08:25<43:02,  2.59s/it, exist=0.2448, loss=0.5064, lr=4.23e-06]
Epoch 5/5:  15%|█▌        | 182/1177 [08:25<39:45,  2.40s/it, exist=0.2448, loss=0.5064, lr=4.23e-06]
Epoch 5/5:  15%|█▌        | 182/1177 [08:28<39:45,  2.40s/it, exist=0.2456, loss=0.5070, lr=4.22e-06]
Epoch 5/5:  16%|█▌        | 183/1177 [08:28<43:40,  2.64s/it, exist=0.2456, loss=0.5070, lr=4.22e-06]
Epoch 5/5:  16%|█▌        | 183/1177 [08:31<43:40,  2.64s/it, exist=0.2459, loss=0.5072, lr=4.21e-06]
Epoch 5/5:  16%|█▌        | 184/1177 [08:31<44:56,  2.72s/it, exist=0.2459, loss=0.5072, lr=4.21e-06]
Epoch 5/5:  16%|█▌        | 184/1177 [08:34<44:56,  2.72s/it, exist=0.2457, loss=0.5074, lr=4.20e-06]
Epoch 5/5:  16%|█▌        | 185/1177 [08:34<44:42,  2.70s/it, exist=0.2457, loss=0.5074, lr=4.20e-06]
Epoch 5/5:  16%|█▌        | 185/1177 [08:37<44:42,  2.70s/it, exist=0.2475, loss=0.5091, lr=4.20e-06]
Epoch 5/5:  16%|█▌        | 186/1177 [08:37<44:41,  2.71s/it, exist=0.2475, loss=0.5091, lr=4.20e-06]
Epoch 5/5:  16%|█▌        | 186/1177 [08:40<44:41,  2.71s/it, exist=0.2466, loss=0.5087, lr=4.19e-06]
Epoch 5/5:  16%|█▌        | 187/1177 [08:40<46:05,  2.79s/it, exist=0.2466, loss=0.5087, lr=4.19e-06]
Epoch 5/5:  16%|█▌        | 187/1177 [08:42<46:05,  2.79s/it, exist=0.2456, loss=0.5076, lr=4.18e-06]
Epoch 5/5:  16%|█▌        | 188/1177 [08:42<45:36,  2.77s/it, exist=0.2456, loss=0.5076, lr=4.18e-06]
Epoch 5/5:  16%|█▌        | 188/1177 [08:45<45:36,  2.77s/it, exist=0.2469, loss=0.5088, lr=4.17e-06]
Epoch 5/5:  16%|█▌        | 189/1177 [08:45<44:37,  2.71s/it, exist=0.2469, loss=0.5088, lr=4.17e-06]
Epoch 5/5:  16%|█▌        | 189/1177 [08:48<44:37,  2.71s/it, exist=0.2462, loss=0.5079, lr=4.16e-06]
Epoch 5/5:  16%|█▌        | 190/1177 [08:48<44:12,  2.69s/it, exist=0.2462, loss=0.5079, lr=4.16e-06]
Epoch 5/5:  16%|█▌        | 190/1177 [08:50<44:12,  2.69s/it, exist=0.2456, loss=0.5078, lr=4.15e-06]
Epoch 5/5:  16%|█▌        | 191/1177 [08:50<43:27,  2.64s/it, exist=0.2456, loss=0.5078, lr=4.15e-06]
Epoch 5/5:  16%|█▌        | 191/1177 [08:53<43:27,  2.64s/it, exist=0.2449, loss=0.5072, lr=4.15e-06]
Epoch 5/5:  16%|█▋        | 192/1177 [08:53<43:31,  2.65s/it, exist=0.2449, loss=0.5072, lr=4.15e-06]
Epoch 5/5:  16%|█▋        | 192/1177 [08:56<43:31,  2.65s/it, exist=0.2443, loss=0.5064, lr=4.14e-06]
Epoch 5/5:  16%|█▋        | 193/1177 [08:56<43:16,  2.64s/it, exist=0.2443, loss=0.5064, lr=4.14e-06]
Epoch 5/5:  16%|█▋        | 193/1177 [08:57<43:16,  2.64s/it, exist=0.2454, loss=0.5074, lr=4.13e-06]
Epoch 5/5:  16%|█▋        | 194/1177 [08:57<39:49,  2.43s/it, exist=0.2454, loss=0.5074, lr=4.13e-06]
Epoch 5/5:  16%|█▋        | 194/1177 [09:00<39:49,  2.43s/it, exist=0.2450, loss=0.5070, lr=4.12e-06]
Epoch 5/5:  17%|█▋        | 195/1177 [09:00<40:36,  2.48s/it, exist=0.2450, loss=0.5070, lr=4.12e-06]
Epoch 5/5:  17%|█▋        | 195/1177 [09:02<40:36,  2.48s/it, exist=0.2454, loss=0.5074, lr=4.11e-06]
Epoch 5/5:  17%|█▋        | 196/1177 [09:02<37:49,  2.31s/it, exist=0.2454, loss=0.5074, lr=4.11e-06]
Epoch 5/5:  17%|█▋        | 196/1177 [09:06<37:49,  2.31s/it, exist=0.2457, loss=0.5077, lr=4.11e-06]
Epoch 5/5:  17%|█▋        | 197/1177 [09:06<45:41,  2.80s/it, exist=0.2457, loss=0.5077, lr=4.11e-06]
Epoch 5/5:  17%|█▋        | 197/1177 [09:08<45:41,  2.80s/it, exist=0.2457, loss=0.5075, lr=4.10e-06]
Epoch 5/5:  17%|█▋        | 198/1177 [09:08<44:35,  2.73s/it, exist=0.2457, loss=0.5075, lr=4.10e-06]
Epoch 5/5:  17%|█▋        | 198/1177 [09:10<44:35,  2.73s/it, exist=0.2456, loss=0.5074, lr=4.09e-06]
Epoch 5/5:  17%|█▋        | 199/1177 [09:10<41:00,  2.52s/it, exist=0.2456, loss=0.5074, lr=4.09e-06]
Epoch 5/5:  17%|█▋        | 199/1177 [09:13<41:00,  2.52s/it, exist=0.2449, loss=0.5066, lr=4.08e-06]
Epoch 5/5:  17%|█▋        | 200/1177 [09:13<40:56,  2.51s/it, exist=0.2449, loss=0.5066, lr=4.08e-06]
Epoch 5/5:  17%|█▋        | 200/1177 [09:16<40:56,  2.51s/it, exist=0.2446, loss=0.5065, lr=4.07e-06]
Epoch 5/5:  17%|█▋        | 201/1177 [09:16<44:49,  2.76s/it, exist=0.2446, loss=0.5065, lr=4.07e-06]
Epoch 5/5:  17%|█▋        | 201/1177 [09:19<44:49,  2.76s/it, exist=0.2441, loss=0.5058, lr=4.06e-06]
Epoch 5/5:  17%|█▋        | 202/1177 [09:19<43:45,  2.69s/it, exist=0.2441, loss=0.5058, lr=4.06e-06]
Epoch 5/5:  17%|█▋        | 202/1177 [09:21<43:45,  2.69s/it, exist=0.2448, loss=0.5078, lr=4.06e-06]
Epoch 5/5:  17%|█▋        | 203/1177 [09:21<42:44,  2.63s/it, exist=0.2448, loss=0.5078, lr=4.06e-06]
Epoch 5/5:  17%|█▋        | 203/1177 [09:24<42:44,  2.63s/it, exist=0.2450, loss=0.5077, lr=4.05e-06]
Epoch 5/5:  17%|█▋        | 204/1177 [09:24<42:34,  2.63s/it, exist=0.2450, loss=0.5077, lr=4.05e-06]
Epoch 5/5:  17%|█▋        | 204/1177 [09:26<42:34,  2.63s/it, exist=0.2446, loss=0.5069, lr=4.04e-06]
Epoch 5/5:  17%|█▋        | 205/1177 [09:26<41:56,  2.59s/it, exist=0.2446, loss=0.5069, lr=4.04e-06]
Epoch 5/5:  17%|█▋        | 205/1177 [09:29<41:56,  2.59s/it, exist=0.2458, loss=0.5080, lr=4.03e-06]
Epoch 5/5:  18%|█▊        | 206/1177 [09:29<40:52,  2.53s/it, exist=0.2458, loss=0.5080, lr=4.03e-06]
Epoch 5/5:  18%|█▊        | 206/1177 [09:31<40:52,  2.53s/it, exist=0.2456, loss=0.5080, lr=4.02e-06]
Epoch 5/5:  18%|█▊        | 207/1177 [09:31<38:17,  2.37s/it, exist=0.2456, loss=0.5080, lr=4.02e-06]
Epoch 5/5:  18%|█▊        | 207/1177 [09:34<38:17,  2.37s/it, exist=0.2449, loss=0.5070, lr=4.02e-06]
Epoch 5/5:  18%|█▊        | 208/1177 [09:34<43:00,  2.66s/it, exist=0.2449, loss=0.5070, lr=4.02e-06]
Epoch 5/5:  18%|█▊        | 208/1177 [09:37<43:00,  2.66s/it, exist=0.2464, loss=0.5088, lr=4.01e-06]
Epoch 5/5:  18%|█▊        | 209/1177 [09:37<42:01,  2.60s/it, exist=0.2464, loss=0.5088, lr=4.01e-06]
Epoch 5/5:  18%|█▊        | 209/1177 [09:39<42:01,  2.60s/it, exist=0.2458, loss=0.5079, lr=4.00e-06]
Epoch 5/5:  18%|█▊        | 210/1177 [09:39<41:06,  2.55s/it, exist=0.2458, loss=0.5079, lr=4.00e-06]
Epoch 5/5:  18%|█▊        | 210/1177 [09:42<41:06,  2.55s/it, exist=0.2463, loss=0.5082, lr=3.99e-06]
Epoch 5/5:  18%|█▊        | 211/1177 [09:42<40:28,  2.51s/it, exist=0.2463, loss=0.5082, lr=3.99e-06]
Epoch 5/5:  18%|█▊        | 211/1177 [09:44<40:28,  2.51s/it, exist=0.2472, loss=0.5087, lr=3.98e-06]
Epoch 5/5:  18%|█▊        | 212/1177 [09:44<37:59,  2.36s/it, exist=0.2472, loss=0.5087, lr=3.98e-06]
Epoch 5/5:  18%|█▊        | 212/1177 [09:47<37:59,  2.36s/it, exist=0.2464, loss=0.5080, lr=3.98e-06]
Epoch 5/5:  18%|█▊        | 213/1177 [09:47<42:41,  2.66s/it, exist=0.2464, loss=0.5080, lr=3.98e-06]
Epoch 5/5:  18%|█▊        | 213/1177 [09:49<42:41,  2.66s/it, exist=0.2475, loss=0.5088, lr=3.97e-06]
Epoch 5/5:  18%|█▊        | 214/1177 [09:49<42:09,  2.63s/it, exist=0.2475, loss=0.5088, lr=3.97e-06]
Epoch 5/5:  18%|█▊        | 214/1177 [09:52<42:09,  2.63s/it, exist=0.2468, loss=0.5079, lr=3.96e-06]
Epoch 5/5:  18%|█▊        | 215/1177 [09:52<42:06,  2.63s/it, exist=0.2468, loss=0.5079, lr=3.96e-06]
Epoch 5/5:  18%|█▊        | 215/1177 [09:55<42:06,  2.63s/it, exist=0.2475, loss=0.5084, lr=3.95e-06]
Epoch 5/5:  18%|█▊        | 216/1177 [09:55<42:24,  2.65s/it, exist=0.2475, loss=0.5084, lr=3.95e-06]
Epoch 5/5:  18%|█▊        | 216/1177 [09:57<42:24,  2.65s/it, exist=0.2480, loss=0.5090, lr=3.94e-06]
Epoch 5/5:  18%|█▊        | 217/1177 [09:57<42:41,  2.67s/it, exist=0.2480, loss=0.5090, lr=3.94e-06]
Epoch 5/5:  18%|█▊        | 217/1177 [10:00<42:41,  2.67s/it, exist=0.2474, loss=0.5085, lr=3.94e-06]
Epoch 5/5:  19%|█▊        | 218/1177 [10:00<42:03,  2.63s/it, exist=0.2474, loss=0.5085, lr=3.94e-06]
Epoch 5/5:  19%|█▊        | 218/1177 [10:03<42:03,  2.63s/it, exist=0.2468, loss=0.5076, lr=3.93e-06]
Epoch 5/5:  19%|█▊        | 219/1177 [10:03<43:29,  2.72s/it, exist=0.2468, loss=0.5076, lr=3.93e-06]
Epoch 5/5:  19%|█▊        | 219/1177 [10:06<43:29,  2.72s/it, exist=0.2463, loss=0.5074, lr=3.92e-06]
Epoch 5/5:  19%|█▊        | 220/1177 [10:06<42:48,  2.68s/it, exist=0.2463, loss=0.5074, lr=3.92e-06]
Epoch 5/5:  19%|█▊        | 220/1177 [10:08<42:48,  2.68s/it, exist=0.2462, loss=0.5073, lr=3.91e-06]
Epoch 5/5:  19%|█▉        | 221/1177 [10:08<41:47,  2.62s/it, exist=0.2462, loss=0.5073, lr=3.91e-06]
Epoch 5/5:  19%|█▉        | 221/1177 [10:11<41:47,  2.62s/it, exist=0.2454, loss=0.5062, lr=3.90e-06]
Epoch 5/5:  19%|█▉        | 222/1177 [10:11<41:29,  2.61s/it, exist=0.2454, loss=0.5062, lr=3.90e-06]
Epoch 5/5:  19%|█▉        | 222/1177 [10:13<41:29,  2.61s/it, exist=0.2447, loss=0.5052, lr=3.90e-06]
Epoch 5/5:  19%|█▉        | 223/1177 [10:13<41:32,  2.61s/it, exist=0.2447, loss=0.5052, lr=3.90e-06]
Epoch 5/5:  19%|█▉        | 223/1177 [10:16<41:32,  2.61s/it, exist=0.2443, loss=0.5047, lr=3.89e-06]
Epoch 5/5:  19%|█▉        | 224/1177 [10:16<41:19,  2.60s/it, exist=0.2443, loss=0.5047, lr=3.89e-06]
Epoch 5/5:  19%|█▉        | 224/1177 [10:18<41:19,  2.60s/it, exist=0.2440, loss=0.5044, lr=3.88e-06]
Epoch 5/5:  19%|█▉        | 225/1177 [10:18<38:18,  2.41s/it, exist=0.2440, loss=0.5044, lr=3.88e-06]
Epoch 5/5:  19%|█▉        | 225/1177 [10:20<38:18,  2.41s/it, exist=0.2434, loss=0.5035, lr=3.87e-06]
Epoch 5/5:  19%|█▉        | 226/1177 [10:20<39:14,  2.48s/it, exist=0.2434, loss=0.5035, lr=3.87e-06]
Epoch 5/5:  19%|█▉        | 226/1177 [10:23<39:14,  2.48s/it, exist=0.2433, loss=0.5032, lr=3.86e-06]
Epoch 5/5:  19%|█▉        | 227/1177 [10:23<40:07,  2.53s/it, exist=0.2433, loss=0.5032, lr=3.86e-06]
Epoch 5/5:  19%|█▉        | 227/1177 [10:26<40:07,  2.53s/it, exist=0.2427, loss=0.5029, lr=3.86e-06]
Epoch 5/5:  19%|█▉        | 228/1177 [10:26<40:09,  2.54s/it, exist=0.2427, loss=0.5029, lr=3.86e-06]
Epoch 5/5:  19%|█▉        | 228/1177 [10:29<40:09,  2.54s/it, exist=0.2426, loss=0.5028, lr=3.85e-06]
Epoch 5/5:  19%|█▉        | 229/1177 [10:29<43:33,  2.76s/it, exist=0.2426, loss=0.5028, lr=3.85e-06]
Epoch 5/5:  19%|█▉        | 229/1177 [10:32<43:33,  2.76s/it, exist=0.2421, loss=0.5022, lr=3.84e-06]
Epoch 5/5:  20%|█▉        | 230/1177 [10:32<42:54,  2.72s/it, exist=0.2421, loss=0.5022, lr=3.84e-06]
Epoch 5/5:  20%|█▉        | 230/1177 [10:34<42:54,  2.72s/it, exist=0.2432, loss=0.5033, lr=3.83e-06]
Epoch 5/5:  20%|█▉        | 231/1177 [10:34<41:35,  2.64s/it, exist=0.2432, loss=0.5033, lr=3.83e-06]
Epoch 5/5:  20%|█▉        | 231/1177 [10:37<41:35,  2.64s/it, exist=0.2427, loss=0.5027, lr=3.82e-06]
Epoch 5/5:  20%|█▉        | 232/1177 [10:37<41:30,  2.64s/it, exist=0.2427, loss=0.5027, lr=3.82e-06]
Epoch 5/5:  20%|█▉        | 232/1177 [10:39<41:30,  2.64s/it, exist=0.2424, loss=0.5023, lr=3.82e-06]
Epoch 5/5:  20%|█▉        | 233/1177 [10:39<40:36,  2.58s/it, exist=0.2424, loss=0.5023, lr=3.82e-06]
Epoch 5/5:  20%|█▉        | 233/1177 [10:41<40:36,  2.58s/it, exist=0.2420, loss=0.5023, lr=3.81e-06]
Epoch 5/5:  20%|█▉        | 234/1177 [10:41<37:39,  2.40s/it, exist=0.2420, loss=0.5023, lr=3.81e-06]
Epoch 5/5:  20%|█▉        | 234/1177 [10:43<37:39,  2.40s/it, exist=0.2414, loss=0.5016, lr=3.80e-06]
Epoch 5/5:  20%|█▉        | 235/1177 [10:43<35:42,  2.27s/it, exist=0.2414, loss=0.5016, lr=3.80e-06]
Epoch 5/5:  20%|█▉        | 235/1177 [10:46<35:42,  2.27s/it, exist=0.2408, loss=0.5009, lr=3.79e-06]
Epoch 5/5:  20%|██        | 236/1177 [10:46<36:49,  2.35s/it, exist=0.2408, loss=0.5009, lr=3.79e-06]
Epoch 5/5:  20%|██        | 236/1177 [10:48<36:49,  2.35s/it, exist=0.2401, loss=0.5003, lr=3.79e-06]
Epoch 5/5:  20%|██        | 237/1177 [10:48<37:22,  2.39s/it, exist=0.2401, loss=0.5003, lr=3.79e-06]
Epoch 5/5:  20%|██        | 237/1177 [10:50<37:22,  2.39s/it, exist=0.2405, loss=0.5006, lr=3.78e-06]
Epoch 5/5:  20%|██        | 238/1177 [10:50<37:18,  2.38s/it, exist=0.2405, loss=0.5006, lr=3.78e-06]
Epoch 5/5:  20%|██        | 238/1177 [10:54<37:18,  2.38s/it, exist=0.2406, loss=0.5010, lr=3.77e-06]
Epoch 5/5:  20%|██        | 239/1177 [10:54<42:23,  2.71s/it, exist=0.2406, loss=0.5010, lr=3.77e-06]
Epoch 5/5:  20%|██        | 239/1177 [10:57<42:23,  2.71s/it, exist=0.2403, loss=0.5005, lr=3.76e-06]
Epoch 5/5:  20%|██        | 240/1177 [10:57<42:10,  2.70s/it, exist=0.2403, loss=0.5005, lr=3.76e-06]
Epoch 5/5:  20%|██        | 240/1177 [11:00<42:10,  2.70s/it, exist=0.2401, loss=0.5003, lr=3.75e-06]
Epoch 5/5:  20%|██        | 241/1177 [11:00<44:38,  2.86s/it, exist=0.2401, loss=0.5003, lr=3.75e-06]
Epoch 5/5:  20%|██        | 241/1177 [11:02<44:38,  2.86s/it, exist=0.2395, loss=0.5000, lr=3.75e-06]
Epoch 5/5:  21%|██        | 242/1177 [11:02<40:25,  2.59s/it, exist=0.2395, loss=0.5000, lr=3.75e-06]
Epoch 5/5:  21%|██        | 242/1177 [11:04<40:25,  2.59s/it, exist=0.2390, loss=0.4993, lr=3.74e-06]
Epoch 5/5:  21%|██        | 243/1177 [11:04<37:32,  2.41s/it, exist=0.2390, loss=0.4993, lr=3.74e-06]
Epoch 5/5:  21%|██        | 243/1177 [11:07<37:32,  2.41s/it, exist=0.2383, loss=0.4988, lr=3.73e-06]
Epoch 5/5:  21%|██        | 244/1177 [11:07<41:25,  2.66s/it, exist=0.2383, loss=0.4988, lr=3.73e-06]
Epoch 5/5:  21%|██        | 244/1177 [11:10<41:25,  2.66s/it, exist=0.2384, loss=0.4992, lr=3.72e-06]
Epoch 5/5:  21%|██        | 245/1177 [11:10<41:06,  2.65s/it, exist=0.2384, loss=0.4992, lr=3.72e-06]
Epoch 5/5:  21%|██        | 245/1177 [11:13<41:06,  2.65s/it, exist=0.2384, loss=0.4993, lr=3.72e-06]
Epoch 5/5:  21%|██        | 246/1177 [11:13<43:18,  2.79s/it, exist=0.2384, loss=0.4993, lr=3.72e-06]
Epoch 5/5:  21%|██        | 246/1177 [11:15<43:18,  2.79s/it, exist=0.2382, loss=0.4993, lr=3.71e-06]
Epoch 5/5:  21%|██        | 247/1177 [11:15<42:18,  2.73s/it, exist=0.2382, loss=0.4993, lr=3.71e-06]
Epoch 5/5:  21%|██        | 247/1177 [11:18<42:18,  2.73s/it, exist=0.2386, loss=0.4995, lr=3.70e-06]
Epoch 5/5:  21%|██        | 248/1177 [11:18<42:25,  2.74s/it, exist=0.2386, loss=0.4995, lr=3.70e-06]
Epoch 5/5:  21%|██        | 248/1177 [11:20<42:25,  2.74s/it, exist=0.2393, loss=0.5001, lr=3.69e-06]
Epoch 5/5:  21%|██        | 249/1177 [11:20<38:44,  2.50s/it, exist=0.2393, loss=0.5001, lr=3.69e-06]
Epoch 5/5:  21%|██        | 249/1177 [11:23<38:44,  2.50s/it, exist=0.2392, loss=0.5002, lr=3.68e-06]
Epoch 5/5:  21%|██        | 250/1177 [11:23<42:15,  2.74s/it, exist=0.2392, loss=0.5002, lr=3.68e-06]
Epoch 5/5:  21%|██        | 250/1177 [11:25<42:15,  2.74s/it, exist=0.2391, loss=0.4998, lr=3.68e-06]
Epoch 5/5:  21%|██▏       | 251/1177 [11:25<38:55,  2.52s/it, exist=0.2391, loss=0.4998, lr=3.68e-06]
Epoch 5/5:  21%|██▏       | 251/1177 [11:28<38:55,  2.52s/it, exist=0.2387, loss=0.4994, lr=3.67e-06]
Epoch 5/5:  21%|██▏       | 252/1177 [11:28<41:03,  2.66s/it, exist=0.2387, loss=0.4994, lr=3.67e-06]
Epoch 5/5:  21%|██▏       | 252/1177 [11:31<41:03,  2.66s/it, exist=0.2381, loss=0.4988, lr=3.66e-06]
Epoch 5/5:  21%|██▏       | 253/1177 [11:31<41:30,  2.70s/it, exist=0.2381, loss=0.4988, lr=3.66e-06]
Epoch 5/5:  21%|██▏       | 253/1177 [11:34<41:30,  2.70s/it, exist=0.2383, loss=0.4986, lr=3.65e-06]
Epoch 5/5:  22%|██▏       | 254/1177 [11:34<40:59,  2.66s/it, exist=0.2383, loss=0.4986, lr=3.65e-06]
Epoch 5/5:  22%|██▏       | 254/1177 [11:36<40:59,  2.66s/it, exist=0.2402, loss=0.5004, lr=3.65e-06]
Epoch 5/5:  22%|██▏       | 255/1177 [11:36<37:36,  2.45s/it, exist=0.2402, loss=0.5004, lr=3.65e-06]
Epoch 5/5:  22%|██▏       | 255/1177 [11:38<37:36,  2.45s/it, exist=0.2397, loss=0.5000, lr=3.64e-06]
Epoch 5/5:  22%|██▏       | 256/1177 [11:38<38:28,  2.51s/it, exist=0.2397, loss=0.5000, lr=3.64e-06]
Epoch 5/5:  22%|██▏       | 256/1177 [11:42<38:28,  2.51s/it, exist=0.2391, loss=0.4995, lr=3.63e-06]
Epoch 5/5:  22%|██▏       | 257/1177 [11:42<42:32,  2.77s/it, exist=0.2391, loss=0.4995, lr=3.63e-06]
Epoch 5/5:  22%|██▏       | 257/1177 [11:44<42:32,  2.77s/it, exist=0.2390, loss=0.4991, lr=3.62e-06]
Epoch 5/5:  22%|██▏       | 258/1177 [11:44<41:36,  2.72s/it, exist=0.2390, loss=0.4991, lr=3.62e-06]
Epoch 5/5:  22%|██▏       | 258/1177 [11:46<41:36,  2.72s/it, exist=0.2386, loss=0.4988, lr=3.61e-06]
Epoch 5/5:  22%|██▏       | 259/1177 [11:46<37:48,  2.47s/it, exist=0.2386, loss=0.4988, lr=3.61e-06]
Epoch 5/5:  22%|██▏       | 259/1177 [11:50<37:48,  2.47s/it, exist=0.2380, loss=0.4980, lr=3.61e-06]
Epoch 5/5:  22%|██▏       | 260/1177 [11:50<41:54,  2.74s/it, exist=0.2380, loss=0.4980, lr=3.61e-06]
Epoch 5/5:  22%|██▏       | 260/1177 [11:52<41:54,  2.74s/it, exist=0.2378, loss=0.4977, lr=3.60e-06]
Epoch 5/5:  22%|██▏       | 261/1177 [11:52<38:31,  2.52s/it, exist=0.2378, loss=0.4977, lr=3.60e-06]
Epoch 5/5:  22%|██▏       | 261/1177 [11:54<38:31,  2.52s/it, exist=0.2383, loss=0.4981, lr=3.59e-06]
Epoch 5/5:  22%|██▏       | 262/1177 [11:54<36:04,  2.37s/it, exist=0.2383, loss=0.4981, lr=3.59e-06]
Epoch 5/5:  22%|██▏       | 262/1177 [11:57<36:04,  2.37s/it, exist=0.2379, loss=0.4977, lr=3.58e-06]
Epoch 5/5:  22%|██▏       | 263/1177 [11:57<43:18,  2.84s/it, exist=0.2379, loss=0.4977, lr=3.58e-06]
Epoch 5/5:  22%|██▏       | 263/1177 [12:00<43:18,  2.84s/it, exist=0.2382, loss=0.4980, lr=3.58e-06]
Epoch 5/5:  22%|██▏       | 264/1177 [12:00<42:38,  2.80s/it, exist=0.2382, loss=0.4980, lr=3.58e-06]
Epoch 5/5:  22%|██▏       | 264/1177 [12:02<42:38,  2.80s/it, exist=0.2390, loss=0.4991, lr=3.57e-06]
Epoch 5/5:  23%|██▎       | 265/1177 [12:02<39:00,  2.57s/it, exist=0.2390, loss=0.4991, lr=3.57e-06]
Epoch 5/5:  23%|██▎       | 265/1177 [12:05<39:00,  2.57s/it, exist=0.2383, loss=0.4983, lr=3.56e-06]
Epoch 5/5:  23%|██▎       | 266/1177 [12:05<39:32,  2.60s/it, exist=0.2383, loss=0.4983, lr=3.56e-06]
Epoch 5/5:  23%|██▎       | 266/1177 [12:07<39:32,  2.60s/it, exist=0.2378, loss=0.4979, lr=3.55e-06]
Epoch 5/5:  23%|██▎       | 267/1177 [12:07<39:29,  2.60s/it, exist=0.2378, loss=0.4979, lr=3.55e-06]
Epoch 5/5:  23%|██▎       | 267/1177 [12:10<39:29,  2.60s/it, exist=0.2379, loss=0.4982, lr=3.55e-06]
Epoch 5/5:  23%|██▎       | 268/1177 [12:10<39:45,  2.62s/it, exist=0.2379, loss=0.4982, lr=3.55e-06]
Epoch 5/5:  23%|██▎       | 268/1177 [12:13<39:45,  2.62s/it, exist=0.2378, loss=0.4984, lr=3.54e-06]
Epoch 5/5:  23%|██▎       | 269/1177 [12:13<42:04,  2.78s/it, exist=0.2378, loss=0.4984, lr=3.54e-06]
Epoch 5/5:  23%|██▎       | 269/1177 [12:16<42:04,  2.78s/it, exist=0.2371, loss=0.4975, lr=3.53e-06]
Epoch 5/5:  23%|██▎       | 270/1177 [12:16<42:06,  2.79s/it, exist=0.2371, loss=0.4975, lr=3.53e-06]
Epoch 5/5:  23%|██▎       | 270/1177 [12:19<42:06,  2.79s/it, exist=0.2368, loss=0.4972, lr=3.52e-06]
Epoch 5/5:  23%|██▎       | 271/1177 [12:19<41:24,  2.74s/it, exist=0.2368, loss=0.4972, lr=3.52e-06]
Epoch 5/5:  23%|██▎       | 271/1177 [12:22<41:24,  2.74s/it, exist=0.2369, loss=0.4970, lr=3.52e-06]
Epoch 5/5:  23%|██▎       | 272/1177 [12:22<42:11,  2.80s/it, exist=0.2369, loss=0.4970, lr=3.52e-06]
Epoch 5/5:  23%|██▎       | 272/1177 [12:25<42:11,  2.80s/it, exist=0.2376, loss=0.4976, lr=3.51e-06]
Epoch 5/5:  23%|██▎       | 273/1177 [12:25<42:20,  2.81s/it, exist=0.2376, loss=0.4976, lr=3.51e-06]
Epoch 5/5:  23%|██▎       | 273/1177 [12:26<42:20,  2.81s/it, exist=0.2369, loss=0.4976, lr=3.50e-06]
Epoch 5/5:  23%|██▎       | 274/1177 [12:26<38:31,  2.56s/it, exist=0.2369, loss=0.4976, lr=3.50e-06]
Epoch 5/5:  23%|██▎       | 274/1177 [12:29<38:31,  2.56s/it, exist=0.2369, loss=0.4975, lr=3.49e-06]
Epoch 5/5:  23%|██▎       | 275/1177 [12:29<38:39,  2.57s/it, exist=0.2369, loss=0.4975, lr=3.49e-06]
Epoch 5/5:  23%|██▎       | 275/1177 [12:32<38:39,  2.57s/it, exist=0.2364, loss=0.4968, lr=3.49e-06]
Epoch 5/5:  23%|██▎       | 276/1177 [12:32<41:47,  2.78s/it, exist=0.2364, loss=0.4968, lr=3.49e-06]
Epoch 5/5:  23%|██▎       | 276/1177 [12:35<41:47,  2.78s/it, exist=0.2359, loss=0.4964, lr=3.48e-06]
Epoch 5/5:  24%|██▎       | 277/1177 [12:35<41:08,  2.74s/it, exist=0.2359, loss=0.4964, lr=3.48e-06]
Epoch 5/5:  24%|██▎       | 277/1177 [12:38<41:08,  2.74s/it, exist=0.2353, loss=0.4957, lr=3.47e-06]
Epoch 5/5:  24%|██▎       | 278/1177 [12:38<40:14,  2.69s/it, exist=0.2353, loss=0.4957, lr=3.47e-06]
Epoch 5/5:  24%|██▎       | 278/1177 [12:40<40:14,  2.69s/it, exist=0.2365, loss=0.4967, lr=3.46e-06]
Epoch 5/5:  24%|██▎       | 279/1177 [12:40<39:56,  2.67s/it, exist=0.2365, loss=0.4967, lr=3.46e-06]
Epoch 5/5:  24%|██▎       | 279/1177 [12:43<39:56,  2.67s/it, exist=0.2361, loss=0.4962, lr=3.46e-06]
Epoch 5/5:  24%|██▍       | 280/1177 [12:43<39:18,  2.63s/it, exist=0.2361, loss=0.4962, lr=3.46e-06]
Epoch 5/5:  24%|██▍       | 280/1177 [12:45<39:18,  2.63s/it, exist=0.2360, loss=0.4959, lr=3.45e-06]
Epoch 5/5:  24%|██▍       | 281/1177 [12:45<36:21,  2.43s/it, exist=0.2360, loss=0.4959, lr=3.45e-06]
Epoch 5/5:  24%|██▍       | 281/1177 [12:48<36:21,  2.43s/it, exist=0.2357, loss=0.4955, lr=3.44e-06]
Epoch 5/5:  24%|██▍       | 282/1177 [12:48<40:17,  2.70s/it, exist=0.2357, loss=0.4955, lr=3.44e-06]
Epoch 5/5:  24%|██▍       | 282/1177 [12:51<40:17,  2.70s/it, exist=0.2353, loss=0.4950, lr=3.43e-06]
Epoch 5/5:  24%|██▍       | 283/1177 [12:51<39:18,  2.64s/it, exist=0.2353, loss=0.4950, lr=3.43e-06]
Epoch 5/5:  24%|██▍       | 283/1177 [12:53<39:18,  2.64s/it, exist=0.2354, loss=0.4950, lr=3.43e-06]
Epoch 5/5:  24%|██▍       | 284/1177 [12:53<39:20,  2.64s/it, exist=0.2354, loss=0.4950, lr=3.43e-06]
Epoch 5/5:  24%|██▍       | 284/1177 [12:56<39:20,  2.64s/it, exist=0.2356, loss=0.4952, lr=3.42e-06]
Epoch 5/5:  24%|██▍       | 285/1177 [12:56<39:10,  2.64s/it, exist=0.2356, loss=0.4952, lr=3.42e-06]
Epoch 5/5:  24%|██▍       | 285/1177 [12:58<39:10,  2.64s/it, exist=0.2359, loss=0.4954, lr=3.41e-06]
Epoch 5/5:  24%|██▍       | 286/1177 [12:58<38:55,  2.62s/it, exist=0.2359, loss=0.4954, lr=3.41e-06]
Epoch 5/5:  24%|██▍       | 286/1177 [13:00<38:55,  2.62s/it, exist=0.2356, loss=0.4951, lr=3.40e-06]
Epoch 5/5:  24%|██▍       | 287/1177 [13:00<35:57,  2.42s/it, exist=0.2356, loss=0.4951, lr=3.40e-06]
Epoch 5/5:  24%|██▍       | 287/1177 [13:03<35:57,  2.42s/it, exist=0.2360, loss=0.4953, lr=3.40e-06]
Epoch 5/5:  24%|██▍       | 288/1177 [13:03<36:08,  2.44s/it, exist=0.2360, loss=0.4953, lr=3.40e-06]
Epoch 5/5:  24%|██▍       | 288/1177 [13:05<36:08,  2.44s/it, exist=0.2362, loss=0.4953, lr=3.39e-06]
Epoch 5/5:  25%|██▍       | 289/1177 [13:05<36:53,  2.49s/it, exist=0.2362, loss=0.4953, lr=3.39e-06]
Epoch 5/5:  25%|██▍       | 289/1177 [13:08<36:53,  2.49s/it, exist=0.2356, loss=0.4945, lr=3.38e-06]
Epoch 5/5:  25%|██▍       | 290/1177 [13:08<38:28,  2.60s/it, exist=0.2356, loss=0.4945, lr=3.38e-06]
Epoch 5/5:  25%|██▍       | 290/1177 [13:11<38:28,  2.60s/it, exist=0.2368, loss=0.4961, lr=3.37e-06]
Epoch 5/5:  25%|██▍       | 291/1177 [13:11<37:29,  2.54s/it, exist=0.2368, loss=0.4961, lr=3.37e-06]
Epoch 5/5:  25%|██▍       | 291/1177 [13:14<37:29,  2.54s/it, exist=0.2375, loss=0.4965, lr=3.37e-06]
Epoch 5/5:  25%|██▍       | 292/1177 [13:14<42:09,  2.86s/it, exist=0.2375, loss=0.4965, lr=3.37e-06]
Epoch 5/5:  25%|██▍       | 292/1177 [13:17<42:09,  2.86s/it, exist=0.2370, loss=0.4960, lr=3.36e-06]
Epoch 5/5:  25%|██▍       | 293/1177 [13:17<40:42,  2.76s/it, exist=0.2370, loss=0.4960, lr=3.36e-06]
Epoch 5/5:  25%|██▍       | 293/1177 [13:19<40:42,  2.76s/it, exist=0.2369, loss=0.4959, lr=3.35e-06]
Epoch 5/5:  25%|██▍       | 294/1177 [13:19<37:16,  2.53s/it, exist=0.2369, loss=0.4959, lr=3.35e-06]
Epoch 5/5:  25%|██▍       | 294/1177 [13:22<37:16,  2.53s/it, exist=0.2367, loss=0.4955, lr=3.34e-06]
Epoch 5/5:  25%|██▌       | 295/1177 [13:22<41:12,  2.80s/it, exist=0.2367, loss=0.4955, lr=3.34e-06]
Epoch 5/5:  25%|██▌       | 295/1177 [13:24<41:12,  2.80s/it, exist=0.2368, loss=0.4956, lr=3.34e-06]
Epoch 5/5:  25%|██▌       | 296/1177 [13:24<37:52,  2.58s/it, exist=0.2368, loss=0.4956, lr=3.34e-06]
Epoch 5/5:  25%|██▌       | 296/1177 [13:27<37:52,  2.58s/it, exist=0.2363, loss=0.4950, lr=3.33e-06]
Epoch 5/5:  25%|██▌       | 297/1177 [13:27<37:19,  2.54s/it, exist=0.2363, loss=0.4950, lr=3.33e-06]
Epoch 5/5:  25%|██▌       | 297/1177 [13:31<37:19,  2.54s/it, exist=0.2361, loss=0.4946, lr=3.32e-06]
Epoch 5/5:  25%|██▌       | 298/1177 [13:31<42:25,  2.90s/it, exist=0.2361, loss=0.4946, lr=3.32e-06]
Epoch 5/5:  25%|██▌       | 298/1177 [13:32<42:25,  2.90s/it, exist=0.2360, loss=0.4944, lr=3.31e-06]
Epoch 5/5:  25%|██▌       | 299/1177 [13:32<38:21,  2.62s/it, exist=0.2360, loss=0.4944, lr=3.31e-06]
Epoch 5/5:  25%|██▌       | 299/1177 [13:36<38:21,  2.62s/it, exist=0.2364, loss=0.4950, lr=3.31e-06]
Epoch 5/5:  25%|██▌       | 300/1177 [13:36<40:34,  2.78s/it, exist=0.2364, loss=0.4950, lr=3.31e-06]
Epoch 5/5:  25%|██▌       | 300/1177 [13:38<40:34,  2.78s/it, exist=0.2365, loss=0.4951, lr=3.30e-06]
Epoch 5/5:  26%|██▌       | 301/1177 [13:38<39:54,  2.73s/it, exist=0.2365, loss=0.4951, lr=3.30e-06]
Epoch 5/5:  26%|██▌       | 301/1177 [13:41<39:54,  2.73s/it, exist=0.2365, loss=0.4950, lr=3.29e-06]
Epoch 5/5:  26%|██▌       | 302/1177 [13:41<38:59,  2.67s/it, exist=0.2365, loss=0.4950, lr=3.29e-06]
Epoch 5/5:  26%|██▌       | 302/1177 [13:43<38:59,  2.67s/it, exist=0.2366, loss=0.4950, lr=3.28e-06]
Epoch 5/5:  26%|██▌       | 303/1177 [13:43<36:22,  2.50s/it, exist=0.2366, loss=0.4950, lr=3.28e-06]
Epoch 5/5:  26%|██▌       | 303/1177 [13:46<36:22,  2.50s/it, exist=0.2366, loss=0.4949, lr=3.28e-06]
Epoch 5/5:  26%|██▌       | 304/1177 [13:46<39:18,  2.70s/it, exist=0.2366, loss=0.4949, lr=3.28e-06]
Epoch 5/5:  26%|██▌       | 304/1177 [13:48<39:18,  2.70s/it, exist=0.2378, loss=0.4960, lr=3.27e-06]
Epoch 5/5:  26%|██▌       | 305/1177 [13:48<35:58,  2.48s/it, exist=0.2378, loss=0.4960, lr=3.27e-06]
Epoch 5/5:  26%|██▌       | 305/1177 [13:51<35:58,  2.48s/it, exist=0.2386, loss=0.4966, lr=3.26e-06]
Epoch 5/5:  26%|██▌       | 306/1177 [13:51<40:05,  2.76s/it, exist=0.2386, loss=0.4966, lr=3.26e-06]
Epoch 5/5:  26%|██▌       | 306/1177 [13:53<40:05,  2.76s/it, exist=0.2380, loss=0.4963, lr=3.25e-06]
Epoch 5/5:  26%|██▌       | 307/1177 [13:53<36:51,  2.54s/it, exist=0.2380, loss=0.4963, lr=3.25e-06]
Epoch 5/5:  26%|██▌       | 307/1177 [13:56<36:51,  2.54s/it, exist=0.2392, loss=0.4974, lr=3.25e-06]
Epoch 5/5:  26%|██▌       | 308/1177 [13:56<37:21,  2.58s/it, exist=0.2392, loss=0.4974, lr=3.25e-06]
Epoch 5/5:  26%|██▌       | 308/1177 [13:59<37:21,  2.58s/it, exist=0.2390, loss=0.4972, lr=3.24e-06]
Epoch 5/5:  26%|██▋       | 309/1177 [13:59<37:58,  2.62s/it, exist=0.2390, loss=0.4972, lr=3.24e-06]
Epoch 5/5:  26%|██▋       | 309/1177 [14:01<37:58,  2.62s/it, exist=0.2399, loss=0.4985, lr=3.23e-06]
Epoch 5/5:  26%|██▋       | 310/1177 [14:01<36:41,  2.54s/it, exist=0.2399, loss=0.4985, lr=3.23e-06]
Epoch 5/5:  26%|██▋       | 310/1177 [14:05<36:41,  2.54s/it, exist=0.2402, loss=0.4991, lr=3.23e-06]
Epoch 5/5:  26%|██▋       | 311/1177 [14:05<40:47,  2.83s/it, exist=0.2402, loss=0.4991, lr=3.23e-06]
Epoch 5/5:  26%|██▋       | 311/1177 [14:07<40:47,  2.83s/it, exist=0.2400, loss=0.4990, lr=3.22e-06]
Epoch 5/5:  27%|██▋       | 312/1177 [14:07<37:05,  2.57s/it, exist=0.2400, loss=0.4990, lr=3.22e-06]
Epoch 5/5:  27%|██▋       | 312/1177 [14:09<37:05,  2.57s/it, exist=0.2396, loss=0.4984, lr=3.21e-06]
Epoch 5/5:  27%|██▋       | 313/1177 [14:09<37:47,  2.62s/it, exist=0.2396, loss=0.4984, lr=3.21e-06]
Epoch 5/5:  27%|██▋       | 313/1177 [14:13<37:47,  2.62s/it, exist=0.2393, loss=0.4980, lr=3.20e-06]
Epoch 5/5:  27%|██▋       | 314/1177 [14:13<40:54,  2.84s/it, exist=0.2393, loss=0.4980, lr=3.20e-06]
Epoch 5/5:  27%|██▋       | 314/1177 [14:15<40:54,  2.84s/it, exist=0.2393, loss=0.4978, lr=3.20e-06]
Epoch 5/5:  27%|██▋       | 315/1177 [14:15<39:47,  2.77s/it, exist=0.2393, loss=0.4978, lr=3.20e-06]
Epoch 5/5:  27%|██▋       | 315/1177 [14:17<39:47,  2.77s/it, exist=0.2388, loss=0.4974, lr=3.19e-06]
Epoch 5/5:  27%|██▋       | 316/1177 [14:17<36:01,  2.51s/it, exist=0.2388, loss=0.4974, lr=3.19e-06]
Epoch 5/5:  27%|██▋       | 316/1177 [14:21<36:01,  2.51s/it, exist=0.2387, loss=0.4971, lr=3.18e-06]
Epoch 5/5:  27%|██▋       | 317/1177 [14:21<39:42,  2.77s/it, exist=0.2387, loss=0.4971, lr=3.18e-06]
Epoch 5/5:  27%|██▋       | 317/1177 [14:23<39:42,  2.77s/it, exist=0.2382, loss=0.4966, lr=3.17e-06]
Epoch 5/5:  27%|██▋       | 318/1177 [14:23<39:11,  2.74s/it, exist=0.2382, loss=0.4966, lr=3.17e-06]
Epoch 5/5:  27%|██▋       | 318/1177 [14:25<39:11,  2.74s/it, exist=0.2388, loss=0.4970, lr=3.17e-06]
Epoch 5/5:  27%|██▋       | 319/1177 [14:25<35:48,  2.50s/it, exist=0.2388, loss=0.4970, lr=3.17e-06]
Epoch 5/5:  27%|██▋       | 319/1177 [14:28<35:48,  2.50s/it, exist=0.2395, loss=0.4976, lr=3.16e-06]
Epoch 5/5:  27%|██▋       | 320/1177 [14:28<38:22,  2.69s/it, exist=0.2395, loss=0.4976, lr=3.16e-06]
Epoch 5/5:  27%|██▋       | 320/1177 [14:31<38:22,  2.69s/it, exist=0.2391, loss=0.4972, lr=3.15e-06]
Epoch 5/5:  27%|██▋       | 321/1177 [14:31<38:15,  2.68s/it, exist=0.2391, loss=0.4972, lr=3.15e-06]
Epoch 5/5:  27%|██▋       | 321/1177 [14:34<38:15,  2.68s/it, exist=0.2401, loss=0.4980, lr=3.15e-06]
Epoch 5/5:  27%|██▋       | 322/1177 [14:34<41:22,  2.90s/it, exist=0.2401, loss=0.4980, lr=3.15e-06]
Epoch 5/5:  27%|██▋       | 322/1177 [14:36<41:22,  2.90s/it, exist=0.2402, loss=0.4980, lr=3.14e-06]
Epoch 5/5:  27%|██▋       | 323/1177 [14:36<37:14,  2.62s/it, exist=0.2402, loss=0.4980, lr=3.14e-06]
Epoch 5/5:  27%|██▋       | 323/1177 [14:38<37:14,  2.62s/it, exist=0.2406, loss=0.4993, lr=3.13e-06]
Epoch 5/5:  28%|██▊       | 324/1177 [14:38<34:50,  2.45s/it, exist=0.2406, loss=0.4993, lr=3.13e-06]
Epoch 5/5:  28%|██▊       | 324/1177 [14:42<34:50,  2.45s/it, exist=0.2405, loss=0.4992, lr=3.12e-06]
Epoch 5/5:  28%|██▊       | 325/1177 [14:42<38:11,  2.69s/it, exist=0.2405, loss=0.4992, lr=3.12e-06]
Epoch 5/5:  28%|██▊       | 325/1177 [14:44<38:11,  2.69s/it, exist=0.2407, loss=0.4992, lr=3.12e-06]
Epoch 5/5:  28%|██▊       | 326/1177 [14:44<34:55,  2.46s/it, exist=0.2407, loss=0.4992, lr=3.12e-06]
Epoch 5/5:  28%|██▊       | 326/1177 [14:47<34:55,  2.46s/it, exist=0.2402, loss=0.4987, lr=3.11e-06]
Epoch 5/5:  28%|██▊       | 327/1177 [14:47<36:34,  2.58s/it, exist=0.2402, loss=0.4987, lr=3.11e-06]
Epoch 5/5:  28%|██▊       | 327/1177 [14:50<36:34,  2.58s/it, exist=0.2398, loss=0.4982, lr=3.10e-06]
Epoch 5/5:  28%|██▊       | 328/1177 [14:50<39:46,  2.81s/it, exist=0.2398, loss=0.4982, lr=3.10e-06]
Epoch 5/5:  28%|██▊       | 328/1177 [14:52<39:46,  2.81s/it, exist=0.2399, loss=0.4983, lr=3.10e-06]
Epoch 5/5:  28%|██▊       | 329/1177 [14:52<36:42,  2.60s/it, exist=0.2399, loss=0.4983, lr=3.10e-06]
Epoch 5/5:  28%|██▊       | 329/1177 [14:55<36:42,  2.60s/it, exist=0.2398, loss=0.4984, lr=3.09e-06]
Epoch 5/5:  28%|██▊       | 330/1177 [14:55<38:55,  2.76s/it, exist=0.2398, loss=0.4984, lr=3.09e-06]
Epoch 5/5:  28%|██▊       | 330/1177 [14:58<38:55,  2.76s/it, exist=0.2393, loss=0.4977, lr=3.08e-06]
Epoch 5/5:  28%|██▊       | 331/1177 [14:58<39:46,  2.82s/it, exist=0.2393, loss=0.4977, lr=3.08e-06]
Epoch 5/5:  28%|██▊       | 331/1177 [15:01<39:46,  2.82s/it, exist=0.2399, loss=0.4981, lr=3.07e-06]
Epoch 5/5:  28%|██▊       | 332/1177 [15:01<38:42,  2.75s/it, exist=0.2399, loss=0.4981, lr=3.07e-06]
Epoch 5/5:  28%|██▊       | 332/1177 [15:04<38:42,  2.75s/it, exist=0.2394, loss=0.4978, lr=3.07e-06]
Epoch 5/5:  28%|██▊       | 333/1177 [15:04<39:39,  2.82s/it, exist=0.2394, loss=0.4978, lr=3.07e-06]
Epoch 5/5:  28%|██▊       | 333/1177 [15:07<39:39,  2.82s/it, exist=0.2397, loss=0.4979, lr=3.06e-06]
Epoch 5/5:  28%|██▊       | 334/1177 [15:07<42:12,  3.00s/it, exist=0.2397, loss=0.4979, lr=3.06e-06]
Epoch 5/5:  28%|██▊       | 334/1177 [15:12<42:12,  3.00s/it, exist=0.2403, loss=0.4986, lr=3.05e-06]
Epoch 5/5:  28%|██▊       | 335/1177 [15:12<48:54,  3.48s/it, exist=0.2403, loss=0.4986, lr=3.05e-06]
Epoch 5/5:  28%|██▊       | 335/1177 [15:15<48:54,  3.48s/it, exist=0.2397, loss=0.4981, lr=3.05e-06]
Epoch 5/5:  29%|██▊       | 336/1177 [15:15<49:00,  3.50s/it, exist=0.2397, loss=0.4981, lr=3.05e-06]
Epoch 5/5:  29%|██▊       | 336/1177 [15:18<49:00,  3.50s/it, exist=0.2396, loss=0.4979, lr=3.04e-06]
Epoch 5/5:  29%|██▊       | 337/1177 [15:18<45:43,  3.27s/it, exist=0.2396, loss=0.4979, lr=3.04e-06]
Epoch 5/5:  29%|██▊       | 337/1177 [15:21<45:43,  3.27s/it, exist=0.2393, loss=0.4978, lr=3.03e-06]
Epoch 5/5:  29%|██▊       | 338/1177 [15:21<43:26,  3.11s/it, exist=0.2393, loss=0.4978, lr=3.03e-06]
Epoch 5/5:  29%|██▊       | 338/1177 [15:23<43:26,  3.11s/it, exist=0.2397, loss=0.4983, lr=3.02e-06]
Epoch 5/5:  29%|██▉       | 339/1177 [15:23<41:02,  2.94s/it, exist=0.2397, loss=0.4983, lr=3.02e-06]
Epoch 5/5:  29%|██▉       | 339/1177 [15:27<41:02,  2.94s/it, exist=0.2392, loss=0.4980, lr=3.02e-06]
Epoch 5/5:  29%|██▉       | 340/1177 [15:27<42:33,  3.05s/it, exist=0.2392, loss=0.4980, lr=3.02e-06]
Epoch 5/5:  29%|██▉       | 340/1177 [15:30<42:33,  3.05s/it, exist=0.2388, loss=0.4975, lr=3.01e-06]
Epoch 5/5:  29%|██▉       | 341/1177 [15:30<46:15,  3.32s/it, exist=0.2388, loss=0.4975, lr=3.01e-06]
Epoch 5/5:  29%|██▉       | 341/1177 [15:33<46:15,  3.32s/it, exist=0.2387, loss=0.4973, lr=3.00e-06]
Epoch 5/5:  29%|██▉       | 342/1177 [15:33<40:52,  2.94s/it, exist=0.2387, loss=0.4973, lr=3.00e-06]
Epoch 5/5:  29%|██▉       | 342/1177 [15:35<40:52,  2.94s/it, exist=0.2384, loss=0.4968, lr=3.00e-06]
Epoch 5/5:  29%|██▉       | 343/1177 [15:35<39:58,  2.88s/it, exist=0.2384, loss=0.4968, lr=3.00e-06]
Epoch 5/5:  29%|██▉       | 343/1177 [15:38<39:58,  2.88s/it, exist=0.2380, loss=0.4964, lr=2.99e-06]
Epoch 5/5:  29%|██▉       | 344/1177 [15:38<38:58,  2.81s/it, exist=0.2380, loss=0.4964, lr=2.99e-06]
Epoch 5/5:  29%|██▉       | 344/1177 [15:40<38:58,  2.81s/it, exist=0.2377, loss=0.4960, lr=2.98e-06]
Epoch 5/5:  29%|██▉       | 345/1177 [15:40<37:43,  2.72s/it, exist=0.2377, loss=0.4960, lr=2.98e-06]
Epoch 5/5:  29%|██▉       | 345/1177 [15:43<37:43,  2.72s/it, exist=0.2374, loss=0.4966, lr=2.98e-06]
Epoch 5/5:  29%|██▉       | 346/1177 [15:43<36:54,  2.67s/it, exist=0.2374, loss=0.4966, lr=2.98e-06]
Epoch 5/5:  29%|██▉       | 346/1177 [15:46<36:54,  2.67s/it, exist=0.2379, loss=0.4971, lr=2.97e-06]
Epoch 5/5:  29%|██▉       | 347/1177 [15:46<39:35,  2.86s/it, exist=0.2379, loss=0.4971, lr=2.97e-06]
Epoch 5/5:  29%|██▉       | 347/1177 [15:49<39:35,  2.86s/it, exist=0.2374, loss=0.4965, lr=2.96e-06]
Epoch 5/5:  30%|██▉       | 348/1177 [15:49<38:39,  2.80s/it, exist=0.2374, loss=0.4965, lr=2.96e-06]
Epoch 5/5:  30%|██▉       | 348/1177 [15:54<38:39,  2.80s/it, exist=0.2369, loss=0.4962, lr=2.95e-06]
Epoch 5/5:  30%|██▉       | 349/1177 [15:54<46:28,  3.37s/it, exist=0.2369, loss=0.4962, lr=2.95e-06]
Epoch 5/5:  30%|██▉       | 349/1177 [16:00<46:28,  3.37s/it, exist=0.2370, loss=0.4963, lr=2.95e-06]
Epoch 5/5:  30%|██▉       | 350/1177 [16:00<58:37,  4.25s/it, exist=0.2370, loss=0.4963, lr=2.95e-06]
Epoch 5/5:  30%|██▉       | 350/1177 [16:02<58:37,  4.25s/it, exist=0.2365, loss=0.4960, lr=2.94e-06]
Epoch 5/5:  30%|██▉       | 351/1177 [16:02<51:18,  3.73s/it, exist=0.2365, loss=0.4960, lr=2.94e-06]
Epoch 5/5:  30%|██▉       | 351/1177 [16:05<51:18,  3.73s/it, exist=0.2363, loss=0.4957, lr=2.93e-06]
Epoch 5/5:  30%|██▉       | 352/1177 [16:05<46:57,  3.41s/it, exist=0.2363, loss=0.4957, lr=2.93e-06]
Epoch 5/5:  30%|██▉       | 352/1177 [16:08<46:57,  3.41s/it, exist=0.2360, loss=0.4952, lr=2.93e-06]
Epoch 5/5:  30%|██▉       | 353/1177 [16:08<43:29,  3.17s/it, exist=0.2360, loss=0.4952, lr=2.93e-06]
Epoch 5/5:  30%|██▉       | 353/1177 [16:12<43:29,  3.17s/it, exist=0.2363, loss=0.4955, lr=2.92e-06]
Epoch 5/5:  30%|███       | 354/1177 [16:12<47:15,  3.45s/it, exist=0.2363, loss=0.4955, lr=2.92e-06]
Epoch 5/5:  30%|███       | 354/1177 [16:16<47:15,  3.45s/it, exist=0.2358, loss=0.4949, lr=2.91e-06]
Epoch 5/5:  30%|███       | 355/1177 [16:16<48:17,  3.52s/it, exist=0.2358, loss=0.4949, lr=2.91e-06]
Epoch 5/5:  30%|███       | 355/1177 [16:18<48:17,  3.52s/it, exist=0.2355, loss=0.4945, lr=2.91e-06]
Epoch 5/5:  30%|███       | 356/1177 [16:18<44:56,  3.28s/it, exist=0.2355, loss=0.4945, lr=2.91e-06]
Epoch 5/5:  30%|███       | 356/1177 [16:22<44:56,  3.28s/it, exist=0.2350, loss=0.4939, lr=2.90e-06]
Epoch 5/5:  30%|███       | 357/1177 [16:22<46:00,  3.37s/it, exist=0.2350, loss=0.4939, lr=2.90e-06]
Epoch 5/5:  30%|███       | 357/1177 [16:26<46:00,  3.37s/it, exist=0.2350, loss=0.4940, lr=2.89e-06]
Epoch 5/5:  30%|███       | 358/1177 [16:26<50:36,  3.71s/it, exist=0.2350, loss=0.4940, lr=2.89e-06]
Epoch 5/5:  30%|███       | 358/1177 [16:30<50:36,  3.71s/it, exist=0.2355, loss=0.4945, lr=2.88e-06]
Epoch 5/5:  31%|███       | 359/1177 [16:30<49:32,  3.63s/it, exist=0.2355, loss=0.4945, lr=2.88e-06]
Epoch 5/5:  31%|███       | 359/1177 [16:32<49:32,  3.63s/it, exist=0.2360, loss=0.4953, lr=2.88e-06]
Epoch 5/5:  31%|███       | 360/1177 [16:32<45:22,  3.33s/it, exist=0.2360, loss=0.4953, lr=2.88e-06]
Epoch 5/5:  31%|███       | 360/1177 [16:36<45:22,  3.33s/it, exist=0.2357, loss=0.4948, lr=2.87e-06]
Epoch 5/5:  31%|███       | 361/1177 [16:36<47:27,  3.49s/it, exist=0.2357, loss=0.4948, lr=2.87e-06]
Epoch 5/5:  31%|███       | 361/1177 [16:39<47:27,  3.49s/it, exist=0.2354, loss=0.4946, lr=2.86e-06]
Epoch 5/5:  31%|███       | 362/1177 [16:39<44:23,  3.27s/it, exist=0.2354, loss=0.4946, lr=2.86e-06]
Epoch 5/5:  31%|███       | 362/1177 [16:43<44:23,  3.27s/it, exist=0.2352, loss=0.4942, lr=2.86e-06]
Epoch 5/5:  31%|███       | 363/1177 [16:43<47:50,  3.53s/it, exist=0.2352, loss=0.4942, lr=2.86e-06]
Epoch 5/5:  31%|███       | 363/1177 [16:45<47:50,  3.53s/it, exist=0.2357, loss=0.4946, lr=2.85e-06]
Epoch 5/5:  31%|███       | 364/1177 [16:45<42:23,  3.13s/it, exist=0.2357, loss=0.4946, lr=2.85e-06]
Epoch 5/5:  31%|███       | 364/1177 [16:47<42:23,  3.13s/it, exist=0.2364, loss=0.4952, lr=2.84e-06]
Epoch 5/5:  31%|███       | 365/1177 [16:47<38:15,  2.83s/it, exist=0.2364, loss=0.4952, lr=2.84e-06]
Epoch 5/5:  31%|███       | 365/1177 [16:51<38:15,  2.83s/it, exist=0.2360, loss=0.4947, lr=2.84e-06]
Epoch 5/5:  31%|███       | 366/1177 [16:51<40:21,  2.99s/it, exist=0.2360, loss=0.4947, lr=2.84e-06]
Epoch 5/5:  31%|███       | 366/1177 [16:53<40:21,  2.99s/it, exist=0.2360, loss=0.4950, lr=2.83e-06]
Epoch 5/5:  31%|███       | 367/1177 [16:53<36:10,  2.68s/it, exist=0.2360, loss=0.4950, lr=2.83e-06]
Epoch 5/5:  31%|███       | 367/1177 [16:56<36:10,  2.68s/it, exist=0.2364, loss=0.4952, lr=2.82e-06]
Epoch 5/5:  31%|███▏      | 368/1177 [16:56<36:24,  2.70s/it, exist=0.2364, loss=0.4952, lr=2.82e-06]
Epoch 5/5:  31%|███▏      | 368/1177 [16:59<36:24,  2.70s/it, exist=0.2361, loss=0.4948, lr=2.82e-06]
Epoch 5/5:  31%|███▏      | 369/1177 [16:59<38:02,  2.82s/it, exist=0.2361, loss=0.4948, lr=2.82e-06]
Epoch 5/5:  31%|███▏      | 369/1177 [17:01<38:02,  2.82s/it, exist=0.2359, loss=0.4945, lr=2.81e-06]
Epoch 5/5:  31%|███▏      | 370/1177 [17:01<36:55,  2.75s/it, exist=0.2359, loss=0.4945, lr=2.81e-06]
Epoch 5/5:  31%|███▏      | 370/1177 [17:04<36:55,  2.75s/it, exist=0.2354, loss=0.4939, lr=2.80e-06]
Epoch 5/5:  32%|███▏      | 371/1177 [17:04<37:31,  2.79s/it, exist=0.2354, loss=0.4939, lr=2.80e-06]
Epoch 5/5:  32%|███▏      | 371/1177 [17:06<37:31,  2.79s/it, exist=0.2358, loss=0.4942, lr=2.80e-06]
Epoch 5/5:  32%|███▏      | 372/1177 [17:06<34:05,  2.54s/it, exist=0.2358, loss=0.4942, lr=2.80e-06]
Epoch 5/5:  32%|███▏      | 372/1177 [17:09<34:05,  2.54s/it, exist=0.2364, loss=0.4947, lr=2.79e-06]
Epoch 5/5:  32%|███▏      | 373/1177 [17:09<34:19,  2.56s/it, exist=0.2364, loss=0.4947, lr=2.79e-06]
Epoch 5/5:  32%|███▏      | 373/1177 [17:11<34:19,  2.56s/it, exist=0.2372, loss=0.4955, lr=2.78e-06]
Epoch 5/5:  32%|███▏      | 374/1177 [17:11<31:49,  2.38s/it, exist=0.2372, loss=0.4955, lr=2.78e-06]
Epoch 5/5:  32%|███▏      | 374/1177 [17:14<31:49,  2.38s/it, exist=0.2387, loss=0.4968, lr=2.78e-06]
Epoch 5/5:  32%|███▏      | 375/1177 [17:14<35:54,  2.69s/it, exist=0.2387, loss=0.4968, lr=2.78e-06]
Epoch 5/5:  32%|███▏      | 375/1177 [17:19<35:54,  2.69s/it, exist=0.2385, loss=0.4965, lr=2.77e-06]
Epoch 5/5:  32%|███▏      | 376/1177 [17:19<44:04,  3.30s/it, exist=0.2385, loss=0.4965, lr=2.77e-06]
Epoch 5/5:  32%|███▏      | 376/1177 [17:24<44:04,  3.30s/it, exist=0.2385, loss=0.4965, lr=2.76e-06]
Epoch 5/5:  32%|███▏      | 377/1177 [17:24<52:07,  3.91s/it, exist=0.2385, loss=0.4965, lr=2.76e-06]
Epoch 5/5:  32%|███▏      | 377/1177 [17:31<52:07,  3.91s/it, exist=0.2386, loss=0.4965, lr=2.75e-06]
Epoch 5/5:  32%|███▏      | 378/1177 [17:31<1:05:25,  4.91s/it, exist=0.2386, loss=0.4965, lr=2.75e-06]
Epoch 5/5:  32%|███▏      | 378/1177 [17:37<1:05:25,  4.91s/it, exist=0.2381, loss=0.4962, lr=2.75e-06]
Epoch 5/5:  32%|███▏      | 379/1177 [17:37<1:09:05,  5.19s/it, exist=0.2381, loss=0.4962, lr=2.75e-06]
Epoch 5/5:  32%|███▏      | 379/1177 [17:40<1:09:05,  5.19s/it, exist=0.2383, loss=0.4963, lr=2.74e-06]
Epoch 5/5:  32%|███▏      | 380/1177 [17:40<59:30,  4.48s/it, exist=0.2383, loss=0.4963, lr=2.74e-06]  
Epoch 5/5:  32%|███▏      | 380/1177 [17:44<59:30,  4.48s/it, exist=0.2379, loss=0.4958, lr=2.73e-06]
Epoch 5/5:  32%|███▏      | 381/1177 [17:44<56:49,  4.28s/it, exist=0.2379, loss=0.4958, lr=2.73e-06]
Epoch 5/5:  32%|███▏      | 381/1177 [17:48<56:49,  4.28s/it, exist=0.2376, loss=0.4954, lr=2.73e-06]
Epoch 5/5:  32%|███▏      | 382/1177 [17:48<54:21,  4.10s/it, exist=0.2376, loss=0.4954, lr=2.73e-06]
Epoch 5/5:  32%|███▏      | 382/1177 [17:51<54:21,  4.10s/it, exist=0.2384, loss=0.4962, lr=2.72e-06]
Epoch 5/5:  33%|███▎      | 383/1177 [17:51<52:53,  4.00s/it, exist=0.2384, loss=0.4962, lr=2.72e-06]
Epoch 5/5:  33%|███▎      | 383/1177 [17:55<52:53,  4.00s/it, exist=0.2384, loss=0.4960, lr=2.71e-06]
Epoch 5/5:  33%|███▎      | 384/1177 [17:55<52:08,  3.94s/it, exist=0.2384, loss=0.4960, lr=2.71e-06]
Epoch 5/5:  33%|███▎      | 384/1177 [17:59<52:08,  3.94s/it, exist=0.2385, loss=0.4960, lr=2.71e-06]
Epoch 5/5:  33%|███▎      | 385/1177 [17:59<50:56,  3.86s/it, exist=0.2385, loss=0.4960, lr=2.71e-06]
Epoch 5/5:  33%|███▎      | 385/1177 [18:02<50:56,  3.86s/it, exist=0.2384, loss=0.4958, lr=2.70e-06]
Epoch 5/5:  33%|███▎      | 386/1177 [18:02<50:26,  3.83s/it, exist=0.2384, loss=0.4958, lr=2.70e-06]
Epoch 5/5:  33%|███▎      | 386/1177 [18:06<50:26,  3.83s/it, exist=0.2384, loss=0.4960, lr=2.69e-06]
Epoch 5/5:  33%|███▎      | 387/1177 [18:06<49:42,  3.78s/it, exist=0.2384, loss=0.4960, lr=2.69e-06]
Epoch 5/5:  33%|███▎      | 387/1177 [18:09<49:42,  3.78s/it, exist=0.2389, loss=0.4967, lr=2.69e-06]
Epoch 5/5:  33%|███▎      | 388/1177 [18:09<45:25,  3.45s/it, exist=0.2389, loss=0.4967, lr=2.69e-06]
Epoch 5/5:  33%|███▎      | 388/1177 [18:15<45:25,  3.45s/it, exist=0.2386, loss=0.4967, lr=2.68e-06]
Epoch 5/5:  33%|███▎      | 389/1177 [18:15<56:19,  4.29s/it, exist=0.2386, loss=0.4967, lr=2.68e-06]
Epoch 5/5:  33%|███▎      | 389/1177 [18:20<56:19,  4.29s/it, exist=0.2383, loss=0.4964, lr=2.67e-06]
Epoch 5/5:  33%|███▎      | 390/1177 [18:20<57:07,  4.36s/it, exist=0.2383, loss=0.4964, lr=2.67e-06]
Epoch 5/5:  33%|███▎      | 390/1177 [18:24<57:07,  4.36s/it, exist=0.2382, loss=0.4962, lr=2.67e-06]
Epoch 5/5:  33%|███▎      | 391/1177 [18:24<58:30,  4.47s/it, exist=0.2382, loss=0.4962, lr=2.67e-06]
Epoch 5/5:  33%|███▎      | 391/1177 [18:29<58:30,  4.47s/it, exist=0.2377, loss=0.4956, lr=2.66e-06]
Epoch 5/5:  33%|███▎      | 392/1177 [18:29<58:59,  4.51s/it, exist=0.2377, loss=0.4956, lr=2.66e-06]
Epoch 5/5:  33%|███▎      | 392/1177 [18:34<58:59,  4.51s/it, exist=0.2373, loss=0.4953, lr=2.65e-06]
Epoch 5/5:  33%|███▎      | 393/1177 [18:34<1:01:54,  4.74s/it, exist=0.2373, loss=0.4953, lr=2.65e-06]
Epoch 5/5:  33%|███▎      | 393/1177 [18:37<1:01:54,  4.74s/it, exist=0.2373, loss=0.4953, lr=2.65e-06]
Epoch 5/5:  33%|███▎      | 394/1177 [18:37<54:05,  4.15s/it, exist=0.2373, loss=0.4953, lr=2.65e-06]  
Epoch 5/5:  33%|███▎      | 394/1177 [18:40<54:05,  4.15s/it, exist=0.2377, loss=0.4958, lr=2.64e-06]
Epoch 5/5:  34%|███▎      | 395/1177 [18:40<50:27,  3.87s/it, exist=0.2377, loss=0.4958, lr=2.64e-06]
Epoch 5/5:  34%|███▎      | 395/1177 [18:42<50:27,  3.87s/it, exist=0.2378, loss=0.4959, lr=2.63e-06]
Epoch 5/5:  34%|███▎      | 396/1177 [18:42<43:24,  3.34s/it, exist=0.2378, loss=0.4959, lr=2.63e-06]
Epoch 5/5:  34%|███▎      | 396/1177 [18:44<43:24,  3.34s/it, exist=0.2382, loss=0.4963, lr=2.63e-06]
Epoch 5/5:  34%|███▎      | 397/1177 [18:44<38:12,  2.94s/it, exist=0.2382, loss=0.4963, lr=2.63e-06]
Epoch 5/5:  34%|███▎      | 397/1177 [18:47<38:12,  2.94s/it, exist=0.2378, loss=0.4959, lr=2.62e-06]
Epoch 5/5:  34%|███▍      | 398/1177 [18:47<38:23,  2.96s/it, exist=0.2378, loss=0.4959, lr=2.62e-06]
Epoch 5/5:  34%|███▍      | 398/1177 [18:51<38:23,  2.96s/it, exist=0.2377, loss=0.4956, lr=2.61e-06]
Epoch 5/5:  34%|███▍      | 399/1177 [18:51<40:38,  3.13s/it, exist=0.2377, loss=0.4956, lr=2.61e-06]
Epoch 5/5:  34%|███▍      | 399/1177 [18:55<40:38,  3.13s/it, exist=0.2376, loss=0.4956, lr=2.61e-06]
Epoch 5/5:  34%|███▍      | 400/1177 [18:55<43:45,  3.38s/it, exist=0.2376, loss=0.4956, lr=2.61e-06]
Epoch 5/5:  34%|███▍      | 400/1177 [18:57<43:45,  3.38s/it, exist=0.2372, loss=0.4950, lr=2.60e-06]
Epoch 5/5:  34%|███▍      | 401/1177 [18:57<40:47,  3.15s/it, exist=0.2372, loss=0.4950, lr=2.60e-06]
Epoch 5/5:  34%|███▍      | 401/1177 [19:00<40:47,  3.15s/it, exist=0.2369, loss=0.4947, lr=2.59e-06]
Epoch 5/5:  34%|███▍      | 402/1177 [19:00<39:34,  3.06s/it, exist=0.2369, loss=0.4947, lr=2.59e-06]
Epoch 5/5:  34%|███▍      | 402/1177 [19:03<39:34,  3.06s/it, exist=0.2381, loss=0.4963, lr=2.59e-06]
Epoch 5/5:  34%|███▍      | 403/1177 [19:03<37:49,  2.93s/it, exist=0.2381, loss=0.4963, lr=2.59e-06]
Epoch 5/5:  34%|███▍      | 403/1177 [19:07<37:49,  2.93s/it, exist=0.2382, loss=0.4962, lr=2.58e-06]
Epoch 5/5:  34%|███▍      | 404/1177 [19:07<40:37,  3.15s/it, exist=0.2382, loss=0.4962, lr=2.58e-06]
Epoch 5/5:  34%|███▍      | 404/1177 [19:10<40:37,  3.15s/it, exist=0.2379, loss=0.4958, lr=2.58e-06]
Epoch 5/5:  34%|███▍      | 405/1177 [19:10<42:07,  3.27s/it, exist=0.2379, loss=0.4958, lr=2.58e-06]
Epoch 5/5:  34%|███▍      | 405/1177 [19:15<42:07,  3.27s/it, exist=0.2376, loss=0.4956, lr=2.57e-06]
Epoch 5/5:  34%|███▍      | 406/1177 [19:15<49:23,  3.84s/it, exist=0.2376, loss=0.4956, lr=2.57e-06]
Epoch 5/5:  34%|███▍      | 406/1177 [19:20<49:23,  3.84s/it, exist=0.2371, loss=0.4952, lr=2.56e-06]
Epoch 5/5:  35%|███▍      | 407/1177 [19:20<54:03,  4.21s/it, exist=0.2371, loss=0.4952, lr=2.56e-06]
Epoch 5/5:  35%|███▍      | 407/1177 [19:28<54:03,  4.21s/it, exist=0.2375, loss=0.4955, lr=2.56e-06]
Epoch 5/5:  35%|███▍      | 408/1177 [19:28<1:07:37,  5.28s/it, exist=0.2375, loss=0.4955, lr=2.56e-06]
Epoch 5/5:  35%|███▍      | 408/1177 [19:32<1:07:37,  5.28s/it, exist=0.2372, loss=0.4951, lr=2.55e-06]
Epoch 5/5:  35%|███▍      | 409/1177 [19:32<1:00:19,  4.71s/it, exist=0.2372, loss=0.4951, lr=2.55e-06]
Epoch 5/5:  35%|███▍      | 409/1177 [19:34<1:00:19,  4.71s/it, exist=0.2372, loss=0.4950, lr=2.54e-06]
Epoch 5/5:  35%|███▍      | 410/1177 [19:34<49:55,  3.90s/it, exist=0.2372, loss=0.4950, lr=2.54e-06]  
Epoch 5/5:  35%|███▍      | 410/1177 [19:36<49:55,  3.90s/it, exist=0.2368, loss=0.4945, lr=2.54e-06]
Epoch 5/5:  35%|███▍      | 411/1177 [19:36<42:39,  3.34s/it, exist=0.2368, loss=0.4945, lr=2.54e-06]
Epoch 5/5:  35%|███▍      | 411/1177 [19:38<42:39,  3.34s/it, exist=0.2366, loss=0.4942, lr=2.53e-06]
Epoch 5/5:  35%|███▌      | 412/1177 [19:38<37:23,  2.93s/it, exist=0.2366, loss=0.4942, lr=2.53e-06]
Epoch 5/5:  35%|███▌      | 412/1177 [19:39<37:23,  2.93s/it, exist=0.2368, loss=0.4944, lr=2.52e-06]
Epoch 5/5:  35%|███▌      | 413/1177 [19:39<33:30,  2.63s/it, exist=0.2368, loss=0.4944, lr=2.52e-06]
Epoch 5/5:  35%|███▌      | 413/1177 [19:42<33:30,  2.63s/it, exist=0.2374, loss=0.4949, lr=2.52e-06]
Epoch 5/5:  35%|███▌      | 414/1177 [19:42<32:59,  2.59s/it, exist=0.2374, loss=0.4949, lr=2.52e-06]
Epoch 5/5:  35%|███▌      | 414/1177 [19:45<32:59,  2.59s/it, exist=0.2371, loss=0.4947, lr=2.51e-06]
Epoch 5/5:  35%|███▌      | 415/1177 [19:45<35:36,  2.80s/it, exist=0.2371, loss=0.4947, lr=2.51e-06]
Epoch 5/5:  35%|███▌      | 415/1177 [19:48<35:36,  2.80s/it, exist=0.2371, loss=0.4947, lr=2.50e-06]
Epoch 5/5:  35%|███▌      | 416/1177 [19:48<36:46,  2.90s/it, exist=0.2371, loss=0.4947, lr=2.50e-06]
Epoch 5/5:  35%|███▌      | 416/1177 [19:50<36:46,  2.90s/it, exist=0.2368, loss=0.4943, lr=2.50e-06]
Epoch 5/5:  35%|███▌      | 417/1177 [19:50<33:05,  2.61s/it, exist=0.2368, loss=0.4943, lr=2.50e-06]
Epoch 5/5:  35%|███▌      | 417/1177 [19:53<33:05,  2.61s/it, exist=0.2372, loss=0.4947, lr=2.49e-06]
Epoch 5/5:  36%|███▌      | 418/1177 [19:53<32:21,  2.56s/it, exist=0.2372, loss=0.4947, lr=2.49e-06]
Epoch 5/5:  36%|███▌      | 418/1177 [19:56<32:21,  2.56s/it, exist=0.2371, loss=0.4945, lr=2.48e-06]
Epoch 5/5:  36%|███▌      | 419/1177 [19:56<32:58,  2.61s/it, exist=0.2371, loss=0.4945, lr=2.48e-06]
Epoch 5/5:  36%|███▌      | 419/1177 [19:59<32:58,  2.61s/it, exist=0.2382, loss=0.4957, lr=2.48e-06]
Epoch 5/5:  36%|███▌      | 420/1177 [19:59<34:48,  2.76s/it, exist=0.2382, loss=0.4957, lr=2.48e-06]
Epoch 5/5:  36%|███▌      | 420/1177 [20:01<34:48,  2.76s/it, exist=0.2380, loss=0.4954, lr=2.47e-06]
Epoch 5/5:  36%|███▌      | 421/1177 [20:01<33:45,  2.68s/it, exist=0.2380, loss=0.4954, lr=2.47e-06]
Epoch 5/5:  36%|███▌      | 421/1177 [20:04<33:45,  2.68s/it, exist=0.2384, loss=0.4958, lr=2.46e-06]
Epoch 5/5:  36%|███▌      | 422/1177 [20:04<35:54,  2.85s/it, exist=0.2384, loss=0.4958, lr=2.46e-06]
Epoch 5/5:  36%|███▌      | 422/1177 [20:08<35:54,  2.85s/it, exist=0.2381, loss=0.4954, lr=2.46e-06]
Epoch 5/5:  36%|███▌      | 423/1177 [20:08<38:36,  3.07s/it, exist=0.2381, loss=0.4954, lr=2.46e-06]
Epoch 5/5:  36%|███▌      | 423/1177 [20:12<38:36,  3.07s/it, exist=0.2386, loss=0.4961, lr=2.45e-06]
Epoch 5/5:  36%|███▌      | 424/1177 [20:12<44:05,  3.51s/it, exist=0.2386, loss=0.4961, lr=2.45e-06]
Epoch 5/5:  36%|███▌      | 424/1177 [20:16<44:05,  3.51s/it, exist=0.2393, loss=0.4967, lr=2.45e-06]
Epoch 5/5:  36%|███▌      | 425/1177 [20:16<44:54,  3.58s/it, exist=0.2393, loss=0.4967, lr=2.45e-06]
Epoch 5/5:  36%|███▌      | 425/1177 [20:20<44:54,  3.58s/it, exist=0.2389, loss=0.4962, lr=2.44e-06]
Epoch 5/5:  36%|███▌      | 426/1177 [20:20<44:51,  3.58s/it, exist=0.2389, loss=0.4962, lr=2.44e-06]
Epoch 5/5:  36%|███▌      | 426/1177 [20:23<44:51,  3.58s/it, exist=0.2389, loss=0.4961, lr=2.43e-06]
Epoch 5/5:  36%|███▋      | 427/1177 [20:23<44:41,  3.57s/it, exist=0.2389, loss=0.4961, lr=2.43e-06]
Epoch 5/5:  36%|███▋      | 427/1177 [20:27<44:41,  3.57s/it, exist=0.2387, loss=0.4959, lr=2.43e-06]
Epoch 5/5:  36%|███▋      | 428/1177 [20:27<44:09,  3.54s/it, exist=0.2387, loss=0.4959, lr=2.43e-06]
Epoch 5/5:  36%|███▋      | 428/1177 [20:29<44:09,  3.54s/it, exist=0.2384, loss=0.4955, lr=2.42e-06]
Epoch 5/5:  36%|███▋      | 429/1177 [20:29<40:04,  3.21s/it, exist=0.2384, loss=0.4955, lr=2.42e-06]
Epoch 5/5:  36%|███▋      | 429/1177 [20:31<40:04,  3.21s/it, exist=0.2383, loss=0.4953, lr=2.41e-06]
Epoch 5/5:  37%|███▋      | 430/1177 [20:31<35:19,  2.84s/it, exist=0.2383, loss=0.4953, lr=2.41e-06]
Epoch 5/5:  37%|███▋      | 430/1177 [20:34<35:19,  2.84s/it, exist=0.2380, loss=0.4951, lr=2.41e-06]
Epoch 5/5:  37%|███▋      | 431/1177 [20:34<34:40,  2.79s/it, exist=0.2380, loss=0.4951, lr=2.41e-06]
Epoch 5/5:  37%|███▋      | 431/1177 [20:37<34:40,  2.79s/it, exist=0.2376, loss=0.4950, lr=2.40e-06]
Epoch 5/5:  37%|███▋      | 432/1177 [20:37<34:10,  2.75s/it, exist=0.2376, loss=0.4950, lr=2.40e-06]
Epoch 5/5:  37%|███▋      | 432/1177 [20:39<34:10,  2.75s/it, exist=0.2373, loss=0.4948, lr=2.39e-06]
Epoch 5/5:  37%|███▋      | 433/1177 [20:39<31:12,  2.52s/it, exist=0.2373, loss=0.4948, lr=2.39e-06]
Epoch 5/5:  37%|███▋      | 433/1177 [20:41<31:12,  2.52s/it, exist=0.2370, loss=0.4946, lr=2.39e-06]
Epoch 5/5:  37%|███▋      | 434/1177 [20:41<29:07,  2.35s/it, exist=0.2370, loss=0.4946, lr=2.39e-06]
Epoch 5/5:  37%|███▋      | 434/1177 [20:45<29:07,  2.35s/it, exist=0.2369, loss=0.4947, lr=2.38e-06]
Epoch 5/5:  37%|███▋      | 435/1177 [20:45<35:33,  2.88s/it, exist=0.2369, loss=0.4947, lr=2.38e-06]
Epoch 5/5:  37%|███▋      | 435/1177 [20:48<35:33,  2.88s/it, exist=0.2366, loss=0.4945, lr=2.38e-06]
Epoch 5/5:  37%|███▋      | 436/1177 [20:48<39:05,  3.16s/it, exist=0.2366, loss=0.4945, lr=2.38e-06]
Epoch 5/5:  37%|███▋      | 436/1177 [20:52<39:05,  3.16s/it, exist=0.2369, loss=0.4949, lr=2.37e-06]
Epoch 5/5:  37%|███▋      | 437/1177 [20:52<39:17,  3.19s/it, exist=0.2369, loss=0.4949, lr=2.37e-06]
Epoch 5/5:  37%|███▋      | 437/1177 [20:54<39:17,  3.19s/it, exist=0.2370, loss=0.4950, lr=2.36e-06]
Epoch 5/5:  37%|███▋      | 438/1177 [20:54<36:51,  2.99s/it, exist=0.2370, loss=0.4950, lr=2.36e-06]
Epoch 5/5:  37%|███▋      | 438/1177 [20:56<36:51,  2.99s/it, exist=0.2367, loss=0.4946, lr=2.36e-06]
Epoch 5/5:  37%|███▋      | 439/1177 [20:56<32:56,  2.68s/it, exist=0.2367, loss=0.4946, lr=2.36e-06]
Epoch 5/5:  37%|███▋      | 439/1177 [20:58<32:56,  2.68s/it, exist=0.2365, loss=0.4945, lr=2.35e-06]
Epoch 5/5:  37%|███▋      | 440/1177 [20:58<30:22,  2.47s/it, exist=0.2365, loss=0.4945, lr=2.35e-06]
Epoch 5/5:  37%|███▋      | 440/1177 [21:01<30:22,  2.47s/it, exist=0.2367, loss=0.4946, lr=2.34e-06]
Epoch 5/5:  37%|███▋      | 441/1177 [21:01<32:43,  2.67s/it, exist=0.2367, loss=0.4946, lr=2.34e-06]
Epoch 5/5:  37%|███▋      | 441/1177 [21:04<32:43,  2.67s/it, exist=0.2364, loss=0.4942, lr=2.34e-06]
Epoch 5/5:  38%|███▊      | 442/1177 [21:04<32:02,  2.62s/it, exist=0.2364, loss=0.4942, lr=2.34e-06]
Epoch 5/5:  38%|███▊      | 442/1177 [21:06<32:02,  2.62s/it, exist=0.2364, loss=0.4942, lr=2.33e-06]
Epoch 5/5:  38%|███▊      | 443/1177 [21:06<31:57,  2.61s/it, exist=0.2364, loss=0.4942, lr=2.33e-06]
Epoch 5/5:  38%|███▊      | 443/1177 [21:09<31:57,  2.61s/it, exist=0.2361, loss=0.4942, lr=2.33e-06]
Epoch 5/5:  38%|███▊      | 444/1177 [21:09<31:43,  2.60s/it, exist=0.2361, loss=0.4942, lr=2.33e-06]
Epoch 5/5:  38%|███▊      | 444/1177 [21:11<31:43,  2.60s/it, exist=0.2359, loss=0.4940, lr=2.32e-06]
Epoch 5/5:  38%|███▊      | 445/1177 [21:11<31:17,  2.56s/it, exist=0.2359, loss=0.4940, lr=2.32e-06]
Epoch 5/5:  38%|███▊      | 445/1177 [21:14<31:17,  2.56s/it, exist=0.2357, loss=0.4938, lr=2.31e-06]
Epoch 5/5:  38%|███▊      | 446/1177 [21:14<30:35,  2.51s/it, exist=0.2357, loss=0.4938, lr=2.31e-06]
Epoch 5/5:  38%|███▊      | 446/1177 [21:16<30:35,  2.51s/it, exist=0.2356, loss=0.4938, lr=2.31e-06]
Epoch 5/5:  38%|███▊      | 447/1177 [21:16<28:49,  2.37s/it, exist=0.2356, loss=0.4938, lr=2.31e-06]
Epoch 5/5:  38%|███▊      | 447/1177 [21:19<28:49,  2.37s/it, exist=0.2356, loss=0.4937, lr=2.30e-06]
Epoch 5/5:  38%|███▊      | 448/1177 [21:19<31:14,  2.57s/it, exist=0.2356, loss=0.4937, lr=2.30e-06]
Epoch 5/5:  38%|███▊      | 448/1177 [21:21<31:14,  2.57s/it, exist=0.2357, loss=0.4937, lr=2.29e-06]
Epoch 5/5:  38%|███▊      | 449/1177 [21:21<28:57,  2.39s/it, exist=0.2357, loss=0.4937, lr=2.29e-06]
Epoch 5/5:  38%|███▊      | 449/1177 [21:23<28:57,  2.39s/it, exist=0.2358, loss=0.4937, lr=2.29e-06]
Epoch 5/5:  38%|███▊      | 450/1177 [21:23<29:19,  2.42s/it, exist=0.2358, loss=0.4937, lr=2.29e-06]
Epoch 5/5:  38%|███▊      | 450/1177 [21:27<29:19,  2.42s/it, exist=0.2356, loss=0.4936, lr=2.28e-06]
Epoch 5/5:  38%|███▊      | 451/1177 [21:27<32:18,  2.67s/it, exist=0.2356, loss=0.4936, lr=2.28e-06]
Epoch 5/5:  38%|███▊      | 451/1177 [21:29<32:18,  2.67s/it, exist=0.2358, loss=0.4939, lr=2.28e-06]
Epoch 5/5:  38%|███▊      | 452/1177 [21:29<31:55,  2.64s/it, exist=0.2358, loss=0.4939, lr=2.28e-06]
Epoch 5/5:  38%|███▊      | 452/1177 [21:31<31:55,  2.64s/it, exist=0.2356, loss=0.4936, lr=2.27e-06]
Epoch 5/5:  38%|███▊      | 453/1177 [21:31<29:30,  2.45s/it, exist=0.2356, loss=0.4936, lr=2.27e-06]
Epoch 5/5:  38%|███▊      | 453/1177 [21:34<29:30,  2.45s/it, exist=0.2352, loss=0.4933, lr=2.26e-06]
Epoch 5/5:  39%|███▊      | 454/1177 [21:34<31:54,  2.65s/it, exist=0.2352, loss=0.4933, lr=2.26e-06]
Epoch 5/5:  39%|███▊      | 454/1177 [21:36<31:54,  2.65s/it, exist=0.2350, loss=0.4933, lr=2.26e-06]
Epoch 5/5:  39%|███▊      | 455/1177 [21:36<29:21,  2.44s/it, exist=0.2350, loss=0.4933, lr=2.26e-06]
Epoch 5/5:  39%|███▊      | 455/1177 [21:40<29:21,  2.44s/it, exist=0.2352, loss=0.4933, lr=2.25e-06]
Epoch 5/5:  39%|███▊      | 456/1177 [21:40<32:12,  2.68s/it, exist=0.2352, loss=0.4933, lr=2.25e-06]
Epoch 5/5:  39%|███▊      | 456/1177 [21:42<32:12,  2.68s/it, exist=0.2349, loss=0.4931, lr=2.24e-06]
Epoch 5/5:  39%|███▉      | 457/1177 [21:42<32:06,  2.68s/it, exist=0.2349, loss=0.4931, lr=2.24e-06]
Epoch 5/5:  39%|███▉      | 457/1177 [21:44<32:06,  2.68s/it, exist=0.2350, loss=0.4931, lr=2.24e-06]
Epoch 5/5:  39%|███▉      | 458/1177 [21:44<29:42,  2.48s/it, exist=0.2350, loss=0.4931, lr=2.24e-06]
Epoch 5/5:  39%|███▉      | 458/1177 [21:47<29:42,  2.48s/it, exist=0.2352, loss=0.4931, lr=2.23e-06]
Epoch 5/5:  39%|███▉      | 459/1177 [21:47<32:29,  2.72s/it, exist=0.2352, loss=0.4931, lr=2.23e-06]
Epoch 5/5:  39%|███▉      | 459/1177 [21:49<32:29,  2.72s/it, exist=0.2350, loss=0.4929, lr=2.23e-06]
Epoch 5/5:  39%|███▉      | 460/1177 [21:49<30:01,  2.51s/it, exist=0.2350, loss=0.4929, lr=2.23e-06]
Epoch 5/5:  39%|███▉      | 460/1177 [21:52<30:01,  2.51s/it, exist=0.2346, loss=0.4924, lr=2.22e-06]
Epoch 5/5:  39%|███▉      | 461/1177 [21:52<30:25,  2.55s/it, exist=0.2346, loss=0.4924, lr=2.22e-06]
Epoch 5/5:  39%|███▉      | 461/1177 [21:56<30:25,  2.55s/it, exist=0.2347, loss=0.4924, lr=2.21e-06]
Epoch 5/5:  39%|███▉      | 462/1177 [21:56<34:06,  2.86s/it, exist=0.2347, loss=0.4924, lr=2.21e-06]
Epoch 5/5:  39%|███▉      | 462/1177 [21:58<34:06,  2.86s/it, exist=0.2343, loss=0.4921, lr=2.21e-06]
Epoch 5/5:  39%|███▉      | 463/1177 [21:58<33:43,  2.83s/it, exist=0.2343, loss=0.4921, lr=2.21e-06]
Epoch 5/5:  39%|███▉      | 463/1177 [22:00<33:43,  2.83s/it, exist=0.2345, loss=0.4922, lr=2.20e-06]
Epoch 5/5:  39%|███▉      | 464/1177 [22:00<30:37,  2.58s/it, exist=0.2345, loss=0.4922, lr=2.20e-06]
Epoch 5/5:  39%|███▉      | 464/1177 [22:04<30:37,  2.58s/it, exist=0.2342, loss=0.4918, lr=2.20e-06]
Epoch 5/5:  40%|███▉      | 465/1177 [22:04<32:15,  2.72s/it, exist=0.2342, loss=0.4918, lr=2.20e-06]
Epoch 5/5:  40%|███▉      | 465/1177 [22:06<32:15,  2.72s/it, exist=0.2346, loss=0.4922, lr=2.19e-06]
Epoch 5/5:  40%|███▉      | 466/1177 [22:06<31:30,  2.66s/it, exist=0.2346, loss=0.4922, lr=2.19e-06]
Epoch 5/5:  40%|███▉      | 466/1177 [22:10<31:30,  2.66s/it, exist=0.2344, loss=0.4919, lr=2.18e-06]
Epoch 5/5:  40%|███▉      | 467/1177 [22:10<34:40,  2.93s/it, exist=0.2344, loss=0.4919, lr=2.18e-06]
Epoch 5/5:  40%|███▉      | 467/1177 [22:14<34:40,  2.93s/it, exist=0.2343, loss=0.4919, lr=2.18e-06]
Epoch 5/5:  40%|███▉      | 468/1177 [22:14<39:49,  3.37s/it, exist=0.2343, loss=0.4919, lr=2.18e-06]
Epoch 5/5:  40%|███▉      | 468/1177 [22:18<39:49,  3.37s/it, exist=0.2347, loss=0.4922, lr=2.17e-06]
Epoch 5/5:  40%|███▉      | 469/1177 [22:18<40:18,  3.42s/it, exist=0.2347, loss=0.4922, lr=2.17e-06]
Epoch 5/5:  40%|███▉      | 469/1177 [22:22<40:18,  3.42s/it, exist=0.2347, loss=0.4923, lr=2.17e-06]
Epoch 5/5:  40%|███▉      | 470/1177 [22:22<45:32,  3.87s/it, exist=0.2347, loss=0.4923, lr=2.17e-06]
Epoch 5/5:  40%|███▉      | 470/1177 [22:27<45:32,  3.87s/it, exist=0.2342, loss=0.4918, lr=2.16e-06]
Epoch 5/5:  40%|████      | 471/1177 [22:27<47:58,  4.08s/it, exist=0.2342, loss=0.4918, lr=2.16e-06]
Epoch 5/5:  40%|████      | 471/1177 [22:31<47:58,  4.08s/it, exist=0.2341, loss=0.4917, lr=2.15e-06]
Epoch 5/5:  40%|████      | 472/1177 [22:31<46:27,  3.95s/it, exist=0.2341, loss=0.4917, lr=2.15e-06]
Epoch 5/5:  40%|████      | 472/1177 [22:33<46:27,  3.95s/it, exist=0.2341, loss=0.4916, lr=2.15e-06]
Epoch 5/5:  40%|████      | 473/1177 [22:33<42:19,  3.61s/it, exist=0.2341, loss=0.4916, lr=2.15e-06]
Epoch 5/5:  40%|████      | 473/1177 [22:37<42:19,  3.61s/it, exist=0.2338, loss=0.4911, lr=2.14e-06]
Epoch 5/5:  40%|████      | 474/1177 [22:37<42:16,  3.61s/it, exist=0.2338, loss=0.4911, lr=2.14e-06]
Epoch 5/5:  40%|████      | 474/1177 [22:40<42:16,  3.61s/it, exist=0.2340, loss=0.4912, lr=2.14e-06]
Epoch 5/5:  40%|████      | 475/1177 [22:40<39:00,  3.33s/it, exist=0.2340, loss=0.4912, lr=2.14e-06]
Epoch 5/5:  40%|████      | 475/1177 [22:43<39:00,  3.33s/it, exist=0.2338, loss=0.4912, lr=2.13e-06]
Epoch 5/5:  40%|████      | 476/1177 [22:43<38:40,  3.31s/it, exist=0.2338, loss=0.4912, lr=2.13e-06]
Epoch 5/5:  40%|████      | 476/1177 [22:45<38:40,  3.31s/it, exist=0.2340, loss=0.4913, lr=2.12e-06]
Epoch 5/5:  41%|████      | 477/1177 [22:45<33:45,  2.89s/it, exist=0.2340, loss=0.4913, lr=2.12e-06]
Epoch 5/5:  41%|████      | 477/1177 [22:47<33:45,  2.89s/it, exist=0.2347, loss=0.4919, lr=2.12e-06]
Epoch 5/5:  41%|████      | 478/1177 [22:47<30:21,  2.61s/it, exist=0.2347, loss=0.4919, lr=2.12e-06]
Epoch 5/5:  41%|████      | 478/1177 [22:50<30:21,  2.61s/it, exist=0.2343, loss=0.4916, lr=2.11e-06]
Epoch 5/5:  41%|████      | 479/1177 [22:50<32:30,  2.79s/it, exist=0.2343, loss=0.4916, lr=2.11e-06]
Epoch 5/5:  41%|████      | 479/1177 [22:52<32:30,  2.79s/it, exist=0.2348, loss=0.4923, lr=2.11e-06]
Epoch 5/5:  41%|████      | 480/1177 [22:52<29:45,  2.56s/it, exist=0.2348, loss=0.4923, lr=2.11e-06]
Epoch 5/5:  41%|████      | 480/1177 [22:55<29:45,  2.56s/it, exist=0.2349, loss=0.4923, lr=2.10e-06]
Epoch 5/5:  41%|████      | 481/1177 [22:55<31:38,  2.73s/it, exist=0.2349, loss=0.4923, lr=2.10e-06]
Epoch 5/5:  41%|████      | 481/1177 [22:58<31:38,  2.73s/it, exist=0.2348, loss=0.4924, lr=2.09e-06]
Epoch 5/5:  41%|████      | 482/1177 [22:58<31:20,  2.71s/it, exist=0.2348, loss=0.4924, lr=2.09e-06]
Epoch 5/5:  41%|████      | 482/1177 [23:00<31:20,  2.71s/it, exist=0.2350, loss=0.4926, lr=2.09e-06]
Epoch 5/5:  41%|████      | 483/1177 [23:00<28:47,  2.49s/it, exist=0.2350, loss=0.4926, lr=2.09e-06]
Epoch 5/5:  41%|████      | 483/1177 [23:03<28:47,  2.49s/it, exist=0.2348, loss=0.4924, lr=2.08e-06]
Epoch 5/5:  41%|████      | 484/1177 [23:03<29:19,  2.54s/it, exist=0.2348, loss=0.4924, lr=2.08e-06]
Epoch 5/5:  41%|████      | 484/1177 [23:06<29:19,  2.54s/it, exist=0.2350, loss=0.4925, lr=2.08e-06]
Epoch 5/5:  41%|████      | 485/1177 [23:06<31:28,  2.73s/it, exist=0.2350, loss=0.4925, lr=2.08e-06]
Epoch 5/5:  41%|████      | 485/1177 [23:08<31:28,  2.73s/it, exist=0.2347, loss=0.4921, lr=2.07e-06]
Epoch 5/5:  41%|████▏     | 486/1177 [23:08<28:53,  2.51s/it, exist=0.2347, loss=0.4921, lr=2.07e-06]
Epoch 5/5:  41%|████▏     | 486/1177 [23:11<28:53,  2.51s/it, exist=0.2347, loss=0.4923, lr=2.06e-06]
Epoch 5/5:  41%|████▏     | 487/1177 [23:11<31:13,  2.72s/it, exist=0.2347, loss=0.4923, lr=2.06e-06]
Epoch 5/5:  41%|████▏     | 487/1177 [23:15<31:13,  2.72s/it, exist=0.2351, loss=0.4925, lr=2.06e-06]
Epoch 5/5:  41%|████▏     | 488/1177 [23:15<34:19,  2.99s/it, exist=0.2351, loss=0.4925, lr=2.06e-06]
Epoch 5/5:  41%|████▏     | 488/1177 [23:19<34:19,  2.99s/it, exist=0.2348, loss=0.4923, lr=2.05e-06]
Epoch 5/5:  42%|████▏     | 489/1177 [23:19<39:51,  3.48s/it, exist=0.2348, loss=0.4923, lr=2.05e-06]
Epoch 5/5:  42%|████▏     | 489/1177 [23:23<39:51,  3.48s/it, exist=0.2346, loss=0.4921, lr=2.05e-06]
Epoch 5/5:  42%|████▏     | 490/1177 [23:23<40:19,  3.52s/it, exist=0.2346, loss=0.4921, lr=2.05e-06]
Epoch 5/5:  42%|████▏     | 490/1177 [23:27<40:19,  3.52s/it, exist=0.2344, loss=0.4919, lr=2.04e-06]
Epoch 5/5:  42%|████▏     | 491/1177 [23:27<40:57,  3.58s/it, exist=0.2344, loss=0.4919, lr=2.04e-06]
Epoch 5/5:  42%|████▏     | 491/1177 [23:29<40:57,  3.58s/it, exist=0.2347, loss=0.4924, lr=2.03e-06]
Epoch 5/5:  42%|████▏     | 492/1177 [23:29<37:55,  3.32s/it, exist=0.2347, loss=0.4924, lr=2.03e-06]
Epoch 5/5:  42%|████▏     | 492/1177 [23:33<37:55,  3.32s/it, exist=0.2343, loss=0.4921, lr=2.03e-06]
Epoch 5/5:  42%|████▏     | 493/1177 [23:33<39:29,  3.46s/it, exist=0.2343, loss=0.4921, lr=2.03e-06]
Epoch 5/5:  42%|████▏     | 493/1177 [23:36<39:29,  3.46s/it, exist=0.2340, loss=0.4919, lr=2.02e-06]
Epoch 5/5:  42%|████▏     | 494/1177 [23:36<37:11,  3.27s/it, exist=0.2340, loss=0.4919, lr=2.02e-06]
Epoch 5/5:  42%|████▏     | 494/1177 [23:39<37:11,  3.27s/it, exist=0.2339, loss=0.4918, lr=2.02e-06]
Epoch 5/5:  42%|████▏     | 495/1177 [23:39<35:10,  3.09s/it, exist=0.2339, loss=0.4918, lr=2.02e-06]
Epoch 5/5:  42%|████▏     | 495/1177 [23:42<35:10,  3.09s/it, exist=0.2340, loss=0.4918, lr=2.01e-06]
Epoch 5/5:  42%|████▏     | 496/1177 [23:42<37:35,  3.31s/it, exist=0.2340, loss=0.4918, lr=2.01e-06]
Epoch 5/5:  42%|████▏     | 496/1177 [23:46<37:35,  3.31s/it, exist=0.2338, loss=0.4915, lr=2.01e-06]
Epoch 5/5:  42%|████▏     | 497/1177 [23:46<38:18,  3.38s/it, exist=0.2338, loss=0.4915, lr=2.01e-06]
Epoch 5/5:  42%|████▏     | 497/1177 [23:48<38:18,  3.38s/it, exist=0.2338, loss=0.4915, lr=2.00e-06]
Epoch 5/5:  42%|████▏     | 498/1177 [23:48<35:33,  3.14s/it, exist=0.2338, loss=0.4915, lr=2.00e-06]
Epoch 5/5:  42%|████▏     | 498/1177 [23:51<35:33,  3.14s/it, exist=0.2337, loss=0.4915, lr=1.99e-06]
Epoch 5/5:  42%|████▏     | 499/1177 [23:51<34:30,  3.05s/it, exist=0.2337, loss=0.4915, lr=1.99e-06]
Epoch 5/5:  42%|████▏     | 499/1177 [23:54<34:30,  3.05s/it, exist=0.2343, loss=0.4920, lr=1.99e-06]
Epoch 5/5:  42%|████▏     | 500/1177 [23:54<34:45,  3.08s/it, exist=0.2343, loss=0.4920, lr=1.99e-06]
Epoch 5/5:  42%|████▏     | 500/1177 [23:56<34:45,  3.08s/it, exist=0.2342, loss=0.4918, lr=1.98e-06]
Epoch 5/5:  43%|████▎     | 501/1177 [23:56<31:04,  2.76s/it, exist=0.2342, loss=0.4918, lr=1.98e-06]
Epoch 5/5:  43%|████▎     | 501/1177 [23:58<31:04,  2.76s/it, exist=0.2338, loss=0.4913, lr=1.98e-06]
Epoch 5/5:  43%|████▎     | 502/1177 [23:58<28:29,  2.53s/it, exist=0.2338, loss=0.4913, lr=1.98e-06]
Epoch 5/5:  43%|████▎     | 502/1177 [24:02<28:29,  2.53s/it, exist=0.2335, loss=0.4910, lr=1.97e-06]
Epoch 5/5:  43%|████▎     | 503/1177 [24:02<31:25,  2.80s/it, exist=0.2335, loss=0.4910, lr=1.97e-06]
Epoch 5/5:  43%|████▎     | 503/1177 [24:04<31:25,  2.80s/it, exist=0.2335, loss=0.4909, lr=1.97e-06]
Epoch 5/5:  43%|████▎     | 504/1177 [24:04<28:34,  2.55s/it, exist=0.2335, loss=0.4909, lr=1.97e-06]
Epoch 5/5:  43%|████▎     | 504/1177 [24:06<28:34,  2.55s/it, exist=0.2332, loss=0.4906, lr=1.96e-06]
Epoch 5/5:  43%|████▎     | 505/1177 [24:06<28:16,  2.52s/it, exist=0.2332, loss=0.4906, lr=1.96e-06]
Epoch 5/5:  43%|████▎     | 505/1177 [24:10<28:16,  2.52s/it, exist=0.2332, loss=0.4904, lr=1.95e-06]
Epoch 5/5:  43%|████▎     | 506/1177 [24:10<32:53,  2.94s/it, exist=0.2332, loss=0.4904, lr=1.95e-06]
Epoch 5/5:  43%|████▎     | 506/1177 [24:14<32:53,  2.94s/it, exist=0.2329, loss=0.4902, lr=1.95e-06]
Epoch 5/5:  43%|████▎     | 507/1177 [24:14<34:36,  3.10s/it, exist=0.2329, loss=0.4902, lr=1.95e-06]
Epoch 5/5:  43%|████▎     | 507/1177 [24:17<34:36,  3.10s/it, exist=0.2327, loss=0.4905, lr=1.94e-06]
Epoch 5/5:  43%|████▎     | 508/1177 [24:17<36:40,  3.29s/it, exist=0.2327, loss=0.4905, lr=1.94e-06]
Epoch 5/5:  43%|████▎     | 508/1177 [24:22<36:40,  3.29s/it, exist=0.2325, loss=0.4902, lr=1.94e-06]
Epoch 5/5:  43%|████▎     | 509/1177 [24:22<41:32,  3.73s/it, exist=0.2325, loss=0.4902, lr=1.94e-06]
Epoch 5/5:  43%|████▎     | 509/1177 [24:26<41:32,  3.73s/it, exist=0.2323, loss=0.4903, lr=1.93e-06]
Epoch 5/5:  43%|████▎     | 510/1177 [24:26<41:06,  3.70s/it, exist=0.2323, loss=0.4903, lr=1.93e-06]
Epoch 5/5:  43%|████▎     | 510/1177 [24:29<41:06,  3.70s/it, exist=0.2326, loss=0.4906, lr=1.93e-06]
Epoch 5/5:  43%|████▎     | 511/1177 [24:29<40:57,  3.69s/it, exist=0.2326, loss=0.4906, lr=1.93e-06]
Epoch 5/5:  43%|████▎     | 511/1177 [24:31<40:57,  3.69s/it, exist=0.2323, loss=0.4902, lr=1.92e-06]
Epoch 5/5:  44%|████▎     | 512/1177 [24:31<35:13,  3.18s/it, exist=0.2323, loss=0.4902, lr=1.92e-06]
Epoch 5/5:  44%|████▎     | 512/1177 [24:33<35:13,  3.18s/it, exist=0.2320, loss=0.4899, lr=1.91e-06]
Epoch 5/5:  44%|████▎     | 513/1177 [24:33<31:16,  2.83s/it, exist=0.2320, loss=0.4899, lr=1.91e-06]
Epoch 5/5:  44%|████▎     | 513/1177 [24:36<31:16,  2.83s/it, exist=0.2321, loss=0.4900, lr=1.91e-06]
Epoch 5/5:  44%|████▎     | 514/1177 [24:36<30:41,  2.78s/it, exist=0.2321, loss=0.4900, lr=1.91e-06]
Epoch 5/5:  44%|████▎     | 514/1177 [24:39<30:41,  2.78s/it, exist=0.2321, loss=0.4899, lr=1.90e-06]
Epoch 5/5:  44%|████▍     | 515/1177 [24:39<29:51,  2.71s/it, exist=0.2321, loss=0.4899, lr=1.90e-06]
Epoch 5/5:  44%|████▍     | 515/1177 [24:41<29:51,  2.71s/it, exist=0.2319, loss=0.4899, lr=1.90e-06]
Epoch 5/5:  44%|████▍     | 516/1177 [24:41<27:25,  2.49s/it, exist=0.2319, loss=0.4899, lr=1.90e-06]
Epoch 5/5:  44%|████▍     | 516/1177 [24:44<27:25,  2.49s/it, exist=0.2321, loss=0.4901, lr=1.89e-06]
Epoch 5/5:  44%|████▍     | 517/1177 [24:44<30:18,  2.76s/it, exist=0.2321, loss=0.4901, lr=1.89e-06]
Epoch 5/5:  44%|████▍     | 517/1177 [24:46<30:18,  2.76s/it, exist=0.2318, loss=0.4896, lr=1.89e-06]
Epoch 5/5:  44%|████▍     | 518/1177 [24:46<27:40,  2.52s/it, exist=0.2318, loss=0.4896, lr=1.89e-06]
Epoch 5/5:  44%|████▍     | 518/1177 [24:49<27:40,  2.52s/it, exist=0.2319, loss=0.4897, lr=1.88e-06]
Epoch 5/5:  44%|████▍     | 519/1177 [24:49<30:10,  2.75s/it, exist=0.2319, loss=0.4897, lr=1.88e-06]
Epoch 5/5:  44%|████▍     | 519/1177 [24:52<30:10,  2.75s/it, exist=0.2321, loss=0.4899, lr=1.87e-06]
Epoch 5/5:  44%|████▍     | 520/1177 [24:52<29:56,  2.73s/it, exist=0.2321, loss=0.4899, lr=1.87e-06]
Epoch 5/5:  44%|████▍     | 520/1177 [24:54<29:56,  2.73s/it, exist=0.2319, loss=0.4896, lr=1.87e-06]
Epoch 5/5:  44%|████▍     | 521/1177 [24:54<27:22,  2.50s/it, exist=0.2319, loss=0.4896, lr=1.87e-06]
Epoch 5/5:  44%|████▍     | 521/1177 [24:58<27:22,  2.50s/it, exist=0.2316, loss=0.4893, lr=1.86e-06]
Epoch 5/5:  44%|████▍     | 522/1177 [24:58<33:30,  3.07s/it, exist=0.2316, loss=0.4893, lr=1.86e-06]
Epoch 5/5:  44%|████▍     | 522/1177 [25:02<33:30,  3.07s/it, exist=0.2321, loss=0.4897, lr=1.86e-06]
Epoch 5/5:  44%|████▍     | 523/1177 [25:02<35:29,  3.26s/it, exist=0.2321, loss=0.4897, lr=1.86e-06]
Epoch 5/5:  44%|████▍     | 523/1177 [25:06<35:29,  3.26s/it, exist=0.2322, loss=0.4898, lr=1.85e-06]
Epoch 5/5:  45%|████▍     | 524/1177 [25:06<37:57,  3.49s/it, exist=0.2322, loss=0.4898, lr=1.85e-06]
Epoch 5/5:  45%|████▍     | 524/1177 [25:10<37:57,  3.49s/it, exist=0.2320, loss=0.4895, lr=1.85e-06]
Epoch 5/5:  45%|████▍     | 525/1177 [25:10<39:10,  3.61s/it, exist=0.2320, loss=0.4895, lr=1.85e-06]
Epoch 5/5:  45%|████▍     | 525/1177 [25:15<39:10,  3.61s/it, exist=0.2319, loss=0.4894, lr=1.84e-06]
Epoch 5/5:  45%|████▍     | 526/1177 [25:15<42:32,  3.92s/it, exist=0.2319, loss=0.4894, lr=1.84e-06]
Epoch 5/5:  45%|████▍     | 526/1177 [25:17<42:32,  3.92s/it, exist=0.2320, loss=0.4895, lr=1.83e-06]
Epoch 5/5:  45%|████▍     | 527/1177 [25:17<38:23,  3.54s/it, exist=0.2320, loss=0.4895, lr=1.83e-06]
Epoch 5/5:  45%|████▍     | 527/1177 [25:22<38:23,  3.54s/it, exist=0.2318, loss=0.4893, lr=1.83e-06]
Epoch 5/5:  45%|████▍     | 528/1177 [25:22<40:57,  3.79s/it, exist=0.2318, loss=0.4893, lr=1.83e-06]
Epoch 5/5:  45%|████▍     | 528/1177 [25:24<40:57,  3.79s/it, exist=0.2318, loss=0.4893, lr=1.82e-06]
Epoch 5/5:  45%|████▍     | 529/1177 [25:24<37:45,  3.50s/it, exist=0.2318, loss=0.4893, lr=1.82e-06]
Epoch 5/5:  45%|████▍     | 529/1177 [25:26<37:45,  3.50s/it, exist=0.2318, loss=0.4893, lr=1.82e-06]
Epoch 5/5:  45%|████▌     | 530/1177 [25:26<32:55,  3.05s/it, exist=0.2318, loss=0.4893, lr=1.82e-06]
Epoch 5/5:  45%|████▌     | 530/1177 [25:30<32:55,  3.05s/it, exist=0.2320, loss=0.4895, lr=1.81e-06]
Epoch 5/5:  45%|████▌     | 531/1177 [25:30<33:50,  3.14s/it, exist=0.2320, loss=0.4895, lr=1.81e-06]
Epoch 5/5:  45%|████▌     | 531/1177 [25:32<33:50,  3.14s/it, exist=0.2318, loss=0.4894, lr=1.81e-06]
Epoch 5/5:  45%|████▌     | 532/1177 [25:32<32:15,  3.00s/it, exist=0.2318, loss=0.4894, lr=1.81e-06]
Epoch 5/5:  45%|████▌     | 532/1177 [25:35<32:15,  3.00s/it, exist=0.2319, loss=0.4896, lr=1.80e-06]
Epoch 5/5:  45%|████▌     | 533/1177 [25:35<31:20,  2.92s/it, exist=0.2319, loss=0.4896, lr=1.80e-06]
Epoch 5/5:  45%|████▌     | 533/1177 [25:38<31:20,  2.92s/it, exist=0.2325, loss=0.4901, lr=1.80e-06]
Epoch 5/5:  45%|████▌     | 534/1177 [25:38<30:24,  2.84s/it, exist=0.2325, loss=0.4901, lr=1.80e-06]
Epoch 5/5:  45%|████▌     | 534/1177 [25:41<30:24,  2.84s/it, exist=0.2323, loss=0.4897, lr=1.79e-06]
Epoch 5/5:  45%|████▌     | 535/1177 [25:41<29:47,  2.78s/it, exist=0.2323, loss=0.4897, lr=1.79e-06]
Epoch 5/5:  45%|████▌     | 535/1177 [25:42<29:47,  2.78s/it, exist=0.2323, loss=0.4897, lr=1.78e-06]
Epoch 5/5:  46%|████▌     | 536/1177 [25:42<27:10,  2.54s/it, exist=0.2323, loss=0.4897, lr=1.78e-06]
Epoch 5/5:  46%|████▌     | 536/1177 [25:46<27:10,  2.54s/it, exist=0.2325, loss=0.4899, lr=1.78e-06]
Epoch 5/5:  46%|████▌     | 537/1177 [25:46<29:15,  2.74s/it, exist=0.2325, loss=0.4899, lr=1.78e-06]
Epoch 5/5:  46%|████▌     | 537/1177 [25:48<29:15,  2.74s/it, exist=0.2323, loss=0.4896, lr=1.77e-06]
Epoch 5/5:  46%|████▌     | 538/1177 [25:48<26:38,  2.50s/it, exist=0.2323, loss=0.4896, lr=1.77e-06]
Epoch 5/5:  46%|████▌     | 538/1177 [25:50<26:38,  2.50s/it, exist=0.2323, loss=0.4895, lr=1.77e-06]
Epoch 5/5:  46%|████▌     | 539/1177 [25:50<26:22,  2.48s/it, exist=0.2323, loss=0.4895, lr=1.77e-06]
Epoch 5/5:  46%|████▌     | 539/1177 [25:53<26:22,  2.48s/it, exist=0.2326, loss=0.4898, lr=1.76e-06]
Epoch 5/5:  46%|████▌     | 540/1177 [25:53<29:16,  2.76s/it, exist=0.2326, loss=0.4898, lr=1.76e-06]
Epoch 5/5:  46%|████▌     | 540/1177 [25:56<29:16,  2.76s/it, exist=0.2324, loss=0.4896, lr=1.76e-06]
Epoch 5/5:  46%|████▌     | 541/1177 [25:56<28:26,  2.68s/it, exist=0.2324, loss=0.4896, lr=1.76e-06]
Epoch 5/5:  46%|████▌     | 541/1177 [26:00<28:26,  2.68s/it, exist=0.2325, loss=0.4899, lr=1.75e-06]
Epoch 5/5:  46%|████▌     | 542/1177 [26:00<33:43,  3.19s/it, exist=0.2325, loss=0.4899, lr=1.75e-06]
Epoch 5/5:  46%|████▌     | 542/1177 [26:03<33:43,  3.19s/it, exist=0.2327, loss=0.4900, lr=1.75e-06]
Epoch 5/5:  46%|████▌     | 543/1177 [26:03<32:18,  3.06s/it, exist=0.2327, loss=0.4900, lr=1.75e-06]
Epoch 5/5:  46%|████▌     | 543/1177 [26:08<32:18,  3.06s/it, exist=0.2331, loss=0.4903, lr=1.74e-06]
Epoch 5/5:  46%|████▌     | 544/1177 [26:08<36:34,  3.47s/it, exist=0.2331, loss=0.4903, lr=1.74e-06]
Epoch 5/5:  46%|████▌     | 544/1177 [26:10<36:34,  3.47s/it, exist=0.2329, loss=0.4901, lr=1.74e-06]
Epoch 5/5:  46%|████▋     | 545/1177 [26:10<34:13,  3.25s/it, exist=0.2329, loss=0.4901, lr=1.74e-06]
Epoch 5/5:  46%|████▋     | 545/1177 [26:14<34:13,  3.25s/it, exist=0.2331, loss=0.4902, lr=1.73e-06]
Epoch 5/5:  46%|████▋     | 546/1177 [26:14<35:29,  3.38s/it, exist=0.2331, loss=0.4902, lr=1.73e-06]
Epoch 5/5:  46%|████▋     | 546/1177 [26:18<35:29,  3.38s/it, exist=0.2328, loss=0.4900, lr=1.72e-06]
Epoch 5/5:  46%|████▋     | 547/1177 [26:18<37:46,  3.60s/it, exist=0.2328, loss=0.4900, lr=1.72e-06]
Epoch 5/5:  46%|████▋     | 547/1177 [26:20<37:46,  3.60s/it, exist=0.2329, loss=0.4900, lr=1.72e-06]
Epoch 5/5:  47%|████▋     | 548/1177 [26:20<32:32,  3.10s/it, exist=0.2329, loss=0.4900, lr=1.72e-06]
Epoch 5/5:  47%|████▋     | 548/1177 [26:23<32:32,  3.10s/it, exist=0.2333, loss=0.4905, lr=1.71e-06]
Epoch 5/5:  47%|████▋     | 549/1177 [26:23<31:15,  2.99s/it, exist=0.2333, loss=0.4905, lr=1.71e-06]
Epoch 5/5:  47%|████▋     | 549/1177 [26:25<31:15,  2.99s/it, exist=0.2329, loss=0.4902, lr=1.71e-06]
Epoch 5/5:  47%|████▋     | 550/1177 [26:25<30:10,  2.89s/it, exist=0.2329, loss=0.4902, lr=1.71e-06]
Epoch 5/5:  47%|████▋     | 550/1177 [26:27<30:10,  2.89s/it, exist=0.2333, loss=0.4905, lr=1.70e-06]
Epoch 5/5:  47%|████▋     | 551/1177 [26:27<27:11,  2.61s/it, exist=0.2333, loss=0.4905, lr=1.70e-06]
Epoch 5/5:  47%|████▋     | 551/1177 [26:31<27:11,  2.61s/it, exist=0.2331, loss=0.4903, lr=1.70e-06]
Epoch 5/5:  47%|████▋     | 552/1177 [26:31<29:11,  2.80s/it, exist=0.2331, loss=0.4903, lr=1.70e-06]
Epoch 5/5:  47%|████▋     | 552/1177 [26:33<29:11,  2.80s/it, exist=0.2329, loss=0.4901, lr=1.69e-06]
Epoch 5/5:  47%|████▋     | 553/1177 [26:33<26:34,  2.55s/it, exist=0.2329, loss=0.4901, lr=1.69e-06]
Epoch 5/5:  47%|████▋     | 553/1177 [26:35<26:34,  2.55s/it, exist=0.2327, loss=0.4900, lr=1.69e-06]
Epoch 5/5:  47%|████▋     | 554/1177 [26:35<27:02,  2.60s/it, exist=0.2327, loss=0.4900, lr=1.69e-06]
Epoch 5/5:  47%|████▋     | 554/1177 [26:37<27:02,  2.60s/it, exist=0.2326, loss=0.4898, lr=1.68e-06]
Epoch 5/5:  47%|████▋     | 555/1177 [26:37<24:56,  2.41s/it, exist=0.2326, loss=0.4898, lr=1.68e-06]
Epoch 5/5:  47%|████▋     | 555/1177 [26:41<24:56,  2.41s/it, exist=0.2324, loss=0.4895, lr=1.68e-06]
Epoch 5/5:  47%|████▋     | 556/1177 [26:41<27:42,  2.68s/it, exist=0.2324, loss=0.4895, lr=1.68e-06]
Epoch 5/5:  47%|████▋     | 556/1177 [26:43<27:42,  2.68s/it, exist=0.2326, loss=0.4896, lr=1.67e-06]
Epoch 5/5:  47%|████▋     | 557/1177 [26:43<27:41,  2.68s/it, exist=0.2326, loss=0.4896, lr=1.67e-06]
Epoch 5/5:  47%|████▋     | 557/1177 [26:46<27:41,  2.68s/it, exist=0.2332, loss=0.4902, lr=1.67e-06]
Epoch 5/5:  47%|████▋     | 558/1177 [26:46<27:08,  2.63s/it, exist=0.2332, loss=0.4902, lr=1.67e-06]
Epoch 5/5:  47%|████▋     | 558/1177 [26:49<27:08,  2.63s/it, exist=0.2336, loss=0.4905, lr=1.66e-06]
Epoch 5/5:  47%|████▋     | 559/1177 [26:49<29:14,  2.84s/it, exist=0.2336, loss=0.4905, lr=1.66e-06]
Epoch 5/5:  47%|████▋     | 559/1177 [26:53<29:14,  2.84s/it, exist=0.2335, loss=0.4902, lr=1.66e-06]
Epoch 5/5:  48%|████▊     | 560/1177 [26:53<31:43,  3.08s/it, exist=0.2335, loss=0.4902, lr=1.66e-06]
Epoch 5/5:  48%|████▊     | 560/1177 [26:57<31:43,  3.08s/it, exist=0.2337, loss=0.4906, lr=1.65e-06]
Epoch 5/5:  48%|████▊     | 561/1177 [26:57<36:17,  3.53s/it, exist=0.2337, loss=0.4906, lr=1.65e-06]
Epoch 5/5:  48%|████▊     | 561/1177 [27:01<36:17,  3.53s/it, exist=0.2338, loss=0.4906, lr=1.64e-06]
Epoch 5/5:  48%|████▊     | 562/1177 [27:01<36:47,  3.59s/it, exist=0.2338, loss=0.4906, lr=1.64e-06]
Epoch 5/5:  48%|████▊     | 562/1177 [27:05<36:47,  3.59s/it, exist=0.2335, loss=0.4903, lr=1.64e-06]
Epoch 5/5:  48%|████▊     | 563/1177 [27:05<37:13,  3.64s/it, exist=0.2335, loss=0.4903, lr=1.64e-06]
Epoch 5/5:  48%|████▊     | 563/1177 [27:08<37:13,  3.64s/it, exist=0.2333, loss=0.4899, lr=1.63e-06]
Epoch 5/5:  48%|████▊     | 564/1177 [27:08<35:26,  3.47s/it, exist=0.2333, loss=0.4899, lr=1.63e-06]
Epoch 5/5:  48%|████▊     | 564/1177 [27:10<35:26,  3.47s/it, exist=0.2332, loss=0.4897, lr=1.63e-06]
Epoch 5/5:  48%|████▊     | 565/1177 [27:10<30:36,  3.00s/it, exist=0.2332, loss=0.4897, lr=1.63e-06]
Epoch 5/5:  48%|████▊     | 565/1177 [27:12<30:36,  3.00s/it, exist=0.2331, loss=0.4897, lr=1.62e-06]
Epoch 5/5:  48%|████▊     | 566/1177 [27:12<29:31,  2.90s/it, exist=0.2331, loss=0.4897, lr=1.62e-06]
Epoch 5/5:  48%|████▊     | 566/1177 [27:15<29:31,  2.90s/it, exist=0.2329, loss=0.4894, lr=1.62e-06]
Epoch 5/5:  48%|████▊     | 567/1177 [27:15<28:21,  2.79s/it, exist=0.2329, loss=0.4894, lr=1.62e-06]
Epoch 5/5:  48%|████▊     | 567/1177 [27:18<28:21,  2.79s/it, exist=0.2330, loss=0.4895, lr=1.61e-06]
Epoch 5/5:  48%|████▊     | 568/1177 [27:18<28:00,  2.76s/it, exist=0.2330, loss=0.4895, lr=1.61e-06]
Epoch 5/5:  48%|████▊     | 568/1177 [27:20<28:00,  2.76s/it, exist=0.2328, loss=0.4892, lr=1.61e-06]
Epoch 5/5:  48%|████▊     | 569/1177 [27:20<27:39,  2.73s/it, exist=0.2328, loss=0.4892, lr=1.61e-06]
Epoch 5/5:  48%|████▊     | 569/1177 [27:23<27:39,  2.73s/it, exist=0.2332, loss=0.4898, lr=1.60e-06]
Epoch 5/5:  48%|████▊     | 570/1177 [27:23<27:10,  2.69s/it, exist=0.2332, loss=0.4898, lr=1.60e-06]
Epoch 5/5:  48%|████▊     | 570/1177 [27:26<27:10,  2.69s/it, exist=0.2331, loss=0.4896, lr=1.60e-06]
Epoch 5/5:  49%|████▊     | 571/1177 [27:26<26:55,  2.67s/it, exist=0.2331, loss=0.4896, lr=1.60e-06]
Epoch 5/5:  49%|████▊     | 571/1177 [27:28<26:55,  2.67s/it, exist=0.2330, loss=0.4895, lr=1.59e-06]
Epoch 5/5:  49%|████▊     | 572/1177 [27:28<26:47,  2.66s/it, exist=0.2330, loss=0.4895, lr=1.59e-06]
Epoch 5/5:  49%|████▊     | 572/1177 [27:30<26:47,  2.66s/it, exist=0.2340, loss=0.4903, lr=1.59e-06]
Epoch 5/5:  49%|████▊     | 573/1177 [27:30<24:28,  2.43s/it, exist=0.2340, loss=0.4903, lr=1.59e-06]
Epoch 5/5:  49%|████▊     | 573/1177 [27:33<24:28,  2.43s/it, exist=0.2338, loss=0.4903, lr=1.58e-06]
Epoch 5/5:  49%|████▉     | 574/1177 [27:33<24:39,  2.45s/it, exist=0.2338, loss=0.4903, lr=1.58e-06]
Epoch 5/5:  49%|████▉     | 574/1177 [27:36<24:39,  2.45s/it, exist=0.2342, loss=0.4906, lr=1.58e-06]
Epoch 5/5:  49%|████▉     | 575/1177 [27:36<26:54,  2.68s/it, exist=0.2342, loss=0.4906, lr=1.58e-06]
Epoch 5/5:  49%|████▉     | 575/1177 [27:38<26:54,  2.68s/it, exist=0.2339, loss=0.4903, lr=1.57e-06]
Epoch 5/5:  49%|████▉     | 576/1177 [27:38<26:54,  2.69s/it, exist=0.2339, loss=0.4903, lr=1.57e-06]
Epoch 5/5:  49%|████▉     | 576/1177 [27:41<26:54,  2.69s/it, exist=0.2339, loss=0.4902, lr=1.57e-06]
Epoch 5/5:  49%|████▉     | 577/1177 [27:41<26:35,  2.66s/it, exist=0.2339, loss=0.4902, lr=1.57e-06]
Epoch 5/5:  49%|████▉     | 577/1177 [27:43<26:35,  2.66s/it, exist=0.2340, loss=0.4904, lr=1.56e-06]
Epoch 5/5:  49%|████▉     | 578/1177 [27:43<24:50,  2.49s/it, exist=0.2340, loss=0.4904, lr=1.56e-06]
Epoch 5/5:  49%|████▉     | 578/1177 [27:46<24:50,  2.49s/it, exist=0.2337, loss=0.4901, lr=1.56e-06]
Epoch 5/5:  49%|████▉     | 579/1177 [27:46<26:49,  2.69s/it, exist=0.2337, loss=0.4901, lr=1.56e-06]
Epoch 5/5:  49%|████▉     | 579/1177 [27:48<26:49,  2.69s/it, exist=0.2336, loss=0.4901, lr=1.55e-06]
Epoch 5/5:  49%|████▉     | 580/1177 [27:48<24:39,  2.48s/it, exist=0.2336, loss=0.4901, lr=1.55e-06]
Epoch 5/5:  49%|████▉     | 580/1177 [27:50<24:39,  2.48s/it, exist=0.2336, loss=0.4901, lr=1.55e-06]
Epoch 5/5:  49%|████▉     | 581/1177 [27:50<23:05,  2.32s/it, exist=0.2336, loss=0.4901, lr=1.55e-06]
Epoch 5/5:  49%|████▉     | 581/1177 [27:54<23:05,  2.32s/it, exist=0.2335, loss=0.4901, lr=1.54e-06]
Epoch 5/5:  49%|████▉     | 582/1177 [27:54<28:09,  2.84s/it, exist=0.2335, loss=0.4901, lr=1.54e-06]
Epoch 5/5:  49%|████▉     | 582/1177 [27:57<28:09,  2.84s/it, exist=0.2332, loss=0.4900, lr=1.54e-06]
Epoch 5/5:  50%|████▉     | 583/1177 [27:57<27:01,  2.73s/it, exist=0.2332, loss=0.4900, lr=1.54e-06]
Epoch 5/5:  50%|████▉     | 583/1177 [28:01<27:01,  2.73s/it, exist=0.2339, loss=0.4905, lr=1.53e-06]
Epoch 5/5:  50%|████▉     | 584/1177 [28:01<30:15,  3.06s/it, exist=0.2339, loss=0.4905, lr=1.53e-06]
Epoch 5/5:  50%|████▉     | 584/1177 [28:03<30:15,  3.06s/it, exist=0.2339, loss=0.4905, lr=1.53e-06]
Epoch 5/5:  50%|████▉     | 585/1177 [28:03<26:58,  2.73s/it, exist=0.2339, loss=0.4905, lr=1.53e-06]
Epoch 5/5:  50%|████▉     | 585/1177 [28:05<26:58,  2.73s/it, exist=0.2336, loss=0.4902, lr=1.52e-06]
Epoch 5/5:  50%|████▉     | 586/1177 [28:05<26:43,  2.71s/it, exist=0.2336, loss=0.4902, lr=1.52e-06]
Epoch 5/5:  50%|████▉     | 586/1177 [28:08<26:43,  2.71s/it, exist=0.2335, loss=0.4900, lr=1.52e-06]
Epoch 5/5:  50%|████▉     | 587/1177 [28:08<26:07,  2.66s/it, exist=0.2335, loss=0.4900, lr=1.52e-06]
Epoch 5/5:  50%|████▉     | 587/1177 [28:10<26:07,  2.66s/it, exist=0.2335, loss=0.4900, lr=1.51e-06]
Epoch 5/5:  50%|████▉     | 588/1177 [28:10<24:09,  2.46s/it, exist=0.2335, loss=0.4900, lr=1.51e-06]
Epoch 5/5:  50%|████▉     | 588/1177 [28:12<24:09,  2.46s/it, exist=0.2335, loss=0.4901, lr=1.50e-06]
Epoch 5/5:  50%|█████     | 589/1177 [28:12<22:37,  2.31s/it, exist=0.2335, loss=0.4901, lr=1.50e-06]
Epoch 5/5:  50%|█████     | 589/1177 [28:16<22:37,  2.31s/it, exist=0.2336, loss=0.4903, lr=1.50e-06]
Epoch 5/5:  50%|█████     | 590/1177 [28:16<27:02,  2.76s/it, exist=0.2336, loss=0.4903, lr=1.50e-06]
Epoch 5/5:  50%|█████     | 590/1177 [28:18<27:02,  2.76s/it, exist=0.2337, loss=0.4904, lr=1.49e-06]
Epoch 5/5:  50%|█████     | 591/1177 [28:18<26:15,  2.69s/it, exist=0.2337, loss=0.4904, lr=1.49e-06]
Epoch 5/5:  50%|█████     | 591/1177 [28:21<26:15,  2.69s/it, exist=0.2339, loss=0.4906, lr=1.49e-06]
Epoch 5/5:  50%|█████     | 592/1177 [28:21<26:06,  2.68s/it, exist=0.2339, loss=0.4906, lr=1.49e-06]
Epoch 5/5:  50%|█████     | 592/1177 [28:23<26:06,  2.68s/it, exist=0.2339, loss=0.4906, lr=1.48e-06]
Epoch 5/5:  50%|█████     | 593/1177 [28:23<24:04,  2.47s/it, exist=0.2339, loss=0.4906, lr=1.48e-06]
Epoch 5/5:  50%|█████     | 593/1177 [28:25<24:04,  2.47s/it, exist=0.2336, loss=0.4904, lr=1.48e-06]
Epoch 5/5:  50%|█████     | 594/1177 [28:25<24:31,  2.52s/it, exist=0.2336, loss=0.4904, lr=1.48e-06]
Epoch 5/5:  50%|█████     | 594/1177 [28:29<24:31,  2.52s/it, exist=0.2334, loss=0.4901, lr=1.47e-06]
Epoch 5/5:  51%|█████     | 595/1177 [28:29<26:30,  2.73s/it, exist=0.2334, loss=0.4901, lr=1.47e-06]
Epoch 5/5:  51%|█████     | 595/1177 [28:31<26:30,  2.73s/it, exist=0.2331, loss=0.4899, lr=1.47e-06]
Epoch 5/5:  51%|█████     | 596/1177 [28:31<26:21,  2.72s/it, exist=0.2331, loss=0.4899, lr=1.47e-06]
Epoch 5/5:  51%|█████     | 596/1177 [28:34<26:21,  2.72s/it, exist=0.2334, loss=0.4902, lr=1.46e-06]
Epoch 5/5:  51%|█████     | 597/1177 [28:34<26:03,  2.70s/it, exist=0.2334, loss=0.4902, lr=1.46e-06]
Epoch 5/5:  51%|█████     | 597/1177 [28:36<26:03,  2.70s/it, exist=0.2332, loss=0.4901, lr=1.46e-06]
Epoch 5/5:  51%|█████     | 598/1177 [28:36<24:06,  2.50s/it, exist=0.2332, loss=0.4901, lr=1.46e-06]
Epoch 5/5:  51%|█████     | 598/1177 [28:39<24:06,  2.50s/it, exist=0.2330, loss=0.4899, lr=1.45e-06]
Epoch 5/5:  51%|█████     | 599/1177 [28:39<26:19,  2.73s/it, exist=0.2330, loss=0.4899, lr=1.45e-06]
Epoch 5/5:  51%|█████     | 599/1177 [28:42<26:19,  2.73s/it, exist=0.2329, loss=0.4898, lr=1.45e-06]
Epoch 5/5:  51%|█████     | 600/1177 [28:42<25:08,  2.61s/it, exist=0.2329, loss=0.4898, lr=1.45e-06]
Epoch 5/5:  51%|█████     | 600/1177 [28:44<25:08,  2.61s/it, exist=0.2330, loss=0.4900, lr=1.44e-06]
Epoch 5/5:  51%|█████     | 601/1177 [28:44<23:14,  2.42s/it, exist=0.2330, loss=0.4900, lr=1.44e-06]
Epoch 5/5:  51%|█████     | 601/1177 [28:47<23:14,  2.42s/it, exist=0.2328, loss=0.4897, lr=1.44e-06]
Epoch 5/5:  51%|█████     | 602/1177 [28:47<27:13,  2.84s/it, exist=0.2328, loss=0.4897, lr=1.44e-06]
Epoch 5/5:  51%|█████     | 602/1177 [28:50<27:13,  2.84s/it, exist=0.2326, loss=0.4896, lr=1.43e-06]
Epoch 5/5:  51%|█████     | 603/1177 [28:50<26:45,  2.80s/it, exist=0.2326, loss=0.4896, lr=1.43e-06]
Epoch 5/5:  51%|█████     | 603/1177 [28:53<26:45,  2.80s/it, exist=0.2324, loss=0.4895, lr=1.43e-06]
Epoch 5/5:  51%|█████▏    | 604/1177 [28:53<26:16,  2.75s/it, exist=0.2324, loss=0.4895, lr=1.43e-06]
Epoch 5/5:  51%|█████▏    | 604/1177 [28:55<26:16,  2.75s/it, exist=0.2327, loss=0.4898, lr=1.42e-06]
Epoch 5/5:  51%|█████▏    | 605/1177 [28:55<25:54,  2.72s/it, exist=0.2327, loss=0.4898, lr=1.42e-06]
Epoch 5/5:  51%|█████▏    | 605/1177 [28:58<25:54,  2.72s/it, exist=0.2328, loss=0.4897, lr=1.42e-06]
Epoch 5/5:  51%|█████▏    | 606/1177 [28:58<25:38,  2.69s/it, exist=0.2328, loss=0.4897, lr=1.42e-06]
Epoch 5/5:  51%|█████▏    | 606/1177 [29:00<25:38,  2.69s/it, exist=0.2327, loss=0.4896, lr=1.42e-06]
Epoch 5/5:  52%|█████▏    | 607/1177 [29:00<25:03,  2.64s/it, exist=0.2327, loss=0.4896, lr=1.42e-06]
Epoch 5/5:  52%|█████▏    | 607/1177 [29:03<25:03,  2.64s/it, exist=0.2325, loss=0.4894, lr=1.41e-06]
Epoch 5/5:  52%|█████▏    | 608/1177 [29:03<25:13,  2.66s/it, exist=0.2325, loss=0.4894, lr=1.41e-06]
Epoch 5/5:  52%|█████▏    | 608/1177 [29:06<25:13,  2.66s/it, exist=0.2323, loss=0.4892, lr=1.41e-06]
Epoch 5/5:  52%|█████▏    | 609/1177 [29:06<25:00,  2.64s/it, exist=0.2323, loss=0.4892, lr=1.41e-06]
Epoch 5/5:  52%|█████▏    | 609/1177 [29:08<25:00,  2.64s/it, exist=0.2324, loss=0.4893, lr=1.40e-06]
Epoch 5/5:  52%|█████▏    | 610/1177 [29:08<24:27,  2.59s/it, exist=0.2324, loss=0.4893, lr=1.40e-06]
Epoch 5/5:  52%|█████▏    | 610/1177 [29:10<24:27,  2.59s/it, exist=0.2326, loss=0.4895, lr=1.40e-06]
Epoch 5/5:  52%|█████▏    | 611/1177 [29:10<22:40,  2.40s/it, exist=0.2326, loss=0.4895, lr=1.40e-06]
Epoch 5/5:  52%|█████▏    | 611/1177 [29:14<22:40,  2.40s/it, exist=0.2328, loss=0.4899, lr=1.39e-06]
Epoch 5/5:  52%|█████▏    | 612/1177 [29:14<25:11,  2.68s/it, exist=0.2328, loss=0.4899, lr=1.39e-06]
Epoch 5/5:  52%|█████▏    | 612/1177 [29:16<25:11,  2.68s/it, exist=0.2332, loss=0.4904, lr=1.39e-06]
Epoch 5/5:  52%|█████▏    | 613/1177 [29:16<25:00,  2.66s/it, exist=0.2332, loss=0.4904, lr=1.39e-06]
Epoch 5/5:  52%|█████▏    | 613/1177 [29:19<25:00,  2.66s/it, exist=0.2333, loss=0.4904, lr=1.38e-06]
Epoch 5/5:  52%|█████▏    | 614/1177 [29:19<25:16,  2.69s/it, exist=0.2333, loss=0.4904, lr=1.38e-06]
Epoch 5/5:  52%|█████▏    | 614/1177 [29:22<25:16,  2.69s/it, exist=0.2333, loss=0.4908, lr=1.38e-06]
Epoch 5/5:  52%|█████▏    | 615/1177 [29:22<25:18,  2.70s/it, exist=0.2333, loss=0.4908, lr=1.38e-06]
Epoch 5/5:  52%|█████▏    | 615/1177 [29:27<25:18,  2.70s/it, exist=0.2333, loss=0.4907, lr=1.37e-06]
Epoch 5/5:  52%|█████▏    | 616/1177 [29:27<31:38,  3.38s/it, exist=0.2333, loss=0.4907, lr=1.37e-06]
Epoch 5/5:  52%|█████▏    | 616/1177 [29:29<31:38,  3.38s/it, exist=0.2332, loss=0.4907, lr=1.37e-06]
Epoch 5/5:  52%|█████▏    | 617/1177 [29:29<29:19,  3.14s/it, exist=0.2332, loss=0.4907, lr=1.37e-06]
Epoch 5/5:  52%|█████▏    | 617/1177 [29:31<29:19,  3.14s/it, exist=0.2329, loss=0.4905, lr=1.36e-06]
Epoch 5/5:  53%|█████▎    | 618/1177 [29:31<25:59,  2.79s/it, exist=0.2329, loss=0.4905, lr=1.36e-06]
Epoch 5/5:  53%|█████▎    | 618/1177 [29:34<25:59,  2.79s/it, exist=0.2330, loss=0.4906, lr=1.36e-06]
Epoch 5/5:  53%|█████▎    | 619/1177 [29:34<25:47,  2.77s/it, exist=0.2330, loss=0.4906, lr=1.36e-06]
Epoch 5/5:  53%|█████▎    | 619/1177 [29:36<25:47,  2.77s/it, exist=0.2328, loss=0.4903, lr=1.35e-06]
Epoch 5/5:  53%|█████▎    | 620/1177 [29:36<23:38,  2.55s/it, exist=0.2328, loss=0.4903, lr=1.35e-06]
Epoch 5/5:  53%|█████▎    | 620/1177 [29:39<23:38,  2.55s/it, exist=0.2327, loss=0.4903, lr=1.35e-06]
Epoch 5/5:  53%|█████▎    | 621/1177 [29:39<24:49,  2.68s/it, exist=0.2327, loss=0.4903, lr=1.35e-06]
Epoch 5/5:  53%|█████▎    | 621/1177 [29:42<24:49,  2.68s/it, exist=0.2326, loss=0.4902, lr=1.34e-06]
Epoch 5/5:  53%|█████▎    | 622/1177 [29:42<24:37,  2.66s/it, exist=0.2326, loss=0.4902, lr=1.34e-06]
Epoch 5/5:  53%|█████▎    | 622/1177 [29:44<24:37,  2.66s/it, exist=0.2324, loss=0.4900, lr=1.34e-06]
Epoch 5/5:  53%|█████▎    | 623/1177 [29:44<24:21,  2.64s/it, exist=0.2324, loss=0.4900, lr=1.34e-06]
Epoch 5/5:  53%|█████▎    | 623/1177 [29:47<24:21,  2.64s/it, exist=0.2327, loss=0.4903, lr=1.33e-06]
Epoch 5/5:  53%|█████▎    | 624/1177 [29:47<24:34,  2.67s/it, exist=0.2327, loss=0.4903, lr=1.33e-06]
Epoch 5/5:  53%|█████▎    | 624/1177 [29:50<24:34,  2.67s/it, exist=0.2327, loss=0.4904, lr=1.33e-06]
Epoch 5/5:  53%|█████▎    | 625/1177 [29:50<24:34,  2.67s/it, exist=0.2327, loss=0.4904, lr=1.33e-06]
Epoch 5/5:  53%|█████▎    | 625/1177 [29:52<24:34,  2.67s/it, exist=0.2325, loss=0.4900, lr=1.32e-06]
Epoch 5/5:  53%|█████▎    | 626/1177 [29:52<23:50,  2.60s/it, exist=0.2325, loss=0.4900, lr=1.32e-06]
Epoch 5/5:  53%|█████▎    | 626/1177 [29:55<23:50,  2.60s/it, exist=0.2325, loss=0.4901, lr=1.32e-06]
Epoch 5/5:  53%|█████▎    | 627/1177 [29:55<23:54,  2.61s/it, exist=0.2325, loss=0.4901, lr=1.32e-06]
Epoch 5/5:  53%|█████▎    | 627/1177 [29:57<23:54,  2.61s/it, exist=0.2323, loss=0.4901, lr=1.31e-06]
Epoch 5/5:  53%|█████▎    | 628/1177 [29:57<22:07,  2.42s/it, exist=0.2323, loss=0.4901, lr=1.31e-06]
Epoch 5/5:  53%|█████▎    | 628/1177 [30:01<22:07,  2.42s/it, exist=0.2321, loss=0.4898, lr=1.31e-06]
Epoch 5/5:  53%|█████▎    | 629/1177 [30:01<26:14,  2.87s/it, exist=0.2321, loss=0.4898, lr=1.31e-06]
Epoch 5/5:  53%|█████▎    | 629/1177 [30:04<26:14,  2.87s/it, exist=0.2323, loss=0.4901, lr=1.30e-06]
Epoch 5/5:  54%|█████▎    | 630/1177 [30:04<27:53,  3.06s/it, exist=0.2323, loss=0.4901, lr=1.30e-06]
Epoch 5/5:  54%|█████▎    | 630/1177 [30:08<27:53,  3.06s/it, exist=0.2320, loss=0.4899, lr=1.30e-06]
Epoch 5/5:  54%|█████▎    | 631/1177 [30:08<31:16,  3.44s/it, exist=0.2320, loss=0.4899, lr=1.30e-06]
Epoch 5/5:  54%|█████▎    | 631/1177 [30:12<31:16,  3.44s/it, exist=0.2319, loss=0.4896, lr=1.29e-06]
Epoch 5/5:  54%|█████▎    | 632/1177 [30:12<32:09,  3.54s/it, exist=0.2319, loss=0.4896, lr=1.29e-06]
Epoch 5/5:  54%|█████▎    | 632/1177 [30:16<32:09,  3.54s/it, exist=0.2318, loss=0.4897, lr=1.29e-06]
Epoch 5/5:  54%|█████▍    | 633/1177 [30:16<32:30,  3.59s/it, exist=0.2318, loss=0.4897, lr=1.29e-06]
Epoch 5/5:  54%|█████▍    | 633/1177 [30:18<32:30,  3.59s/it, exist=0.2321, loss=0.4900, lr=1.29e-06]
Epoch 5/5:  54%|█████▍    | 634/1177 [30:18<28:00,  3.10s/it, exist=0.2321, loss=0.4900, lr=1.29e-06]
Epoch 5/5:  54%|█████▍    | 634/1177 [30:20<28:00,  3.10s/it, exist=0.2320, loss=0.4900, lr=1.28e-06]
Epoch 5/5:  54%|█████▍    | 635/1177 [30:20<26:55,  2.98s/it, exist=0.2320, loss=0.4900, lr=1.28e-06]
Epoch 5/5:  54%|█████▍    | 635/1177 [30:23<26:55,  2.98s/it, exist=0.2320, loss=0.4900, lr=1.28e-06]
Epoch 5/5:  54%|█████▍    | 636/1177 [30:23<26:00,  2.88s/it, exist=0.2320, loss=0.4900, lr=1.28e-06]
Epoch 5/5:  54%|█████▍    | 636/1177 [30:26<26:00,  2.88s/it, exist=0.2320, loss=0.4902, lr=1.27e-06]
Epoch 5/5:  54%|█████▍    | 637/1177 [30:26<25:07,  2.79s/it, exist=0.2320, loss=0.4902, lr=1.27e-06]
Epoch 5/5:  54%|█████▍    | 637/1177 [30:28<25:07,  2.79s/it, exist=0.2319, loss=0.4901, lr=1.27e-06]
Epoch 5/5:  54%|█████▍    | 638/1177 [30:28<24:00,  2.67s/it, exist=0.2319, loss=0.4901, lr=1.27e-06]
Epoch 5/5:  54%|█████▍    | 638/1177 [30:30<24:00,  2.67s/it, exist=0.2318, loss=0.4900, lr=1.26e-06]
Epoch 5/5:  54%|█████▍    | 639/1177 [30:30<22:02,  2.46s/it, exist=0.2318, loss=0.4900, lr=1.26e-06]
Epoch 5/5:  54%|█████▍    | 639/1177 [30:33<22:02,  2.46s/it, exist=0.2316, loss=0.4897, lr=1.26e-06]
Epoch 5/5:  54%|█████▍    | 640/1177 [30:33<22:13,  2.48s/it, exist=0.2316, loss=0.4897, lr=1.26e-06]
Epoch 5/5:  54%|█████▍    | 640/1177 [30:35<22:13,  2.48s/it, exist=0.2314, loss=0.4895, lr=1.25e-06]
Epoch 5/5:  54%|█████▍    | 641/1177 [30:35<22:42,  2.54s/it, exist=0.2314, loss=0.4895, lr=1.25e-06]
Epoch 5/5:  54%|█████▍    | 641/1177 [30:38<22:42,  2.54s/it, exist=0.2314, loss=0.4894, lr=1.25e-06]
Epoch 5/5:  55%|█████▍    | 642/1177 [30:38<23:00,  2.58s/it, exist=0.2314, loss=0.4894, lr=1.25e-06]
Epoch 5/5:  55%|█████▍    | 642/1177 [30:41<23:00,  2.58s/it, exist=0.2312, loss=0.4893, lr=1.24e-06]
Epoch 5/5:  55%|█████▍    | 643/1177 [30:41<24:15,  2.73s/it, exist=0.2312, loss=0.4893, lr=1.24e-06]
Epoch 5/5:  55%|█████▍    | 643/1177 [30:43<24:15,  2.73s/it, exist=0.2310, loss=0.4890, lr=1.24e-06]
Epoch 5/5:  55%|█████▍    | 644/1177 [30:43<23:36,  2.66s/it, exist=0.2310, loss=0.4890, lr=1.24e-06]
Epoch 5/5:  55%|█████▍    | 644/1177 [30:46<23:36,  2.66s/it, exist=0.2308, loss=0.4888, lr=1.23e-06]
Epoch 5/5:  55%|█████▍    | 645/1177 [30:46<23:25,  2.64s/it, exist=0.2308, loss=0.4888, lr=1.23e-06]
Epoch 5/5:  55%|█████▍    | 645/1177 [30:49<23:25,  2.64s/it, exist=0.2306, loss=0.4886, lr=1.23e-06]
Epoch 5/5:  55%|█████▍    | 646/1177 [30:49<23:08,  2.61s/it, exist=0.2306, loss=0.4886, lr=1.23e-06]
Epoch 5/5:  55%|█████▍    | 646/1177 [30:52<23:08,  2.61s/it, exist=0.2308, loss=0.4887, lr=1.22e-06]
Epoch 5/5:  55%|█████▍    | 647/1177 [30:52<25:48,  2.92s/it, exist=0.2308, loss=0.4887, lr=1.22e-06]
Epoch 5/5:  55%|█████▍    | 647/1177 [30:56<25:48,  2.92s/it, exist=0.2306, loss=0.4884, lr=1.22e-06]
Epoch 5/5:  55%|█████▌    | 648/1177 [30:56<27:30,  3.12s/it, exist=0.2306, loss=0.4884, lr=1.22e-06]
Epoch 5/5:  55%|█████▌    | 648/1177 [30:59<27:30,  3.12s/it, exist=0.2304, loss=0.4884, lr=1.22e-06]
Epoch 5/5:  55%|█████▌    | 649/1177 [30:59<27:55,  3.17s/it, exist=0.2304, loss=0.4884, lr=1.22e-06]
Epoch 5/5:  55%|█████▌    | 649/1177 [31:02<27:55,  3.17s/it, exist=0.2302, loss=0.4882, lr=1.21e-06]
Epoch 5/5:  55%|█████▌    | 650/1177 [31:02<27:08,  3.09s/it, exist=0.2302, loss=0.4882, lr=1.21e-06]
Epoch 5/5:  55%|█████▌    | 650/1177 [31:06<27:08,  3.09s/it, exist=0.2299, loss=0.4881, lr=1.21e-06]
Epoch 5/5:  55%|█████▌    | 651/1177 [31:06<28:35,  3.26s/it, exist=0.2299, loss=0.4881, lr=1.21e-06]
Epoch 5/5:  55%|█████▌    | 651/1177 [31:08<28:35,  3.26s/it, exist=0.2299, loss=0.4881, lr=1.20e-06]
Epoch 5/5:  55%|█████▌    | 652/1177 [31:08<26:46,  3.06s/it, exist=0.2299, loss=0.4881, lr=1.20e-06]
Epoch 5/5:  55%|█████▌    | 652/1177 [31:10<26:46,  3.06s/it, exist=0.2297, loss=0.4879, lr=1.20e-06]
Epoch 5/5:  55%|█████▌    | 653/1177 [31:10<24:08,  2.77s/it, exist=0.2297, loss=0.4879, lr=1.20e-06]
Epoch 5/5:  55%|█████▌    | 653/1177 [31:13<24:08,  2.77s/it, exist=0.2295, loss=0.4876, lr=1.19e-06]
Epoch 5/5:  56%|█████▌    | 654/1177 [31:13<23:44,  2.72s/it, exist=0.2295, loss=0.4876, lr=1.19e-06]
Epoch 5/5:  56%|█████▌    | 654/1177 [31:16<23:44,  2.72s/it, exist=0.2296, loss=0.4876, lr=1.19e-06]
Epoch 5/5:  56%|█████▌    | 655/1177 [31:16<25:02,  2.88s/it, exist=0.2296, loss=0.4876, lr=1.19e-06]
Epoch 5/5:  56%|█████▌    | 655/1177 [31:19<25:02,  2.88s/it, exist=0.2299, loss=0.4879, lr=1.18e-06]
Epoch 5/5:  56%|█████▌    | 656/1177 [31:19<24:12,  2.79s/it, exist=0.2299, loss=0.4879, lr=1.18e-06]
Epoch 5/5:  56%|█████▌    | 656/1177 [31:21<24:12,  2.79s/it, exist=0.2300, loss=0.4881, lr=1.18e-06]
Epoch 5/5:  56%|█████▌    | 657/1177 [31:21<23:45,  2.74s/it, exist=0.2300, loss=0.4881, lr=1.18e-06]
Epoch 5/5:  56%|█████▌    | 657/1177 [31:24<23:45,  2.74s/it, exist=0.2305, loss=0.4884, lr=1.18e-06]
Epoch 5/5:  56%|█████▌    | 658/1177 [31:24<23:36,  2.73s/it, exist=0.2305, loss=0.4884, lr=1.18e-06]
Epoch 5/5:  56%|█████▌    | 658/1177 [31:27<23:36,  2.73s/it, exist=0.2303, loss=0.4883, lr=1.17e-06]
Epoch 5/5:  56%|█████▌    | 659/1177 [31:27<23:34,  2.73s/it, exist=0.2303, loss=0.4883, lr=1.17e-06]
Epoch 5/5:  56%|█████▌    | 659/1177 [31:30<23:34,  2.73s/it, exist=0.2305, loss=0.4884, lr=1.17e-06]
Epoch 5/5:  56%|█████▌    | 660/1177 [31:30<25:05,  2.91s/it, exist=0.2305, loss=0.4884, lr=1.17e-06]
Epoch 5/5:  56%|█████▌    | 660/1177 [31:32<25:05,  2.91s/it, exist=0.2306, loss=0.4885, lr=1.16e-06]
Epoch 5/5:  56%|█████▌    | 661/1177 [31:32<22:30,  2.62s/it, exist=0.2306, loss=0.4885, lr=1.16e-06]
Epoch 5/5:  56%|█████▌    | 661/1177 [31:35<22:30,  2.62s/it, exist=0.2308, loss=0.4886, lr=1.16e-06]
Epoch 5/5:  56%|█████▌    | 662/1177 [31:35<23:58,  2.79s/it, exist=0.2308, loss=0.4886, lr=1.16e-06]
Epoch 5/5:  56%|█████▌    | 662/1177 [31:37<23:58,  2.79s/it, exist=0.2307, loss=0.4885, lr=1.15e-06]
Epoch 5/5:  56%|█████▋    | 663/1177 [31:37<21:42,  2.53s/it, exist=0.2307, loss=0.4885, lr=1.15e-06]
Epoch 5/5:  56%|█████▋    | 663/1177 [31:40<21:42,  2.53s/it, exist=0.2307, loss=0.4885, lr=1.15e-06]
Epoch 5/5:  56%|█████▋    | 664/1177 [31:40<22:08,  2.59s/it, exist=0.2307, loss=0.4885, lr=1.15e-06]
Epoch 5/5:  56%|█████▋    | 664/1177 [31:43<22:08,  2.59s/it, exist=0.2306, loss=0.4884, lr=1.14e-06]
Epoch 5/5:  56%|█████▋    | 665/1177 [31:43<24:19,  2.85s/it, exist=0.2306, loss=0.4884, lr=1.14e-06]
Epoch 5/5:  56%|█████▋    | 665/1177 [31:46<24:19,  2.85s/it, exist=0.2305, loss=0.4885, lr=1.14e-06]
Epoch 5/5:  57%|█████▋    | 666/1177 [31:46<23:41,  2.78s/it, exist=0.2305, loss=0.4885, lr=1.14e-06]
Epoch 5/5:  57%|█████▋    | 666/1177 [31:51<23:41,  2.78s/it, exist=0.2305, loss=0.4884, lr=1.13e-06]
Epoch 5/5:  57%|█████▋    | 667/1177 [31:51<28:15,  3.32s/it, exist=0.2305, loss=0.4884, lr=1.13e-06]
Epoch 5/5:  57%|█████▋    | 667/1177 [31:53<28:15,  3.32s/it, exist=0.2304, loss=0.4883, lr=1.13e-06]
Epoch 5/5:  57%|█████▋    | 668/1177 [31:53<26:14,  3.09s/it, exist=0.2304, loss=0.4883, lr=1.13e-06]
Epoch 5/5:  57%|█████▋    | 668/1177 [31:56<26:14,  3.09s/it, exist=0.2302, loss=0.4880, lr=1.13e-06]
Epoch 5/5:  57%|█████▋    | 669/1177 [31:56<25:30,  3.01s/it, exist=0.2302, loss=0.4880, lr=1.13e-06]
Epoch 5/5:  57%|█████▋    | 669/1177 [32:00<25:30,  3.01s/it, exist=0.2300, loss=0.4878, lr=1.12e-06]
Epoch 5/5:  57%|█████▋    | 670/1177 [32:00<27:06,  3.21s/it, exist=0.2300, loss=0.4878, lr=1.12e-06]
Epoch 5/5:  57%|█████▋    | 670/1177 [32:04<27:06,  3.21s/it, exist=0.2298, loss=0.4876, lr=1.12e-06]
Epoch 5/5:  57%|█████▋    | 671/1177 [32:04<29:02,  3.44s/it, exist=0.2298, loss=0.4876, lr=1.12e-06]
Epoch 5/5:  57%|█████▋    | 671/1177 [32:09<29:02,  3.44s/it, exist=0.2300, loss=0.4877, lr=1.11e-06]
Epoch 5/5:  57%|█████▋    | 672/1177 [32:09<34:41,  4.12s/it, exist=0.2300, loss=0.4877, lr=1.11e-06]
Epoch 5/5:  57%|█████▋    | 672/1177 [32:14<34:41,  4.12s/it, exist=0.2298, loss=0.4874, lr=1.11e-06]
Epoch 5/5:  57%|█████▋    | 673/1177 [32:14<35:13,  4.19s/it, exist=0.2298, loss=0.4874, lr=1.11e-06]
Epoch 5/5:  57%|█████▋    | 673/1177 [32:16<35:13,  4.19s/it, exist=0.2299, loss=0.4874, lr=1.10e-06]
Epoch 5/5:  57%|█████▋    | 674/1177 [32:16<31:19,  3.74s/it, exist=0.2299, loss=0.4874, lr=1.10e-06]
Epoch 5/5:  57%|█████▋    | 674/1177 [32:22<31:19,  3.74s/it, exist=0.2299, loss=0.4874, lr=1.10e-06]
Epoch 5/5:  57%|█████▋    | 675/1177 [32:22<35:22,  4.23s/it, exist=0.2299, loss=0.4874, lr=1.10e-06]
Epoch 5/5:  57%|█████▋    | 675/1177 [32:27<35:22,  4.23s/it, exist=0.2301, loss=0.4877, lr=1.10e-06]
Epoch 5/5:  57%|█████▋    | 676/1177 [32:27<37:48,  4.53s/it, exist=0.2301, loss=0.4877, lr=1.10e-06]
Epoch 5/5:  57%|█████▋    | 676/1177 [32:30<37:48,  4.53s/it, exist=0.2305, loss=0.4883, lr=1.09e-06]
Epoch 5/5:  58%|█████▊    | 677/1177 [32:30<33:20,  4.00s/it, exist=0.2305, loss=0.4883, lr=1.09e-06]
Epoch 5/5:  58%|█████▊    | 677/1177 [32:32<33:20,  4.00s/it, exist=0.2303, loss=0.4881, lr=1.09e-06]
Epoch 5/5:  58%|█████▊    | 678/1177 [32:32<29:40,  3.57s/it, exist=0.2303, loss=0.4881, lr=1.09e-06]
Epoch 5/5:  58%|█████▊    | 678/1177 [32:36<29:40,  3.57s/it, exist=0.2303, loss=0.4882, lr=1.08e-06]
Epoch 5/5:  58%|█████▊    | 679/1177 [32:36<28:44,  3.46s/it, exist=0.2303, loss=0.4882, lr=1.08e-06]
Epoch 5/5:  58%|█████▊    | 679/1177 [32:38<28:44,  3.46s/it, exist=0.2301, loss=0.4878, lr=1.08e-06]
Epoch 5/5:  58%|█████▊    | 680/1177 [32:38<26:57,  3.26s/it, exist=0.2301, loss=0.4878, lr=1.08e-06]
Epoch 5/5:  58%|█████▊    | 680/1177 [32:43<26:57,  3.26s/it, exist=0.2300, loss=0.4879, lr=1.07e-06]
Epoch 5/5:  58%|█████▊    | 681/1177 [32:43<30:45,  3.72s/it, exist=0.2300, loss=0.4879, lr=1.07e-06]
Epoch 5/5:  58%|█████▊    | 681/1177 [32:48<30:45,  3.72s/it, exist=0.2303, loss=0.4881, lr=1.07e-06]
Epoch 5/5:  58%|█████▊    | 682/1177 [32:48<32:45,  3.97s/it, exist=0.2303, loss=0.4881, lr=1.07e-06]
Epoch 5/5:  58%|█████▊    | 682/1177 [32:51<32:45,  3.97s/it, exist=0.2301, loss=0.4881, lr=1.07e-06]
Epoch 5/5:  58%|█████▊    | 683/1177 [32:51<31:56,  3.88s/it, exist=0.2301, loss=0.4881, lr=1.07e-06]
Epoch 5/5:  58%|█████▊    | 683/1177 [32:55<31:56,  3.88s/it, exist=0.2303, loss=0.4882, lr=1.06e-06]
Epoch 5/5:  58%|█████▊    | 684/1177 [32:55<31:05,  3.78s/it, exist=0.2303, loss=0.4882, lr=1.06e-06]
Epoch 5/5:  58%|█████▊    | 684/1177 [32:58<31:05,  3.78s/it, exist=0.2304, loss=0.4883, lr=1.06e-06]
Epoch 5/5:  58%|█████▊    | 685/1177 [32:58<27:59,  3.41s/it, exist=0.2304, loss=0.4883, lr=1.06e-06]
Epoch 5/5:  58%|█████▊    | 685/1177 [33:02<27:59,  3.41s/it, exist=0.2304, loss=0.4882, lr=1.05e-06]
Epoch 5/5:  58%|█████▊    | 686/1177 [33:02<31:36,  3.86s/it, exist=0.2304, loss=0.4882, lr=1.05e-06]
Epoch 5/5:  58%|█████▊    | 686/1177 [33:05<31:36,  3.86s/it, exist=0.2302, loss=0.4881, lr=1.05e-06]
Epoch 5/5:  58%|█████▊    | 687/1177 [33:05<28:58,  3.55s/it, exist=0.2302, loss=0.4881, lr=1.05e-06]
Epoch 5/5:  58%|█████▊    | 687/1177 [33:10<28:58,  3.55s/it, exist=0.2302, loss=0.4881, lr=1.04e-06]
Epoch 5/5:  58%|█████▊    | 688/1177 [33:10<31:15,  3.84s/it, exist=0.2302, loss=0.4881, lr=1.04e-06]
Epoch 5/5:  58%|█████▊    | 688/1177 [33:13<31:15,  3.84s/it, exist=0.2300, loss=0.4878, lr=1.04e-06]
Epoch 5/5:  59%|█████▊    | 689/1177 [33:13<28:39,  3.52s/it, exist=0.2300, loss=0.4878, lr=1.04e-06]
Epoch 5/5:  59%|█████▊    | 689/1177 [33:16<28:39,  3.52s/it, exist=0.2299, loss=0.4876, lr=1.04e-06]
Epoch 5/5:  59%|█████▊    | 690/1177 [33:16<28:49,  3.55s/it, exist=0.2299, loss=0.4876, lr=1.04e-06]
Epoch 5/5:  59%|█████▊    | 690/1177 [33:19<28:49,  3.55s/it, exist=0.2297, loss=0.4873, lr=1.03e-06]
Epoch 5/5:  59%|█████▊    | 691/1177 [33:19<26:56,  3.33s/it, exist=0.2297, loss=0.4873, lr=1.03e-06]
Epoch 5/5:  59%|█████▊    | 691/1177 [33:22<26:56,  3.33s/it, exist=0.2294, loss=0.4871, lr=1.03e-06]
Epoch 5/5:  59%|█████▉    | 692/1177 [33:22<25:09,  3.11s/it, exist=0.2294, loss=0.4871, lr=1.03e-06]
Epoch 5/5:  59%|█████▉    | 692/1177 [33:24<25:09,  3.11s/it, exist=0.2295, loss=0.4872, lr=1.02e-06]
Epoch 5/5:  59%|█████▉    | 693/1177 [33:24<23:47,  2.95s/it, exist=0.2295, loss=0.4872, lr=1.02e-06]
Epoch 5/5:  59%|█████▉    | 693/1177 [33:27<23:47,  2.95s/it, exist=0.2300, loss=0.4879, lr=1.02e-06]
Epoch 5/5:  59%|█████▉    | 694/1177 [33:27<22:51,  2.84s/it, exist=0.2300, loss=0.4879, lr=1.02e-06]
Epoch 5/5:  59%|█████▉    | 694/1177 [33:29<22:51,  2.84s/it, exist=0.2301, loss=0.4884, lr=1.01e-06]
Epoch 5/5:  59%|█████▉    | 695/1177 [33:29<22:09,  2.76s/it, exist=0.2301, loss=0.4884, lr=1.01e-06]
Epoch 5/5:  59%|█████▉    | 695/1177 [33:32<22:09,  2.76s/it, exist=0.2300, loss=0.4886, lr=1.01e-06]
Epoch 5/5:  59%|█████▉    | 696/1177 [33:32<22:05,  2.76s/it, exist=0.2300, loss=0.4886, lr=1.01e-06]
Epoch 5/5:  59%|█████▉    | 696/1177 [33:35<22:05,  2.76s/it, exist=0.2304, loss=0.4889, lr=1.01e-06]
Epoch 5/5:  59%|█████▉    | 697/1177 [33:35<21:45,  2.72s/it, exist=0.2304, loss=0.4889, lr=1.01e-06]
Epoch 5/5:  59%|█████▉    | 697/1177 [33:37<21:45,  2.72s/it, exist=0.2305, loss=0.4891, lr=1.00e-06]
Epoch 5/5:  59%|█████▉    | 698/1177 [33:37<21:13,  2.66s/it, exist=0.2305, loss=0.4891, lr=1.00e-06]
Epoch 5/5:  59%|█████▉    | 698/1177 [33:40<21:13,  2.66s/it, exist=0.2304, loss=0.4889, lr=9.98e-07]
Epoch 5/5:  59%|█████▉    | 699/1177 [33:40<20:52,  2.62s/it, exist=0.2304, loss=0.4889, lr=9.98e-07]
Epoch 5/5:  59%|█████▉    | 699/1177 [33:42<20:52,  2.62s/it, exist=0.2304, loss=0.4889, lr=9.94e-07]
Epoch 5/5:  59%|█████▉    | 700/1177 [33:42<19:13,  2.42s/it, exist=0.2304, loss=0.4889, lr=9.94e-07]
Epoch 5/5:  59%|█████▉    | 700/1177 [33:44<19:13,  2.42s/it, exist=0.2303, loss=0.4888, lr=9.90e-07]
Epoch 5/5:  60%|█████▉    | 701/1177 [33:44<19:12,  2.42s/it, exist=0.2303, loss=0.4888, lr=9.90e-07]
Epoch 5/5:  60%|█████▉    | 701/1177 [33:48<19:12,  2.42s/it, exist=0.2303, loss=0.4889, lr=9.86e-07]
Epoch 5/5:  60%|█████▉    | 702/1177 [33:48<22:37,  2.86s/it, exist=0.2303, loss=0.4889, lr=9.86e-07]
Epoch 5/5:  60%|█████▉    | 702/1177 [33:53<22:37,  2.86s/it, exist=0.2303, loss=0.4888, lr=9.81e-07]
Epoch 5/5:  60%|█████▉    | 703/1177 [33:53<27:35,  3.49s/it, exist=0.2303, loss=0.4888, lr=9.81e-07]
Epoch 5/5:  60%|█████▉    | 703/1177 [33:58<27:35,  3.49s/it, exist=0.2305, loss=0.4890, lr=9.77e-07]
Epoch 5/5:  60%|█████▉    | 704/1177 [33:58<31:14,  3.96s/it, exist=0.2305, loss=0.4890, lr=9.77e-07]
Epoch 5/5:  60%|█████▉    | 704/1177 [34:02<31:14,  3.96s/it, exist=0.2303, loss=0.4886, lr=9.73e-07]
Epoch 5/5:  60%|█████▉    | 705/1177 [34:02<30:23,  3.86s/it, exist=0.2303, loss=0.4886, lr=9.73e-07]
Epoch 5/5:  60%|█████▉    | 705/1177 [34:05<30:23,  3.86s/it, exist=0.2301, loss=0.4884, lr=9.69e-07]
Epoch 5/5:  60%|█████▉    | 706/1177 [34:05<29:27,  3.75s/it, exist=0.2301, loss=0.4884, lr=9.69e-07]
Epoch 5/5:  60%|█████▉    | 706/1177 [34:08<29:27,  3.75s/it, exist=0.2305, loss=0.4888, lr=9.65e-07]
Epoch 5/5:  60%|██████    | 707/1177 [34:08<26:48,  3.42s/it, exist=0.2305, loss=0.4888, lr=9.65e-07]
Epoch 5/5:  60%|██████    | 707/1177 [34:12<26:48,  3.42s/it, exist=0.2305, loss=0.4888, lr=9.61e-07]
Epoch 5/5:  60%|██████    | 708/1177 [34:12<29:35,  3.79s/it, exist=0.2305, loss=0.4888, lr=9.61e-07]
Epoch 5/5:  60%|██████    | 708/1177 [34:16<29:35,  3.79s/it, exist=0.2302, loss=0.4886, lr=9.57e-07]
Epoch 5/5:  60%|██████    | 709/1177 [34:16<28:08,  3.61s/it, exist=0.2302, loss=0.4886, lr=9.57e-07]
Epoch 5/5:  60%|██████    | 709/1177 [34:18<28:08,  3.61s/it, exist=0.2301, loss=0.4885, lr=9.53e-07]
Epoch 5/5:  60%|██████    | 710/1177 [34:18<26:12,  3.37s/it, exist=0.2301, loss=0.4885, lr=9.53e-07]
Epoch 5/5:  60%|██████    | 710/1177 [34:23<26:12,  3.37s/it, exist=0.2299, loss=0.4885, lr=9.49e-07]
Epoch 5/5:  60%|██████    | 711/1177 [34:23<29:13,  3.76s/it, exist=0.2299, loss=0.4885, lr=9.49e-07]
Epoch 5/5:  60%|██████    | 711/1177 [34:26<29:13,  3.76s/it, exist=0.2301, loss=0.4887, lr=9.45e-07]
Epoch 5/5:  60%|██████    | 712/1177 [34:26<26:40,  3.44s/it, exist=0.2301, loss=0.4887, lr=9.45e-07]
Epoch 5/5:  60%|██████    | 712/1177 [34:30<26:40,  3.44s/it, exist=0.2300, loss=0.4885, lr=9.41e-07]
Epoch 5/5:  61%|██████    | 713/1177 [34:30<28:40,  3.71s/it, exist=0.2300, loss=0.4885, lr=9.41e-07]
Epoch 5/5:  61%|██████    | 713/1177 [34:34<28:40,  3.71s/it, exist=0.2303, loss=0.4890, lr=9.37e-07]
Epoch 5/5:  61%|██████    | 714/1177 [34:34<27:55,  3.62s/it, exist=0.2303, loss=0.4890, lr=9.37e-07]
Epoch 5/5:  61%|██████    | 714/1177 [34:36<27:55,  3.62s/it, exist=0.2306, loss=0.4893, lr=9.33e-07]
Epoch 5/5:  61%|██████    | 715/1177 [34:36<25:36,  3.32s/it, exist=0.2306, loss=0.4893, lr=9.33e-07]
Epoch 5/5:  61%|██████    | 715/1177 [34:39<25:36,  3.32s/it, exist=0.2305, loss=0.4890, lr=9.29e-07]
Epoch 5/5:  61%|██████    | 716/1177 [34:39<23:54,  3.11s/it, exist=0.2305, loss=0.4890, lr=9.29e-07]
Epoch 5/5:  61%|██████    | 716/1177 [34:41<23:54,  3.11s/it, exist=0.2304, loss=0.4891, lr=9.25e-07]
Epoch 5/5:  61%|██████    | 717/1177 [34:41<21:10,  2.76s/it, exist=0.2304, loss=0.4891, lr=9.25e-07]
Epoch 5/5:  61%|██████    | 717/1177 [34:43<21:10,  2.76s/it, exist=0.2306, loss=0.4892, lr=9.21e-07]
Epoch 5/5:  61%|██████    | 718/1177 [34:43<19:25,  2.54s/it, exist=0.2306, loss=0.4892, lr=9.21e-07]
Epoch 5/5:  61%|██████    | 718/1177 [34:45<19:25,  2.54s/it, exist=0.2305, loss=0.4890, lr=9.17e-07]
Epoch 5/5:  61%|██████    | 719/1177 [34:45<19:06,  2.50s/it, exist=0.2305, loss=0.4890, lr=9.17e-07]
Epoch 5/5:  61%|██████    | 719/1177 [34:48<19:06,  2.50s/it, exist=0.2305, loss=0.4889, lr=9.13e-07]
Epoch 5/5:  61%|██████    | 720/1177 [34:48<19:17,  2.53s/it, exist=0.2305, loss=0.4889, lr=9.13e-07]
Epoch 5/5:  61%|██████    | 720/1177 [34:51<19:17,  2.53s/it, exist=0.2307, loss=0.4891, lr=9.09e-07]
Epoch 5/5:  61%|██████▏   | 721/1177 [34:51<20:59,  2.76s/it, exist=0.2307, loss=0.4891, lr=9.09e-07]
Epoch 5/5:  61%|██████▏   | 721/1177 [34:54<20:59,  2.76s/it, exist=0.2305, loss=0.4888, lr=9.05e-07]
Epoch 5/5:  61%|██████▏   | 722/1177 [34:54<20:38,  2.72s/it, exist=0.2305, loss=0.4888, lr=9.05e-07]
Epoch 5/5:  61%|██████▏   | 722/1177 [34:56<20:38,  2.72s/it, exist=0.2304, loss=0.4886, lr=9.01e-07]
Epoch 5/5:  61%|██████▏   | 723/1177 [34:56<20:29,  2.71s/it, exist=0.2304, loss=0.4886, lr=9.01e-07]
Epoch 5/5:  61%|██████▏   | 723/1177 [34:59<20:29,  2.71s/it, exist=0.2303, loss=0.4885, lr=8.97e-07]
Epoch 5/5:  62%|██████▏   | 724/1177 [34:59<20:18,  2.69s/it, exist=0.2303, loss=0.4885, lr=8.97e-07]
Epoch 5/5:  62%|██████▏   | 724/1177 [35:02<20:18,  2.69s/it, exist=0.2304, loss=0.4886, lr=8.93e-07]
Epoch 5/5:  62%|██████▏   | 725/1177 [35:02<20:02,  2.66s/it, exist=0.2304, loss=0.4886, lr=8.93e-07]
Epoch 5/5:  62%|██████▏   | 725/1177 [35:05<20:02,  2.66s/it, exist=0.2302, loss=0.4885, lr=8.89e-07]
Epoch 5/5:  62%|██████▏   | 726/1177 [35:05<20:56,  2.79s/it, exist=0.2302, loss=0.4885, lr=8.89e-07]
Epoch 5/5:  62%|██████▏   | 726/1177 [35:08<20:56,  2.79s/it, exist=0.2301, loss=0.4883, lr=8.85e-07]
Epoch 5/5:  62%|██████▏   | 727/1177 [35:08<22:52,  3.05s/it, exist=0.2301, loss=0.4883, lr=8.85e-07]
Epoch 5/5:  62%|██████▏   | 727/1177 [35:13<22:52,  3.05s/it, exist=0.2300, loss=0.4881, lr=8.81e-07]
Epoch 5/5:  62%|██████▏   | 728/1177 [35:13<25:58,  3.47s/it, exist=0.2300, loss=0.4881, lr=8.81e-07]
Epoch 5/5:  62%|██████▏   | 728/1177 [35:18<25:58,  3.47s/it, exist=0.2298, loss=0.4880, lr=8.77e-07]
Epoch 5/5:  62%|██████▏   | 729/1177 [35:18<29:51,  4.00s/it, exist=0.2298, loss=0.4880, lr=8.77e-07]
Epoch 5/5:  62%|██████▏   | 729/1177 [35:21<29:51,  4.00s/it, exist=0.2297, loss=0.4879, lr=8.73e-07]
Epoch 5/5:  62%|██████▏   | 730/1177 [35:21<26:52,  3.61s/it, exist=0.2297, loss=0.4879, lr=8.73e-07]
Epoch 5/5:  62%|██████▏   | 730/1177 [35:24<26:52,  3.61s/it, exist=0.2296, loss=0.4877, lr=8.70e-07]
Epoch 5/5:  62%|██████▏   | 731/1177 [35:24<26:26,  3.56s/it, exist=0.2296, loss=0.4877, lr=8.70e-07]
Epoch 5/5:  62%|██████▏   | 731/1177 [35:27<26:26,  3.56s/it, exist=0.2298, loss=0.4879, lr=8.66e-07]
Epoch 5/5:  62%|██████▏   | 732/1177 [35:27<25:39,  3.46s/it, exist=0.2298, loss=0.4879, lr=8.66e-07]
Epoch 5/5:  62%|██████▏   | 732/1177 [35:30<25:39,  3.46s/it, exist=0.2297, loss=0.4878, lr=8.62e-07]
Epoch 5/5:  62%|██████▏   | 733/1177 [35:30<23:46,  3.21s/it, exist=0.2297, loss=0.4878, lr=8.62e-07]
Epoch 5/5:  62%|██████▏   | 733/1177 [35:32<23:46,  3.21s/it, exist=0.2296, loss=0.4877, lr=8.58e-07]
Epoch 5/5:  62%|██████▏   | 734/1177 [35:32<21:03,  2.85s/it, exist=0.2296, loss=0.4877, lr=8.58e-07]
Epoch 5/5:  62%|██████▏   | 734/1177 [35:35<21:03,  2.85s/it, exist=0.2299, loss=0.4880, lr=8.54e-07]
Epoch 5/5:  62%|██████▏   | 735/1177 [35:35<21:59,  2.98s/it, exist=0.2299, loss=0.4880, lr=8.54e-07]
Epoch 5/5:  62%|██████▏   | 735/1177 [35:38<21:59,  2.98s/it, exist=0.2301, loss=0.4882, lr=8.50e-07]
Epoch 5/5:  63%|██████▎   | 736/1177 [35:38<20:47,  2.83s/it, exist=0.2301, loss=0.4882, lr=8.50e-07]
Epoch 5/5:  63%|██████▎   | 736/1177 [35:43<20:47,  2.83s/it, exist=0.2303, loss=0.4886, lr=8.46e-07]
Epoch 5/5:  63%|██████▎   | 737/1177 [35:43<26:19,  3.59s/it, exist=0.2303, loss=0.4886, lr=8.46e-07]
Epoch 5/5:  63%|██████▎   | 737/1177 [35:47<26:19,  3.59s/it, exist=0.2306, loss=0.4889, lr=8.43e-07]
Epoch 5/5:  63%|██████▎   | 738/1177 [35:47<25:55,  3.54s/it, exist=0.2306, loss=0.4889, lr=8.43e-07]
Epoch 5/5:  63%|██████▎   | 738/1177 [35:49<25:55,  3.54s/it, exist=0.2309, loss=0.4891, lr=8.39e-07]
Epoch 5/5:  63%|██████▎   | 739/1177 [35:49<22:19,  3.06s/it, exist=0.2309, loss=0.4891, lr=8.39e-07]
Epoch 5/5:  63%|██████▎   | 739/1177 [35:51<22:19,  3.06s/it, exist=0.2307, loss=0.4889, lr=8.35e-07]
Epoch 5/5:  63%|██████▎   | 740/1177 [35:51<21:33,  2.96s/it, exist=0.2307, loss=0.4889, lr=8.35e-07]
Epoch 5/5:  63%|██████▎   | 740/1177 [35:54<21:33,  2.96s/it, exist=0.2305, loss=0.4886, lr=8.31e-07]
Epoch 5/5:  63%|██████▎   | 741/1177 [35:54<20:38,  2.84s/it, exist=0.2305, loss=0.4886, lr=8.31e-07]
Epoch 5/5:  63%|██████▎   | 741/1177 [35:56<20:38,  2.84s/it, exist=0.2306, loss=0.4888, lr=8.27e-07]
Epoch 5/5:  63%|██████▎   | 742/1177 [35:56<18:54,  2.61s/it, exist=0.2306, loss=0.4888, lr=8.27e-07]
Epoch 5/5:  63%|██████▎   | 742/1177 [35:59<18:54,  2.61s/it, exist=0.2304, loss=0.4885, lr=8.24e-07]
Epoch 5/5:  63%|██████▎   | 743/1177 [35:59<20:24,  2.82s/it, exist=0.2304, loss=0.4885, lr=8.24e-07]
Epoch 5/5:  63%|██████▎   | 743/1177 [36:02<20:24,  2.82s/it, exist=0.2302, loss=0.4884, lr=8.20e-07]
Epoch 5/5:  63%|██████▎   | 744/1177 [36:02<19:56,  2.76s/it, exist=0.2302, loss=0.4884, lr=8.20e-07]
Epoch 5/5:  63%|██████▎   | 744/1177 [36:06<19:56,  2.76s/it, exist=0.2307, loss=0.4888, lr=8.16e-07]
Epoch 5/5:  63%|██████▎   | 745/1177 [36:06<22:07,  3.07s/it, exist=0.2307, loss=0.4888, lr=8.16e-07]
Epoch 5/5:  63%|██████▎   | 745/1177 [36:09<22:07,  3.07s/it, exist=0.2308, loss=0.4889, lr=8.12e-07]
Epoch 5/5:  63%|██████▎   | 746/1177 [36:09<23:10,  3.23s/it, exist=0.2308, loss=0.4889, lr=8.12e-07]
Epoch 5/5:  63%|██████▎   | 746/1177 [36:11<23:10,  3.23s/it, exist=0.2309, loss=0.4890, lr=8.09e-07]
Epoch 5/5:  63%|██████▎   | 747/1177 [36:11<21:01,  2.93s/it, exist=0.2309, loss=0.4890, lr=8.09e-07]
Epoch 5/5:  63%|██████▎   | 747/1177 [36:14<21:01,  2.93s/it, exist=0.2307, loss=0.4889, lr=8.05e-07]
Epoch 5/5:  64%|██████▎   | 748/1177 [36:14<20:53,  2.92s/it, exist=0.2307, loss=0.4889, lr=8.05e-07]
Epoch 5/5:  64%|██████▎   | 748/1177 [36:19<20:53,  2.92s/it, exist=0.2306, loss=0.4887, lr=8.01e-07]
Epoch 5/5:  64%|██████▎   | 749/1177 [36:19<24:47,  3.48s/it, exist=0.2306, loss=0.4887, lr=8.01e-07]
Epoch 5/5:  64%|██████▎   | 749/1177 [36:22<24:47,  3.48s/it, exist=0.2306, loss=0.4888, lr=7.97e-07]
Epoch 5/5:  64%|██████▎   | 750/1177 [36:22<23:16,  3.27s/it, exist=0.2306, loss=0.4888, lr=7.97e-07]
Epoch 5/5:  64%|██████▎   | 750/1177 [36:25<23:16,  3.27s/it, exist=0.2310, loss=0.4894, lr=7.94e-07]
Epoch 5/5:  64%|██████▍   | 751/1177 [36:25<23:06,  3.26s/it, exist=0.2310, loss=0.4894, lr=7.94e-07]
Epoch 5/5:  64%|██████▍   | 751/1177 [36:28<23:06,  3.26s/it, exist=0.2312, loss=0.4896, lr=7.90e-07]
Epoch 5/5:  64%|██████▍   | 752/1177 [36:28<21:39,  3.06s/it, exist=0.2312, loss=0.4896, lr=7.90e-07]
Epoch 5/5:  64%|██████▍   | 752/1177 [36:31<21:39,  3.06s/it, exist=0.2309, loss=0.4893, lr=7.86e-07]
Epoch 5/5:  64%|██████▍   | 753/1177 [36:31<21:03,  2.98s/it, exist=0.2309, loss=0.4893, lr=7.86e-07]
Epoch 5/5:  64%|██████▍   | 753/1177 [36:34<21:03,  2.98s/it, exist=0.2311, loss=0.4895, lr=7.83e-07]
Epoch 5/5:  64%|██████▍   | 754/1177 [36:34<21:24,  3.04s/it, exist=0.2311, loss=0.4895, lr=7.83e-07]
Epoch 5/5:  64%|██████▍   | 754/1177 [36:36<21:24,  3.04s/it, exist=0.2313, loss=0.4896, lr=7.79e-07]
Epoch 5/5:  64%|██████▍   | 755/1177 [36:36<20:21,  2.89s/it, exist=0.2313, loss=0.4896, lr=7.79e-07]
Epoch 5/5:  64%|██████▍   | 755/1177 [36:39<20:21,  2.89s/it, exist=0.2311, loss=0.4894, lr=7.75e-07]
Epoch 5/5:  64%|██████▍   | 756/1177 [36:39<19:29,  2.78s/it, exist=0.2311, loss=0.4894, lr=7.75e-07]
Epoch 5/5:  64%|██████▍   | 756/1177 [36:41<19:29,  2.78s/it, exist=0.2317, loss=0.4901, lr=7.72e-07]
Epoch 5/5:  64%|██████▍   | 757/1177 [36:41<17:39,  2.52s/it, exist=0.2317, loss=0.4901, lr=7.72e-07]
Epoch 5/5:  64%|██████▍   | 757/1177 [36:45<17:39,  2.52s/it, exist=0.2317, loss=0.4900, lr=7.68e-07]
Epoch 5/5:  64%|██████▍   | 758/1177 [36:45<20:20,  2.91s/it, exist=0.2317, loss=0.4900, lr=7.68e-07]
Epoch 5/5:  64%|██████▍   | 758/1177 [36:47<20:20,  2.91s/it, exist=0.2315, loss=0.4898, lr=7.64e-07]
Epoch 5/5:  64%|██████▍   | 759/1177 [36:47<20:21,  2.92s/it, exist=0.2315, loss=0.4898, lr=7.64e-07]
Epoch 5/5:  64%|██████▍   | 759/1177 [36:50<20:21,  2.92s/it, exist=0.2316, loss=0.4899, lr=7.61e-07]
Epoch 5/5:  65%|██████▍   | 760/1177 [36:50<19:45,  2.84s/it, exist=0.2316, loss=0.4899, lr=7.61e-07]
Epoch 5/5:  65%|██████▍   | 760/1177 [36:54<19:45,  2.84s/it, exist=0.2318, loss=0.4902, lr=7.57e-07]
Epoch 5/5:  65%|██████▍   | 761/1177 [36:54<22:25,  3.23s/it, exist=0.2318, loss=0.4902, lr=7.57e-07]
Epoch 5/5:  65%|██████▍   | 761/1177 [36:58<22:25,  3.23s/it, exist=0.2319, loss=0.4902, lr=7.53e-07]
Epoch 5/5:  65%|██████▍   | 762/1177 [36:58<23:30,  3.40s/it, exist=0.2319, loss=0.4902, lr=7.53e-07]
Epoch 5/5:  65%|██████▍   | 762/1177 [37:02<23:30,  3.40s/it, exist=0.2318, loss=0.4901, lr=7.50e-07]
Epoch 5/5:  65%|██████▍   | 763/1177 [37:02<23:35,  3.42s/it, exist=0.2318, loss=0.4901, lr=7.50e-07]
Epoch 5/5:  65%|██████▍   | 763/1177 [37:04<23:35,  3.42s/it, exist=0.2317, loss=0.4900, lr=7.46e-07]
Epoch 5/5:  65%|██████▍   | 764/1177 [37:04<22:08,  3.22s/it, exist=0.2317, loss=0.4900, lr=7.46e-07]
Epoch 5/5:  65%|██████▍   | 764/1177 [37:07<22:08,  3.22s/it, exist=0.2316, loss=0.4900, lr=7.43e-07]
Epoch 5/5:  65%|██████▍   | 765/1177 [37:07<21:16,  3.10s/it, exist=0.2316, loss=0.4900, lr=7.43e-07]
Epoch 5/5:  65%|██████▍   | 765/1177 [37:11<21:16,  3.10s/it, exist=0.2317, loss=0.4900, lr=7.39e-07]
Epoch 5/5:  65%|██████▌   | 766/1177 [37:11<23:19,  3.41s/it, exist=0.2317, loss=0.4900, lr=7.39e-07]
Epoch 5/5:  65%|██████▌   | 766/1177 [37:14<23:19,  3.41s/it, exist=0.2315, loss=0.4898, lr=7.35e-07]
Epoch 5/5:  65%|██████▌   | 767/1177 [37:14<22:15,  3.26s/it, exist=0.2315, loss=0.4898, lr=7.35e-07]
Epoch 5/5:  65%|██████▌   | 767/1177 [37:18<22:15,  3.26s/it, exist=0.2315, loss=0.4898, lr=7.32e-07]
Epoch 5/5:  65%|██████▌   | 768/1177 [37:18<22:59,  3.37s/it, exist=0.2315, loss=0.4898, lr=7.32e-07]
Epoch 5/5:  65%|██████▌   | 768/1177 [37:21<22:59,  3.37s/it, exist=0.2313, loss=0.4896, lr=7.28e-07]
Epoch 5/5:  65%|██████▌   | 769/1177 [37:21<23:27,  3.45s/it, exist=0.2313, loss=0.4896, lr=7.28e-07]
Epoch 5/5:  65%|██████▌   | 769/1177 [37:24<23:27,  3.45s/it, exist=0.2312, loss=0.4895, lr=7.25e-07]
Epoch 5/5:  65%|██████▌   | 770/1177 [37:24<22:36,  3.33s/it, exist=0.2312, loss=0.4895, lr=7.25e-07]
Epoch 5/5:  65%|██████▌   | 770/1177 [37:27<22:36,  3.33s/it, exist=0.2311, loss=0.4894, lr=7.21e-07]
Epoch 5/5:  66%|██████▌   | 771/1177 [37:27<20:42,  3.06s/it, exist=0.2311, loss=0.4894, lr=7.21e-07]
Epoch 5/5:  66%|██████▌   | 771/1177 [37:29<20:42,  3.06s/it, exist=0.2312, loss=0.4895, lr=7.18e-07]
Epoch 5/5:  66%|██████▌   | 772/1177 [37:29<18:28,  2.74s/it, exist=0.2312, loss=0.4895, lr=7.18e-07]
Epoch 5/5:  66%|██████▌   | 772/1177 [37:31<18:28,  2.74s/it, exist=0.2312, loss=0.4894, lr=7.14e-07]
Epoch 5/5:  66%|██████▌   | 773/1177 [37:31<17:57,  2.67s/it, exist=0.2312, loss=0.4894, lr=7.14e-07]
Epoch 5/5:  66%|██████▌   | 773/1177 [37:33<17:57,  2.67s/it, exist=0.2310, loss=0.4892, lr=7.11e-07]
Epoch 5/5:  66%|██████▌   | 774/1177 [37:33<16:33,  2.47s/it, exist=0.2310, loss=0.4892, lr=7.11e-07]
Epoch 5/5:  66%|██████▌   | 774/1177 [37:37<16:33,  2.47s/it, exist=0.2308, loss=0.4889, lr=7.07e-07]
Epoch 5/5:  66%|██████▌   | 775/1177 [37:37<18:02,  2.69s/it, exist=0.2308, loss=0.4889, lr=7.07e-07]
Epoch 5/5:  66%|██████▌   | 775/1177 [37:39<18:02,  2.69s/it, exist=0.2307, loss=0.4888, lr=7.04e-07]
Epoch 5/5:  66%|██████▌   | 776/1177 [37:39<17:26,  2.61s/it, exist=0.2307, loss=0.4888, lr=7.04e-07]
Epoch 5/5:  66%|██████▌   | 776/1177 [37:42<17:26,  2.61s/it, exist=0.2310, loss=0.4891, lr=7.00e-07]
Epoch 5/5:  66%|██████▌   | 777/1177 [37:42<17:53,  2.68s/it, exist=0.2310, loss=0.4891, lr=7.00e-07]
Epoch 5/5:  66%|██████▌   | 777/1177 [37:44<17:53,  2.68s/it, exist=0.2312, loss=0.4892, lr=6.97e-07]
Epoch 5/5:  66%|██████▌   | 778/1177 [37:44<16:29,  2.48s/it, exist=0.2312, loss=0.4892, lr=6.97e-07]
Epoch 5/5:  66%|██████▌   | 778/1177 [37:47<16:29,  2.48s/it, exist=0.2312, loss=0.4892, lr=6.93e-07]
Epoch 5/5:  66%|██████▌   | 779/1177 [37:47<16:52,  2.54s/it, exist=0.2312, loss=0.4892, lr=6.93e-07]
Epoch 5/5:  66%|██████▌   | 779/1177 [37:49<16:52,  2.54s/it, exist=0.2311, loss=0.4890, lr=6.90e-07]
Epoch 5/5:  66%|██████▋   | 780/1177 [37:49<16:38,  2.52s/it, exist=0.2311, loss=0.4890, lr=6.90e-07]
Epoch 5/5:  66%|██████▋   | 780/1177 [37:52<16:38,  2.52s/it, exist=0.2311, loss=0.4891, lr=6.86e-07]
Epoch 5/5:  66%|██████▋   | 781/1177 [37:52<17:31,  2.66s/it, exist=0.2311, loss=0.4891, lr=6.86e-07]
Epoch 5/5:  66%|██████▋   | 781/1177 [37:54<17:31,  2.66s/it, exist=0.2311, loss=0.4893, lr=6.83e-07]
Epoch 5/5:  66%|██████▋   | 782/1177 [37:54<16:11,  2.46s/it, exist=0.2311, loss=0.4893, lr=6.83e-07]
Epoch 5/5:  66%|██████▋   | 782/1177 [37:56<16:11,  2.46s/it, exist=0.2315, loss=0.4897, lr=6.79e-07]
Epoch 5/5:  67%|██████▋   | 783/1177 [37:56<15:32,  2.37s/it, exist=0.2315, loss=0.4897, lr=6.79e-07]
Epoch 5/5:  67%|██████▋   | 783/1177 [38:00<15:32,  2.37s/it, exist=0.2313, loss=0.4895, lr=6.76e-07]
Epoch 5/5:  67%|██████▋   | 784/1177 [38:00<18:25,  2.81s/it, exist=0.2313, loss=0.4895, lr=6.76e-07]
Epoch 5/5:  67%|██████▋   | 784/1177 [38:06<18:25,  2.81s/it, exist=0.2311, loss=0.4893, lr=6.73e-07]
Epoch 5/5:  67%|██████▋   | 785/1177 [38:06<24:40,  3.78s/it, exist=0.2311, loss=0.4893, lr=6.73e-07]
Epoch 5/5:  67%|██████▋   | 785/1177 [38:09<24:40,  3.78s/it, exist=0.2313, loss=0.4895, lr=6.69e-07]
Epoch 5/5:  67%|██████▋   | 786/1177 [38:09<22:43,  3.49s/it, exist=0.2313, loss=0.4895, lr=6.69e-07]
Epoch 5/5:  67%|██████▋   | 786/1177 [38:12<22:43,  3.49s/it, exist=0.2312, loss=0.4893, lr=6.66e-07]
Epoch 5/5:  67%|██████▋   | 787/1177 [38:12<21:44,  3.34s/it, exist=0.2312, loss=0.4893, lr=6.66e-07]
Epoch 5/5:  67%|██████▋   | 787/1177 [38:14<21:44,  3.34s/it, exist=0.2310, loss=0.4894, lr=6.62e-07]
Epoch 5/5:  67%|██████▋   | 788/1177 [38:14<19:06,  2.95s/it, exist=0.2310, loss=0.4894, lr=6.62e-07]
Epoch 5/5:  67%|██████▋   | 788/1177 [38:16<19:06,  2.95s/it, exist=0.2308, loss=0.4892, lr=6.59e-07]
Epoch 5/5:  67%|██████▋   | 789/1177 [38:16<18:04,  2.80s/it, exist=0.2308, loss=0.4892, lr=6.59e-07]
Epoch 5/5:  67%|██████▋   | 789/1177 [38:19<18:04,  2.80s/it, exist=0.2309, loss=0.4893, lr=6.56e-07]
Epoch 5/5:  67%|██████▋   | 790/1177 [38:19<17:39,  2.74s/it, exist=0.2309, loss=0.4893, lr=6.56e-07]
Epoch 5/5:  67%|██████▋   | 790/1177 [38:21<17:39,  2.74s/it, exist=0.2311, loss=0.4895, lr=6.52e-07]
Epoch 5/5:  67%|██████▋   | 791/1177 [38:21<17:14,  2.68s/it, exist=0.2311, loss=0.4895, lr=6.52e-07]
Epoch 5/5:  67%|██████▋   | 791/1177 [38:25<17:14,  2.68s/it, exist=0.2312, loss=0.4896, lr=6.49e-07]
Epoch 5/5:  67%|██████▋   | 792/1177 [38:25<18:29,  2.88s/it, exist=0.2312, loss=0.4896, lr=6.49e-07]
Epoch 5/5:  67%|██████▋   | 792/1177 [38:27<18:29,  2.88s/it, exist=0.2310, loss=0.4894, lr=6.46e-07]
Epoch 5/5:  67%|██████▋   | 793/1177 [38:27<17:53,  2.80s/it, exist=0.2310, loss=0.4894, lr=6.46e-07]
Epoch 5/5:  67%|██████▋   | 793/1177 [38:29<17:53,  2.80s/it, exist=0.2311, loss=0.4894, lr=6.42e-07]
Epoch 5/5:  67%|██████▋   | 794/1177 [38:29<16:15,  2.55s/it, exist=0.2311, loss=0.4894, lr=6.42e-07]
Epoch 5/5:  67%|██████▋   | 794/1177 [38:33<16:15,  2.55s/it, exist=0.2309, loss=0.4892, lr=6.39e-07]
Epoch 5/5:  68%|██████▊   | 795/1177 [38:33<17:49,  2.80s/it, exist=0.2309, loss=0.4892, lr=6.39e-07]
Epoch 5/5:  68%|██████▊   | 795/1177 [38:36<17:49,  2.80s/it, exist=0.2313, loss=0.4896, lr=6.36e-07]
Epoch 5/5:  68%|██████▊   | 796/1177 [38:36<18:33,  2.92s/it, exist=0.2313, loss=0.4896, lr=6.36e-07]
Epoch 5/5:  68%|██████▊   | 796/1177 [38:39<18:33,  2.92s/it, exist=0.2313, loss=0.4896, lr=6.32e-07]
Epoch 5/5:  68%|██████▊   | 797/1177 [38:39<18:24,  2.91s/it, exist=0.2313, loss=0.4896, lr=6.32e-07]
Epoch 5/5:  68%|██████▊   | 797/1177 [38:42<18:24,  2.91s/it, exist=0.2313, loss=0.4896, lr=6.29e-07]
Epoch 5/5:  68%|██████▊   | 798/1177 [38:42<18:39,  2.95s/it, exist=0.2313, loss=0.4896, lr=6.29e-07]
Epoch 5/5:  68%|██████▊   | 798/1177 [38:44<18:39,  2.95s/it, exist=0.2313, loss=0.4895, lr=6.26e-07]
Epoch 5/5:  68%|██████▊   | 799/1177 [38:44<16:48,  2.67s/it, exist=0.2313, loss=0.4895, lr=6.26e-07]
Epoch 5/5:  68%|██████▊   | 799/1177 [38:46<16:48,  2.67s/it, exist=0.2311, loss=0.4893, lr=6.22e-07]
Epoch 5/5:  68%|██████▊   | 800/1177 [38:46<15:32,  2.47s/it, exist=0.2311, loss=0.4893, lr=6.22e-07]
Epoch 5/5:  68%|██████▊   | 800/1177 [38:49<15:32,  2.47s/it, exist=0.2310, loss=0.4893, lr=6.19e-07]
Epoch 5/5:  68%|██████▊   | 801/1177 [38:49<17:27,  2.79s/it, exist=0.2310, loss=0.4893, lr=6.19e-07]
Epoch 5/5:  68%|██████▊   | 801/1177 [38:53<17:27,  2.79s/it, exist=0.2313, loss=0.4896, lr=6.16e-07]
Epoch 5/5:  68%|██████▊   | 802/1177 [38:53<19:16,  3.08s/it, exist=0.2313, loss=0.4896, lr=6.16e-07]
Epoch 5/5:  68%|██████▊   | 802/1177 [38:55<19:16,  3.08s/it, exist=0.2315, loss=0.4898, lr=6.13e-07]
Epoch 5/5:  68%|██████▊   | 803/1177 [38:55<17:08,  2.75s/it, exist=0.2315, loss=0.4898, lr=6.13e-07]
Epoch 5/5:  68%|██████▊   | 803/1177 [38:58<17:08,  2.75s/it, exist=0.2312, loss=0.4896, lr=6.09e-07]
Epoch 5/5:  68%|██████▊   | 804/1177 [38:58<16:41,  2.69s/it, exist=0.2312, loss=0.4896, lr=6.09e-07]
Epoch 5/5:  68%|██████▊   | 804/1177 [39:01<16:41,  2.69s/it, exist=0.2313, loss=0.4897, lr=6.06e-07]
Epoch 5/5:  68%|██████▊   | 805/1177 [39:01<16:58,  2.74s/it, exist=0.2313, loss=0.4897, lr=6.06e-07]
Epoch 5/5:  68%|██████▊   | 805/1177 [39:05<16:58,  2.74s/it, exist=0.2312, loss=0.4896, lr=6.03e-07]
Epoch 5/5:  68%|██████▊   | 806/1177 [39:05<20:12,  3.27s/it, exist=0.2312, loss=0.4896, lr=6.03e-07]
Epoch 5/5:  68%|██████▊   | 806/1177 [39:08<20:12,  3.27s/it, exist=0.2311, loss=0.4895, lr=6.00e-07]
Epoch 5/5:  69%|██████▊   | 807/1177 [39:08<19:38,  3.18s/it, exist=0.2311, loss=0.4895, lr=6.00e-07]
Epoch 5/5:  69%|██████▊   | 807/1177 [39:11<19:38,  3.18s/it, exist=0.2310, loss=0.4894, lr=5.96e-07]
Epoch 5/5:  69%|██████▊   | 808/1177 [39:11<18:14,  2.97s/it, exist=0.2310, loss=0.4894, lr=5.96e-07]
Epoch 5/5:  69%|██████▊   | 808/1177 [39:14<18:14,  2.97s/it, exist=0.2312, loss=0.4897, lr=5.93e-07]
Epoch 5/5:  69%|██████▊   | 809/1177 [39:14<19:16,  3.14s/it, exist=0.2312, loss=0.4897, lr=5.93e-07]
Epoch 5/5:  69%|██████▊   | 809/1177 [39:18<19:16,  3.14s/it, exist=0.2313, loss=0.4897, lr=5.90e-07]
Epoch 5/5:  69%|██████▉   | 810/1177 [39:18<19:54,  3.25s/it, exist=0.2313, loss=0.4897, lr=5.90e-07]
Epoch 5/5:  69%|██████▉   | 810/1177 [39:21<19:54,  3.25s/it, exist=0.2311, loss=0.4896, lr=5.87e-07]
Epoch 5/5:  69%|██████▉   | 811/1177 [39:21<20:10,  3.31s/it, exist=0.2311, loss=0.4896, lr=5.87e-07]
Epoch 5/5:  69%|██████▉   | 811/1177 [39:25<20:10,  3.31s/it, exist=0.2310, loss=0.4895, lr=5.83e-07]
Epoch 5/5:  69%|██████▉   | 812/1177 [39:25<20:30,  3.37s/it, exist=0.2310, loss=0.4895, lr=5.83e-07]
Epoch 5/5:  69%|██████▉   | 812/1177 [39:28<20:30,  3.37s/it, exist=0.2311, loss=0.4895, lr=5.80e-07]
Epoch 5/5:  69%|██████▉   | 813/1177 [39:28<20:12,  3.33s/it, exist=0.2311, loss=0.4895, lr=5.80e-07]
Epoch 5/5:  69%|██████▉   | 813/1177 [39:30<20:12,  3.33s/it, exist=0.2311, loss=0.4895, lr=5.77e-07]
Epoch 5/5:  69%|██████▉   | 814/1177 [39:30<18:36,  3.08s/it, exist=0.2311, loss=0.4895, lr=5.77e-07]
Epoch 5/5:  69%|██████▉   | 814/1177 [39:32<18:36,  3.08s/it, exist=0.2311, loss=0.4895, lr=5.74e-07]
Epoch 5/5:  69%|██████▉   | 815/1177 [39:32<16:35,  2.75s/it, exist=0.2311, loss=0.4895, lr=5.74e-07]
Epoch 5/5:  69%|██████▉   | 815/1177 [39:35<16:35,  2.75s/it, exist=0.2310, loss=0.4893, lr=5.71e-07]
Epoch 5/5:  69%|██████▉   | 816/1177 [39:35<15:51,  2.64s/it, exist=0.2310, loss=0.4893, lr=5.71e-07]
Epoch 5/5:  69%|██████▉   | 816/1177 [39:37<15:51,  2.64s/it, exist=0.2309, loss=0.4891, lr=5.68e-07]
Epoch 5/5:  69%|██████▉   | 817/1177 [39:37<15:48,  2.64s/it, exist=0.2309, loss=0.4891, lr=5.68e-07]
Epoch 5/5:  69%|██████▉   | 817/1177 [39:40<15:48,  2.64s/it, exist=0.2307, loss=0.4890, lr=5.65e-07]
Epoch 5/5:  69%|██████▉   | 818/1177 [39:40<15:23,  2.57s/it, exist=0.2307, loss=0.4890, lr=5.65e-07]
Epoch 5/5:  69%|██████▉   | 818/1177 [39:42<15:23,  2.57s/it, exist=0.2310, loss=0.4894, lr=5.61e-07]
Epoch 5/5:  70%|██████▉   | 819/1177 [39:42<15:21,  2.57s/it, exist=0.2310, loss=0.4894, lr=5.61e-07]
Epoch 5/5:  70%|██████▉   | 819/1177 [39:44<15:21,  2.57s/it, exist=0.2310, loss=0.4893, lr=5.58e-07]
Epoch 5/5:  70%|██████▉   | 820/1177 [39:44<14:21,  2.41s/it, exist=0.2310, loss=0.4893, lr=5.58e-07]
Epoch 5/5:  70%|██████▉   | 820/1177 [39:47<14:21,  2.41s/it, exist=0.2309, loss=0.4893, lr=5.55e-07]
Epoch 5/5:  70%|██████▉   | 821/1177 [39:47<15:40,  2.64s/it, exist=0.2309, loss=0.4893, lr=5.55e-07]
Epoch 5/5:  70%|██████▉   | 821/1177 [39:51<15:40,  2.64s/it, exist=0.2312, loss=0.4895, lr=5.52e-07]
Epoch 5/5:  70%|██████▉   | 822/1177 [39:51<17:09,  2.90s/it, exist=0.2312, loss=0.4895, lr=5.52e-07]
Epoch 5/5:  70%|██████▉   | 822/1177 [39:53<17:09,  2.90s/it, exist=0.2314, loss=0.4897, lr=5.49e-07]
Epoch 5/5:  70%|██████▉   | 823/1177 [39:53<15:23,  2.61s/it, exist=0.2314, loss=0.4897, lr=5.49e-07]
Epoch 5/5:  70%|██████▉   | 823/1177 [39:56<15:23,  2.61s/it, exist=0.2314, loss=0.4897, lr=5.46e-07]
Epoch 5/5:  70%|███████   | 824/1177 [39:56<16:22,  2.78s/it, exist=0.2314, loss=0.4897, lr=5.46e-07]
Epoch 5/5:  70%|███████   | 824/1177 [39:58<16:22,  2.78s/it, exist=0.2315, loss=0.4899, lr=5.43e-07]
Epoch 5/5:  70%|███████   | 825/1177 [39:58<14:59,  2.55s/it, exist=0.2315, loss=0.4899, lr=5.43e-07]
Epoch 5/5:  70%|███████   | 825/1177 [40:00<14:59,  2.55s/it, exist=0.2314, loss=0.4898, lr=5.40e-07]
Epoch 5/5:  70%|███████   | 826/1177 [40:00<13:54,  2.38s/it, exist=0.2314, loss=0.4898, lr=5.40e-07]
Epoch 5/5:  70%|███████   | 826/1177 [40:05<13:54,  2.38s/it, exist=0.2314, loss=0.4898, lr=5.37e-07]
Epoch 5/5:  70%|███████   | 827/1177 [40:05<17:35,  3.02s/it, exist=0.2314, loss=0.4898, lr=5.37e-07]
Epoch 5/5:  70%|███████   | 827/1177 [40:10<17:35,  3.02s/it, exist=0.2312, loss=0.4896, lr=5.34e-07]
Epoch 5/5:  70%|███████   | 828/1177 [40:10<21:24,  3.68s/it, exist=0.2312, loss=0.4896, lr=5.34e-07]
Epoch 5/5:  70%|███████   | 828/1177 [40:13<21:24,  3.68s/it, exist=0.2314, loss=0.4901, lr=5.31e-07]
Epoch 5/5:  70%|███████   | 829/1177 [40:13<19:40,  3.39s/it, exist=0.2314, loss=0.4901, lr=5.31e-07]
Epoch 5/5:  70%|███████   | 829/1177 [40:16<19:40,  3.39s/it, exist=0.2315, loss=0.4901, lr=5.28e-07]
Epoch 5/5:  71%|███████   | 830/1177 [40:16<19:58,  3.45s/it, exist=0.2315, loss=0.4901, lr=5.28e-07]
Epoch 5/5:  71%|███████   | 830/1177 [40:19<19:58,  3.45s/it, exist=0.2318, loss=0.4905, lr=5.25e-07]
Epoch 5/5:  71%|███████   | 831/1177 [40:19<18:41,  3.24s/it, exist=0.2318, loss=0.4905, lr=5.25e-07]
Epoch 5/5:  71%|███████   | 831/1177 [40:23<18:41,  3.24s/it, exist=0.2319, loss=0.4904, lr=5.22e-07]
Epoch 5/5:  71%|███████   | 832/1177 [40:23<20:16,  3.53s/it, exist=0.2319, loss=0.4904, lr=5.22e-07]
Epoch 5/5:  71%|███████   | 832/1177 [40:26<20:16,  3.53s/it, exist=0.2318, loss=0.4903, lr=5.19e-07]
Epoch 5/5:  71%|███████   | 833/1177 [40:26<18:49,  3.28s/it, exist=0.2318, loss=0.4903, lr=5.19e-07]
Epoch 5/5:  71%|███████   | 833/1177 [40:29<18:49,  3.28s/it, exist=0.2317, loss=0.4902, lr=5.16e-07]
Epoch 5/5:  71%|███████   | 834/1177 [40:29<18:52,  3.30s/it, exist=0.2317, loss=0.4902, lr=5.16e-07]
Epoch 5/5:  71%|███████   | 834/1177 [40:32<18:52,  3.30s/it, exist=0.2316, loss=0.4900, lr=5.13e-07]
Epoch 5/5:  71%|███████   | 835/1177 [40:32<17:53,  3.14s/it, exist=0.2316, loss=0.4900, lr=5.13e-07]
Epoch 5/5:  71%|███████   | 835/1177 [40:35<17:53,  3.14s/it, exist=0.2316, loss=0.4901, lr=5.10e-07]
Epoch 5/5:  71%|███████   | 836/1177 [40:35<18:28,  3.25s/it, exist=0.2316, loss=0.4901, lr=5.10e-07]
Epoch 5/5:  71%|███████   | 836/1177 [40:38<18:28,  3.25s/it, exist=0.2316, loss=0.4900, lr=5.07e-07]
Epoch 5/5:  71%|███████   | 837/1177 [40:38<17:02,  3.01s/it, exist=0.2316, loss=0.4900, lr=5.07e-07]
Epoch 5/5:  71%|███████   | 837/1177 [40:40<17:02,  3.01s/it, exist=0.2314, loss=0.4899, lr=5.04e-07]
Epoch 5/5:  71%|███████   | 838/1177 [40:40<16:07,  2.85s/it, exist=0.2314, loss=0.4899, lr=5.04e-07]
Epoch 5/5:  71%|███████   | 838/1177 [40:43<16:07,  2.85s/it, exist=0.2314, loss=0.4899, lr=5.01e-07]
Epoch 5/5:  71%|███████▏  | 839/1177 [40:43<15:43,  2.79s/it, exist=0.2314, loss=0.4899, lr=5.01e-07]
Epoch 5/5:  71%|███████▏  | 839/1177 [40:46<15:43,  2.79s/it, exist=0.2313, loss=0.4898, lr=4.98e-07]
Epoch 5/5:  71%|███████▏  | 840/1177 [40:46<15:19,  2.73s/it, exist=0.2313, loss=0.4898, lr=4.98e-07]
Epoch 5/5:  71%|███████▏  | 840/1177 [40:48<15:19,  2.73s/it, exist=0.2313, loss=0.4898, lr=4.95e-07]
Epoch 5/5:  71%|███████▏  | 841/1177 [40:48<14:01,  2.50s/it, exist=0.2313, loss=0.4898, lr=4.95e-07]
Epoch 5/5:  71%|███████▏  | 841/1177 [40:50<14:01,  2.50s/it, exist=0.2312, loss=0.4897, lr=4.92e-07]
Epoch 5/5:  72%|███████▏  | 842/1177 [40:50<14:07,  2.53s/it, exist=0.2312, loss=0.4897, lr=4.92e-07]
Epoch 5/5:  72%|███████▏  | 842/1177 [40:54<14:07,  2.53s/it, exist=0.2311, loss=0.4895, lr=4.89e-07]
Epoch 5/5:  72%|███████▏  | 843/1177 [40:54<15:26,  2.77s/it, exist=0.2311, loss=0.4895, lr=4.89e-07]
Epoch 5/5:  72%|███████▏  | 843/1177 [40:56<15:26,  2.77s/it, exist=0.2317, loss=0.4901, lr=4.86e-07]
Epoch 5/5:  72%|███████▏  | 844/1177 [40:56<15:30,  2.80s/it, exist=0.2317, loss=0.4901, lr=4.86e-07]
Epoch 5/5:  72%|███████▏  | 844/1177 [41:00<15:30,  2.80s/it, exist=0.2315, loss=0.4898, lr=4.83e-07]
Epoch 5/5:  72%|███████▏  | 845/1177 [41:00<16:37,  3.01s/it, exist=0.2315, loss=0.4898, lr=4.83e-07]
Epoch 5/5:  72%|███████▏  | 845/1177 [41:04<16:37,  3.01s/it, exist=0.2315, loss=0.4898, lr=4.80e-07]
Epoch 5/5:  72%|███████▏  | 846/1177 [41:04<19:04,  3.46s/it, exist=0.2315, loss=0.4898, lr=4.80e-07]
Epoch 5/5:  72%|███████▏  | 846/1177 [41:07<19:04,  3.46s/it, exist=0.2317, loss=0.4900, lr=4.77e-07]
Epoch 5/5:  72%|███████▏  | 847/1177 [41:07<17:53,  3.25s/it, exist=0.2317, loss=0.4900, lr=4.77e-07]
Epoch 5/5:  72%|███████▏  | 847/1177 [41:12<17:53,  3.25s/it, exist=0.2316, loss=0.4900, lr=4.74e-07]
Epoch 5/5:  72%|███████▏  | 848/1177 [41:12<19:58,  3.64s/it, exist=0.2316, loss=0.4900, lr=4.74e-07]
Epoch 5/5:  72%|███████▏  | 848/1177 [41:14<19:58,  3.64s/it, exist=0.2314, loss=0.4898, lr=4.72e-07]
Epoch 5/5:  72%|███████▏  | 849/1177 [41:14<18:28,  3.38s/it, exist=0.2314, loss=0.4898, lr=4.72e-07]
Epoch 5/5:  72%|███████▏  | 849/1177 [41:19<18:28,  3.38s/it, exist=0.2315, loss=0.4898, lr=4.69e-07]
Epoch 5/5:  72%|███████▏  | 850/1177 [41:19<20:31,  3.77s/it, exist=0.2315, loss=0.4898, lr=4.69e-07]
Epoch 5/5:  72%|███████▏  | 850/1177 [41:22<20:31,  3.77s/it, exist=0.2313, loss=0.4897, lr=4.66e-07]
Epoch 5/5:  72%|███████▏  | 851/1177 [41:22<19:46,  3.64s/it, exist=0.2313, loss=0.4897, lr=4.66e-07]
Epoch 5/5:  72%|███████▏  | 851/1177 [41:30<19:46,  3.64s/it, exist=0.2311, loss=0.4894, lr=4.63e-07]
Epoch 5/5:  72%|███████▏  | 852/1177 [41:30<25:43,  4.75s/it, exist=0.2311, loss=0.4894, lr=4.63e-07]
Epoch 5/5:  72%|███████▏  | 852/1177 [41:34<25:43,  4.75s/it, exist=0.2315, loss=0.4898, lr=4.60e-07]
Epoch 5/5:  72%|███████▏  | 853/1177 [41:34<25:17,  4.68s/it, exist=0.2315, loss=0.4898, lr=4.60e-07]
Epoch 5/5:  72%|███████▏  | 853/1177 [41:38<25:17,  4.68s/it, exist=0.2313, loss=0.4897, lr=4.57e-07]
Epoch 5/5:  73%|███████▎  | 854/1177 [41:38<22:56,  4.26s/it, exist=0.2313, loss=0.4897, lr=4.57e-07]
Epoch 5/5:  73%|███████▎  | 854/1177 [41:41<22:56,  4.26s/it, exist=0.2315, loss=0.4898, lr=4.55e-07]
Epoch 5/5:  73%|███████▎  | 855/1177 [41:41<21:40,  4.04s/it, exist=0.2315, loss=0.4898, lr=4.55e-07]
Epoch 5/5:  73%|███████▎  | 855/1177 [41:45<21:40,  4.04s/it, exist=0.2313, loss=0.4896, lr=4.52e-07]
Epoch 5/5:  73%|███████▎  | 856/1177 [41:45<20:56,  3.92s/it, exist=0.2313, loss=0.4896, lr=4.52e-07]
Epoch 5/5:  73%|███████▎  | 856/1177 [41:48<20:56,  3.92s/it, exist=0.2311, loss=0.4893, lr=4.49e-07]
Epoch 5/5:  73%|███████▎  | 857/1177 [41:48<19:15,  3.61s/it, exist=0.2311, loss=0.4893, lr=4.49e-07]
Epoch 5/5:  73%|███████▎  | 857/1177 [41:51<19:15,  3.61s/it, exist=0.2309, loss=0.4890, lr=4.46e-07]
Epoch 5/5:  73%|███████▎  | 858/1177 [41:51<19:26,  3.66s/it, exist=0.2309, loss=0.4890, lr=4.46e-07]
Epoch 5/5:  73%|███████▎  | 858/1177 [41:55<19:26,  3.66s/it, exist=0.2309, loss=0.4890, lr=4.43e-07]
Epoch 5/5:  73%|███████▎  | 859/1177 [41:55<19:29,  3.68s/it, exist=0.2309, loss=0.4890, lr=4.43e-07]
Epoch 5/5:  73%|███████▎  | 859/1177 [41:57<19:29,  3.68s/it, exist=0.2311, loss=0.4891, lr=4.41e-07]
Epoch 5/5:  73%|███████▎  | 860/1177 [41:57<16:44,  3.17s/it, exist=0.2311, loss=0.4891, lr=4.41e-07]
Epoch 5/5:  73%|███████▎  | 860/1177 [42:00<16:44,  3.17s/it, exist=0.2309, loss=0.4890, lr=4.38e-07]
Epoch 5/5:  73%|███████▎  | 861/1177 [42:00<16:36,  3.15s/it, exist=0.2309, loss=0.4890, lr=4.38e-07]
Epoch 5/5:  73%|███████▎  | 861/1177 [42:02<16:36,  3.15s/it, exist=0.2307, loss=0.4887, lr=4.35e-07]
Epoch 5/5:  73%|███████▎  | 862/1177 [42:02<14:42,  2.80s/it, exist=0.2307, loss=0.4887, lr=4.35e-07]
Epoch 5/5:  73%|███████▎  | 862/1177 [42:05<14:42,  2.80s/it, exist=0.2306, loss=0.4885, lr=4.32e-07]
Epoch 5/5:  73%|███████▎  | 863/1177 [42:05<14:23,  2.75s/it, exist=0.2306, loss=0.4885, lr=4.32e-07]
Epoch 5/5:  73%|███████▎  | 863/1177 [42:07<14:23,  2.75s/it, exist=0.2306, loss=0.4886, lr=4.30e-07]
Epoch 5/5:  73%|███████▎  | 864/1177 [42:07<14:04,  2.70s/it, exist=0.2306, loss=0.4886, lr=4.30e-07]
Epoch 5/5:  73%|███████▎  | 864/1177 [42:09<14:04,  2.70s/it, exist=0.2311, loss=0.4891, lr=4.27e-07]
Epoch 5/5:  73%|███████▎  | 865/1177 [42:09<12:54,  2.48s/it, exist=0.2311, loss=0.4891, lr=4.27e-07]
Epoch 5/5:  73%|███████▎  | 865/1177 [42:12<12:54,  2.48s/it, exist=0.2310, loss=0.4890, lr=4.24e-07]
Epoch 5/5:  74%|███████▎  | 866/1177 [42:12<13:33,  2.62s/it, exist=0.2310, loss=0.4890, lr=4.24e-07]
Epoch 5/5:  74%|███████▎  | 866/1177 [42:16<13:33,  2.62s/it, exist=0.2308, loss=0.4888, lr=4.21e-07]
Epoch 5/5:  74%|███████▎  | 867/1177 [42:16<15:24,  2.98s/it, exist=0.2308, loss=0.4888, lr=4.21e-07]
Epoch 5/5:  74%|███████▎  | 867/1177 [42:20<15:24,  2.98s/it, exist=0.2308, loss=0.4888, lr=4.19e-07]
Epoch 5/5:  74%|███████▎  | 868/1177 [42:20<15:58,  3.10s/it, exist=0.2308, loss=0.4888, lr=4.19e-07]
Epoch 5/5:  74%|███████▎  | 868/1177 [42:22<15:58,  3.10s/it, exist=0.2311, loss=0.4891, lr=4.16e-07]
Epoch 5/5:  74%|███████▍  | 869/1177 [42:22<14:20,  2.79s/it, exist=0.2311, loss=0.4891, lr=4.16e-07]
Epoch 5/5:  74%|███████▍  | 869/1177 [42:25<14:20,  2.79s/it, exist=0.2310, loss=0.4890, lr=4.13e-07]
Epoch 5/5:  74%|███████▍  | 870/1177 [42:25<14:59,  2.93s/it, exist=0.2310, loss=0.4890, lr=4.13e-07]
Epoch 5/5:  74%|███████▍  | 870/1177 [42:29<14:59,  2.93s/it, exist=0.2311, loss=0.4891, lr=4.11e-07]
Epoch 5/5:  74%|███████▍  | 871/1177 [42:29<16:48,  3.29s/it, exist=0.2311, loss=0.4891, lr=4.11e-07]
Epoch 5/5:  74%|███████▍  | 871/1177 [42:33<16:48,  3.29s/it, exist=0.2312, loss=0.4891, lr=4.08e-07]
Epoch 5/5:  74%|███████▍  | 872/1177 [42:33<17:07,  3.37s/it, exist=0.2312, loss=0.4891, lr=4.08e-07]
Epoch 5/5:  74%|███████▍  | 872/1177 [42:36<17:07,  3.37s/it, exist=0.2316, loss=0.4895, lr=4.05e-07]
Epoch 5/5:  74%|███████▍  | 873/1177 [42:36<17:29,  3.45s/it, exist=0.2316, loss=0.4895, lr=4.05e-07]
Epoch 5/5:  74%|███████▍  | 873/1177 [42:39<17:29,  3.45s/it, exist=0.2314, loss=0.4894, lr=4.03e-07]
Epoch 5/5:  74%|███████▍  | 874/1177 [42:39<16:29,  3.26s/it, exist=0.2314, loss=0.4894, lr=4.03e-07]
Epoch 5/5:  74%|███████▍  | 874/1177 [42:43<16:29,  3.26s/it, exist=0.2312, loss=0.4893, lr=4.00e-07]
Epoch 5/5:  74%|███████▍  | 875/1177 [42:43<17:13,  3.42s/it, exist=0.2312, loss=0.4893, lr=4.00e-07]
Epoch 5/5:  74%|███████▍  | 875/1177 [42:48<17:13,  3.42s/it, exist=0.2314, loss=0.4894, lr=3.97e-07]
Epoch 5/5:  74%|███████▍  | 876/1177 [42:48<19:47,  3.95s/it, exist=0.2314, loss=0.4894, lr=3.97e-07]
Epoch 5/5:  74%|███████▍  | 876/1177 [42:50<19:47,  3.95s/it, exist=0.2313, loss=0.4893, lr=3.95e-07]
Epoch 5/5:  75%|███████▍  | 877/1177 [42:50<17:28,  3.50s/it, exist=0.2313, loss=0.4893, lr=3.95e-07]
Epoch 5/5:  75%|███████▍  | 877/1177 [42:53<17:28,  3.50s/it, exist=0.2313, loss=0.4893, lr=3.92e-07]
Epoch 5/5:  75%|███████▍  | 878/1177 [42:53<16:05,  3.23s/it, exist=0.2313, loss=0.4893, lr=3.92e-07]
Epoch 5/5:  75%|███████▍  | 878/1177 [42:55<16:05,  3.23s/it, exist=0.2313, loss=0.4894, lr=3.89e-07]
Epoch 5/5:  75%|███████▍  | 879/1177 [42:55<14:28,  2.91s/it, exist=0.2313, loss=0.4894, lr=3.89e-07]
Epoch 5/5:  75%|███████▍  | 879/1177 [42:58<14:28,  2.91s/it, exist=0.2313, loss=0.4893, lr=3.87e-07]
Epoch 5/5:  75%|███████▍  | 880/1177 [42:58<13:46,  2.78s/it, exist=0.2313, loss=0.4893, lr=3.87e-07]
Epoch 5/5:  75%|███████▍  | 880/1177 [43:01<13:46,  2.78s/it, exist=0.2313, loss=0.4892, lr=3.84e-07]
Epoch 5/5:  75%|███████▍  | 881/1177 [43:01<15:11,  3.08s/it, exist=0.2313, loss=0.4892, lr=3.84e-07]
Epoch 5/5:  75%|███████▍  | 881/1177 [43:04<15:11,  3.08s/it, exist=0.2311, loss=0.4891, lr=3.82e-07]
Epoch 5/5:  75%|███████▍  | 882/1177 [43:04<14:10,  2.88s/it, exist=0.2311, loss=0.4891, lr=3.82e-07]
Epoch 5/5:  75%|███████▍  | 882/1177 [43:06<14:10,  2.88s/it, exist=0.2314, loss=0.4893, lr=3.79e-07]
Epoch 5/5:  75%|███████▌  | 883/1177 [43:06<12:48,  2.61s/it, exist=0.2314, loss=0.4893, lr=3.79e-07]
Epoch 5/5:  75%|███████▌  | 883/1177 [43:09<12:48,  2.61s/it, exist=0.2312, loss=0.4891, lr=3.77e-07]
Epoch 5/5:  75%|███████▌  | 884/1177 [43:09<13:33,  2.78s/it, exist=0.2312, loss=0.4891, lr=3.77e-07]
Epoch 5/5:  75%|███████▌  | 884/1177 [43:12<13:33,  2.78s/it, exist=0.2312, loss=0.4891, lr=3.74e-07]
Epoch 5/5:  75%|███████▌  | 885/1177 [43:12<13:20,  2.74s/it, exist=0.2312, loss=0.4891, lr=3.74e-07]
Epoch 5/5:  75%|███████▌  | 885/1177 [43:14<13:20,  2.74s/it, exist=0.2313, loss=0.4891, lr=3.71e-07]
Epoch 5/5:  75%|███████▌  | 886/1177 [43:14<12:12,  2.52s/it, exist=0.2313, loss=0.4891, lr=3.71e-07]
Epoch 5/5:  75%|███████▌  | 886/1177 [43:17<12:12,  2.52s/it, exist=0.2311, loss=0.4889, lr=3.69e-07]
Epoch 5/5:  75%|███████▌  | 887/1177 [43:17<13:08,  2.72s/it, exist=0.2311, loss=0.4889, lr=3.69e-07]
Epoch 5/5:  75%|███████▌  | 887/1177 [43:19<13:08,  2.72s/it, exist=0.2311, loss=0.4889, lr=3.66e-07]
Epoch 5/5:  75%|███████▌  | 888/1177 [43:19<12:54,  2.68s/it, exist=0.2311, loss=0.4889, lr=3.66e-07]
Epoch 5/5:  75%|███████▌  | 888/1177 [43:22<12:54,  2.68s/it, exist=0.2313, loss=0.4891, lr=3.64e-07]
Epoch 5/5:  76%|███████▌  | 889/1177 [43:22<12:33,  2.62s/it, exist=0.2313, loss=0.4891, lr=3.64e-07]
Epoch 5/5:  76%|███████▌  | 889/1177 [43:24<12:33,  2.62s/it, exist=0.2313, loss=0.4890, lr=3.61e-07]
Epoch 5/5:  76%|███████▌  | 890/1177 [43:24<12:07,  2.53s/it, exist=0.2313, loss=0.4890, lr=3.61e-07]
Epoch 5/5:  76%|███████▌  | 890/1177 [43:27<12:07,  2.53s/it, exist=0.2314, loss=0.4893, lr=3.59e-07]
Epoch 5/5:  76%|███████▌  | 891/1177 [43:27<13:01,  2.73s/it, exist=0.2314, loss=0.4893, lr=3.59e-07]
Epoch 5/5:  76%|███████▌  | 891/1177 [43:29<13:01,  2.73s/it, exist=0.2316, loss=0.4894, lr=3.56e-07]
Epoch 5/5:  76%|███████▌  | 892/1177 [43:29<11:55,  2.51s/it, exist=0.2316, loss=0.4894, lr=3.56e-07]
Epoch 5/5:  76%|███████▌  | 892/1177 [43:34<11:55,  2.51s/it, exist=0.2316, loss=0.4894, lr=3.54e-07]
Epoch 5/5:  76%|███████▌  | 893/1177 [43:34<14:36,  3.09s/it, exist=0.2316, loss=0.4894, lr=3.54e-07]
Epoch 5/5:  76%|███████▌  | 893/1177 [43:38<14:36,  3.09s/it, exist=0.2315, loss=0.4893, lr=3.51e-07]
Epoch 5/5:  76%|███████▌  | 894/1177 [43:38<16:36,  3.52s/it, exist=0.2315, loss=0.4893, lr=3.51e-07]
Epoch 5/5:  76%|███████▌  | 894/1177 [43:42<16:36,  3.52s/it, exist=0.2315, loss=0.4894, lr=3.49e-07]
Epoch 5/5:  76%|███████▌  | 895/1177 [43:42<16:40,  3.55s/it, exist=0.2315, loss=0.4894, lr=3.49e-07]
Epoch 5/5:  76%|███████▌  | 895/1177 [43:46<16:40,  3.55s/it, exist=0.2317, loss=0.4896, lr=3.46e-07]
Epoch 5/5:  76%|███████▌  | 896/1177 [43:46<16:30,  3.53s/it, exist=0.2317, loss=0.4896, lr=3.46e-07]
Epoch 5/5:  76%|███████▌  | 896/1177 [43:49<16:30,  3.53s/it, exist=0.2315, loss=0.4894, lr=3.44e-07]
Epoch 5/5:  76%|███████▌  | 897/1177 [43:49<16:29,  3.53s/it, exist=0.2315, loss=0.4894, lr=3.44e-07]
Epoch 5/5:  76%|███████▌  | 897/1177 [43:53<16:29,  3.53s/it, exist=0.2313, loss=0.4893, lr=3.41e-07]
Epoch 5/5:  76%|███████▋  | 898/1177 [43:53<17:32,  3.77s/it, exist=0.2313, loss=0.4893, lr=3.41e-07]
Epoch 5/5:  76%|███████▋  | 898/1177 [43:57<17:32,  3.77s/it, exist=0.2312, loss=0.4892, lr=3.39e-07]
Epoch 5/5:  76%|███████▋  | 899/1177 [43:57<16:54,  3.65s/it, exist=0.2312, loss=0.4892, lr=3.39e-07]
Epoch 5/5:  76%|███████▋  | 899/1177 [44:00<16:54,  3.65s/it, exist=0.2311, loss=0.4890, lr=3.37e-07]
Epoch 5/5:  76%|███████▋  | 900/1177 [44:00<16:44,  3.63s/it, exist=0.2311, loss=0.4890, lr=3.37e-07]
Epoch 5/5:  76%|███████▋  | 900/1177 [44:03<16:44,  3.63s/it, exist=0.2312, loss=0.4891, lr=3.34e-07]
Epoch 5/5:  77%|███████▋  | 901/1177 [44:03<14:53,  3.24s/it, exist=0.2312, loss=0.4891, lr=3.34e-07]
Epoch 5/5:  77%|███████▋  | 901/1177 [44:06<14:53,  3.24s/it, exist=0.2311, loss=0.4890, lr=3.32e-07]
Epoch 5/5:  77%|███████▋  | 902/1177 [44:06<14:46,  3.22s/it, exist=0.2311, loss=0.4890, lr=3.32e-07]
Epoch 5/5:  77%|███████▋  | 902/1177 [44:09<14:46,  3.22s/it, exist=0.2310, loss=0.4888, lr=3.29e-07]
Epoch 5/5:  77%|███████▋  | 903/1177 [44:09<13:56,  3.05s/it, exist=0.2310, loss=0.4888, lr=3.29e-07]
Epoch 5/5:  77%|███████▋  | 903/1177 [44:11<13:56,  3.05s/it, exist=0.2309, loss=0.4887, lr=3.27e-07]
Epoch 5/5:  77%|███████▋  | 904/1177 [44:11<12:27,  2.74s/it, exist=0.2309, loss=0.4887, lr=3.27e-07]
Epoch 5/5:  77%|███████▋  | 904/1177 [44:15<12:27,  2.74s/it, exist=0.2309, loss=0.4887, lr=3.25e-07]
Epoch 5/5:  77%|███████▋  | 905/1177 [44:15<14:36,  3.22s/it, exist=0.2309, loss=0.4887, lr=3.25e-07]
Epoch 5/5:  77%|███████▋  | 905/1177 [44:18<14:36,  3.22s/it, exist=0.2307, loss=0.4885, lr=3.22e-07]
Epoch 5/5:  77%|███████▋  | 906/1177 [44:18<15:02,  3.33s/it, exist=0.2307, loss=0.4885, lr=3.22e-07]
Epoch 5/5:  77%|███████▋  | 906/1177 [44:22<15:02,  3.33s/it, exist=0.2309, loss=0.4887, lr=3.20e-07]
Epoch 5/5:  77%|███████▋  | 907/1177 [44:22<15:11,  3.38s/it, exist=0.2309, loss=0.4887, lr=3.20e-07]
Epoch 5/5:  77%|███████▋  | 907/1177 [44:24<15:11,  3.38s/it, exist=0.2308, loss=0.4886, lr=3.17e-07]
Epoch 5/5:  77%|███████▋  | 908/1177 [44:24<13:17,  2.96s/it, exist=0.2308, loss=0.4886, lr=3.17e-07]
Epoch 5/5:  77%|███████▋  | 908/1177 [44:27<13:17,  2.96s/it, exist=0.2306, loss=0.4884, lr=3.15e-07]
Epoch 5/5:  77%|███████▋  | 909/1177 [44:27<13:34,  3.04s/it, exist=0.2306, loss=0.4884, lr=3.15e-07]
Epoch 5/5:  77%|███████▋  | 909/1177 [44:31<13:34,  3.04s/it, exist=0.2306, loss=0.4884, lr=3.13e-07]
Epoch 5/5:  77%|███████▋  | 910/1177 [44:31<14:14,  3.20s/it, exist=0.2306, loss=0.4884, lr=3.13e-07]
Epoch 5/5:  77%|███████▋  | 910/1177 [44:33<14:14,  3.20s/it, exist=0.2310, loss=0.4888, lr=3.10e-07]
Epoch 5/5:  77%|███████▋  | 911/1177 [44:33<13:14,  2.99s/it, exist=0.2310, loss=0.4888, lr=3.10e-07]
Epoch 5/5:  77%|███████▋  | 911/1177 [44:35<13:14,  2.99s/it, exist=0.2312, loss=0.4891, lr=3.08e-07]
Epoch 5/5:  77%|███████▋  | 912/1177 [44:35<11:53,  2.69s/it, exist=0.2312, loss=0.4891, lr=3.08e-07]
Epoch 5/5:  77%|███████▋  | 912/1177 [44:38<11:53,  2.69s/it, exist=0.2311, loss=0.4889, lr=3.06e-07]
Epoch 5/5:  78%|███████▊  | 913/1177 [44:38<11:37,  2.64s/it, exist=0.2311, loss=0.4889, lr=3.06e-07]
Epoch 5/5:  78%|███████▊  | 913/1177 [44:42<11:37,  2.64s/it, exist=0.2309, loss=0.4888, lr=3.04e-07]
Epoch 5/5:  78%|███████▊  | 914/1177 [44:42<13:47,  3.15s/it, exist=0.2309, loss=0.4888, lr=3.04e-07]
Epoch 5/5:  78%|███████▊  | 914/1177 [44:45<13:47,  3.15s/it, exist=0.2308, loss=0.4887, lr=3.01e-07]
Epoch 5/5:  78%|███████▊  | 915/1177 [44:45<12:59,  2.97s/it, exist=0.2308, loss=0.4887, lr=3.01e-07]
Epoch 5/5:  78%|███████▊  | 915/1177 [44:49<12:59,  2.97s/it, exist=0.2308, loss=0.4887, lr=2.99e-07]
Epoch 5/5:  78%|███████▊  | 916/1177 [44:49<15:14,  3.51s/it, exist=0.2308, loss=0.4887, lr=2.99e-07]
Epoch 5/5:  78%|███████▊  | 916/1177 [44:54<15:14,  3.51s/it, exist=0.2309, loss=0.4887, lr=2.97e-07]
Epoch 5/5:  78%|███████▊  | 917/1177 [44:54<16:11,  3.74s/it, exist=0.2309, loss=0.4887, lr=2.97e-07]
Epoch 5/5:  78%|███████▊  | 917/1177 [44:56<16:11,  3.74s/it, exist=0.2310, loss=0.4889, lr=2.94e-07]
Epoch 5/5:  78%|███████▊  | 918/1177 [44:56<14:35,  3.38s/it, exist=0.2310, loss=0.4889, lr=2.94e-07]
Epoch 5/5:  78%|███████▊  | 918/1177 [44:58<14:35,  3.38s/it, exist=0.2308, loss=0.4887, lr=2.92e-07]
Epoch 5/5:  78%|███████▊  | 919/1177 [44:58<12:55,  3.01s/it, exist=0.2308, loss=0.4887, lr=2.92e-07]
Epoch 5/5:  78%|███████▊  | 919/1177 [45:01<12:55,  3.01s/it, exist=0.2306, loss=0.4884, lr=2.90e-07]
Epoch 5/5:  78%|███████▊  | 920/1177 [45:01<12:23,  2.89s/it, exist=0.2306, loss=0.4884, lr=2.90e-07]
Epoch 5/5:  78%|███████▊  | 920/1177 [45:03<12:23,  2.89s/it, exist=0.2307, loss=0.4884, lr=2.88e-07]
Epoch 5/5:  78%|███████▊  | 921/1177 [45:03<11:08,  2.61s/it, exist=0.2307, loss=0.4884, lr=2.88e-07]
Epoch 5/5:  78%|███████▊  | 921/1177 [45:06<11:08,  2.61s/it, exist=0.2305, loss=0.4882, lr=2.85e-07]
Epoch 5/5:  78%|███████▊  | 922/1177 [45:06<11:40,  2.75s/it, exist=0.2305, loss=0.4882, lr=2.85e-07]
Epoch 5/5:  78%|███████▊  | 922/1177 [45:09<11:40,  2.75s/it, exist=0.2308, loss=0.4885, lr=2.83e-07]
Epoch 5/5:  78%|███████▊  | 923/1177 [45:09<12:30,  2.95s/it, exist=0.2308, loss=0.4885, lr=2.83e-07]
Epoch 5/5:  78%|███████▊  | 923/1177 [45:13<12:30,  2.95s/it, exist=0.2314, loss=0.4890, lr=2.81e-07]
Epoch 5/5:  79%|███████▊  | 924/1177 [45:13<13:13,  3.14s/it, exist=0.2314, loss=0.4890, lr=2.81e-07]
Epoch 5/5:  79%|███████▊  | 924/1177 [45:17<13:13,  3.14s/it, exist=0.2317, loss=0.4893, lr=2.79e-07]
Epoch 5/5:  79%|███████▊  | 925/1177 [45:17<13:54,  3.31s/it, exist=0.2317, loss=0.4893, lr=2.79e-07]
Epoch 5/5:  79%|███████▊  | 925/1177 [45:20<13:54,  3.31s/it, exist=0.2318, loss=0.4895, lr=2.76e-07]
Epoch 5/5:  79%|███████▊  | 926/1177 [45:20<14:22,  3.44s/it, exist=0.2318, loss=0.4895, lr=2.76e-07]
Epoch 5/5:  79%|███████▊  | 926/1177 [45:24<14:22,  3.44s/it, exist=0.2317, loss=0.4894, lr=2.74e-07]
Epoch 5/5:  79%|███████▉  | 927/1177 [45:24<14:25,  3.46s/it, exist=0.2317, loss=0.4894, lr=2.74e-07]
Epoch 5/5:  79%|███████▉  | 927/1177 [45:28<14:25,  3.46s/it, exist=0.2318, loss=0.4895, lr=2.72e-07]
Epoch 5/5:  79%|███████▉  | 928/1177 [45:28<14:31,  3.50s/it, exist=0.2318, loss=0.4895, lr=2.72e-07]
Epoch 5/5:  79%|███████▉  | 928/1177 [45:31<14:31,  3.50s/it, exist=0.2317, loss=0.4893, lr=2.70e-07]
Epoch 5/5:  79%|███████▉  | 929/1177 [45:31<14:07,  3.42s/it, exist=0.2317, loss=0.4893, lr=2.70e-07]
Epoch 5/5:  79%|███████▉  | 929/1177 [45:33<14:07,  3.42s/it, exist=0.2317, loss=0.4893, lr=2.68e-07]
Epoch 5/5:  79%|███████▉  | 930/1177 [45:33<12:57,  3.15s/it, exist=0.2317, loss=0.4893, lr=2.68e-07]
Epoch 5/5:  79%|███████▉  | 930/1177 [45:36<12:57,  3.15s/it, exist=0.2315, loss=0.4891, lr=2.66e-07]
Epoch 5/5:  79%|███████▉  | 931/1177 [45:36<12:08,  2.96s/it, exist=0.2315, loss=0.4891, lr=2.66e-07]
Epoch 5/5:  79%|███████▉  | 931/1177 [45:38<12:08,  2.96s/it, exist=0.2314, loss=0.4889, lr=2.63e-07]
Epoch 5/5:  79%|███████▉  | 932/1177 [45:38<10:49,  2.65s/it, exist=0.2314, loss=0.4889, lr=2.63e-07]
Epoch 5/5:  79%|███████▉  | 932/1177 [45:42<10:49,  2.65s/it, exist=0.2312, loss=0.4887, lr=2.61e-07]
Epoch 5/5:  79%|███████▉  | 933/1177 [45:42<12:38,  3.11s/it, exist=0.2312, loss=0.4887, lr=2.61e-07]
Epoch 5/5:  79%|███████▉  | 933/1177 [45:45<12:38,  3.11s/it, exist=0.2311, loss=0.4885, lr=2.59e-07]
Epoch 5/5:  79%|███████▉  | 934/1177 [45:45<12:33,  3.10s/it, exist=0.2311, loss=0.4885, lr=2.59e-07]
Epoch 5/5:  79%|███████▉  | 934/1177 [45:49<12:33,  3.10s/it, exist=0.2309, loss=0.4884, lr=2.57e-07]
Epoch 5/5:  79%|███████▉  | 935/1177 [45:49<13:24,  3.32s/it, exist=0.2309, loss=0.4884, lr=2.57e-07]
Epoch 5/5:  79%|███████▉  | 935/1177 [45:52<13:24,  3.32s/it, exist=0.2309, loss=0.4884, lr=2.55e-07]
Epoch 5/5:  80%|███████▉  | 936/1177 [45:52<12:42,  3.16s/it, exist=0.2309, loss=0.4884, lr=2.55e-07]
Epoch 5/5:  80%|███████▉  | 936/1177 [45:54<12:42,  3.16s/it, exist=0.2309, loss=0.4884, lr=2.53e-07]
Epoch 5/5:  80%|███████▉  | 937/1177 [45:54<12:03,  3.01s/it, exist=0.2309, loss=0.4884, lr=2.53e-07]
Epoch 5/5:  80%|███████▉  | 937/1177 [45:57<12:03,  3.01s/it, exist=0.2310, loss=0.4885, lr=2.51e-07]
Epoch 5/5:  80%|███████▉  | 938/1177 [45:57<11:52,  2.98s/it, exist=0.2310, loss=0.4885, lr=2.51e-07]
Epoch 5/5:  80%|███████▉  | 938/1177 [45:59<11:52,  2.98s/it, exist=0.2312, loss=0.4887, lr=2.49e-07]
Epoch 5/5:  80%|███████▉  | 939/1177 [45:59<10:38,  2.68s/it, exist=0.2312, loss=0.4887, lr=2.49e-07]
Epoch 5/5:  80%|███████▉  | 939/1177 [46:02<10:38,  2.68s/it, exist=0.2312, loss=0.4887, lr=2.47e-07]
Epoch 5/5:  80%|███████▉  | 940/1177 [46:02<10:19,  2.61s/it, exist=0.2312, loss=0.4887, lr=2.47e-07]
Epoch 5/5:  80%|███████▉  | 940/1177 [46:05<10:19,  2.61s/it, exist=0.2310, loss=0.4886, lr=2.44e-07]
Epoch 5/5:  80%|███████▉  | 941/1177 [46:05<11:19,  2.88s/it, exist=0.2310, loss=0.4886, lr=2.44e-07]
Epoch 5/5:  80%|███████▉  | 941/1177 [46:09<11:19,  2.88s/it, exist=0.2309, loss=0.4884, lr=2.42e-07]
Epoch 5/5:  80%|████████  | 942/1177 [46:09<12:48,  3.27s/it, exist=0.2309, loss=0.4884, lr=2.42e-07]
Epoch 5/5:  80%|████████  | 942/1177 [46:13<12:48,  3.27s/it, exist=0.2307, loss=0.4882, lr=2.40e-07]
Epoch 5/5:  80%|████████  | 943/1177 [46:13<13:15,  3.40s/it, exist=0.2307, loss=0.4882, lr=2.40e-07]
Epoch 5/5:  80%|████████  | 943/1177 [46:17<13:15,  3.40s/it, exist=0.2308, loss=0.4883, lr=2.38e-07]
Epoch 5/5:  80%|████████  | 944/1177 [46:17<13:33,  3.49s/it, exist=0.2308, loss=0.4883, lr=2.38e-07]
Epoch 5/5:  80%|████████  | 944/1177 [46:19<13:33,  3.49s/it, exist=0.2309, loss=0.4885, lr=2.36e-07]
Epoch 5/5:  80%|████████  | 945/1177 [46:19<12:34,  3.25s/it, exist=0.2309, loss=0.4885, lr=2.36e-07]
Epoch 5/5:  80%|████████  | 945/1177 [46:24<12:34,  3.25s/it, exist=0.2310, loss=0.4886, lr=2.34e-07]
Epoch 5/5:  80%|████████  | 946/1177 [46:24<13:57,  3.63s/it, exist=0.2310, loss=0.4886, lr=2.34e-07]
Epoch 5/5:  80%|████████  | 946/1177 [46:27<13:57,  3.63s/it, exist=0.2308, loss=0.4885, lr=2.32e-07]
Epoch 5/5:  80%|████████  | 947/1177 [46:27<13:12,  3.45s/it, exist=0.2308, loss=0.4885, lr=2.32e-07]
Epoch 5/5:  80%|████████  | 947/1177 [46:30<13:12,  3.45s/it, exist=0.2308, loss=0.4885, lr=2.30e-07]
Epoch 5/5:  81%|████████  | 948/1177 [46:30<13:13,  3.47s/it, exist=0.2308, loss=0.4885, lr=2.30e-07]
Epoch 5/5:  81%|████████  | 948/1177 [46:33<13:13,  3.47s/it, exist=0.2307, loss=0.4885, lr=2.28e-07]
Epoch 5/5:  81%|████████  | 949/1177 [46:33<12:20,  3.25s/it, exist=0.2307, loss=0.4885, lr=2.28e-07]
Epoch 5/5:  81%|████████  | 949/1177 [46:38<12:20,  3.25s/it, exist=0.2307, loss=0.4884, lr=2.26e-07]
Epoch 5/5:  81%|████████  | 950/1177 [46:38<13:31,  3.57s/it, exist=0.2307, loss=0.4884, lr=2.26e-07]
Epoch 5/5:  81%|████████  | 950/1177 [46:40<13:31,  3.57s/it, exist=0.2306, loss=0.4882, lr=2.24e-07]
Epoch 5/5:  81%|████████  | 951/1177 [46:40<12:10,  3.23s/it, exist=0.2306, loss=0.4882, lr=2.24e-07]
Epoch 5/5:  81%|████████  | 951/1177 [46:42<12:10,  3.23s/it, exist=0.2308, loss=0.4884, lr=2.22e-07]
Epoch 5/5:  81%|████████  | 952/1177 [46:42<10:45,  2.87s/it, exist=0.2308, loss=0.4884, lr=2.22e-07]
Epoch 5/5:  81%|████████  | 952/1177 [46:45<10:45,  2.87s/it, exist=0.2309, loss=0.4886, lr=2.20e-07]
Epoch 5/5:  81%|████████  | 953/1177 [46:45<10:28,  2.81s/it, exist=0.2309, loss=0.4886, lr=2.20e-07]
Epoch 5/5:  81%|████████  | 953/1177 [46:49<10:28,  2.81s/it, exist=0.2309, loss=0.4886, lr=2.18e-07]
Epoch 5/5:  81%|████████  | 954/1177 [46:49<11:42,  3.15s/it, exist=0.2309, loss=0.4886, lr=2.18e-07]
Epoch 5/5:  81%|████████  | 954/1177 [46:51<11:42,  3.15s/it, exist=0.2311, loss=0.4888, lr=2.16e-07]
Epoch 5/5:  81%|████████  | 955/1177 [46:51<11:14,  3.04s/it, exist=0.2311, loss=0.4888, lr=2.16e-07]
Epoch 5/5:  81%|████████  | 955/1177 [46:54<11:14,  3.04s/it, exist=0.2312, loss=0.4888, lr=2.14e-07]
Epoch 5/5:  81%|████████  | 956/1177 [46:54<10:51,  2.95s/it, exist=0.2312, loss=0.4888, lr=2.14e-07]
Epoch 5/5:  81%|████████  | 956/1177 [46:57<10:51,  2.95s/it, exist=0.2311, loss=0.4888, lr=2.13e-07]
Epoch 5/5:  81%|████████▏ | 957/1177 [46:57<10:27,  2.85s/it, exist=0.2311, loss=0.4888, lr=2.13e-07]
Epoch 5/5:  81%|████████▏ | 957/1177 [47:01<10:27,  2.85s/it, exist=0.2310, loss=0.4886, lr=2.11e-07]
Epoch 5/5:  81%|████████▏ | 958/1177 [47:01<12:12,  3.35s/it, exist=0.2310, loss=0.4886, lr=2.11e-07]
Epoch 5/5:  81%|████████▏ | 958/1177 [47:05<12:12,  3.35s/it, exist=0.2310, loss=0.4886, lr=2.09e-07]
Epoch 5/5:  81%|████████▏ | 959/1177 [47:05<12:18,  3.39s/it, exist=0.2310, loss=0.4886, lr=2.09e-07]
Epoch 5/5:  81%|████████▏ | 959/1177 [47:08<12:18,  3.39s/it, exist=0.2309, loss=0.4884, lr=2.07e-07]
Epoch 5/5:  82%|████████▏ | 960/1177 [47:08<12:33,  3.47s/it, exist=0.2309, loss=0.4884, lr=2.07e-07]
Epoch 5/5:  82%|████████▏ | 960/1177 [47:12<12:33,  3.47s/it, exist=0.2310, loss=0.4885, lr=2.05e-07]
Epoch 5/5:  82%|████████▏ | 961/1177 [47:12<12:27,  3.46s/it, exist=0.2310, loss=0.4885, lr=2.05e-07]
Epoch 5/5:  82%|████████▏ | 961/1177 [47:15<12:27,  3.46s/it, exist=0.2310, loss=0.4885, lr=2.03e-07]
Epoch 5/5:  82%|████████▏ | 962/1177 [47:15<12:08,  3.39s/it, exist=0.2310, loss=0.4885, lr=2.03e-07]
Epoch 5/5:  82%|████████▏ | 962/1177 [47:18<12:08,  3.39s/it, exist=0.2311, loss=0.4886, lr=2.01e-07]
Epoch 5/5:  82%|████████▏ | 963/1177 [47:18<11:20,  3.18s/it, exist=0.2311, loss=0.4886, lr=2.01e-07]
Epoch 5/5:  82%|████████▏ | 963/1177 [47:21<11:20,  3.18s/it, exist=0.2311, loss=0.4885, lr=1.99e-07]
Epoch 5/5:  82%|████████▏ | 964/1177 [47:21<11:39,  3.28s/it, exist=0.2311, loss=0.4885, lr=1.99e-07]
Epoch 5/5:  82%|████████▏ | 964/1177 [47:26<11:39,  3.28s/it, exist=0.2314, loss=0.4887, lr=1.97e-07]
Epoch 5/5:  82%|████████▏ | 965/1177 [47:26<13:04,  3.70s/it, exist=0.2314, loss=0.4887, lr=1.97e-07]
Epoch 5/5:  82%|████████▏ | 965/1177 [47:29<13:04,  3.70s/it, exist=0.2314, loss=0.4888, lr=1.96e-07]
Epoch 5/5:  82%|████████▏ | 966/1177 [47:29<11:56,  3.40s/it, exist=0.2314, loss=0.4888, lr=1.96e-07]
Epoch 5/5:  82%|████████▏ | 966/1177 [47:33<11:56,  3.40s/it, exist=0.2312, loss=0.4888, lr=1.94e-07]
Epoch 5/5:  82%|████████▏ | 967/1177 [47:33<12:57,  3.70s/it, exist=0.2312, loss=0.4888, lr=1.94e-07]
Epoch 5/5:  82%|████████▏ | 967/1177 [47:36<12:57,  3.70s/it, exist=0.2311, loss=0.4886, lr=1.92e-07]
Epoch 5/5:  82%|████████▏ | 968/1177 [47:36<11:49,  3.39s/it, exist=0.2311, loss=0.4886, lr=1.92e-07]
Epoch 5/5:  82%|████████▏ | 968/1177 [47:39<11:49,  3.39s/it, exist=0.2311, loss=0.4885, lr=1.90e-07]
Epoch 5/5:  82%|████████▏ | 969/1177 [47:39<11:37,  3.35s/it, exist=0.2311, loss=0.4885, lr=1.90e-07]
Epoch 5/5:  82%|████████▏ | 969/1177 [47:41<11:37,  3.35s/it, exist=0.2309, loss=0.4883, lr=1.88e-07]
Epoch 5/5:  82%|████████▏ | 970/1177 [47:41<10:10,  2.95s/it, exist=0.2309, loss=0.4883, lr=1.88e-07]
Epoch 5/5:  82%|████████▏ | 970/1177 [47:44<10:10,  2.95s/it, exist=0.2310, loss=0.4883, lr=1.86e-07]
Epoch 5/5:  82%|████████▏ | 971/1177 [47:44<10:06,  2.95s/it, exist=0.2310, loss=0.4883, lr=1.86e-07]
Epoch 5/5:  82%|████████▏ | 971/1177 [47:47<10:06,  2.95s/it, exist=0.2309, loss=0.4882, lr=1.85e-07]
Epoch 5/5:  83%|████████▎ | 972/1177 [47:47<10:20,  3.03s/it, exist=0.2309, loss=0.4882, lr=1.85e-07]
Epoch 5/5:  83%|████████▎ | 972/1177 [47:51<10:20,  3.03s/it, exist=0.2307, loss=0.4880, lr=1.83e-07]
Epoch 5/5:  83%|████████▎ | 973/1177 [47:51<11:06,  3.27s/it, exist=0.2307, loss=0.4880, lr=1.83e-07]
Epoch 5/5:  83%|████████▎ | 973/1177 [47:54<11:06,  3.27s/it, exist=0.2309, loss=0.4881, lr=1.81e-07]
Epoch 5/5:  83%|████████▎ | 974/1177 [47:54<10:22,  3.07s/it, exist=0.2309, loss=0.4881, lr=1.81e-07]
Epoch 5/5:  83%|████████▎ | 974/1177 [47:56<10:22,  3.07s/it, exist=0.2309, loss=0.4881, lr=1.79e-07]
Epoch 5/5:  83%|████████▎ | 975/1177 [47:56<09:14,  2.75s/it, exist=0.2309, loss=0.4881, lr=1.79e-07]
Epoch 5/5:  83%|████████▎ | 975/1177 [47:58<09:14,  2.75s/it, exist=0.2310, loss=0.4881, lr=1.77e-07]
Epoch 5/5:  83%|████████▎ | 976/1177 [47:58<09:09,  2.73s/it, exist=0.2310, loss=0.4881, lr=1.77e-07]
Epoch 5/5:  83%|████████▎ | 976/1177 [48:01<09:09,  2.73s/it, exist=0.2311, loss=0.4884, lr=1.76e-07]
Epoch 5/5:  83%|████████▎ | 977/1177 [48:01<09:00,  2.70s/it, exist=0.2311, loss=0.4884, lr=1.76e-07]
Epoch 5/5:  83%|████████▎ | 977/1177 [48:04<09:00,  2.70s/it, exist=0.2310, loss=0.4883, lr=1.74e-07]
Epoch 5/5:  83%|████████▎ | 978/1177 [48:04<08:54,  2.68s/it, exist=0.2310, loss=0.4883, lr=1.74e-07]
Epoch 5/5:  83%|████████▎ | 978/1177 [48:07<08:54,  2.68s/it, exist=0.2309, loss=0.4883, lr=1.72e-07]
Epoch 5/5:  83%|████████▎ | 979/1177 [48:07<09:20,  2.83s/it, exist=0.2309, loss=0.4883, lr=1.72e-07]
Epoch 5/5:  83%|████████▎ | 979/1177 [48:11<09:20,  2.83s/it, exist=0.2307, loss=0.4881, lr=1.70e-07]
Epoch 5/5:  83%|████████▎ | 980/1177 [48:11<10:52,  3.31s/it, exist=0.2307, loss=0.4881, lr=1.70e-07]
Epoch 5/5:  83%|████████▎ | 980/1177 [48:16<10:52,  3.31s/it, exist=0.2309, loss=0.4882, lr=1.69e-07]
Epoch 5/5:  83%|████████▎ | 981/1177 [48:16<12:13,  3.74s/it, exist=0.2309, loss=0.4882, lr=1.69e-07]
Epoch 5/5:  83%|████████▎ | 981/1177 [48:19<12:13,  3.74s/it, exist=0.2310, loss=0.4885, lr=1.67e-07]
Epoch 5/5:  83%|████████▎ | 982/1177 [48:19<11:08,  3.43s/it, exist=0.2310, loss=0.4885, lr=1.67e-07]
Epoch 5/5:  83%|████████▎ | 982/1177 [48:21<11:08,  3.43s/it, exist=0.2310, loss=0.4884, lr=1.65e-07]
Epoch 5/5:  84%|████████▎ | 983/1177 [48:21<09:42,  3.00s/it, exist=0.2310, loss=0.4884, lr=1.65e-07]
Epoch 5/5:  84%|████████▎ | 983/1177 [48:23<09:42,  3.00s/it, exist=0.2308, loss=0.4882, lr=1.64e-07]
Epoch 5/5:  84%|████████▎ | 984/1177 [48:23<09:12,  2.86s/it, exist=0.2308, loss=0.4882, lr=1.64e-07]
Epoch 5/5:  84%|████████▎ | 984/1177 [48:27<09:12,  2.86s/it, exist=0.2307, loss=0.4880, lr=1.62e-07]
Epoch 5/5:  84%|████████▎ | 985/1177 [48:27<10:08,  3.17s/it, exist=0.2307, loss=0.4880, lr=1.62e-07]
Epoch 5/5:  84%|████████▎ | 985/1177 [48:31<10:08,  3.17s/it, exist=0.2307, loss=0.4880, lr=1.60e-07]
Epoch 5/5:  84%|████████▍ | 986/1177 [48:31<11:06,  3.49s/it, exist=0.2307, loss=0.4880, lr=1.60e-07]
Epoch 5/5:  84%|████████▍ | 986/1177 [48:34<11:06,  3.49s/it, exist=0.2308, loss=0.4881, lr=1.59e-07]
Epoch 5/5:  84%|████████▍ | 987/1177 [48:34<10:24,  3.29s/it, exist=0.2308, loss=0.4881, lr=1.59e-07]
Epoch 5/5:  84%|████████▍ | 987/1177 [48:38<10:24,  3.29s/it, exist=0.2309, loss=0.4882, lr=1.57e-07]
Epoch 5/5:  84%|████████▍ | 988/1177 [48:38<11:00,  3.50s/it, exist=0.2309, loss=0.4882, lr=1.57e-07]
Epoch 5/5:  84%|████████▍ | 988/1177 [48:41<11:00,  3.50s/it, exist=0.2310, loss=0.4882, lr=1.55e-07]
Epoch 5/5:  84%|████████▍ | 989/1177 [48:41<10:35,  3.38s/it, exist=0.2310, loss=0.4882, lr=1.55e-07]
Epoch 5/5:  84%|████████▍ | 989/1177 [48:44<10:35,  3.38s/it, exist=0.2311, loss=0.4884, lr=1.54e-07]
Epoch 5/5:  84%|████████▍ | 990/1177 [48:44<10:09,  3.26s/it, exist=0.2311, loss=0.4884, lr=1.54e-07]
Epoch 5/5:  84%|████████▍ | 990/1177 [48:47<10:09,  3.26s/it, exist=0.2312, loss=0.4885, lr=1.52e-07]
Epoch 5/5:  84%|████████▍ | 991/1177 [48:47<09:16,  2.99s/it, exist=0.2312, loss=0.4885, lr=1.52e-07]
Epoch 5/5:  84%|████████▍ | 991/1177 [48:48<09:16,  2.99s/it, exist=0.2315, loss=0.4888, lr=1.50e-07]
Epoch 5/5:  84%|████████▍ | 992/1177 [48:48<08:16,  2.68s/it, exist=0.2315, loss=0.4888, lr=1.50e-07]
Epoch 5/5:  84%|████████▍ | 992/1177 [48:51<08:16,  2.68s/it, exist=0.2315, loss=0.4888, lr=1.49e-07]
Epoch 5/5:  84%|████████▍ | 993/1177 [48:51<08:22,  2.73s/it, exist=0.2315, loss=0.4888, lr=1.49e-07]
Epoch 5/5:  84%|████████▍ | 993/1177 [48:54<08:22,  2.73s/it, exist=0.2314, loss=0.4886, lr=1.47e-07]
Epoch 5/5:  84%|████████▍ | 994/1177 [48:54<08:43,  2.86s/it, exist=0.2314, loss=0.4886, lr=1.47e-07]
Epoch 5/5:  84%|████████▍ | 994/1177 [48:58<08:43,  2.86s/it, exist=0.2315, loss=0.4887, lr=1.46e-07]
Epoch 5/5:  85%|████████▍ | 995/1177 [48:58<08:59,  2.96s/it, exist=0.2315, loss=0.4887, lr=1.46e-07]
Epoch 5/5:  85%|████████▍ | 995/1177 [49:02<08:59,  2.96s/it, exist=0.2316, loss=0.4888, lr=1.44e-07]
Epoch 5/5:  85%|████████▍ | 996/1177 [49:02<10:01,  3.32s/it, exist=0.2316, loss=0.4888, lr=1.44e-07]
Epoch 5/5:  85%|████████▍ | 996/1177 [49:05<10:01,  3.32s/it, exist=0.2315, loss=0.4887, lr=1.42e-07]
Epoch 5/5:  85%|████████▍ | 997/1177 [49:05<09:26,  3.15s/it, exist=0.2315, loss=0.4887, lr=1.42e-07]
Epoch 5/5:  85%|████████▍ | 997/1177 [49:09<09:26,  3.15s/it, exist=0.2316, loss=0.4889, lr=1.41e-07]
Epoch 5/5:  85%|████████▍ | 998/1177 [49:09<10:42,  3.59s/it, exist=0.2316, loss=0.4889, lr=1.41e-07]
Epoch 5/5:  85%|████████▍ | 998/1177 [49:12<10:42,  3.59s/it, exist=0.2315, loss=0.4888, lr=1.39e-07]
Epoch 5/5:  85%|████████▍ | 999/1177 [49:12<09:31,  3.21s/it, exist=0.2315, loss=0.4888, lr=1.39e-07]
Epoch 5/5:  85%|████████▍ | 999/1177 [49:15<09:31,  3.21s/it, exist=0.2313, loss=0.4887, lr=1.38e-07]
Epoch 5/5:  85%|████████▍ | 1000/1177 [49:15<09:40,  3.28s/it, exist=0.2313, loss=0.4887, lr=1.38e-07]
Epoch 5/5:  85%|████████▍ | 1000/1177 [49:18<09:40,  3.28s/it, exist=0.2312, loss=0.4886, lr=1.36e-07]
Epoch 5/5:  85%|████████▌ | 1001/1177 [49:18<09:09,  3.12s/it, exist=0.2312, loss=0.4886, lr=1.36e-07]
Epoch 5/5:  85%|████████▌ | 1001/1177 [49:22<09:09,  3.12s/it, exist=0.2311, loss=0.4885, lr=1.35e-07]
Epoch 5/5:  85%|████████▌ | 1002/1177 [49:22<09:53,  3.39s/it, exist=0.2311, loss=0.4885, lr=1.35e-07]
Epoch 5/5:  85%|████████▌ | 1002/1177 [49:24<09:53,  3.39s/it, exist=0.2312, loss=0.4887, lr=1.33e-07]
Epoch 5/5:  85%|████████▌ | 1003/1177 [49:24<09:08,  3.15s/it, exist=0.2312, loss=0.4887, lr=1.33e-07]
Epoch 5/5:  85%|████████▌ | 1003/1177 [49:27<09:08,  3.15s/it, exist=0.2315, loss=0.4889, lr=1.31e-07]
Epoch 5/5:  85%|████████▌ | 1004/1177 [49:27<08:59,  3.12s/it, exist=0.2315, loss=0.4889, lr=1.31e-07]
Epoch 5/5:  85%|████████▌ | 1004/1177 [49:31<08:59,  3.12s/it, exist=0.2314, loss=0.4889, lr=1.30e-07]
Epoch 5/5:  85%|████████▌ | 1005/1177 [49:31<09:25,  3.29s/it, exist=0.2314, loss=0.4889, lr=1.30e-07]
Epoch 5/5:  85%|████████▌ | 1005/1177 [49:35<09:25,  3.29s/it, exist=0.2313, loss=0.4887, lr=1.28e-07]
Epoch 5/5:  85%|████████▌ | 1006/1177 [49:35<09:34,  3.36s/it, exist=0.2313, loss=0.4887, lr=1.28e-07]
Epoch 5/5:  85%|████████▌ | 1006/1177 [49:37<09:34,  3.36s/it, exist=0.2315, loss=0.4889, lr=1.27e-07]
Epoch 5/5:  86%|████████▌ | 1007/1177 [49:37<09:01,  3.18s/it, exist=0.2315, loss=0.4889, lr=1.27e-07]
Epoch 5/5:  86%|████████▌ | 1007/1177 [49:39<09:01,  3.18s/it, exist=0.2318, loss=0.4892, lr=1.25e-07]
Epoch 5/5:  86%|████████▌ | 1008/1177 [49:39<07:55,  2.81s/it, exist=0.2318, loss=0.4892, lr=1.25e-07]
Epoch 5/5:  86%|████████▌ | 1008/1177 [49:43<07:55,  2.81s/it, exist=0.2318, loss=0.4892, lr=1.24e-07]
Epoch 5/5:  86%|████████▌ | 1009/1177 [49:43<08:28,  3.03s/it, exist=0.2318, loss=0.4892, lr=1.24e-07]
Epoch 5/5:  86%|████████▌ | 1009/1177 [49:47<08:28,  3.03s/it, exist=0.2317, loss=0.4891, lr=1.23e-07]
Epoch 5/5:  86%|████████▌ | 1010/1177 [49:47<09:36,  3.45s/it, exist=0.2317, loss=0.4891, lr=1.23e-07]
Epoch 5/5:  86%|████████▌ | 1010/1177 [49:50<09:36,  3.45s/it, exist=0.2317, loss=0.4891, lr=1.21e-07]
Epoch 5/5:  86%|████████▌ | 1011/1177 [49:50<08:56,  3.23s/it, exist=0.2317, loss=0.4891, lr=1.21e-07]
Epoch 5/5:  86%|████████▌ | 1011/1177 [49:53<08:56,  3.23s/it, exist=0.2316, loss=0.4890, lr=1.20e-07]
Epoch 5/5:  86%|████████▌ | 1012/1177 [49:53<08:23,  3.05s/it, exist=0.2316, loss=0.4890, lr=1.20e-07]
Epoch 5/5:  86%|████████▌ | 1012/1177 [49:55<08:23,  3.05s/it, exist=0.2315, loss=0.4890, lr=1.18e-07]
Epoch 5/5:  86%|████████▌ | 1013/1177 [49:55<07:29,  2.74s/it, exist=0.2315, loss=0.4890, lr=1.18e-07]
Epoch 5/5:  86%|████████▌ | 1013/1177 [49:58<07:29,  2.74s/it, exist=0.2313, loss=0.4888, lr=1.17e-07]
Epoch 5/5:  86%|████████▌ | 1014/1177 [49:58<07:47,  2.87s/it, exist=0.2313, loss=0.4888, lr=1.17e-07]
Epoch 5/5:  86%|████████▌ | 1014/1177 [50:00<07:47,  2.87s/it, exist=0.2312, loss=0.4886, lr=1.15e-07]
Epoch 5/5:  86%|████████▌ | 1015/1177 [50:00<07:32,  2.79s/it, exist=0.2312, loss=0.4886, lr=1.15e-07]
Epoch 5/5:  86%|████████▌ | 1015/1177 [50:02<07:32,  2.79s/it, exist=0.2315, loss=0.4889, lr=1.14e-07]
Epoch 5/5:  86%|████████▋ | 1016/1177 [50:02<06:46,  2.53s/it, exist=0.2315, loss=0.4889, lr=1.14e-07]
Epoch 5/5:  86%|████████▋ | 1016/1177 [50:06<06:46,  2.53s/it, exist=0.2314, loss=0.4888, lr=1.12e-07]
Epoch 5/5:  86%|████████▋ | 1017/1177 [50:06<07:28,  2.80s/it, exist=0.2314, loss=0.4888, lr=1.12e-07]
Epoch 5/5:  86%|████████▋ | 1017/1177 [50:09<07:28,  2.80s/it, exist=0.2314, loss=0.4889, lr=1.11e-07]
Epoch 5/5:  86%|████████▋ | 1018/1177 [50:09<07:48,  2.94s/it, exist=0.2314, loss=0.4889, lr=1.11e-07]
Epoch 5/5:  86%|████████▋ | 1018/1177 [50:12<07:48,  2.94s/it, exist=0.2313, loss=0.4887, lr=1.10e-07]
Epoch 5/5:  87%|████████▋ | 1019/1177 [50:12<07:33,  2.87s/it, exist=0.2313, loss=0.4887, lr=1.10e-07]
Epoch 5/5:  87%|████████▋ | 1019/1177 [50:15<07:33,  2.87s/it, exist=0.2315, loss=0.4888, lr=1.08e-07]
Epoch 5/5:  87%|████████▋ | 1020/1177 [50:15<07:54,  3.02s/it, exist=0.2315, loss=0.4888, lr=1.08e-07]
Epoch 5/5:  87%|████████▋ | 1020/1177 [50:19<07:54,  3.02s/it, exist=0.2315, loss=0.4888, lr=1.07e-07]
Epoch 5/5:  87%|████████▋ | 1021/1177 [50:19<08:08,  3.13s/it, exist=0.2315, loss=0.4888, lr=1.07e-07]
Epoch 5/5:  87%|████████▋ | 1021/1177 [50:23<08:08,  3.13s/it, exist=0.2314, loss=0.4887, lr=1.06e-07]
Epoch 5/5:  87%|████████▋ | 1022/1177 [50:23<08:53,  3.44s/it, exist=0.2314, loss=0.4887, lr=1.06e-07]
Epoch 5/5:  87%|████████▋ | 1022/1177 [50:26<08:53,  3.44s/it, exist=0.2315, loss=0.4889, lr=1.04e-07]
Epoch 5/5:  87%|████████▋ | 1023/1177 [50:26<08:37,  3.36s/it, exist=0.2315, loss=0.4889, lr=1.04e-07]
Epoch 5/5:  87%|████████▋ | 1023/1177 [50:29<08:37,  3.36s/it, exist=0.2317, loss=0.4890, lr=1.03e-07]
Epoch 5/5:  87%|████████▋ | 1024/1177 [50:29<08:32,  3.35s/it, exist=0.2317, loss=0.4890, lr=1.03e-07]
Epoch 5/5:  87%|████████▋ | 1024/1177 [50:34<08:32,  3.35s/it, exist=0.2318, loss=0.4891, lr=1.02e-07]
Epoch 5/5:  87%|████████▋ | 1025/1177 [50:34<09:46,  3.86s/it, exist=0.2318, loss=0.4891, lr=1.02e-07]
Epoch 5/5:  87%|████████▋ | 1025/1177 [50:38<09:46,  3.86s/it, exist=0.2322, loss=0.4894, lr=1.00e-07]
Epoch 5/5:  87%|████████▋ | 1026/1177 [50:38<09:35,  3.81s/it, exist=0.2322, loss=0.4894, lr=1.00e-07]
Epoch 5/5:  87%|████████▋ | 1026/1177 [50:41<09:35,  3.81s/it, exist=0.2323, loss=0.4895, lr=9.89e-08]
Epoch 5/5:  87%|████████▋ | 1027/1177 [50:41<09:20,  3.74s/it, exist=0.2323, loss=0.4895, lr=9.89e-08]
Epoch 5/5:  87%|████████▋ | 1027/1177 [50:45<09:20,  3.74s/it, exist=0.2322, loss=0.4893, lr=9.76e-08]
Epoch 5/5:  87%|████████▋ | 1028/1177 [50:45<09:11,  3.70s/it, exist=0.2322, loss=0.4893, lr=9.76e-08]
Epoch 5/5:  87%|████████▋ | 1028/1177 [50:48<09:11,  3.70s/it, exist=0.2323, loss=0.4894, lr=9.62e-08]
Epoch 5/5:  87%|████████▋ | 1029/1177 [50:48<08:26,  3.42s/it, exist=0.2323, loss=0.4894, lr=9.62e-08]
Epoch 5/5:  87%|████████▋ | 1029/1177 [50:51<08:26,  3.42s/it, exist=0.2322, loss=0.4893, lr=9.50e-08]
Epoch 5/5:  88%|████████▊ | 1030/1177 [50:51<08:05,  3.30s/it, exist=0.2322, loss=0.4893, lr=9.50e-08]
Epoch 5/5:  88%|████████▊ | 1030/1177 [50:54<08:05,  3.30s/it, exist=0.2325, loss=0.4895, lr=9.37e-08]
Epoch 5/5:  88%|████████▊ | 1031/1177 [50:54<07:59,  3.28s/it, exist=0.2325, loss=0.4895, lr=9.37e-08]
Epoch 5/5:  88%|████████▊ | 1031/1177 [50:57<07:59,  3.28s/it, exist=0.2328, loss=0.4899, lr=9.24e-08]
Epoch 5/5:  88%|████████▊ | 1032/1177 [50:57<07:23,  3.06s/it, exist=0.2328, loss=0.4899, lr=9.24e-08]
Epoch 5/5:  88%|████████▊ | 1032/1177 [51:00<07:23,  3.06s/it, exist=0.2329, loss=0.4900, lr=9.11e-08]
Epoch 5/5:  88%|████████▊ | 1033/1177 [51:00<07:12,  3.01s/it, exist=0.2329, loss=0.4900, lr=9.11e-08]
Epoch 5/5:  88%|████████▊ | 1033/1177 [51:03<07:12,  3.01s/it, exist=0.2329, loss=0.4900, lr=8.99e-08]
Epoch 5/5:  88%|████████▊ | 1034/1177 [51:03<07:17,  3.06s/it, exist=0.2329, loss=0.4900, lr=8.99e-08]
Epoch 5/5:  88%|████████▊ | 1034/1177 [51:05<07:17,  3.06s/it, exist=0.2332, loss=0.4904, lr=8.86e-08]
Epoch 5/5:  88%|████████▊ | 1035/1177 [51:05<06:47,  2.87s/it, exist=0.2332, loss=0.4904, lr=8.86e-08]
Epoch 5/5:  88%|████████▊ | 1035/1177 [51:09<06:47,  2.87s/it, exist=0.2331, loss=0.4902, lr=8.74e-08]
Epoch 5/5:  88%|████████▊ | 1036/1177 [51:09<07:44,  3.30s/it, exist=0.2331, loss=0.4902, lr=8.74e-08]
Epoch 5/5:  88%|████████▊ | 1036/1177 [51:13<07:44,  3.30s/it, exist=0.2331, loss=0.4902, lr=8.61e-08]
Epoch 5/5:  88%|████████▊ | 1037/1177 [51:13<08:12,  3.51s/it, exist=0.2331, loss=0.4902, lr=8.61e-08]
Epoch 5/5:  88%|████████▊ | 1037/1177 [51:17<08:12,  3.51s/it, exist=0.2329, loss=0.4900, lr=8.49e-08]
Epoch 5/5:  88%|████████▊ | 1038/1177 [51:17<08:11,  3.53s/it, exist=0.2329, loss=0.4900, lr=8.49e-08]
Epoch 5/5:  88%|████████▊ | 1038/1177 [51:21<08:11,  3.53s/it, exist=0.2329, loss=0.4901, lr=8.37e-08]
Epoch 5/5:  88%|████████▊ | 1039/1177 [51:21<08:04,  3.51s/it, exist=0.2329, loss=0.4901, lr=8.37e-08]
Epoch 5/5:  88%|████████▊ | 1039/1177 [51:23<08:04,  3.51s/it, exist=0.2328, loss=0.4899, lr=8.25e-08]
Epoch 5/5:  88%|████████▊ | 1040/1177 [51:23<07:05,  3.10s/it, exist=0.2328, loss=0.4899, lr=8.25e-08]
Epoch 5/5:  88%|████████▊ | 1040/1177 [51:26<07:05,  3.10s/it, exist=0.2328, loss=0.4898, lr=8.13e-08]
Epoch 5/5:  88%|████████▊ | 1041/1177 [51:26<07:17,  3.22s/it, exist=0.2328, loss=0.4898, lr=8.13e-08]
Epoch 5/5:  88%|████████▊ | 1041/1177 [51:31<07:17,  3.22s/it, exist=0.2330, loss=0.4901, lr=8.01e-08]
Epoch 5/5:  89%|████████▊ | 1042/1177 [51:31<08:05,  3.60s/it, exist=0.2330, loss=0.4901, lr=8.01e-08]
Epoch 5/5:  89%|████████▊ | 1042/1177 [51:34<08:05,  3.60s/it, exist=0.2329, loss=0.4901, lr=7.89e-08]
Epoch 5/5:  89%|████████▊ | 1043/1177 [51:34<08:00,  3.58s/it, exist=0.2329, loss=0.4901, lr=7.89e-08]
Epoch 5/5:  89%|████████▊ | 1043/1177 [51:38<08:00,  3.58s/it, exist=0.2328, loss=0.4899, lr=7.77e-08]
Epoch 5/5:  89%|████████▊ | 1044/1177 [51:38<07:56,  3.59s/it, exist=0.2328, loss=0.4899, lr=7.77e-08]
Epoch 5/5:  89%|████████▊ | 1044/1177 [51:41<07:56,  3.59s/it, exist=0.2326, loss=0.4897, lr=7.66e-08]
Epoch 5/5:  89%|████████▉ | 1045/1177 [51:41<07:53,  3.59s/it, exist=0.2326, loss=0.4897, lr=7.66e-08]
Epoch 5/5:  89%|████████▉ | 1045/1177 [51:44<07:53,  3.59s/it, exist=0.2326, loss=0.4897, lr=7.54e-08]
Epoch 5/5:  89%|████████▉ | 1046/1177 [51:44<07:11,  3.30s/it, exist=0.2326, loss=0.4897, lr=7.54e-08]
Epoch 5/5:  89%|████████▉ | 1046/1177 [51:46<07:11,  3.30s/it, exist=0.2325, loss=0.4897, lr=7.43e-08]
Epoch 5/5:  89%|████████▉ | 1047/1177 [51:46<06:17,  2.90s/it, exist=0.2325, loss=0.4897, lr=7.43e-08]
Epoch 5/5:  89%|████████▉ | 1047/1177 [51:48<06:17,  2.90s/it, exist=0.2324, loss=0.4896, lr=7.31e-08]
Epoch 5/5:  89%|████████▉ | 1048/1177 [51:48<05:38,  2.63s/it, exist=0.2324, loss=0.4896, lr=7.31e-08]
Epoch 5/5:  89%|████████▉ | 1048/1177 [51:51<05:38,  2.63s/it, exist=0.2323, loss=0.4894, lr=7.20e-08]
Epoch 5/5:  89%|████████▉ | 1049/1177 [51:51<06:01,  2.83s/it, exist=0.2323, loss=0.4894, lr=7.20e-08]
Epoch 5/5:  89%|████████▉ | 1049/1177 [51:54<06:01,  2.83s/it, exist=0.2324, loss=0.4895, lr=7.09e-08]
Epoch 5/5:  89%|████████▉ | 1050/1177 [51:54<06:11,  2.92s/it, exist=0.2324, loss=0.4895, lr=7.09e-08]
Epoch 5/5:  89%|████████▉ | 1050/1177 [51:58<06:11,  2.92s/it, exist=0.2324, loss=0.4895, lr=6.98e-08]
Epoch 5/5:  89%|████████▉ | 1051/1177 [51:58<06:36,  3.15s/it, exist=0.2324, loss=0.4895, lr=6.98e-08]
Epoch 5/5:  89%|████████▉ | 1051/1177 [52:01<06:36,  3.15s/it, exist=0.2325, loss=0.4895, lr=6.87e-08]
Epoch 5/5:  89%|████████▉ | 1052/1177 [52:01<06:34,  3.16s/it, exist=0.2325, loss=0.4895, lr=6.87e-08]
Epoch 5/5:  89%|████████▉ | 1052/1177 [52:05<06:34,  3.16s/it, exist=0.2323, loss=0.4894, lr=6.76e-08]
Epoch 5/5:  89%|████████▉ | 1053/1177 [52:05<06:36,  3.20s/it, exist=0.2323, loss=0.4894, lr=6.76e-08]
Epoch 5/5:  89%|████████▉ | 1053/1177 [52:08<06:36,  3.20s/it, exist=0.2322, loss=0.4893, lr=6.65e-08]
Epoch 5/5:  90%|████████▉ | 1054/1177 [52:08<06:48,  3.32s/it, exist=0.2322, loss=0.4893, lr=6.65e-08]
Epoch 5/5:  90%|████████▉ | 1054/1177 [52:11<06:48,  3.32s/it, exist=0.2321, loss=0.4891, lr=6.54e-08]
Epoch 5/5:  90%|████████▉ | 1055/1177 [52:11<06:13,  3.06s/it, exist=0.2321, loss=0.4891, lr=6.54e-08]
Epoch 5/5:  90%|████████▉ | 1055/1177 [52:14<06:13,  3.06s/it, exist=0.2321, loss=0.4891, lr=6.43e-08]
Epoch 5/5:  90%|████████▉ | 1056/1177 [52:14<06:37,  3.29s/it, exist=0.2321, loss=0.4891, lr=6.43e-08]
Epoch 5/5:  90%|████████▉ | 1056/1177 [52:17<06:37,  3.29s/it, exist=0.2320, loss=0.4889, lr=6.33e-08]
Epoch 5/5:  90%|████████▉ | 1057/1177 [52:17<06:13,  3.11s/it, exist=0.2320, loss=0.4889, lr=6.33e-08]
Epoch 5/5:  90%|████████▉ | 1057/1177 [52:21<06:13,  3.11s/it, exist=0.2319, loss=0.4888, lr=6.22e-08]
Epoch 5/5:  90%|████████▉ | 1058/1177 [52:21<06:21,  3.20s/it, exist=0.2319, loss=0.4888, lr=6.22e-08]
Epoch 5/5:  90%|████████▉ | 1058/1177 [52:23<06:21,  3.20s/it, exist=0.2320, loss=0.4889, lr=6.12e-08]
Epoch 5/5:  90%|████████▉ | 1059/1177 [52:23<05:54,  3.00s/it, exist=0.2320, loss=0.4889, lr=6.12e-08]
Epoch 5/5:  90%|████████▉ | 1059/1177 [52:25<05:54,  3.00s/it, exist=0.2320, loss=0.4889, lr=6.02e-08]
Epoch 5/5:  90%|█████████ | 1060/1177 [52:25<05:16,  2.71s/it, exist=0.2320, loss=0.4889, lr=6.02e-08]
Epoch 5/5:  90%|█████████ | 1060/1177 [52:28<05:16,  2.71s/it, exist=0.2319, loss=0.4887, lr=5.91e-08]
Epoch 5/5:  90%|█████████ | 1061/1177 [52:28<05:14,  2.71s/it, exist=0.2319, loss=0.4887, lr=5.91e-08]
Epoch 5/5:  90%|█████████ | 1061/1177 [52:31<05:14,  2.71s/it, exist=0.2318, loss=0.4886, lr=5.81e-08]
Epoch 5/5:  90%|█████████ | 1062/1177 [52:31<05:39,  2.95s/it, exist=0.2318, loss=0.4886, lr=5.81e-08]
Epoch 5/5:  90%|█████████ | 1062/1177 [52:35<05:39,  2.95s/it, exist=0.2316, loss=0.4885, lr=5.71e-08]
Epoch 5/5:  90%|█████████ | 1063/1177 [52:35<05:51,  3.09s/it, exist=0.2316, loss=0.4885, lr=5.71e-08]
Epoch 5/5:  90%|█████████ | 1063/1177 [52:37<05:51,  3.09s/it, exist=0.2318, loss=0.4887, lr=5.61e-08]
Epoch 5/5:  90%|█████████ | 1064/1177 [52:37<05:28,  2.90s/it, exist=0.2318, loss=0.4887, lr=5.61e-08]
Epoch 5/5:  90%|█████████ | 1064/1177 [52:42<05:28,  2.90s/it, exist=0.2318, loss=0.4886, lr=5.51e-08]
Epoch 5/5:  90%|█████████ | 1065/1177 [52:42<06:40,  3.58s/it, exist=0.2318, loss=0.4886, lr=5.51e-08]
Epoch 5/5:  90%|█████████ | 1065/1177 [52:47<06:40,  3.58s/it, exist=0.2319, loss=0.4887, lr=5.42e-08]
Epoch 5/5:  91%|█████████ | 1066/1177 [52:47<07:19,  3.96s/it, exist=0.2319, loss=0.4887, lr=5.42e-08]
Epoch 5/5:  91%|█████████ | 1066/1177 [52:50<07:19,  3.96s/it, exist=0.2318, loss=0.4885, lr=5.32e-08]
Epoch 5/5:  91%|█████████ | 1067/1177 [52:50<06:29,  3.54s/it, exist=0.2318, loss=0.4885, lr=5.32e-08]
Epoch 5/5:  91%|█████████ | 1067/1177 [52:52<06:29,  3.54s/it, exist=0.2316, loss=0.4884, lr=5.22e-08]
Epoch 5/5:  91%|█████████ | 1068/1177 [52:52<05:36,  3.09s/it, exist=0.2316, loss=0.4884, lr=5.22e-08]
Epoch 5/5:  91%|█████████ | 1068/1177 [52:55<05:36,  3.09s/it, exist=0.2317, loss=0.4884, lr=5.13e-08]
Epoch 5/5:  91%|█████████ | 1069/1177 [52:55<05:26,  3.03s/it, exist=0.2317, loss=0.4884, lr=5.13e-08]
Epoch 5/5:  91%|█████████ | 1069/1177 [52:58<05:26,  3.03s/it, exist=0.2317, loss=0.4883, lr=5.03e-08]
Epoch 5/5:  91%|█████████ | 1070/1177 [52:58<05:39,  3.17s/it, exist=0.2317, loss=0.4883, lr=5.03e-08]
Epoch 5/5:  91%|█████████ | 1070/1177 [53:01<05:39,  3.17s/it, exist=0.2316, loss=0.4883, lr=4.94e-08]
Epoch 5/5:  91%|█████████ | 1071/1177 [53:01<05:12,  2.95s/it, exist=0.2316, loss=0.4883, lr=4.94e-08]
Epoch 5/5:  91%|█████████ | 1071/1177 [53:03<05:12,  2.95s/it, exist=0.2315, loss=0.4881, lr=4.85e-08]
Epoch 5/5:  91%|█████████ | 1072/1177 [53:03<04:53,  2.80s/it, exist=0.2315, loss=0.4881, lr=4.85e-08]
Epoch 5/5:  91%|█████████ | 1072/1177 [53:07<04:53,  2.80s/it, exist=0.2313, loss=0.4881, lr=4.75e-08]
Epoch 5/5:  91%|█████████ | 1073/1177 [53:07<05:18,  3.06s/it, exist=0.2313, loss=0.4881, lr=4.75e-08]
Epoch 5/5:  91%|█████████ | 1073/1177 [53:11<05:18,  3.06s/it, exist=0.2312, loss=0.4880, lr=4.66e-08]
Epoch 5/5:  91%|█████████ | 1074/1177 [53:11<06:01,  3.51s/it, exist=0.2312, loss=0.4880, lr=4.66e-08]
Epoch 5/5:  91%|█████████ | 1074/1177 [53:14<06:01,  3.51s/it, exist=0.2311, loss=0.4880, lr=4.57e-08]
Epoch 5/5:  91%|█████████▏| 1075/1177 [53:14<05:18,  3.12s/it, exist=0.2311, loss=0.4880, lr=4.57e-08]
Epoch 5/5:  91%|█████████▏| 1075/1177 [53:18<05:18,  3.12s/it, exist=0.2310, loss=0.4879, lr=4.48e-08]
Epoch 5/5:  91%|█████████▏| 1076/1177 [53:18<05:50,  3.48s/it, exist=0.2310, loss=0.4879, lr=4.48e-08]
Epoch 5/5:  91%|█████████▏| 1076/1177 [53:22<05:50,  3.48s/it, exist=0.2309, loss=0.4878, lr=4.40e-08]
Epoch 5/5:  92%|█████████▏| 1077/1177 [53:22<06:13,  3.74s/it, exist=0.2309, loss=0.4878, lr=4.40e-08]
Epoch 5/5:  92%|█████████▏| 1077/1177 [53:25<06:13,  3.74s/it, exist=0.2309, loss=0.4877, lr=4.31e-08]
Epoch 5/5:  92%|█████████▏| 1078/1177 [53:25<05:37,  3.41s/it, exist=0.2309, loss=0.4877, lr=4.31e-08]
Epoch 5/5:  92%|█████████▏| 1078/1177 [53:27<05:37,  3.41s/it, exist=0.2308, loss=0.4877, lr=4.22e-08]
Epoch 5/5:  92%|█████████▏| 1079/1177 [53:27<04:56,  3.03s/it, exist=0.2308, loss=0.4877, lr=4.22e-08]
Epoch 5/5:  92%|█████████▏| 1079/1177 [53:31<04:56,  3.03s/it, exist=0.2307, loss=0.4876, lr=4.14e-08]
Epoch 5/5:  92%|█████████▏| 1080/1177 [53:31<05:33,  3.44s/it, exist=0.2307, loss=0.4876, lr=4.14e-08]
Epoch 5/5:  92%|█████████▏| 1080/1177 [53:34<05:33,  3.44s/it, exist=0.2305, loss=0.4874, lr=4.05e-08]
Epoch 5/5:  92%|█████████▏| 1081/1177 [53:34<05:10,  3.23s/it, exist=0.2305, loss=0.4874, lr=4.05e-08]
Epoch 5/5:  92%|█████████▏| 1081/1177 [53:38<05:10,  3.23s/it, exist=0.2304, loss=0.4875, lr=3.97e-08]
Epoch 5/5:  92%|█████████▏| 1082/1177 [53:38<05:19,  3.37s/it, exist=0.2304, loss=0.4875, lr=3.97e-08]
Epoch 5/5:  92%|█████████▏| 1082/1177 [53:40<05:19,  3.37s/it, exist=0.2303, loss=0.4873, lr=3.88e-08]
Epoch 5/5:  92%|█████████▏| 1083/1177 [53:40<04:48,  3.07s/it, exist=0.2303, loss=0.4873, lr=3.88e-08]
Epoch 5/5:  92%|█████████▏| 1083/1177 [53:42<04:48,  3.07s/it, exist=0.2302, loss=0.4873, lr=3.80e-08]
Epoch 5/5:  92%|█████████▏| 1084/1177 [53:42<04:14,  2.74s/it, exist=0.2302, loss=0.4873, lr=3.80e-08]
Epoch 5/5:  92%|█████████▏| 1084/1177 [53:45<04:14,  2.74s/it, exist=0.2303, loss=0.4874, lr=3.72e-08]
Epoch 5/5:  92%|█████████▏| 1085/1177 [53:45<04:11,  2.74s/it, exist=0.2303, loss=0.4874, lr=3.72e-08]
Epoch 5/5:  92%|█████████▏| 1085/1177 [53:49<04:11,  2.74s/it, exist=0.2302, loss=0.4873, lr=3.64e-08]
Epoch 5/5:  92%|█████████▏| 1086/1177 [53:49<04:36,  3.04s/it, exist=0.2302, loss=0.4873, lr=3.64e-08]
Epoch 5/5:  92%|█████████▏| 1086/1177 [53:52<04:36,  3.04s/it, exist=0.2304, loss=0.4874, lr=3.56e-08]
Epoch 5/5:  92%|█████████▏| 1087/1177 [53:52<04:50,  3.23s/it, exist=0.2304, loss=0.4874, lr=3.56e-08]
Epoch 5/5:  92%|█████████▏| 1087/1177 [53:58<04:50,  3.23s/it, exist=0.2305, loss=0.4875, lr=3.48e-08]
Epoch 5/5:  92%|█████████▏| 1088/1177 [53:58<05:54,  3.98s/it, exist=0.2305, loss=0.4875, lr=3.48e-08]
Epoch 5/5:  92%|█████████▏| 1088/1177 [54:03<05:54,  3.98s/it, exist=0.2303, loss=0.4873, lr=3.40e-08]
Epoch 5/5:  93%|█████████▎| 1089/1177 [54:03<06:21,  4.34s/it, exist=0.2303, loss=0.4873, lr=3.40e-08]
Epoch 5/5:  93%|█████████▎| 1089/1177 [54:07<06:21,  4.34s/it, exist=0.2303, loss=0.4874, lr=3.33e-08]
Epoch 5/5:  93%|█████████▎| 1090/1177 [54:07<06:05,  4.20s/it, exist=0.2303, loss=0.4874, lr=3.33e-08]
Epoch 5/5:  93%|█████████▎| 1090/1177 [54:10<06:05,  4.20s/it, exist=0.2302, loss=0.4874, lr=3.25e-08]
Epoch 5/5:  93%|█████████▎| 1091/1177 [54:10<05:22,  3.75s/it, exist=0.2302, loss=0.4874, lr=3.25e-08]
Epoch 5/5:  93%|█████████▎| 1091/1177 [54:13<05:22,  3.75s/it, exist=0.2302, loss=0.4873, lr=3.18e-08]
Epoch 5/5:  93%|█████████▎| 1092/1177 [54:13<05:02,  3.56s/it, exist=0.2302, loss=0.4873, lr=3.18e-08]
Epoch 5/5:  93%|█████████▎| 1092/1177 [54:16<05:02,  3.56s/it, exist=0.2304, loss=0.4876, lr=3.10e-08]
Epoch 5/5:  93%|█████████▎| 1093/1177 [54:16<04:53,  3.49s/it, exist=0.2304, loss=0.4876, lr=3.10e-08]
Epoch 5/5:  93%|█████████▎| 1093/1177 [54:21<04:53,  3.49s/it, exist=0.2304, loss=0.4876, lr=3.03e-08]
Epoch 5/5:  93%|█████████▎| 1094/1177 [54:21<05:21,  3.88s/it, exist=0.2304, loss=0.4876, lr=3.03e-08]
Epoch 5/5:  93%|█████████▎| 1094/1177 [54:25<05:21,  3.88s/it, exist=0.2303, loss=0.4875, lr=2.96e-08]
Epoch 5/5:  93%|█████████▎| 1095/1177 [54:25<05:31,  4.05s/it, exist=0.2303, loss=0.4875, lr=2.96e-08]
Epoch 5/5:  93%|█████████▎| 1095/1177 [54:29<05:31,  4.05s/it, exist=0.2302, loss=0.4874, lr=2.88e-08]
Epoch 5/5:  93%|█████████▎| 1096/1177 [54:29<05:19,  3.94s/it, exist=0.2302, loss=0.4874, lr=2.88e-08]
Epoch 5/5:  93%|█████████▎| 1096/1177 [54:33<05:19,  3.94s/it, exist=0.2302, loss=0.4873, lr=2.81e-08]
Epoch 5/5:  93%|█████████▎| 1097/1177 [54:33<05:06,  3.83s/it, exist=0.2302, loss=0.4873, lr=2.81e-08]
Epoch 5/5:  93%|█████████▎| 1097/1177 [54:36<05:06,  3.83s/it, exist=0.2301, loss=0.4872, lr=2.74e-08]
Epoch 5/5:  93%|█████████▎| 1098/1177 [54:36<04:49,  3.66s/it, exist=0.2301, loss=0.4872, lr=2.74e-08]
Epoch 5/5:  93%|█████████▎| 1098/1177 [54:39<04:49,  3.66s/it, exist=0.2302, loss=0.4873, lr=2.67e-08]
Epoch 5/5:  93%|█████████▎| 1099/1177 [54:39<04:27,  3.43s/it, exist=0.2302, loss=0.4873, lr=2.67e-08]
Epoch 5/5:  93%|█████████▎| 1099/1177 [54:42<04:27,  3.43s/it, exist=0.2301, loss=0.4871, lr=2.61e-08]
Epoch 5/5:  93%|█████████▎| 1100/1177 [54:42<04:10,  3.26s/it, exist=0.2301, loss=0.4871, lr=2.61e-08]
Epoch 5/5:  93%|█████████▎| 1100/1177 [54:46<04:10,  3.26s/it, exist=0.2300, loss=0.4870, lr=2.54e-08]
Epoch 5/5:  94%|█████████▎| 1101/1177 [54:46<04:32,  3.59s/it, exist=0.2300, loss=0.4870, lr=2.54e-08]
Epoch 5/5:  94%|█████████▎| 1101/1177 [54:49<04:32,  3.59s/it, exist=0.2300, loss=0.4869, lr=2.47e-08]
Epoch 5/5:  94%|█████████▎| 1102/1177 [54:49<04:22,  3.50s/it, exist=0.2300, loss=0.4869, lr=2.47e-08]
Epoch 5/5:  94%|█████████▎| 1102/1177 [54:52<04:22,  3.50s/it, exist=0.2299, loss=0.4871, lr=2.41e-08]
Epoch 5/5:  94%|█████████▎| 1103/1177 [54:52<03:58,  3.22s/it, exist=0.2299, loss=0.4871, lr=2.41e-08]
Epoch 5/5:  94%|█████████▎| 1103/1177 [54:54<03:58,  3.22s/it, exist=0.2298, loss=0.4870, lr=2.34e-08]
Epoch 5/5:  94%|█████████▍| 1104/1177 [54:54<03:40,  3.01s/it, exist=0.2298, loss=0.4870, lr=2.34e-08]
Epoch 5/5:  94%|█████████▍| 1104/1177 [54:57<03:40,  3.01s/it, exist=0.2298, loss=0.4870, lr=2.28e-08]
Epoch 5/5:  94%|█████████▍| 1105/1177 [54:57<03:22,  2.81s/it, exist=0.2298, loss=0.4870, lr=2.28e-08]
Epoch 5/5:  94%|█████████▍| 1105/1177 [55:00<03:22,  2.81s/it, exist=0.2300, loss=0.4871, lr=2.22e-08]
Epoch 5/5:  94%|█████████▍| 1106/1177 [55:00<03:18,  2.79s/it, exist=0.2300, loss=0.4871, lr=2.22e-08]
Epoch 5/5:  94%|█████████▍| 1106/1177 [55:05<03:18,  2.79s/it, exist=0.2299, loss=0.4870, lr=2.15e-08]
Epoch 5/5:  94%|█████████▍| 1107/1177 [55:05<04:07,  3.53s/it, exist=0.2299, loss=0.4870, lr=2.15e-08]
Epoch 5/5:  94%|█████████▍| 1107/1177 [55:09<04:07,  3.53s/it, exist=0.2300, loss=0.4873, lr=2.09e-08]
Epoch 5/5:  94%|█████████▍| 1108/1177 [55:09<04:11,  3.64s/it, exist=0.2300, loss=0.4873, lr=2.09e-08]
Epoch 5/5:  94%|█████████▍| 1108/1177 [55:14<04:11,  3.64s/it, exist=0.2299, loss=0.4871, lr=2.03e-08]
Epoch 5/5:  94%|█████████▍| 1109/1177 [55:14<04:45,  4.20s/it, exist=0.2299, loss=0.4871, lr=2.03e-08]
Epoch 5/5:  94%|█████████▍| 1109/1177 [55:19<04:45,  4.20s/it, exist=0.2298, loss=0.4871, lr=1.97e-08]
Epoch 5/5:  94%|█████████▍| 1110/1177 [55:19<04:46,  4.28s/it, exist=0.2298, loss=0.4871, lr=1.97e-08]
Epoch 5/5:  94%|█████████▍| 1110/1177 [55:23<04:46,  4.28s/it, exist=0.2299, loss=0.4872, lr=1.92e-08]
Epoch 5/5:  94%|█████████▍| 1111/1177 [55:23<04:47,  4.36s/it, exist=0.2299, loss=0.4872, lr=1.92e-08]
Epoch 5/5:  94%|█████████▍| 1111/1177 [55:27<04:47,  4.36s/it, exist=0.2301, loss=0.4874, lr=1.86e-08]
Epoch 5/5:  94%|█████████▍| 1112/1177 [55:27<04:41,  4.33s/it, exist=0.2301, loss=0.4874, lr=1.86e-08]
Epoch 5/5:  94%|█████████▍| 1112/1177 [55:32<04:41,  4.33s/it, exist=0.2300, loss=0.4873, lr=1.80e-08]
Epoch 5/5:  95%|█████████▍| 1113/1177 [55:32<04:43,  4.44s/it, exist=0.2300, loss=0.4873, lr=1.80e-08]
Epoch 5/5:  95%|█████████▍| 1113/1177 [55:37<04:43,  4.44s/it, exist=0.2299, loss=0.4873, lr=1.74e-08]
Epoch 5/5:  95%|█████████▍| 1114/1177 [55:37<04:54,  4.67s/it, exist=0.2299, loss=0.4873, lr=1.74e-08]
Epoch 5/5:  95%|█████████▍| 1114/1177 [55:39<04:54,  4.67s/it, exist=0.2299, loss=0.4873, lr=1.69e-08]
Epoch 5/5:  95%|█████████▍| 1115/1177 [55:39<03:59,  3.87s/it, exist=0.2299, loss=0.4873, lr=1.69e-08]
Epoch 5/5:  95%|█████████▍| 1115/1177 [55:41<03:59,  3.87s/it, exist=0.2300, loss=0.4874, lr=1.64e-08]
Epoch 5/5:  95%|█████████▍| 1116/1177 [55:41<03:20,  3.29s/it, exist=0.2300, loss=0.4874, lr=1.64e-08]
Epoch 5/5:  95%|█████████▍| 1116/1177 [55:44<03:20,  3.29s/it, exist=0.2299, loss=0.4873, lr=1.58e-08]
Epoch 5/5:  95%|█████████▍| 1117/1177 [55:44<03:11,  3.20s/it, exist=0.2299, loss=0.4873, lr=1.58e-08]
Epoch 5/5:  95%|█████████▍| 1117/1177 [55:47<03:11,  3.20s/it, exist=0.2299, loss=0.4873, lr=1.53e-08]
Epoch 5/5:  95%|█████████▍| 1118/1177 [55:47<03:07,  3.18s/it, exist=0.2299, loss=0.4873, lr=1.53e-08]
Epoch 5/5:  95%|█████████▍| 1118/1177 [55:50<03:07,  3.18s/it, exist=0.2299, loss=0.4874, lr=1.48e-08]
Epoch 5/5:  95%|█████████▌| 1119/1177 [55:50<03:02,  3.14s/it, exist=0.2299, loss=0.4874, lr=1.48e-08]
Epoch 5/5:  95%|█████████▌| 1119/1177 [55:52<03:02,  3.14s/it, exist=0.2298, loss=0.4872, lr=1.43e-08]
Epoch 5/5:  95%|█████████▌| 1120/1177 [55:52<02:39,  2.80s/it, exist=0.2298, loss=0.4872, lr=1.43e-08]
Epoch 5/5:  95%|█████████▌| 1120/1177 [55:56<02:39,  2.80s/it, exist=0.2300, loss=0.4874, lr=1.38e-08]
Epoch 5/5:  95%|█████████▌| 1121/1177 [55:56<02:44,  2.94s/it, exist=0.2300, loss=0.4874, lr=1.38e-08]
Epoch 5/5:  95%|█████████▌| 1121/1177 [55:59<02:44,  2.94s/it, exist=0.2299, loss=0.4872, lr=1.33e-08]
Epoch 5/5:  95%|█████████▌| 1122/1177 [55:59<02:51,  3.11s/it, exist=0.2299, loss=0.4872, lr=1.33e-08]
Epoch 5/5:  95%|█████████▌| 1122/1177 [56:04<02:51,  3.11s/it, exist=0.2300, loss=0.4874, lr=1.28e-08]
Epoch 5/5:  95%|█████████▌| 1123/1177 [56:04<03:17,  3.65s/it, exist=0.2300, loss=0.4874, lr=1.28e-08]
Epoch 5/5:  95%|█████████▌| 1123/1177 [56:08<03:17,  3.65s/it, exist=0.2300, loss=0.4875, lr=1.23e-08]
Epoch 5/5:  95%|█████████▌| 1124/1177 [56:08<03:12,  3.63s/it, exist=0.2300, loss=0.4875, lr=1.23e-08]
Epoch 5/5:  95%|█████████▌| 1124/1177 [56:11<03:12,  3.63s/it, exist=0.2300, loss=0.4874, lr=1.19e-08]
Epoch 5/5:  96%|█████████▌| 1125/1177 [56:11<03:06,  3.60s/it, exist=0.2300, loss=0.4874, lr=1.19e-08]
Epoch 5/5:  96%|█████████▌| 1125/1177 [56:15<03:06,  3.60s/it, exist=0.2301, loss=0.4876, lr=1.14e-08]
Epoch 5/5:  96%|█████████▌| 1126/1177 [56:15<03:04,  3.62s/it, exist=0.2301, loss=0.4876, lr=1.14e-08]
Epoch 5/5:  96%|█████████▌| 1126/1177 [56:18<03:04,  3.62s/it, exist=0.2305, loss=0.4879, lr=1.10e-08]
Epoch 5/5:  96%|█████████▌| 1127/1177 [56:18<02:59,  3.60s/it, exist=0.2305, loss=0.4879, lr=1.10e-08]
Epoch 5/5:  96%|█████████▌| 1127/1177 [56:21<02:59,  3.60s/it, exist=0.2305, loss=0.4879, lr=1.06e-08]
Epoch 5/5:  96%|█████████▌| 1128/1177 [56:21<02:33,  3.14s/it, exist=0.2305, loss=0.4879, lr=1.06e-08]
Epoch 5/5:  96%|█████████▌| 1128/1177 [56:24<02:33,  3.14s/it, exist=0.2307, loss=0.4881, lr=1.01e-08]
Epoch 5/5:  96%|█████████▌| 1129/1177 [56:24<02:28,  3.09s/it, exist=0.2307, loss=0.4881, lr=1.01e-08]
Epoch 5/5:  96%|█████████▌| 1129/1177 [56:28<02:28,  3.09s/it, exist=0.2306, loss=0.4880, lr=9.71e-09]
Epoch 5/5:  96%|█████████▌| 1130/1177 [56:28<02:39,  3.40s/it, exist=0.2306, loss=0.4880, lr=9.71e-09]
Epoch 5/5:  96%|█████████▌| 1130/1177 [56:32<02:39,  3.40s/it, exist=0.2304, loss=0.4878, lr=9.30e-09]
Epoch 5/5:  96%|█████████▌| 1131/1177 [56:32<02:45,  3.59s/it, exist=0.2304, loss=0.4878, lr=9.30e-09]
Epoch 5/5:  96%|█████████▌| 1131/1177 [56:36<02:45,  3.59s/it, exist=0.2306, loss=0.4881, lr=8.90e-09]
Epoch 5/5:  96%|█████████▌| 1132/1177 [56:36<02:48,  3.73s/it, exist=0.2306, loss=0.4881, lr=8.90e-09]
Epoch 5/5:  96%|█████████▌| 1132/1177 [56:38<02:48,  3.73s/it, exist=0.2305, loss=0.4879, lr=8.51e-09]
Epoch 5/5:  96%|█████████▋| 1133/1177 [56:38<02:31,  3.43s/it, exist=0.2305, loss=0.4879, lr=8.51e-09]
Epoch 5/5:  96%|█████████▋| 1133/1177 [56:42<02:31,  3.43s/it, exist=0.2305, loss=0.4879, lr=8.13e-09]
Epoch 5/5:  96%|█████████▋| 1134/1177 [56:42<02:35,  3.61s/it, exist=0.2305, loss=0.4879, lr=8.13e-09]
Epoch 5/5:  96%|█████████▋| 1134/1177 [56:46<02:35,  3.61s/it, exist=0.2304, loss=0.4878, lr=7.76e-09]
Epoch 5/5:  96%|█████████▋| 1135/1177 [56:46<02:26,  3.50s/it, exist=0.2304, loss=0.4878, lr=7.76e-09]
Epoch 5/5:  96%|█████████▋| 1135/1177 [56:49<02:26,  3.50s/it, exist=0.2303, loss=0.4876, lr=7.39e-09]
Epoch 5/5:  97%|█████████▋| 1136/1177 [56:49<02:17,  3.34s/it, exist=0.2303, loss=0.4876, lr=7.39e-09]
Epoch 5/5:  97%|█████████▋| 1136/1177 [56:52<02:17,  3.34s/it, exist=0.2304, loss=0.4877, lr=7.03e-09]
Epoch 5/5:  97%|█████████▋| 1137/1177 [56:52<02:16,  3.41s/it, exist=0.2304, loss=0.4877, lr=7.03e-09]
Epoch 5/5:  97%|█████████▋| 1137/1177 [56:57<02:16,  3.41s/it, exist=0.2306, loss=0.4878, lr=6.69e-09]
Epoch 5/5:  97%|█████████▋| 1138/1177 [56:57<02:23,  3.67s/it, exist=0.2306, loss=0.4878, lr=6.69e-09]
Epoch 5/5:  97%|█████████▋| 1138/1177 [57:03<02:23,  3.67s/it, exist=0.2307, loss=0.4880, lr=6.35e-09]
Epoch 5/5:  97%|█████████▋| 1139/1177 [57:03<02:46,  4.38s/it, exist=0.2307, loss=0.4880, lr=6.35e-09]
Epoch 5/5:  97%|█████████▋| 1139/1177 [57:06<02:46,  4.38s/it, exist=0.2306, loss=0.4880, lr=6.02e-09]
Epoch 5/5:  97%|█████████▋| 1140/1177 [57:06<02:33,  4.14s/it, exist=0.2306, loss=0.4880, lr=6.02e-09]
Epoch 5/5:  97%|█████████▋| 1140/1177 [57:10<02:33,  4.14s/it, exist=0.2305, loss=0.4879, lr=5.70e-09]
Epoch 5/5:  97%|█████████▋| 1141/1177 [57:10<02:25,  4.04s/it, exist=0.2305, loss=0.4879, lr=5.70e-09]
Epoch 5/5:  97%|█████████▋| 1141/1177 [57:13<02:25,  4.04s/it, exist=0.2304, loss=0.4877, lr=5.39e-09]
Epoch 5/5:  97%|█████████▋| 1142/1177 [57:13<02:07,  3.64s/it, exist=0.2304, loss=0.4877, lr=5.39e-09]
Epoch 5/5:  97%|█████████▋| 1142/1177 [57:15<02:07,  3.64s/it, exist=0.2302, loss=0.4876, lr=5.08e-09]
Epoch 5/5:  97%|█████████▋| 1143/1177 [57:15<01:51,  3.27s/it, exist=0.2302, loss=0.4876, lr=5.08e-09]
Epoch 5/5:  97%|█████████▋| 1143/1177 [57:17<01:51,  3.27s/it, exist=0.2301, loss=0.4875, lr=4.79e-09]
Epoch 5/5:  97%|█████████▋| 1144/1177 [57:17<01:35,  2.89s/it, exist=0.2301, loss=0.4875, lr=4.79e-09]
Epoch 5/5:  97%|█████████▋| 1144/1177 [57:20<01:35,  2.89s/it, exist=0.2303, loss=0.4876, lr=4.50e-09]
Epoch 5/5:  97%|█████████▋| 1145/1177 [57:20<01:30,  2.82s/it, exist=0.2303, loss=0.4876, lr=4.50e-09]
Epoch 5/5:  97%|█████████▋| 1145/1177 [57:22<01:30,  2.82s/it, exist=0.2304, loss=0.4878, lr=4.23e-09]
Epoch 5/5:  97%|█████████▋| 1146/1177 [57:22<01:19,  2.56s/it, exist=0.2304, loss=0.4878, lr=4.23e-09]
Epoch 5/5:  97%|█████████▋| 1146/1177 [57:24<01:19,  2.56s/it, exist=0.2304, loss=0.4877, lr=3.96e-09]
Epoch 5/5:  97%|█████████▋| 1147/1177 [57:24<01:11,  2.39s/it, exist=0.2304, loss=0.4877, lr=3.96e-09]
Epoch 5/5:  97%|█████████▋| 1147/1177 [57:27<01:11,  2.39s/it, exist=0.2307, loss=0.4881, lr=3.70e-09]
Epoch 5/5:  98%|█████████▊| 1148/1177 [57:27<01:20,  2.79s/it, exist=0.2307, loss=0.4881, lr=3.70e-09]
Epoch 5/5:  98%|█████████▊| 1148/1177 [57:30<01:20,  2.79s/it, exist=0.2310, loss=0.4885, lr=3.45e-09]
Epoch 5/5:  98%|█████████▊| 1149/1177 [57:30<01:17,  2.78s/it, exist=0.2310, loss=0.4885, lr=3.45e-09]
Epoch 5/5:  98%|█████████▊| 1149/1177 [57:33<01:17,  2.78s/it, exist=0.2309, loss=0.4884, lr=3.21e-09]
Epoch 5/5:  98%|█████████▊| 1150/1177 [57:33<01:13,  2.71s/it, exist=0.2309, loss=0.4884, lr=3.21e-09]
Epoch 5/5:  98%|█████████▊| 1150/1177 [57:35<01:13,  2.71s/it, exist=0.2308, loss=0.4884, lr=2.97e-09]
Epoch 5/5:  98%|█████████▊| 1151/1177 [57:35<01:09,  2.69s/it, exist=0.2308, loss=0.4884, lr=2.97e-09]
Epoch 5/5:  98%|█████████▊| 1151/1177 [57:38<01:09,  2.69s/it, exist=0.2309, loss=0.4885, lr=2.75e-09]
Epoch 5/5:  98%|█████████▊| 1152/1177 [57:38<01:08,  2.73s/it, exist=0.2309, loss=0.4885, lr=2.75e-09]
Epoch 5/5:  98%|█████████▊| 1152/1177 [57:42<01:08,  2.73s/it, exist=0.2308, loss=0.4883, lr=2.53e-09]
Epoch 5/5:  98%|█████████▊| 1153/1177 [57:42<01:11,  2.99s/it, exist=0.2308, loss=0.4883, lr=2.53e-09]
Epoch 5/5:  98%|█████████▊| 1153/1177 [57:45<01:11,  2.99s/it, exist=0.2307, loss=0.4884, lr=2.33e-09]
Epoch 5/5:  98%|█████████▊| 1154/1177 [57:45<01:10,  3.09s/it, exist=0.2307, loss=0.4884, lr=2.33e-09]
Epoch 5/5:  98%|█████████▊| 1154/1177 [57:50<01:10,  3.09s/it, exist=0.2306, loss=0.4882, lr=2.13e-09]
Epoch 5/5:  98%|█████████▊| 1155/1177 [57:50<01:17,  3.52s/it, exist=0.2306, loss=0.4882, lr=2.13e-09]
Epoch 5/5:  98%|█████████▊| 1155/1177 [57:54<01:17,  3.52s/it, exist=0.2305, loss=0.4882, lr=1.94e-09]
Epoch 5/5:  98%|█████████▊| 1156/1177 [57:54<01:22,  3.92s/it, exist=0.2305, loss=0.4882, lr=1.94e-09]
Epoch 5/5:  98%|█████████▊| 1156/1177 [57:59<01:22,  3.92s/it, exist=0.2303, loss=0.4881, lr=1.76e-09]
Epoch 5/5:  98%|█████████▊| 1157/1177 [57:59<01:20,  4.00s/it, exist=0.2303, loss=0.4881, lr=1.76e-09]
Epoch 5/5:  98%|█████████▊| 1157/1177 [58:01<01:20,  4.00s/it, exist=0.2304, loss=0.4884, lr=1.59e-09]
Epoch 5/5:  98%|█████████▊| 1158/1177 [58:01<01:09,  3.64s/it, exist=0.2304, loss=0.4884, lr=1.59e-09]
Epoch 5/5:  98%|█████████▊| 1158/1177 [58:05<01:09,  3.64s/it, exist=0.2304, loss=0.4884, lr=1.42e-09]
Epoch 5/5:  98%|█████████▊| 1159/1177 [58:05<01:04,  3.58s/it, exist=0.2304, loss=0.4884, lr=1.42e-09]
Epoch 5/5:  98%|█████████▊| 1159/1177 [58:08<01:04,  3.58s/it, exist=0.2306, loss=0.4885, lr=1.27e-09]
Epoch 5/5:  99%|█████████▊| 1160/1177 [58:08<00:57,  3.36s/it, exist=0.2306, loss=0.4885, lr=1.27e-09]
Epoch 5/5:  99%|█████████▊| 1160/1177 [58:12<00:57,  3.36s/it, exist=0.2304, loss=0.4884, lr=1.13e-09]
Epoch 5/5:  99%|█████████▊| 1161/1177 [58:12<00:55,  3.48s/it, exist=0.2304, loss=0.4884, lr=1.13e-09]
Epoch 5/5:  99%|█████████▊| 1161/1177 [58:14<00:55,  3.48s/it, exist=0.2303, loss=0.4883, lr=9.89e-10]
Epoch 5/5:  99%|█████████▊| 1162/1177 [58:14<00:45,  3.03s/it, exist=0.2303, loss=0.4883, lr=9.89e-10]
Epoch 5/5:  99%|█████████▊| 1162/1177 [58:17<00:45,  3.03s/it, exist=0.2302, loss=0.4882, lr=8.62e-10]
Epoch 5/5:  99%|█████████▉| 1163/1177 [58:17<00:43,  3.08s/it, exist=0.2302, loss=0.4882, lr=8.62e-10]
Epoch 5/5:  99%|█████████▉| 1163/1177 [58:19<00:43,  3.08s/it, exist=0.2301, loss=0.4880, lr=7.43e-10]
Epoch 5/5:  99%|█████████▉| 1164/1177 [58:19<00:35,  2.76s/it, exist=0.2301, loss=0.4880, lr=7.43e-10]
Epoch 5/5:  99%|█████████▉| 1164/1177 [58:22<00:35,  2.76s/it, exist=0.2300, loss=0.4879, lr=6.33e-10]
Epoch 5/5:  99%|█████████▉| 1165/1177 [58:22<00:33,  2.81s/it, exist=0.2300, loss=0.4879, lr=6.33e-10]
Epoch 5/5:  99%|█████████▉| 1165/1177 [58:25<00:33,  2.81s/it, exist=0.2301, loss=0.4881, lr=5.32e-10]
Epoch 5/5:  99%|█████████▉| 1166/1177 [58:25<00:33,  3.08s/it, exist=0.2301, loss=0.4881, lr=5.32e-10]
Epoch 5/5:  99%|█████████▉| 1166/1177 [58:31<00:33,  3.08s/it, exist=0.2300, loss=0.4880, lr=4.40e-10]
Epoch 5/5:  99%|█████████▉| 1167/1177 [58:31<00:37,  3.78s/it, exist=0.2300, loss=0.4880, lr=4.40e-10]
Epoch 5/5:  99%|█████████▉| 1167/1177 [58:36<00:37,  3.78s/it, exist=0.2301, loss=0.4881, lr=3.56e-10]
Epoch 5/5:  99%|█████████▉| 1168/1177 [58:36<00:37,  4.22s/it, exist=0.2301, loss=0.4881, lr=3.56e-10]
Epoch 5/5:  99%|█████████▉| 1168/1177 [58:39<00:37,  4.22s/it, exist=0.2300, loss=0.4881, lr=2.81e-10]
Epoch 5/5:  99%|█████████▉| 1169/1177 [58:39<00:30,  3.81s/it, exist=0.2300, loss=0.4881, lr=2.81e-10]
Epoch 5/5:  99%|█████████▉| 1169/1177 [58:41<00:30,  3.81s/it, exist=0.2300, loss=0.4880, lr=2.15e-10]
Epoch 5/5:  99%|█████████▉| 1170/1177 [58:41<00:23,  3.43s/it, exist=0.2300, loss=0.4880, lr=2.15e-10]
Epoch 5/5:  99%|█████████▉| 1170/1177 [58:43<00:23,  3.43s/it, exist=0.2299, loss=0.4879, lr=1.58e-10]
Epoch 5/5:  99%|█████████▉| 1171/1177 [58:43<00:17,  3.00s/it, exist=0.2299, loss=0.4879, lr=1.58e-10]
Epoch 5/5:  99%|█████████▉| 1171/1177 [58:45<00:17,  3.00s/it, exist=0.2300, loss=0.4881, lr=1.10e-10]
Epoch 5/5: 100%|█████████▉| 1172/1177 [58:45<00:13,  2.73s/it, exist=0.2300, loss=0.4881, lr=1.10e-10]
Epoch 5/5: 100%|█████████▉| 1172/1177 [58:48<00:13,  2.73s/it, exist=0.2301, loss=0.4882, lr=7.04e-11]
Epoch 5/5: 100%|█████████▉| 1173/1177 [58:48<00:10,  2.72s/it, exist=0.2301, loss=0.4882, lr=7.04e-11]
Epoch 5/5: 100%|█████████▉| 1173/1177 [58:51<00:10,  2.72s/it, exist=0.2302, loss=0.4883, lr=3.96e-11]
Epoch 5/5: 100%|█████████▉| 1174/1177 [58:51<00:08,  2.71s/it, exist=0.2302, loss=0.4883, lr=3.96e-11]
Epoch 5/5: 100%|█████████▉| 1174/1177 [58:54<00:08,  2.71s/it, exist=0.2301, loss=0.4882, lr=1.76e-11]
Epoch 5/5: 100%|█████████▉| 1175/1177 [58:54<00:05,  2.71s/it, exist=0.2301, loss=0.4882, lr=1.76e-11]
Epoch 5/5: 100%|█████████▉| 1175/1177 [58:56<00:05,  2.71s/it, exist=0.2301, loss=0.4881, lr=4.40e-12]
Epoch 5/5: 100%|█████████▉| 1176/1177 [58:56<00:02,  2.72s/it, exist=0.2301, loss=0.4881, lr=4.40e-12]
Epoch 5/5: 100%|█████████▉| 1176/1177 [58:57<00:02,  2.72s/it, exist=0.2300, loss=0.4879, lr=0.00e+00]
Epoch 5/5: 100%|██████████| 1177/1177 [58:57<00:00,  2.03s/it, exist=0.2300, loss=0.4879, lr=0.00e+00]
Epoch 5/5: 100%|██████████| 1177/1177 [58:58<00:00,  3.01s/it, exist=0.2300, loss=0.4879, lr=0.00e+00]
Epoch 5  loss=0.4879  ce=0.0000  mask=0.1020  exist=0.2300  lr=0.00e+00
Saved: checkpoints/ec_simtoken/ec_simtoken_v1_ep5.pth

Eval test_s:   0%|          | 0/572 [00:00<?, ?it/s]
Eval test_s:   0%|          | 1/572 [00:20<3:13:31, 20.34s/it]
Eval test_s:   0%|          | 2/572 [00:22<1:33:05,  9.80s/it]
Eval test_s:   1%|          | 3/572 [00:24<58:41,  6.19s/it]  
Eval test_s:   1%|          | 4/572 [00:26<42:28,  4.49s/it]
Eval test_s:   1%|          | 5/572 [00:28<33:22,  3.53s/it]
Eval test_s:   1%|          | 6/572 [00:30<28:02,  2.97s/it]
Eval test_s:   1%|          | 7/572 [00:32<24:39,  2.62s/it]
Eval test_s:   1%|▏         | 8/572 [00:34<22:19,  2.38s/it]
Eval test_s:   2%|▏         | 9/572 [00:35<20:46,  2.21s/it]
Eval test_s:   2%|▏         | 10/572 [00:37<19:43,  2.11s/it]
Eval test_s:   2%|▏         | 11/572 [00:39<18:54,  2.02s/it]
Eval test_s:   2%|▏         | 12/572 [00:41<17:46,  1.90s/it]
Eval test_s:   2%|▏         | 13/572 [00:43<17:38,  1.89s/it]
Eval test_s:   2%|▏         | 14/572 [00:45<18:11,  1.96s/it]
Eval test_s:   3%|▎         | 15/572 [00:46<17:47,  1.92s/it]
Eval test_s:   3%|▎         | 16/572 [00:48<17:14,  1.86s/it]
Eval test_s:   3%|▎         | 17/572 [00:50<17:17,  1.87s/it]
Eval test_s:   3%|▎         | 18/572 [00:52<17:53,  1.94s/it]
Eval test_s:   3%|▎         | 19/572 [00:54<17:40,  1.92s/it]
Eval test_s:   3%|▎         | 20/572 [00:56<17:36,  1.91s/it]
Eval test_s:   4%|▎         | 21/572 [00:58<17:24,  1.89s/it]
Eval test_s:   4%|▍         | 22/572 [01:00<17:22,  1.90s/it]
Eval test_s:   4%|▍         | 23/572 [01:02<17:14,  1.89s/it]
Eval test_s:   4%|▍         | 24/572 [01:03<16:35,  1.82s/it]
Eval test_s:   4%|▍         | 25/572 [01:05<16:46,  1.84s/it]
Eval test_s:   5%|▍         | 26/572 [01:07<17:01,  1.87s/it]
Eval test_s:   5%|▍         | 27/572 [01:09<17:26,  1.92s/it]
Eval test_s:   5%|▍         | 28/572 [01:11<17:17,  1.91s/it]
Eval test_s:   5%|▌         | 29/572 [01:13<17:02,  1.88s/it]
Eval test_s:   5%|▌         | 30/572 [01:15<17:00,  1.88s/it]
Eval test_s:   5%|▌         | 31/572 [01:17<16:46,  1.86s/it]
Eval test_s:   6%|▌         | 32/572 [01:18<16:39,  1.85s/it]
Eval test_s:   6%|▌         | 33/572 [01:20<16:41,  1.86s/it]
Eval test_s:   6%|▌         | 34/572 [01:22<16:41,  1.86s/it]
Eval test_s:   6%|▌         | 35/572 [01:24<16:28,  1.84s/it]
Eval test_s:   6%|▋         | 36/572 [01:25<15:48,  1.77s/it]
Eval test_s:   6%|▋         | 37/572 [01:27<16:11,  1.82s/it]
Eval test_s:   7%|▋         | 38/572 [01:30<17:07,  1.92s/it]
Eval test_s:   7%|▋         | 39/572 [01:31<16:54,  1.90s/it]
Eval test_s:   7%|▋         | 40/572 [01:33<16:17,  1.84s/it]
Eval test_s:   7%|▋         | 41/572 [01:35<16:12,  1.83s/it]
Eval test_s:   7%|▋         | 42/572 [01:37<17:22,  1.97s/it]
Eval test_s:   8%|▊         | 43/572 [01:42<24:11,  2.74s/it]
Eval test_s:   8%|▊         | 44/572 [01:43<21:21,  2.43s/it]
Eval test_s:   8%|▊         | 45/572 [01:45<19:53,  2.26s/it]
Eval test_s:   8%|▊         | 46/572 [01:47<18:53,  2.15s/it]
Eval test_s:   8%|▊         | 47/572 [01:49<17:33,  2.01s/it]
Eval test_s:   8%|▊         | 48/572 [01:51<17:47,  2.04s/it]
Eval test_s:   9%|▊         | 49/572 [01:53<17:18,  1.99s/it]
Eval test_s:   9%|▊         | 50/572 [01:55<16:56,  1.95s/it]
Eval test_s:   9%|▉         | 51/572 [01:57<16:35,  1.91s/it]
Eval test_s:   9%|▉         | 52/572 [01:58<16:25,  1.89s/it]
Eval test_s:   9%|▉         | 53/572 [02:00<16:15,  1.88s/it]
Eval test_s:   9%|▉         | 54/572 [02:02<16:17,  1.89s/it]
Eval test_s:  10%|▉         | 55/572 [02:04<16:15,  1.89s/it]
Eval test_s:  10%|▉         | 56/572 [02:06<16:11,  1.88s/it]
Eval test_s:  10%|▉         | 57/572 [02:08<16:04,  1.87s/it]
Eval test_s:  10%|█         | 58/572 [02:09<15:24,  1.80s/it]
Eval test_s:  10%|█         | 59/572 [02:11<15:32,  1.82s/it]
Eval test_s:  10%|█         | 60/572 [02:13<15:42,  1.84s/it]
Eval test_s:  11%|█         | 61/572 [02:15<16:16,  1.91s/it]
Eval test_s:  11%|█         | 62/572 [02:17<16:06,  1.89s/it]
Eval test_s:  11%|█         | 63/572 [02:19<15:55,  1.88s/it]
Eval test_s:  11%|█         | 64/572 [02:21<15:53,  1.88s/it]
Eval test_s:  11%|█▏        | 65/572 [02:23<15:50,  1.87s/it]
Eval test_s:  12%|█▏        | 66/572 [02:25<15:42,  1.86s/it]
Eval test_s:  12%|█▏        | 67/572 [02:26<15:39,  1.86s/it]
Eval test_s:  12%|█▏        | 68/572 [02:28<15:34,  1.85s/it]
Eval test_s:  12%|█▏        | 69/572 [02:30<15:29,  1.85s/it]
Eval test_s:  12%|█▏        | 70/572 [02:32<15:30,  1.85s/it]
Eval test_s:  12%|█▏        | 71/572 [02:34<15:25,  1.85s/it]
Eval test_s:  13%|█▎        | 72/572 [02:36<15:29,  1.86s/it]
Eval test_s:  13%|█▎        | 73/572 [02:37<15:23,  1.85s/it]
Eval test_s:  13%|█▎        | 74/572 [02:39<15:17,  1.84s/it]
Eval test_s:  13%|█▎        | 75/572 [02:41<15:14,  1.84s/it]
Eval test_s:  13%|█▎        | 76/572 [02:43<15:17,  1.85s/it]
Eval test_s:  13%|█▎        | 77/572 [02:45<15:11,  1.84s/it]
Eval test_s:  14%|█▎        | 78/572 [02:47<15:07,  1.84s/it]
Eval test_s:  14%|█▍        | 79/572 [02:48<14:32,  1.77s/it]
Eval test_s:  14%|█▍        | 80/572 [02:50<14:29,  1.77s/it]
Eval test_s:  14%|█▍        | 81/572 [02:52<14:55,  1.82s/it]
Eval test_s:  14%|█▍        | 82/572 [02:54<14:56,  1.83s/it]
Eval test_s:  15%|█▍        | 83/572 [02:56<14:53,  1.83s/it]
Eval test_s:  15%|█▍        | 84/572 [02:57<14:51,  1.83s/it]
Eval test_s:  15%|█▍        | 85/572 [02:59<14:47,  1.82s/it]
Eval test_s:  15%|█▌        | 86/572 [03:01<14:45,  1.82s/it]
Eval test_s:  15%|█▌        | 87/572 [03:03<14:46,  1.83s/it]
Eval test_s:  15%|█▌        | 88/572 [03:05<14:52,  1.84s/it]
Eval test_s:  16%|█▌        | 89/572 [03:07<14:49,  1.84s/it]
Eval test_s:  16%|█▌        | 90/572 [03:08<14:44,  1.83s/it]
Eval test_s:  16%|█▌        | 91/572 [03:10<14:39,  1.83s/it]
Eval test_s:  16%|█▌        | 92/572 [03:12<14:38,  1.83s/it]
Eval test_s:  16%|█▋        | 93/572 [03:14<14:38,  1.83s/it]
Eval test_s:  16%|█▋        | 94/572 [03:16<14:39,  1.84s/it]
Eval test_s:  17%|█▋        | 95/572 [03:18<14:41,  1.85s/it]
Eval test_s:  17%|█▋        | 96/572 [03:20<14:43,  1.86s/it]
Eval test_s:  17%|█▋        | 97/572 [03:21<14:42,  1.86s/it]
Eval test_s:  17%|█▋        | 98/572 [03:23<14:40,  1.86s/it]
Eval test_s:  17%|█▋        | 99/572 [03:25<14:03,  1.78s/it]
Eval test_s:  17%|█▋        | 100/572 [03:27<14:12,  1.81s/it]
Eval test_s:  18%|█▊        | 101/572 [03:29<14:49,  1.89s/it]
Eval test_s:  18%|█▊        | 102/572 [03:31<14:46,  1.89s/it]
Eval test_s:  18%|█▊        | 103/572 [03:33<14:39,  1.87s/it]
Eval test_s:  18%|█▊        | 104/572 [03:34<14:36,  1.87s/it]
Eval test_s:  18%|█▊        | 105/572 [03:36<14:35,  1.88s/it]
Eval test_s:  19%|█▊        | 106/572 [03:38<14:29,  1.87s/it]
Eval test_s:  19%|█▊        | 107/572 [03:40<14:25,  1.86s/it]
Eval test_s:  19%|█▉        | 108/572 [03:42<14:26,  1.87s/it]
Eval test_s:  19%|█▉        | 109/572 [03:44<13:51,  1.80s/it]
Eval test_s:  19%|█▉        | 110/572 [03:46<14:32,  1.89s/it]
Eval test_s:  19%|█▉        | 111/572 [03:47<14:23,  1.87s/it]
Eval test_s:  20%|█▉        | 112/572 [03:49<13:48,  1.80s/it]
Eval test_s:  20%|█▉        | 113/572 [03:51<13:50,  1.81s/it]
Eval test_s:  20%|█▉        | 114/572 [03:53<13:55,  1.82s/it]
Eval test_s:  20%|██        | 115/572 [03:55<13:58,  1.83s/it]
Eval test_s:  20%|██        | 116/572 [03:57<14:46,  1.94s/it]
Eval test_s:  20%|██        | 117/572 [03:59<14:32,  1.92s/it]
Eval test_s:  21%|██        | 118/572 [04:01<14:22,  1.90s/it]
Eval test_s:  21%|██        | 119/572 [04:02<14:14,  1.89s/it]
Eval test_s:  21%|██        | 120/572 [04:04<14:12,  1.89s/it]
Eval test_s:  21%|██        | 121/572 [04:06<14:09,  1.88s/it]
Eval test_s:  21%|██▏       | 122/572 [04:08<14:01,  1.87s/it]
Eval test_s:  22%|██▏       | 123/572 [04:10<13:25,  1.79s/it]
Eval test_s:  22%|██▏       | 124/572 [04:12<13:48,  1.85s/it]
Eval test_s:  22%|██▏       | 125/572 [04:13<13:16,  1.78s/it]
Eval test_s:  22%|██▏       | 126/572 [04:15<13:23,  1.80s/it]
Eval test_s:  22%|██▏       | 127/572 [04:17<13:58,  1.88s/it]
Eval test_s:  22%|██▏       | 128/572 [04:19<13:51,  1.87s/it]
Eval test_s:  23%|██▎       | 129/572 [04:21<13:44,  1.86s/it]
Eval test_s:  23%|██▎       | 130/572 [04:23<13:37,  1.85s/it]
Eval test_s:  23%|██▎       | 131/572 [04:24<13:34,  1.85s/it]
Eval test_s:  23%|██▎       | 132/572 [04:26<13:42,  1.87s/it]
Eval test_s:  23%|██▎       | 133/572 [04:28<13:41,  1.87s/it]
Eval test_s:  23%|██▎       | 134/572 [04:30<13:37,  1.87s/it]
Eval test_s:  24%|██▎       | 135/572 [04:32<13:02,  1.79s/it]
Eval test_s:  24%|██▍       | 136/572 [04:34<13:06,  1.80s/it]
Eval test_s:  24%|██▍       | 137/572 [04:36<13:41,  1.89s/it]
Eval test_s:  24%|██▍       | 138/572 [04:37<13:32,  1.87s/it]
Eval test_s:  24%|██▍       | 139/572 [04:39<13:29,  1.87s/it]
Eval test_s:  24%|██▍       | 140/572 [04:41<13:32,  1.88s/it]
Eval test_s:  25%|██▍       | 141/572 [04:43<13:29,  1.88s/it]
Eval test_s:  25%|██▍       | 142/572 [04:45<12:55,  1.80s/it]
Eval test_s:  25%|██▌       | 143/572 [04:47<13:01,  1.82s/it]
Eval test_s:  25%|██▌       | 144/572 [04:49<13:30,  1.89s/it]
Eval test_s:  25%|██▌       | 145/572 [04:51<13:20,  1.88s/it]
Eval test_s:  26%|██▌       | 146/572 [04:52<13:21,  1.88s/it]
Eval test_s:  26%|██▌       | 147/572 [04:54<13:19,  1.88s/it]
Eval test_s:  26%|██▌       | 148/572 [04:56<13:15,  1.88s/it]
Eval test_s:  26%|██▌       | 149/572 [04:58<13:09,  1.87s/it]
Eval test_s:  26%|██▌       | 150/572 [05:00<13:07,  1.87s/it]
Eval test_s:  26%|██▋       | 151/572 [05:02<12:38,  1.80s/it]
Eval test_s:  27%|██▋       | 152/572 [05:03<12:41,  1.81s/it]
Eval test_s:  27%|██▋       | 153/572 [05:05<12:49,  1.84s/it]
Eval test_s:  27%|██▋       | 154/572 [05:07<13:11,  1.89s/it]
Eval test_s:  27%|██▋       | 155/572 [05:09<13:04,  1.88s/it]
Eval test_s:  27%|██▋       | 156/572 [05:11<13:28,  1.94s/it]
Eval test_s:  27%|██▋       | 157/572 [05:13<13:14,  1.91s/it]
Eval test_s:  28%|██▊       | 158/572 [05:15<13:14,  1.92s/it]
Eval test_s:  28%|██▊       | 159/572 [05:17<12:38,  1.84s/it]
Eval test_s:  28%|██▊       | 160/572 [05:19<12:46,  1.86s/it]
Eval test_s:  28%|██▊       | 161/572 [05:21<13:21,  1.95s/it]
Eval test_s:  28%|██▊       | 162/572 [05:23<13:09,  1.92s/it]
Eval test_s:  28%|██▊       | 163/572 [05:24<12:33,  1.84s/it]
Eval test_s:  29%|██▊       | 164/572 [05:26<12:31,  1.84s/it]
Eval test_s:  29%|██▉       | 165/572 [05:29<14:41,  2.17s/it]
Eval test_s:  29%|██▉       | 166/572 [05:32<17:14,  2.55s/it]
Eval test_s:  29%|██▉       | 167/572 [05:35<16:40,  2.47s/it]
Eval test_s:  29%|██▉       | 168/572 [05:37<15:31,  2.30s/it]
Eval test_s:  30%|██▉       | 169/572 [05:38<14:03,  2.09s/it]
Eval test_s:  30%|██▉       | 170/572 [05:40<13:39,  2.04s/it]
Eval test_s:  30%|██▉       | 171/572 [05:42<12:45,  1.91s/it]
Eval test_s:  30%|███       | 172/572 [05:44<13:13,  1.98s/it]
Eval test_s:  30%|███       | 173/572 [05:46<13:38,  2.05s/it]
Eval test_s:  30%|███       | 174/572 [05:48<12:49,  1.93s/it]
Eval test_s:  31%|███       | 175/572 [05:50<12:45,  1.93s/it]
Eval test_s:  31%|███       | 176/572 [05:52<13:09,  1.99s/it]
Eval test_s:  31%|███       | 177/572 [05:54<13:02,  1.98s/it]
Eval test_s:  31%|███       | 178/572 [05:56<12:40,  1.93s/it]
Eval test_s:  31%|███▏      | 179/572 [05:58<12:58,  1.98s/it]
Eval test_s:  31%|███▏      | 180/572 [06:00<12:43,  1.95s/it]
Eval test_s:  32%|███▏      | 181/572 [06:01<12:34,  1.93s/it]
Eval test_s:  32%|███▏      | 182/572 [06:03<12:27,  1.92s/it]
Eval test_s:  32%|███▏      | 183/572 [06:05<12:15,  1.89s/it]
Eval test_s:  32%|███▏      | 184/572 [06:07<12:13,  1.89s/it]
Eval test_s:  32%|███▏      | 185/572 [06:09<12:15,  1.90s/it]
Eval test_s:  33%|███▎      | 186/572 [06:11<12:14,  1.90s/it]
Eval test_s:  33%|███▎      | 187/572 [06:13<12:06,  1.89s/it]
Eval test_s:  33%|███▎      | 188/572 [06:15<11:59,  1.87s/it]
Eval test_s:  33%|███▎      | 189/572 [06:16<11:27,  1.80s/it]
Eval test_s:  33%|███▎      | 190/572 [06:18<12:02,  1.89s/it]
Eval test_s:  33%|███▎      | 191/572 [06:20<11:27,  1.80s/it]
Eval test_s:  34%|███▎      | 192/572 [06:22<12:01,  1.90s/it]
Eval test_s:  34%|███▎      | 193/572 [06:24<11:52,  1.88s/it]
Eval test_s:  34%|███▍      | 194/572 [06:26<11:22,  1.81s/it]
Eval test_s:  34%|███▍      | 195/572 [06:27<11:27,  1.82s/it]
Eval test_s:  34%|███▍      | 196/572 [06:29<11:57,  1.91s/it]
Eval test_s:  34%|███▍      | 197/572 [06:31<11:53,  1.90s/it]
Eval test_s:  35%|███▍      | 198/572 [06:33<12:01,  1.93s/it]
Eval test_s:  35%|███▍      | 199/572 [06:35<11:48,  1.90s/it]
Eval test_s:  35%|███▍      | 200/572 [06:37<11:17,  1.82s/it]
Eval test_s:  35%|███▌      | 201/572 [06:39<11:19,  1.83s/it]
Eval test_s:  35%|███▌      | 202/572 [06:41<11:49,  1.92s/it]
Eval test_s:  35%|███▌      | 203/572 [06:43<11:40,  1.90s/it]
Eval test_s:  36%|███▌      | 204/572 [06:45<11:37,  1.90s/it]
Eval test_s:  36%|███▌      | 205/572 [06:46<11:34,  1.89s/it]
Eval test_s:  36%|███▌      | 206/572 [06:48<11:26,  1.88s/it]
Eval test_s:  36%|███▌      | 207/572 [06:50<11:34,  1.90s/it]
Eval test_s:  36%|███▋      | 208/572 [06:52<11:32,  1.90s/it]
Eval test_s:  37%|███▋      | 209/572 [06:54<11:25,  1.89s/it]
Eval test_s:  37%|███▋      | 210/572 [06:56<11:24,  1.89s/it]
Eval test_s:  37%|███▋      | 211/572 [06:58<10:51,  1.81s/it]
Eval test_s:  37%|███▋      | 212/572 [07:00<11:23,  1.90s/it]
Eval test_s:  37%|███▋      | 213/572 [07:02<11:29,  1.92s/it]
Eval test_s:  37%|███▋      | 214/572 [07:03<11:19,  1.90s/it]
Eval test_s:  38%|███▊      | 215/572 [07:05<11:12,  1.88s/it]
Eval test_s:  38%|███▊      | 216/572 [07:07<11:06,  1.87s/it]
Eval test_s:  38%|███▊      | 217/572 [07:09<10:38,  1.80s/it]
Eval test_s:  38%|███▊      | 218/572 [07:11<10:45,  1.82s/it]
Eval test_s:  38%|███▊      | 219/572 [07:13<10:47,  1.83s/it]
Eval test_s:  38%|███▊      | 220/572 [07:15<11:11,  1.91s/it]
Eval test_s:  39%|███▊      | 221/572 [07:16<11:07,  1.90s/it]
Eval test_s:  39%|███▉      | 222/572 [07:18<11:03,  1.89s/it]
Eval test_s:  39%|███▉      | 223/572 [07:20<10:35,  1.82s/it]
Eval test_s:  39%|███▉      | 224/572 [07:22<10:45,  1.86s/it]
Eval test_s:  39%|███▉      | 225/572 [07:24<10:50,  1.87s/it]
Eval test_s:  40%|███▉      | 226/572 [07:26<11:11,  1.94s/it]
Eval test_s:  40%|███▉      | 227/572 [07:28<11:09,  1.94s/it]
Eval test_s:  40%|███▉      | 228/572 [07:30<10:54,  1.90s/it]
Eval test_s:  40%|████      | 229/572 [07:32<10:46,  1.88s/it]
Eval test_s:  40%|████      | 230/572 [07:33<10:39,  1.87s/it]
Eval test_s:  40%|████      | 231/572 [07:35<10:37,  1.87s/it]
Eval test_s:  41%|████      | 232/572 [07:37<10:36,  1.87s/it]
Eval test_s:  41%|████      | 233/572 [07:39<10:32,  1.87s/it]
Eval test_s:  41%|████      | 234/572 [07:41<10:28,  1.86s/it]
Eval test_s:  41%|████      | 235/572 [07:43<10:25,  1.86s/it]
Eval test_s:  41%|████▏     | 236/572 [07:44<10:01,  1.79s/it]
Eval test_s:  41%|████▏     | 237/572 [07:46<10:09,  1.82s/it]
Eval test_s:  42%|████▏     | 238/572 [07:48<10:15,  1.84s/it]
Eval test_s:  42%|████▏     | 239/572 [07:50<10:43,  1.93s/it]
Eval test_s:  42%|████▏     | 240/572 [07:52<10:30,  1.90s/it]
Eval test_s:  42%|████▏     | 241/572 [07:54<10:23,  1.88s/it]
Eval test_s:  42%|████▏     | 242/572 [07:56<10:18,  1.88s/it]
Eval test_s:  42%|████▏     | 243/572 [07:57<09:53,  1.80s/it]
Eval test_s:  43%|████▎     | 244/572 [07:59<09:55,  1.82s/it]
Eval test_s:  43%|████▎     | 245/572 [08:01<10:20,  1.90s/it]
Eval test_s:  43%|████▎     | 246/572 [08:03<10:15,  1.89s/it]
Eval test_s:  43%|████▎     | 247/572 [08:05<10:12,  1.88s/it]
Eval test_s:  43%|████▎     | 248/572 [08:07<09:45,  1.81s/it]
Eval test_s:  44%|████▎     | 249/572 [08:09<10:15,  1.91s/it]
Eval test_s:  44%|████▎     | 250/572 [08:11<10:10,  1.89s/it]
Eval test_s:  44%|████▍     | 251/572 [08:13<10:08,  1.90s/it]
Eval test_s:  44%|████▍     | 252/572 [08:14<10:01,  1.88s/it]
Eval test_s:  44%|████▍     | 253/572 [08:16<09:57,  1.87s/it]
Eval test_s:  44%|████▍     | 254/572 [08:18<09:55,  1.87s/it]
Eval test_s:  45%|████▍     | 255/572 [08:20<09:36,  1.82s/it]
Eval test_s:  45%|████▍     | 256/572 [08:22<09:42,  1.84s/it]
Eval test_s:  45%|████▍     | 257/572 [08:24<09:54,  1.89s/it]
Eval test_s:  45%|████▌     | 258/572 [08:26<09:47,  1.87s/it]
Eval test_s:  45%|████▌     | 259/572 [08:27<09:44,  1.87s/it]
Eval test_s:  45%|████▌     | 260/572 [08:29<09:38,  1.86s/it]
Eval test_s:  46%|████▌     | 261/572 [08:31<09:34,  1.85s/it]
Eval test_s:  46%|████▌     | 262/572 [08:33<09:32,  1.85s/it]
Eval test_s:  46%|████▌     | 263/572 [08:35<09:31,  1.85s/it]
Eval test_s:  46%|████▌     | 264/572 [08:37<09:31,  1.86s/it]
Eval test_s:  46%|████▋     | 265/572 [08:39<09:31,  1.86s/it]
Eval test_s:  47%|████▋     | 266/572 [08:40<09:27,  1.85s/it]
Eval test_s:  47%|████▋     | 267/572 [08:42<09:28,  1.86s/it]
Eval test_s:  47%|████▋     | 268/572 [08:44<09:26,  1.86s/it]
Eval test_s:  47%|████▋     | 269/572 [08:46<09:19,  1.85s/it]
Eval test_s:  47%|████▋     | 270/572 [08:48<09:18,  1.85s/it]
Eval test_s:  47%|████▋     | 271/572 [08:49<08:59,  1.79s/it]
Eval test_s:  48%|████▊     | 272/572 [08:52<09:28,  1.90s/it]
Eval test_s:  48%|████▊     | 273/572 [08:53<09:25,  1.89s/it]
Eval test_s:  48%|████▊     | 274/572 [08:55<08:57,  1.80s/it]
Eval test_s:  48%|████▊     | 275/572 [08:57<09:25,  1.90s/it]
Eval test_s:  48%|████▊     | 276/572 [08:59<09:20,  1.89s/it]
Eval test_s:  48%|████▊     | 277/572 [09:01<10:02,  2.04s/it]
Eval test_s:  49%|████▊     | 278/572 [09:03<09:44,  1.99s/it]
Eval test_s:  49%|████▉     | 279/572 [09:05<09:32,  1.95s/it]
Eval test_s:  49%|████▉     | 280/572 [09:07<09:25,  1.94s/it]
Eval test_s:  49%|████▉     | 281/572 [09:09<09:20,  1.93s/it]
Eval test_s:  49%|████▉     | 282/572 [09:11<09:13,  1.91s/it]
Eval test_s:  49%|████▉     | 283/572 [09:13<09:07,  1.89s/it]
Eval test_s:  50%|████▉     | 284/572 [09:15<09:00,  1.88s/it]
Eval test_s:  50%|████▉     | 285/572 [09:16<08:57,  1.87s/it]
Eval test_s:  50%|█████     | 286/572 [09:18<08:48,  1.85s/it]
Eval test_s:  50%|█████     | 287/572 [09:20<08:27,  1.78s/it]
Eval test_s:  50%|█████     | 288/572 [09:22<08:29,  1.79s/it]
Eval test_s:  51%|█████     | 289/572 [09:24<08:57,  1.90s/it]
Eval test_s:  51%|█████     | 290/572 [09:26<08:50,  1.88s/it]
Eval test_s:  51%|█████     | 291/572 [09:27<08:27,  1.81s/it]
Eval test_s:  51%|█████     | 292/572 [09:29<08:46,  1.88s/it]
Eval test_s:  51%|█████     | 293/572 [09:32<10:27,  2.25s/it]
Eval test_s:  51%|█████▏    | 294/572 [09:35<11:29,  2.48s/it]
Eval test_s:  52%|█████▏    | 295/572 [09:37<10:39,  2.31s/it]
Eval test_s:  52%|█████▏    | 296/572 [09:39<09:58,  2.17s/it]
Eval test_s:  52%|█████▏    | 297/572 [09:41<09:29,  2.07s/it]
Eval test_s:  52%|█████▏    | 298/572 [09:43<09:11,  2.01s/it]
Eval test_s:  52%|█████▏    | 299/572 [09:45<08:57,  1.97s/it]
Eval test_s:  52%|█████▏    | 300/572 [09:47<08:48,  1.94s/it]
Eval test_s:  53%|█████▎    | 301/572 [09:49<08:40,  1.92s/it]
Eval test_s:  53%|█████▎    | 302/572 [09:50<08:31,  1.90s/it]
Eval test_s:  53%|█████▎    | 303/572 [09:52<08:24,  1.88s/it]
Eval test_s:  53%|█████▎    | 304/572 [09:54<08:24,  1.88s/it]
Eval test_s:  53%|█████▎    | 305/572 [09:56<08:18,  1.87s/it]
Eval test_s:  53%|█████▎    | 306/572 [09:58<08:16,  1.87s/it]
Eval test_s:  54%|█████▎    | 307/572 [10:00<08:15,  1.87s/it]
Eval test_s:  54%|█████▍    | 308/572 [10:02<08:11,  1.86s/it]
Eval test_s:  54%|█████▍    | 309/572 [10:03<08:07,  1.85s/it]
Eval test_s:  54%|█████▍    | 310/572 [10:05<08:05,  1.85s/it]
Eval test_s:  54%|█████▍    | 311/572 [10:07<08:02,  1.85s/it]
Eval test_s:  55%|█████▍    | 312/572 [10:09<07:42,  1.78s/it]
Eval test_s:  55%|█████▍    | 313/572 [10:11<07:45,  1.80s/it]
Eval test_s:  55%|█████▍    | 314/572 [10:13<08:05,  1.88s/it]
Eval test_s:  55%|█████▌    | 315/572 [10:14<08:01,  1.87s/it]
Eval test_s:  55%|█████▌    | 316/572 [10:16<07:39,  1.80s/it]
Eval test_s:  55%|█████▌    | 317/572 [10:18<08:01,  1.89s/it]
Eval test_s:  56%|█████▌    | 318/572 [10:20<07:57,  1.88s/it]
Eval test_s:  56%|█████▌    | 319/572 [10:22<07:53,  1.87s/it]
Eval test_s:  56%|█████▌    | 320/572 [10:24<07:53,  1.88s/it]
Eval test_s:  56%|█████▌    | 321/572 [10:26<07:47,  1.86s/it]
Eval test_s:  56%|█████▋    | 322/572 [10:27<07:43,  1.85s/it]
Eval test_s:  56%|█████▋    | 323/572 [10:29<07:25,  1.79s/it]
Eval test_s:  57%|█████▋    | 324/572 [10:31<07:23,  1.79s/it]
Eval test_s:  57%|█████▋    | 325/572 [10:33<07:28,  1.82s/it]
Eval test_s:  57%|█████▋    | 326/572 [10:35<07:50,  1.91s/it]
Eval test_s:  57%|█████▋    | 327/572 [10:37<07:44,  1.89s/it]
Eval test_s:  57%|█████▋    | 328/572 [10:39<07:39,  1.88s/it]
Eval test_s:  58%|█████▊    | 329/572 [10:40<07:34,  1.87s/it]
Eval test_s:  58%|█████▊    | 330/572 [10:42<07:32,  1.87s/it]
Eval test_s:  58%|█████▊    | 331/572 [10:44<07:29,  1.86s/it]
Eval test_s:  58%|█████▊    | 332/572 [10:46<07:27,  1.86s/it]
Eval test_s:  58%|█████▊    | 333/572 [10:48<07:23,  1.86s/it]
Eval test_s:  58%|█████▊    | 334/572 [10:51<08:42,  2.19s/it]
Eval test_s:  59%|█████▊    | 335/572 [10:53<08:35,  2.17s/it]
Eval test_s:  59%|█████▊    | 336/572 [10:55<07:54,  2.01s/it]
Eval test_s:  59%|█████▉    | 337/572 [10:56<07:26,  1.90s/it]
Eval test_s:  59%|█████▉    | 338/572 [10:59<08:01,  2.06s/it]
Eval test_s:  59%|█████▉    | 339/572 [11:00<07:29,  1.93s/it]
Eval test_s:  59%|█████▉    | 340/572 [11:03<08:09,  2.11s/it]
Eval test_s:  60%|█████▉    | 341/572 [11:05<07:52,  2.05s/it]
Eval test_s:  60%|█████▉    | 342/572 [11:08<09:34,  2.50s/it]
Eval test_s:  60%|█████▉    | 343/572 [11:10<08:57,  2.35s/it]
Eval test_s:  60%|██████    | 344/572 [11:12<08:20,  2.20s/it]
Eval test_s:  60%|██████    | 345/572 [11:14<07:38,  2.02s/it]
Eval test_s:  60%|██████    | 346/572 [11:16<07:25,  1.97s/it]
Eval test_s:  61%|██████    | 347/572 [11:18<07:29,  2.00s/it]
Eval test_s:  61%|██████    | 348/572 [11:20<07:28,  2.00s/it]
Eval test_s:  61%|██████    | 349/572 [11:22<07:18,  1.97s/it]
Eval test_s:  61%|██████    | 350/572 [11:23<07:08,  1.93s/it]
Eval test_s:  61%|██████▏   | 351/572 [11:25<06:59,  1.90s/it]
Eval test_s:  62%|██████▏   | 352/572 [11:27<06:55,  1.89s/it]
Eval test_s:  62%|██████▏   | 353/572 [11:29<06:51,  1.88s/it]
Eval test_s:  62%|██████▏   | 354/572 [11:31<06:46,  1.86s/it]
Eval test_s:  62%|██████▏   | 355/572 [11:32<06:30,  1.80s/it]
Eval test_s:  62%|██████▏   | 356/572 [11:34<06:35,  1.83s/it]
Eval test_s:  62%|██████▏   | 357/572 [11:36<06:52,  1.92s/it]
Eval test_s:  63%|██████▎   | 358/572 [11:38<06:45,  1.89s/it]
Eval test_s:  63%|██████▎   | 359/572 [11:40<06:40,  1.88s/it]
Eval test_s:  63%|██████▎   | 360/572 [11:42<06:37,  1.88s/it]
Eval test_s:  63%|██████▎   | 361/572 [11:44<06:33,  1.87s/it]
Eval test_s:  63%|██████▎   | 362/572 [11:46<06:30,  1.86s/it]
Eval test_s:  63%|██████▎   | 363/572 [11:47<06:26,  1.85s/it]
Eval test_s:  64%|██████▎   | 364/572 [11:49<06:25,  1.86s/it]
Eval test_s:  64%|██████▍   | 365/572 [11:51<06:24,  1.86s/it]
Eval test_s:  64%|██████▍   | 366/572 [11:53<06:21,  1.85s/it]
Eval test_s:  64%|██████▍   | 367/572 [11:55<06:17,  1.84s/it]
Eval test_s:  64%|██████▍   | 368/572 [11:57<06:16,  1.85s/it]
Eval test_s:  65%|██████▍   | 369/572 [11:59<06:12,  1.84s/it]
Eval test_s:  65%|██████▍   | 370/572 [12:00<06:09,  1.83s/it]
Eval test_s:  65%|██████▍   | 371/572 [12:02<06:06,  1.83s/it]
Eval test_s:  65%|██████▌   | 372/572 [12:04<06:06,  1.83s/it]
Eval test_s:  65%|██████▌   | 373/572 [12:06<06:03,  1.82s/it]
Eval test_s:  65%|██████▌   | 374/572 [12:08<06:00,  1.82s/it]
Eval test_s:  66%|██████▌   | 375/572 [12:09<05:45,  1.76s/it]
Eval test_s:  66%|██████▌   | 376/572 [12:11<06:03,  1.85s/it]
Eval test_s:  66%|██████▌   | 377/572 [12:13<06:02,  1.86s/it]
Eval test_s:  66%|██████▌   | 378/572 [12:15<06:00,  1.86s/it]
Eval test_s:  66%|██████▋   | 379/572 [12:17<05:58,  1.86s/it]
Eval test_s:  66%|██████▋   | 380/572 [12:19<05:54,  1.85s/it]
Eval test_s:  67%|██████▋   | 381/572 [12:21<05:52,  1.85s/it]
Eval test_s:  67%|██████▋   | 382/572 [12:22<05:50,  1.85s/it]
Eval test_s:  67%|██████▋   | 383/572 [12:24<05:47,  1.84s/it]
Eval test_s:  67%|██████▋   | 384/572 [12:26<05:47,  1.85s/it]
Eval test_s:  67%|██████▋   | 385/572 [12:28<05:44,  1.84s/it]
Eval test_s:  67%|██████▋   | 386/572 [12:30<05:40,  1.83s/it]
Eval test_s:  68%|██████▊   | 387/572 [12:32<05:40,  1.84s/it]
Eval test_s:  68%|██████▊   | 388/572 [12:33<05:39,  1.84s/it]
Eval test_s:  68%|██████▊   | 389/572 [12:35<05:37,  1.84s/it]
Eval test_s:  68%|██████▊   | 390/572 [12:37<05:35,  1.84s/it]
Eval test_s:  68%|██████▊   | 391/572 [12:39<05:32,  1.84s/it]
Eval test_s:  69%|██████▊   | 392/572 [12:41<05:32,  1.85s/it]
Eval test_s:  69%|██████▊   | 393/572 [12:42<05:18,  1.78s/it]
Eval test_s:  69%|██████▉   | 394/572 [12:44<05:23,  1.82s/it]
Eval test_s:  69%|██████▉   | 395/572 [12:46<05:32,  1.88s/it]
Eval test_s:  69%|██████▉   | 396/572 [12:48<05:29,  1.87s/it]
Eval test_s:  69%|██████▉   | 397/572 [12:50<05:25,  1.86s/it]
Eval test_s:  70%|██████▉   | 398/572 [12:52<05:23,  1.86s/it]
Eval test_s:  70%|██████▉   | 399/572 [12:54<05:21,  1.86s/it]
Eval test_s:  70%|██████▉   | 400/572 [12:56<05:20,  1.86s/it]
Eval test_s:  70%|███████   | 401/572 [12:57<05:08,  1.80s/it]
Eval test_s:  70%|███████   | 402/572 [12:59<05:25,  1.91s/it]
Eval test_s:  70%|███████   | 403/572 [13:01<05:21,  1.90s/it]
Eval test_s:  71%|███████   | 404/572 [13:03<05:18,  1.90s/it]
Eval test_s:  71%|███████   | 405/572 [13:05<05:03,  1.82s/it]
Eval test_s:  71%|███████   | 406/572 [13:07<05:05,  1.84s/it]
Eval test_s:  71%|███████   | 407/572 [13:09<05:06,  1.86s/it]
Eval test_s:  71%|███████▏  | 408/572 [13:11<05:16,  1.93s/it]
Eval test_s:  72%|███████▏  | 409/572 [13:13<05:12,  1.92s/it]
Eval test_s:  72%|███████▏  | 410/572 [13:15<05:09,  1.91s/it]
Eval test_s:  72%|███████▏  | 411/572 [13:16<05:04,  1.89s/it]
Eval test_s:  72%|███████▏  | 412/572 [13:18<05:02,  1.89s/it]
Eval test_s:  72%|███████▏  | 413/572 [13:20<04:59,  1.88s/it]
Eval test_s:  72%|███████▏  | 414/572 [13:22<04:56,  1.88s/it]
Eval test_s:  73%|███████▎  | 415/572 [13:24<04:53,  1.87s/it]
Eval test_s:  73%|███████▎  | 416/572 [13:25<04:40,  1.80s/it]
Eval test_s:  73%|███████▎  | 417/572 [13:28<04:56,  1.91s/it]
Eval test_s:  73%|███████▎  | 418/572 [13:30<04:51,  1.90s/it]
Eval test_s:  73%|███████▎  | 419/572 [13:31<04:47,  1.88s/it]
Eval test_s:  73%|███████▎  | 420/572 [13:33<04:43,  1.86s/it]
Eval test_s:  74%|███████▎  | 421/572 [13:35<04:41,  1.86s/it]
Eval test_s:  74%|███████▍  | 422/572 [13:37<04:39,  1.86s/it]
Eval test_s:  74%|███████▍  | 423/572 [13:39<04:37,  1.86s/it]
Eval test_s:  74%|███████▍  | 424/572 [13:41<04:36,  1.87s/it]
Eval test_s:  74%|███████▍  | 425/572 [13:42<04:23,  1.80s/it]
Eval test_s:  74%|███████▍  | 426/572 [13:44<04:32,  1.86s/it]
Eval test_s:  75%|███████▍  | 427/572 [13:46<04:28,  1.85s/it]
Eval test_s:  75%|███████▍  | 428/572 [13:48<04:27,  1.86s/it]
Eval test_s:  75%|███████▌  | 429/572 [13:50<04:26,  1.86s/it]
Eval test_s:  75%|███████▌  | 430/572 [13:52<04:24,  1.86s/it]
Eval test_s:  75%|███████▌  | 431/572 [13:53<04:12,  1.79s/it]
Eval test_s:  76%|███████▌  | 432/572 [13:55<04:13,  1.81s/it]
Eval test_s:  76%|███████▌  | 433/572 [13:57<04:23,  1.90s/it]
Eval test_s:  76%|███████▌  | 434/572 [13:59<04:20,  1.89s/it]
Eval test_s:  76%|███████▌  | 435/572 [14:01<04:17,  1.88s/it]
Eval test_s:  76%|███████▌  | 436/572 [14:03<04:16,  1.88s/it]
Eval test_s:  76%|███████▋  | 437/572 [14:05<04:13,  1.87s/it]
Eval test_s:  77%|███████▋  | 438/572 [14:06<04:01,  1.80s/it]
Eval test_s:  77%|███████▋  | 439/572 [14:08<04:02,  1.82s/it]
Eval test_s:  77%|███████▋  | 440/572 [14:10<04:02,  1.84s/it]
Eval test_s:  77%|███████▋  | 441/572 [14:12<04:02,  1.85s/it]
Eval test_s:  77%|███████▋  | 442/572 [14:14<04:11,  1.93s/it]
Eval test_s:  77%|███████▋  | 443/572 [14:16<04:06,  1.91s/it]
Eval test_s:  78%|███████▊  | 444/572 [14:18<03:53,  1.83s/it]
Eval test_s:  78%|███████▊  | 445/572 [14:19<03:44,  1.76s/it]
Eval test_s:  78%|███████▊  | 446/572 [14:21<03:46,  1.80s/it]
Eval test_s:  78%|███████▊  | 447/572 [14:23<03:46,  1.81s/it]
Eval test_s:  78%|███████▊  | 448/572 [14:25<03:51,  1.87s/it]
Eval test_s:  78%|███████▊  | 449/572 [14:27<03:40,  1.79s/it]
Eval test_s:  79%|███████▊  | 450/572 [14:29<04:07,  2.03s/it]
Eval test_s:  79%|███████▉  | 451/572 [14:33<05:14,  2.60s/it]
Eval test_s:  79%|███████▉  | 452/572 [14:36<05:04,  2.54s/it]
Eval test_s:  79%|███████▉  | 453/572 [14:37<04:32,  2.29s/it]
Eval test_s:  79%|███████▉  | 454/572 [14:39<04:16,  2.18s/it]
Eval test_s:  80%|███████▉  | 455/572 [14:41<03:55,  2.02s/it]
Eval test_s:  80%|███████▉  | 456/572 [14:43<04:06,  2.12s/it]
Eval test_s:  80%|███████▉  | 457/572 [14:45<03:47,  1.98s/it]
Eval test_s:  80%|████████  | 458/572 [14:47<03:43,  1.96s/it]
Eval test_s:  80%|████████  | 459/572 [14:49<03:48,  2.02s/it]
Eval test_s:  80%|████████  | 460/572 [14:51<03:33,  1.91s/it]
Eval test_s:  81%|████████  | 461/572 [14:53<03:39,  1.98s/it]
Eval test_s:  81%|████████  | 462/572 [14:55<03:35,  1.96s/it]
Eval test_s:  81%|████████  | 463/572 [14:56<03:29,  1.92s/it]
Eval test_s:  81%|████████  | 464/572 [14:58<03:28,  1.93s/it]
Eval test_s:  81%|████████▏ | 465/572 [15:00<03:24,  1.91s/it]
Eval test_s:  81%|████████▏ | 466/572 [15:02<03:22,  1.91s/it]
Eval test_s:  82%|████████▏ | 467/572 [15:04<03:20,  1.91s/it]
Eval test_s:  82%|████████▏ | 468/572 [15:06<03:18,  1.91s/it]
Eval test_s:  82%|████████▏ | 469/572 [15:08<03:08,  1.83s/it]
Eval test_s:  82%|████████▏ | 470/572 [15:09<03:08,  1.85s/it]
Eval test_s:  82%|████████▏ | 471/572 [15:12<03:14,  1.92s/it]
Eval test_s:  83%|████████▎ | 472/572 [15:13<03:11,  1.92s/it]
Eval test_s:  83%|████████▎ | 473/572 [15:15<03:02,  1.84s/it]
Eval test_s:  83%|████████▎ | 474/572 [15:17<03:08,  1.92s/it]
Eval test_s:  83%|████████▎ | 475/572 [15:19<03:04,  1.91s/it]
Eval test_s:  83%|████████▎ | 476/572 [15:21<03:02,  1.90s/it]
Eval test_s:  83%|████████▎ | 477/572 [15:23<02:59,  1.89s/it]
Eval test_s:  84%|████████▎ | 478/572 [15:25<02:50,  1.81s/it]
Eval test_s:  84%|████████▎ | 479/572 [15:27<02:56,  1.89s/it]
Eval test_s:  84%|████████▍ | 480/572 [15:28<02:53,  1.88s/it]
Eval test_s:  84%|████████▍ | 481/572 [15:30<02:50,  1.88s/it]
Eval test_s:  84%|████████▍ | 482/572 [15:32<02:49,  1.88s/it]
Eval test_s:  84%|████████▍ | 483/572 [15:34<02:47,  1.88s/it]
Eval test_s:  85%|████████▍ | 484/572 [15:36<02:44,  1.87s/it]
Eval test_s:  85%|████████▍ | 485/572 [15:38<02:41,  1.86s/it]
Eval test_s:  85%|████████▍ | 486/572 [15:40<02:39,  1.86s/it]
Eval test_s:  85%|████████▌ | 487/572 [15:42<02:38,  1.86s/it]
Eval test_s:  85%|████████▌ | 488/572 [15:43<02:29,  1.78s/it]
Eval test_s:  85%|████████▌ | 489/572 [15:45<02:34,  1.86s/it]
Eval test_s:  86%|████████▌ | 490/572 [15:47<02:31,  1.85s/it]
Eval test_s:  86%|████████▌ | 491/572 [15:49<02:30,  1.86s/it]
Eval test_s:  86%|████████▌ | 492/572 [15:51<02:28,  1.85s/it]
Eval test_s:  86%|████████▌ | 493/572 [15:52<02:21,  1.79s/it]
Eval test_s:  86%|████████▋ | 494/572 [15:54<02:22,  1.83s/it]
Eval test_s:  87%|████████▋ | 495/572 [15:56<02:29,  1.94s/it]
Eval test_s:  87%|████████▋ | 496/572 [15:58<02:26,  1.92s/it]
Eval test_s:  87%|████████▋ | 497/572 [16:00<02:22,  1.91s/it]
Eval test_s:  87%|████████▋ | 498/572 [16:02<02:15,  1.83s/it]
Eval test_s:  87%|████████▋ | 499/572 [16:04<02:14,  1.84s/it]
Eval test_s:  87%|████████▋ | 500/572 [16:06<02:14,  1.86s/it]
Eval test_s:  88%|████████▊ | 501/572 [16:08<02:17,  1.94s/it]
Eval test_s:  88%|████████▊ | 502/572 [16:10<02:13,  1.91s/it]
Eval test_s:  88%|████████▊ | 503/572 [16:11<02:10,  1.89s/it]
Eval test_s:  88%|████████▊ | 504/572 [16:13<02:07,  1.88s/it]
Eval test_s:  88%|████████▊ | 505/572 [16:15<02:06,  1.88s/it]
Eval test_s:  88%|████████▊ | 506/572 [16:17<02:03,  1.88s/it]
Eval test_s:  89%|████████▊ | 507/572 [16:19<02:01,  1.87s/it]
Eval test_s:  89%|████████▉ | 508/572 [16:21<01:59,  1.87s/it]
Eval test_s:  89%|████████▉ | 509/572 [16:23<01:58,  1.88s/it]
Eval test_s:  89%|████████▉ | 510/572 [16:24<01:53,  1.83s/it]
Eval test_s:  89%|████████▉ | 511/572 [16:26<01:52,  1.85s/it]
Eval test_s:  90%|████████▉ | 512/572 [16:28<01:56,  1.94s/it]
Eval test_s:  90%|████████▉ | 513/572 [16:30<01:52,  1.91s/it]
Eval test_s:  90%|████████▉ | 514/572 [16:32<01:49,  1.88s/it]
Eval test_s:  90%|█████████ | 515/572 [16:34<01:46,  1.88s/it]
Eval test_s:  90%|█████████ | 516/572 [16:36<01:40,  1.80s/it]
Eval test_s:  90%|█████████ | 517/572 [16:38<01:44,  1.90s/it]
Eval test_s:  91%|█████████ | 518/572 [16:40<01:42,  1.89s/it]
Eval test_s:  91%|█████████ | 519/572 [16:41<01:40,  1.89s/it]
Eval test_s:  91%|█████████ | 520/572 [16:43<01:33,  1.80s/it]
Eval test_s:  91%|█████████ | 521/572 [16:45<01:36,  1.88s/it]
Eval test_s:  91%|█████████▏| 522/572 [16:47<01:33,  1.87s/it]
Eval test_s:  91%|█████████▏| 523/572 [16:49<01:31,  1.87s/it]
Eval test_s:  92%|█████████▏| 524/572 [16:51<01:29,  1.87s/it]
Eval test_s:  92%|█████████▏| 525/572 [16:53<01:27,  1.86s/it]
Eval test_s:  92%|█████████▏| 526/572 [16:54<01:25,  1.85s/it]
Eval test_s:  92%|█████████▏| 527/572 [16:56<01:20,  1.79s/it]
Eval test_s:  92%|█████████▏| 528/572 [16:58<01:20,  1.82s/it]
Eval test_s:  92%|█████████▏| 529/572 [17:00<01:20,  1.87s/it]
Eval test_s:  93%|█████████▎| 530/572 [17:02<01:18,  1.87s/it]
Eval test_s:  93%|█████████▎| 531/572 [17:04<01:16,  1.86s/it]
Eval test_s:  93%|█████████▎| 532/572 [17:06<01:14,  1.87s/it]
Eval test_s:  93%|█████████▎| 533/572 [17:07<01:12,  1.86s/it]
Eval test_s:  93%|█████████▎| 534/572 [17:09<01:10,  1.86s/it]
Eval test_s:  94%|█████████▎| 535/572 [17:11<01:09,  1.87s/it]
Eval test_s:  94%|█████████▎| 536/572 [17:13<01:07,  1.87s/it]
Eval test_s:  94%|█████████▍| 537/572 [17:15<01:05,  1.88s/it]
Eval test_s:  94%|█████████▍| 538/572 [17:17<01:03,  1.86s/it]
Eval test_s:  94%|█████████▍| 539/572 [17:19<01:01,  1.86s/it]
Eval test_s:  94%|█████████▍| 540/572 [17:20<00:59,  1.85s/it]
Eval test_s:  95%|█████████▍| 541/572 [17:22<00:57,  1.85s/it]
Eval test_s:  95%|█████████▍| 542/572 [17:24<00:53,  1.77s/it]
Eval test_s:  95%|█████████▍| 543/572 [17:26<00:52,  1.81s/it]
Eval test_s:  95%|█████████▌| 544/572 [17:28<00:53,  1.90s/it]
Eval test_s:  95%|█████████▌| 545/572 [17:29<00:49,  1.83s/it]
Eval test_s:  95%|█████████▌| 546/572 [17:31<00:48,  1.85s/it]
Eval test_s:  96%|█████████▌| 547/572 [17:33<00:47,  1.91s/it]
Eval test_s:  96%|█████████▌| 548/572 [17:35<00:45,  1.89s/it]
Eval test_s:  96%|█████████▌| 549/572 [17:37<00:43,  1.89s/it]
Eval test_s:  96%|█████████▌| 550/572 [17:39<00:41,  1.88s/it]
Eval test_s:  96%|█████████▋| 551/572 [17:41<00:39,  1.86s/it]
Eval test_s:  97%|█████████▋| 552/572 [17:43<00:37,  1.87s/it]
Eval test_s:  97%|█████████▋| 553/572 [17:45<00:35,  1.86s/it]
Eval test_s:  97%|█████████▋| 554/572 [17:46<00:33,  1.86s/it]
Eval test_s:  97%|█████████▋| 555/572 [17:48<00:30,  1.79s/it]
Eval test_s:  97%|█████████▋| 556/572 [17:50<00:28,  1.79s/it]
Eval test_s:  97%|█████████▋| 557/572 [17:52<00:28,  1.89s/it]
Eval test_s:  98%|█████████▊| 558/572 [17:54<00:26,  1.90s/it]
Eval test_s:  98%|█████████▊| 559/572 [17:56<00:25,  1.96s/it]
Eval test_s:  98%|█████████▊| 560/572 [17:58<00:23,  1.92s/it]
Eval test_s:  98%|█████████▊| 561/572 [18:00<00:21,  1.91s/it]
Eval test_s:  98%|█████████▊| 562/572 [18:03<00:23,  2.34s/it]
Eval test_s:  98%|█████████▊| 563/572 [18:05<00:20,  2.32s/it]
Eval test_s:  99%|█████████▊| 564/572 [18:07<00:17,  2.17s/it]
Eval test_s:  99%|█████████▉| 565/572 [18:09<00:14,  2.09s/it]
Eval test_s:  99%|█████████▉| 566/572 [18:11<00:11,  1.95s/it]
Eval test_s:  99%|█████████▉| 567/572 [18:12<00:09,  1.87s/it]
Eval test_s:  99%|█████████▉| 568/572 [18:14<00:07,  1.81s/it]
Eval test_s:  99%|█████████▉| 569/572 [18:16<00:05,  1.77s/it]
Eval test_s: 100%|█████████▉| 570/572 [18:17<00:03,  1.74s/it]
Eval test_s: 100%|█████████▉| 571/572 [18:19<00:01,  1.73s/it]
Eval test_s: 100%|██████████| 572/572 [18:21<00:00,  1.72s/it]
                                                              
  [test_s]  mIoU=0.7066  F=0.8005

Eval test_u:   0%|          | 0/414 [00:00<?, ?it/s]
Eval test_u:   0%|          | 1/414 [00:19<2:14:53, 19.60s/it]
Eval test_u:   0%|          | 2/414 [00:21<1:04:16,  9.36s/it]
Eval test_u:   1%|          | 3/414 [00:23<40:37,  5.93s/it]  
Eval test_u:   1%|          | 4/414 [00:25<29:26,  4.31s/it]
Eval test_u:   1%|          | 5/414 [00:27<23:28,  3.44s/it]
Eval test_u:   1%|▏         | 6/414 [00:29<19:47,  2.91s/it]
Eval test_u:   2%|▏         | 7/414 [00:31<17:23,  2.56s/it]
Eval test_u:   2%|▏         | 8/414 [00:32<15:46,  2.33s/it]
Eval test_u:   2%|▏         | 9/414 [00:34<14:50,  2.20s/it]
Eval test_u:   2%|▏         | 10/414 [00:36<14:08,  2.10s/it]
Eval test_u:   3%|▎         | 11/414 [00:38<13:31,  2.01s/it]
Eval test_u:   3%|▎         | 12/414 [00:40<13:08,  1.96s/it]
Eval test_u:   3%|▎         | 13/414 [00:42<12:49,  1.92s/it]
Eval test_u:   3%|▎         | 14/414 [00:44<12:41,  1.90s/it]
Eval test_u:   4%|▎         | 15/414 [00:45<12:32,  1.88s/it]
Eval test_u:   4%|▍         | 16/414 [00:47<12:26,  1.88s/it]
Eval test_u:   4%|▍         | 17/414 [00:49<12:27,  1.88s/it]
Eval test_u:   4%|▍         | 18/414 [00:51<12:19,  1.87s/it]
Eval test_u:   5%|▍         | 19/414 [00:53<12:18,  1.87s/it]
Eval test_u:   5%|▍         | 20/414 [00:55<12:13,  1.86s/it]
Eval test_u:   5%|▌         | 21/414 [00:57<12:11,  1.86s/it]
Eval test_u:   5%|▌         | 22/414 [00:58<12:10,  1.86s/it]
Eval test_u:   6%|▌         | 23/414 [01:00<12:08,  1.86s/it]
Eval test_u:   6%|▌         | 24/414 [01:02<12:06,  1.86s/it]
Eval test_u:   6%|▌         | 25/414 [01:04<12:04,  1.86s/it]
Eval test_u:   6%|▋         | 26/414 [01:06<12:02,  1.86s/it]
Eval test_u:   7%|▋         | 27/414 [01:08<11:59,  1.86s/it]
Eval test_u:   7%|▋         | 28/414 [01:10<11:56,  1.86s/it]
Eval test_u:   7%|▋         | 29/414 [01:11<11:55,  1.86s/it]
Eval test_u:   7%|▋         | 30/414 [01:13<11:57,  1.87s/it]
Eval test_u:   7%|▋         | 31/414 [01:15<11:55,  1.87s/it]
Eval test_u:   8%|▊         | 32/414 [01:17<11:49,  1.86s/it]
Eval test_u:   8%|▊         | 33/414 [01:19<11:43,  1.85s/it]
Eval test_u:   8%|▊         | 34/414 [01:21<11:43,  1.85s/it]
Eval test_u:   8%|▊         | 35/414 [01:23<11:42,  1.85s/it]
Eval test_u:   9%|▊         | 36/414 [01:24<11:35,  1.84s/it]
Eval test_u:   9%|▉         | 37/414 [01:26<11:29,  1.83s/it]
Eval test_u:   9%|▉         | 38/414 [01:28<11:30,  1.84s/it]
Eval test_u:   9%|▉         | 39/414 [01:30<11:30,  1.84s/it]
Eval test_u:  10%|▉         | 40/414 [01:32<11:28,  1.84s/it]
Eval test_u:  10%|▉         | 41/414 [01:34<11:29,  1.85s/it]
Eval test_u:  10%|█         | 42/414 [01:35<11:29,  1.85s/it]
Eval test_u:  10%|█         | 43/414 [01:37<11:31,  1.86s/it]
Eval test_u:  11%|█         | 44/414 [01:39<11:29,  1.86s/it]
Eval test_u:  11%|█         | 45/414 [01:41<11:29,  1.87s/it]
Eval test_u:  11%|█         | 46/414 [01:43<11:19,  1.85s/it]
Eval test_u:  11%|█▏        | 47/414 [01:45<11:11,  1.83s/it]
Eval test_u:  12%|█▏        | 48/414 [01:47<11:10,  1.83s/it]
Eval test_u:  12%|█▏        | 49/414 [01:48<11:10,  1.84s/it]
Eval test_u:  12%|█▏        | 50/414 [01:50<11:15,  1.86s/it]
Eval test_u:  12%|█▏        | 51/414 [01:52<11:10,  1.85s/it]
Eval test_u:  13%|█▎        | 52/414 [01:54<11:10,  1.85s/it]
Eval test_u:  13%|█▎        | 53/414 [01:56<11:06,  1.85s/it]
Eval test_u:  13%|█▎        | 54/414 [01:58<11:06,  1.85s/it]
Eval test_u:  13%|█▎        | 55/414 [02:00<11:04,  1.85s/it]
Eval test_u:  14%|█▎        | 56/414 [02:01<10:39,  1.79s/it]
Eval test_u:  14%|█▍        | 57/414 [02:03<10:27,  1.76s/it]
Eval test_u:  14%|█▍        | 58/414 [02:05<10:33,  1.78s/it]
Eval test_u:  14%|█▍        | 59/414 [02:06<10:36,  1.79s/it]
Eval test_u:  14%|█▍        | 60/414 [02:08<10:41,  1.81s/it]
Eval test_u:  15%|█▍        | 61/414 [02:10<10:40,  1.82s/it]
Eval test_u:  15%|█▍        | 62/414 [02:12<10:40,  1.82s/it]
Eval test_u:  15%|█▌        | 63/414 [02:14<10:38,  1.82s/it]
Eval test_u:  15%|█▌        | 64/414 [02:16<10:37,  1.82s/it]
Eval test_u:  16%|█▌        | 65/414 [02:18<10:38,  1.83s/it]
Eval test_u:  16%|█▌        | 66/414 [02:19<10:34,  1.82s/it]
Eval test_u:  16%|█▌        | 67/414 [02:21<10:32,  1.82s/it]
Eval test_u:  16%|█▋        | 68/414 [02:23<10:32,  1.83s/it]
Eval test_u:  17%|█▋        | 69/414 [02:25<10:32,  1.83s/it]
Eval test_u:  17%|█▋        | 70/414 [02:27<10:31,  1.83s/it]
Eval test_u:  17%|█▋        | 71/414 [02:29<10:33,  1.85s/it]
Eval test_u:  17%|█▋        | 72/414 [02:30<10:33,  1.85s/it]
Eval test_u:  18%|█▊        | 73/414 [02:32<10:33,  1.86s/it]
Eval test_u:  18%|█▊        | 74/414 [02:34<10:27,  1.85s/it]
Eval test_u:  18%|█▊        | 75/414 [02:36<10:30,  1.86s/it]
Eval test_u:  18%|█▊        | 76/414 [02:38<10:30,  1.87s/it]
Eval test_u:  19%|█▊        | 77/414 [02:40<10:30,  1.87s/it]
Eval test_u:  19%|█▉        | 78/414 [02:42<10:27,  1.87s/it]
Eval test_u:  19%|█▉        | 79/414 [02:43<10:25,  1.87s/it]
Eval test_u:  19%|█▉        | 80/414 [02:45<10:21,  1.86s/it]
Eval test_u:  20%|█▉        | 81/414 [02:47<10:16,  1.85s/it]
Eval test_u:  20%|█▉        | 82/414 [02:49<10:12,  1.84s/it]
Eval test_u:  20%|██        | 83/414 [02:51<10:10,  1.84s/it]
Eval test_u:  20%|██        | 84/414 [02:53<10:06,  1.84s/it]
Eval test_u:  21%|██        | 85/414 [02:54<10:03,  1.84s/it]
Eval test_u:  21%|██        | 86/414 [02:56<10:02,  1.84s/it]
Eval test_u:  21%|██        | 87/414 [02:58<10:01,  1.84s/it]
Eval test_u:  21%|██▏       | 88/414 [03:00<10:03,  1.85s/it]
Eval test_u:  21%|██▏       | 89/414 [03:02<09:58,  1.84s/it]
Eval test_u:  22%|██▏       | 90/414 [03:04<09:49,  1.82s/it]
Eval test_u:  22%|██▏       | 91/414 [03:05<09:47,  1.82s/it]
Eval test_u:  22%|██▏       | 92/414 [03:07<09:43,  1.81s/it]
Eval test_u:  22%|██▏       | 93/414 [03:09<09:45,  1.82s/it]
Eval test_u:  23%|██▎       | 94/414 [03:11<09:42,  1.82s/it]
Eval test_u:  23%|██▎       | 95/414 [03:13<09:40,  1.82s/it]
Eval test_u:  23%|██▎       | 96/414 [03:15<09:42,  1.83s/it]
Eval test_u:  23%|██▎       | 97/414 [03:16<09:41,  1.84s/it]
Eval test_u:  24%|██▎       | 98/414 [03:18<09:39,  1.83s/it]
Eval test_u:  24%|██▍       | 99/414 [03:20<09:39,  1.84s/it]
Eval test_u:  24%|██▍       | 100/414 [03:22<09:38,  1.84s/it]
Eval test_u:  24%|██▍       | 101/414 [03:24<09:41,  1.86s/it]
Eval test_u:  25%|██▍       | 102/414 [03:26<09:34,  1.84s/it]
Eval test_u:  25%|██▍       | 103/414 [03:27<09:31,  1.84s/it]
Eval test_u:  25%|██▌       | 104/414 [03:29<09:24,  1.82s/it]
Eval test_u:  25%|██▌       | 105/414 [03:31<09:22,  1.82s/it]
Eval test_u:  26%|██▌       | 106/414 [03:33<09:25,  1.84s/it]
Eval test_u:  26%|██▌       | 107/414 [03:35<09:26,  1.85s/it]
Eval test_u:  26%|██▌       | 108/414 [03:37<09:25,  1.85s/it]
Eval test_u:  26%|██▋       | 109/414 [03:39<09:22,  1.84s/it]
Eval test_u:  27%|██▋       | 110/414 [03:40<09:20,  1.84s/it]
Eval test_u:  27%|██▋       | 111/414 [03:42<09:17,  1.84s/it]
Eval test_u:  27%|██▋       | 112/414 [03:44<09:19,  1.85s/it]
Eval test_u:  27%|██▋       | 113/414 [03:46<09:17,  1.85s/it]
Eval test_u:  28%|██▊       | 114/414 [03:48<09:15,  1.85s/it]
Eval test_u:  28%|██▊       | 115/414 [03:50<09:12,  1.85s/it]
Eval test_u:  28%|██▊       | 116/414 [03:51<09:10,  1.85s/it]
Eval test_u:  28%|██▊       | 117/414 [03:53<09:08,  1.85s/it]
Eval test_u:  29%|██▊       | 118/414 [03:55<09:08,  1.85s/it]
Eval test_u:  29%|██▊       | 119/414 [03:57<09:21,  1.90s/it]
Eval test_u:  29%|██▉       | 120/414 [03:59<09:15,  1.89s/it]
Eval test_u:  29%|██▉       | 121/414 [04:01<09:10,  1.88s/it]
Eval test_u:  29%|██▉       | 122/414 [04:03<09:11,  1.89s/it]
Eval test_u:  30%|██▉       | 123/414 [04:05<09:07,  1.88s/it]
Eval test_u:  30%|██▉       | 124/414 [04:07<09:05,  1.88s/it]
Eval test_u:  30%|███       | 125/414 [04:08<08:59,  1.87s/it]
Eval test_u:  30%|███       | 126/414 [04:10<08:37,  1.80s/it]
Eval test_u:  31%|███       | 127/414 [04:12<08:40,  1.81s/it]
Eval test_u:  31%|███       | 128/414 [04:14<08:42,  1.83s/it]
Eval test_u:  31%|███       | 129/414 [04:16<08:42,  1.83s/it]
Eval test_u:  31%|███▏      | 130/414 [04:17<08:40,  1.83s/it]
Eval test_u:  32%|███▏      | 131/414 [04:19<08:41,  1.84s/it]
Eval test_u:  32%|███▏      | 132/414 [04:21<08:40,  1.85s/it]
Eval test_u:  32%|███▏      | 133/414 [04:23<08:37,  1.84s/it]
Eval test_u:  32%|███▏      | 134/414 [04:25<08:35,  1.84s/it]
Eval test_u:  33%|███▎      | 135/414 [04:27<08:32,  1.84s/it]
Eval test_u:  33%|███▎      | 136/414 [04:28<08:29,  1.83s/it]
Eval test_u:  33%|███▎      | 137/414 [04:30<08:30,  1.84s/it]
Eval test_u:  33%|███▎      | 138/414 [04:32<08:28,  1.84s/it]
Eval test_u:  34%|███▎      | 139/414 [04:34<08:29,  1.85s/it]
Eval test_u:  34%|███▍      | 140/414 [04:36<08:25,  1.85s/it]
Eval test_u:  34%|███▍      | 141/414 [04:38<08:24,  1.85s/it]
Eval test_u:  34%|███▍      | 142/414 [04:40<08:21,  1.84s/it]
Eval test_u:  35%|███▍      | 143/414 [04:41<08:18,  1.84s/it]
Eval test_u:  35%|███▍      | 144/414 [04:43<08:15,  1.84s/it]
Eval test_u:  35%|███▌      | 145/414 [04:45<08:12,  1.83s/it]
Eval test_u:  35%|███▌      | 146/414 [04:47<08:13,  1.84s/it]
Eval test_u:  36%|███▌      | 147/414 [04:49<08:12,  1.84s/it]
Eval test_u:  36%|███▌      | 148/414 [04:51<08:09,  1.84s/it]
Eval test_u:  36%|███▌      | 149/414 [04:52<08:06,  1.84s/it]
Eval test_u:  36%|███▌      | 150/414 [04:54<08:05,  1.84s/it]
Eval test_u:  36%|███▋      | 151/414 [04:56<08:04,  1.84s/it]
Eval test_u:  37%|███▋      | 152/414 [04:58<07:59,  1.83s/it]
Eval test_u:  37%|███▋      | 153/414 [05:00<07:57,  1.83s/it]
Eval test_u:  37%|███▋      | 154/414 [05:02<07:57,  1.84s/it]
Eval test_u:  37%|███▋      | 155/414 [05:03<07:55,  1.83s/it]
Eval test_u:  38%|███▊      | 156/414 [05:05<07:54,  1.84s/it]
Eval test_u:  38%|███▊      | 157/414 [05:07<07:50,  1.83s/it]
Eval test_u:  38%|███▊      | 158/414 [05:09<07:48,  1.83s/it]
Eval test_u:  38%|███▊      | 159/414 [05:11<07:49,  1.84s/it]
Eval test_u:  39%|███▊      | 160/414 [05:13<07:46,  1.84s/it]
Eval test_u:  39%|███▉      | 161/414 [05:14<07:44,  1.83s/it]
Eval test_u:  39%|███▉      | 162/414 [05:16<07:42,  1.84s/it]
Eval test_u:  39%|███▉      | 163/414 [05:18<07:44,  1.85s/it]
Eval test_u:  40%|███▉      | 164/414 [05:20<07:43,  1.85s/it]
Eval test_u:  40%|███▉      | 165/414 [05:22<07:41,  1.85s/it]
Eval test_u:  40%|████      | 166/414 [05:24<07:42,  1.86s/it]
Eval test_u:  40%|████      | 167/414 [05:26<07:38,  1.86s/it]
Eval test_u:  41%|████      | 168/414 [05:27<07:40,  1.87s/it]
Eval test_u:  41%|████      | 169/414 [05:29<07:35,  1.86s/it]
Eval test_u:  41%|████      | 170/414 [05:31<07:35,  1.87s/it]
Eval test_u:  41%|████▏     | 171/414 [05:33<07:31,  1.86s/it]
Eval test_u:  42%|████▏     | 172/414 [05:35<07:27,  1.85s/it]
Eval test_u:  42%|████▏     | 173/414 [05:37<07:28,  1.86s/it]
Eval test_u:  42%|████▏     | 174/414 [05:39<07:29,  1.87s/it]
Eval test_u:  42%|████▏     | 175/414 [05:41<07:26,  1.87s/it]
Eval test_u:  43%|████▎     | 176/414 [05:42<07:22,  1.86s/it]
Eval test_u:  43%|████▎     | 177/414 [05:44<07:19,  1.86s/it]
Eval test_u:  43%|████▎     | 178/414 [05:46<07:15,  1.85s/it]
Eval test_u:  43%|████▎     | 179/414 [05:48<07:12,  1.84s/it]
Eval test_u:  43%|████▎     | 180/414 [05:50<07:02,  1.81s/it]
Eval test_u:  44%|████▎     | 181/414 [05:51<07:03,  1.82s/it]
Eval test_u:  44%|████▍     | 182/414 [05:53<07:02,  1.82s/it]
Eval test_u:  44%|████▍     | 183/414 [05:55<07:01,  1.83s/it]
Eval test_u:  44%|████▍     | 184/414 [05:57<07:00,  1.83s/it]
Eval test_u:  45%|████▍     | 185/414 [05:59<06:59,  1.83s/it]
Eval test_u:  45%|████▍     | 186/414 [06:01<06:59,  1.84s/it]
Eval test_u:  45%|████▌     | 187/414 [06:02<06:58,  1.84s/it]
Eval test_u:  45%|████▌     | 188/414 [06:04<06:59,  1.86s/it]
Eval test_u:  46%|████▌     | 189/414 [06:05<06:07,  1.63s/it]
Eval test_u:  46%|████▌     | 190/414 [06:07<06:15,  1.68s/it]
Eval test_u:  46%|████▌     | 191/414 [06:09<06:41,  1.80s/it]
Eval test_u:  46%|████▋     | 192/414 [06:11<06:48,  1.84s/it]
Eval test_u:  47%|████▋     | 193/414 [06:13<06:53,  1.87s/it]
Eval test_u:  47%|████▋     | 194/414 [06:15<06:51,  1.87s/it]
Eval test_u:  47%|████▋     | 195/414 [06:17<06:48,  1.87s/it]
Eval test_u:  47%|████▋     | 196/414 [06:19<06:45,  1.86s/it]
Eval test_u:  48%|████▊     | 197/414 [06:21<06:43,  1.86s/it]
Eval test_u:  48%|████▊     | 198/414 [06:23<06:44,  1.87s/it]
Eval test_u:  48%|████▊     | 199/414 [06:24<06:40,  1.86s/it]
Eval test_u:  48%|████▊     | 200/414 [06:26<06:40,  1.87s/it]
Eval test_u:  49%|████▊     | 201/414 [06:28<06:39,  1.88s/it]
Eval test_u:  49%|████▉     | 202/414 [06:30<06:40,  1.89s/it]
Eval test_u:  49%|████▉     | 203/414 [06:32<06:43,  1.91s/it]
Eval test_u:  49%|████▉     | 204/414 [06:34<06:25,  1.84s/it]
Eval test_u:  50%|████▉     | 205/414 [06:36<06:23,  1.84s/it]
Eval test_u:  50%|████▉     | 206/414 [06:37<06:27,  1.87s/it]
Eval test_u:  50%|█████     | 207/414 [06:39<06:23,  1.85s/it]
Eval test_u:  50%|█████     | 208/414 [06:41<06:27,  1.88s/it]
Eval test_u:  50%|█████     | 209/414 [06:43<06:23,  1.87s/it]
Eval test_u:  51%|█████     | 210/414 [06:45<06:18,  1.86s/it]
Eval test_u:  51%|█████     | 211/414 [06:47<06:15,  1.85s/it]
Eval test_u:  51%|█████     | 212/414 [06:49<06:14,  1.85s/it]
Eval test_u:  51%|█████▏    | 213/414 [06:50<06:14,  1.86s/it]
Eval test_u:  52%|█████▏    | 214/414 [06:52<06:09,  1.85s/it]
Eval test_u:  52%|█████▏    | 215/414 [06:54<06:08,  1.85s/it]
Eval test_u:  52%|█████▏    | 216/414 [06:56<06:06,  1.85s/it]
Eval test_u:  52%|█████▏    | 217/414 [06:58<06:03,  1.84s/it]
Eval test_u:  53%|█████▎    | 218/414 [07:00<06:02,  1.85s/it]
Eval test_u:  53%|█████▎    | 219/414 [07:02<06:00,  1.85s/it]
Eval test_u:  53%|█████▎    | 220/414 [07:03<05:55,  1.83s/it]
Eval test_u:  53%|█████▎    | 221/414 [07:05<05:54,  1.84s/it]
Eval test_u:  54%|█████▎    | 222/414 [07:07<05:51,  1.83s/it]
Eval test_u:  54%|█████▍    | 223/414 [07:09<05:50,  1.84s/it]
Eval test_u:  54%|█████▍    | 224/414 [07:11<05:48,  1.83s/it]
Eval test_u:  54%|█████▍    | 225/414 [07:13<05:48,  1.84s/it]
Eval test_u:  55%|█████▍    | 226/414 [07:14<05:46,  1.84s/it]
Eval test_u:  55%|█████▍    | 227/414 [07:16<05:41,  1.83s/it]
Eval test_u:  55%|█████▌    | 228/414 [07:18<05:35,  1.80s/it]
Eval test_u:  55%|█████▌    | 229/414 [07:20<05:34,  1.81s/it]
Eval test_u:  56%|█████▌    | 230/414 [07:22<05:34,  1.82s/it]
Eval test_u:  56%|█████▌    | 231/414 [07:23<05:35,  1.83s/it]
Eval test_u:  56%|█████▌    | 232/414 [07:25<05:33,  1.83s/it]
Eval test_u:  56%|█████▋    | 233/414 [07:27<05:34,  1.85s/it]
Eval test_u:  57%|█████▋    | 234/414 [07:29<05:29,  1.83s/it]
Eval test_u:  57%|█████▋    | 235/414 [07:31<05:28,  1.83s/it]
Eval test_u:  57%|█████▋    | 236/414 [07:33<05:31,  1.86s/it]
Eval test_u:  57%|█████▋    | 237/414 [07:35<05:29,  1.86s/it]
Eval test_u:  57%|█████▋    | 238/414 [07:37<05:30,  1.88s/it]
Eval test_u:  58%|█████▊    | 239/414 [07:38<05:32,  1.90s/it]
Eval test_u:  58%|█████▊    | 240/414 [07:40<05:29,  1.89s/it]
Eval test_u:  58%|█████▊    | 241/414 [07:42<05:26,  1.89s/it]
Eval test_u:  58%|█████▊    | 242/414 [07:44<05:22,  1.87s/it]
Eval test_u:  59%|█████▊    | 243/414 [07:46<05:21,  1.88s/it]
Eval test_u:  59%|█████▉    | 244/414 [07:48<05:21,  1.89s/it]
Eval test_u:  59%|█████▉    | 245/414 [07:50<05:19,  1.89s/it]
Eval test_u:  59%|█████▉    | 246/414 [07:52<05:15,  1.88s/it]
Eval test_u:  60%|█████▉    | 247/414 [07:53<05:11,  1.87s/it]
Eval test_u:  60%|█████▉    | 248/414 [07:55<05:12,  1.88s/it]
Eval test_u:  60%|██████    | 249/414 [07:57<05:08,  1.87s/it]
Eval test_u:  60%|██████    | 250/414 [07:59<05:09,  1.89s/it]
Eval test_u:  61%|██████    | 251/414 [08:01<05:07,  1.89s/it]
Eval test_u:  61%|██████    | 252/414 [08:03<05:04,  1.88s/it]
Eval test_u:  61%|██████    | 253/414 [08:05<05:02,  1.88s/it]
Eval test_u:  61%|██████▏   | 254/414 [08:07<04:59,  1.87s/it]
Eval test_u:  62%|██████▏   | 255/414 [08:08<04:56,  1.87s/it]
Eval test_u:  62%|██████▏   | 256/414 [08:10<04:53,  1.86s/it]
Eval test_u:  62%|██████▏   | 257/414 [08:12<04:51,  1.86s/it]
Eval test_u:  62%|██████▏   | 258/414 [08:14<04:48,  1.85s/it]
Eval test_u:  63%|██████▎   | 259/414 [08:16<04:49,  1.87s/it]
Eval test_u:  63%|██████▎   | 260/414 [08:18<04:49,  1.88s/it]
Eval test_u:  63%|██████▎   | 261/414 [08:20<04:47,  1.88s/it]
Eval test_u:  63%|██████▎   | 262/414 [08:22<04:44,  1.87s/it]
Eval test_u:  64%|██████▎   | 263/414 [08:23<04:43,  1.88s/it]
Eval test_u:  64%|██████▍   | 264/414 [08:25<04:44,  1.90s/it]
Eval test_u:  64%|██████▍   | 265/414 [08:27<04:42,  1.89s/it]
Eval test_u:  64%|██████▍   | 266/414 [08:29<04:36,  1.87s/it]
Eval test_u:  64%|██████▍   | 267/414 [08:31<04:35,  1.87s/it]
Eval test_u:  65%|██████▍   | 268/414 [08:33<04:34,  1.88s/it]
Eval test_u:  65%|██████▍   | 269/414 [08:35<04:33,  1.88s/it]
Eval test_u:  65%|██████▌   | 270/414 [08:37<04:31,  1.88s/it]
Eval test_u:  65%|██████▌   | 271/414 [08:38<04:28,  1.88s/it]
Eval test_u:  66%|██████▌   | 272/414 [08:40<04:28,  1.89s/it]
Eval test_u:  66%|██████▌   | 273/414 [08:42<04:27,  1.90s/it]
Eval test_u:  66%|██████▌   | 274/414 [08:44<04:24,  1.89s/it]
Eval test_u:  66%|██████▋   | 275/414 [08:46<04:07,  1.78s/it]
Eval test_u:  67%|██████▋   | 276/414 [08:48<04:12,  1.83s/it]
Eval test_u:  67%|██████▋   | 277/414 [08:50<04:12,  1.84s/it]
Eval test_u:  67%|██████▋   | 278/414 [08:52<04:18,  1.90s/it]
Eval test_u:  67%|██████▋   | 279/414 [08:54<04:17,  1.91s/it]
Eval test_u:  68%|██████▊   | 280/414 [08:55<04:14,  1.90s/it]
Eval test_u:  68%|██████▊   | 281/414 [08:57<04:12,  1.90s/it]
Eval test_u:  68%|██████▊   | 282/414 [08:59<04:11,  1.91s/it]
Eval test_u:  68%|██████▊   | 283/414 [09:01<04:09,  1.91s/it]
Eval test_u:  69%|██████▊   | 284/414 [09:03<04:06,  1.90s/it]
Eval test_u:  69%|██████▉   | 285/414 [09:05<04:02,  1.88s/it]
Eval test_u:  69%|██████▉   | 286/414 [09:06<03:50,  1.80s/it]
Eval test_u:  69%|██████▉   | 287/414 [09:08<03:54,  1.85s/it]
Eval test_u:  70%|██████▉   | 288/414 [09:10<03:53,  1.86s/it]
Eval test_u:  70%|██████▉   | 289/414 [09:12<03:55,  1.89s/it]
Eval test_u:  70%|███████   | 290/414 [09:14<03:53,  1.88s/it]
Eval test_u:  70%|███████   | 291/414 [09:16<03:51,  1.88s/it]
Eval test_u:  71%|███████   | 292/414 [09:18<03:51,  1.89s/it]
Eval test_u:  71%|███████   | 293/414 [09:20<03:48,  1.89s/it]
Eval test_u:  71%|███████   | 294/414 [09:22<03:45,  1.88s/it]
Eval test_u:  71%|███████▏  | 295/414 [09:23<03:42,  1.87s/it]
Eval test_u:  71%|███████▏  | 296/414 [09:25<03:42,  1.88s/it]
Eval test_u:  72%|███████▏  | 297/414 [09:27<03:40,  1.89s/it]
Eval test_u:  72%|███████▏  | 298/414 [09:29<03:39,  1.89s/it]
Eval test_u:  72%|███████▏  | 299/414 [09:31<03:36,  1.89s/it]
Eval test_u:  72%|███████▏  | 300/414 [09:33<03:35,  1.89s/it]
Eval test_u:  73%|███████▎  | 301/414 [09:35<03:34,  1.90s/it]
Eval test_u:  73%|███████▎  | 302/414 [09:37<03:32,  1.90s/it]
Eval test_u:  73%|███████▎  | 303/414 [09:39<03:30,  1.89s/it]
Eval test_u:  73%|███████▎  | 304/414 [09:41<03:27,  1.88s/it]
Eval test_u:  74%|███████▎  | 305/414 [09:42<03:21,  1.85s/it]
Eval test_u:  74%|███████▍  | 306/414 [09:44<03:21,  1.87s/it]
Eval test_u:  74%|███████▍  | 307/414 [09:46<03:19,  1.86s/it]
Eval test_u:  74%|███████▍  | 308/414 [09:48<03:17,  1.86s/it]
Eval test_u:  75%|███████▍  | 309/414 [09:50<03:15,  1.86s/it]
Eval test_u:  75%|███████▍  | 310/414 [09:52<03:13,  1.86s/it]
Eval test_u:  75%|███████▌  | 311/414 [09:54<03:11,  1.86s/it]
Eval test_u:  75%|███████▌  | 312/414 [09:55<03:09,  1.86s/it]
Eval test_u:  76%|███████▌  | 313/414 [09:57<03:07,  1.86s/it]
Eval test_u:  76%|███████▌  | 314/414 [09:59<03:06,  1.86s/it]
Eval test_u:  76%|███████▌  | 315/414 [10:01<03:04,  1.86s/it]
Eval test_u:  76%|███████▋  | 316/414 [10:03<03:01,  1.85s/it]
Eval test_u:  77%|███████▋  | 317/414 [10:05<03:00,  1.86s/it]
Eval test_u:  77%|███████▋  | 318/414 [10:06<02:55,  1.83s/it]
Eval test_u:  77%|███████▋  | 319/414 [10:08<02:56,  1.85s/it]
Eval test_u:  77%|███████▋  | 320/414 [10:10<02:54,  1.86s/it]
Eval test_u:  78%|███████▊  | 321/414 [10:12<02:53,  1.86s/it]
Eval test_u:  78%|███████▊  | 322/414 [10:14<02:50,  1.86s/it]
Eval test_u:  78%|███████▊  | 323/414 [10:16<02:49,  1.86s/it]
Eval test_u:  78%|███████▊  | 324/414 [10:18<02:47,  1.86s/it]
Eval test_u:  79%|███████▊  | 325/414 [10:19<02:45,  1.86s/it]
Eval test_u:  79%|███████▊  | 326/414 [10:21<02:42,  1.85s/it]
Eval test_u:  79%|███████▉  | 327/414 [10:23<02:41,  1.86s/it]
Eval test_u:  79%|███████▉  | 328/414 [10:25<02:39,  1.85s/it]
Eval test_u:  79%|███████▉  | 329/414 [10:27<02:37,  1.86s/it]
Eval test_u:  80%|███████▉  | 330/414 [10:29<02:35,  1.85s/it]
Eval test_u:  80%|███████▉  | 331/414 [10:31<02:34,  1.86s/it]
Eval test_u:  80%|████████  | 332/414 [10:32<02:31,  1.85s/it]
Eval test_u:  80%|████████  | 333/414 [10:34<02:30,  1.86s/it]
Eval test_u:  81%|████████  | 334/414 [10:36<02:29,  1.87s/it]
Eval test_u:  81%|████████  | 335/414 [10:38<02:23,  1.82s/it]
Eval test_u:  81%|████████  | 336/414 [10:40<02:24,  1.85s/it]
Eval test_u:  81%|████████▏ | 337/414 [10:42<02:23,  1.86s/it]
Eval test_u:  82%|████████▏ | 338/414 [10:44<02:23,  1.89s/it]
Eval test_u:  82%|████████▏ | 339/414 [10:46<02:25,  1.94s/it]
Eval test_u:  82%|████████▏ | 340/414 [10:48<02:22,  1.93s/it]
Eval test_u:  82%|████████▏ | 341/414 [10:49<02:19,  1.91s/it]
Eval test_u:  83%|████████▎ | 342/414 [10:51<02:16,  1.89s/it]
Eval test_u:  83%|████████▎ | 343/414 [10:53<02:13,  1.88s/it]
Eval test_u:  83%|████████▎ | 344/414 [10:55<02:13,  1.91s/it]
Eval test_u:  83%|████████▎ | 345/414 [10:57<02:14,  1.94s/it]
Eval test_u:  84%|████████▎ | 346/414 [10:59<02:13,  1.96s/it]
Eval test_u:  84%|████████▍ | 347/414 [11:01<02:10,  1.95s/it]
Eval test_u:  84%|████████▍ | 348/414 [11:03<02:07,  1.94s/it]
Eval test_u:  84%|████████▍ | 349/414 [11:05<02:04,  1.92s/it]
Eval test_u:  85%|████████▍ | 350/414 [11:07<02:01,  1.90s/it]
Eval test_u:  85%|████████▍ | 351/414 [11:09<01:59,  1.90s/it]
Eval test_u:  85%|████████▌ | 352/414 [11:11<01:58,  1.90s/it]
Eval test_u:  85%|████████▌ | 353/414 [11:12<01:55,  1.90s/it]
Eval test_u:  86%|████████▌ | 354/414 [11:14<01:54,  1.90s/it]
Eval test_u:  86%|████████▌ | 355/414 [11:16<01:52,  1.91s/it]
Eval test_u:  86%|████████▌ | 356/414 [11:18<01:50,  1.90s/it]
Eval test_u:  86%|████████▌ | 357/414 [11:20<01:48,  1.90s/it]
Eval test_u:  86%|████████▋ | 358/414 [11:22<01:45,  1.88s/it]
Eval test_u:  87%|████████▋ | 359/414 [11:24<01:43,  1.89s/it]
Eval test_u:  87%|████████▋ | 360/414 [11:26<01:41,  1.88s/it]
Eval test_u:  87%|████████▋ | 361/414 [11:28<01:39,  1.88s/it]
Eval test_u:  87%|████████▋ | 362/414 [11:29<01:37,  1.88s/it]
Eval test_u:  88%|████████▊ | 363/414 [11:31<01:35,  1.88s/it]
Eval test_u:  88%|████████▊ | 364/414 [11:33<01:33,  1.87s/it]
Eval test_u:  88%|████████▊ | 365/414 [11:35<01:31,  1.87s/it]
Eval test_u:  88%|████████▊ | 366/414 [11:37<01:31,  1.90s/it]
Eval test_u:  89%|████████▊ | 367/414 [11:39<01:29,  1.89s/it]
Eval test_u:  89%|████████▉ | 368/414 [11:41<01:26,  1.89s/it]
Eval test_u:  89%|████████▉ | 369/414 [11:43<01:25,  1.90s/it]
Eval test_u:  89%|████████▉ | 370/414 [11:45<01:23,  1.90s/it]
Eval test_u:  90%|████████▉ | 371/414 [11:46<01:21,  1.89s/it]
Eval test_u:  90%|████████▉ | 372/414 [11:48<01:19,  1.88s/it]
Eval test_u:  90%|█████████ | 373/414 [11:50<01:17,  1.88s/it]
Eval test_u:  90%|█████████ | 374/414 [11:52<01:14,  1.87s/it]
Eval test_u:  91%|█████████ | 375/414 [11:54<01:13,  1.88s/it]
Eval test_u:  91%|█████████ | 376/414 [11:56<01:11,  1.88s/it]
Eval test_u:  91%|█████████ | 377/414 [11:58<01:09,  1.87s/it]
Eval test_u:  91%|█████████▏| 378/414 [11:59<01:06,  1.84s/it]
Eval test_u:  92%|█████████▏| 379/414 [12:01<01:05,  1.86s/it]
Eval test_u:  92%|█████████▏| 380/414 [12:03<01:03,  1.86s/it]
Eval test_u:  92%|█████████▏| 381/414 [12:05<01:01,  1.87s/it]
Eval test_u:  92%|█████████▏| 382/414 [12:07<01:00,  1.88s/it]
Eval test_u:  93%|█████████▎| 383/414 [12:09<00:58,  1.89s/it]
Eval test_u:  93%|█████████▎| 384/414 [12:11<00:56,  1.89s/it]
Eval test_u:  93%|█████████▎| 385/414 [12:12<00:50,  1.73s/it]
Eval test_u:  93%|█████████▎| 386/414 [12:14<00:47,  1.70s/it]
Eval test_u:  93%|█████████▎| 387/414 [12:16<00:48,  1.78s/it]
Eval test_u:  94%|█████████▎| 388/414 [12:18<00:47,  1.82s/it]
Eval test_u:  94%|█████████▍| 389/414 [12:20<00:45,  1.83s/it]
Eval test_u:  94%|█████████▍| 390/414 [12:21<00:44,  1.84s/it]
Eval test_u:  94%|█████████▍| 391/414 [12:23<00:42,  1.85s/it]
Eval test_u:  95%|█████████▍| 392/414 [12:25<00:41,  1.87s/it]
Eval test_u:  95%|█████████▍| 393/414 [12:27<00:40,  1.93s/it]
Eval test_u:  95%|█████████▌| 394/414 [12:29<00:38,  1.92s/it]
Eval test_u:  95%|█████████▌| 395/414 [12:31<00:35,  1.86s/it]
Eval test_u:  96%|█████████▌| 396/414 [12:33<00:33,  1.86s/it]
Eval test_u:  96%|█████████▌| 397/414 [12:35<00:31,  1.86s/it]
Eval test_u:  96%|█████████▌| 398/414 [12:36<00:29,  1.86s/it]
Eval test_u:  96%|█████████▋| 399/414 [12:38<00:27,  1.87s/it]
Eval test_u:  97%|█████████▋| 400/414 [12:40<00:26,  1.87s/it]
Eval test_u:  97%|█████████▋| 401/414 [12:42<00:24,  1.87s/it]
Eval test_u:  97%|█████████▋| 402/414 [12:44<00:22,  1.88s/it]
Eval test_u:  97%|█████████▋| 403/414 [12:46<00:20,  1.88s/it]
Eval test_u:  98%|█████████▊| 404/414 [12:48<00:18,  1.88s/it]
Eval test_u:  98%|█████████▊| 405/414 [12:50<00:16,  1.88s/it]
Eval test_u:  98%|█████████▊| 406/414 [12:51<00:14,  1.87s/it]
Eval test_u:  98%|█████████▊| 407/414 [12:53<00:13,  1.87s/it]
Eval test_u:  99%|█████████▊| 408/414 [12:55<00:10,  1.81s/it]
Eval test_u:  99%|█████████▉| 409/414 [12:57<00:08,  1.76s/it]
Eval test_u:  99%|█████████▉| 410/414 [12:58<00:06,  1.72s/it]
Eval test_u:  99%|█████████▉| 411/414 [13:00<00:05,  1.71s/it]
Eval test_u: 100%|█████████▉| 412/414 [13:02<00:03,  1.69s/it]
Eval test_u: 100%|█████████▉| 413/414 [13:03<00:01,  1.68s/it]
Eval test_u: 100%|██████████| 414/414 [13:05<00:00,  1.67s/it]
                                                              
  [test_u]  mIoU=0.6857  F=0.7843

Eval test_n:   0%|          | 0/257 [00:00<?, ?it/s]
Eval test_n:   0%|          | 1/257 [00:18<1:17:52, 18.25s/it]
Eval test_n:   1%|          | 2/257 [00:18<33:06,  7.79s/it]  
Eval test_n:   1%|          | 3/257 [00:19<18:50,  4.45s/it]
Eval test_n:   2%|▏         | 4/257 [00:20<12:51,  3.05s/it]
Eval test_n:   2%|▏         | 5/257 [00:21<09:34,  2.28s/it]
Eval test_n:   2%|▏         | 6/257 [00:21<06:57,  1.66s/it]
Eval test_n:   3%|▎         | 7/257 [00:21<05:17,  1.27s/it]
Eval test_n:   3%|▎         | 8/257 [00:22<04:12,  1.01s/it]
Eval test_n:   4%|▎         | 9/257 [00:24<05:05,  1.23s/it]
Eval test_n:   4%|▍         | 10/257 [00:24<04:05,  1.00it/s]
Eval test_n:   4%|▍         | 11/257 [00:25<03:25,  1.20it/s]
Eval test_n:   5%|▍         | 12/257 [00:25<03:14,  1.26it/s]
Eval test_n:   5%|▌         | 13/257 [00:26<03:24,  1.20it/s]
Eval test_n:   5%|▌         | 14/257 [00:27<03:05,  1.31it/s]
Eval test_n:   6%|▌         | 15/257 [00:27<02:42,  1.49it/s]
Eval test_n:   6%|▌         | 16/257 [00:28<02:27,  1.64it/s]
Eval test_n:   7%|▋         | 17/257 [00:29<03:07,  1.28it/s]
Eval test_n:   7%|▋         | 18/257 [00:30<02:59,  1.33it/s]
Eval test_n:   7%|▋         | 19/257 [00:30<02:38,  1.50it/s]
Eval test_n:   8%|▊         | 20/257 [00:31<02:23,  1.65it/s]
Eval test_n:   8%|▊         | 21/257 [00:32<03:33,  1.10it/s]
Eval test_n:   9%|▊         | 22/257 [00:33<03:14,  1.21it/s]
Eval test_n:   9%|▉         | 23/257 [00:33<02:47,  1.40it/s]
Eval test_n:   9%|▉         | 24/257 [00:34<02:58,  1.30it/s]
Eval test_n:  10%|▉         | 25/257 [00:35<03:09,  1.22it/s]
Eval test_n:  10%|█         | 26/257 [00:35<02:43,  1.41it/s]
Eval test_n:  11%|█         | 27/257 [00:36<02:40,  1.43it/s]
Eval test_n:  11%|█         | 28/257 [00:37<03:09,  1.21it/s]
Eval test_n:  11%|█▏        | 29/257 [00:38<02:43,  1.39it/s]
Eval test_n:  12%|█▏        | 30/257 [00:38<02:25,  1.56it/s]
Eval test_n:  12%|█▏        | 31/257 [00:39<02:57,  1.28it/s]
Eval test_n:  12%|█▏        | 32/257 [00:40<02:34,  1.46it/s]
Eval test_n:  13%|█▎        | 33/257 [00:40<02:33,  1.46it/s]
Eval test_n:  13%|█▎        | 34/257 [00:41<02:30,  1.48it/s]
Eval test_n:  14%|█▎        | 35/257 [00:42<02:42,  1.36it/s]
Eval test_n:  14%|█▍        | 36/257 [00:42<02:23,  1.54it/s]
Eval test_n:  14%|█▍        | 37/257 [00:43<02:24,  1.52it/s]
Eval test_n:  15%|█▍        | 38/257 [00:44<02:25,  1.51it/s]
Eval test_n:  15%|█▌        | 39/257 [00:45<02:43,  1.33it/s]
Eval test_n:  16%|█▌        | 40/257 [00:45<02:24,  1.50it/s]
Eval test_n:  16%|█▌        | 41/257 [00:46<02:26,  1.48it/s]
Eval test_n:  16%|█▋        | 42/257 [00:47<02:25,  1.48it/s]
Eval test_n:  17%|█▋        | 43/257 [00:47<02:10,  1.64it/s]
Eval test_n:  17%|█▋        | 44/257 [00:48<02:28,  1.44it/s]
Eval test_n:  18%|█▊        | 45/257 [00:49<02:26,  1.44it/s]
Eval test_n:  18%|█▊        | 46/257 [00:49<02:24,  1.46it/s]
Eval test_n:  18%|█▊        | 47/257 [00:50<02:25,  1.44it/s]
Eval test_n:  19%|█▊        | 48/257 [00:51<02:23,  1.46it/s]
Eval test_n:  19%|█▉        | 49/257 [00:51<02:22,  1.46it/s]
Eval test_n:  19%|█▉        | 50/257 [00:52<02:17,  1.50it/s]
Eval test_n:  20%|█▉        | 51/257 [00:52<02:04,  1.65it/s]
Eval test_n:  20%|██        | 52/257 [00:53<02:22,  1.44it/s]
Eval test_n:  21%|██        | 53/257 [00:54<02:22,  1.43it/s]
Eval test_n:  21%|██        | 54/257 [00:55<02:22,  1.42it/s]
Eval test_n:  21%|██▏       | 55/257 [00:55<02:20,  1.44it/s]
Eval test_n:  22%|██▏       | 56/257 [00:56<02:05,  1.60it/s]
Eval test_n:  22%|██▏       | 57/257 [00:56<01:54,  1.75it/s]
Eval test_n:  23%|██▎       | 58/257 [00:57<01:47,  1.86it/s]
Eval test_n:  23%|██▎       | 59/257 [01:02<05:52,  1.78s/it]
Eval test_n:  23%|██▎       | 60/257 [01:02<04:32,  1.39s/it]
Eval test_n:  24%|██▎       | 61/257 [01:02<03:36,  1.11s/it]
Eval test_n:  24%|██▍       | 62/257 [01:03<02:58,  1.09it/s]
Eval test_n:  25%|██▍       | 63/257 [01:04<02:48,  1.15it/s]
Eval test_n:  25%|██▍       | 64/257 [01:04<02:23,  1.34it/s]
Eval test_n:  25%|██▌       | 65/257 [01:05<02:05,  1.53it/s]
Eval test_n:  26%|██▌       | 66/257 [01:05<02:17,  1.39it/s]
Eval test_n:  26%|██▌       | 67/257 [01:06<02:36,  1.22it/s]
Eval test_n:  26%|██▋       | 68/257 [01:07<02:14,  1.40it/s]
Eval test_n:  27%|██▋       | 69/257 [01:07<01:59,  1.57it/s]
Eval test_n:  27%|██▋       | 70/257 [01:08<02:01,  1.53it/s]
Eval test_n:  28%|██▊       | 71/257 [01:09<02:24,  1.28it/s]
Eval test_n:  28%|██▊       | 72/257 [01:10<02:06,  1.47it/s]
Eval test_n:  28%|██▊       | 73/257 [01:10<02:05,  1.47it/s]
Eval test_n:  29%|██▉       | 74/257 [01:11<02:03,  1.48it/s]
Eval test_n:  29%|██▉       | 75/257 [01:12<02:14,  1.36it/s]
Eval test_n:  30%|██▉       | 76/257 [01:13<02:10,  1.39it/s]
Eval test_n:  30%|██▉       | 77/257 [01:13<01:55,  1.55it/s]
Eval test_n:  30%|███       | 78/257 [01:14<02:04,  1.44it/s]
Eval test_n:  31%|███       | 79/257 [01:14<01:51,  1.60it/s]
Eval test_n:  31%|███       | 80/257 [01:15<01:53,  1.55it/s]
Eval test_n:  32%|███▏      | 81/257 [01:15<01:44,  1.69it/s]
Eval test_n:  32%|███▏      | 82/257 [01:20<04:46,  1.64s/it]
Eval test_n:  32%|███▏      | 83/257 [01:20<03:43,  1.29s/it]
Eval test_n:  33%|███▎      | 84/257 [01:20<02:59,  1.04s/it]
Eval test_n:  33%|███▎      | 85/257 [01:21<02:28,  1.16it/s]
Eval test_n:  33%|███▎      | 86/257 [01:24<04:24,  1.55s/it]
Eval test_n:  34%|███▍      | 87/257 [01:24<03:27,  1.22s/it]
Eval test_n:  34%|███▍      | 88/257 [01:25<02:47,  1.01it/s]
Eval test_n:  35%|███▍      | 89/257 [01:26<02:31,  1.11it/s]
Eval test_n:  35%|███▌      | 90/257 [01:26<02:08,  1.30it/s]
Eval test_n:  35%|███▌      | 91/257 [01:27<01:52,  1.48it/s]
Eval test_n:  36%|███▌      | 92/257 [01:27<01:40,  1.64it/s]
Eval test_n:  36%|███▌      | 93/257 [01:28<01:55,  1.42it/s]
Eval test_n:  37%|███▋      | 94/257 [01:29<02:06,  1.29it/s]
Eval test_n:  37%|███▋      | 95/257 [01:29<01:50,  1.47it/s]
Eval test_n:  37%|███▋      | 96/257 [01:30<01:38,  1.63it/s]
Eval test_n:  38%|███▊      | 97/257 [01:31<01:51,  1.43it/s]
Eval test_n:  38%|███▊      | 98/257 [01:32<01:56,  1.36it/s]
Eval test_n:  39%|███▊      | 99/257 [01:32<01:42,  1.54it/s]
Eval test_n:  39%|███▉      | 100/257 [01:33<01:44,  1.51it/s]
Eval test_n:  39%|███▉      | 101/257 [01:34<01:54,  1.37it/s]
Eval test_n:  40%|███▉      | 102/257 [01:34<01:48,  1.43it/s]
Eval test_n:  40%|████      | 103/257 [01:35<01:47,  1.43it/s]
Eval test_n:  40%|████      | 104/257 [01:36<01:47,  1.43it/s]
Eval test_n:  41%|████      | 105/257 [01:36<01:44,  1.46it/s]
Eval test_n:  41%|████      | 106/257 [01:37<01:43,  1.45it/s]
Eval test_n:  42%|████▏     | 107/257 [01:38<01:42,  1.46it/s]
Eval test_n:  42%|████▏     | 108/257 [01:38<01:31,  1.62it/s]
Eval test_n:  42%|████▏     | 109/257 [01:39<01:34,  1.57it/s]
Eval test_n:  43%|████▎     | 110/257 [01:40<01:44,  1.41it/s]
Eval test_n:  43%|████▎     | 111/257 [01:40<01:41,  1.44it/s]
Eval test_n:  44%|████▎     | 112/257 [01:41<01:30,  1.60it/s]
Eval test_n:  44%|████▍     | 113/257 [01:42<01:39,  1.44it/s]
Eval test_n:  44%|████▍     | 114/257 [01:43<01:49,  1.31it/s]
Eval test_n:  45%|████▍     | 115/257 [01:43<01:45,  1.35it/s]
Eval test_n:  45%|████▌     | 116/257 [01:44<01:32,  1.52it/s]
Eval test_n:  46%|████▌     | 117/257 [01:44<01:33,  1.49it/s]
Eval test_n:  46%|████▌     | 118/257 [01:45<01:34,  1.47it/s]
Eval test_n:  46%|████▋     | 119/257 [01:46<01:34,  1.46it/s]
Eval test_n:  47%|████▋     | 120/257 [01:46<01:31,  1.49it/s]
Eval test_n:  47%|████▋     | 121/257 [01:47<01:32,  1.47it/s]
Eval test_n:  47%|████▋     | 122/257 [01:48<01:22,  1.63it/s]
Eval test_n:  48%|████▊     | 123/257 [01:49<01:40,  1.34it/s]
Eval test_n:  48%|████▊     | 124/257 [01:49<01:27,  1.52it/s]
Eval test_n:  49%|████▊     | 125/257 [01:50<01:19,  1.67it/s]
Eval test_n:  49%|████▉     | 126/257 [01:50<01:12,  1.80it/s]
Eval test_n:  49%|████▉     | 127/257 [01:51<01:25,  1.53it/s]
Eval test_n:  50%|████▉     | 128/257 [01:52<01:25,  1.50it/s]
Eval test_n:  50%|█████     | 129/257 [01:52<01:23,  1.53it/s]
Eval test_n:  51%|█████     | 130/257 [01:53<01:24,  1.51it/s]
Eval test_n:  51%|█████     | 131/257 [01:54<01:24,  1.50it/s]
Eval test_n:  51%|█████▏    | 132/257 [01:54<01:24,  1.48it/s]
Eval test_n:  52%|█████▏    | 133/257 [01:55<01:24,  1.47it/s]
Eval test_n:  52%|█████▏    | 134/257 [01:56<01:24,  1.46it/s]
Eval test_n:  53%|█████▎    | 135/257 [01:56<01:22,  1.48it/s]
Eval test_n:  53%|█████▎    | 136/257 [01:57<01:26,  1.39it/s]
Eval test_n:  53%|█████▎    | 137/257 [01:58<01:17,  1.56it/s]
Eval test_n:  54%|█████▎    | 138/257 [01:58<01:18,  1.52it/s]
Eval test_n:  54%|█████▍    | 139/257 [01:59<01:27,  1.35it/s]
Eval test_n:  54%|█████▍    | 140/257 [02:00<01:24,  1.38it/s]
Eval test_n:  55%|█████▍    | 141/257 [02:00<01:14,  1.55it/s]
Eval test_n:  55%|█████▌    | 142/257 [02:01<01:16,  1.51it/s]
Eval test_n:  56%|█████▌    | 143/257 [02:02<01:24,  1.34it/s]
Eval test_n:  56%|█████▌    | 144/257 [02:03<01:19,  1.42it/s]
Eval test_n:  56%|█████▋    | 145/257 [02:03<01:10,  1.59it/s]
Eval test_n:  57%|█████▋    | 146/257 [02:04<01:12,  1.53it/s]
Eval test_n:  57%|█████▋    | 147/257 [02:05<01:18,  1.41it/s]
Eval test_n:  58%|█████▊    | 148/257 [02:05<01:13,  1.48it/s]
Eval test_n:  58%|█████▊    | 149/257 [02:06<01:05,  1.64it/s]
Eval test_n:  58%|█████▊    | 150/257 [02:06<01:07,  1.58it/s]
Eval test_n:  59%|█████▉    | 151/257 [02:07<01:15,  1.40it/s]
Eval test_n:  59%|█████▉    | 152/257 [02:08<01:12,  1.44it/s]
Eval test_n:  60%|█████▉    | 153/257 [02:08<01:04,  1.61it/s]
Eval test_n:  60%|█████▉    | 154/257 [02:09<01:12,  1.42it/s]
Eval test_n:  60%|██████    | 155/257 [02:10<01:04,  1.59it/s]
Eval test_n:  61%|██████    | 156/257 [02:11<01:19,  1.28it/s]
Eval test_n:  61%|██████    | 157/257 [02:12<01:15,  1.33it/s]
Eval test_n:  61%|██████▏   | 158/257 [02:12<01:17,  1.27it/s]
Eval test_n:  62%|██████▏   | 159/257 [02:13<01:12,  1.35it/s]
Eval test_n:  62%|██████▏   | 160/257 [02:14<01:03,  1.52it/s]
Eval test_n:  63%|██████▎   | 161/257 [02:14<01:02,  1.54it/s]
Eval test_n:  63%|██████▎   | 162/257 [02:15<00:56,  1.70it/s]
Eval test_n:  63%|██████▎   | 163/257 [02:16<01:04,  1.45it/s]
Eval test_n:  64%|██████▍   | 164/257 [02:16<01:04,  1.45it/s]
Eval test_n:  64%|██████▍   | 165/257 [02:17<01:03,  1.46it/s]
Eval test_n:  65%|██████▍   | 166/257 [02:18<01:02,  1.45it/s]
Eval test_n:  65%|██████▍   | 167/257 [02:19<01:09,  1.30it/s]
Eval test_n:  65%|██████▌   | 168/257 [02:19<01:00,  1.47it/s]
Eval test_n:  66%|██████▌   | 169/257 [02:20<01:05,  1.34it/s]
Eval test_n:  66%|██████▌   | 170/257 [02:20<00:57,  1.52it/s]
Eval test_n:  67%|██████▋   | 171/257 [02:21<01:02,  1.37it/s]
Eval test_n:  67%|██████▋   | 172/257 [02:22<00:55,  1.53it/s]
Eval test_n:  67%|██████▋   | 173/257 [02:23<01:01,  1.38it/s]
Eval test_n:  68%|██████▊   | 174/257 [02:23<00:59,  1.40it/s]
Eval test_n:  68%|██████▊   | 175/257 [02:24<00:57,  1.43it/s]
Eval test_n:  68%|██████▊   | 176/257 [02:24<00:50,  1.59it/s]
Eval test_n:  69%|██████▉   | 177/257 [02:25<00:56,  1.41it/s]
Eval test_n:  69%|██████▉   | 178/257 [02:26<00:55,  1.43it/s]
Eval test_n:  70%|██████▉   | 179/257 [02:26<00:49,  1.59it/s]
Eval test_n:  70%|███████   | 180/257 [02:27<00:48,  1.57it/s]
Eval test_n:  70%|███████   | 181/257 [02:28<00:48,  1.55it/s]
Eval test_n:  71%|███████   | 182/257 [02:28<00:47,  1.56it/s]
Eval test_n:  71%|███████   | 183/257 [02:29<00:46,  1.58it/s]
Eval test_n:  72%|███████▏  | 184/257 [02:29<00:42,  1.72it/s]
Eval test_n:  72%|███████▏  | 185/257 [02:30<00:44,  1.62it/s]
Eval test_n:  72%|███████▏  | 186/257 [02:31<00:54,  1.31it/s]
Eval test_n:  73%|███████▎  | 187/257 [02:32<00:47,  1.49it/s]
Eval test_n:  73%|███████▎  | 188/257 [02:32<00:46,  1.48it/s]
Eval test_n:  74%|███████▎  | 189/257 [02:33<00:45,  1.48it/s]
Eval test_n:  74%|███████▍  | 190/257 [02:34<00:45,  1.47it/s]
Eval test_n:  74%|███████▍  | 191/257 [02:35<00:48,  1.35it/s]
Eval test_n:  75%|███████▍  | 192/257 [02:35<00:42,  1.52it/s]
Eval test_n:  75%|███████▌  | 193/257 [02:36<00:42,  1.51it/s]
Eval test_n:  75%|███████▌  | 194/257 [02:37<00:42,  1.50it/s]
Eval test_n:  76%|███████▌  | 195/257 [02:37<00:44,  1.38it/s]
Eval test_n:  76%|███████▋  | 196/257 [02:38<00:39,  1.56it/s]
Eval test_n:  77%|███████▋  | 197/257 [02:38<00:35,  1.70it/s]
Eval test_n:  77%|███████▋  | 198/257 [02:39<00:32,  1.81it/s]
Eval test_n:  77%|███████▋  | 199/257 [02:40<00:40,  1.42it/s]
Eval test_n:  78%|███████▊  | 200/257 [02:40<00:39,  1.43it/s]
Eval test_n:  78%|███████▊  | 201/257 [02:41<00:35,  1.59it/s]
Eval test_n:  79%|███████▊  | 202/257 [02:42<00:35,  1.56it/s]
Eval test_n:  79%|███████▉  | 203/257 [02:42<00:35,  1.53it/s]
Eval test_n:  79%|███████▉  | 204/257 [02:43<00:34,  1.54it/s]
Eval test_n:  80%|███████▉  | 205/257 [02:44<00:34,  1.52it/s]
Eval test_n:  80%|████████  | 206/257 [02:44<00:33,  1.51it/s]
Eval test_n:  81%|████████  | 207/257 [02:45<00:40,  1.24it/s]
Eval test_n:  81%|████████  | 208/257 [02:46<00:34,  1.43it/s]
Eval test_n:  81%|████████▏ | 209/257 [02:46<00:30,  1.58it/s]
Eval test_n:  82%|████████▏ | 210/257 [02:47<00:30,  1.54it/s]
Eval test_n:  82%|████████▏ | 211/257 [02:48<00:30,  1.52it/s]
Eval test_n:  82%|████████▏ | 212/257 [02:49<00:39,  1.15it/s]
Eval test_n:  83%|████████▎ | 213/257 [02:50<00:35,  1.23it/s]
Eval test_n:  83%|████████▎ | 214/257 [02:50<00:33,  1.29it/s]
Eval test_n:  84%|████████▎ | 215/257 [02:51<00:28,  1.47it/s]
Eval test_n:  84%|████████▍ | 216/257 [02:52<00:29,  1.39it/s]
Eval test_n:  84%|████████▍ | 217/257 [02:52<00:25,  1.56it/s]
Eval test_n:  85%|████████▍ | 218/257 [02:53<00:22,  1.71it/s]
Eval test_n:  85%|████████▌ | 219/257 [02:55<00:45,  1.20s/it]
Eval test_n:  86%|████████▌ | 220/257 [02:56<00:40,  1.09s/it]
Eval test_n:  86%|████████▌ | 221/257 [02:57<00:32,  1.11it/s]
Eval test_n:  86%|████████▋ | 222/257 [02:57<00:31,  1.10it/s]
Eval test_n:  87%|████████▋ | 223/257 [02:58<00:26,  1.29it/s]
Eval test_n:  87%|████████▋ | 224/257 [02:58<00:22,  1.47it/s]
Eval test_n:  88%|████████▊ | 225/257 [02:59<00:19,  1.63it/s]
Eval test_n:  88%|████████▊ | 226/257 [03:00<00:19,  1.60it/s]
Eval test_n:  88%|████████▊ | 227/257 [03:01<00:24,  1.24it/s]
Eval test_n:  89%|████████▊ | 228/257 [03:01<00:20,  1.43it/s]
Eval test_n:  89%|████████▉ | 229/257 [03:02<00:19,  1.44it/s]
Eval test_n:  89%|████████▉ | 230/257 [03:03<00:21,  1.27it/s]
Eval test_n:  90%|████████▉ | 231/257 [03:03<00:18,  1.44it/s]
Eval test_n:  90%|█████████ | 232/257 [03:04<00:17,  1.45it/s]
Eval test_n:  91%|█████████ | 233/257 [03:04<00:14,  1.62it/s]
Eval test_n:  91%|█████████ | 234/257 [03:05<00:16,  1.43it/s]
Eval test_n:  91%|█████████▏| 235/257 [03:06<00:16,  1.31it/s]
Eval test_n:  92%|█████████▏| 236/257 [03:07<00:14,  1.49it/s]
Eval test_n:  92%|█████████▏| 237/257 [03:07<00:12,  1.66it/s]
Eval test_n:  93%|█████████▎| 238/257 [03:08<00:11,  1.60it/s]
Eval test_n:  93%|█████████▎| 239/257 [03:09<00:13,  1.30it/s]
Eval test_n:  93%|█████████▎| 240/257 [03:09<00:11,  1.48it/s]
Eval test_n:  94%|█████████▍| 241/257 [03:10<00:09,  1.64it/s]
Eval test_n:  94%|█████████▍| 242/257 [03:10<00:08,  1.77it/s]
Eval test_n:  95%|█████████▍| 243/257 [03:11<00:10,  1.39it/s]
Eval test_n:  95%|█████████▍| 244/257 [03:12<00:09,  1.40it/s]
Eval test_n:  95%|█████████▌| 245/257 [03:13<00:07,  1.57it/s]
Eval test_n:  96%|█████████▌| 246/257 [03:13<00:06,  1.72it/s]
Eval test_n:  96%|█████████▌| 247/257 [03:14<00:07,  1.38it/s]
Eval test_n:  96%|█████████▋| 248/257 [03:15<00:06,  1.41it/s]
Eval test_n:  97%|█████████▋| 249/257 [03:15<00:05,  1.43it/s]
Eval test_n:  97%|█████████▋| 250/257 [03:16<00:05,  1.32it/s]
Eval test_n:  98%|█████████▊| 251/257 [03:17<00:03,  1.51it/s]
Eval test_n:  98%|█████████▊| 252/257 [03:18<00:03,  1.36it/s]
Eval test_n:  98%|█████████▊| 253/257 [03:18<00:02,  1.52it/s]
Eval test_n:  99%|█████████▉| 254/257 [03:19<00:01,  1.66it/s]
Eval test_n:  99%|█████████▉| 255/257 [03:19<00:01,  1.79it/s]
Eval test_n: 100%|█████████▉| 256/257 [03:20<00:00,  1.68it/s]
Eval test_n: 100%|██████████| 257/257 [03:20<00:00,  1.78it/s]
                                                              
  [test_n]  Null_S=0.0037  null_tp=53/1028  null_fn=975/1028
Saved: checkpoints/ec_simtoken/ec_simtoken_v1.pth