nohup: ignoring input
/scratch/ts1v23/.conda/envs/tlcontrol/lib/python3.10/site-packages/torch/nn/modules/transformer.py:392: UserWarning: enable_nested_tensor is True, but self.use_nested_tensor is False because encoder_layer.self_attn.batch_first was not True(use batch_first for better inference performance)
  warnings.warn(
------------ Options -------------
batch_size: 64
checkpoints_dir: ./checkpoints
cond_drop_prob: 0.1
control: trajectory
ctrl_loss: 0.9
dataset_name: t2m
dropout: 0.2
eval_every_e: 10
ff_size: 1024
force_mask: False
gamma: 0.1
gpu_id: 0
gumbel_sample: False
is_continue: False
is_train: True
latent_dim: 384
log_every: 50
lr: 0.0002
max_epoch: 1500
max_motion_length: 196
milestones: [50000]
n_heads: 6
n_layers: 8
name: My_t2m_transformer1201
save_latest: 500
seed: 3407
share_weight: False
trans_name: t2m_nlayer8_nhead6_ld384_ff1024_cdp0.1_rvq6ns
unit_length: 4
vq_name: rvq_nq1_dc512_nc512
warm_up_iter: 2000
xent: 0.1
-------------- End ----------------
Loading VQ Model /scratch/ts1v23/workspace/new/TLControl/save_weights_vq/best_model_epoch_hml_emaReset.pth
latent_dim: 384, ff_size: 1024, nlayers: 8, nheads: 6, dropout: 0.2
Loading CLIP...
Total parameters of all models: 12.83M

  0%|          | 0/23384 [00:00<?, ?it/s]
  0%|          | 28/23384 [00:00<01:23, 279.91it/s]
  0%|          | 62/23384 [00:00<01:14, 315.11it/s]
  0%|          | 97/23384 [00:00<01:10, 329.61it/s]
  1%|          | 133/23384 [00:00<01:08, 340.52it/s]
  1%|          | 168/23384 [00:00<01:07, 343.48it/s]
  1%|          | 204/23384 [00:00<01:07, 345.87it/s]
  1%|          | 239/23384 [00:00<01:07, 344.75it/s]
  1%|          | 274/23384 [00:00<01:08, 336.80it/s]
  1%|▏         | 308/23384 [00:00<01:09, 334.39it/s]
  1%|▏         | 342/23384 [00:01<01:10, 325.48it/s]
  2%|▏         | 375/23384 [00:01<01:11, 323.33it/s]
  2%|▏         | 408/23384 [00:01<01:15, 304.86it/s]
  2%|▏         | 439/23384 [00:01<01:15, 305.81it/s]
  2%|▏         | 471/23384 [00:01<01:14, 306.91it/s]
  2%|▏         | 502/23384 [00:01<01:16, 300.85it/s]
  2%|▏         | 533/23384 [00:01<01:16, 300.18it/s]
  2%|▏         | 564/23384 [00:01<01:15, 302.29it/s]
  3%|▎         | 597/23384 [00:01<01:14, 307.69it/s]
  3%|▎         | 630/23384 [00:01<01:12, 312.71it/s]
  3%|▎         | 662/23384 [00:02<01:13, 310.63it/s]
  3%|▎         | 694/23384 [00:02<01:12, 311.03it/s]
  3%|▎         | 726/23384 [00:02<01:12, 312.51it/s]
  3%|▎         | 758/23384 [00:02<01:15, 299.18it/s]
  3%|▎         | 791/23384 [00:02<01:13, 305.48it/s]
  4%|▎         | 823/23384 [00:02<01:12, 309.54it/s]
  4%|▎         | 856/23384 [00:02<01:11, 315.40it/s]
  4%|▍         | 890/23384 [00:02<01:10, 319.90it/s]
  4%|▍         | 924/23384 [00:02<01:09, 323.93it/s]
  4%|▍         | 957/23384 [00:03<01:10, 318.27it/s]
  4%|▍         | 989/23384 [00:03<01:13, 305.01it/s]
  4%|▍         | 1022/23384 [00:03<01:12, 310.48it/s]
  5%|▍         | 1054/23384 [00:03<01:11, 312.21it/s]
  5%|▍         | 1086/23384 [00:03<01:13, 302.71it/s]
  5%|▍         | 1117/23384 [00:03<01:14, 298.69it/s]
  5%|▍         | 1150/23384 [00:03<01:12, 305.00it/s]
  5%|▌         | 1184/23384 [00:03<01:10, 313.14it/s]
  5%|▌         | 1217/23384 [00:03<01:09, 317.18it/s]
  5%|▌         | 1251/23384 [00:03<01:08, 321.20it/s]
  5%|▌         | 1286/23384 [00:04<01:07, 328.88it/s]
  6%|▌         | 1319/23384 [00:04<01:07, 328.75it/s]
  6%|▌         | 1353/23384 [00:04<01:06, 330.76it/s]
  6%|▌         | 1387/23384 [00:04<01:06, 332.06it/s]
  6%|▌         | 1421/23384 [00:04<01:06, 328.02it/s]
  6%|▌         | 1454/23384 [00:04<01:07, 327.09it/s]
  6%|▋         | 1487/23384 [00:04<01:06, 327.54it/s]
  7%|▋         | 1522/23384 [00:04<01:05, 333.90it/s]
  7%|▋         | 1556/23384 [00:04<01:05, 331.80it/s]
  7%|▋         | 1590/23384 [00:04<01:07, 322.90it/s]
  7%|▋         | 1623/23384 [00:05<01:09, 313.83it/s]
  7%|▋         | 1655/23384 [00:05<01:10, 309.96it/s]
  7%|▋         | 1687/23384 [00:05<01:11, 305.53it/s]
  7%|▋         | 1718/23384 [00:05<01:10, 305.84it/s]
  7%|▋         | 1750/23384 [00:05<01:09, 309.32it/s]
  8%|▊         | 1784/23384 [00:05<01:07, 317.98it/s]
  8%|▊         | 1818/23384 [00:05<01:06, 323.68it/s]
  8%|▊         | 1853/23384 [00:05<01:05, 328.76it/s]
  8%|▊         | 1889/23384 [00:05<01:03, 336.99it/s]
  8%|▊         | 1924/23384 [00:06<01:03, 338.89it/s]
  8%|▊         | 1959/23384 [00:06<01:02, 340.80it/s]
  9%|▊         | 1994/23384 [00:06<01:04, 334.19it/s]
  9%|▊         | 2028/23384 [00:06<01:04, 330.39it/s]
  9%|▉         | 2063/23384 [00:06<01:03, 335.76it/s]
  9%|▉         | 2097/23384 [00:06<01:03, 335.31it/s]
  9%|▉         | 2132/23384 [00:06<01:02, 338.64it/s]
  9%|▉         | 2166/23384 [00:06<01:03, 336.56it/s]
  9%|▉         | 2201/23384 [00:06<01:02, 338.68it/s]
 10%|▉         | 2235/23384 [00:06<01:03, 331.74it/s]
 10%|▉         | 2269/23384 [00:07<01:04, 328.39it/s]
 10%|▉         | 2302/23384 [00:07<01:05, 323.37it/s]
 10%|▉         | 2335/23384 [00:07<01:05, 323.44it/s]
 10%|█         | 2368/23384 [00:07<01:07, 313.45it/s]
 10%|█         | 2401/23384 [00:07<01:06, 315.52it/s]
 10%|█         | 2436/23384 [00:07<01:04, 322.59it/s]
 11%|█         | 2470/23384 [00:07<01:04, 325.02it/s]
 11%|█         | 2505/23384 [00:07<01:03, 329.35it/s]
 11%|█         | 2540/23384 [00:07<01:02, 333.16it/s]
 11%|█         | 2576/23384 [00:08<01:01, 338.58it/s]
 11%|█         | 2612/23384 [00:08<01:00, 342.93it/s]
 11%|█▏        | 2647/23384 [00:08<01:00, 343.89it/s]
 11%|█▏        | 2682/23384 [00:08<01:01, 336.64it/s]
 12%|█▏        | 2716/23384 [00:08<01:01, 336.57it/s]
 12%|█▏        | 2751/23384 [00:08<01:01, 338.03it/s]
 12%|█▏        | 2785/23384 [00:08<01:04, 321.25it/s]
 12%|█▏        | 2818/23384 [00:08<01:03, 322.58it/s]
 12%|█▏        | 2853/23384 [00:08<01:02, 327.99it/s]
 12%|█▏        | 2886/23384 [00:08<01:03, 324.01it/s]
 12%|█▏        | 2919/23384 [00:09<01:03, 323.01it/s]
 13%|█▎        | 2952/23384 [00:09<01:04, 316.00it/s]
 13%|█▎        | 2984/23384 [00:09<01:05, 309.94it/s]
 13%|█▎        | 3017/23384 [00:09<01:04, 314.63it/s]
 13%|█▎        | 3049/23384 [00:09<01:05, 310.65it/s]
 13%|█▎        | 3082/23384 [00:09<01:04, 315.43it/s]
 13%|█▎        | 3116/23384 [00:09<01:02, 322.55it/s]
 13%|█▎        | 3149/23384 [00:09<01:02, 324.15it/s]
 14%|█▎        | 3184/23384 [00:09<01:01, 329.72it/s]
 14%|█▍        | 3219/23384 [00:09<01:00, 334.07it/s]
 14%|█▍        | 3255/23384 [00:10<00:59, 339.12it/s]
 14%|█▍        | 3290/23384 [00:10<00:59, 339.80it/s]
 14%|█▍        | 3324/23384 [00:10<00:59, 338.29it/s]
 14%|█▍        | 3358/23384 [00:10<00:59, 338.42it/s]
 15%|█▍        | 3392/23384 [00:10<00:59, 337.60it/s]
 15%|█▍        | 3426/23384 [00:10<00:59, 337.38it/s]
 15%|█▍        | 3460/23384 [00:10<00:59, 336.86it/s]
 15%|█▍        | 3495/23384 [00:10<00:58, 339.86it/s]
 15%|█▌        | 3529/23384 [00:10<00:58, 337.92it/s]
 15%|█▌        | 3563/23384 [00:11<01:00, 325.69it/s]
 15%|█▌        | 3596/23384 [00:11<01:01, 322.19it/s]
 16%|█▌        | 3629/23384 [00:11<01:01, 319.91it/s]
 16%|█▌        | 3662/23384 [00:11<01:02, 317.37it/s]
 16%|█▌        | 3696/23384 [00:11<01:01, 321.11it/s]
 16%|█▌        | 3729/23384 [00:11<01:01, 318.08it/s]
 16%|█▌        | 3761/23384 [00:11<01:02, 314.88it/s]
 16%|█▌        | 3797/23384 [00:11<01:00, 326.35it/s]
 16%|█▋        | 3830/23384 [00:11<01:01, 319.89it/s]
 17%|█▋        | 3863/23384 [00:11<01:01, 315.95it/s]
 17%|█▋        | 3895/23384 [00:12<01:03, 304.70it/s]
 17%|█▋        | 3926/23384 [00:12<01:03, 304.17it/s]
 17%|█▋        | 3959/23384 [00:12<01:02, 309.08it/s]
 17%|█▋        | 3991/23384 [00:12<01:02, 311.38it/s]
 17%|█▋        | 4023/23384 [00:12<01:03, 302.79it/s]
 17%|█▋        | 4056/23384 [00:12<01:02, 308.03it/s]
 17%|█▋        | 4088/23384 [00:12<01:02, 307.89it/s]
 18%|█▊        | 4119/23384 [00:12<01:04, 297.83it/s]
 18%|█▊        | 4151/23384 [00:12<01:03, 304.14it/s]
 18%|█▊        | 4182/23384 [00:13<01:04, 297.68it/s]
 18%|█▊        | 4212/23384 [00:13<01:06, 290.00it/s]
 18%|█▊        | 4242/23384 [00:13<01:08, 280.48it/s]
 18%|█▊        | 4271/23384 [00:13<01:07, 281.08it/s]
 18%|█▊        | 4300/23384 [00:13<01:07, 280.71it/s]
 19%|█▊        | 4329/23384 [00:13<01:08, 276.59it/s]
 19%|█▊        | 4359/23384 [00:13<01:07, 283.08it/s]
 19%|█▉        | 4389/23384 [00:13<01:06, 285.70it/s]
 19%|█▉        | 4423/23384 [00:13<01:03, 299.19it/s]
 19%|█▉        | 4456/23384 [00:13<01:01, 306.19it/s]
 19%|█▉        | 4487/23384 [00:14<01:02, 303.58it/s]
 19%|█▉        | 4518/23384 [00:14<01:02, 300.46it/s]
 19%|█▉        | 4551/23384 [00:14<01:01, 308.59it/s]
 20%|█▉        | 4582/23384 [00:14<01:01, 306.09it/s]
 20%|█▉        | 4613/23384 [00:14<01:01, 304.66it/s]
 20%|█▉        | 4644/23384 [00:14<01:01, 302.50it/s]
 20%|█▉        | 4675/23384 [00:14<01:02, 299.40it/s]
 20%|██        | 4707/23384 [00:14<01:01, 303.91it/s]
 20%|██        | 4738/23384 [00:14<01:02, 297.50it/s]
 20%|██        | 4769/23384 [00:15<01:02, 298.74it/s]
 21%|██        | 4801/23384 [00:15<01:00, 304.90it/s]
 21%|██        | 4832/23384 [00:15<01:02, 298.99it/s]
 21%|██        | 4862/23384 [00:15<01:03, 293.37it/s]
 21%|██        | 4893/23384 [00:15<01:02, 296.11it/s]
 21%|██        | 4927/23384 [00:15<01:00, 307.49it/s]
 21%|██        | 4958/23384 [00:15<01:00, 306.69it/s]
 21%|██▏       | 4990/23384 [00:15<00:59, 309.22it/s]
 21%|██▏       | 5022/23384 [00:15<00:59, 309.27it/s]
 22%|██▏       | 5055/23384 [00:15<00:58, 313.18it/s]
 22%|██▏       | 5089/23384 [00:16<00:57, 319.10it/s]
 22%|██▏       | 5121/23384 [00:16<00:57, 319.32it/s]
 22%|██▏       | 5153/23384 [00:16<00:57, 314.34it/s]
 22%|██▏       | 5187/23384 [00:16<00:56, 319.88it/s]
 22%|██▏       | 5221/23384 [00:16<00:55, 325.63it/s]
 22%|██▏       | 5254/23384 [00:16<00:56, 323.66it/s]
 23%|██▎       | 5288/23384 [00:16<00:55, 327.43it/s]
 23%|██▎       | 5321/23384 [00:16<00:55, 327.10it/s]
 23%|██▎       | 5354/23384 [00:16<00:57, 313.05it/s]
 23%|██▎       | 5386/23384 [00:16<01:00, 299.44it/s]
 23%|██▎       | 5417/23384 [00:17<01:02, 287.68it/s]
 23%|██▎       | 5446/23384 [00:17<01:03, 284.23it/s]
 23%|██▎       | 5475/23384 [00:17<01:03, 280.14it/s]
 24%|██▎       | 5504/23384 [00:17<01:04, 277.23it/s]
 24%|██▎       | 5539/23384 [00:17<01:00, 295.60it/s]
 24%|██▍       | 5569/23384 [00:17<01:00, 296.18it/s]
 24%|██▍       | 5604/23384 [00:17<00:57, 309.60it/s]
 24%|██▍       | 5638/23384 [00:17<00:55, 318.19it/s]
 24%|██▍       | 5671/23384 [00:17<00:55, 321.13it/s]
 24%|██▍       | 5706/23384 [00:18<00:54, 326.90it/s]
 25%|██▍       | 5739/23384 [00:18<00:54, 322.61it/s]
 25%|██▍       | 5772/23384 [00:18<00:54, 324.23it/s]
 25%|██▍       | 5805/23384 [00:18<00:54, 324.55it/s]
 25%|██▍       | 5838/23384 [00:18<00:55, 316.11it/s]
 25%|██▌       | 5870/23384 [00:18<00:57, 306.54it/s]
 25%|██▌       | 5902/23384 [00:18<00:56, 306.74it/s]
 25%|██▌       | 5936/23384 [00:18<00:55, 316.16it/s]
 26%|██▌       | 5968/23384 [00:18<00:55, 315.25it/s]
 26%|██▌       | 6000/23384 [00:18<00:55, 312.06it/s]
 26%|██▌       | 6032/23384 [00:19<00:57, 299.32it/s]
 26%|██▌       | 6063/23384 [00:19<00:57, 301.49it/s]
 26%|██▌       | 6096/23384 [00:19<00:55, 308.83it/s]
 26%|██▌       | 6127/23384 [00:19<00:55, 308.41it/s]
 26%|██▋       | 6160/23384 [00:19<00:55, 311.65it/s]
 26%|██▋       | 6192/23384 [00:19<00:55, 311.53it/s]
 27%|██▋       | 6227/23384 [00:19<00:53, 322.58it/s]
 27%|██▋       | 6262/23384 [00:19<00:52, 328.62it/s]
 27%|██▋       | 6296/23384 [00:19<00:51, 330.65it/s]
 27%|██▋       | 6330/23384 [00:20<00:51, 328.17it/s]
 27%|██▋       | 6366/23384 [00:20<00:50, 336.23it/s]
 27%|██▋       | 6400/23384 [00:20<00:51, 326.72it/s]
 28%|██▊       | 6433/23384 [00:20<00:52, 324.06it/s]
 28%|██▊       | 6466/23384 [00:20<00:53, 317.66it/s]
 28%|██▊       | 6502/23384 [00:20<00:51, 328.25it/s]
 28%|██▊       | 6535/23384 [00:20<00:51, 326.55it/s]
 28%|██▊       | 6568/23384 [00:20<00:52, 320.89it/s]
 28%|██▊       | 6601/23384 [00:20<00:52, 317.79it/s]
 28%|██▊       | 6633/23384 [00:20<00:52, 317.04it/s]
 29%|██▊       | 6666/23384 [00:21<00:52, 319.00it/s]
 29%|██▊       | 6700/23384 [00:21<00:51, 323.42it/s]
 29%|██▉       | 6733/23384 [00:21<00:52, 314.96it/s]
 29%|██▉       | 6765/23384 [00:21<00:53, 308.77it/s]
 29%|██▉       | 6796/23384 [00:21<00:56, 295.56it/s]
 29%|██▉       | 6829/23384 [00:21<00:54, 303.58it/s]
 29%|██▉       | 6862/23384 [00:21<00:53, 308.22it/s]
 29%|██▉       | 6894/23384 [00:21<00:53, 309.49it/s]
 30%|██▉       | 6926/23384 [00:21<00:53, 308.79it/s]
 30%|██▉       | 6959/23384 [00:22<00:52, 313.71it/s]
 30%|██▉       | 6993/23384 [00:22<00:51, 317.99it/s]
 30%|███       | 7026/23384 [00:22<00:51, 320.06it/s]
 30%|███       | 7059/23384 [00:22<00:52, 309.85it/s]
 30%|███       | 7095/23384 [00:22<00:50, 320.60it/s]
 30%|███       | 7131/23384 [00:22<00:49, 330.27it/s]
 31%|███       | 7165/23384 [00:22<00:49, 326.44it/s]
 31%|███       | 7198/23384 [00:22<00:49, 327.43it/s]
 31%|███       | 7231/23384 [00:22<00:50, 319.64it/s]
 31%|███       | 7264/23384 [00:22<00:51, 315.97it/s]
 31%|███       | 7296/23384 [00:23<00:51, 312.05it/s]
 31%|███▏      | 7328/23384 [00:23<00:51, 309.73it/s]
 31%|███▏      | 7360/23384 [00:23<00:51, 311.63it/s]
 32%|███▏      | 7392/23384 [00:23<00:53, 300.87it/s]
 32%|███▏      | 7424/23384 [00:23<00:52, 303.93it/s]
 32%|███▏      | 7455/23384 [00:23<00:53, 299.82it/s]
 32%|███▏      | 7486/23384 [00:23<00:52, 301.50it/s]
 32%|███▏      | 7518/23384 [00:23<00:51, 306.67it/s]
 32%|███▏      | 7551/23384 [00:23<00:50, 312.43it/s]
 32%|███▏      | 7585/23384 [00:23<00:49, 318.23it/s]
 33%|███▎      | 7618/23384 [00:24<00:49, 319.56it/s]
 33%|███▎      | 7651/23384 [00:24<00:49, 321.08it/s]
 33%|███▎      | 7684/23384 [00:24<00:48, 321.90it/s]
 33%|███▎      | 7717/23384 [00:24<00:48, 319.78it/s]
 33%|███▎      | 7749/23384 [00:24<00:49, 316.79it/s]
 33%|███▎      | 7783/23384 [00:24<00:48, 321.32it/s]
 33%|███▎      | 7816/23384 [00:24<00:48, 318.93it/s]
 34%|███▎      | 7848/23384 [00:24<00:48, 318.13it/s]
 34%|███▎      | 7880/23384 [00:24<00:50, 305.21it/s]
 34%|███▍      | 7911/23384 [00:25<00:51, 299.58it/s]
 34%|███▍      | 7942/23384 [00:25<00:51, 299.96it/s]
 34%|███▍      | 7973/23384 [00:25<00:53, 287.81it/s]
 34%|███▍      | 8007/23384 [00:25<00:51, 300.04it/s]
 34%|███▍      | 8038/23384 [00:25<00:51, 298.98it/s]
 35%|███▍      | 8071/23384 [00:25<00:50, 305.82it/s]
 35%|███▍      | 8106/23384 [00:25<00:48, 316.82it/s]
 35%|███▍      | 8141/23384 [00:25<00:47, 323.22it/s]
 35%|███▍      | 8175/23384 [00:25<00:46, 326.35it/s]
 35%|███▌      | 8210/23384 [00:25<00:45, 333.03it/s]
 35%|███▌      | 8245/23384 [00:26<00:45, 335.71it/s]
 35%|███▌      | 8279/23384 [00:26<00:54, 279.41it/s]
 36%|███▌      | 8309/23384 [00:26<01:00, 250.58it/s]
 36%|███▌      | 8336/23384 [00:26<01:00, 249.22it/s]
 36%|███▌      | 8362/23384 [00:26<01:02, 238.49it/s]
 36%|███▌      | 8387/23384 [00:26<01:08, 219.58it/s]
 36%|███▌      | 8410/23384 [00:26<01:09, 216.36it/s]
 36%|███▌      | 8433/23384 [00:26<01:09, 215.96it/s]
 36%|███▌      | 8456/23384 [00:27<01:08, 216.86it/s]
 36%|███▋      | 8478/23384 [00:27<01:08, 217.54it/s]
 36%|███▋      | 8500/23384 [00:27<01:08, 216.59it/s]
 36%|███▋      | 8522/23384 [00:27<01:12, 204.20it/s]
 37%|███▋      | 8543/23384 [00:27<01:12, 203.55it/s]
 37%|███▋      | 8567/23384 [00:27<01:09, 212.66it/s]
 37%|███▋      | 8589/23384 [00:27<01:09, 211.97it/s]
 37%|███▋      | 8611/23384 [00:27<01:10, 210.73it/s]
 37%|███▋      | 8633/23384 [00:27<01:10, 209.35it/s]
 37%|███▋      | 8657/23384 [00:28<01:08, 215.89it/s]
 37%|███▋      | 8680/23384 [00:28<01:07, 218.76it/s]
 37%|███▋      | 8706/23384 [00:28<01:03, 230.73it/s]
 37%|███▋      | 8730/23384 [00:28<01:04, 228.30it/s]
 37%|███▋      | 8753/23384 [00:28<01:04, 225.26it/s]
 38%|███▊      | 8776/23384 [00:28<01:05, 222.86it/s]
 38%|███▊      | 8799/23384 [00:28<01:06, 220.60it/s]
 38%|███▊      | 8822/23384 [00:28<01:06, 219.85it/s]
 38%|███▊      | 8847/23384 [00:28<01:04, 224.53it/s]
 38%|███▊      | 8870/23384 [00:28<01:05, 221.61it/s]
 38%|███▊      | 8893/23384 [00:29<01:09, 209.76it/s]
 38%|███▊      | 8918/23384 [00:29<01:05, 219.46it/s]
 38%|███▊      | 8941/23384 [00:29<01:05, 221.64it/s]
 38%|███▊      | 8965/23384 [00:29<01:04, 224.87it/s]
 38%|███▊      | 8990/23384 [00:29<01:02, 230.62it/s]
 39%|███▊      | 9021/23384 [00:29<00:57, 251.63it/s]
 39%|███▊      | 9047/23384 [00:29<00:56, 253.27it/s]
 39%|███▉      | 9073/23384 [00:29<00:57, 247.83it/s]
 39%|███▉      | 9098/23384 [00:29<00:59, 239.86it/s]
 39%|███▉      | 9123/23384 [00:30<01:00, 237.35it/s]
 39%|███▉      | 9148/23384 [00:30<00:59, 240.10it/s]
 39%|███▉      | 9176/23384 [00:30<00:57, 248.57it/s]
 39%|███▉      | 9201/23384 [00:30<00:57, 246.29it/s]
 39%|███▉      | 9229/23384 [00:30<00:55, 254.50it/s]
 40%|███▉      | 9256/23384 [00:30<00:55, 256.57it/s]
 40%|███▉      | 9283/23384 [00:30<00:54, 259.86it/s]
 40%|███▉      | 9310/23384 [00:30<00:55, 251.99it/s]
 40%|███▉      | 9336/23384 [00:30<00:55, 253.11it/s]
 40%|████      | 9363/23384 [00:31<00:54, 255.90it/s]
 40%|████      | 9389/23384 [00:31<00:54, 255.49it/s]
 40%|████      | 9415/23384 [00:31<00:56, 248.25it/s]
 40%|████      | 9442/23384 [00:31<00:55, 250.82it/s]
 40%|████      | 9468/23384 [00:31<00:57, 239.94it/s]
 41%|████      | 9493/23384 [00:31<01:00, 228.80it/s]
 41%|████      | 9517/23384 [00:31<01:01, 225.94it/s]
 41%|████      | 9540/23384 [00:31<01:01, 225.36it/s]
 41%|████      | 9563/23384 [00:31<01:01, 223.23it/s]
 41%|████      | 9589/23384 [00:31<00:59, 231.84it/s]
 41%|████      | 9615/23384 [00:32<00:57, 238.18it/s]
 41%|████      | 9642/23384 [00:32<00:55, 246.30it/s]
 41%|████▏     | 9669/23384 [00:32<00:54, 252.87it/s]
 41%|████▏     | 9696/23384 [00:32<00:53, 256.43it/s]
 42%|████▏     | 9722/23384 [00:32<00:53, 253.06it/s]
 42%|████▏     | 9748/23384 [00:32<00:54, 248.16it/s]
 42%|████▏     | 9773/23384 [00:32<00:56, 242.94it/s]
 42%|████▏     | 9798/23384 [00:32<00:55, 244.44it/s]
 42%|████▏     | 9823/23384 [00:32<00:56, 240.55it/s]
 42%|████▏     | 9851/23384 [00:33<00:54, 250.39it/s]
 42%|████▏     | 9877/23384 [00:33<00:54, 245.67it/s]
 42%|████▏     | 9903/23384 [00:33<00:54, 247.93it/s]
 42%|████▏     | 9928/23384 [00:33<00:54, 246.17it/s]
 43%|████▎     | 9953/23384 [00:33<00:56, 237.98it/s]
 43%|████▎     | 9980/23384 [00:33<00:54, 244.23it/s]
 43%|████▎     | 10005/23384 [00:33<00:54, 244.35it/s]
 43%|████▎     | 10031/23384 [00:33<00:53, 247.54it/s]
 43%|████▎     | 10063/23384 [00:33<00:49, 267.48it/s]
 43%|████▎     | 10092/23384 [00:33<00:48, 272.73it/s]
 43%|████▎     | 10120/23384 [00:34<00:49, 269.23it/s]
 43%|████▎     | 10147/23384 [00:34<00:49, 266.00it/s]
 44%|████▎     | 10174/23384 [00:34<00:51, 256.50it/s]
 44%|████▎     | 10200/23384 [00:34<00:51, 253.84it/s]
 44%|████▎     | 10226/23384 [00:34<00:53, 247.92it/s]
 44%|████▍     | 10251/23384 [00:34<00:53, 245.07it/s]
 44%|████▍     | 10278/23384 [00:34<00:52, 251.77it/s]
 44%|████▍     | 10304/23384 [00:34<00:53, 242.30it/s]
 44%|████▍     | 10329/23384 [00:34<00:55, 235.20it/s]
 44%|████▍     | 10353/23384 [00:35<00:55, 233.28it/s]
 44%|████▍     | 10377/23384 [00:35<00:57, 226.11it/s]
 44%|████▍     | 10403/23384 [00:35<00:55, 234.34it/s]
 45%|████▍     | 10427/23384 [00:35<00:55, 232.46it/s]
 45%|████▍     | 10451/23384 [00:35<00:56, 227.23it/s]
 45%|████▍     | 10474/23384 [00:35<00:56, 227.10it/s]
 45%|████▍     | 10502/23384 [00:35<00:53, 240.09it/s]
 45%|████▌     | 10527/23384 [00:35<00:54, 237.06it/s]
 45%|████▌     | 10551/23384 [00:35<00:54, 236.35it/s]
 45%|████▌     | 10575/23384 [00:36<00:55, 230.63it/s]
 45%|████▌     | 10599/23384 [00:36<00:58, 218.12it/s]
 45%|████▌     | 10623/23384 [00:36<00:57, 223.69it/s]
 46%|████▌     | 10647/23384 [00:36<00:56, 224.89it/s]
 46%|████▌     | 10670/23384 [00:36<00:58, 217.77it/s]
 46%|████▌     | 10692/23384 [00:36<01:00, 210.19it/s]
 46%|████▌     | 10720/23384 [00:36<00:55, 229.64it/s]
 46%|████▌     | 10744/23384 [00:36<01:19, 158.87it/s]
 46%|████▌     | 10765/23384 [00:37<01:14, 169.40it/s]
 46%|████▌     | 10787/23384 [00:37<01:10, 179.63it/s]
 46%|████▌     | 10807/23384 [00:37<01:09, 181.81it/s]
 46%|████▋     | 10829/23384 [00:37<01:06, 189.70it/s]
 46%|████▋     | 10850/23384 [00:37<01:04, 192.86it/s]
 46%|████▋     | 10873/23384 [00:37<01:02, 200.52it/s]
 47%|████▋     | 10895/23384 [00:37<01:00, 205.66it/s]
 47%|████▋     | 10918/23384 [00:37<00:58, 212.40it/s]
 47%|████▋     | 10941/23384 [00:37<00:57, 216.12it/s]
 47%|████▋     | 10965/23384 [00:37<00:56, 221.28it/s]
 47%|████▋     | 10988/23384 [00:38<00:57, 217.30it/s]
 47%|████▋     | 11011/23384 [00:38<00:56, 219.62it/s]
 47%|████▋     | 11035/23384 [00:38<00:54, 224.70it/s]
 47%|████▋     | 11058/23384 [00:38<00:55, 221.63it/s]
 47%|████▋     | 11081/23384 [00:38<00:55, 221.52it/s]
 47%|████▋     | 11105/23384 [00:38<00:54, 226.01it/s]
 48%|████▊     | 11129/23384 [00:38<00:53, 228.91it/s]
 48%|████▊     | 11154/23384 [00:38<00:52, 231.31it/s]
 48%|████▊     | 11179/23384 [00:38<00:52, 234.59it/s]
 48%|████▊     | 11203/23384 [00:38<00:52, 234.03it/s]
 48%|████▊     | 11229/23384 [00:39<00:50, 240.84it/s]
 48%|████▊     | 11254/23384 [00:39<00:51, 235.21it/s]
 48%|████▊     | 11279/23384 [00:39<00:50, 237.88it/s]
 48%|████▊     | 11303/23384 [00:39<00:51, 235.30it/s]
 48%|████▊     | 11329/23384 [00:39<00:49, 241.16it/s]
 49%|████▊     | 11354/23384 [00:39<00:50, 240.07it/s]
 49%|████▊     | 11379/23384 [00:39<00:50, 239.80it/s]
 49%|████▉     | 11406/23384 [00:39<00:48, 246.68it/s]
 49%|████▉     | 11431/23384 [00:39<00:48, 244.64it/s]
 49%|████▉     | 11457/23384 [00:40<00:47, 249.09it/s]
 49%|████▉     | 11483/23384 [00:40<00:47, 250.30it/s]
 49%|████▉     | 11509/23384 [00:40<00:48, 243.13it/s]
 49%|████▉     | 11539/23384 [00:40<00:46, 254.63it/s]
 49%|████▉     | 11565/23384 [00:40<00:48, 244.58it/s]
 50%|████▉     | 11590/23384 [00:40<00:51, 229.40it/s]
 50%|████▉     | 11617/23384 [00:40<00:49, 239.85it/s]
 50%|████▉     | 11645/23384 [00:40<00:46, 250.30it/s]
 50%|████▉     | 11675/23384 [00:40<00:44, 264.20it/s]
 50%|█████     | 11702/23384 [00:41<00:44, 261.39it/s]
 50%|█████     | 11730/23384 [00:41<00:43, 266.18it/s]
 50%|█████     | 11759/23384 [00:41<00:42, 271.14it/s]
 50%|█████     | 11787/23384 [00:41<00:44, 261.08it/s]
 51%|█████     | 11821/23384 [00:41<00:40, 283.17it/s]
 51%|█████     | 11855/23384 [00:41<00:38, 296.60it/s]
 51%|█████     | 11888/23384 [00:41<00:38, 302.13it/s]
 51%|█████     | 11924/23384 [00:41<00:36, 316.70it/s]
 51%|█████     | 11958/23384 [00:41<00:35, 319.23it/s]
 51%|█████▏    | 11991/23384 [00:41<00:35, 321.97it/s]
 51%|█████▏    | 12024/23384 [00:42<00:35, 317.77it/s]
 52%|█████▏    | 12056/23384 [00:42<00:36, 314.21it/s]
 52%|█████▏    | 12088/23384 [00:42<00:36, 308.97it/s]
 52%|█████▏    | 12120/23384 [00:42<00:36, 309.81it/s]
 52%|█████▏    | 12152/23384 [00:42<00:36, 309.78it/s]
 52%|█████▏    | 12187/23384 [00:42<00:34, 320.59it/s]
 52%|█████▏    | 12220/23384 [00:42<00:35, 314.80it/s]
 52%|█████▏    | 12252/23384 [00:42<00:35, 309.78it/s]
 53%|█████▎    | 12284/23384 [00:42<00:36, 300.28it/s]
 53%|█████▎    | 12316/23384 [00:43<00:36, 304.61it/s]
 53%|█████▎    | 12347/23384 [00:43<00:36, 300.69it/s]
 53%|█████▎    | 12379/23384 [00:43<00:36, 304.08it/s]
 53%|█████▎    | 12412/23384 [00:43<00:35, 311.10it/s]
 53%|█████▎    | 12445/23384 [00:43<00:34, 315.04it/s]
 53%|█████▎    | 12480/23384 [00:43<00:33, 324.70it/s]
 54%|█████▎    | 12516/23384 [00:43<00:32, 332.90it/s]
 54%|█████▎    | 12551/23384 [00:43<00:32, 335.64it/s]
 54%|█████▍    | 12586/23384 [00:43<00:31, 338.71it/s]
 54%|█████▍    | 12621/23384 [00:43<00:31, 340.97it/s]
 54%|█████▍    | 12656/23384 [00:44<00:31, 337.63it/s]
 54%|█████▍    | 12693/23384 [00:44<00:30, 346.20it/s]
 54%|█████▍    | 12731/23384 [00:44<00:30, 354.39it/s]
 55%|█████▍    | 12767/23384 [00:44<00:30, 352.21it/s]
 55%|█████▍    | 12803/23384 [00:44<00:33, 320.24it/s]
 55%|█████▍    | 12836/23384 [00:44<00:34, 308.26it/s]
 55%|█████▌    | 12868/23384 [00:44<00:34, 306.05it/s]
 55%|█████▌    | 12902/23384 [00:44<00:33, 313.07it/s]
 55%|█████▌    | 12934/23384 [00:44<00:33, 314.15it/s]
 55%|█████▌    | 12970/23384 [00:45<00:31, 327.15it/s]
 56%|█████▌    | 13005/23384 [00:45<00:31, 332.85it/s]
 56%|█████▌    | 13042/23384 [00:45<00:30, 340.43it/s]
 56%|█████▌    | 13077/23384 [00:45<00:30, 338.22it/s]
 56%|█████▌    | 13111/23384 [00:45<00:30, 338.54it/s]
 56%|█████▌    | 13145/23384 [00:45<00:30, 335.18it/s]
 56%|█████▋    | 13181/23384 [00:45<00:29, 340.64it/s]
 57%|█████▋    | 13216/23384 [00:45<00:30, 338.03it/s]
 57%|█████▋    | 13253/23384 [00:45<00:29, 346.88it/s]
 57%|█████▋    | 13290/23384 [00:45<00:28, 352.40it/s]
 57%|█████▋    | 13327/23384 [00:46<00:28, 357.39it/s]
 57%|█████▋    | 13364/23384 [00:46<00:27, 358.71it/s]
 57%|█████▋    | 13401/23384 [00:46<00:27, 361.01it/s]
 57%|█████▋    | 13438/23384 [00:46<00:28, 354.02it/s]
 58%|█████▊    | 13475/23384 [00:46<00:27, 357.69it/s]
 58%|█████▊    | 13512/23384 [00:46<00:27, 360.80it/s]
 58%|█████▊    | 13549/23384 [00:46<00:27, 360.95it/s]
 58%|█████▊    | 13586/23384 [00:46<00:27, 362.49it/s]
 58%|█████▊    | 13626/23384 [00:46<00:26, 372.28it/s]
 58%|█████▊    | 13664/23384 [00:46<00:26, 373.35it/s]
 59%|█████▊    | 13702/23384 [00:47<00:26, 365.21it/s]
 59%|█████▉    | 13739/23384 [00:47<00:26, 365.25it/s]
 59%|█████▉    | 13777/23384 [00:47<00:26, 367.87it/s]
 59%|█████▉    | 13816/23384 [00:47<00:25, 370.87it/s]
 59%|█████▉    | 13854/23384 [00:47<00:25, 372.16it/s]
 59%|█████▉    | 13892/23384 [00:47<00:25, 368.90it/s]
 60%|█████▉    | 13929/23384 [00:47<00:25, 368.83it/s]
 60%|█████▉    | 13970/23384 [00:47<00:24, 378.32it/s]
 60%|█████▉    | 14009/23384 [00:47<00:24, 380.67it/s]
 60%|██████    | 14048/23384 [00:47<00:25, 370.38it/s]
 60%|██████    | 14086/23384 [00:48<00:25, 370.60it/s]
 60%|██████    | 14124/23384 [00:48<00:25, 365.93it/s]
 61%|██████    | 14162/23384 [00:48<00:25, 367.24it/s]
 61%|██████    | 14199/23384 [00:48<00:25, 365.62it/s]
 61%|██████    | 14237/23384 [00:48<00:24, 366.71it/s]
 61%|██████    | 14274/23384 [00:48<00:25, 364.10it/s]
 61%|██████    | 14314/23384 [00:48<00:24, 373.26it/s]
 61%|██████▏   | 14352/23384 [00:48<00:24, 363.05it/s]
 62%|██████▏   | 14389/23384 [00:48<00:25, 348.05it/s]
 62%|██████▏   | 14424/23384 [00:49<00:26, 340.96it/s]
 62%|██████▏   | 14459/23384 [00:49<00:26, 341.59it/s]
 62%|██████▏   | 14494/23384 [00:49<00:26, 341.71it/s]
 62%|██████▏   | 14529/23384 [00:49<00:26, 339.49it/s]
 62%|██████▏   | 14565/23384 [00:49<00:25, 343.76it/s]
 62%|██████▏   | 14600/23384 [00:49<00:25, 345.47it/s]
 63%|██████▎   | 14635/23384 [00:49<00:26, 334.13it/s]
 63%|██████▎   | 14670/23384 [00:49<00:25, 338.10it/s]
 63%|██████▎   | 14706/23384 [00:49<00:25, 341.98it/s]
 63%|██████▎   | 14741/23384 [00:49<00:25, 336.70it/s]
 63%|██████▎   | 14777/23384 [00:50<00:25, 343.42it/s]
 63%|██████▎   | 14813/23384 [00:50<00:24, 346.55it/s]
 64%|██████▎   | 14850/23384 [00:50<00:24, 353.24it/s]
 64%|██████▎   | 14886/23384 [00:50<00:24, 343.08it/s]
 64%|██████▍   | 14922/23384 [00:50<00:24, 347.77it/s]
 64%|██████▍   | 14957/23384 [00:50<00:24, 343.06it/s]
 64%|██████▍   | 14992/23384 [00:50<00:24, 337.00it/s]
 64%|██████▍   | 15026/23384 [00:50<00:25, 322.37it/s]
 64%|██████▍   | 15063/23384 [00:50<00:24, 335.56it/s]
 65%|██████▍   | 15100/23384 [00:51<00:24, 342.63it/s]
 65%|██████▍   | 15135/23384 [00:51<00:24, 339.48it/s]
 65%|██████▍   | 15175/23384 [00:51<00:23, 355.10it/s]
 65%|██████▌   | 15214/23384 [00:51<00:22, 364.47it/s]
 65%|██████▌   | 15251/23384 [00:51<00:22, 364.37it/s]
 65%|██████▌   | 15288/23384 [00:51<00:22, 359.73it/s]
 66%|██████▌   | 15325/23384 [00:51<00:22, 351.31it/s]
 66%|██████▌   | 15362/23384 [00:51<00:22, 356.40it/s]
 66%|██████▌   | 15401/23384 [00:51<00:21, 365.41it/s]
 66%|██████▌   | 15438/23384 [00:51<00:21, 363.65it/s]
 66%|██████▌   | 15475/23384 [00:52<00:21, 365.02it/s]
 66%|██████▋   | 15512/23384 [00:52<00:21, 362.58it/s]
 66%|██████▋   | 15549/23384 [00:52<00:21, 362.89it/s]
 67%|██████▋   | 15586/23384 [00:52<00:22, 346.12it/s]
 67%|██████▋   | 15621/23384 [00:52<00:22, 338.02it/s]
 67%|██████▋   | 15656/23384 [00:52<00:22, 341.18it/s]
 67%|██████▋   | 15694/23384 [00:52<00:21, 350.40it/s]
 67%|██████▋   | 15735/23384 [00:52<00:20, 366.06it/s]
 67%|██████▋   | 15777/23384 [00:52<00:19, 381.02it/s]
 68%|██████▊   | 15816/23384 [00:53<00:20, 368.20it/s]
 68%|██████▊   | 15857/23384 [00:53<00:19, 378.56it/s]
 68%|██████▊   | 15896/23384 [00:53<00:19, 375.03it/s]
 68%|██████▊   | 15934/23384 [00:53<00:19, 372.62it/s]
 68%|██████▊   | 15972/23384 [00:53<00:19, 370.85it/s]
 68%|██████▊   | 16010/23384 [00:53<00:19, 373.29it/s]
 69%|██████▊   | 16049/23384 [00:53<00:19, 377.27it/s]
 69%|██████▉   | 16087/23384 [00:53<00:20, 364.48it/s]
 69%|██████▉   | 16125/23384 [00:53<00:19, 366.50it/s]
 69%|██████▉   | 16164/23384 [00:53<00:19, 371.67it/s]
 69%|██████▉   | 16202/23384 [00:54<00:19, 364.24it/s]
 69%|██████▉   | 16239/23384 [00:54<00:19, 359.67it/s]
 70%|██████▉   | 16276/23384 [00:54<00:19, 357.80it/s]
 70%|██████▉   | 16314/23384 [00:54<00:19, 362.04it/s]
 70%|██████▉   | 16351/23384 [00:54<00:19, 360.23it/s]
 70%|███████   | 16391/23384 [00:54<00:18, 371.49it/s]
 70%|███████   | 16429/23384 [00:54<00:18, 372.31it/s]
 70%|███████   | 16469/23384 [00:54<00:18, 379.29it/s]
 71%|███████   | 16507/23384 [00:54<00:18, 373.97it/s]
 71%|███████   | 16545/23384 [00:54<00:18, 374.46it/s]
 71%|███████   | 16586/23384 [00:55<00:17, 382.61it/s]
 71%|███████   | 16625/23384 [00:55<00:17, 382.21it/s]
 71%|███████▏  | 16664/23384 [00:55<00:18, 372.77it/s]
 71%|███████▏  | 16706/23384 [00:55<00:17, 384.92it/s]
 72%|███████▏  | 16747/23384 [00:55<00:16, 390.99it/s]
 72%|███████▏  | 16790/23384 [00:55<00:16, 400.33it/s]
 72%|███████▏  | 16831/23384 [00:55<00:16, 394.26it/s]
 72%|███████▏  | 16871/23384 [00:55<00:16, 393.97it/s]
 72%|███████▏  | 16911/23384 [00:55<00:16, 392.62it/s]
 72%|███████▏  | 16951/23384 [00:56<00:17, 376.74it/s]
 73%|███████▎  | 16989/23384 [00:56<00:16, 377.47it/s]
 73%|███████▎  | 17029/23384 [00:56<00:16, 382.96it/s]
 73%|███████▎  | 17071/23384 [00:56<00:16, 393.66it/s]
 73%|███████▎  | 17114/23384 [00:56<00:15, 402.45it/s]
 73%|███████▎  | 17155/23384 [00:56<00:15, 401.32it/s]
 74%|███████▎  | 17196/23384 [00:56<00:16, 384.35it/s]
 74%|███████▎  | 17235/23384 [00:56<00:16, 379.29it/s]
 74%|███████▍  | 17274/23384 [00:56<00:16, 381.28it/s]
 74%|███████▍  | 17315/23384 [00:56<00:15, 389.26it/s]
 74%|███████▍  | 17355/23384 [00:57<00:15, 390.70it/s]
 74%|███████▍  | 17398/23384 [00:57<00:14, 399.98it/s]
 75%|███████▍  | 17441/23384 [00:57<00:14, 407.78it/s]
 75%|███████▍  | 17482/23384 [00:57<00:14, 406.24it/s]
 75%|███████▍  | 17523/23384 [00:57<00:14, 397.82it/s]
 75%|███████▌  | 17563/23384 [00:57<00:14, 393.02it/s]
 75%|███████▌  | 17603/23384 [00:57<00:14, 388.19it/s]
 75%|███████▌  | 17642/23384 [00:57<00:14, 385.56it/s]
 76%|███████▌  | 17684/23384 [00:57<00:14, 394.85it/s]
 76%|███████▌  | 17725/23384 [00:57<00:14, 396.46it/s]
 76%|███████▌  | 17767/23384 [00:58<00:14, 400.55it/s]
 76%|███████▌  | 17808/23384 [00:58<00:14, 386.42it/s]
 76%|███████▋  | 17847/23384 [00:58<00:14, 378.98it/s]
 76%|███████▋  | 17885/23384 [00:58<00:14, 371.28it/s]
 77%|███████▋  | 17923/23384 [00:58<00:14, 369.92it/s]
 77%|███████▋  | 17961/23384 [00:58<00:15, 359.97it/s]
 77%|███████▋  | 17998/23384 [00:58<00:14, 361.74it/s]
 77%|███████▋  | 18038/23384 [00:58<00:14, 372.31it/s]
 77%|███████▋  | 18078/23384 [00:58<00:14, 378.27it/s]
 77%|███████▋  | 18116/23384 [00:59<00:14, 372.39it/s]
 78%|███████▊  | 18154/23384 [00:59<00:13, 374.49it/s]
 78%|███████▊  | 18193/23384 [00:59<00:13, 376.71it/s]
 78%|███████▊  | 18231/23384 [00:59<00:13, 376.91it/s]
 78%|███████▊  | 18269/23384 [00:59<00:13, 372.32it/s]
 78%|███████▊  | 18309/23384 [00:59<00:13, 379.75it/s]
 78%|███████▊  | 18349/23384 [00:59<00:13, 383.89it/s]
 79%|███████▊  | 18390/23384 [00:59<00:12, 390.65it/s]
 79%|███████▉  | 18430/23384 [00:59<00:12, 392.51it/s]
 79%|███████▉  | 18472/23384 [00:59<00:12, 400.65it/s]
 79%|███████▉  | 18513/23384 [01:00<00:12, 388.31it/s]
 79%|███████▉  | 18552/23384 [01:00<00:12, 387.21it/s]
 80%|███████▉  | 18591/23384 [01:00<00:12, 381.26it/s]
 80%|███████▉  | 18630/23384 [01:00<00:12, 380.71it/s]
 80%|███████▉  | 18669/23384 [01:00<00:12, 373.29it/s]
 80%|████████  | 18710/23384 [01:00<00:12, 382.95it/s]
 80%|████████  | 18749/23384 [01:00<00:12, 377.24it/s]
 80%|████████  | 18787/23384 [01:00<00:12, 377.33it/s]
 81%|████████  | 18825/23384 [01:00<00:12, 371.91it/s]
 81%|████████  | 18865/23384 [01:00<00:11, 378.07it/s]
 81%|████████  | 18903/23384 [01:01<00:11, 376.73it/s]
 81%|████████  | 18941/23384 [01:01<00:11, 373.02it/s]
 81%|████████  | 18982/23384 [01:01<00:11, 383.68it/s]
 81%|████████▏ | 19025/23384 [01:01<00:11, 395.76it/s]
 82%|████████▏ | 19065/23384 [01:01<00:11, 386.33it/s]
 82%|████████▏ | 19106/23384 [01:01<00:10, 392.86it/s]
 82%|████████▏ | 19146/23384 [01:01<00:10, 390.71it/s]
 82%|████████▏ | 19186/23384 [01:01<00:10, 390.91it/s]
 82%|████████▏ | 19226/23384 [01:01<00:10, 387.97it/s]
 82%|████████▏ | 19268/23384 [01:02<00:10, 394.26it/s]
 83%|████████▎ | 19308/23384 [01:02<00:10, 395.58it/s]
 83%|████████▎ | 19349/23384 [01:02<00:10, 398.92it/s]
 83%|████████▎ | 19389/23384 [01:02<00:10, 385.68it/s]
 83%|████████▎ | 19428/23384 [01:02<00:10, 379.00it/s]
 83%|████████▎ | 19469/23384 [01:02<00:10, 385.33it/s]
 83%|████████▎ | 19508/23384 [01:02<00:10, 379.12it/s]
 84%|████████▎ | 19546/23384 [01:02<00:10, 377.34it/s]
 84%|████████▍ | 19586/23384 [01:02<00:09, 381.37it/s]
 84%|████████▍ | 19625/23384 [01:02<00:09, 377.47it/s]
 84%|████████▍ | 19663/23384 [01:03<00:09, 376.78it/s]
 84%|████████▍ | 19701/23384 [01:03<00:09, 376.50it/s]
 84%|████████▍ | 19739/23384 [01:03<00:09, 370.59it/s]
 85%|████████▍ | 19777/23384 [01:03<00:09, 373.26it/s]
 85%|████████▍ | 19815/23384 [01:03<00:09, 370.84it/s]
 85%|████████▍ | 19853/23384 [01:03<00:09, 372.97it/s]
 85%|████████▌ | 19895/23384 [01:03<00:09, 384.49it/s]
 85%|████████▌ | 19934/23384 [01:03<00:08, 383.34it/s]
 85%|████████▌ | 19974/23384 [01:03<00:08, 388.11it/s]
 86%|████████▌ | 20013/23384 [01:03<00:08, 383.03it/s]
 86%|████████▌ | 20054/23384 [01:04<00:08, 390.42it/s]
 86%|████████▌ | 20094/23384 [01:04<00:08, 388.97it/s]
 86%|████████▌ | 20133/23384 [01:04<00:08, 383.77it/s]
 86%|████████▋ | 20173/23384 [01:04<00:08, 385.77it/s]
 86%|████████▋ | 20213/23384 [01:04<00:08, 388.54it/s]
 87%|████████▋ | 20253/23384 [01:04<00:08, 390.62it/s]
 87%|████████▋ | 20293/23384 [01:04<00:07, 389.50it/s]
 87%|████████▋ | 20332/23384 [01:04<00:07, 386.18it/s]
 87%|████████▋ | 20373/23384 [01:04<00:07, 392.22it/s]
 87%|████████▋ | 20416/23384 [01:05<00:07, 403.02it/s]
 87%|████████▋ | 20459/23384 [01:05<00:07, 410.37it/s]
 88%|████████▊ | 20501/23384 [01:05<00:06, 413.14it/s]
 88%|████████▊ | 20546/23384 [01:05<00:06, 422.98it/s]
 88%|████████▊ | 20589/23384 [01:05<00:06, 422.96it/s]
 88%|████████▊ | 20632/23384 [01:05<00:06, 420.41it/s]
 88%|████████▊ | 20675/23384 [01:05<00:06, 418.88it/s]
 89%|████████▊ | 20717/23384 [01:05<00:06, 418.90it/s]
 89%|████████▉ | 20759/23384 [01:05<00:06, 408.58it/s]
 89%|████████▉ | 20800/23384 [01:05<00:06, 404.01it/s]
 89%|████████▉ | 20845/23384 [01:06<00:06, 417.23it/s]
 89%|████████▉ | 20887/23384 [01:06<00:06, 411.24it/s]
 90%|████████▉ | 20929/23384 [01:06<00:06, 407.68it/s]
 90%|████████▉ | 20972/23384 [01:06<00:05, 413.41it/s]
 90%|████████▉ | 21014/23384 [01:06<00:05, 402.99it/s]
 90%|█████████ | 21057/23384 [01:06<00:05, 409.11it/s]
 90%|█████████ | 21099/23384 [01:06<00:05, 410.91it/s]
 90%|█████████ | 21143/23384 [01:06<00:05, 418.93it/s]
 91%|█████████ | 21185/23384 [01:06<00:05, 417.58it/s]
 91%|█████████ | 21227/23384 [01:06<00:05, 415.99it/s]
 91%|█████████ | 21269/23384 [01:07<00:05, 410.61it/s]
 91%|█████████ | 21311/23384 [01:07<00:05, 409.45it/s]
 91%|█████████▏| 21352/23384 [01:07<00:05, 395.27it/s]
 91%|█████████▏| 21392/23384 [01:07<00:05, 387.77it/s]
 92%|█████████▏| 21431/23384 [01:07<00:05, 382.09it/s]
 92%|█████████▏| 21472/23384 [01:07<00:04, 387.62it/s]
 92%|█████████▏| 21511/23384 [01:07<00:04, 381.76it/s]
 92%|█████████▏| 21555/23384 [01:07<00:04, 396.90it/s]
 92%|█████████▏| 21595/23384 [01:07<00:04, 392.68it/s]
 93%|█████████▎| 21635/23384 [01:08<00:04, 386.42it/s]
 93%|█████████▎| 21675/23384 [01:08<00:04, 388.11it/s]
 93%|█████████▎| 21714/23384 [01:08<00:04, 388.27it/s]
 93%|█████████▎| 21753/23384 [01:08<00:04, 380.91it/s]
 93%|█████████▎| 21794/23384 [01:08<00:04, 386.93it/s]
 93%|█████████▎| 21833/23384 [01:08<00:04, 387.30it/s]
 94%|█████████▎| 21873/23384 [01:08<00:03, 388.06it/s]
 94%|█████████▎| 21912/23384 [01:08<00:03, 386.13it/s]
 94%|█████████▍| 21953/23384 [01:08<00:03, 392.24it/s]
 94%|█████████▍| 21994/23384 [01:08<00:03, 395.12it/s]
 94%|█████████▍| 22034/23384 [01:09<00:03, 393.41it/s]
 94%|█████████▍| 22076/23384 [01:09<00:03, 400.19it/s]
 95%|█████████▍| 22117/23384 [01:09<00:03, 401.51it/s]
 95%|█████████▍| 22158/23384 [01:09<00:03, 401.81it/s]
 95%|█████████▍| 22203/23384 [01:09<00:02, 414.04it/s]
 95%|█████████▌| 22245/23384 [01:09<00:02, 415.09it/s]
 95%|█████████▌| 22287/23384 [01:09<00:02, 408.06it/s]
 95%|█████████▌| 22328/23384 [01:09<00:02, 404.27it/s]
 96%|█████████▌| 22369/23384 [01:09<00:02, 404.51it/s]
 96%|█████████▌| 22411/23384 [01:09<00:02, 406.63it/s]
 96%|█████████▌| 22452/23384 [01:10<00:02, 400.54it/s]
 96%|█████████▌| 22493/23384 [01:10<00:02, 396.09it/s]
 96%|█████████▋| 22534/23384 [01:10<00:02, 397.71it/s]
 97%|█████████▋| 22574/23384 [01:10<00:02, 398.00it/s]
 97%|█████████▋| 22616/23384 [01:10<00:01, 403.39it/s]
 97%|█████████▋| 22658/23384 [01:10<00:01, 407.52it/s]
 97%|█████████▋| 22703/23384 [01:10<00:01, 418.33it/s]
 97%|█████████▋| 22745/23384 [01:10<00:01, 406.51it/s]
 97%|█████████▋| 22786/23384 [01:10<00:01, 405.24it/s]
 98%|█████████▊| 22830/23384 [01:10<00:01, 413.23it/s]
 98%|█████████▊| 22872/23384 [01:11<00:01, 412.84it/s]
 98%|█████████▊| 22914/23384 [01:11<00:01, 414.19it/s]
 98%|█████████▊| 22956/23384 [01:11<00:01, 405.86it/s]
 98%|█████████▊| 22997/23384 [01:11<00:00, 403.04it/s]
 99%|█████████▊| 23038/23384 [01:11<00:00, 393.89it/s]
 99%|█████████▊| 23078/23384 [01:11<00:00, 384.40it/s]
 99%|█████████▉| 23117/23384 [01:11<00:00, 375.05it/s]
 99%|█████████▉| 23155/23384 [01:11<00:00, 367.07it/s]
 99%|█████████▉| 23195/23384 [01:11<00:00, 374.61it/s]
 99%|█████████▉| 23233/23384 [01:12<00:00, 370.63it/s]
100%|█████████▉| 23271/23384 [01:12<00:00, 371.18it/s]
100%|█████████▉| 23309/23384 [01:12<00:00, 373.71it/s]
100%|█████████▉| 23347/23384 [01:12<00:00, 371.94it/s]
100%|██████████| 23384/23384 [01:12<00:00, 322.69it/s]

  0%|          | 0/1460 [00:00<?, ?it/s]
  3%|▎         | 38/1460 [00:00<00:03, 375.59it/s]
  5%|▌         | 76/1460 [00:00<00:03, 360.27it/s]
  8%|▊         | 116/1460 [00:00<00:03, 374.34it/s]
 11%|█         | 154/1460 [00:00<00:03, 374.25it/s]
 13%|█▎        | 194/1460 [00:00<00:03, 382.18it/s]
 16%|█▌        | 233/1460 [00:00<00:03, 382.60it/s]
 19%|█▊        | 273/1460 [00:00<00:03, 386.78it/s]
 22%|██▏       | 315/1460 [00:00<00:02, 394.42it/s]
 24%|██▍       | 355/1460 [00:00<00:02, 390.44it/s]
 27%|██▋       | 398/1460 [00:01<00:02, 400.07it/s]
 30%|███       | 440/1460 [00:01<00:02, 403.39it/s]
 33%|███▎      | 481/1460 [00:01<00:02, 389.72it/s]
 36%|███▌      | 521/1460 [00:01<00:02, 372.21it/s]
 38%|███▊      | 559/1460 [00:01<00:02, 365.58it/s]
 41%|████      | 596/1460 [00:01<00:02, 362.97it/s]
 43%|████▎     | 633/1460 [00:01<00:02, 359.81it/s]
 46%|████▌     | 673/1460 [00:01<00:02, 370.65it/s]
 49%|████▉     | 713/1460 [00:01<00:01, 376.48it/s]
 51%|█████▏    | 751/1460 [00:01<00:01, 368.34it/s]
 54%|█████▍    | 788/1460 [00:02<00:03, 223.15it/s]
 57%|█████▋    | 826/1460 [00:02<00:02, 253.54it/s]
 59%|█████▉    | 863/1460 [00:02<00:02, 278.06it/s]
 62%|██████▏   | 898/1460 [00:02<00:01, 292.89it/s]
 64%|██████▍   | 936/1460 [00:02<00:01, 313.36it/s]
 67%|██████▋   | 976/1460 [00:02<00:01, 334.49it/s]
 69%|██████▉   | 1012/1460 [00:02<00:01, 336.95it/s]
 72%|███████▏  | 1051/1460 [00:03<00:01, 349.96it/s]
 75%|███████▍  | 1089/1460 [00:03<00:01, 357.07it/s]
 77%|███████▋  | 1128/1460 [00:03<00:00, 364.51it/s]
 80%|████████  | 1169/1460 [00:03<00:00, 377.63it/s]
 83%|████████▎ | 1208/1460 [00:03<00:00, 378.28it/s]
 85%|████████▌ | 1247/1460 [00:03<00:00, 376.93it/s]
 88%|████████▊ | 1285/1460 [00:03<00:00, 370.18it/s]
 91%|█████████ | 1324/1460 [00:03<00:00, 373.74it/s]
 93%|█████████▎| 1362/1460 [00:03<00:00, 370.79it/s]
 96%|█████████▌| 1401/1460 [00:03<00:00, 375.54it/s]
 99%|█████████▊| 1439/1460 [00:04<00:00, 372.04it/s]
100%|██████████| 1460/1460 [00:04<00:00, 354.18it/s]
Reading ./checkpoints/t2m/Comp_v6_KLD005/opt.txt
Loading dataset t2m ...

  0%|          | 0/1460 [00:00<?, ?it/s]
 10%|▉         | 140/1460 [00:00<00:00, 1381.37it/s]
 19%|█▉        | 280/1460 [00:00<00:00, 1386.96it/s]
 29%|██▉       | 429/1460 [00:00<00:00, 1430.50it/s]
 39%|███▉      | 573/1460 [00:00<00:00, 1366.20it/s]
 49%|████▉     | 713/1460 [00:00<00:00, 1377.54it/s]
 58%|█████▊    | 852/1460 [00:00<00:00, 1377.53it/s]
 68%|██████▊   | 993/1460 [00:00<00:00, 1387.90it/s]
 78%|███████▊  | 1146/1460 [00:00<00:00, 1431.30it/s]
 91%|█████████ | 1331/1460 [00:00<00:00, 1560.20it/s]
100%|██████████| 1460/1460 [00:00<00:00, 1481.66it/s]
Pointer Pointing at 0
Ground Truth Dataset Loading Completed!!!
Reading ./checkpoints/t2m/Comp_v6_KLD005/opt.txt
Loading Evaluation Model Wrapper (Epoch 28) Completed!!
Total Epochs: 1500, Total Iters: 574500
Iters Per Epoch, Training: 0383, Validation: 023
--> 	 Eva. Ep 0 :, FID. 28.8010, Diversity Real. 9.3754, Diversity. 4.0470, R_precision_real. [0.50265957 0.7087766  0.79787234], R_precision. [0.03457447 0.06316489 0.09840426], matching_score_real. 2.963627576828003, matching_score_pred. 7.9468278884887695
--> --> 	 FID Improved from 100.00000 to 28.80096 !!!
--> --> 	 matching_score Improved from 100.00000 to 7.94683 !!!
--> --> 	 Diversity Improved from 100.00000 to 4.04696 !!!
--> --> 	 Top1 Improved from 0.0000 to 0.0346 !!!
--> --> 	 Top2 Improved from 0.0000 to 0.0632 !!!
--> --> 	 Top3 Improved from 0.0000 to 0.0984 !!!
ep/it: 0-  49 niter:    50  0m 38s (- 7319m 11s) completed:  0%) loss_emb: 0.0069  loss: 4.8114  acc: 0.0315  lr: 0.0000 
ep/it: 0-  99 niter:   100  0m 59s (- 5734m 10s) completed:  0%) loss_emb: 0.0067  loss: 4.2911  acc: 0.1639  lr: 0.0000 
ep/it: 0- 149 niter:   150  1m 21s (- 5198m 41s) completed:  0%) loss_emb: 0.0064  loss: 3.9612  acc: 0.1725  lr: 0.0000 
ep/it: 0- 199 niter:   200  1m 42s (- 4918m 15s) completed:  0%) loss_emb: 0.0063  loss: 3.8148  acc: 0.1749  lr: 0.0000 
ep/it: 0- 249 niter:   250  2m 4s (- 4750m 6s) completed:  0%) loss_emb: 0.0063  loss: 3.7379  acc: 0.1884  lr: 0.0000 
ep/it: 0- 299 niter:   300  2m 25s (- 4630m 8s) completed:  0%) loss_emb: 0.0062  loss: 3.6899  acc: 0.1937  lr: 0.0000 
ep/it: 0- 349 niter:   350  2m 46s (- 4554m 36s) completed:  0%) loss_emb: 0.0062  loss: 3.6731  acc: 0.1935  lr: 0.0000 
Validation time:
ep/it: 1-  16 niter:   400  3m 8s (- 4501m 44s) completed:  0%) loss_emb: 0.0062  loss: 3.6392  acc: 0.1953  lr: 0.0000 
ep/it: 1-  66 niter:   450  3m 29s (- 4449m 36s) completed:  0%) loss_emb: 0.0061  loss: 3.5968  acc: 0.1992  lr: 0.0000 
ep/it: 1- 116 niter:   500  3m 50s (- 4405m 14s) completed:  0%) loss_emb: 0.0061  loss: 3.5408  acc: 0.2054  lr: 0.0000 
ep/it: 1- 166 niter:   550  4m 11s (- 4379m 50s) completed:  0%) loss_emb: 0.0060  loss: 3.4866  acc: 0.2097  lr: 0.0001 
ep/it: 1- 216 niter:   600  4m 33s (- 4352m 10s) completed:  0%) loss_emb: 0.0059  loss: 3.4277  acc: 0.2163  lr: 0.0001 
ep/it: 1- 266 niter:   650  4m 54s (- 4328m 51s) completed:  0%) loss_emb: 0.0059  loss: 3.4013  acc: 0.2190  lr: 0.0001 
ep/it: 1- 316 niter:   700  5m 15s (- 4311m 57s) completed:  0%) loss_emb: 0.0059  loss: 3.3657  acc: 0.2245  lr: 0.0001 
ep/it: 1- 366 niter:   750  5m 36s (- 4296m 38s) completed:  0%) loss_emb: 0.0058  loss: 3.3460  acc: 0.2262  lr: 0.0001 
Validation time:
ep/it: 2-  33 niter:   800  5m 59s (- 4292m 56s) completed:  0%) loss_emb: 0.0057  loss: 3.2723  acc: 0.2399  lr: 0.0001 
ep/it: 2-  83 niter:   850  6m 20s (- 4278m 50s) completed:  0%) loss_emb: 0.0057  loss: 3.2633  acc: 0.2430  lr: 0.0001 
ep/it: 2- 133 niter:   900  6m 41s (- 4268m 34s) completed:  0%) loss_emb: 0.0056  loss: 3.1887  acc: 0.2565  lr: 0.0001 
ep/it: 2- 183 niter:   950  7m 3s (- 4256m 55s) completed:  0%) loss_emb: 0.0056  loss: 3.1740  acc: 0.2604  lr: 0.0001 
ep/it: 2- 233 niter:  1000  7m 24s (- 4247m 43s) completed:  0%) loss_emb: 0.0055  loss: 3.0997  acc: 0.2766  lr: 0.0001 
ep/it: 2- 283 niter:  1050  7m 46s (- 4244m 25s) completed:  0%) loss_emb: 0.0054  loss: 3.0507  acc: 0.2901  lr: 0.0001 
ep/it: 2- 333 niter:  1100  8m 7s (- 4236m 13s) completed:  0%) loss_emb: 0.0054  loss: 3.0024  acc: 0.3002  lr: 0.0001 
Validation time:
ep/it: 3-   0 niter:  1150  8m 29s (- 4232m 22s) completed:  0%) loss_emb: 0.0053  loss: 2.9265  acc: 0.3181  lr: 0.0001 
ep/it: 3-  50 niter:  1200  8m 51s (- 4228m 18s) completed:  0%) loss_emb: 0.0052  loss: 2.8706  acc: 0.3278  lr: 0.0001 
ep/it: 3- 100 niter:  1250  9m 12s (- 4221m 30s) completed:  0%) loss_emb: 0.0051  loss: 2.8023  acc: 0.3441  lr: 0.0001 
ep/it: 3- 150 niter:  1300  9m 34s (- 4219m 43s) completed:  0%) loss_emb: 0.0051  loss: 2.7822  acc: 0.3486  lr: 0.0001 
ep/it: 3- 200 niter:  1350  9m 55s (- 4211m 1s) completed:  0%) loss_emb: 0.0050  loss: 2.7269  acc: 0.3607  lr: 0.0001 
ep/it: 3- 250 niter:  1400  10m 16s (- 4207m 29s) completed:  0%) loss_emb: 0.0049  loss: 2.6480  acc: 0.3773  lr: 0.0001 
ep/it: 3- 300 niter:  1450  10m 37s (- 4201m 2s) completed:  0%) loss_emb: 0.0048  loss: 2.6044  acc: 0.3896  lr: 0.0001 
ep/it: 3- 350 niter:  1500  10m 59s (- 4196m 4s) completed:  0%) loss_emb: 0.0048  loss: 2.5574  acc: 0.4000  lr: 0.0001 
Validation time:
ep/it: 4-  17 niter:  1550  11m 20s (- 4195m 5s) completed:  0%) loss_emb: 0.0047  loss: 2.4792  acc: 0.4154  lr: 0.0002 
ep/it: 4-  67 niter:  1600  11m 42s (- 4189m 59s) completed:  0%) loss_emb: 0.0046  loss: 2.4085  acc: 0.4304  lr: 0.0002 
ep/it: 4- 117 niter:  1650  12m 3s (- 4187m 48s) completed:  0%) loss_emb: 0.0045  loss: 2.3899  acc: 0.4370  lr: 0.0002 
ep/it: 4- 167 niter:  1700  12m 25s (- 4184m 45s) completed:  0%) loss_emb: 0.0045  loss: 2.3594  acc: 0.4431  lr: 0.0002 
ep/it: 4- 217 niter:  1750  12m 46s (- 4180m 33s) completed:  0%) loss_emb: 0.0044  loss: 2.2895  acc: 0.4576  lr: 0.0002 
ep/it: 4- 267 niter:  1800  13m 7s (- 4177m 35s) completed:  0%) loss_emb: 0.0043  loss: 2.2598  acc: 0.4656  lr: 0.0002 
ep/it: 4- 317 niter:  1850  13m 29s (- 4174m 3s) completed:  0%) loss_emb: 0.0042  loss: 2.1764  acc: 0.4834  lr: 0.0002 
ep/it: 4- 367 niter:  1900  13m 50s (- 4170m 58s) completed:  0%) loss_emb: 0.0042  loss: 2.1951  acc: 0.4795  lr: 0.0002 
Validation time:
ep/it: 5-  34 niter:  1950  14m 12s (- 4172m 0s) completed:  0%) loss_emb: 0.0042  loss: 2.1487  acc: 0.4910  lr: 0.0002 
ep/it: 5-  84 niter:  2000  14m 33s (- 4169m 12s) completed:  0%) loss_emb: 0.0041  loss: 2.0978  acc: 0.5021  lr: 0.0002 
ep/it: 5- 134 niter:  2050  14m 55s (- 4166m 14s) completed:  0%) loss_emb: 0.0040  loss: 2.0324  acc: 0.5167  lr: 0.0002 
ep/it: 5- 184 niter:  2100  15m 16s (- 4162m 5s) completed:  0%) loss_emb: 0.0040  loss: 2.0227  acc: 0.5201  lr: 0.0002 
ep/it: 5- 234 niter:  2150  15m 37s (- 4160m 1s) completed:  0%) loss_emb: 0.0040  loss: 2.0007  acc: 0.5241  lr: 0.0002 
ep/it: 5- 284 niter:  2200  15m 58s (- 4156m 43s) completed:  0%) loss_emb: 0.0039  loss: 1.9729  acc: 0.5308  lr: 0.0002 
ep/it: 5- 334 niter:  2250  16m 20s (- 4154m 35s) completed:  0%) loss_emb: 0.0039  loss: 1.9446  acc: 0.5367  lr: 0.0002 
Validation time:
ep/it: 6-   1 niter:  2300  16m 42s (- 4155m 25s) completed:  0%) loss_emb: 0.0038  loss: 1.9180  acc: 0.5424  lr: 0.0002 
ep/it: 6-  51 niter:  2350  17m 3s (- 4152m 43s) completed:  0%) loss_emb: 0.0038  loss: 1.9010  acc: 0.5484  lr: 0.0002 
ep/it: 6- 101 niter:  2400  17m 24s (- 4150m 42s) completed:  0%) loss_emb: 0.0037  loss: 1.8434  acc: 0.5588  lr: 0.0002 
ep/it: 6- 151 niter:  2450  17m 45s (- 4147m 46s) completed:  0%) loss_emb: 0.0037  loss: 1.8689  acc: 0.5539  lr: 0.0002 
ep/it: 6- 201 niter:  2500  18m 7s (- 4145m 27s) completed:  0%) loss_emb: 0.0037  loss: 1.8555  acc: 0.5565  lr: 0.0002 
ep/it: 6- 251 niter:  2550  18m 28s (- 4144m 3s) completed:  0%) loss_emb: 0.0037  loss: 1.8319  acc: 0.5611  lr: 0.0002 
ep/it: 6- 301 niter:  2600  18m 49s (- 4142m 4s) completed:  0%) loss_emb: 0.0036  loss: 1.8078  acc: 0.5680  lr: 0.0002 
ep/it: 6- 351 niter:  2650  19m 11s (- 4139m 50s) completed:  0%) loss_emb: 0.0036  loss: 1.7627  acc: 0.5779  lr: 0.0002 
Validation time:
ep/it: 7-  18 niter:  2700  19m 32s (- 4139m 17s) completed:  0%) loss_emb: 0.0036  loss: 1.7902  acc: 0.5707  lr: 0.0002 
ep/it: 7-  68 niter:  2750  19m 54s (- 4137m 31s) completed:  0%) loss_emb: 0.0036  loss: 1.7656  acc: 0.5761  lr: 0.0002 
ep/it: 7- 118 niter:  2800  20m 15s (- 4136m 0s) completed:  0%) loss_emb: 0.0035  loss: 1.7620  acc: 0.5769  lr: 0.0002 
ep/it: 7- 168 niter:  2850  20m 36s (- 4134m 4s) completed:  0%) loss_emb: 0.0035  loss: 1.7141  acc: 0.5891  lr: 0.0002 
ep/it: 7- 218 niter:  2900  20m 57s (- 4131m 45s) completed:  0%) loss_emb: 0.0035  loss: 1.7324  acc: 0.5832  lr: 0.0002 
ep/it: 7- 268 niter:  2950  21m 18s (- 4128m 36s) completed:  0%) loss_emb: 0.0035  loss: 1.7443  acc: 0.5808  lr: 0.0002 
ep/it: 7- 318 niter:  3000  21m 40s (- 4127m 47s) completed:  0%) loss_emb: 0.0034  loss: 1.7044  acc: 0.5906  lr: 0.0002 
ep/it: 7- 368 niter:  3050  22m 1s (- 4127m 56s) completed:  0%) loss_emb: 0.0034  loss: 1.6672  acc: 0.5985  lr: 0.0002 
Validation time:
ep/it: 8-  35 niter:  3100  22m 24s (- 4129m 27s) completed:  0%) loss_emb: 0.0034  loss: 1.6611  acc: 0.5981  lr: 0.0002 
ep/it: 8-  85 niter:  3150  22m 45s (- 4128m 14s) completed:  0%) loss_emb: 0.0034  loss: 1.6557  acc: 0.6007  lr: 0.0002 
ep/it: 8- 135 niter:  3200  23m 7s (- 4128m 28s) completed:  0%) loss_emb: 0.0034  loss: 1.6610  acc: 0.5992  lr: 0.0002 
ep/it: 8- 185 niter:  3250  23m 28s (- 4126m 49s) completed:  0%) loss_emb: 0.0034  loss: 1.6708  acc: 0.5974  lr: 0.0002 
ep/it: 8- 235 niter:  3300  23m 49s (- 4125m 9s) completed:  0%) loss_emb: 0.0033  loss: 1.6268  acc: 0.6082  lr: 0.0002 
ep/it: 8- 285 niter:  3350  24m 11s (- 4123m 5s) completed:  0%) loss_emb: 0.0033  loss: 1.6365  acc: 0.6056  lr: 0.0002 
ep/it: 8- 335 niter:  3400  24m 32s (- 4121m 12s) completed:  0%) loss_emb: 0.0033  loss: 1.6251  acc: 0.6069  lr: 0.0002 
Validation time:
ep/it: 9-   2 niter:  3450  24m 54s (- 4121m 43s) completed:  0%) loss_emb: 0.0033  loss: 1.6401  acc: 0.6037  lr: 0.0002 
ep/it: 9-  52 niter:  3500  25m 15s (- 4120m 37s) completed:  0%) loss_emb: 0.0033  loss: 1.5954  acc: 0.6137  lr: 0.0002 
ep/it: 9- 102 niter:  3550  25m 36s (- 4119m 32s) completed:  0%) loss_emb: 0.0032  loss: 1.5821  acc: 0.6166  lr: 0.0002 
ep/it: 9- 152 niter:  3600  25m 57s (- 4117m 45s) completed:  0%) loss_emb: 0.0032  loss: 1.5947  acc: 0.6138  lr: 0.0002 
ep/it: 9- 202 niter:  3650  26m 18s (- 4115m 47s) completed:  0%) loss_emb: 0.0033  loss: 1.6131  acc: 0.6100  lr: 0.0002 
ep/it: 9- 252 niter:  3700  26m 40s (- 4114m 15s) completed:  0%) loss_emb: 0.0032  loss: 1.5970  acc: 0.6132  lr: 0.0002 
ep/it: 9- 302 niter:  3750  27m 1s (- 4112m 59s) completed:  0%) loss_emb: 0.0032  loss: 1.5505  acc: 0.6243  lr: 0.0002 
ep/it: 9- 352 niter:  3800  27m 22s (- 4111m 10s) completed:  0%) loss_emb: 0.0032  loss: 1.5407  acc: 0.6267  lr: 0.0002 
Validation time:
--> 	 Eva. Ep 10 :, FID. 9.9593, Diversity Real. 9.3289, Diversity. 7.0938, R_precision_real. [0.51130319 0.7087766  0.78989362], R_precision. [0.18816489 0.31449468 0.41023936], matching_score_real. 2.93660306930542, matching_score_pred. 6.017515182495117
--> --> 	 FID Improved from 28.80096 to 9.95930 !!!
--> --> 	 matching_score Improved from 7.94683 to 6.01752 !!!
--> --> 	 Diversity Improved from 4.04696 to 7.09381 !!!
--> --> 	 Top1 Improved from 0.0346 to 0.1882 !!!
--> --> 	 Top2 Improved from 0.0632 to 0.3145 !!!
--> --> 	 Top3 Improved from 0.0984 to 0.4102 !!!
ep/it:10-  19 niter:  3850  27m 58s (- 4147m 33s) completed:  0%) loss_emb: 0.0032  loss: 1.5532  acc: 0.6229  lr: 0.0002 
ep/it:10-  69 niter:  3900  28m 20s (- 4146m 1s) completed:  0%) loss_emb: 0.0032  loss: 1.5422  acc: 0.6252  lr: 0.0002 
ep/it:10- 119 niter:  3950  28m 41s (- 4144m 46s) completed:  0%) loss_emb: 0.0031  loss: 1.4987  acc: 0.6363  lr: 0.0002 
ep/it:10- 169 niter:  4000  29m 2s (- 4143m 10s) completed:  0%) loss_emb: 0.0031  loss: 1.5337  acc: 0.6273  lr: 0.0002 
ep/it:10- 219 niter:  4050  29m 24s (- 4141m 57s) completed:  0%) loss_emb: 0.0031  loss: 1.5363  acc: 0.6260  lr: 0.0002 
ep/it:10- 269 niter:  4100  29m 45s (- 4140m 1s) completed:  0%) loss_emb: 0.0031  loss: 1.5168  acc: 0.6307  lr: 0.0002 
ep/it:10- 319 niter:  4150  30m 6s (- 4138m 19s) completed:  0%) loss_emb: 0.0031  loss: 1.5189  acc: 0.6316  lr: 0.0002 
ep/it:10- 369 niter:  4200  30m 27s (- 4136m 38s) completed:  0%) loss_emb: 0.0031  loss: 1.4975  acc: 0.6353  lr: 0.0002 
Validation time:
ep/it:11-  36 niter:  4250  30m 49s (- 4135m 58s) completed:  0%) loss_emb: 0.0031  loss: 1.5302  acc: 0.6287  lr: 0.0002 
ep/it:11-  86 niter:  4300  31m 10s (- 4134m 34s) completed:  0%) loss_emb: 0.0031  loss: 1.5277  acc: 0.6274  lr: 0.0002 
ep/it:11- 136 niter:  4350  31m 31s (- 4132m 27s) completed:  0%) loss_emb: 0.0031  loss: 1.5061  acc: 0.6329  lr: 0.0002 
ep/it:11- 186 niter:  4400  31m 52s (- 4130m 56s) completed:  0%) loss_emb: 0.0030  loss: 1.4683  acc: 0.6406  lr: 0.0002 
ep/it:11- 236 niter:  4450  32m 14s (- 4129m 16s) completed:  0%) loss_emb: 0.0030  loss: 1.4817  acc: 0.6386  lr: 0.0002 
ep/it:11- 286 niter:  4500  32m 35s (- 4128m 19s) completed:  0%) loss_emb: 0.0031  loss: 1.4893  acc: 0.6366  lr: 0.0002 
ep/it:11- 336 niter:  4550  32m 56s (- 4127m 6s) completed:  0%) loss_emb: 0.0030  loss: 1.4709  acc: 0.6414  lr: 0.0002 
Validation time:
ep/it:12-   3 niter:  4600  33m 18s (- 4127m 7s) completed:  0%) loss_emb: 0.0031  loss: 1.4884  acc: 0.6375  lr: 0.0002 
ep/it:12-  53 niter:  4650  33m 40s (- 4126m 26s) completed:  0%) loss_emb: 0.0030  loss: 1.4638  acc: 0.6424  lr: 0.0002 
ep/it:12- 103 niter:  4700  34m 2s (- 4126m 37s) completed:  0%) loss_emb: 0.0030  loss: 1.4731  acc: 0.6401  lr: 0.0002 
ep/it:12- 153 niter:  4750  34m 23s (- 4125m 54s) completed:  0%) loss_emb: 0.0031  loss: 1.4878  acc: 0.6364  lr: 0.0002 
ep/it:12- 203 niter:  4800  34m 45s (- 4124m 42s) completed:  0%) loss_emb: 0.0030  loss: 1.4513  acc: 0.6451  lr: 0.0002 
ep/it:12- 253 niter:  4850  35m 6s (- 4123m 37s) completed:  0%) loss_emb: 0.0029  loss: 1.4108  acc: 0.6533  lr: 0.0002 
ep/it:12- 303 niter:  4900  35m 28s (- 4123m 14s) completed:  0%) loss_emb: 0.0030  loss: 1.4748  acc: 0.6403  lr: 0.0002 
ep/it:12- 353 niter:  4950  35m 49s (- 4122m 1s) completed:  0%) loss_emb: 0.0030  loss: 1.4345  acc: 0.6493  lr: 0.0002 
Validation time:
ep/it:13-  20 niter:  5000  36m 11s (- 4121m 45s) completed:  0%) loss_emb: 0.0029  loss: 1.4164  acc: 0.6524  lr: 0.0002 
ep/it:13-  70 niter:  5050  36m 32s (- 4121m 19s) completed:  0%) loss_emb: 0.0030  loss: 1.4588  acc: 0.6438  lr: 0.0002 
ep/it:13- 120 niter:  5100  36m 54s (- 4120m 17s) completed:  0%) loss_emb: 0.0030  loss: 1.4357  acc: 0.6484  lr: 0.0002 
ep/it:13- 170 niter:  5150  37m 15s (- 4118m 34s) completed:  0%) loss_emb: 0.0030  loss: 1.4376  acc: 0.6476  lr: 0.0002 
ep/it:13- 220 niter:  5200  37m 36s (- 4116m 51s) completed:  0%) loss_emb: 0.0029  loss: 1.4007  acc: 0.6557  lr: 0.0002 
ep/it:13- 270 niter:  5250  37m 57s (- 4116m 19s) completed:  0%) loss_emb: 0.0029  loss: 1.4203  acc: 0.6520  lr: 0.0002 
ep/it:13- 320 niter:  5300  38m 19s (- 4115m 38s) completed:  0%) loss_emb: 0.0029  loss: 1.4164  acc: 0.6534  lr: 0.0002 
ep/it:13- 370 niter:  5350  38m 40s (- 4114m 13s) completed:  0%) loss_emb: 0.0029  loss: 1.4126  acc: 0.6532  lr: 0.0002 
Validation time:
ep/it:14-  37 niter:  5400  39m 2s (- 4114m 35s) completed:  0%) loss_emb: 0.0029  loss: 1.3936  acc: 0.6580  lr: 0.0002 
ep/it:14-  87 niter:  5450  39m 23s (- 4113m 45s) completed:  0%) loss_emb: 0.0029  loss: 1.4062  acc: 0.6537  lr: 0.0002 
ep/it:14- 137 niter:  5500  39m 45s (- 4113m 18s) completed:  0%) loss_emb: 0.0029  loss: 1.4176  acc: 0.6514  lr: 0.0002 
ep/it:14- 187 niter:  5550  40m 7s (- 4112m 38s) completed:  0%) loss_emb: 0.0029  loss: 1.4007  acc: 0.6562  lr: 0.0002 
ep/it:14- 237 niter:  5600  40m 28s (- 4111m 27s) completed:  0%) loss_emb: 0.0029  loss: 1.4124  acc: 0.6535  lr: 0.0002 
ep/it:14- 287 niter:  5650  40m 49s (- 4110m 35s) completed:  0%) loss_emb: 0.0029  loss: 1.3848  acc: 0.6597  lr: 0.0002 
ep/it:14- 337 niter:  5700  41m 10s (- 4109m 32s) completed:  0%) loss_emb: 0.0030  loss: 1.4412  acc: 0.6463  lr: 0.0002 
Validation time:
ep/it:15-   4 niter:  5750  41m 33s (- 4110m 3s) completed:  1%) loss_emb: 0.0029  loss: 1.3986  acc: 0.6556  lr: 0.0002 
ep/it:15-  54 niter:  5800  41m 54s (- 4109m 30s) completed:  1%) loss_emb: 0.0029  loss: 1.3801  acc: 0.6592  lr: 0.0002 
ep/it:15- 104 niter:  5850  42m 16s (- 4109m 2s) completed:  1%) loss_emb: 0.0029  loss: 1.3943  acc: 0.6569  lr: 0.0002 
ep/it:15- 154 niter:  5900  42m 37s (- 4107m 43s) completed:  1%) loss_emb: 0.0028  loss: 1.3685  acc: 0.6626  lr: 0.0002 
ep/it:15- 204 niter:  5950  42m 58s (- 4106m 9s) completed:  1%) loss_emb: 0.0028  loss: 1.3755  acc: 0.6616  lr: 0.0002 
ep/it:15- 254 niter:  6000  43m 19s (- 4105m 17s) completed:  1%) loss_emb: 0.0029  loss: 1.4036  acc: 0.6551  lr: 0.0002 
ep/it:15- 304 niter:  6050  43m 41s (- 4105m 27s) completed:  1%) loss_emb: 0.0029  loss: 1.4054  acc: 0.6545  lr: 0.0002 
ep/it:15- 354 niter:  6100  44m 2s (- 4104m 13s) completed:  1%) loss_emb: 0.0029  loss: 1.3772  acc: 0.6599  lr: 0.0002 
Validation time:
ep/it:16-  21 niter:  6150  44m 24s (- 4104m 31s) completed:  1%) loss_emb: 0.0028  loss: 1.3676  acc: 0.6611  lr: 0.0002 
ep/it:16-  71 niter:  6200  44m 46s (- 4103m 26s) completed:  1%) loss_emb: 0.0029  loss: 1.3849  acc: 0.6573  lr: 0.0002 
ep/it:16- 121 niter:  6250  45m 6s (- 4101m 51s) completed:  1%) loss_emb: 0.0028  loss: 1.3430  acc: 0.6684  lr: 0.0002 
ep/it:16- 171 niter:  6300  45m 27s (- 4100m 21s) completed:  1%) loss_emb: 0.0029  loss: 1.3778  acc: 0.6602  lr: 0.0002 
ep/it:16- 221 niter:  6350  45m 48s (- 4098m 37s) completed:  1%) loss_emb: 0.0028  loss: 1.3283  acc: 0.6713  lr: 0.0002 
ep/it:16- 271 niter:  6400  46m 9s (- 4097m 25s) completed:  1%) loss_emb: 0.0028  loss: 1.3601  acc: 0.6636  lr: 0.0002 
ep/it:16- 321 niter:  6450  46m 30s (- 4095m 55s) completed:  1%) loss_emb: 0.0028  loss: 1.3385  acc: 0.6688  lr: 0.0002 
ep/it:16- 371 niter:  6500  46m 51s (- 4094m 4s) completed:  1%) loss_emb: 0.0029  loss: 1.3832  acc: 0.6572  lr: 0.0002 
Validation time:
ep/it:17-  38 niter:  6550  47m 12s (- 4094m 6s) completed:  1%) loss_emb: 0.0028  loss: 1.3369  acc: 0.6690  lr: 0.0002 
ep/it:17-  88 niter:  6600  47m 34s (- 4093m 18s) completed:  1%) loss_emb: 0.0028  loss: 1.3270  acc: 0.6709  lr: 0.0002 
ep/it:17- 138 niter:  6650  47m 55s (- 4092m 53s) completed:  1%) loss_emb: 0.0028  loss: 1.3668  acc: 0.6620  lr: 0.0002 
ep/it:17- 188 niter:  6700  48m 16s (- 4091m 4s) completed:  1%) loss_emb: 0.0028  loss: 1.3620  acc: 0.6638  lr: 0.0002 
ep/it:17- 238 niter:  6750  48m 37s (- 4089m 47s) completed:  1%) loss_emb: 0.0027  loss: 1.3124  acc: 0.6743  lr: 0.0002 
ep/it:17- 288 niter:  6800  48m 58s (- 4088m 49s) completed:  1%) loss_emb: 0.0028  loss: 1.3528  acc: 0.6649  lr: 0.0002 
ep/it:17- 338 niter:  6850  49m 19s (- 4087m 30s) completed:  1%) loss_emb: 0.0028  loss: 1.3362  acc: 0.6698  lr: 0.0002 
Validation time:
ep/it:18-   5 niter:  6900  49m 41s (- 4087m 8s) completed:  1%) loss_emb: 0.0028  loss: 1.3352  acc: 0.6695  lr: 0.0002 
ep/it:18-  55 niter:  6950  50m 2s (- 4085m 52s) completed:  1%) loss_emb: 0.0028  loss: 1.3370  acc: 0.6679  lr: 0.0002 
ep/it:18- 105 niter:  7000  50m 23s (- 4085m 26s) completed:  1%) loss_emb: 0.0028  loss: 1.3412  acc: 0.6677  lr: 0.0002 
ep/it:18- 155 niter:  7050  50m 45s (- 4084m 50s) completed:  1%) loss_emb: 0.0027  loss: 1.3116  acc: 0.6743  lr: 0.0002 
ep/it:18- 205 niter:  7100  51m 5s (- 4083m 34s) completed:  1%) loss_emb: 0.0027  loss: 1.3156  acc: 0.6735  lr: 0.0002 
ep/it:18- 255 niter:  7150  51m 27s (- 4082m 33s) completed:  1%) loss_emb: 0.0027  loss: 1.3161  acc: 0.6731  lr: 0.0002 
ep/it:18- 305 niter:  7200  51m 48s (- 4081m 47s) completed:  1%) loss_emb: 0.0028  loss: 1.3255  acc: 0.6714  lr: 0.0002 
ep/it:18- 355 niter:  7250  52m 9s (- 4081m 0s) completed:  1%) loss_emb: 0.0028  loss: 1.3190  acc: 0.6709  lr: 0.0002 
Validation time:
ep/it:19-  22 niter:  7300  52m 31s (- 4080m 32s) completed:  1%) loss_emb: 0.0027  loss: 1.3033  acc: 0.6759  lr: 0.0002 
ep/it:19-  72 niter:  7350  52m 51s (- 4078m 56s) completed:  1%) loss_emb: 0.0027  loss: 1.3158  acc: 0.6725  lr: 0.0002 
ep/it:19- 122 niter:  7400  53m 12s (- 4077m 53s) completed:  1%) loss_emb: 0.0027  loss: 1.3180  acc: 0.6724  lr: 0.0002 
ep/it:19- 172 niter:  7450  53m 34s (- 4077m 18s) completed:  1%) loss_emb: 0.0027  loss: 1.3153  acc: 0.6731  lr: 0.0002 
ep/it:19- 222 niter:  7500  53m 55s (- 4076m 39s) completed:  1%) loss_emb: 0.0028  loss: 1.3400  acc: 0.6674  lr: 0.0002 
ep/it:19- 272 niter:  7550  54m 16s (- 4075m 56s) completed:  1%) loss_emb: 0.0027  loss: 1.3018  acc: 0.6764  lr: 0.0002 
ep/it:19- 322 niter:  7600  54m 38s (- 4075m 19s) completed:  1%) loss_emb: 0.0027  loss: 1.3078  acc: 0.6757  lr: 0.0002 
ep/it:19- 372 niter:  7650  54m 59s (- 4074m 59s) completed:  1%) loss_emb: 0.0027  loss: 1.3109  acc: 0.6732  lr: 0.0002 
Validation time:
--> 	 Eva. Ep 20 :, FID. 9.5584, Diversity Real. 9.5995, Diversity. 6.9172, R_precision_real. [0.50598404 0.70146277 0.79720745], R_precision. [0.21675532 0.35172872 0.4581117 ], matching_score_real. 2.895113945007324, matching_score_pred. 5.52779483795166
--> --> 	 FID Improved from 9.95930 to 9.55844 !!!
--> --> 	 matching_score Improved from 6.01752 to 5.52779 !!!
--> --> 	 Top1 Improved from 0.1882 to 0.2168 !!!
--> --> 	 Top2 Improved from 0.3145 to 0.3517 !!!
--> --> 	 Top3 Improved from 0.4102 to 0.4581 !!!
ep/it:20-  39 niter:  7700  55m 37s (- 4094m 41s) completed:  1%) loss_emb: 0.0028  loss: 1.3273  acc: 0.6704  lr: 0.0002 
ep/it:20-  89 niter:  7750  55m 58s (- 4093m 48s) completed:  1%) loss_emb: 0.0027  loss: 1.2992  acc: 0.6771  lr: 0.0002 
ep/it:20- 139 niter:  7800  56m 19s (- 4092m 49s) completed:  1%) loss_emb: 0.0027  loss: 1.3035  acc: 0.6756  lr: 0.0002 
ep/it:20- 189 niter:  7850  56m 41s (- 4091m 44s) completed:  1%) loss_emb: 0.0027  loss: 1.2903  acc: 0.6788  lr: 0.0002 
ep/it:20- 239 niter:  7900  57m 2s (- 4091m 13s) completed:  1%) loss_emb: 0.0027  loss: 1.2977  acc: 0.6775  lr: 0.0002 
ep/it:20- 289 niter:  7950  57m 24s (- 4091m 1s) completed:  1%) loss_emb: 0.0027  loss: 1.2926  acc: 0.6793  lr: 0.0002 
ep/it:20- 339 niter:  8000  57m 45s (- 4090m 15s) completed:  1%) loss_emb: 0.0026  loss: 1.2537  acc: 0.6874  lr: 0.0002 
Validation time:
ep/it:21-   6 niter:  8050  58m 8s (- 4091m 16s) completed:  1%) loss_emb: 0.0027  loss: 1.3098  acc: 0.6742  lr: 0.0002 
ep/it:21-  56 niter:  8100  58m 29s (- 4090m 16s) completed:  1%) loss_emb: 0.0027  loss: 1.2816  acc: 0.6797  lr: 0.0002 
ep/it:21- 106 niter:  8150  58m 51s (- 4089m 32s) completed:  1%) loss_emb: 0.0027  loss: 1.2796  acc: 0.6808  lr: 0.0002 
ep/it:21- 156 niter:  8200  59m 12s (- 4089m 16s) completed:  1%) loss_emb: 0.0027  loss: 1.2975  acc: 0.6764  lr: 0.0002 
ep/it:21- 206 niter:  8250  59m 34s (- 4089m 0s) completed:  1%) loss_emb: 0.0027  loss: 1.3004  acc: 0.6757  lr: 0.0002 
ep/it:21- 256 niter:  8300  59m 55s (- 4088m 13s) completed:  1%) loss_emb: 0.0027  loss: 1.2722  acc: 0.6831  lr: 0.0002 
ep/it:21- 306 niter:  8350  60m 16s (- 4087m 13s) completed:  1%) loss_emb: 0.0026  loss: 1.2478  acc: 0.6884  lr: 0.0002 
ep/it:21- 356 niter:  8400  60m 38s (- 4086m 32s) completed:  1%) loss_emb: 0.0027  loss: 1.2933  acc: 0.6777  lr: 0.0002 
Validation time:
ep/it:22-  23 niter:  8450  61m 0s (- 4086m 47s) completed:  1%) loss_emb: 0.0026  loss: 1.2615  acc: 0.6844  lr: 0.0002 
ep/it:22-  73 niter:  8500  61m 22s (- 4086m 35s) completed:  1%) loss_emb: 0.0026  loss: 1.2445  acc: 0.6883  lr: 0.0002 
ep/it:22- 123 niter:  8550  61m 43s (- 4085m 59s) completed:  1%) loss_emb: 0.0026  loss: 1.2645  acc: 0.6843  lr: 0.0002 
ep/it:22- 173 niter:  8600  62m 4s (- 4085m 6s) completed:  1%) loss_emb: 0.0026  loss: 1.2487  acc: 0.6882  lr: 0.0002 
ep/it:22- 223 niter:  8650  62m 25s (- 4084m 2s) completed:  1%) loss_emb: 0.0026  loss: 1.2470  acc: 0.6885  lr: 0.0002 
ep/it:22- 273 niter:  8700  62m 47s (- 4083m 36s) completed:  1%) loss_emb: 0.0027  loss: 1.2634  acc: 0.6838  lr: 0.0002 
ep/it:22- 323 niter:  8750  63m 8s (- 4082m 44s) completed:  1%) loss_emb: 0.0027  loss: 1.2789  acc: 0.6811  lr: 0.0002 
ep/it:22- 373 niter:  8800  63m 29s (- 4081m 46s) completed:  1%) loss_emb: 0.0027  loss: 1.2734  acc: 0.6822  lr: 0.0002 
Validation time:
ep/it:23-  40 niter:  8850  63m 52s (- 4082m 15s) completed:  1%) loss_emb: 0.0027  loss: 1.2723  acc: 0.6811  lr: 0.0002 
ep/it:23-  90 niter:  8900  64m 13s (- 4081m 24s) completed:  1%) loss_emb: 0.0026  loss: 1.2533  acc: 0.6868  lr: 0.0002 
ep/it:23- 140 niter:  8950  64m 34s (- 4080m 48s) completed:  1%) loss_emb: 0.0026  loss: 1.2626  acc: 0.6833  lr: 0.0002 
ep/it:23- 190 niter:  9000  64m 55s (- 4079m 54s) completed:  1%) loss_emb: 0.0026  loss: 1.2528  acc: 0.6865  lr: 0.0002 
ep/it:23- 240 niter:  9050  65m 17s (- 4079m 15s) completed:  1%) loss_emb: 0.0026  loss: 1.2671  acc: 0.6836  lr: 0.0002 
ep/it:23- 290 niter:  9100  65m 38s (- 4078m 55s) completed:  1%) loss_emb: 0.0026  loss: 1.2501  acc: 0.6866  lr: 0.0002 
ep/it:23- 340 niter:  9150  66m 0s (- 4077m 59s) completed:  1%) loss_emb: 0.0026  loss: 1.2260  acc: 0.6920  lr: 0.0002 
Validation time:
ep/it:24-   7 niter:  9200  66m 22s (- 4078m 27s) completed:  1%) loss_emb: 0.0026  loss: 1.2588  acc: 0.6847  lr: 0.0002 
ep/it:24-  57 niter:  9250  66m 43s (- 4077m 34s) completed:  1%) loss_emb: 0.0026  loss: 1.2358  acc: 0.6893  lr: 0.0002 
ep/it:24- 107 niter:  9300  67m 5s (- 4077m 22s) completed:  1%) loss_emb: 0.0026  loss: 1.2433  acc: 0.6886  lr: 0.0002 
ep/it:24- 157 niter:  9350  67m 27s (- 4076m 56s) completed:  1%) loss_emb: 0.0027  loss: 1.2701  acc: 0.6821  lr: 0.0002 
ep/it:24- 207 niter:  9400  67m 48s (- 4076m 26s) completed:  1%) loss_emb: 0.0026  loss: 1.2559  acc: 0.6859  lr: 0.0002 
ep/it:24- 257 niter:  9450  68m 10s (- 4076m 7s) completed:  1%) loss_emb: 0.0026  loss: 1.2273  acc: 0.6912  lr: 0.0002 
ep/it:24- 307 niter:  9500  68m 31s (- 4075m 43s) completed:  1%) loss_emb: 0.0026  loss: 1.2297  acc: 0.6919  lr: 0.0002 
ep/it:24- 357 niter:  9550  68m 53s (- 4075m 15s) completed:  1%) loss_emb: 0.0026  loss: 1.2366  acc: 0.6912  lr: 0.0002 
Validation time:
ep/it:25-  24 niter:  9600  69m 15s (- 4075m 10s) completed:  1%) loss_emb: 0.0026  loss: 1.2397  acc: 0.6888  lr: 0.0002 
ep/it:25-  74 niter:  9650  69m 37s (- 4074m 58s) completed:  1%) loss_emb: 0.0026  loss: 1.2273  acc: 0.6915  lr: 0.0002 
ep/it:25- 124 niter:  9700  69m 59s (- 4074m 58s) completed:  1%) loss_emb: 0.0026  loss: 1.2263  acc: 0.6909  lr: 0.0002 
ep/it:25- 174 niter:  9750  70m 19s (- 4073m 53s) completed:  1%) loss_emb: 0.0026  loss: 1.2589  acc: 0.6852  lr: 0.0002 
ep/it:25- 224 niter:  9800  70m 41s (- 4073m 10s) completed:  1%) loss_emb: 0.0026  loss: 1.2179  acc: 0.6943  lr: 0.0002 
ep/it:25- 274 niter:  9850  71m 2s (- 4072m 37s) completed:  1%) loss_emb: 0.0026  loss: 1.2229  acc: 0.6930  lr: 0.0002 
ep/it:25- 324 niter:  9900  71m 23s (- 4071m 45s) completed:  1%) loss_emb: 0.0026  loss: 1.2360  acc: 0.6895  lr: 0.0002 
ep/it:25- 374 niter:  9950  71m 45s (- 4071m 12s) completed:  1%) loss_emb: 0.0026  loss: 1.2220  acc: 0.6931  lr: 0.0002 
Validation time:
ep/it:26-  41 niter: 10000  72m 7s (- 4071m 31s) completed:  1%) loss_emb: 0.0026  loss: 1.2136  acc: 0.6944  lr: 0.0002 
ep/it:26-  91 niter: 10050  72m 29s (- 4071m 27s) completed:  1%) loss_emb: 0.0027  loss: 1.2774  acc: 0.6802  lr: 0.0002 
ep/it:26- 141 niter: 10100  72m 50s (- 4070m 44s) completed:  1%) loss_emb: 0.0026  loss: 1.2483  acc: 0.6864  lr: 0.0002 
ep/it:26- 191 niter: 10150  73m 12s (- 4070m 8s) completed:  1%) loss_emb: 0.0025  loss: 1.2011  acc: 0.6980  lr: 0.0002 
ep/it:26- 241 niter: 10200  73m 33s (- 4069m 29s) completed:  1%) loss_emb: 0.0026  loss: 1.2270  acc: 0.6923  lr: 0.0002 
ep/it:26- 291 niter: 10250  73m 55s (- 4069m 12s) completed:  1%) loss_emb: 0.0026  loss: 1.2105  acc: 0.6950  lr: 0.0002 
ep/it:26- 341 niter: 10300  74m 16s (- 4068m 25s) completed:  1%) loss_emb: 0.0026  loss: 1.2131  acc: 0.6953  lr: 0.0002 
Validation time:
ep/it:27-   8 niter: 10350  74m 38s (- 4068m 15s) completed:  1%) loss_emb: 0.0026  loss: 1.2290  acc: 0.6914  lr: 0.0002 
ep/it:27-  58 niter: 10400  74m 59s (- 4067m 14s) completed:  1%) loss_emb: 0.0026  loss: 1.2132  acc: 0.6939  lr: 0.0002 
ep/it:27- 108 niter: 10450  75m 20s (- 4066m 32s) completed:  1%) loss_emb: 0.0025  loss: 1.1912  acc: 0.7000  lr: 0.0002 
ep/it:27- 158 niter: 10500  75m 41s (- 4065m 57s) completed:  1%) loss_emb: 0.0026  loss: 1.2205  acc: 0.6926  lr: 0.0002 
ep/it:27- 208 niter: 10550  76m 3s (- 4065m 45s) completed:  1%) loss_emb: 0.0026  loss: 1.2261  acc: 0.6916  lr: 0.0002 
ep/it:27- 258 niter: 10600  76m 25s (- 4065m 39s) completed:  1%) loss_emb: 0.0026  loss: 1.2333  acc: 0.6900  lr: 0.0002 
ep/it:27- 308 niter: 10650  76m 46s (- 4064m 53s) completed:  1%) loss_emb: 0.0026  loss: 1.2289  acc: 0.6904  lr: 0.0002 
ep/it:27- 358 niter: 10700  77m 7s (- 4064m 16s) completed:  1%) loss_emb: 0.0026  loss: 1.2136  acc: 0.6943  lr: 0.0002 
Validation time:
ep/it:28-  25 niter: 10750  77m 30s (- 4064m 38s) completed:  1%) loss_emb: 0.0025  loss: 1.2131  acc: 0.6936  lr: 0.0002 
ep/it:28-  75 niter: 10800  77m 52s (- 4064m 14s) completed:  1%) loss_emb: 0.0025  loss: 1.2115  acc: 0.6948  lr: 0.0002 
ep/it:28- 125 niter: 10850  78m 13s (- 4063m 47s) completed:  1%) loss_emb: 0.0025  loss: 1.1938  acc: 0.6981  lr: 0.0002 
ep/it:28- 175 niter: 10900  78m 34s (- 4063m 11s) completed:  1%) loss_emb: 0.0026  loss: 1.2484  acc: 0.6866  lr: 0.0002 
ep/it:28- 225 niter: 10950  78m 57s (- 4063m 26s) completed:  1%) loss_emb: 0.0025  loss: 1.2050  acc: 0.6968  lr: 0.0002 
ep/it:28- 275 niter: 11000  79m 18s (- 4062m 58s) completed:  1%) loss_emb: 0.0025  loss: 1.1854  acc: 0.7004  lr: 0.0002 
ep/it:28- 325 niter: 11050  79m 40s (- 4062m 28s) completed:  1%) loss_emb: 0.0025  loss: 1.1789  acc: 0.7031  lr: 0.0002 
ep/it:28- 375 niter: 11100  80m 1s (- 4061m 51s) completed:  1%) loss_emb: 0.0026  loss: 1.2163  acc: 0.6923  lr: 0.0002 
Validation time:
ep/it:29-  42 niter: 11150  80m 23s (- 4061m 51s) completed:  1%) loss_emb: 0.0025  loss: 1.2000  acc: 0.6975  lr: 0.0002 
ep/it:29-  92 niter: 11200  80m 45s (- 4061m 25s) completed:  1%) loss_emb: 0.0025  loss: 1.1861  acc: 0.7008  lr: 0.0002 
ep/it:29- 142 niter: 11250  81m 7s (- 4061m 14s) completed:  1%) loss_emb: 0.0026  loss: 1.2209  acc: 0.6926  lr: 0.0002 
ep/it:29- 192 niter: 11300  81m 28s (- 4060m 38s) completed:  1%) loss_emb: 0.0025  loss: 1.1991  acc: 0.6983  lr: 0.0002 
ep/it:29- 242 niter: 11350  81m 49s (- 4059m 49s) completed:  1%) loss_emb: 0.0025  loss: 1.2017  acc: 0.6967  lr: 0.0002 
ep/it:29- 292 niter: 11400  82m 10s (- 4058m 55s) completed:  1%) loss_emb: 0.0025  loss: 1.1932  acc: 0.6987  lr: 0.0002 
ep/it:29- 342 niter: 11450  82m 31s (- 4058m 32s) completed:  1%) loss_emb: 0.0025  loss: 1.1818  acc: 0.7009  lr: 0.0002 
Validation time:
--> 	 Eva. Ep 30 :, FID. 9.9971, Diversity Real. 9.3632, Diversity. 7.3107, R_precision_real. [0.5099734  0.6974734  0.79787234], R_precision. [0.23869681 0.39295213 0.49867021], matching_score_real. 2.9328765869140625, matching_score_pred. 5.250527381896973
--> --> 	 matching_score Improved from 5.52779 to 5.25053 !!!
--> --> 	 Diversity Improved from 7.09381 to 7.31065 !!!
--> --> 	 Top1 Improved from 0.2168 to 0.2387 !!!
--> --> 	 Top2 Improved from 0.3517 to 0.3930 !!!
--> --> 	 Top3 Improved from 0.4581 to 0.4987 !!!
ep/it:30-   9 niter: 11500  83m 9s (- 4071m 4s) completed:  2%) loss_emb: 0.0026  loss: 1.2211  acc: 0.6920  lr: 0.0002 
ep/it:30-  59 niter: 11550  83m 30s (- 4070m 32s) completed:  2%) loss_emb: 0.0025  loss: 1.1960  acc: 0.6966  lr: 0.0002 
ep/it:30- 109 niter: 11600  83m 52s (- 4070m 10s) completed:  2%) loss_emb: 0.0025  loss: 1.1899  acc: 0.7001  lr: 0.0002 
ep/it:30- 159 niter: 11650  84m 13s (- 4069m 34s) completed:  2%) loss_emb: 0.0025  loss: 1.1996  acc: 0.6973  lr: 0.0002 
ep/it:30- 209 niter: 11700  84m 35s (- 4068m 40s) completed:  2%) loss_emb: 0.0025  loss: 1.2085  acc: 0.6953  lr: 0.0002 
ep/it:30- 259 niter: 11750  84m 56s (- 4067m 54s) completed:  2%) loss_emb: 0.0025  loss: 1.1823  acc: 0.7010  lr: 0.0002 
ep/it:30- 309 niter: 11800  85m 17s (- 4066m 59s) completed:  2%) loss_emb: 0.0025  loss: 1.1908  acc: 0.6989  lr: 0.0002 
ep/it:30- 359 niter: 11850  85m 38s (- 4066m 12s) completed:  2%) loss_emb: 0.0025  loss: 1.1973  acc: 0.6974  lr: 0.0002 
Validation time:
ep/it:31-  26 niter: 11900  86m 0s (- 4065m 53s) completed:  2%) loss_emb: 0.0025  loss: 1.1924  acc: 0.6986  lr: 0.0002 
ep/it:31-  76 niter: 11950  86m 21s (- 4065m 16s) completed:  2%) loss_emb: 0.0025  loss: 1.1829  acc: 0.7011  lr: 0.0002 
ep/it:31- 126 niter: 12000  86m 42s (- 4064m 34s) completed:  2%) loss_emb: 0.0025  loss: 1.2052  acc: 0.6955  lr: 0.0002 
ep/it:31- 176 niter: 12050  87m 4s (- 4064m 1s) completed:  2%) loss_emb: 0.0025  loss: 1.1946  acc: 0.6974  lr: 0.0002 
ep/it:31- 226 niter: 12100  87m 25s (- 4063m 21s) completed:  2%) loss_emb: 0.0025  loss: 1.1629  acc: 0.7041  lr: 0.0002 
ep/it:31- 276 niter: 12150  87m 46s (- 4062m 35s) completed:  2%) loss_emb: 0.0025  loss: 1.2028  acc: 0.6957  lr: 0.0002 
ep/it:31- 326 niter: 12200  88m 8s (- 4062m 31s) completed:  2%) loss_emb: 0.0025  loss: 1.1917  acc: 0.6984  lr: 0.0002 
ep/it:31- 376 niter: 12250  88m 29s (- 4061m 41s) completed:  2%) loss_emb: 0.0025  loss: 1.1675  acc: 0.7047  lr: 0.0002 
Validation time:
ep/it:32-  43 niter: 12300  88m 51s (- 4061m 47s) completed:  2%) loss_emb: 0.0025  loss: 1.1652  acc: 0.7052  lr: 0.0002 
ep/it:32-  93 niter: 12350  89m 13s (- 4061m 17s) completed:  2%) loss_emb: 0.0025  loss: 1.1590  acc: 0.7050  lr: 0.0002 
ep/it:32- 143 niter: 12400  89m 34s (- 4060m 34s) completed:  2%) loss_emb: 0.0025  loss: 1.1973  acc: 0.6974  lr: 0.0002 
ep/it:32- 193 niter: 12450  89m 56s (- 4060m 4s) completed:  2%) loss_emb: 0.0025  loss: 1.1858  acc: 0.6995  lr: 0.0002 
ep/it:32- 243 niter: 12500  90m 17s (- 4059m 22s) completed:  2%) loss_emb: 0.0025  loss: 1.1892  acc: 0.6993  lr: 0.0002 
ep/it:32- 293 niter: 12550  90m 39s (- 4059m 2s) completed:  2%) loss_emb: 0.0025  loss: 1.1809  acc: 0.7005  lr: 0.0002 
ep/it:32- 343 niter: 12600  91m 0s (- 4058m 25s) completed:  2%) loss_emb: 0.0025  loss: 1.1761  acc: 0.7027  lr: 0.0002 
Validation time:
ep/it:33-  10 niter: 12650  91m 22s (- 4058m 35s) completed:  2%) loss_emb: 0.0025  loss: 1.1698  acc: 0.7031  lr: 0.0002 
ep/it:33-  60 niter: 12700  91m 44s (- 4058m 8s) completed:  2%) loss_emb: 0.0025  loss: 1.1919  acc: 0.6983  lr: 0.0002 
ep/it:33- 110 niter: 12750  92m 5s (- 4057m 28s) completed:  2%) loss_emb: 0.0025  loss: 1.1764  acc: 0.7023  lr: 0.0002 
ep/it:33- 160 niter: 12800  92m 27s (- 4056m 58s) completed:  2%) loss_emb: 0.0024  loss: 1.1568  acc: 0.7062  lr: 0.0002 
ep/it:33- 210 niter: 12850  92m 47s (- 4056m 0s) completed:  2%) loss_emb: 0.0025  loss: 1.1804  acc: 0.7006  lr: 0.0002 
ep/it:33- 260 niter: 12900  93m 9s (- 4055m 29s) completed:  2%) loss_emb: 0.0024  loss: 1.1526  acc: 0.7069  lr: 0.0002 
ep/it:33- 310 niter: 12950  93m 30s (- 4054m 49s) completed:  2%) loss_emb: 0.0025  loss: 1.1646  acc: 0.7045  lr: 0.0002 
ep/it:33- 360 niter: 13000  93m 51s (- 4054m 13s) completed:  2%) loss_emb: 0.0025  loss: 1.1684  acc: 0.7030  lr: 0.0002 
Validation time: