File size: 84,128 Bytes
13da1af
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
nohup: ignoring input
/scratch/ts1v23/.conda/envs/tlcontrol/lib/python3.10/site-packages/torch/nn/modules/transformer.py:392: UserWarning: enable_nested_tensor is True, but self.use_nested_tensor is False because encoder_layer.self_attn.batch_first was not True(use batch_first for better inference performance)
  warnings.warn(
------------ Options -------------
batch_size: 64
checkpoints_dir: ./checkpoints
cond_drop_prob: 0.1
control: trajectory
ctrl_loss: 0.9
dataset_name: t2m
dropout: 0.2
eval_every_e: 10
ff_size: 1024
force_mask: False
gamma: 0.1
gpu_id: 0
gumbel_sample: False
is_continue: False
is_train: True
latent_dim: 384
log_every: 50
lr: 0.0002
max_epoch: 1500
max_motion_length: 196
milestones: [50000]
n_heads: 6
n_layers: 8
name: My_t2m_transformer1201
save_latest: 500
seed: 3407
share_weight: False
trans_name: t2m_nlayer8_nhead6_ld384_ff1024_cdp0.1_rvq6ns
unit_length: 4
vq_name: rvq_nq1_dc512_nc512
warm_up_iter: 2000
xent: 0.1
-------------- End ----------------
Loading VQ Model /scratch/ts1v23/workspace/new/TLControl/save_weights_vq/best_model_epoch_hml_emaReset.pth
latent_dim: 384, ff_size: 1024, nlayers: 8, nheads: 6, dropout: 0.2
Loading CLIP...
Total parameters of all models: 12.83M

  0%|          | 0/23384 [00:00<?, ?it/s]
  0%|          | 28/23384 [00:00<01:23, 279.91it/s]
  0%|          | 62/23384 [00:00<01:14, 315.11it/s]
  0%|          | 97/23384 [00:00<01:10, 329.61it/s]
  1%|          | 133/23384 [00:00<01:08, 340.52it/s]
  1%|          | 168/23384 [00:00<01:07, 343.48it/s]
  1%|          | 204/23384 [00:00<01:07, 345.87it/s]
  1%|          | 239/23384 [00:00<01:07, 344.75it/s]
  1%|          | 274/23384 [00:00<01:08, 336.80it/s]
  1%|▏         | 308/23384 [00:00<01:09, 334.39it/s]
  1%|▏         | 342/23384 [00:01<01:10, 325.48it/s]
  2%|▏         | 375/23384 [00:01<01:11, 323.33it/s]
  2%|▏         | 408/23384 [00:01<01:15, 304.86it/s]
  2%|▏         | 439/23384 [00:01<01:15, 305.81it/s]
  2%|▏         | 471/23384 [00:01<01:14, 306.91it/s]
  2%|▏         | 502/23384 [00:01<01:16, 300.85it/s]
  2%|▏         | 533/23384 [00:01<01:16, 300.18it/s]
  2%|▏         | 564/23384 [00:01<01:15, 302.29it/s]
  3%|β–Ž         | 597/23384 [00:01<01:14, 307.69it/s]
  3%|β–Ž         | 630/23384 [00:01<01:12, 312.71it/s]
  3%|β–Ž         | 662/23384 [00:02<01:13, 310.63it/s]
  3%|β–Ž         | 694/23384 [00:02<01:12, 311.03it/s]
  3%|β–Ž         | 726/23384 [00:02<01:12, 312.51it/s]
  3%|β–Ž         | 758/23384 [00:02<01:15, 299.18it/s]
  3%|β–Ž         | 791/23384 [00:02<01:13, 305.48it/s]
  4%|β–Ž         | 823/23384 [00:02<01:12, 309.54it/s]
  4%|β–Ž         | 856/23384 [00:02<01:11, 315.40it/s]
  4%|▍         | 890/23384 [00:02<01:10, 319.90it/s]
  4%|▍         | 924/23384 [00:02<01:09, 323.93it/s]
  4%|▍         | 957/23384 [00:03<01:10, 318.27it/s]
  4%|▍         | 989/23384 [00:03<01:13, 305.01it/s]
  4%|▍         | 1022/23384 [00:03<01:12, 310.48it/s]
  5%|▍         | 1054/23384 [00:03<01:11, 312.21it/s]
  5%|▍         | 1086/23384 [00:03<01:13, 302.71it/s]
  5%|▍         | 1117/23384 [00:03<01:14, 298.69it/s]
  5%|▍         | 1150/23384 [00:03<01:12, 305.00it/s]
  5%|β–Œ         | 1184/23384 [00:03<01:10, 313.14it/s]
  5%|β–Œ         | 1217/23384 [00:03<01:09, 317.18it/s]
  5%|β–Œ         | 1251/23384 [00:03<01:08, 321.20it/s]
  5%|β–Œ         | 1286/23384 [00:04<01:07, 328.88it/s]
  6%|β–Œ         | 1319/23384 [00:04<01:07, 328.75it/s]
  6%|β–Œ         | 1353/23384 [00:04<01:06, 330.76it/s]
  6%|β–Œ         | 1387/23384 [00:04<01:06, 332.06it/s]
  6%|β–Œ         | 1421/23384 [00:04<01:06, 328.02it/s]
  6%|β–Œ         | 1454/23384 [00:04<01:07, 327.09it/s]
  6%|β–‹         | 1487/23384 [00:04<01:06, 327.54it/s]
  7%|β–‹         | 1522/23384 [00:04<01:05, 333.90it/s]
  7%|β–‹         | 1556/23384 [00:04<01:05, 331.80it/s]
  7%|β–‹         | 1590/23384 [00:04<01:07, 322.90it/s]
  7%|β–‹         | 1623/23384 [00:05<01:09, 313.83it/s]
  7%|β–‹         | 1655/23384 [00:05<01:10, 309.96it/s]
  7%|β–‹         | 1687/23384 [00:05<01:11, 305.53it/s]
  7%|β–‹         | 1718/23384 [00:05<01:10, 305.84it/s]
  7%|β–‹         | 1750/23384 [00:05<01:09, 309.32it/s]
  8%|β–Š         | 1784/23384 [00:05<01:07, 317.98it/s]
  8%|β–Š         | 1818/23384 [00:05<01:06, 323.68it/s]
  8%|β–Š         | 1853/23384 [00:05<01:05, 328.76it/s]
  8%|β–Š         | 1889/23384 [00:05<01:03, 336.99it/s]
  8%|β–Š         | 1924/23384 [00:06<01:03, 338.89it/s]
  8%|β–Š         | 1959/23384 [00:06<01:02, 340.80it/s]
  9%|β–Š         | 1994/23384 [00:06<01:04, 334.19it/s]
  9%|β–Š         | 2028/23384 [00:06<01:04, 330.39it/s]
  9%|β–‰         | 2063/23384 [00:06<01:03, 335.76it/s]
  9%|β–‰         | 2097/23384 [00:06<01:03, 335.31it/s]
  9%|β–‰         | 2132/23384 [00:06<01:02, 338.64it/s]
  9%|β–‰         | 2166/23384 [00:06<01:03, 336.56it/s]
  9%|β–‰         | 2201/23384 [00:06<01:02, 338.68it/s]
 10%|β–‰         | 2235/23384 [00:06<01:03, 331.74it/s]
 10%|β–‰         | 2269/23384 [00:07<01:04, 328.39it/s]
 10%|β–‰         | 2302/23384 [00:07<01:05, 323.37it/s]
 10%|β–‰         | 2335/23384 [00:07<01:05, 323.44it/s]
 10%|β–ˆ         | 2368/23384 [00:07<01:07, 313.45it/s]
 10%|β–ˆ         | 2401/23384 [00:07<01:06, 315.52it/s]
 10%|β–ˆ         | 2436/23384 [00:07<01:04, 322.59it/s]
 11%|β–ˆ         | 2470/23384 [00:07<01:04, 325.02it/s]
 11%|β–ˆ         | 2505/23384 [00:07<01:03, 329.35it/s]
 11%|β–ˆ         | 2540/23384 [00:07<01:02, 333.16it/s]
 11%|β–ˆ         | 2576/23384 [00:08<01:01, 338.58it/s]
 11%|β–ˆ         | 2612/23384 [00:08<01:00, 342.93it/s]
 11%|β–ˆβ–        | 2647/23384 [00:08<01:00, 343.89it/s]
 11%|β–ˆβ–        | 2682/23384 [00:08<01:01, 336.64it/s]
 12%|β–ˆβ–        | 2716/23384 [00:08<01:01, 336.57it/s]
 12%|β–ˆβ–        | 2751/23384 [00:08<01:01, 338.03it/s]
 12%|β–ˆβ–        | 2785/23384 [00:08<01:04, 321.25it/s]
 12%|β–ˆβ–        | 2818/23384 [00:08<01:03, 322.58it/s]
 12%|β–ˆβ–        | 2853/23384 [00:08<01:02, 327.99it/s]
 12%|β–ˆβ–        | 2886/23384 [00:08<01:03, 324.01it/s]
 12%|β–ˆβ–        | 2919/23384 [00:09<01:03, 323.01it/s]
 13%|β–ˆβ–Ž        | 2952/23384 [00:09<01:04, 316.00it/s]
 13%|β–ˆβ–Ž        | 2984/23384 [00:09<01:05, 309.94it/s]
 13%|β–ˆβ–Ž        | 3017/23384 [00:09<01:04, 314.63it/s]
 13%|β–ˆβ–Ž        | 3049/23384 [00:09<01:05, 310.65it/s]
 13%|β–ˆβ–Ž        | 3082/23384 [00:09<01:04, 315.43it/s]
 13%|β–ˆβ–Ž        | 3116/23384 [00:09<01:02, 322.55it/s]
 13%|β–ˆβ–Ž        | 3149/23384 [00:09<01:02, 324.15it/s]
 14%|β–ˆβ–Ž        | 3184/23384 [00:09<01:01, 329.72it/s]
 14%|β–ˆβ–        | 3219/23384 [00:09<01:00, 334.07it/s]
 14%|β–ˆβ–        | 3255/23384 [00:10<00:59, 339.12it/s]
 14%|β–ˆβ–        | 3290/23384 [00:10<00:59, 339.80it/s]
 14%|β–ˆβ–        | 3324/23384 [00:10<00:59, 338.29it/s]
 14%|β–ˆβ–        | 3358/23384 [00:10<00:59, 338.42it/s]
 15%|β–ˆβ–        | 3392/23384 [00:10<00:59, 337.60it/s]
 15%|β–ˆβ–        | 3426/23384 [00:10<00:59, 337.38it/s]
 15%|β–ˆβ–        | 3460/23384 [00:10<00:59, 336.86it/s]
 15%|β–ˆβ–        | 3495/23384 [00:10<00:58, 339.86it/s]
 15%|β–ˆβ–Œ        | 3529/23384 [00:10<00:58, 337.92it/s]
 15%|β–ˆβ–Œ        | 3563/23384 [00:11<01:00, 325.69it/s]
 15%|β–ˆβ–Œ        | 3596/23384 [00:11<01:01, 322.19it/s]
 16%|β–ˆβ–Œ        | 3629/23384 [00:11<01:01, 319.91it/s]
 16%|β–ˆβ–Œ        | 3662/23384 [00:11<01:02, 317.37it/s]
 16%|β–ˆβ–Œ        | 3696/23384 [00:11<01:01, 321.11it/s]
 16%|β–ˆβ–Œ        | 3729/23384 [00:11<01:01, 318.08it/s]
 16%|β–ˆβ–Œ        | 3761/23384 [00:11<01:02, 314.88it/s]
 16%|β–ˆβ–Œ        | 3797/23384 [00:11<01:00, 326.35it/s]
 16%|β–ˆβ–‹        | 3830/23384 [00:11<01:01, 319.89it/s]
 17%|β–ˆβ–‹        | 3863/23384 [00:11<01:01, 315.95it/s]
 17%|β–ˆβ–‹        | 3895/23384 [00:12<01:03, 304.70it/s]
 17%|β–ˆβ–‹        | 3926/23384 [00:12<01:03, 304.17it/s]
 17%|β–ˆβ–‹        | 3959/23384 [00:12<01:02, 309.08it/s]
 17%|β–ˆβ–‹        | 3991/23384 [00:12<01:02, 311.38it/s]
 17%|β–ˆβ–‹        | 4023/23384 [00:12<01:03, 302.79it/s]
 17%|β–ˆβ–‹        | 4056/23384 [00:12<01:02, 308.03it/s]
 17%|β–ˆβ–‹        | 4088/23384 [00:12<01:02, 307.89it/s]
 18%|β–ˆβ–Š        | 4119/23384 [00:12<01:04, 297.83it/s]
 18%|β–ˆβ–Š        | 4151/23384 [00:12<01:03, 304.14it/s]
 18%|β–ˆβ–Š        | 4182/23384 [00:13<01:04, 297.68it/s]
 18%|β–ˆβ–Š        | 4212/23384 [00:13<01:06, 290.00it/s]
 18%|β–ˆβ–Š        | 4242/23384 [00:13<01:08, 280.48it/s]
 18%|β–ˆβ–Š        | 4271/23384 [00:13<01:07, 281.08it/s]
 18%|β–ˆβ–Š        | 4300/23384 [00:13<01:07, 280.71it/s]
 19%|β–ˆβ–Š        | 4329/23384 [00:13<01:08, 276.59it/s]
 19%|β–ˆβ–Š        | 4359/23384 [00:13<01:07, 283.08it/s]
 19%|β–ˆβ–‰        | 4389/23384 [00:13<01:06, 285.70it/s]
 19%|β–ˆβ–‰        | 4423/23384 [00:13<01:03, 299.19it/s]
 19%|β–ˆβ–‰        | 4456/23384 [00:13<01:01, 306.19it/s]
 19%|β–ˆβ–‰        | 4487/23384 [00:14<01:02, 303.58it/s]
 19%|β–ˆβ–‰        | 4518/23384 [00:14<01:02, 300.46it/s]
 19%|β–ˆβ–‰        | 4551/23384 [00:14<01:01, 308.59it/s]
 20%|β–ˆβ–‰        | 4582/23384 [00:14<01:01, 306.09it/s]
 20%|β–ˆβ–‰        | 4613/23384 [00:14<01:01, 304.66it/s]
 20%|β–ˆβ–‰        | 4644/23384 [00:14<01:01, 302.50it/s]
 20%|β–ˆβ–‰        | 4675/23384 [00:14<01:02, 299.40it/s]
 20%|β–ˆβ–ˆ        | 4707/23384 [00:14<01:01, 303.91it/s]
 20%|β–ˆβ–ˆ        | 4738/23384 [00:14<01:02, 297.50it/s]
 20%|β–ˆβ–ˆ        | 4769/23384 [00:15<01:02, 298.74it/s]
 21%|β–ˆβ–ˆ        | 4801/23384 [00:15<01:00, 304.90it/s]
 21%|β–ˆβ–ˆ        | 4832/23384 [00:15<01:02, 298.99it/s]
 21%|β–ˆβ–ˆ        | 4862/23384 [00:15<01:03, 293.37it/s]
 21%|β–ˆβ–ˆ        | 4893/23384 [00:15<01:02, 296.11it/s]
 21%|β–ˆβ–ˆ        | 4927/23384 [00:15<01:00, 307.49it/s]
 21%|β–ˆβ–ˆ        | 4958/23384 [00:15<01:00, 306.69it/s]
 21%|β–ˆβ–ˆβ–       | 4990/23384 [00:15<00:59, 309.22it/s]
 21%|β–ˆβ–ˆβ–       | 5022/23384 [00:15<00:59, 309.27it/s]
 22%|β–ˆβ–ˆβ–       | 5055/23384 [00:15<00:58, 313.18it/s]
 22%|β–ˆβ–ˆβ–       | 5089/23384 [00:16<00:57, 319.10it/s]
 22%|β–ˆβ–ˆβ–       | 5121/23384 [00:16<00:57, 319.32it/s]
 22%|β–ˆβ–ˆβ–       | 5153/23384 [00:16<00:57, 314.34it/s]
 22%|β–ˆβ–ˆβ–       | 5187/23384 [00:16<00:56, 319.88it/s]
 22%|β–ˆβ–ˆβ–       | 5221/23384 [00:16<00:55, 325.63it/s]
 22%|β–ˆβ–ˆβ–       | 5254/23384 [00:16<00:56, 323.66it/s]
 23%|β–ˆβ–ˆβ–Ž       | 5288/23384 [00:16<00:55, 327.43it/s]
 23%|β–ˆβ–ˆβ–Ž       | 5321/23384 [00:16<00:55, 327.10it/s]
 23%|β–ˆβ–ˆβ–Ž       | 5354/23384 [00:16<00:57, 313.05it/s]
 23%|β–ˆβ–ˆβ–Ž       | 5386/23384 [00:16<01:00, 299.44it/s]
 23%|β–ˆβ–ˆβ–Ž       | 5417/23384 [00:17<01:02, 287.68it/s]
 23%|β–ˆβ–ˆβ–Ž       | 5446/23384 [00:17<01:03, 284.23it/s]
 23%|β–ˆβ–ˆβ–Ž       | 5475/23384 [00:17<01:03, 280.14it/s]
 24%|β–ˆβ–ˆβ–Ž       | 5504/23384 [00:17<01:04, 277.23it/s]
 24%|β–ˆβ–ˆβ–Ž       | 5539/23384 [00:17<01:00, 295.60it/s]
 24%|β–ˆβ–ˆβ–       | 5569/23384 [00:17<01:00, 296.18it/s]
 24%|β–ˆβ–ˆβ–       | 5604/23384 [00:17<00:57, 309.60it/s]
 24%|β–ˆβ–ˆβ–       | 5638/23384 [00:17<00:55, 318.19it/s]
 24%|β–ˆβ–ˆβ–       | 5671/23384 [00:17<00:55, 321.13it/s]
 24%|β–ˆβ–ˆβ–       | 5706/23384 [00:18<00:54, 326.90it/s]
 25%|β–ˆβ–ˆβ–       | 5739/23384 [00:18<00:54, 322.61it/s]
 25%|β–ˆβ–ˆβ–       | 5772/23384 [00:18<00:54, 324.23it/s]
 25%|β–ˆβ–ˆβ–       | 5805/23384 [00:18<00:54, 324.55it/s]
 25%|β–ˆβ–ˆβ–       | 5838/23384 [00:18<00:55, 316.11it/s]
 25%|β–ˆβ–ˆβ–Œ       | 5870/23384 [00:18<00:57, 306.54it/s]
 25%|β–ˆβ–ˆβ–Œ       | 5902/23384 [00:18<00:56, 306.74it/s]
 25%|β–ˆβ–ˆβ–Œ       | 5936/23384 [00:18<00:55, 316.16it/s]
 26%|β–ˆβ–ˆβ–Œ       | 5968/23384 [00:18<00:55, 315.25it/s]
 26%|β–ˆβ–ˆβ–Œ       | 6000/23384 [00:18<00:55, 312.06it/s]
 26%|β–ˆβ–ˆβ–Œ       | 6032/23384 [00:19<00:57, 299.32it/s]
 26%|β–ˆβ–ˆβ–Œ       | 6063/23384 [00:19<00:57, 301.49it/s]
 26%|β–ˆβ–ˆβ–Œ       | 6096/23384 [00:19<00:55, 308.83it/s]
 26%|β–ˆβ–ˆβ–Œ       | 6127/23384 [00:19<00:55, 308.41it/s]
 26%|β–ˆβ–ˆβ–‹       | 6160/23384 [00:19<00:55, 311.65it/s]
 26%|β–ˆβ–ˆβ–‹       | 6192/23384 [00:19<00:55, 311.53it/s]
 27%|β–ˆβ–ˆβ–‹       | 6227/23384 [00:19<00:53, 322.58it/s]
 27%|β–ˆβ–ˆβ–‹       | 6262/23384 [00:19<00:52, 328.62it/s]
 27%|β–ˆβ–ˆβ–‹       | 6296/23384 [00:19<00:51, 330.65it/s]
 27%|β–ˆβ–ˆβ–‹       | 6330/23384 [00:20<00:51, 328.17it/s]
 27%|β–ˆβ–ˆβ–‹       | 6366/23384 [00:20<00:50, 336.23it/s]
 27%|β–ˆβ–ˆβ–‹       | 6400/23384 [00:20<00:51, 326.72it/s]
 28%|β–ˆβ–ˆβ–Š       | 6433/23384 [00:20<00:52, 324.06it/s]
 28%|β–ˆβ–ˆβ–Š       | 6466/23384 [00:20<00:53, 317.66it/s]
 28%|β–ˆβ–ˆβ–Š       | 6502/23384 [00:20<00:51, 328.25it/s]
 28%|β–ˆβ–ˆβ–Š       | 6535/23384 [00:20<00:51, 326.55it/s]
 28%|β–ˆβ–ˆβ–Š       | 6568/23384 [00:20<00:52, 320.89it/s]
 28%|β–ˆβ–ˆβ–Š       | 6601/23384 [00:20<00:52, 317.79it/s]
 28%|β–ˆβ–ˆβ–Š       | 6633/23384 [00:20<00:52, 317.04it/s]
 29%|β–ˆβ–ˆβ–Š       | 6666/23384 [00:21<00:52, 319.00it/s]
 29%|β–ˆβ–ˆβ–Š       | 6700/23384 [00:21<00:51, 323.42it/s]
 29%|β–ˆβ–ˆβ–‰       | 6733/23384 [00:21<00:52, 314.96it/s]
 29%|β–ˆβ–ˆβ–‰       | 6765/23384 [00:21<00:53, 308.77it/s]
 29%|β–ˆβ–ˆβ–‰       | 6796/23384 [00:21<00:56, 295.56it/s]
 29%|β–ˆβ–ˆβ–‰       | 6829/23384 [00:21<00:54, 303.58it/s]
 29%|β–ˆβ–ˆβ–‰       | 6862/23384 [00:21<00:53, 308.22it/s]
 29%|β–ˆβ–ˆβ–‰       | 6894/23384 [00:21<00:53, 309.49it/s]
 30%|β–ˆβ–ˆβ–‰       | 6926/23384 [00:21<00:53, 308.79it/s]
 30%|β–ˆβ–ˆβ–‰       | 6959/23384 [00:22<00:52, 313.71it/s]
 30%|β–ˆβ–ˆβ–‰       | 6993/23384 [00:22<00:51, 317.99it/s]
 30%|β–ˆβ–ˆβ–ˆ       | 7026/23384 [00:22<00:51, 320.06it/s]
 30%|β–ˆβ–ˆβ–ˆ       | 7059/23384 [00:22<00:52, 309.85it/s]
 30%|β–ˆβ–ˆβ–ˆ       | 7095/23384 [00:22<00:50, 320.60it/s]
 30%|β–ˆβ–ˆβ–ˆ       | 7131/23384 [00:22<00:49, 330.27it/s]
 31%|β–ˆβ–ˆβ–ˆ       | 7165/23384 [00:22<00:49, 326.44it/s]
 31%|β–ˆβ–ˆβ–ˆ       | 7198/23384 [00:22<00:49, 327.43it/s]
 31%|β–ˆβ–ˆβ–ˆ       | 7231/23384 [00:22<00:50, 319.64it/s]
 31%|β–ˆβ–ˆβ–ˆ       | 7264/23384 [00:22<00:51, 315.97it/s]
 31%|β–ˆβ–ˆβ–ˆ       | 7296/23384 [00:23<00:51, 312.05it/s]
 31%|β–ˆβ–ˆβ–ˆβ–      | 7328/23384 [00:23<00:51, 309.73it/s]
 31%|β–ˆβ–ˆβ–ˆβ–      | 7360/23384 [00:23<00:51, 311.63it/s]
 32%|β–ˆβ–ˆβ–ˆβ–      | 7392/23384 [00:23<00:53, 300.87it/s]
 32%|β–ˆβ–ˆβ–ˆβ–      | 7424/23384 [00:23<00:52, 303.93it/s]
 32%|β–ˆβ–ˆβ–ˆβ–      | 7455/23384 [00:23<00:53, 299.82it/s]
 32%|β–ˆβ–ˆβ–ˆβ–      | 7486/23384 [00:23<00:52, 301.50it/s]
 32%|β–ˆβ–ˆβ–ˆβ–      | 7518/23384 [00:23<00:51, 306.67it/s]
 32%|β–ˆβ–ˆβ–ˆβ–      | 7551/23384 [00:23<00:50, 312.43it/s]
 32%|β–ˆβ–ˆβ–ˆβ–      | 7585/23384 [00:23<00:49, 318.23it/s]
 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 7618/23384 [00:24<00:49, 319.56it/s]
 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 7651/23384 [00:24<00:49, 321.08it/s]
 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 7684/23384 [00:24<00:48, 321.90it/s]
 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 7717/23384 [00:24<00:48, 319.78it/s]
 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 7749/23384 [00:24<00:49, 316.79it/s]
 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 7783/23384 [00:24<00:48, 321.32it/s]
 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 7816/23384 [00:24<00:48, 318.93it/s]
 34%|β–ˆβ–ˆβ–ˆβ–Ž      | 7848/23384 [00:24<00:48, 318.13it/s]
 34%|β–ˆβ–ˆβ–ˆβ–Ž      | 7880/23384 [00:24<00:50, 305.21it/s]
 34%|β–ˆβ–ˆβ–ˆβ–      | 7911/23384 [00:25<00:51, 299.58it/s]
 34%|β–ˆβ–ˆβ–ˆβ–      | 7942/23384 [00:25<00:51, 299.96it/s]
 34%|β–ˆβ–ˆβ–ˆβ–      | 7973/23384 [00:25<00:53, 287.81it/s]
 34%|β–ˆβ–ˆβ–ˆβ–      | 8007/23384 [00:25<00:51, 300.04it/s]
 34%|β–ˆβ–ˆβ–ˆβ–      | 8038/23384 [00:25<00:51, 298.98it/s]
 35%|β–ˆβ–ˆβ–ˆβ–      | 8071/23384 [00:25<00:50, 305.82it/s]
 35%|β–ˆβ–ˆβ–ˆβ–      | 8106/23384 [00:25<00:48, 316.82it/s]
 35%|β–ˆβ–ˆβ–ˆβ–      | 8141/23384 [00:25<00:47, 323.22it/s]
 35%|β–ˆβ–ˆβ–ˆβ–      | 8175/23384 [00:25<00:46, 326.35it/s]
 35%|β–ˆβ–ˆβ–ˆβ–Œ      | 8210/23384 [00:25<00:45, 333.03it/s]
 35%|β–ˆβ–ˆβ–ˆβ–Œ      | 8245/23384 [00:26<00:45, 335.71it/s]
 35%|β–ˆβ–ˆβ–ˆβ–Œ      | 8279/23384 [00:26<00:54, 279.41it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 8309/23384 [00:26<01:00, 250.58it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 8336/23384 [00:26<01:00, 249.22it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 8362/23384 [00:26<01:02, 238.49it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 8387/23384 [00:26<01:08, 219.58it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 8410/23384 [00:26<01:09, 216.36it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 8433/23384 [00:26<01:09, 215.96it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 8456/23384 [00:27<01:08, 216.86it/s]
 36%|β–ˆβ–ˆβ–ˆβ–‹      | 8478/23384 [00:27<01:08, 217.54it/s]
 36%|β–ˆβ–ˆβ–ˆβ–‹      | 8500/23384 [00:27<01:08, 216.59it/s]
 36%|β–ˆβ–ˆβ–ˆβ–‹      | 8522/23384 [00:27<01:12, 204.20it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8543/23384 [00:27<01:12, 203.55it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8567/23384 [00:27<01:09, 212.66it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8589/23384 [00:27<01:09, 211.97it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8611/23384 [00:27<01:10, 210.73it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8633/23384 [00:27<01:10, 209.35it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8657/23384 [00:28<01:08, 215.89it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8680/23384 [00:28<01:07, 218.76it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8706/23384 [00:28<01:03, 230.73it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8730/23384 [00:28<01:04, 228.30it/s]
 37%|β–ˆβ–ˆβ–ˆβ–‹      | 8753/23384 [00:28<01:04, 225.26it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8776/23384 [00:28<01:05, 222.86it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8799/23384 [00:28<01:06, 220.60it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8822/23384 [00:28<01:06, 219.85it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8847/23384 [00:28<01:04, 224.53it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8870/23384 [00:28<01:05, 221.61it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8893/23384 [00:29<01:09, 209.76it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8918/23384 [00:29<01:05, 219.46it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8941/23384 [00:29<01:05, 221.64it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8965/23384 [00:29<01:04, 224.87it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 8990/23384 [00:29<01:02, 230.62it/s]
 39%|β–ˆβ–ˆβ–ˆβ–Š      | 9021/23384 [00:29<00:57, 251.63it/s]
 39%|β–ˆβ–ˆβ–ˆβ–Š      | 9047/23384 [00:29<00:56, 253.27it/s]
 39%|β–ˆβ–ˆβ–ˆβ–‰      | 9073/23384 [00:29<00:57, 247.83it/s]
 39%|β–ˆβ–ˆβ–ˆβ–‰      | 9098/23384 [00:29<00:59, 239.86it/s]
 39%|β–ˆβ–ˆβ–ˆβ–‰      | 9123/23384 [00:30<01:00, 237.35it/s]
 39%|β–ˆβ–ˆβ–ˆβ–‰      | 9148/23384 [00:30<00:59, 240.10it/s]
 39%|β–ˆβ–ˆβ–ˆβ–‰      | 9176/23384 [00:30<00:57, 248.57it/s]
 39%|β–ˆβ–ˆβ–ˆβ–‰      | 9201/23384 [00:30<00:57, 246.29it/s]
 39%|β–ˆβ–ˆβ–ˆβ–‰      | 9229/23384 [00:30<00:55, 254.50it/s]
 40%|β–ˆβ–ˆβ–ˆβ–‰      | 9256/23384 [00:30<00:55, 256.57it/s]
 40%|β–ˆβ–ˆβ–ˆβ–‰      | 9283/23384 [00:30<00:54, 259.86it/s]
 40%|β–ˆβ–ˆβ–ˆβ–‰      | 9310/23384 [00:30<00:55, 251.99it/s]
 40%|β–ˆβ–ˆβ–ˆβ–‰      | 9336/23384 [00:30<00:55, 253.11it/s]
 40%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9363/23384 [00:31<00:54, 255.90it/s]
 40%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9389/23384 [00:31<00:54, 255.49it/s]
 40%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9415/23384 [00:31<00:56, 248.25it/s]
 40%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9442/23384 [00:31<00:55, 250.82it/s]
 40%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9468/23384 [00:31<00:57, 239.94it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9493/23384 [00:31<01:00, 228.80it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9517/23384 [00:31<01:01, 225.94it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9540/23384 [00:31<01:01, 225.36it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9563/23384 [00:31<01:01, 223.23it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9589/23384 [00:31<00:59, 231.84it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9615/23384 [00:32<00:57, 238.18it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 9642/23384 [00:32<00:55, 246.30it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9669/23384 [00:32<00:54, 252.87it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9696/23384 [00:32<00:53, 256.43it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9722/23384 [00:32<00:53, 253.06it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9748/23384 [00:32<00:54, 248.16it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9773/23384 [00:32<00:56, 242.94it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9798/23384 [00:32<00:55, 244.44it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9823/23384 [00:32<00:56, 240.55it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9851/23384 [00:33<00:54, 250.39it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9877/23384 [00:33<00:54, 245.67it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9903/23384 [00:33<00:54, 247.93it/s]
 42%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 9928/23384 [00:33<00:54, 246.17it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 9953/23384 [00:33<00:56, 237.98it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 9980/23384 [00:33<00:54, 244.23it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10005/23384 [00:33<00:54, 244.35it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10031/23384 [00:33<00:53, 247.54it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10063/23384 [00:33<00:49, 267.48it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10092/23384 [00:33<00:48, 272.73it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10120/23384 [00:34<00:49, 269.23it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10147/23384 [00:34<00:49, 266.00it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10174/23384 [00:34<00:51, 256.50it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10200/23384 [00:34<00:51, 253.84it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 10226/23384 [00:34<00:53, 247.92it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10251/23384 [00:34<00:53, 245.07it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10278/23384 [00:34<00:52, 251.77it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10304/23384 [00:34<00:53, 242.30it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10329/23384 [00:34<00:55, 235.20it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10353/23384 [00:35<00:55, 233.28it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10377/23384 [00:35<00:57, 226.11it/s]
 44%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10403/23384 [00:35<00:55, 234.34it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10427/23384 [00:35<00:55, 232.46it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10451/23384 [00:35<00:56, 227.23it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10474/23384 [00:35<00:56, 227.10it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–     | 10502/23384 [00:35<00:53, 240.09it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10527/23384 [00:35<00:54, 237.06it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10551/23384 [00:35<00:54, 236.35it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10575/23384 [00:36<00:55, 230.63it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10599/23384 [00:36<00:58, 218.12it/s]
 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10623/23384 [00:36<00:57, 223.69it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10647/23384 [00:36<00:56, 224.89it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10670/23384 [00:36<00:58, 217.77it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10692/23384 [00:36<01:00, 210.19it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10720/23384 [00:36<00:55, 229.64it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10744/23384 [00:36<01:19, 158.87it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10765/23384 [00:37<01:14, 169.40it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10787/23384 [00:37<01:10, 179.63it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 10807/23384 [00:37<01:09, 181.81it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 10829/23384 [00:37<01:06, 189.70it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 10850/23384 [00:37<01:04, 192.86it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 10873/23384 [00:37<01:02, 200.52it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 10895/23384 [00:37<01:00, 205.66it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 10918/23384 [00:37<00:58, 212.40it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 10941/23384 [00:37<00:57, 216.12it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 10965/23384 [00:37<00:56, 221.28it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 10988/23384 [00:38<00:57, 217.30it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 11011/23384 [00:38<00:56, 219.62it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 11035/23384 [00:38<00:54, 224.70it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 11058/23384 [00:38<00:55, 221.63it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 11081/23384 [00:38<00:55, 221.52it/s]
 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹     | 11105/23384 [00:38<00:54, 226.01it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11129/23384 [00:38<00:53, 228.91it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11154/23384 [00:38<00:52, 231.31it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11179/23384 [00:38<00:52, 234.59it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11203/23384 [00:38<00:52, 234.03it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11229/23384 [00:39<00:50, 240.84it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11254/23384 [00:39<00:51, 235.21it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11279/23384 [00:39<00:50, 237.88it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11303/23384 [00:39<00:51, 235.30it/s]
 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11329/23384 [00:39<00:49, 241.16it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11354/23384 [00:39<00:50, 240.07it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š     | 11379/23384 [00:39<00:50, 239.80it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11406/23384 [00:39<00:48, 246.68it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11431/23384 [00:39<00:48, 244.64it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11457/23384 [00:40<00:47, 249.09it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11483/23384 [00:40<00:47, 250.30it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11509/23384 [00:40<00:48, 243.13it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11539/23384 [00:40<00:46, 254.63it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11565/23384 [00:40<00:48, 244.58it/s]
 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11590/23384 [00:40<00:51, 229.40it/s]
 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11617/23384 [00:40<00:49, 239.85it/s]
 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11645/23384 [00:40<00:46, 250.30it/s]
 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 11675/23384 [00:40<00:44, 264.20it/s]
 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11702/23384 [00:41<00:44, 261.39it/s]
 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11730/23384 [00:41<00:43, 266.18it/s]
 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11759/23384 [00:41<00:42, 271.14it/s]
 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11787/23384 [00:41<00:44, 261.08it/s]
 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11821/23384 [00:41<00:40, 283.17it/s]
 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11855/23384 [00:41<00:38, 296.60it/s]
 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11888/23384 [00:41<00:38, 302.13it/s]
 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11924/23384 [00:41<00:36, 316.70it/s]
 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ     | 11958/23384 [00:41<00:35, 319.23it/s]
 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 11991/23384 [00:41<00:35, 321.97it/s]
 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12024/23384 [00:42<00:35, 317.77it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12056/23384 [00:42<00:36, 314.21it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12088/23384 [00:42<00:36, 308.97it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12120/23384 [00:42<00:36, 309.81it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12152/23384 [00:42<00:36, 309.78it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12187/23384 [00:42<00:34, 320.59it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12220/23384 [00:42<00:35, 314.80it/s]
 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12252/23384 [00:42<00:35, 309.78it/s]
 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12284/23384 [00:42<00:36, 300.28it/s]
 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12316/23384 [00:43<00:36, 304.61it/s]
 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12347/23384 [00:43<00:36, 300.69it/s]
 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12379/23384 [00:43<00:36, 304.08it/s]
 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12412/23384 [00:43<00:35, 311.10it/s]
 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12445/23384 [00:43<00:34, 315.04it/s]
 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12480/23384 [00:43<00:33, 324.70it/s]
 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12516/23384 [00:43<00:32, 332.90it/s]
 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž    | 12551/23384 [00:43<00:32, 335.64it/s]
 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12586/23384 [00:43<00:31, 338.71it/s]
 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12621/23384 [00:43<00:31, 340.97it/s]
 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12656/23384 [00:44<00:31, 337.63it/s]
 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12693/23384 [00:44<00:30, 346.20it/s]
 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12731/23384 [00:44<00:30, 354.39it/s]
 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12767/23384 [00:44<00:30, 352.21it/s]
 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12803/23384 [00:44<00:33, 320.24it/s]
 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 12836/23384 [00:44<00:34, 308.26it/s]
 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 12868/23384 [00:44<00:34, 306.05it/s]
 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 12902/23384 [00:44<00:33, 313.07it/s]
 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 12934/23384 [00:44<00:33, 314.15it/s]
 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 12970/23384 [00:45<00:31, 327.15it/s]
 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 13005/23384 [00:45<00:31, 332.85it/s]
 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 13042/23384 [00:45<00:30, 340.43it/s]
 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 13077/23384 [00:45<00:30, 338.22it/s]
 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 13111/23384 [00:45<00:30, 338.54it/s]
 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ    | 13145/23384 [00:45<00:30, 335.18it/s]
 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 13181/23384 [00:45<00:29, 340.64it/s]
 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 13216/23384 [00:45<00:30, 338.03it/s]
 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 13253/23384 [00:45<00:29, 346.88it/s]
 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 13290/23384 [00:45<00:28, 352.40it/s]
 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 13327/23384 [00:46<00:28, 357.39it/s]
 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 13364/23384 [00:46<00:27, 358.71it/s]
 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 13401/23384 [00:46<00:27, 361.01it/s]
 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 13438/23384 [00:46<00:28, 354.02it/s]
 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š    | 13475/23384 [00:46<00:27, 357.69it/s]
 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š    | 13512/23384 [00:46<00:27, 360.80it/s]
 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š    | 13549/23384 [00:46<00:27, 360.95it/s]
 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š    | 13586/23384 [00:46<00:27, 362.49it/s]
 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š    | 13626/23384 [00:46<00:26, 372.28it/s]
 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š    | 13664/23384 [00:46<00:26, 373.35it/s]
 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š    | 13702/23384 [00:47<00:26, 365.21it/s]
 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 13739/23384 [00:47<00:26, 365.25it/s]
 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 13777/23384 [00:47<00:26, 367.87it/s]
 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 13816/23384 [00:47<00:25, 370.87it/s]
 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 13854/23384 [00:47<00:25, 372.16it/s]
 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 13892/23384 [00:47<00:25, 368.90it/s]
 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 13929/23384 [00:47<00:25, 368.83it/s]
 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 13970/23384 [00:47<00:24, 378.32it/s]
 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 14009/23384 [00:47<00:24, 380.67it/s]
 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ    | 14048/23384 [00:47<00:25, 370.38it/s]
 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ    | 14086/23384 [00:48<00:25, 370.60it/s]
 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ    | 14124/23384 [00:48<00:25, 365.93it/s]
 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ    | 14162/23384 [00:48<00:25, 367.24it/s]
 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ    | 14199/23384 [00:48<00:25, 365.62it/s]
 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ    | 14237/23384 [00:48<00:24, 366.71it/s]
 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ    | 14274/23384 [00:48<00:25, 364.10it/s]
 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ    | 14314/23384 [00:48<00:24, 373.26it/s]
 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14352/23384 [00:48<00:24, 363.05it/s]
 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14389/23384 [00:48<00:25, 348.05it/s]
 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14424/23384 [00:49<00:26, 340.96it/s]
 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14459/23384 [00:49<00:26, 341.59it/s]
 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14494/23384 [00:49<00:26, 341.71it/s]
 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14529/23384 [00:49<00:26, 339.49it/s]
 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14565/23384 [00:49<00:25, 343.76it/s]
 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14600/23384 [00:49<00:25, 345.47it/s]
 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž   | 14635/23384 [00:49<00:26, 334.13it/s]
 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž   | 14670/23384 [00:49<00:25, 338.10it/s]
 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž   | 14706/23384 [00:49<00:25, 341.98it/s]
 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž   | 14741/23384 [00:49<00:25, 336.70it/s]
 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž   | 14777/23384 [00:50<00:25, 343.42it/s]
 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž   | 14813/23384 [00:50<00:24, 346.55it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž   | 14850/23384 [00:50<00:24, 353.24it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž   | 14886/23384 [00:50<00:24, 343.08it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14922/23384 [00:50<00:24, 347.77it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14957/23384 [00:50<00:24, 343.06it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 14992/23384 [00:50<00:24, 337.00it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 15026/23384 [00:50<00:25, 322.37it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 15063/23384 [00:50<00:24, 335.56it/s]
 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 15100/23384 [00:51<00:24, 342.63it/s]
 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 15135/23384 [00:51<00:24, 339.48it/s]
 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 15175/23384 [00:51<00:23, 355.10it/s]
 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ   | 15214/23384 [00:51<00:22, 364.47it/s]
 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ   | 15251/23384 [00:51<00:22, 364.37it/s]
 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ   | 15288/23384 [00:51<00:22, 359.73it/s]
 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ   | 15325/23384 [00:51<00:22, 351.31it/s]
 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ   | 15362/23384 [00:51<00:22, 356.40it/s]
 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ   | 15401/23384 [00:51<00:21, 365.41it/s]
 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ   | 15438/23384 [00:51<00:21, 363.65it/s]
 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ   | 15475/23384 [00:52<00:21, 365.02it/s]
 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 15512/23384 [00:52<00:21, 362.58it/s]
 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 15549/23384 [00:52<00:21, 362.89it/s]
 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 15586/23384 [00:52<00:22, 346.12it/s]
 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 15621/23384 [00:52<00:22, 338.02it/s]
 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 15656/23384 [00:52<00:22, 341.18it/s]
 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 15694/23384 [00:52<00:21, 350.40it/s]
 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 15735/23384 [00:52<00:20, 366.06it/s]
 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 15777/23384 [00:52<00:19, 381.02it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š   | 15816/23384 [00:53<00:20, 368.20it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š   | 15857/23384 [00:53<00:19, 378.56it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š   | 15896/23384 [00:53<00:19, 375.03it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š   | 15934/23384 [00:53<00:19, 372.62it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š   | 15972/23384 [00:53<00:19, 370.85it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š   | 16010/23384 [00:53<00:19, 373.29it/s]
 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š   | 16049/23384 [00:53<00:19, 377.27it/s]
 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 16087/23384 [00:53<00:20, 364.48it/s]
 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 16125/23384 [00:53<00:19, 366.50it/s]
 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 16164/23384 [00:53<00:19, 371.67it/s]
 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 16202/23384 [00:54<00:19, 364.24it/s]
 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 16239/23384 [00:54<00:19, 359.67it/s]
 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 16276/23384 [00:54<00:19, 357.80it/s]
 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 16314/23384 [00:54<00:19, 362.04it/s]
 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 16351/23384 [00:54<00:19, 360.23it/s]
 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ   | 16391/23384 [00:54<00:18, 371.49it/s]
 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ   | 16429/23384 [00:54<00:18, 372.31it/s]
 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ   | 16469/23384 [00:54<00:18, 379.29it/s]
 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ   | 16507/23384 [00:54<00:18, 373.97it/s]
 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ   | 16545/23384 [00:54<00:18, 374.46it/s]
 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ   | 16586/23384 [00:55<00:17, 382.61it/s]
 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ   | 16625/23384 [00:55<00:17, 382.21it/s]
 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 16664/23384 [00:55<00:18, 372.77it/s]
 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 16706/23384 [00:55<00:17, 384.92it/s]
 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 16747/23384 [00:55<00:16, 390.99it/s]
 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 16790/23384 [00:55<00:16, 400.33it/s]
 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 16831/23384 [00:55<00:16, 394.26it/s]
 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 16871/23384 [00:55<00:16, 393.97it/s]
 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 16911/23384 [00:55<00:16, 392.62it/s]
 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 16951/23384 [00:56<00:17, 376.74it/s]
 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž  | 16989/23384 [00:56<00:16, 377.47it/s]
 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž  | 17029/23384 [00:56<00:16, 382.96it/s]
 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž  | 17071/23384 [00:56<00:16, 393.66it/s]
 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž  | 17114/23384 [00:56<00:15, 402.45it/s]
 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž  | 17155/23384 [00:56<00:15, 401.32it/s]
 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž  | 17196/23384 [00:56<00:16, 384.35it/s]
 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž  | 17235/23384 [00:56<00:16, 379.29it/s]
 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 17274/23384 [00:56<00:16, 381.28it/s]
 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 17315/23384 [00:56<00:15, 389.26it/s]
 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 17355/23384 [00:57<00:15, 390.70it/s]
 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 17398/23384 [00:57<00:14, 399.98it/s]
 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 17441/23384 [00:57<00:14, 407.78it/s]
 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 17482/23384 [00:57<00:14, 406.24it/s]
 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 17523/23384 [00:57<00:14, 397.82it/s]
 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ  | 17563/23384 [00:57<00:14, 393.02it/s]
 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ  | 17603/23384 [00:57<00:14, 388.19it/s]
 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ  | 17642/23384 [00:57<00:14, 385.56it/s]
 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ  | 17684/23384 [00:57<00:14, 394.85it/s]
 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ  | 17725/23384 [00:57<00:14, 396.46it/s]
 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ  | 17767/23384 [00:58<00:14, 400.55it/s]
 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ  | 17808/23384 [00:58<00:14, 386.42it/s]
 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 17847/23384 [00:58<00:14, 378.98it/s]
 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 17885/23384 [00:58<00:14, 371.28it/s]
 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 17923/23384 [00:58<00:14, 369.92it/s]
 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 17961/23384 [00:58<00:15, 359.97it/s]
 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 17998/23384 [00:58<00:14, 361.74it/s]
 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 18038/23384 [00:58<00:14, 372.31it/s]
 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 18078/23384 [00:58<00:14, 378.27it/s]
 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 18116/23384 [00:59<00:14, 372.39it/s]
 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š  | 18154/23384 [00:59<00:13, 374.49it/s]
 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š  | 18193/23384 [00:59<00:13, 376.71it/s]
 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š  | 18231/23384 [00:59<00:13, 376.91it/s]
 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š  | 18269/23384 [00:59<00:13, 372.32it/s]
 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š  | 18309/23384 [00:59<00:13, 379.75it/s]
 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š  | 18349/23384 [00:59<00:13, 383.89it/s]
 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š  | 18390/23384 [00:59<00:12, 390.65it/s]
 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰  | 18430/23384 [00:59<00:12, 392.51it/s]
 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰  | 18472/23384 [00:59<00:12, 400.65it/s]
 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰  | 18513/23384 [01:00<00:12, 388.31it/s]
 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰  | 18552/23384 [01:00<00:12, 387.21it/s]
 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰  | 18591/23384 [01:00<00:12, 381.26it/s]
 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰  | 18630/23384 [01:00<00:12, 380.71it/s]
 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰  | 18669/23384 [01:00<00:12, 373.29it/s]
 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 18710/23384 [01:00<00:12, 382.95it/s]
 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 18749/23384 [01:00<00:12, 377.24it/s]
 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 18787/23384 [01:00<00:12, 377.33it/s]
 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 18825/23384 [01:00<00:12, 371.91it/s]
 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 18865/23384 [01:00<00:11, 378.07it/s]
 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 18903/23384 [01:01<00:11, 376.73it/s]
 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 18941/23384 [01:01<00:11, 373.02it/s]
 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 18982/23384 [01:01<00:11, 383.68it/s]
 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19025/23384 [01:01<00:11, 395.76it/s]
 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19065/23384 [01:01<00:11, 386.33it/s]
 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19106/23384 [01:01<00:10, 392.86it/s]
 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19146/23384 [01:01<00:10, 390.71it/s]
 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19186/23384 [01:01<00:10, 390.91it/s]
 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19226/23384 [01:01<00:10, 387.97it/s]
 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19268/23384 [01:02<00:10, 394.26it/s]
 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 19308/23384 [01:02<00:10, 395.58it/s]
 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 19349/23384 [01:02<00:10, 398.92it/s]
 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 19389/23384 [01:02<00:10, 385.68it/s]
 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 19428/23384 [01:02<00:10, 379.00it/s]
 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 19469/23384 [01:02<00:10, 385.33it/s]
 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 19508/23384 [01:02<00:10, 379.12it/s]
 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 19546/23384 [01:02<00:10, 377.34it/s]
 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19586/23384 [01:02<00:09, 381.37it/s]
 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19625/23384 [01:02<00:09, 377.47it/s]
 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19663/23384 [01:03<00:09, 376.78it/s]
 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19701/23384 [01:03<00:09, 376.50it/s]
 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19739/23384 [01:03<00:09, 370.59it/s]
 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19777/23384 [01:03<00:09, 373.26it/s]
 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19815/23384 [01:03<00:09, 370.84it/s]
 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 19853/23384 [01:03<00:09, 372.97it/s]
 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 19895/23384 [01:03<00:09, 384.49it/s]
 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 19934/23384 [01:03<00:08, 383.34it/s]
 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 19974/23384 [01:03<00:08, 388.11it/s]
 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 20013/23384 [01:03<00:08, 383.03it/s]
 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 20054/23384 [01:04<00:08, 390.42it/s]
 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 20094/23384 [01:04<00:08, 388.97it/s]
 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 20133/23384 [01:04<00:08, 383.77it/s]
 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 20173/23384 [01:04<00:08, 385.77it/s]
 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 20213/23384 [01:04<00:08, 388.54it/s]
 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 20253/23384 [01:04<00:08, 390.62it/s]
 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 20293/23384 [01:04<00:07, 389.50it/s]
 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 20332/23384 [01:04<00:07, 386.18it/s]
 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 20373/23384 [01:04<00:07, 392.22it/s]
 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 20416/23384 [01:05<00:07, 403.02it/s]
 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 20459/23384 [01:05<00:07, 410.37it/s]
 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 20501/23384 [01:05<00:06, 413.14it/s]
 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 20546/23384 [01:05<00:06, 422.98it/s]
 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 20589/23384 [01:05<00:06, 422.96it/s]
 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 20632/23384 [01:05<00:06, 420.41it/s]
 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 20675/23384 [01:05<00:06, 418.88it/s]
 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 20717/23384 [01:05<00:06, 418.90it/s]
 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 20759/23384 [01:05<00:06, 408.58it/s]
 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 20800/23384 [01:05<00:06, 404.01it/s]
 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 20845/23384 [01:06<00:06, 417.23it/s]
 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 20887/23384 [01:06<00:06, 411.24it/s]
 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 20929/23384 [01:06<00:06, 407.68it/s]
 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 20972/23384 [01:06<00:05, 413.41it/s]
 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 21014/23384 [01:06<00:05, 402.99it/s]
 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 21057/23384 [01:06<00:05, 409.11it/s]
 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 21099/23384 [01:06<00:05, 410.91it/s]
 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 21143/23384 [01:06<00:05, 418.93it/s]
 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 21185/23384 [01:06<00:05, 417.58it/s]
 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 21227/23384 [01:06<00:05, 415.99it/s]
 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 21269/23384 [01:07<00:05, 410.61it/s]
 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 21311/23384 [01:07<00:05, 409.45it/s]
 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21352/23384 [01:07<00:05, 395.27it/s]
 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21392/23384 [01:07<00:05, 387.77it/s]
 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21431/23384 [01:07<00:05, 382.09it/s]
 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21472/23384 [01:07<00:04, 387.62it/s]
 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21511/23384 [01:07<00:04, 381.76it/s]
 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21555/23384 [01:07<00:04, 396.90it/s]
 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21595/23384 [01:07<00:04, 392.68it/s]
 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 21635/23384 [01:08<00:04, 386.42it/s]
 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 21675/23384 [01:08<00:04, 388.11it/s]
 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 21714/23384 [01:08<00:04, 388.27it/s]
 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 21753/23384 [01:08<00:04, 380.91it/s]
 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 21794/23384 [01:08<00:04, 386.93it/s]
 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 21833/23384 [01:08<00:04, 387.30it/s]
 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 21873/23384 [01:08<00:03, 388.06it/s]
 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 21912/23384 [01:08<00:03, 386.13it/s]
 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21953/23384 [01:08<00:03, 392.24it/s]
 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 21994/23384 [01:08<00:03, 395.12it/s]
 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 22034/23384 [01:09<00:03, 393.41it/s]
 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 22076/23384 [01:09<00:03, 400.19it/s]
 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 22117/23384 [01:09<00:03, 401.51it/s]
 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 22158/23384 [01:09<00:03, 401.81it/s]
 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 22203/23384 [01:09<00:02, 414.04it/s]
 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 22245/23384 [01:09<00:02, 415.09it/s]
 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 22287/23384 [01:09<00:02, 408.06it/s]
 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 22328/23384 [01:09<00:02, 404.27it/s]
 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 22369/23384 [01:09<00:02, 404.51it/s]
 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 22411/23384 [01:09<00:02, 406.63it/s]
 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 22452/23384 [01:10<00:02, 400.54it/s]
 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 22493/23384 [01:10<00:02, 396.09it/s]
 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 22534/23384 [01:10<00:02, 397.71it/s]
 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 22574/23384 [01:10<00:02, 398.00it/s]
 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 22616/23384 [01:10<00:01, 403.39it/s]
 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 22658/23384 [01:10<00:01, 407.52it/s]
 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 22703/23384 [01:10<00:01, 418.33it/s]
 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 22745/23384 [01:10<00:01, 406.51it/s]
 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 22786/23384 [01:10<00:01, 405.24it/s]
 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 22830/23384 [01:10<00:01, 413.23it/s]
 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 22872/23384 [01:11<00:01, 412.84it/s]
 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 22914/23384 [01:11<00:01, 414.19it/s]
 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 22956/23384 [01:11<00:01, 405.86it/s]
 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 22997/23384 [01:11<00:00, 403.04it/s]
 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 23038/23384 [01:11<00:00, 393.89it/s]
 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 23078/23384 [01:11<00:00, 384.40it/s]
 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 23117/23384 [01:11<00:00, 375.05it/s]
 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 23155/23384 [01:11<00:00, 367.07it/s]
 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 23195/23384 [01:11<00:00, 374.61it/s]
 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 23233/23384 [01:12<00:00, 370.63it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 23271/23384 [01:12<00:00, 371.18it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 23309/23384 [01:12<00:00, 373.71it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 23347/23384 [01:12<00:00, 371.94it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 23384/23384 [01:12<00:00, 322.69it/s]

  0%|          | 0/1460 [00:00<?, ?it/s]
  3%|β–Ž         | 38/1460 [00:00<00:03, 375.59it/s]
  5%|β–Œ         | 76/1460 [00:00<00:03, 360.27it/s]
  8%|β–Š         | 116/1460 [00:00<00:03, 374.34it/s]
 11%|β–ˆ         | 154/1460 [00:00<00:03, 374.25it/s]
 13%|β–ˆβ–Ž        | 194/1460 [00:00<00:03, 382.18it/s]
 16%|β–ˆβ–Œ        | 233/1460 [00:00<00:03, 382.60it/s]
 19%|β–ˆβ–Š        | 273/1460 [00:00<00:03, 386.78it/s]
 22%|β–ˆβ–ˆβ–       | 315/1460 [00:00<00:02, 394.42it/s]
 24%|β–ˆβ–ˆβ–       | 355/1460 [00:00<00:02, 390.44it/s]
 27%|β–ˆβ–ˆβ–‹       | 398/1460 [00:01<00:02, 400.07it/s]
 30%|β–ˆβ–ˆβ–ˆ       | 440/1460 [00:01<00:02, 403.39it/s]
 33%|β–ˆβ–ˆβ–ˆβ–Ž      | 481/1460 [00:01<00:02, 389.72it/s]
 36%|β–ˆβ–ˆβ–ˆβ–Œ      | 521/1460 [00:01<00:02, 372.21it/s]
 38%|β–ˆβ–ˆβ–ˆβ–Š      | 559/1460 [00:01<00:02, 365.58it/s]
 41%|β–ˆβ–ˆβ–ˆβ–ˆ      | 596/1460 [00:01<00:02, 362.97it/s]
 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž     | 633/1460 [00:01<00:02, 359.81it/s]
 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ     | 673/1460 [00:01<00:02, 370.65it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 713/1460 [00:01<00:01, 376.48it/s]
 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 751/1460 [00:01<00:01, 368.34it/s]
 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–    | 788/1460 [00:02<00:03, 223.15it/s]
 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹    | 826/1460 [00:02<00:02, 253.54it/s]
 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰    | 863/1460 [00:02<00:02, 278.06it/s]
 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 898/1460 [00:02<00:01, 292.89it/s]
 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–   | 936/1460 [00:02<00:01, 313.36it/s]
 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹   | 976/1460 [00:02<00:01, 334.49it/s]
 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰   | 1012/1460 [00:02<00:01, 336.95it/s]
 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 1051/1460 [00:03<00:01, 349.96it/s]
 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–  | 1089/1460 [00:03<00:01, 357.07it/s]
 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹  | 1128/1460 [00:03<00:00, 364.51it/s]
 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ  | 1169/1460 [00:03<00:00, 377.63it/s]
 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 1208/1460 [00:03<00:00, 378.28it/s]
 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 1247/1460 [00:03<00:00, 376.93it/s]
 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 1285/1460 [00:03<00:00, 370.18it/s]
 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1324/1460 [00:03<00:00, 373.74it/s]
 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 1362/1460 [00:03<00:00, 370.79it/s]
 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 1401/1460 [00:03<00:00, 375.54it/s]
 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 1439/1460 [00:04<00:00, 372.04it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1460/1460 [00:04<00:00, 354.18it/s]
Reading ./checkpoints/t2m/Comp_v6_KLD005/opt.txt
Loading dataset t2m ...

  0%|          | 0/1460 [00:00<?, ?it/s]
 10%|β–‰         | 140/1460 [00:00<00:00, 1381.37it/s]
 19%|β–ˆβ–‰        | 280/1460 [00:00<00:00, 1386.96it/s]
 29%|β–ˆβ–ˆβ–‰       | 429/1460 [00:00<00:00, 1430.50it/s]
 39%|β–ˆβ–ˆβ–ˆβ–‰      | 573/1460 [00:00<00:00, 1366.20it/s]
 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰     | 713/1460 [00:00<00:00, 1377.54it/s]
 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š    | 852/1460 [00:00<00:00, 1377.53it/s]
 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š   | 993/1460 [00:00<00:00, 1387.90it/s]
 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š  | 1146/1460 [00:00<00:00, 1431.30it/s]
 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 1331/1460 [00:00<00:00, 1560.20it/s]
100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 1460/1460 [00:00<00:00, 1481.66it/s]
Pointer Pointing at 0
Ground Truth Dataset Loading Completed!!!
Reading ./checkpoints/t2m/Comp_v6_KLD005/opt.txt
Loading Evaluation Model Wrapper (Epoch 28) Completed!!
Total Epochs: 1500, Total Iters: 574500
Iters Per Epoch, Training: 0383, Validation: 023
--> 	 Eva. Ep 0 :, FID. 28.8010, Diversity Real. 9.3754, Diversity. 4.0470, R_precision_real. [0.50265957 0.7087766  0.79787234], R_precision. [0.03457447 0.06316489 0.09840426], matching_score_real. 2.963627576828003, matching_score_pred. 7.9468278884887695
--> --> 	 FID Improved from 100.00000 to 28.80096 !!!
--> --> 	 matching_score Improved from 100.00000 to 7.94683 !!!
--> --> 	 Diversity Improved from 100.00000 to 4.04696 !!!
--> --> 	 Top1 Improved from 0.0000 to 0.0346 !!!
--> --> 	 Top2 Improved from 0.0000 to 0.0632 !!!
--> --> 	 Top3 Improved from 0.0000 to 0.0984 !!!
ep/it: 0-  49 niter:    50  0m 38s (- 7319m 11s) completed:  0%) loss_emb: 0.0069  loss: 4.8114  acc: 0.0315  lr: 0.0000 
ep/it: 0-  99 niter:   100  0m 59s (- 5734m 10s) completed:  0%) loss_emb: 0.0067  loss: 4.2911  acc: 0.1639  lr: 0.0000 
ep/it: 0- 149 niter:   150  1m 21s (- 5198m 41s) completed:  0%) loss_emb: 0.0064  loss: 3.9612  acc: 0.1725  lr: 0.0000 
ep/it: 0- 199 niter:   200  1m 42s (- 4918m 15s) completed:  0%) loss_emb: 0.0063  loss: 3.8148  acc: 0.1749  lr: 0.0000 
ep/it: 0- 249 niter:   250  2m 4s (- 4750m 6s) completed:  0%) loss_emb: 0.0063  loss: 3.7379  acc: 0.1884  lr: 0.0000 
ep/it: 0- 299 niter:   300  2m 25s (- 4630m 8s) completed:  0%) loss_emb: 0.0062  loss: 3.6899  acc: 0.1937  lr: 0.0000 
ep/it: 0- 349 niter:   350  2m 46s (- 4554m 36s) completed:  0%) loss_emb: 0.0062  loss: 3.6731  acc: 0.1935  lr: 0.0000 
Validation time:
ep/it: 1-  16 niter:   400  3m 8s (- 4501m 44s) completed:  0%) loss_emb: 0.0062  loss: 3.6392  acc: 0.1953  lr: 0.0000 
ep/it: 1-  66 niter:   450  3m 29s (- 4449m 36s) completed:  0%) loss_emb: 0.0061  loss: 3.5968  acc: 0.1992  lr: 0.0000 
ep/it: 1- 116 niter:   500  3m 50s (- 4405m 14s) completed:  0%) loss_emb: 0.0061  loss: 3.5408  acc: 0.2054  lr: 0.0000 
ep/it: 1- 166 niter:   550  4m 11s (- 4379m 50s) completed:  0%) loss_emb: 0.0060  loss: 3.4866  acc: 0.2097  lr: 0.0001 
ep/it: 1- 216 niter:   600  4m 33s (- 4352m 10s) completed:  0%) loss_emb: 0.0059  loss: 3.4277  acc: 0.2163  lr: 0.0001 
ep/it: 1- 266 niter:   650  4m 54s (- 4328m 51s) completed:  0%) loss_emb: 0.0059  loss: 3.4013  acc: 0.2190  lr: 0.0001 
ep/it: 1- 316 niter:   700  5m 15s (- 4311m 57s) completed:  0%) loss_emb: 0.0059  loss: 3.3657  acc: 0.2245  lr: 0.0001 
ep/it: 1- 366 niter:   750  5m 36s (- 4296m 38s) completed:  0%) loss_emb: 0.0058  loss: 3.3460  acc: 0.2262  lr: 0.0001 
Validation time:
ep/it: 2-  33 niter:   800  5m 59s (- 4292m 56s) completed:  0%) loss_emb: 0.0057  loss: 3.2723  acc: 0.2399  lr: 0.0001 
ep/it: 2-  83 niter:   850  6m 20s (- 4278m 50s) completed:  0%) loss_emb: 0.0057  loss: 3.2633  acc: 0.2430  lr: 0.0001 
ep/it: 2- 133 niter:   900  6m 41s (- 4268m 34s) completed:  0%) loss_emb: 0.0056  loss: 3.1887  acc: 0.2565  lr: 0.0001 
ep/it: 2- 183 niter:   950  7m 3s (- 4256m 55s) completed:  0%) loss_emb: 0.0056  loss: 3.1740  acc: 0.2604  lr: 0.0001 
ep/it: 2- 233 niter:  1000  7m 24s (- 4247m 43s) completed:  0%) loss_emb: 0.0055  loss: 3.0997  acc: 0.2766  lr: 0.0001 
ep/it: 2- 283 niter:  1050  7m 46s (- 4244m 25s) completed:  0%) loss_emb: 0.0054  loss: 3.0507  acc: 0.2901  lr: 0.0001 
ep/it: 2- 333 niter:  1100  8m 7s (- 4236m 13s) completed:  0%) loss_emb: 0.0054  loss: 3.0024  acc: 0.3002  lr: 0.0001 
Validation time:
ep/it: 3-   0 niter:  1150  8m 29s (- 4232m 22s) completed:  0%) loss_emb: 0.0053  loss: 2.9265  acc: 0.3181  lr: 0.0001 
ep/it: 3-  50 niter:  1200  8m 51s (- 4228m 18s) completed:  0%) loss_emb: 0.0052  loss: 2.8706  acc: 0.3278  lr: 0.0001 
ep/it: 3- 100 niter:  1250  9m 12s (- 4221m 30s) completed:  0%) loss_emb: 0.0051  loss: 2.8023  acc: 0.3441  lr: 0.0001 
ep/it: 3- 150 niter:  1300  9m 34s (- 4219m 43s) completed:  0%) loss_emb: 0.0051  loss: 2.7822  acc: 0.3486  lr: 0.0001 
ep/it: 3- 200 niter:  1350  9m 55s (- 4211m 1s) completed:  0%) loss_emb: 0.0050  loss: 2.7269  acc: 0.3607  lr: 0.0001 
ep/it: 3- 250 niter:  1400  10m 16s (- 4207m 29s) completed:  0%) loss_emb: 0.0049  loss: 2.6480  acc: 0.3773  lr: 0.0001 
ep/it: 3- 300 niter:  1450  10m 37s (- 4201m 2s) completed:  0%) loss_emb: 0.0048  loss: 2.6044  acc: 0.3896  lr: 0.0001 
ep/it: 3- 350 niter:  1500  10m 59s (- 4196m 4s) completed:  0%) loss_emb: 0.0048  loss: 2.5574  acc: 0.4000  lr: 0.0001 
Validation time:
ep/it: 4-  17 niter:  1550  11m 20s (- 4195m 5s) completed:  0%) loss_emb: 0.0047  loss: 2.4792  acc: 0.4154  lr: 0.0002 
ep/it: 4-  67 niter:  1600  11m 42s (- 4189m 59s) completed:  0%) loss_emb: 0.0046  loss: 2.4085  acc: 0.4304  lr: 0.0002 
ep/it: 4- 117 niter:  1650  12m 3s (- 4187m 48s) completed:  0%) loss_emb: 0.0045  loss: 2.3899  acc: 0.4370  lr: 0.0002 
ep/it: 4- 167 niter:  1700  12m 25s (- 4184m 45s) completed:  0%) loss_emb: 0.0045  loss: 2.3594  acc: 0.4431  lr: 0.0002 
ep/it: 4- 217 niter:  1750  12m 46s (- 4180m 33s) completed:  0%) loss_emb: 0.0044  loss: 2.2895  acc: 0.4576  lr: 0.0002 
ep/it: 4- 267 niter:  1800  13m 7s (- 4177m 35s) completed:  0%) loss_emb: 0.0043  loss: 2.2598  acc: 0.4656  lr: 0.0002 
ep/it: 4- 317 niter:  1850  13m 29s (- 4174m 3s) completed:  0%) loss_emb: 0.0042  loss: 2.1764  acc: 0.4834  lr: 0.0002 
ep/it: 4- 367 niter:  1900  13m 50s (- 4170m 58s) completed:  0%) loss_emb: 0.0042  loss: 2.1951  acc: 0.4795  lr: 0.0002 
Validation time:
ep/it: 5-  34 niter:  1950  14m 12s (- 4172m 0s) completed:  0%) loss_emb: 0.0042  loss: 2.1487  acc: 0.4910  lr: 0.0002 
ep/it: 5-  84 niter:  2000  14m 33s (- 4169m 12s) completed:  0%) loss_emb: 0.0041  loss: 2.0978  acc: 0.5021  lr: 0.0002 
ep/it: 5- 134 niter:  2050  14m 55s (- 4166m 14s) completed:  0%) loss_emb: 0.0040  loss: 2.0324  acc: 0.5167  lr: 0.0002 
ep/it: 5- 184 niter:  2100  15m 16s (- 4162m 5s) completed:  0%) loss_emb: 0.0040  loss: 2.0227  acc: 0.5201  lr: 0.0002 
ep/it: 5- 234 niter:  2150  15m 37s (- 4160m 1s) completed:  0%) loss_emb: 0.0040  loss: 2.0007  acc: 0.5241  lr: 0.0002 
ep/it: 5- 284 niter:  2200  15m 58s (- 4156m 43s) completed:  0%) loss_emb: 0.0039  loss: 1.9729  acc: 0.5308  lr: 0.0002 
ep/it: 5- 334 niter:  2250  16m 20s (- 4154m 35s) completed:  0%) loss_emb: 0.0039  loss: 1.9446  acc: 0.5367  lr: 0.0002 
Validation time:
ep/it: 6-   1 niter:  2300  16m 42s (- 4155m 25s) completed:  0%) loss_emb: 0.0038  loss: 1.9180  acc: 0.5424  lr: 0.0002 
ep/it: 6-  51 niter:  2350  17m 3s (- 4152m 43s) completed:  0%) loss_emb: 0.0038  loss: 1.9010  acc: 0.5484  lr: 0.0002 
ep/it: 6- 101 niter:  2400  17m 24s (- 4150m 42s) completed:  0%) loss_emb: 0.0037  loss: 1.8434  acc: 0.5588  lr: 0.0002 
ep/it: 6- 151 niter:  2450  17m 45s (- 4147m 46s) completed:  0%) loss_emb: 0.0037  loss: 1.8689  acc: 0.5539  lr: 0.0002 
ep/it: 6- 201 niter:  2500  18m 7s (- 4145m 27s) completed:  0%) loss_emb: 0.0037  loss: 1.8555  acc: 0.5565  lr: 0.0002 
ep/it: 6- 251 niter:  2550  18m 28s (- 4144m 3s) completed:  0%) loss_emb: 0.0037  loss: 1.8319  acc: 0.5611  lr: 0.0002 
ep/it: 6- 301 niter:  2600  18m 49s (- 4142m 4s) completed:  0%) loss_emb: 0.0036  loss: 1.8078  acc: 0.5680  lr: 0.0002 
ep/it: 6- 351 niter:  2650  19m 11s (- 4139m 50s) completed:  0%) loss_emb: 0.0036  loss: 1.7627  acc: 0.5779  lr: 0.0002 
Validation time:
ep/it: 7-  18 niter:  2700  19m 32s (- 4139m 17s) completed:  0%) loss_emb: 0.0036  loss: 1.7902  acc: 0.5707  lr: 0.0002 
ep/it: 7-  68 niter:  2750  19m 54s (- 4137m 31s) completed:  0%) loss_emb: 0.0036  loss: 1.7656  acc: 0.5761  lr: 0.0002 
ep/it: 7- 118 niter:  2800  20m 15s (- 4136m 0s) completed:  0%) loss_emb: 0.0035  loss: 1.7620  acc: 0.5769  lr: 0.0002 
ep/it: 7- 168 niter:  2850  20m 36s (- 4134m 4s) completed:  0%) loss_emb: 0.0035  loss: 1.7141  acc: 0.5891  lr: 0.0002 
ep/it: 7- 218 niter:  2900  20m 57s (- 4131m 45s) completed:  0%) loss_emb: 0.0035  loss: 1.7324  acc: 0.5832  lr: 0.0002 
ep/it: 7- 268 niter:  2950  21m 18s (- 4128m 36s) completed:  0%) loss_emb: 0.0035  loss: 1.7443  acc: 0.5808  lr: 0.0002 
ep/it: 7- 318 niter:  3000  21m 40s (- 4127m 47s) completed:  0%) loss_emb: 0.0034  loss: 1.7044  acc: 0.5906  lr: 0.0002 
ep/it: 7- 368 niter:  3050  22m 1s (- 4127m 56s) completed:  0%) loss_emb: 0.0034  loss: 1.6672  acc: 0.5985  lr: 0.0002 
Validation time:
ep/it: 8-  35 niter:  3100  22m 24s (- 4129m 27s) completed:  0%) loss_emb: 0.0034  loss: 1.6611  acc: 0.5981  lr: 0.0002 
ep/it: 8-  85 niter:  3150  22m 45s (- 4128m 14s) completed:  0%) loss_emb: 0.0034  loss: 1.6557  acc: 0.6007  lr: 0.0002 
ep/it: 8- 135 niter:  3200  23m 7s (- 4128m 28s) completed:  0%) loss_emb: 0.0034  loss: 1.6610  acc: 0.5992  lr: 0.0002 
ep/it: 8- 185 niter:  3250  23m 28s (- 4126m 49s) completed:  0%) loss_emb: 0.0034  loss: 1.6708  acc: 0.5974  lr: 0.0002 
ep/it: 8- 235 niter:  3300  23m 49s (- 4125m 9s) completed:  0%) loss_emb: 0.0033  loss: 1.6268  acc: 0.6082  lr: 0.0002 
ep/it: 8- 285 niter:  3350  24m 11s (- 4123m 5s) completed:  0%) loss_emb: 0.0033  loss: 1.6365  acc: 0.6056  lr: 0.0002 
ep/it: 8- 335 niter:  3400  24m 32s (- 4121m 12s) completed:  0%) loss_emb: 0.0033  loss: 1.6251  acc: 0.6069  lr: 0.0002 
Validation time:
ep/it: 9-   2 niter:  3450  24m 54s (- 4121m 43s) completed:  0%) loss_emb: 0.0033  loss: 1.6401  acc: 0.6037  lr: 0.0002 
ep/it: 9-  52 niter:  3500  25m 15s (- 4120m 37s) completed:  0%) loss_emb: 0.0033  loss: 1.5954  acc: 0.6137  lr: 0.0002 
ep/it: 9- 102 niter:  3550  25m 36s (- 4119m 32s) completed:  0%) loss_emb: 0.0032  loss: 1.5821  acc: 0.6166  lr: 0.0002 
ep/it: 9- 152 niter:  3600  25m 57s (- 4117m 45s) completed:  0%) loss_emb: 0.0032  loss: 1.5947  acc: 0.6138  lr: 0.0002 
ep/it: 9- 202 niter:  3650  26m 18s (- 4115m 47s) completed:  0%) loss_emb: 0.0033  loss: 1.6131  acc: 0.6100  lr: 0.0002 
ep/it: 9- 252 niter:  3700  26m 40s (- 4114m 15s) completed:  0%) loss_emb: 0.0032  loss: 1.5970  acc: 0.6132  lr: 0.0002 
ep/it: 9- 302 niter:  3750  27m 1s (- 4112m 59s) completed:  0%) loss_emb: 0.0032  loss: 1.5505  acc: 0.6243  lr: 0.0002 
ep/it: 9- 352 niter:  3800  27m 22s (- 4111m 10s) completed:  0%) loss_emb: 0.0032  loss: 1.5407  acc: 0.6267  lr: 0.0002 
Validation time:
--> 	 Eva. Ep 10 :, FID. 9.9593, Diversity Real. 9.3289, Diversity. 7.0938, R_precision_real. [0.51130319 0.7087766  0.78989362], R_precision. [0.18816489 0.31449468 0.41023936], matching_score_real. 2.93660306930542, matching_score_pred. 6.017515182495117
--> --> 	 FID Improved from 28.80096 to 9.95930 !!!
--> --> 	 matching_score Improved from 7.94683 to 6.01752 !!!
--> --> 	 Diversity Improved from 4.04696 to 7.09381 !!!
--> --> 	 Top1 Improved from 0.0346 to 0.1882 !!!
--> --> 	 Top2 Improved from 0.0632 to 0.3145 !!!
--> --> 	 Top3 Improved from 0.0984 to 0.4102 !!!
ep/it:10-  19 niter:  3850  27m 58s (- 4147m 33s) completed:  0%) loss_emb: 0.0032  loss: 1.5532  acc: 0.6229  lr: 0.0002 
ep/it:10-  69 niter:  3900  28m 20s (- 4146m 1s) completed:  0%) loss_emb: 0.0032  loss: 1.5422  acc: 0.6252  lr: 0.0002 
ep/it:10- 119 niter:  3950  28m 41s (- 4144m 46s) completed:  0%) loss_emb: 0.0031  loss: 1.4987  acc: 0.6363  lr: 0.0002 
ep/it:10- 169 niter:  4000  29m 2s (- 4143m 10s) completed:  0%) loss_emb: 0.0031  loss: 1.5337  acc: 0.6273  lr: 0.0002 
ep/it:10- 219 niter:  4050  29m 24s (- 4141m 57s) completed:  0%) loss_emb: 0.0031  loss: 1.5363  acc: 0.6260  lr: 0.0002 
ep/it:10- 269 niter:  4100  29m 45s (- 4140m 1s) completed:  0%) loss_emb: 0.0031  loss: 1.5168  acc: 0.6307  lr: 0.0002 
ep/it:10- 319 niter:  4150  30m 6s (- 4138m 19s) completed:  0%) loss_emb: 0.0031  loss: 1.5189  acc: 0.6316  lr: 0.0002 
ep/it:10- 369 niter:  4200  30m 27s (- 4136m 38s) completed:  0%) loss_emb: 0.0031  loss: 1.4975  acc: 0.6353  lr: 0.0002 
Validation time:
ep/it:11-  36 niter:  4250  30m 49s (- 4135m 58s) completed:  0%) loss_emb: 0.0031  loss: 1.5302  acc: 0.6287  lr: 0.0002 
ep/it:11-  86 niter:  4300  31m 10s (- 4134m 34s) completed:  0%) loss_emb: 0.0031  loss: 1.5277  acc: 0.6274  lr: 0.0002 
ep/it:11- 136 niter:  4350  31m 31s (- 4132m 27s) completed:  0%) loss_emb: 0.0031  loss: 1.5061  acc: 0.6329  lr: 0.0002 
ep/it:11- 186 niter:  4400  31m 52s (- 4130m 56s) completed:  0%) loss_emb: 0.0030  loss: 1.4683  acc: 0.6406  lr: 0.0002 
ep/it:11- 236 niter:  4450  32m 14s (- 4129m 16s) completed:  0%) loss_emb: 0.0030  loss: 1.4817  acc: 0.6386  lr: 0.0002 
ep/it:11- 286 niter:  4500  32m 35s (- 4128m 19s) completed:  0%) loss_emb: 0.0031  loss: 1.4893  acc: 0.6366  lr: 0.0002 
ep/it:11- 336 niter:  4550  32m 56s (- 4127m 6s) completed:  0%) loss_emb: 0.0030  loss: 1.4709  acc: 0.6414  lr: 0.0002 
Validation time:
ep/it:12-   3 niter:  4600  33m 18s (- 4127m 7s) completed:  0%) loss_emb: 0.0031  loss: 1.4884  acc: 0.6375  lr: 0.0002 
ep/it:12-  53 niter:  4650  33m 40s (- 4126m 26s) completed:  0%) loss_emb: 0.0030  loss: 1.4638  acc: 0.6424  lr: 0.0002 
ep/it:12- 103 niter:  4700  34m 2s (- 4126m 37s) completed:  0%) loss_emb: 0.0030  loss: 1.4731  acc: 0.6401  lr: 0.0002 
ep/it:12- 153 niter:  4750  34m 23s (- 4125m 54s) completed:  0%) loss_emb: 0.0031  loss: 1.4878  acc: 0.6364  lr: 0.0002 
ep/it:12- 203 niter:  4800  34m 45s (- 4124m 42s) completed:  0%) loss_emb: 0.0030  loss: 1.4513  acc: 0.6451  lr: 0.0002 
ep/it:12- 253 niter:  4850  35m 6s (- 4123m 37s) completed:  0%) loss_emb: 0.0029  loss: 1.4108  acc: 0.6533  lr: 0.0002 
ep/it:12- 303 niter:  4900  35m 28s (- 4123m 14s) completed:  0%) loss_emb: 0.0030  loss: 1.4748  acc: 0.6403  lr: 0.0002 
ep/it:12- 353 niter:  4950  35m 49s (- 4122m 1s) completed:  0%) loss_emb: 0.0030  loss: 1.4345  acc: 0.6493  lr: 0.0002 
Validation time:
ep/it:13-  20 niter:  5000  36m 11s (- 4121m 45s) completed:  0%) loss_emb: 0.0029  loss: 1.4164  acc: 0.6524  lr: 0.0002 
ep/it:13-  70 niter:  5050  36m 32s (- 4121m 19s) completed:  0%) loss_emb: 0.0030  loss: 1.4588  acc: 0.6438  lr: 0.0002 
ep/it:13- 120 niter:  5100  36m 54s (- 4120m 17s) completed:  0%) loss_emb: 0.0030  loss: 1.4357  acc: 0.6484  lr: 0.0002 
ep/it:13- 170 niter:  5150  37m 15s (- 4118m 34s) completed:  0%) loss_emb: 0.0030  loss: 1.4376  acc: 0.6476  lr: 0.0002 
ep/it:13- 220 niter:  5200  37m 36s (- 4116m 51s) completed:  0%) loss_emb: 0.0029  loss: 1.4007  acc: 0.6557  lr: 0.0002 
ep/it:13- 270 niter:  5250  37m 57s (- 4116m 19s) completed:  0%) loss_emb: 0.0029  loss: 1.4203  acc: 0.6520  lr: 0.0002 
ep/it:13- 320 niter:  5300  38m 19s (- 4115m 38s) completed:  0%) loss_emb: 0.0029  loss: 1.4164  acc: 0.6534  lr: 0.0002 
ep/it:13- 370 niter:  5350  38m 40s (- 4114m 13s) completed:  0%) loss_emb: 0.0029  loss: 1.4126  acc: 0.6532  lr: 0.0002 
Validation time:
ep/it:14-  37 niter:  5400  39m 2s (- 4114m 35s) completed:  0%) loss_emb: 0.0029  loss: 1.3936  acc: 0.6580  lr: 0.0002 
ep/it:14-  87 niter:  5450  39m 23s (- 4113m 45s) completed:  0%) loss_emb: 0.0029  loss: 1.4062  acc: 0.6537  lr: 0.0002 
ep/it:14- 137 niter:  5500  39m 45s (- 4113m 18s) completed:  0%) loss_emb: 0.0029  loss: 1.4176  acc: 0.6514  lr: 0.0002 
ep/it:14- 187 niter:  5550  40m 7s (- 4112m 38s) completed:  0%) loss_emb: 0.0029  loss: 1.4007  acc: 0.6562  lr: 0.0002 
ep/it:14- 237 niter:  5600  40m 28s (- 4111m 27s) completed:  0%) loss_emb: 0.0029  loss: 1.4124  acc: 0.6535  lr: 0.0002 
ep/it:14- 287 niter:  5650  40m 49s (- 4110m 35s) completed:  0%) loss_emb: 0.0029  loss: 1.3848  acc: 0.6597  lr: 0.0002 
ep/it:14- 337 niter:  5700  41m 10s (- 4109m 32s) completed:  0%) loss_emb: 0.0030  loss: 1.4412  acc: 0.6463  lr: 0.0002 
Validation time:
ep/it:15-   4 niter:  5750  41m 33s (- 4110m 3s) completed:  1%) loss_emb: 0.0029  loss: 1.3986  acc: 0.6556  lr: 0.0002 
ep/it:15-  54 niter:  5800  41m 54s (- 4109m 30s) completed:  1%) loss_emb: 0.0029  loss: 1.3801  acc: 0.6592  lr: 0.0002 
ep/it:15- 104 niter:  5850  42m 16s (- 4109m 2s) completed:  1%) loss_emb: 0.0029  loss: 1.3943  acc: 0.6569  lr: 0.0002 
ep/it:15- 154 niter:  5900  42m 37s (- 4107m 43s) completed:  1%) loss_emb: 0.0028  loss: 1.3685  acc: 0.6626  lr: 0.0002 
ep/it:15- 204 niter:  5950  42m 58s (- 4106m 9s) completed:  1%) loss_emb: 0.0028  loss: 1.3755  acc: 0.6616  lr: 0.0002 
ep/it:15- 254 niter:  6000  43m 19s (- 4105m 17s) completed:  1%) loss_emb: 0.0029  loss: 1.4036  acc: 0.6551  lr: 0.0002 
ep/it:15- 304 niter:  6050  43m 41s (- 4105m 27s) completed:  1%) loss_emb: 0.0029  loss: 1.4054  acc: 0.6545  lr: 0.0002 
ep/it:15- 354 niter:  6100  44m 2s (- 4104m 13s) completed:  1%) loss_emb: 0.0029  loss: 1.3772  acc: 0.6599  lr: 0.0002 
Validation time:
ep/it:16-  21 niter:  6150  44m 24s (- 4104m 31s) completed:  1%) loss_emb: 0.0028  loss: 1.3676  acc: 0.6611  lr: 0.0002 
ep/it:16-  71 niter:  6200  44m 46s (- 4103m 26s) completed:  1%) loss_emb: 0.0029  loss: 1.3849  acc: 0.6573  lr: 0.0002 
ep/it:16- 121 niter:  6250  45m 6s (- 4101m 51s) completed:  1%) loss_emb: 0.0028  loss: 1.3430  acc: 0.6684  lr: 0.0002 
ep/it:16- 171 niter:  6300  45m 27s (- 4100m 21s) completed:  1%) loss_emb: 0.0029  loss: 1.3778  acc: 0.6602  lr: 0.0002 
ep/it:16- 221 niter:  6350  45m 48s (- 4098m 37s) completed:  1%) loss_emb: 0.0028  loss: 1.3283  acc: 0.6713  lr: 0.0002 
ep/it:16- 271 niter:  6400  46m 9s (- 4097m 25s) completed:  1%) loss_emb: 0.0028  loss: 1.3601  acc: 0.6636  lr: 0.0002 
ep/it:16- 321 niter:  6450  46m 30s (- 4095m 55s) completed:  1%) loss_emb: 0.0028  loss: 1.3385  acc: 0.6688  lr: 0.0002 
ep/it:16- 371 niter:  6500  46m 51s (- 4094m 4s) completed:  1%) loss_emb: 0.0029  loss: 1.3832  acc: 0.6572  lr: 0.0002 
Validation time:
ep/it:17-  38 niter:  6550  47m 12s (- 4094m 6s) completed:  1%) loss_emb: 0.0028  loss: 1.3369  acc: 0.6690  lr: 0.0002 
ep/it:17-  88 niter:  6600  47m 34s (- 4093m 18s) completed:  1%) loss_emb: 0.0028  loss: 1.3270  acc: 0.6709  lr: 0.0002 
ep/it:17- 138 niter:  6650  47m 55s (- 4092m 53s) completed:  1%) loss_emb: 0.0028  loss: 1.3668  acc: 0.6620  lr: 0.0002 
ep/it:17- 188 niter:  6700  48m 16s (- 4091m 4s) completed:  1%) loss_emb: 0.0028  loss: 1.3620  acc: 0.6638  lr: 0.0002 
ep/it:17- 238 niter:  6750  48m 37s (- 4089m 47s) completed:  1%) loss_emb: 0.0027  loss: 1.3124  acc: 0.6743  lr: 0.0002 
ep/it:17- 288 niter:  6800  48m 58s (- 4088m 49s) completed:  1%) loss_emb: 0.0028  loss: 1.3528  acc: 0.6649  lr: 0.0002 
ep/it:17- 338 niter:  6850  49m 19s (- 4087m 30s) completed:  1%) loss_emb: 0.0028  loss: 1.3362  acc: 0.6698  lr: 0.0002 
Validation time:
ep/it:18-   5 niter:  6900  49m 41s (- 4087m 8s) completed:  1%) loss_emb: 0.0028  loss: 1.3352  acc: 0.6695  lr: 0.0002 
ep/it:18-  55 niter:  6950  50m 2s (- 4085m 52s) completed:  1%) loss_emb: 0.0028  loss: 1.3370  acc: 0.6679  lr: 0.0002 
ep/it:18- 105 niter:  7000  50m 23s (- 4085m 26s) completed:  1%) loss_emb: 0.0028  loss: 1.3412  acc: 0.6677  lr: 0.0002 
ep/it:18- 155 niter:  7050  50m 45s (- 4084m 50s) completed:  1%) loss_emb: 0.0027  loss: 1.3116  acc: 0.6743  lr: 0.0002 
ep/it:18- 205 niter:  7100  51m 5s (- 4083m 34s) completed:  1%) loss_emb: 0.0027  loss: 1.3156  acc: 0.6735  lr: 0.0002 
ep/it:18- 255 niter:  7150  51m 27s (- 4082m 33s) completed:  1%) loss_emb: 0.0027  loss: 1.3161  acc: 0.6731  lr: 0.0002 
ep/it:18- 305 niter:  7200  51m 48s (- 4081m 47s) completed:  1%) loss_emb: 0.0028  loss: 1.3255  acc: 0.6714  lr: 0.0002 
ep/it:18- 355 niter:  7250  52m 9s (- 4081m 0s) completed:  1%) loss_emb: 0.0028  loss: 1.3190  acc: 0.6709  lr: 0.0002 
Validation time:
ep/it:19-  22 niter:  7300  52m 31s (- 4080m 32s) completed:  1%) loss_emb: 0.0027  loss: 1.3033  acc: 0.6759  lr: 0.0002 
ep/it:19-  72 niter:  7350  52m 51s (- 4078m 56s) completed:  1%) loss_emb: 0.0027  loss: 1.3158  acc: 0.6725  lr: 0.0002 
ep/it:19- 122 niter:  7400  53m 12s (- 4077m 53s) completed:  1%) loss_emb: 0.0027  loss: 1.3180  acc: 0.6724  lr: 0.0002 
ep/it:19- 172 niter:  7450  53m 34s (- 4077m 18s) completed:  1%) loss_emb: 0.0027  loss: 1.3153  acc: 0.6731  lr: 0.0002 
ep/it:19- 222 niter:  7500  53m 55s (- 4076m 39s) completed:  1%) loss_emb: 0.0028  loss: 1.3400  acc: 0.6674  lr: 0.0002 
ep/it:19- 272 niter:  7550  54m 16s (- 4075m 56s) completed:  1%) loss_emb: 0.0027  loss: 1.3018  acc: 0.6764  lr: 0.0002 
ep/it:19- 322 niter:  7600  54m 38s (- 4075m 19s) completed:  1%) loss_emb: 0.0027  loss: 1.3078  acc: 0.6757  lr: 0.0002 
ep/it:19- 372 niter:  7650  54m 59s (- 4074m 59s) completed:  1%) loss_emb: 0.0027  loss: 1.3109  acc: 0.6732  lr: 0.0002 
Validation time:
--> 	 Eva. Ep 20 :, FID. 9.5584, Diversity Real. 9.5995, Diversity. 6.9172, R_precision_real. [0.50598404 0.70146277 0.79720745], R_precision. [0.21675532 0.35172872 0.4581117 ], matching_score_real. 2.895113945007324, matching_score_pred. 5.52779483795166
--> --> 	 FID Improved from 9.95930 to 9.55844 !!!
--> --> 	 matching_score Improved from 6.01752 to 5.52779 !!!
--> --> 	 Top1 Improved from 0.1882 to 0.2168 !!!
--> --> 	 Top2 Improved from 0.3145 to 0.3517 !!!
--> --> 	 Top3 Improved from 0.4102 to 0.4581 !!!
ep/it:20-  39 niter:  7700  55m 37s (- 4094m 41s) completed:  1%) loss_emb: 0.0028  loss: 1.3273  acc: 0.6704  lr: 0.0002 
ep/it:20-  89 niter:  7750  55m 58s (- 4093m 48s) completed:  1%) loss_emb: 0.0027  loss: 1.2992  acc: 0.6771  lr: 0.0002 
ep/it:20- 139 niter:  7800  56m 19s (- 4092m 49s) completed:  1%) loss_emb: 0.0027  loss: 1.3035  acc: 0.6756  lr: 0.0002 
ep/it:20- 189 niter:  7850  56m 41s (- 4091m 44s) completed:  1%) loss_emb: 0.0027  loss: 1.2903  acc: 0.6788  lr: 0.0002 
ep/it:20- 239 niter:  7900  57m 2s (- 4091m 13s) completed:  1%) loss_emb: 0.0027  loss: 1.2977  acc: 0.6775  lr: 0.0002 
ep/it:20- 289 niter:  7950  57m 24s (- 4091m 1s) completed:  1%) loss_emb: 0.0027  loss: 1.2926  acc: 0.6793  lr: 0.0002 
ep/it:20- 339 niter:  8000  57m 45s (- 4090m 15s) completed:  1%) loss_emb: 0.0026  loss: 1.2537  acc: 0.6874  lr: 0.0002 
Validation time:
ep/it:21-   6 niter:  8050  58m 8s (- 4091m 16s) completed:  1%) loss_emb: 0.0027  loss: 1.3098  acc: 0.6742  lr: 0.0002 
ep/it:21-  56 niter:  8100  58m 29s (- 4090m 16s) completed:  1%) loss_emb: 0.0027  loss: 1.2816  acc: 0.6797  lr: 0.0002 
ep/it:21- 106 niter:  8150  58m 51s (- 4089m 32s) completed:  1%) loss_emb: 0.0027  loss: 1.2796  acc: 0.6808  lr: 0.0002 
ep/it:21- 156 niter:  8200  59m 12s (- 4089m 16s) completed:  1%) loss_emb: 0.0027  loss: 1.2975  acc: 0.6764  lr: 0.0002 
ep/it:21- 206 niter:  8250  59m 34s (- 4089m 0s) completed:  1%) loss_emb: 0.0027  loss: 1.3004  acc: 0.6757  lr: 0.0002 
ep/it:21- 256 niter:  8300  59m 55s (- 4088m 13s) completed:  1%) loss_emb: 0.0027  loss: 1.2722  acc: 0.6831  lr: 0.0002 
ep/it:21- 306 niter:  8350  60m 16s (- 4087m 13s) completed:  1%) loss_emb: 0.0026  loss: 1.2478  acc: 0.6884  lr: 0.0002 
ep/it:21- 356 niter:  8400  60m 38s (- 4086m 32s) completed:  1%) loss_emb: 0.0027  loss: 1.2933  acc: 0.6777  lr: 0.0002 
Validation time:
ep/it:22-  23 niter:  8450  61m 0s (- 4086m 47s) completed:  1%) loss_emb: 0.0026  loss: 1.2615  acc: 0.6844  lr: 0.0002 
ep/it:22-  73 niter:  8500  61m 22s (- 4086m 35s) completed:  1%) loss_emb: 0.0026  loss: 1.2445  acc: 0.6883  lr: 0.0002 
ep/it:22- 123 niter:  8550  61m 43s (- 4085m 59s) completed:  1%) loss_emb: 0.0026  loss: 1.2645  acc: 0.6843  lr: 0.0002 
ep/it:22- 173 niter:  8600  62m 4s (- 4085m 6s) completed:  1%) loss_emb: 0.0026  loss: 1.2487  acc: 0.6882  lr: 0.0002 
ep/it:22- 223 niter:  8650  62m 25s (- 4084m 2s) completed:  1%) loss_emb: 0.0026  loss: 1.2470  acc: 0.6885  lr: 0.0002 
ep/it:22- 273 niter:  8700  62m 47s (- 4083m 36s) completed:  1%) loss_emb: 0.0027  loss: 1.2634  acc: 0.6838  lr: 0.0002 
ep/it:22- 323 niter:  8750  63m 8s (- 4082m 44s) completed:  1%) loss_emb: 0.0027  loss: 1.2789  acc: 0.6811  lr: 0.0002 
ep/it:22- 373 niter:  8800  63m 29s (- 4081m 46s) completed:  1%) loss_emb: 0.0027  loss: 1.2734  acc: 0.6822  lr: 0.0002 
Validation time:
ep/it:23-  40 niter:  8850  63m 52s (- 4082m 15s) completed:  1%) loss_emb: 0.0027  loss: 1.2723  acc: 0.6811  lr: 0.0002 
ep/it:23-  90 niter:  8900  64m 13s (- 4081m 24s) completed:  1%) loss_emb: 0.0026  loss: 1.2533  acc: 0.6868  lr: 0.0002 
ep/it:23- 140 niter:  8950  64m 34s (- 4080m 48s) completed:  1%) loss_emb: 0.0026  loss: 1.2626  acc: 0.6833  lr: 0.0002 
ep/it:23- 190 niter:  9000  64m 55s (- 4079m 54s) completed:  1%) loss_emb: 0.0026  loss: 1.2528  acc: 0.6865  lr: 0.0002 
ep/it:23- 240 niter:  9050  65m 17s (- 4079m 15s) completed:  1%) loss_emb: 0.0026  loss: 1.2671  acc: 0.6836  lr: 0.0002 
ep/it:23- 290 niter:  9100  65m 38s (- 4078m 55s) completed:  1%) loss_emb: 0.0026  loss: 1.2501  acc: 0.6866  lr: 0.0002 
ep/it:23- 340 niter:  9150  66m 0s (- 4077m 59s) completed:  1%) loss_emb: 0.0026  loss: 1.2260  acc: 0.6920  lr: 0.0002 
Validation time:
ep/it:24-   7 niter:  9200  66m 22s (- 4078m 27s) completed:  1%) loss_emb: 0.0026  loss: 1.2588  acc: 0.6847  lr: 0.0002 
ep/it:24-  57 niter:  9250  66m 43s (- 4077m 34s) completed:  1%) loss_emb: 0.0026  loss: 1.2358  acc: 0.6893  lr: 0.0002 
ep/it:24- 107 niter:  9300  67m 5s (- 4077m 22s) completed:  1%) loss_emb: 0.0026  loss: 1.2433  acc: 0.6886  lr: 0.0002 
ep/it:24- 157 niter:  9350  67m 27s (- 4076m 56s) completed:  1%) loss_emb: 0.0027  loss: 1.2701  acc: 0.6821  lr: 0.0002 
ep/it:24- 207 niter:  9400  67m 48s (- 4076m 26s) completed:  1%) loss_emb: 0.0026  loss: 1.2559  acc: 0.6859  lr: 0.0002 
ep/it:24- 257 niter:  9450  68m 10s (- 4076m 7s) completed:  1%) loss_emb: 0.0026  loss: 1.2273  acc: 0.6912  lr: 0.0002 
ep/it:24- 307 niter:  9500  68m 31s (- 4075m 43s) completed:  1%) loss_emb: 0.0026  loss: 1.2297  acc: 0.6919  lr: 0.0002 
ep/it:24- 357 niter:  9550  68m 53s (- 4075m 15s) completed:  1%) loss_emb: 0.0026  loss: 1.2366  acc: 0.6912  lr: 0.0002 
Validation time:
ep/it:25-  24 niter:  9600  69m 15s (- 4075m 10s) completed:  1%) loss_emb: 0.0026  loss: 1.2397  acc: 0.6888  lr: 0.0002 
ep/it:25-  74 niter:  9650  69m 37s (- 4074m 58s) completed:  1%) loss_emb: 0.0026  loss: 1.2273  acc: 0.6915  lr: 0.0002 
ep/it:25- 124 niter:  9700  69m 59s (- 4074m 58s) completed:  1%) loss_emb: 0.0026  loss: 1.2263  acc: 0.6909  lr: 0.0002 
ep/it:25- 174 niter:  9750  70m 19s (- 4073m 53s) completed:  1%) loss_emb: 0.0026  loss: 1.2589  acc: 0.6852  lr: 0.0002 
ep/it:25- 224 niter:  9800  70m 41s (- 4073m 10s) completed:  1%) loss_emb: 0.0026  loss: 1.2179  acc: 0.6943  lr: 0.0002 
ep/it:25- 274 niter:  9850  71m 2s (- 4072m 37s) completed:  1%) loss_emb: 0.0026  loss: 1.2229  acc: 0.6930  lr: 0.0002 
ep/it:25- 324 niter:  9900  71m 23s (- 4071m 45s) completed:  1%) loss_emb: 0.0026  loss: 1.2360  acc: 0.6895  lr: 0.0002 
ep/it:25- 374 niter:  9950  71m 45s (- 4071m 12s) completed:  1%) loss_emb: 0.0026  loss: 1.2220  acc: 0.6931  lr: 0.0002 
Validation time:
ep/it:26-  41 niter: 10000  72m 7s (- 4071m 31s) completed:  1%) loss_emb: 0.0026  loss: 1.2136  acc: 0.6944  lr: 0.0002 
ep/it:26-  91 niter: 10050  72m 29s (- 4071m 27s) completed:  1%) loss_emb: 0.0027  loss: 1.2774  acc: 0.6802  lr: 0.0002 
ep/it:26- 141 niter: 10100  72m 50s (- 4070m 44s) completed:  1%) loss_emb: 0.0026  loss: 1.2483  acc: 0.6864  lr: 0.0002 
ep/it:26- 191 niter: 10150  73m 12s (- 4070m 8s) completed:  1%) loss_emb: 0.0025  loss: 1.2011  acc: 0.6980  lr: 0.0002 
ep/it:26- 241 niter: 10200  73m 33s (- 4069m 29s) completed:  1%) loss_emb: 0.0026  loss: 1.2270  acc: 0.6923  lr: 0.0002 
ep/it:26- 291 niter: 10250  73m 55s (- 4069m 12s) completed:  1%) loss_emb: 0.0026  loss: 1.2105  acc: 0.6950  lr: 0.0002 
ep/it:26- 341 niter: 10300  74m 16s (- 4068m 25s) completed:  1%) loss_emb: 0.0026  loss: 1.2131  acc: 0.6953  lr: 0.0002 
Validation time:
ep/it:27-   8 niter: 10350  74m 38s (- 4068m 15s) completed:  1%) loss_emb: 0.0026  loss: 1.2290  acc: 0.6914  lr: 0.0002 
ep/it:27-  58 niter: 10400  74m 59s (- 4067m 14s) completed:  1%) loss_emb: 0.0026  loss: 1.2132  acc: 0.6939  lr: 0.0002 
ep/it:27- 108 niter: 10450  75m 20s (- 4066m 32s) completed:  1%) loss_emb: 0.0025  loss: 1.1912  acc: 0.7000  lr: 0.0002 
ep/it:27- 158 niter: 10500  75m 41s (- 4065m 57s) completed:  1%) loss_emb: 0.0026  loss: 1.2205  acc: 0.6926  lr: 0.0002 
ep/it:27- 208 niter: 10550  76m 3s (- 4065m 45s) completed:  1%) loss_emb: 0.0026  loss: 1.2261  acc: 0.6916  lr: 0.0002 
ep/it:27- 258 niter: 10600  76m 25s (- 4065m 39s) completed:  1%) loss_emb: 0.0026  loss: 1.2333  acc: 0.6900  lr: 0.0002 
ep/it:27- 308 niter: 10650  76m 46s (- 4064m 53s) completed:  1%) loss_emb: 0.0026  loss: 1.2289  acc: 0.6904  lr: 0.0002 
ep/it:27- 358 niter: 10700  77m 7s (- 4064m 16s) completed:  1%) loss_emb: 0.0026  loss: 1.2136  acc: 0.6943  lr: 0.0002 
Validation time:
ep/it:28-  25 niter: 10750  77m 30s (- 4064m 38s) completed:  1%) loss_emb: 0.0025  loss: 1.2131  acc: 0.6936  lr: 0.0002 
ep/it:28-  75 niter: 10800  77m 52s (- 4064m 14s) completed:  1%) loss_emb: 0.0025  loss: 1.2115  acc: 0.6948  lr: 0.0002 
ep/it:28- 125 niter: 10850  78m 13s (- 4063m 47s) completed:  1%) loss_emb: 0.0025  loss: 1.1938  acc: 0.6981  lr: 0.0002 
ep/it:28- 175 niter: 10900  78m 34s (- 4063m 11s) completed:  1%) loss_emb: 0.0026  loss: 1.2484  acc: 0.6866  lr: 0.0002 
ep/it:28- 225 niter: 10950  78m 57s (- 4063m 26s) completed:  1%) loss_emb: 0.0025  loss: 1.2050  acc: 0.6968  lr: 0.0002 
ep/it:28- 275 niter: 11000  79m 18s (- 4062m 58s) completed:  1%) loss_emb: 0.0025  loss: 1.1854  acc: 0.7004  lr: 0.0002 
ep/it:28- 325 niter: 11050  79m 40s (- 4062m 28s) completed:  1%) loss_emb: 0.0025  loss: 1.1789  acc: 0.7031  lr: 0.0002 
ep/it:28- 375 niter: 11100  80m 1s (- 4061m 51s) completed:  1%) loss_emb: 0.0026  loss: 1.2163  acc: 0.6923  lr: 0.0002 
Validation time:
ep/it:29-  42 niter: 11150  80m 23s (- 4061m 51s) completed:  1%) loss_emb: 0.0025  loss: 1.2000  acc: 0.6975  lr: 0.0002 
ep/it:29-  92 niter: 11200  80m 45s (- 4061m 25s) completed:  1%) loss_emb: 0.0025  loss: 1.1861  acc: 0.7008  lr: 0.0002 
ep/it:29- 142 niter: 11250  81m 7s (- 4061m 14s) completed:  1%) loss_emb: 0.0026  loss: 1.2209  acc: 0.6926  lr: 0.0002 
ep/it:29- 192 niter: 11300  81m 28s (- 4060m 38s) completed:  1%) loss_emb: 0.0025  loss: 1.1991  acc: 0.6983  lr: 0.0002 
ep/it:29- 242 niter: 11350  81m 49s (- 4059m 49s) completed:  1%) loss_emb: 0.0025  loss: 1.2017  acc: 0.6967  lr: 0.0002 
ep/it:29- 292 niter: 11400  82m 10s (- 4058m 55s) completed:  1%) loss_emb: 0.0025  loss: 1.1932  acc: 0.6987  lr: 0.0002 
ep/it:29- 342 niter: 11450  82m 31s (- 4058m 32s) completed:  1%) loss_emb: 0.0025  loss: 1.1818  acc: 0.7009  lr: 0.0002 
Validation time:
--> 	 Eva. Ep 30 :, FID. 9.9971, Diversity Real. 9.3632, Diversity. 7.3107, R_precision_real. [0.5099734  0.6974734  0.79787234], R_precision. [0.23869681 0.39295213 0.49867021], matching_score_real. 2.9328765869140625, matching_score_pred. 5.250527381896973
--> --> 	 matching_score Improved from 5.52779 to 5.25053 !!!
--> --> 	 Diversity Improved from 7.09381 to 7.31065 !!!
--> --> 	 Top1 Improved from 0.2168 to 0.2387 !!!
--> --> 	 Top2 Improved from 0.3517 to 0.3930 !!!
--> --> 	 Top3 Improved from 0.4581 to 0.4987 !!!
ep/it:30-   9 niter: 11500  83m 9s (- 4071m 4s) completed:  2%) loss_emb: 0.0026  loss: 1.2211  acc: 0.6920  lr: 0.0002 
ep/it:30-  59 niter: 11550  83m 30s (- 4070m 32s) completed:  2%) loss_emb: 0.0025  loss: 1.1960  acc: 0.6966  lr: 0.0002 
ep/it:30- 109 niter: 11600  83m 52s (- 4070m 10s) completed:  2%) loss_emb: 0.0025  loss: 1.1899  acc: 0.7001  lr: 0.0002 
ep/it:30- 159 niter: 11650  84m 13s (- 4069m 34s) completed:  2%) loss_emb: 0.0025  loss: 1.1996  acc: 0.6973  lr: 0.0002 
ep/it:30- 209 niter: 11700  84m 35s (- 4068m 40s) completed:  2%) loss_emb: 0.0025  loss: 1.2085  acc: 0.6953  lr: 0.0002 
ep/it:30- 259 niter: 11750  84m 56s (- 4067m 54s) completed:  2%) loss_emb: 0.0025  loss: 1.1823  acc: 0.7010  lr: 0.0002 
ep/it:30- 309 niter: 11800  85m 17s (- 4066m 59s) completed:  2%) loss_emb: 0.0025  loss: 1.1908  acc: 0.6989  lr: 0.0002 
ep/it:30- 359 niter: 11850  85m 38s (- 4066m 12s) completed:  2%) loss_emb: 0.0025  loss: 1.1973  acc: 0.6974  lr: 0.0002 
Validation time:
ep/it:31-  26 niter: 11900  86m 0s (- 4065m 53s) completed:  2%) loss_emb: 0.0025  loss: 1.1924  acc: 0.6986  lr: 0.0002 
ep/it:31-  76 niter: 11950  86m 21s (- 4065m 16s) completed:  2%) loss_emb: 0.0025  loss: 1.1829  acc: 0.7011  lr: 0.0002 
ep/it:31- 126 niter: 12000  86m 42s (- 4064m 34s) completed:  2%) loss_emb: 0.0025  loss: 1.2052  acc: 0.6955  lr: 0.0002 
ep/it:31- 176 niter: 12050  87m 4s (- 4064m 1s) completed:  2%) loss_emb: 0.0025  loss: 1.1946  acc: 0.6974  lr: 0.0002 
ep/it:31- 226 niter: 12100  87m 25s (- 4063m 21s) completed:  2%) loss_emb: 0.0025  loss: 1.1629  acc: 0.7041  lr: 0.0002 
ep/it:31- 276 niter: 12150  87m 46s (- 4062m 35s) completed:  2%) loss_emb: 0.0025  loss: 1.2028  acc: 0.6957  lr: 0.0002 
ep/it:31- 326 niter: 12200  88m 8s (- 4062m 31s) completed:  2%) loss_emb: 0.0025  loss: 1.1917  acc: 0.6984  lr: 0.0002 
ep/it:31- 376 niter: 12250  88m 29s (- 4061m 41s) completed:  2%) loss_emb: 0.0025  loss: 1.1675  acc: 0.7047  lr: 0.0002 
Validation time:
ep/it:32-  43 niter: 12300  88m 51s (- 4061m 47s) completed:  2%) loss_emb: 0.0025  loss: 1.1652  acc: 0.7052  lr: 0.0002 
ep/it:32-  93 niter: 12350  89m 13s (- 4061m 17s) completed:  2%) loss_emb: 0.0025  loss: 1.1590  acc: 0.7050  lr: 0.0002 
ep/it:32- 143 niter: 12400  89m 34s (- 4060m 34s) completed:  2%) loss_emb: 0.0025  loss: 1.1973  acc: 0.6974  lr: 0.0002 
ep/it:32- 193 niter: 12450  89m 56s (- 4060m 4s) completed:  2%) loss_emb: 0.0025  loss: 1.1858  acc: 0.6995  lr: 0.0002 
ep/it:32- 243 niter: 12500  90m 17s (- 4059m 22s) completed:  2%) loss_emb: 0.0025  loss: 1.1892  acc: 0.6993  lr: 0.0002 
ep/it:32- 293 niter: 12550  90m 39s (- 4059m 2s) completed:  2%) loss_emb: 0.0025  loss: 1.1809  acc: 0.7005  lr: 0.0002 
ep/it:32- 343 niter: 12600  91m 0s (- 4058m 25s) completed:  2%) loss_emb: 0.0025  loss: 1.1761  acc: 0.7027  lr: 0.0002 
Validation time:
ep/it:33-  10 niter: 12650  91m 22s (- 4058m 35s) completed:  2%) loss_emb: 0.0025  loss: 1.1698  acc: 0.7031  lr: 0.0002 
ep/it:33-  60 niter: 12700  91m 44s (- 4058m 8s) completed:  2%) loss_emb: 0.0025  loss: 1.1919  acc: 0.6983  lr: 0.0002 
ep/it:33- 110 niter: 12750  92m 5s (- 4057m 28s) completed:  2%) loss_emb: 0.0025  loss: 1.1764  acc: 0.7023  lr: 0.0002 
ep/it:33- 160 niter: 12800  92m 27s (- 4056m 58s) completed:  2%) loss_emb: 0.0024  loss: 1.1568  acc: 0.7062  lr: 0.0002 
ep/it:33- 210 niter: 12850  92m 47s (- 4056m 0s) completed:  2%) loss_emb: 0.0025  loss: 1.1804  acc: 0.7006  lr: 0.0002 
ep/it:33- 260 niter: 12900  93m 9s (- 4055m 29s) completed:  2%) loss_emb: 0.0024  loss: 1.1526  acc: 0.7069  lr: 0.0002 
ep/it:33- 310 niter: 12950  93m 30s (- 4054m 49s) completed:  2%) loss_emb: 0.0025  loss: 1.1646  acc: 0.7045  lr: 0.0002 
ep/it:33- 360 niter: 13000  93m 51s (- 4054m 13s) completed:  2%) loss_emb: 0.0025  loss: 1.1684  acc: 0.7030  lr: 0.0002 
Validation time: