File size: 108,526 Bytes
c7b14e3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 | 2026-08-08T22:15:11-07:00 serving outputs/release/healed/release-offpolicy-math-keep75/step0150 on GPU 0 port 8460 (pp=1 think=template-default)
2026-08-08T22:15:11-07:00 waiting for server /health ...
2026-08-08T22:15:41-07:00 server up; chat pass [gsm8k_cot_zeroshot,minerva_math500,ifeval]
2026-08-08:22:15:49 INFO [_cli.run:388] Selected Tasks: ['gsm8k_cot_zeroshot', 'minerva_math500', 'ifeval']
2026-08-08:22:15:50 INFO [evaluator:214] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2026-08-08:22:15:50 WARNING [evaluator:226] generation_kwargs: {'max_gen_toks': 1280} specified through cli, these settings will update set parameters in yaml tasks. Ensure 'do_sample=True' for non-greedy decoding!
2026-08-08:22:15:50 INFO [evaluator:239] Initializing local-chat-completions model, with arguments: {'model': 'student', 'base_url': 'http://127.0.0.1:8460/v1/chat/completions', 'num_concurrent': 48, 'tokenized_requests': False, 'max_retries': 3}
2026-08-08:22:15:50 INFO [models.api_models:179] Using max length 2048 - 1
2026-08-08:22:15:50 INFO [models.api_models:200] Using tokenizer None
2026-08-08:22:15:55 INFO [evaluator_utils:446] Selected tasks:
2026-08-08:22:15:55 INFO [evaluator_utils:480] Task: gsm8k_cot_zeroshot (gsm8k/gsm8k-cot-zeroshot.yaml)
2026-08-08:22:15:55 INFO [evaluator_utils:480] Task: ifeval (ifeval/ifeval.yaml)
2026-08-08:22:15:55 INFO [evaluator_utils:480] Task: minerva_math500 (minerva_math/minerva_math500.yaml)
2026-08-08:22:15:55 INFO [evaluator:314] gsm8k_cot_zeroshot: Using gen_kwargs: {'until': ['Q:', '</s>', '<|im_end|>'], 'do_sample': False, 'max_gen_toks': 1280}
2026-08-08:22:15:55 INFO [evaluator:314] minerva_math500: Using gen_kwargs: {'until': ['Problem:'], 'do_sample': False, 'temperature': 0.0, 'max_gen_toks': 1280}
2026-08-08:22:15:55 INFO [evaluator:314] ifeval: Using gen_kwargs: {'until': [], 'do_sample': False, 'temperature': 0.0, 'max_gen_toks': 1280}
2026-08-08:22:15:55 INFO [api.task:312] Building contexts for gsm8k_cot_zeroshot on rank 0...
0%| | 0/1319 [00:00<?, ?it/s]
14%|โโ | 190/1319 [00:00<00:00, 1899.80it/s]
29%|โโโ | 385/1319 [00:00<00:00, 1924.81it/s]
44%|โโโโโ | 581/1319 [00:00<00:00, 1937.61it/s]
59%|โโโโโโ | 777/1319 [00:00<00:00, 1944.22it/s]
74%|โโโโโโโโ | 973/1319 [00:00<00:00, 1947.14it/s]
89%|โโโโโโโโโ | 1169/1319 [00:00<00:00, 1949.65it/s]
100%|โโโโโโโโโโ| 1319/1319 [00:00<00:00, 1944.45it/s]
2026-08-08:22:15:56 INFO [api.task:312] Building contexts for minerva_math500 on rank 0...
0%| | 0/500 [00:00<?, ?it/s]
8%|โ | 41/500 [00:00<00:01, 409.25it/s]
17%|โโ | 83/500 [00:00<00:01, 415.00it/s]
25%|โโโ | 126/500 [00:00<00:00, 417.85it/s]
34%|โโโโ | 169/500 [00:00<00:00, 420.10it/s]
42%|โโโโโ | 212/500 [00:00<00:00, 422.25it/s]
51%|โโโโโ | 255/500 [00:00<00:00, 422.68it/s]
60%|โโโโโโ | 298/500 [00:00<00:00, 423.28it/s]
68%|โโโโโโโ | 341/500 [00:00<00:00, 423.98it/s]
77%|โโโโโโโโ | 384/500 [00:00<00:00, 425.05it/s]
85%|โโโโโโโโโ | 427/500 [00:01<00:00, 425.60it/s]
94%|โโโโโโโโโโ| 470/500 [00:01<00:00, 425.61it/s]
100%|โโโโโโโโโโ| 500/500 [00:01<00:00, 423.15it/s]
2026-08-08:22:15:57 INFO [api.task:312] Building contexts for ifeval on rank 0...
0%| | 0/541 [00:00<?, ?it/s]
100%|โโโโโโโโโโ| 541/541 [00:00<00:00, 70741.94it/s]
2026-08-08:22:15:57 INFO [evaluator:585] Running generate_until requests
2026-08-08:22:15:57 INFO [models.api_models:747] Tokenized requests are disabled. Context + generation length is not checked.
Requesting API: 0%| | 0/1319 [00:00<?, ?it/s]
Requesting API: 0%| | 1/1319 [00:01<22:18, 1.02s/it]
Requesting API: 0%| | 2/1319 [00:01<16:41, 1.31it/s]
Requesting API: 0%| | 4/1319 [00:02<09:07, 2.40it/s]
Requesting API: 0%| | 5/1319 [00:02<07:08, 3.07it/s]
Requesting API: 1%| | 8/1319 [00:02<04:28, 4.88it/s]
Requesting API: 1%| | 13/1319 [00:02<02:12, 9.86it/s]
Requesting API: 1%|โ | 19/1319 [00:02<01:22, 15.69it/s]
Requesting API: 2%|โ | 22/1319 [00:02<01:17, 16.71it/s]
Requesting API: 2%|โ | 26/1319 [00:03<01:23, 15.43it/s]
Requesting API: 2%|โ | 30/1319 [00:03<01:24, 15.31it/s]
Requesting API: 3%|โ | 33/1319 [00:03<01:17, 16.66it/s]
Requesting API: 3%|โ | 36/1319 [00:03<01:08, 18.70it/s]
Requesting API: 3%|โ | 39/1319 [00:03<01:16, 16.78it/s]
Requesting API: 3%|โ | 42/1319 [00:04<01:07, 18.82it/s]
Requesting API: 3%|โ | 46/1319 [00:04<00:55, 22.86it/s]
Requesting API: 4%|โ | 49/1319 [00:04<01:07, 18.69it/s]
Requesting API: 4%|โ | 55/1319 [00:04<00:53, 23.44it/s]
Requesting API: 4%|โ | 58/1319 [00:04<00:56, 22.16it/s]
Requesting API: 5%|โ | 62/1319 [00:04<00:50, 25.09it/s]
Requesting API: 5%|โ | 67/1319 [00:05<00:50, 24.79it/s]
Requesting API: 5%|โ | 71/1319 [00:05<00:49, 25.32it/s]
Requesting API: 6%|โ | 75/1319 [00:05<00:45, 27.44it/s]
Requesting API: 6%|โ | 78/1319 [00:05<01:11, 17.32it/s]
Requesting API: 6%|โ | 82/1319 [00:05<01:00, 20.59it/s]
Requesting API: 6%|โ | 85/1319 [00:05<00:56, 21.92it/s]
Requesting API: 7%|โ | 88/1319 [00:06<00:53, 23.08it/s]
Requesting API: 7%|โ | 92/1319 [00:06<00:49, 24.81it/s]
Requesting API: 8%|โ | 99/1319 [00:06<00:40, 29.97it/s]
Requesting API: 8%|โ | 103/1319 [00:06<00:42, 28.89it/s]
Requesting API: 8%|โ | 106/1319 [00:06<00:49, 24.71it/s]
Requesting API: 8%|โ | 109/1319 [00:06<00:49, 24.63it/s]
Requesting API: 8%|โ | 112/1319 [00:06<00:48, 24.95it/s]
Requesting API: 9%|โ | 115/1319 [00:07<00:49, 24.56it/s]
Requesting API: 9%|โ | 118/1319 [00:07<00:50, 23.86it/s]
Requesting API: 9%|โ | 123/1319 [00:07<00:51, 23.29it/s]
Requesting API: 10%|โ | 126/1319 [00:07<00:56, 21.08it/s]
Requesting API: 10%|โ | 129/1319 [00:07<00:58, 20.18it/s]
Requesting API: 10%|โ | 132/1319 [00:07<00:54, 21.80it/s]
Requesting API: 10%|โ | 135/1319 [00:08<01:13, 16.16it/s]
Requesting API: 10%|โ | 138/1319 [00:08<01:05, 18.16it/s]
Requesting API: 11%|โ | 141/1319 [00:08<01:01, 19.18it/s]
Requesting API: 11%|โ | 146/1319 [00:08<00:47, 24.94it/s]
Requesting API: 11%|โโ | 150/1319 [00:08<00:42, 27.19it/s]
Requesting API: 12%|โโ | 156/1319 [00:08<00:37, 30.96it/s]
Requesting API: 12%|โโ | 160/1319 [00:09<00:50, 23.01it/s]
Requesting API: 12%|โโ | 164/1319 [00:09<00:55, 20.81it/s]
Requesting API: 13%|โโ | 170/1319 [00:09<00:45, 25.32it/s]
Requesting API: 13%|โโ | 173/1319 [00:09<00:48, 23.48it/s]
Requesting API: 13%|โโ | 176/1319 [00:09<00:48, 23.43it/s]
Requesting API: 14%|โโ | 179/1319 [00:10<00:58, 19.38it/s]
Requesting API: 14%|โโ | 183/1319 [00:10<00:54, 21.01it/s]
Requesting API: 14%|โโ | 186/1319 [00:10<00:59, 19.02it/s]
Requesting API: 14%|โโ | 189/1319 [00:10<00:54, 20.83it/s]
Requesting API: 15%|โโ | 192/1319 [00:10<00:52, 21.37it/s]
Requesting API: 15%|โโ | 195/1319 [00:10<01:04, 17.39it/s]
Requesting API: 15%|โโ | 202/1319 [00:10<00:43, 25.47it/s]
Requesting API: 16%|โโ | 205/1319 [00:11<00:44, 24.93it/s]
Requesting API: 16%|โโ | 209/1319 [00:11<00:45, 24.55it/s]
Requesting API: 16%|โโ | 212/1319 [00:11<00:47, 23.38it/s]
Requesting API: 16%|โโ | 215/1319 [00:11<00:48, 22.54it/s]
Requesting API: 17%|โโ | 219/1319 [00:11<00:44, 24.92it/s]
Requesting API: 17%|โโ | 222/1319 [00:11<00:51, 21.15it/s]
Requesting API: 17%|โโ | 225/1319 [00:12<00:50, 21.67it/s]
Requesting API: 17%|โโ | 230/1319 [00:12<00:40, 26.97it/s]
Requesting API: 18%|โโ | 233/1319 [00:12<00:42, 25.69it/s]
Requesting API: 18%|โโ | 236/1319 [00:12<00:46, 23.32it/s]
Requesting API: 18%|โโ | 240/1319 [00:12<00:44, 24.42it/s]
Requesting API: 18%|โโ | 243/1319 [00:12<00:44, 24.26it/s]
Requesting API: 19%|โโ | 246/1319 [00:12<00:53, 20.01it/s]
Requesting API: 19%|โโ | 249/1319 [00:13<00:51, 20.84it/s]
Requesting API: 19%|โโ | 252/1319 [00:13<01:00, 17.63it/s]
Requesting API: 20%|โโ | 258/1319 [00:13<00:42, 25.14it/s]
Requesting API: 20%|โโ | 264/1319 [00:13<00:35, 29.65it/s]
Requesting API: 20%|โโ | 268/1319 [00:13<00:35, 29.20it/s]
Requesting API: 21%|โโ | 272/1319 [00:13<00:43, 24.19it/s]
Requesting API: 21%|โโ | 275/1319 [00:14<00:52, 19.83it/s]
Requesting API: 21%|โโ | 278/1319 [00:14<00:49, 21.24it/s]
Requesting API: 21%|โโโ | 281/1319 [00:14<00:49, 20.98it/s]
Requesting API: 22%|โโโ | 284/1319 [00:14<00:46, 22.47it/s]
Requesting API: 22%|โโโ | 287/1319 [00:14<00:59, 17.47it/s]
Requesting API: 22%|โโโ | 292/1319 [00:14<00:45, 22.33it/s]
Requesting API: 22%|โโโ | 295/1319 [00:15<00:43, 23.48it/s]
Requesting API: 23%|โโโ | 298/1319 [00:15<00:55, 18.50it/s]
Requesting API: 23%|โโโ | 304/1319 [00:15<00:39, 25.69it/s]
Requesting API: 23%|โโโ | 308/1319 [00:15<00:41, 24.17it/s]
Requesting API: 24%|โโโ | 311/1319 [00:15<00:54, 18.37it/s]
Requesting API: 24%|โโโ | 314/1319 [00:16<00:52, 19.21it/s]
Requesting API: 24%|โโโ | 317/1319 [00:16<00:51, 19.35it/s]
Requesting API: 24%|โโโ | 320/1319 [00:16<00:58, 16.96it/s]
Requesting API: 24%|โโโ | 323/1319 [00:16<01:02, 15.81it/s]
Requesting API: 25%|โโโ | 328/1319 [00:16<00:46, 21.35it/s]
Requesting API: 25%|โโโ | 331/1319 [00:16<00:47, 20.81it/s]
Requesting API: 25%|โโโ | 334/1319 [00:17<00:59, 16.66it/s]
Requesting API: 26%|โโโ | 338/1319 [00:17<00:54, 18.12it/s]
Requesting API: 26%|โโโ | 342/1319 [00:17<00:48, 20.21it/s]
Requesting API: 26%|โโโ | 345/1319 [00:17<00:46, 20.86it/s]
Requesting API: 26%|โโโ | 349/1319 [00:17<00:41, 23.15it/s]
Requesting API: 27%|โโโ | 352/1319 [00:17<00:44, 21.56it/s]
Requesting API: 27%|โโโ | 356/1319 [00:18<00:38, 24.74it/s]
Requesting API: 27%|โโโ | 360/1319 [00:18<00:38, 25.00it/s]
Requesting API: 28%|โโโ | 364/1319 [00:18<00:34, 27.55it/s]
Requesting API: 28%|โโโ | 367/1319 [00:18<00:45, 21.12it/s]
Requesting API: 28%|โโโ | 370/1319 [00:18<00:44, 21.53it/s]
Requesting API: 28%|โโโ | 374/1319 [00:18<00:38, 24.70it/s]
Requesting API: 29%|โโโ | 377/1319 [00:19<00:43, 21.77it/s]
Requesting API: 29%|โโโ | 380/1319 [00:19<00:46, 20.34it/s]
Requesting API: 29%|โโโ | 383/1319 [00:19<01:09, 13.41it/s]
Requesting API: 29%|โโโ | 387/1319 [00:19<00:54, 17.05it/s]
Requesting API: 30%|โโโ | 391/1319 [00:19<00:45, 20.59it/s]
Requesting API: 30%|โโโ | 395/1319 [00:19<00:39, 23.33it/s]
Requesting API: 30%|โโโ | 399/1319 [00:20<00:35, 25.75it/s]
Requesting API: 30%|โโโ | 402/1319 [00:20<00:41, 22.14it/s]
Requesting API: 31%|โโโ | 405/1319 [00:20<00:40, 22.39it/s]
Requesting API: 31%|โโโ | 408/1319 [00:20<00:44, 20.37it/s]
Requesting API: 31%|โโโโ | 414/1319 [00:20<00:34, 26.35it/s]
Requesting API: 32%|โโโโ | 417/1319 [00:21<00:49, 18.30it/s]
Requesting API: 32%|โโโโ | 420/1319 [00:21<00:59, 15.21it/s]
Requesting API: 32%|โโโโ | 423/1319 [00:21<00:51, 17.29it/s]
Requesting API: 32%|โโโโ | 427/1319 [00:21<00:43, 20.69it/s]
Requesting API: 33%|โโโโ | 430/1319 [00:21<00:46, 19.18it/s]
Requesting API: 33%|โโโโ | 437/1319 [00:21<00:32, 26.92it/s]
Requesting API: 33%|โโโโ | 441/1319 [00:22<00:35, 24.96it/s]
Requesting API: 34%|โโโโ | 445/1319 [00:22<00:33, 26.36it/s]
Requesting API: 34%|โโโโ | 448/1319 [00:22<00:35, 24.77it/s]
Requesting API: 34%|โโโโ | 451/1319 [00:22<00:38, 22.55it/s]
Requesting API: 34%|โโโโ | 455/1319 [00:22<00:36, 23.62it/s]
Requesting API: 35%|โโโโ | 459/1319 [00:23<00:49, 17.27it/s]
Requesting API: 35%|โโโโ | 465/1319 [00:23<00:38, 22.14it/s]
Requesting API: 36%|โโโโ | 469/1319 [00:23<00:34, 24.70it/s]
Requesting API: 36%|โโโโ | 472/1319 [00:23<00:33, 25.23it/s]
Requesting API: 36%|โโโโ | 475/1319 [00:23<00:32, 25.59it/s]
Requesting API: 36%|โโโโ | 478/1319 [00:23<00:31, 26.56it/s]
Requesting API: 37%|โโโโ | 484/1319 [00:23<00:27, 30.03it/s]
Requesting API: 37%|โโโโ | 489/1319 [00:24<00:33, 24.47it/s]
Requesting API: 37%|โโโโ | 494/1319 [00:24<00:29, 27.55it/s]
Requesting API: 38%|โโโโ | 498/1319 [00:24<00:32, 25.47it/s]
Requesting API: 38%|โโโโ | 501/1319 [00:24<00:34, 23.37it/s]
Requesting API: 38%|โโโโ | 504/1319 [00:24<00:33, 24.03it/s]
Requesting API: 38%|โโโโ | 507/1319 [00:24<00:34, 23.48it/s]
Requesting API: 39%|โโโโ | 510/1319 [00:24<00:36, 22.46it/s]
Requesting API: 39%|โโโโ | 513/1319 [00:25<00:41, 19.63it/s]
Requesting API: 39%|โโโโ | 516/1319 [00:25<00:40, 19.90it/s]
Requesting API: 39%|โโโโ | 519/1319 [00:25<00:42, 18.62it/s]
Requesting API: 40%|โโโโ | 523/1319 [00:25<00:43, 18.33it/s]
Requesting API: 40%|โโโโ | 527/1319 [00:25<00:37, 21.05it/s]
Requesting API: 40%|โโโโ | 530/1319 [00:26<00:43, 18.19it/s]
Requesting API: 40%|โโโโ | 532/1319 [00:26<00:43, 18.11it/s]
Requesting API: 41%|โโโโ | 539/1319 [00:26<00:29, 26.46it/s]
Requesting API: 41%|โโโโ | 544/1319 [00:26<00:25, 30.21it/s]
Requesting API: 42%|โโโโโ | 548/1319 [00:26<00:25, 29.90it/s]
Requesting API: 42%|โโโโโ | 554/1319 [00:26<00:22, 34.11it/s]
Requesting API: 42%|โโโโโ | 558/1319 [00:26<00:27, 27.31it/s]
Requesting API: 43%|โโโโโ | 561/1319 [00:27<00:28, 26.14it/s]
Requesting API: 43%|โโโโโ | 564/1319 [00:27<00:33, 22.71it/s]
Requesting API: 43%|โโโโโ | 568/1319 [00:27<00:40, 18.77it/s]
Requesting API: 43%|โโโโโ | 571/1319 [00:27<00:40, 18.49it/s]
Requesting API: 44%|โโโโโ | 574/1319 [00:28<00:49, 14.92it/s]
Requesting API: 44%|โโโโโ | 579/1319 [00:28<00:39, 18.84it/s]
Requesting API: 44%|โโโโโ | 585/1319 [00:28<00:31, 23.53it/s]
Requesting API: 45%|โโโโโ | 589/1319 [00:28<00:35, 20.51it/s]
Requesting API: 45%|โโโโโ | 592/1319 [00:28<00:36, 19.89it/s]
Requesting API: 45%|โโโโโ | 595/1319 [00:28<00:36, 19.69it/s]
Requesting API: 45%|โโโโโ | 599/1319 [00:29<00:33, 21.34it/s]
Requesting API: 46%|โโโโโ | 604/1319 [00:29<00:28, 25.09it/s]
Requesting API: 46%|โโโโโ | 607/1319 [00:29<00:33, 21.33it/s]
Requesting API: 46%|โโโโโ | 611/1319 [00:29<00:29, 24.34it/s]
Requesting API: 47%|โโโโโ | 616/1319 [00:29<00:25, 28.11it/s]
Requesting API: 47%|โโโโโ | 620/1319 [00:29<00:23, 29.96it/s]
Requesting API: 47%|โโโโโ | 624/1319 [00:30<00:27, 24.89it/s]
Requesting API: 48%|โโโโโ | 627/1319 [00:30<00:35, 19.50it/s]
Requesting API: 48%|โโโโโ | 631/1319 [00:30<00:31, 21.78it/s]
Requesting API: 48%|โโโโโ | 634/1319 [00:30<00:31, 21.87it/s]
Requesting API: 48%|โโโโโ | 637/1319 [00:30<00:30, 22.68it/s]
Requesting API: 49%|โโโโโ | 640/1319 [00:30<00:31, 21.87it/s]
Requesting API: 49%|โโโโโ | 644/1319 [00:31<00:35, 19.02it/s]
Requesting API: 49%|โโโโโ | 647/1319 [00:31<00:32, 20.40it/s]
Requesting API: 49%|โโโโโ | 650/1319 [00:31<00:30, 21.81it/s]
Requesting API: 50%|โโโโโ | 653/1319 [00:31<00:30, 21.81it/s]
Requesting API: 50%|โโโโโ | 658/1319 [00:31<00:25, 26.17it/s]
Requesting API: 50%|โโโโโ | 661/1319 [00:31<00:25, 26.00it/s]
Requesting API: 50%|โโโโโ | 665/1319 [00:31<00:25, 25.99it/s]
Requesting API: 51%|โโโโโ | 670/1319 [00:32<00:25, 25.94it/s]
Requesting API: 51%|โโโโโ | 675/1319 [00:32<00:23, 27.59it/s]
Requesting API: 51%|โโโโโโ | 678/1319 [00:32<00:34, 18.75it/s]
Requesting API: 52%|โโโโโโ | 681/1319 [00:32<00:31, 20.21it/s]
Requesting API: 52%|โโโโโโ | 685/1319 [00:32<00:26, 23.84it/s]
Requesting API: 52%|โโโโโโ | 688/1319 [00:33<00:30, 20.40it/s]
Requesting API: 52%|โโโโโโ | 691/1319 [00:33<00:28, 22.21it/s]
Requesting API: 53%|โโโโโโ | 694/1319 [00:33<00:27, 22.37it/s]
Requesting API: 53%|โโโโโโ | 697/1319 [00:33<00:26, 23.28it/s]
Requesting API: 53%|โโโโโโ | 701/1319 [00:33<00:23, 26.82it/s]
Requesting API: 53%|โโโโโโ | 704/1319 [00:33<00:24, 25.31it/s]
Requesting API: 54%|โโโโโโ | 707/1319 [00:33<00:25, 23.89it/s]
Requesting API: 54%|โโโโโโ | 710/1319 [00:33<00:25, 23.67it/s]
Requesting API: 54%|โโโโโโ | 714/1319 [00:33<00:22, 26.68it/s]
Requesting API: 54%|โโโโโโ | 718/1319 [00:34<00:20, 29.21it/s]
Requesting API: 55%|โโโโโโ | 722/1319 [00:34<00:20, 29.62it/s]
Requesting API: 55%|โโโโโโ | 726/1319 [00:34<00:27, 21.80it/s]
Requesting API: 55%|โโโโโโ | 729/1319 [00:34<00:26, 22.28it/s]
Requesting API: 55%|โโโโโโ | 732/1319 [00:34<00:25, 23.47it/s]
Requesting API: 56%|โโโโโโ | 735/1319 [00:35<00:32, 17.88it/s]
Requesting API: 56%|โโโโโโ | 738/1319 [00:35<00:29, 19.62it/s]
Requesting API: 56%|โโโโโโ | 744/1319 [00:35<00:21, 27.12it/s]
Requesting API: 57%|โโโโโโ | 749/1319 [00:35<00:21, 26.83it/s]
Requesting API: 57%|โโโโโโ | 752/1319 [00:35<00:26, 21.39it/s]
Requesting API: 58%|โโโโโโ | 759/1319 [00:35<00:23, 23.42it/s]
Requesting API: 58%|โโโโโโ | 765/1319 [00:36<00:21, 26.30it/s]
Requesting API: 58%|โโโโโโ | 768/1319 [00:36<00:24, 22.30it/s]
Requesting API: 58%|โโโโโโ | 771/1319 [00:36<00:24, 21.95it/s]
Requesting API: 59%|โโโโโโ | 775/1319 [00:36<00:21, 25.27it/s]
Requesting API: 59%|โโโโโโ | 778/1319 [00:36<00:27, 19.39it/s]
Requesting API: 59%|โโโโโโ | 782/1319 [00:36<00:23, 22.45it/s]
Requesting API: 60%|โโโโโโ | 785/1319 [00:37<00:24, 21.81it/s]
Requesting API: 60%|โโโโโโ | 791/1319 [00:37<00:18, 28.58it/s]
Requesting API: 60%|โโโโโโ | 795/1319 [00:37<00:24, 21.75it/s]
Requesting API: 61%|โโโโโโ | 799/1319 [00:37<00:23, 22.34it/s]
Requesting API: 61%|โโโโโโ | 802/1319 [00:37<00:24, 21.25it/s]
Requesting API: 61%|โโโโโโ | 805/1319 [00:38<00:25, 20.32it/s]
Requesting API: 61%|โโโโโโโ | 808/1319 [00:38<00:24, 21.17it/s]
Requesting API: 61%|โโโโโโโ | 811/1319 [00:38<00:22, 22.32it/s]
Requesting API: 62%|โโโโโโโ | 814/1319 [00:38<00:32, 15.54it/s]
Requesting API: 62%|โโโโโโโ | 817/1319 [00:38<00:29, 17.09it/s]
Requesting API: 62%|โโโโโโโ | 823/1319 [00:38<00:21, 23.38it/s]
Requesting API: 63%|โโโโโโโ | 827/1319 [00:38<00:18, 25.99it/s]
Requesting API: 63%|โโโโโโโ | 830/1319 [00:39<00:20, 23.75it/s]
Requesting API: 63%|โโโโโโโ | 833/1319 [00:39<00:24, 19.94it/s]
Requesting API: 63%|โโโโโโโ | 836/1319 [00:39<00:26, 18.36it/s]
Requesting API: 64%|โโโโโโโ | 840/1319 [00:39<00:21, 21.81it/s]
Requesting API: 64%|โโโโโโโ | 843/1319 [00:39<00:21, 22.04it/s]
Requesting API: 64%|โโโโโโโ | 848/1319 [00:39<00:17, 27.39it/s]
Requesting API: 65%|โโโโโโโ | 857/1319 [00:40<00:12, 36.38it/s]
Requesting API: 65%|โโโโโโโ | 861/1319 [00:40<00:12, 36.29it/s]
Requesting API: 66%|โโโโโโโ | 865/1319 [00:40<00:21, 21.54it/s]
Requesting API: 66%|โโโโโโโ | 868/1319 [00:40<00:23, 19.10it/s]
Requesting API: 66%|โโโโโโโ | 871/1319 [00:40<00:22, 19.90it/s]
Requesting API: 66%|โโโโโโโ | 874/1319 [00:41<00:21, 20.62it/s]
Requesting API: 67%|โโโโโโโ | 880/1319 [00:41<00:16, 27.18it/s]
Requesting API: 67%|โโโโโโโ | 885/1319 [00:41<00:15, 27.60it/s]
Requesting API: 67%|โโโโโโโ | 889/1319 [00:41<00:18, 23.40it/s]
Requesting API: 68%|โโโโโโโ | 892/1319 [00:41<00:18, 23.19it/s]
Requesting API: 68%|โโโโโโโ | 895/1319 [00:41<00:17, 23.96it/s]
Requesting API: 68%|โโโโโโโ | 898/1319 [00:42<00:18, 22.80it/s]
Requesting API: 68%|โโโโโโโ | 902/1319 [00:42<00:17, 23.74it/s]
Requesting API: 69%|โโโโโโโ | 906/1319 [00:42<00:17, 23.82it/s]
Requesting API: 69%|โโโโโโโ | 909/1319 [00:42<00:16, 24.38it/s]
Requesting API: 69%|โโโโโโโ | 912/1319 [00:42<00:19, 20.74it/s]
Requesting API: 69%|โโโโโโโ | 915/1319 [00:42<00:21, 19.22it/s]
Requesting API: 70%|โโโโโโโ | 918/1319 [00:43<00:22, 17.51it/s]
Requesting API: 70%|โโโโโโโ | 921/1319 [00:43<00:21, 18.68it/s]
Requesting API: 70%|โโโโโโโ | 925/1319 [00:43<00:22, 17.24it/s]
Requesting API: 71%|โโโโโโโ | 931/1319 [00:43<00:17, 21.86it/s]
Requesting API: 71%|โโโโโโโ | 935/1319 [00:43<00:16, 23.91it/s]
Requesting API: 71%|โโโโโโโ | 938/1319 [00:43<00:15, 25.11it/s]
Requesting API: 71%|โโโโโโโโ | 942/1319 [00:43<00:13, 27.10it/s]
Requesting API: 72%|โโโโโโโโ | 946/1319 [00:44<00:15, 24.13it/s]
Requesting API: 72%|โโโโโโโโ | 949/1319 [00:44<00:15, 24.59it/s]
Requesting API: 72%|โโโโโโโโ | 952/1319 [00:44<00:18, 20.28it/s]
Requesting API: 72%|โโโโโโโโ | 955/1319 [00:44<00:19, 18.30it/s]
Requesting API: 73%|โโโโโโโโ | 958/1319 [00:44<00:21, 17.04it/s]
Requesting API: 73%|โโโโโโโโ | 960/1319 [00:45<00:25, 14.33it/s]
Requesting API: 73%|โโโโโโโโ | 964/1319 [00:45<00:18, 18.84it/s]
Requesting API: 73%|โโโโโโโโ | 968/1319 [00:45<00:16, 21.38it/s]
Requesting API: 74%|โโโโโโโโ | 972/1319 [00:45<00:17, 19.90it/s]
Requesting API: 74%|โโโโโโโโ | 975/1319 [00:45<00:17, 20.01it/s]
Requesting API: 74%|โโโโโโโโ | 978/1319 [00:45<00:15, 21.91it/s]
Requesting API: 74%|โโโโโโโโ | 981/1319 [00:46<00:19, 16.93it/s]
Requesting API: 75%|โโโโโโโโ | 984/1319 [00:46<00:18, 18.08it/s]
Requesting API: 75%|โโโโโโโโ | 987/1319 [00:46<00:19, 17.43it/s]
Requesting API: 75%|โโโโโโโโ | 989/1319 [00:46<00:20, 15.81it/s]
Requesting API: 75%|โโโโโโโโ | 992/1319 [00:46<00:17, 18.58it/s]
Requesting API: 75%|โโโโโโโโ | 995/1319 [00:46<00:19, 17.02it/s]
Requesting API: 76%|โโโโโโโโ | 998/1319 [00:47<00:21, 15.22it/s]
Requesting API: 76%|โโโโโโโโ | 1002/1319 [00:47<00:17, 17.93it/s]
Requesting API: 76%|โโโโโโโโ | 1006/1319 [00:47<00:17, 17.79it/s]
Requesting API: 76%|โโโโโโโโ | 1009/1319 [00:47<00:19, 15.86it/s]
Requesting API: 77%|โโโโโโโโ | 1013/1319 [00:48<00:18, 16.78it/s]
Requesting API: 77%|โโโโโโโโ | 1017/1319 [00:48<00:15, 19.49it/s]
Requesting API: 77%|โโโโโโโโ | 1021/1319 [00:48<00:14, 19.87it/s]
Requesting API: 78%|โโโโโโโโ | 1025/1319 [00:48<00:14, 20.66it/s]
Requesting API: 78%|โโโโโโโโ | 1028/1319 [00:48<00:13, 21.73it/s]
Requesting API: 78%|โโโโโโโโ | 1031/1319 [00:48<00:13, 21.32it/s]
Requesting API: 78%|โโโโโโโโ | 1034/1319 [00:48<00:13, 21.11it/s]
Requesting API: 79%|โโโโโโโโ | 1037/1319 [00:49<00:16, 17.05it/s]
Requesting API: 79%|โโโโโโโโ | 1040/1319 [00:49<00:14, 19.44it/s]
Requesting API: 79%|โโโโโโโโ | 1045/1319 [00:49<00:11, 24.76it/s]
Requesting API: 79%|โโโโโโโโ | 1048/1319 [00:49<00:11, 24.62it/s]
Requesting API: 80%|โโโโโโโโ | 1053/1319 [00:49<00:08, 30.32it/s]
Requesting API: 80%|โโโโโโโโ | 1057/1319 [00:50<00:12, 20.18it/s]
Requesting API: 80%|โโโโโโโโ | 1060/1319 [00:50<00:14, 17.85it/s]
Requesting API: 81%|โโโโโโโโ | 1063/1319 [00:50<00:13, 18.83it/s]
Requesting API: 81%|โโโโโโโโ | 1067/1319 [00:50<00:11, 21.29it/s]
Requesting API: 81%|โโโโโโโโ | 1070/1319 [00:50<00:12, 19.45it/s]
Requesting API: 81%|โโโโโโโโโ | 1073/1319 [00:50<00:11, 20.99it/s]
Requesting API: 82%|โโโโโโโโโ | 1076/1319 [00:51<00:14, 17.34it/s]
Requesting API: 82%|โโโโโโโโโ | 1078/1319 [00:51<00:14, 16.22it/s]
Requesting API: 82%|โโโโโโโโโ | 1083/1319 [00:51<00:10, 22.14it/s]
Requesting API: 82%|โโโโโโโโโ | 1086/1319 [00:51<00:10, 21.35it/s]
Requesting API: 83%|โโโโโโโโโ | 1089/1319 [00:51<00:13, 17.54it/s]
Requesting API: 83%|โโโโโโโโโ | 1092/1319 [00:51<00:12, 17.98it/s]
Requesting API: 83%|โโโโโโโโโ | 1096/1319 [00:52<00:10, 21.61it/s]
Requesting API: 83%|โโโโโโโโโ | 1099/1319 [00:52<00:09, 23.36it/s]
Requesting API: 84%|โโโโโโโโโ | 1103/1319 [00:52<00:09, 21.63it/s]
Requesting API: 84%|โโโโโโโโโ | 1106/1319 [00:52<00:09, 22.74it/s]
Requesting API: 84%|โโโโโโโโโ | 1111/1319 [00:52<00:10, 20.16it/s]
Requesting API: 84%|โโโโโโโโโ | 1114/1319 [00:53<00:11, 17.34it/s]
Requesting API: 85%|โโโโโโโโโ | 1116/1319 [00:53<00:11, 17.76it/s]
Requesting API: 85%|โโโโโโโโโ | 1119/1319 [00:53<00:12, 16.62it/s]
Requesting API: 85%|โโโโโโโโโ | 1121/1319 [00:53<00:11, 16.73it/s]
Requesting API: 85%|โโโโโโโโโ | 1123/1319 [00:53<00:11, 16.89it/s]
Requesting API: 85%|โโโโโโโโโ | 1127/1319 [00:53<00:09, 20.94it/s]
Requesting API: 86%|โโโโโโโโโ | 1132/1319 [00:53<00:07, 26.59it/s]
Requesting API: 86%|โโโโโโโโโ | 1136/1319 [00:53<00:06, 26.79it/s]
Requesting API: 86%|โโโโโโโโโ | 1139/1319 [00:54<00:07, 22.60it/s]
Requesting API: 87%|โโโโโโโโโ | 1142/1319 [00:54<00:10, 17.23it/s]
Requesting API: 87%|โโโโโโโโโ | 1145/1319 [00:54<00:11, 15.80it/s]
Requesting API: 87%|โโโโโโโโโ | 1147/1319 [00:54<00:11, 15.52it/s]
Requesting API: 87%|โโโโโโโโโ | 1151/1319 [00:54<00:08, 19.25it/s]
Requesting API: 88%|โโโโโโโโโ | 1155/1319 [00:55<00:08, 18.39it/s]
Requesting API: 88%|โโโโโโโโโ | 1158/1319 [00:55<00:11, 14.47it/s]
Requesting API: 88%|โโโโโโโโโ | 1160/1319 [00:55<00:10, 14.96it/s]
Requesting API: 88%|โโโโโโโโโ | 1164/1319 [00:55<00:08, 17.35it/s]
Requesting API: 88%|โโโโโโโโโ | 1167/1319 [00:55<00:08, 18.88it/s]
Requesting API: 89%|โโโโโโโโโ | 1171/1319 [00:55<00:06, 22.36it/s]
Requesting API: 89%|โโโโโโโโโ | 1174/1319 [00:56<00:07, 19.65it/s]
Requesting API: 89%|โโโโโโโโโ | 1177/1319 [00:56<00:11, 12.85it/s]
Requesting API: 89%|โโโโโโโโโ | 1180/1319 [00:56<00:10, 13.18it/s]
Requesting API: 90%|โโโโโโโโโ | 1184/1319 [00:57<00:08, 15.89it/s]
Requesting API: 90%|โโโโโโโโโ | 1190/1319 [00:57<00:05, 23.15it/s]
Requesting API: 91%|โโโโโโโโโ | 1194/1319 [00:57<00:05, 21.97it/s]
Requesting API: 91%|โโโโโโโโโ | 1197/1319 [00:57<00:05, 22.80it/s]
Requesting API: 91%|โโโโโโโโโ | 1201/1319 [00:57<00:04, 26.13it/s]
Requesting API: 91%|โโโโโโโโโโ| 1205/1319 [00:57<00:04, 23.86it/s]
Requesting API: 92%|โโโโโโโโโโ| 1208/1319 [00:57<00:05, 20.45it/s]
Requesting API: 92%|โโโโโโโโโโ| 1211/1319 [00:58<00:06, 17.77it/s]
Requesting API: 92%|โโโโโโโโโโ| 1214/1319 [00:58<00:06, 16.62it/s]
Requesting API: 92%|โโโโโโโโโโ| 1216/1319 [00:58<00:06, 16.26it/s]
Requesting API: 92%|โโโโโโโโโโ| 1219/1319 [00:58<00:06, 16.27it/s]
Requesting API: 93%|โโโโโโโโโโ| 1221/1319 [00:58<00:05, 16.49it/s]
Requesting API: 93%|โโโโโโโโโโ| 1223/1319 [00:59<00:06, 13.97it/s]
Requesting API: 93%|โโโโโโโโโโ| 1225/1319 [00:59<00:06, 14.65it/s]
Requesting API: 93%|โโโโโโโโโโ| 1228/1319 [00:59<00:05, 17.29it/s]
Requesting API: 93%|โโโโโโโโโโ| 1233/1319 [00:59<00:03, 24.26it/s]
Requesting API: 94%|โโโโโโโโโโ| 1236/1319 [00:59<00:03, 22.45it/s]
Requesting API: 94%|โโโโโโโโโโ| 1240/1319 [00:59<00:02, 26.42it/s]
Requesting API: 94%|โโโโโโโโโโ| 1245/1319 [00:59<00:02, 28.12it/s]
Requesting API: 95%|โโโโโโโโโโ| 1249/1319 [00:59<00:02, 30.07it/s]
Requesting API: 95%|โโโโโโโโโโ| 1253/1319 [01:00<00:02, 26.02it/s]
Requesting API: 95%|โโโโโโโโโโ| 1256/1319 [01:00<00:02, 21.10it/s]
Requesting API: 96%|โโโโโโโโโโ| 1262/1319 [01:00<00:02, 26.17it/s]
Requesting API: 96%|โโโโโโโโโโ| 1265/1319 [01:00<00:02, 21.22it/s]
Requesting API: 96%|โโโโโโโโโโ| 1268/1319 [01:00<00:02, 19.64it/s]
Requesting API: 96%|โโโโโโโโโโ| 1271/1319 [01:01<00:02, 20.33it/s]
Requesting API: 97%|โโโโโโโโโโ| 1274/1319 [01:01<00:02, 17.32it/s]
Requesting API: 97%|โโโโโโโโโโ| 1278/1319 [01:01<00:01, 21.12it/s]
Requesting API: 98%|โโโโโโโโโโ| 1289/1319 [01:01<00:00, 31.24it/s]
Requesting API: 98%|โโโโโโโโโโ| 1293/1319 [01:01<00:00, 27.66it/s]
Requesting API: 98%|โโโโโโโโโโ| 1296/1319 [01:01<00:00, 24.38it/s]
Requesting API: 99%|โโโโโโโโโโ| 1301/1319 [01:02<00:00, 25.72it/s]
Requesting API: 99%|โโโโโโโโโโ| 1304/1319 [01:02<00:00, 22.74it/s]
Requesting API: 99%|โโโโโโโโโโ| 1307/1319 [01:02<00:00, 23.14it/s]
Requesting API: 99%|โโโโโโโโโโ| 1310/1319 [01:02<00:00, 18.25it/s]
Requesting API: 99%|โโโโโโโโโโ| 1312/1319 [01:02<00:00, 16.40it/s]
Requesting API: 100%|โโโโโโโโโโ| 1315/1319 [01:03<00:00, 13.94it/s]
Requesting API: 100%|โโโโโโโโโโ| 1317/1319 [01:04<00:00, 5.60it/s]
Requesting API: 100%|โโโโโโโโโโ| 1317/1319 [01:18<00:00, 5.60it/s]
Requesting API: 100%|โโโโโโโโโโ| 1319/1319 [01:18<00:00, 1.77s/it]
Requesting API: 100%|โโโโโโโโโโ| 1319/1319 [01:18<00:00, 16.88it/s]
Requesting API: 0%| | 0/500 [00:00<?, ?it/s]
Requesting API: 0%| | 1/500 [00:02<21:38, 2.60s/it]
Requesting API: 0%| | 2/500 [00:03<10:57, 1.32s/it]
Requesting API: 1%| | 3/500 [00:03<07:16, 1.14it/s]
Requesting API: 1%| | 4/500 [00:03<04:55, 1.68it/s]
Requesting API: 1%| | 5/500 [00:04<06:09, 1.34it/s]
Requesting API: 2%|โ | 8/500 [00:05<03:25, 2.39it/s]
Requesting API: 2%|โ | 9/500 [00:05<03:47, 2.15it/s]
Requesting API: 2%|โ | 10/500 [00:05<03:05, 2.63it/s]
Requesting API: 2%|โ | 11/500 [00:06<02:58, 2.74it/s]
Requesting API: 2%|โ | 12/500 [00:06<03:08, 2.59it/s]
Requesting API: 3%|โ | 13/500 [00:06<02:34, 3.14it/s]
Requesting API: 3%|โ | 15/500 [00:07<02:54, 2.78it/s]
Requesting API: 4%|โ | 18/500 [00:07<01:44, 4.60it/s]
Requesting API: 4%|โ | 20/500 [00:08<01:47, 4.48it/s]
Requesting API: 4%|โ | 21/500 [00:08<02:00, 3.96it/s]
Requesting API: 4%|โ | 22/500 [00:08<02:03, 3.86it/s]
Requesting API: 5%|โ | 24/500 [00:09<01:51, 4.28it/s]
Requesting API: 5%|โ | 25/500 [00:09<01:49, 4.35it/s]
Requesting API: 5%|โ | 27/500 [00:09<01:22, 5.70it/s]
Requesting API: 6%|โ | 29/500 [00:10<01:25, 5.54it/s]
Requesting API: 6%|โ | 30/500 [00:10<01:43, 4.54it/s]
Requesting API: 6%|โ | 32/500 [00:10<01:24, 5.56it/s]
Requesting API: 7%|โ | 34/500 [00:11<01:35, 4.90it/s]
Requesting API: 7%|โ | 35/500 [00:11<01:59, 3.91it/s]
Requesting API: 7%|โ | 36/500 [00:11<01:57, 3.96it/s]
Requesting API: 7%|โ | 37/500 [00:12<01:54, 4.03it/s]
Requesting API: 8%|โ | 38/500 [00:12<02:41, 2.87it/s]
Requesting API: 8%|โ | 40/500 [00:13<01:56, 3.95it/s]
Requesting API: 8%|โ | 41/500 [00:13<01:52, 4.10it/s]
Requesting API: 9%|โ | 43/500 [00:13<01:18, 5.83it/s]
Requesting API: 9%|โ | 44/500 [00:13<01:13, 6.24it/s]
Requesting API: 9%|โ | 45/500 [00:13<01:08, 6.64it/s]
Requesting API: 9%|โ | 46/500 [00:13<01:15, 5.97it/s]
Requesting API: 9%|โ | 47/500 [00:13<01:10, 6.46it/s]
Requesting API: 10%|โ | 48/500 [00:14<01:07, 6.68it/s]
Requesting API: 10%|โ | 49/500 [00:14<02:19, 3.22it/s]
Requesting API: 10%|โ | 50/500 [00:14<02:01, 3.70it/s]
Requesting API: 10%|โ | 52/500 [00:15<01:18, 5.68it/s]
Requesting API: 11%|โ | 54/500 [00:15<01:41, 4.41it/s]
Requesting API: 11%|โ | 55/500 [00:16<01:52, 3.97it/s]
Requesting API: 11%|โ | 56/500 [00:16<01:53, 3.92it/s]
Requesting API: 12%|โโ | 58/500 [00:16<01:35, 4.62it/s]
Requesting API: 12%|โโ | 59/500 [00:16<01:34, 4.68it/s]
Requesting API: 12%|โโ | 61/500 [00:17<01:47, 4.09it/s]
Requesting API: 12%|โโ | 62/500 [00:17<01:35, 4.58it/s]
Requesting API: 13%|โโ | 63/500 [00:17<01:48, 4.03it/s]
Requesting API: 13%|โโ | 64/500 [00:18<01:40, 4.36it/s]
Requesting API: 13%|โโ | 65/500 [00:18<01:36, 4.53it/s]
Requesting API: 13%|โโ | 66/500 [00:18<01:47, 4.02it/s]
Requesting API: 13%|โโ | 67/500 [00:18<01:35, 4.54it/s]
Requesting API: 14%|โโ | 68/500 [00:19<01:47, 4.04it/s]
Requesting API: 14%|โโ | 69/500 [00:20<03:42, 1.94it/s]
Requesting API: 14%|โโ | 70/500 [00:20<03:04, 2.33it/s]
Requesting API: 14%|โโ | 72/500 [00:20<02:01, 3.51it/s]
Requesting API: 15%|โโ | 73/500 [00:21<02:27, 2.89it/s]
Requesting API: 15%|โโ | 74/500 [00:21<02:21, 3.01it/s]
Requesting API: 15%|โโ | 75/500 [00:21<02:19, 3.05it/s]
Requesting API: 15%|โโ | 77/500 [00:22<01:42, 4.14it/s]
Requesting API: 16%|โโ | 78/500 [00:22<01:35, 4.43it/s]
Requesting API: 16%|โโ | 79/500 [00:22<01:26, 4.85it/s]
Requesting API: 16%|โโ | 80/500 [00:22<02:03, 3.40it/s]
Requesting API: 16%|โโ | 81/500 [00:23<02:14, 3.11it/s]
Requesting API: 17%|โโ | 84/500 [00:23<01:18, 5.30it/s]
Requesting API: 17%|โโ | 85/500 [00:23<01:19, 5.24it/s]
Requesting API: 17%|โโ | 87/500 [00:23<01:04, 6.38it/s]
Requesting API: 18%|โโ | 88/500 [00:24<02:06, 3.24it/s]
Requesting API: 18%|โโ | 89/500 [00:25<03:08, 2.18it/s]
Requesting API: 18%|โโ | 90/500 [00:26<03:42, 1.84it/s]
Requesting API: 18%|โโ | 91/500 [00:26<02:57, 2.30it/s]
Requesting API: 18%|โโ | 92/500 [00:26<02:20, 2.90it/s]
Requesting API: 19%|โโ | 94/500 [00:26<01:28, 4.61it/s]
Requesting API: 19%|โโ | 97/500 [00:27<01:24, 4.74it/s]
Requesting API: 20%|โโ | 99/500 [00:28<01:54, 3.50it/s]
Requesting API: 20%|โโ | 101/500 [00:29<02:06, 3.14it/s]
Requesting API: 20%|โโ | 102/500 [00:30<02:49, 2.35it/s]
Requesting API: 21%|โโ | 103/500 [00:30<02:54, 2.28it/s]
Requesting API: 21%|โโ | 104/500 [00:31<03:14, 2.04it/s]
Requesting API: 21%|โโโ | 107/500 [00:32<03:05, 2.11it/s]
Requesting API: 22%|โโโ | 108/500 [00:32<02:43, 2.39it/s]
Requesting API: 22%|โโโ | 109/500 [00:33<03:00, 2.17it/s]
Requesting API: 22%|โโโ | 110/500 [00:33<02:48, 2.31it/s]
Requesting API: 22%|โโโ | 111/500 [00:33<02:21, 2.75it/s]
Requesting API: 22%|โโโ | 112/500 [00:34<02:41, 2.40it/s]
Requesting API: 23%|โโโ | 113/500 [00:35<04:02, 1.60it/s]
Requesting API: 23%|โโโ | 114/500 [00:35<03:22, 1.91it/s]
Requesting API: 23%|โโโ | 116/500 [00:36<02:05, 3.06it/s]
Requesting API: 23%|โโโ | 117/500 [00:36<02:04, 3.08it/s]
Requesting API: 24%|โโโ | 119/500 [00:36<01:34, 4.04it/s]
Requesting API: 24%|โโโ | 121/500 [00:37<02:02, 3.10it/s]
Requesting API: 24%|โโโ | 122/500 [00:37<01:57, 3.22it/s]
Requesting API: 25%|โโโ | 123/500 [00:38<02:19, 2.70it/s]
Requesting API: 25%|โโโ | 124/500 [00:38<02:09, 2.90it/s]
Requesting API: 25%|โโโ | 125/500 [00:38<01:54, 3.29it/s]
Requesting API: 25%|โโโ | 126/500 [00:39<02:51, 2.19it/s]
Requesting API: 25%|โโโ | 127/500 [00:39<02:17, 2.72it/s]
Requesting API: 26%|โโโ | 129/500 [00:40<01:26, 4.27it/s]
Requesting API: 26%|โโโ | 131/500 [00:40<01:53, 3.25it/s]
Requesting API: 26%|โโโ | 132/500 [00:41<01:59, 3.08it/s]
Requesting API: 27%|โโโ | 133/500 [00:41<01:56, 3.16it/s]
Requesting API: 27%|โโโ | 134/500 [00:42<02:17, 2.67it/s]
Requesting API: 27%|โโโ | 136/500 [00:42<01:27, 4.17it/s]
Requesting API: 28%|โโโ | 138/500 [00:42<01:15, 4.79it/s]
Requesting API: 28%|โโโ | 139/500 [00:43<02:32, 2.37it/s]
Requesting API: 28%|โโโ | 140/500 [00:44<02:33, 2.35it/s]
Requesting API: 28%|โโโ | 142/500 [00:44<01:41, 3.52it/s]
Requesting API: 29%|โโโ | 143/500 [00:44<01:26, 4.11it/s]
Requesting API: 29%|โโโ | 144/500 [00:44<01:14, 4.77it/s]
Requesting API: 29%|โโโ | 145/500 [00:44<01:16, 4.64it/s]
Requesting API: 29%|โโโ | 146/500 [00:44<01:15, 4.72it/s]
Requesting API: 29%|โโโ | 147/500 [00:45<01:14, 4.75it/s]
Requesting API: 30%|โโโ | 148/500 [00:45<01:13, 4.79it/s]
Requesting API: 30%|โโโ | 149/500 [00:45<01:35, 3.68it/s]
Requesting API: 30%|โโโ | 150/500 [00:46<01:43, 3.39it/s]
Requesting API: 30%|โโโ | 151/500 [00:46<01:51, 3.13it/s]
Requesting API: 30%|โโโ | 152/500 [00:46<01:34, 3.69it/s]
Requesting API: 31%|โโโ | 153/500 [00:46<01:24, 4.11it/s]
Requesting API: 31%|โโโ | 155/500 [00:47<01:13, 4.67it/s]
Requesting API: 31%|โโโ | 156/500 [00:47<01:38, 3.48it/s]
Requesting API: 32%|โโโโ | 158/500 [00:47<01:08, 4.97it/s]
Requesting API: 32%|โโโโ | 160/500 [00:48<01:22, 4.10it/s]
Requesting API: 32%|โโโโ | 161/500 [00:49<02:01, 2.80it/s]
Requesting API: 33%|โโโโ | 163/500 [00:49<01:34, 3.56it/s]
Requesting API: 33%|โโโโ | 164/500 [00:50<01:56, 2.89it/s]
Requesting API: 33%|โโโโ | 165/500 [00:50<01:39, 3.38it/s]
Requesting API: 33%|โโโโ | 166/500 [00:50<01:43, 3.22it/s]
Requesting API: 33%|โโโโ | 167/500 [00:50<01:29, 3.72it/s]
Requesting API: 34%|โโโโ | 168/500 [00:51<01:25, 3.88it/s]
Requesting API: 34%|โโโโ | 171/500 [00:51<00:58, 5.61it/s]
Requesting API: 35%|โโโโ | 173/500 [00:51<01:07, 4.82it/s]
Requesting API: 35%|โโโโ | 174/500 [00:52<01:53, 2.88it/s]
Requesting API: 35%|โโโโ | 175/500 [00:53<01:58, 2.74it/s]
Requesting API: 35%|โโโโ | 176/500 [00:53<01:50, 2.94it/s]
Requesting API: 36%|โโโโ | 178/500 [00:53<01:15, 4.29it/s]
Requesting API: 36%|โโโโ | 179/500 [00:54<01:23, 3.85it/s]
Requesting API: 36%|โโโโ | 180/500 [00:54<01:24, 3.79it/s]
Requesting API: 36%|โโโโ | 181/500 [00:54<01:27, 3.63it/s]
Requesting API: 36%|โโโโ | 182/500 [00:55<01:58, 2.69it/s]
Requesting API: 37%|โโโโ | 183/500 [00:55<01:38, 3.21it/s]
Requesting API: 37%|โโโโ | 185/500 [00:55<01:21, 3.85it/s]
Requesting API: 37%|โโโโ | 186/500 [00:56<01:28, 3.53it/s]
Requesting API: 37%|โโโโ | 187/500 [00:56<01:54, 2.72it/s]
Requesting API: 38%|โโโโ | 188/500 [00:57<01:41, 3.08it/s]
Requesting API: 38%|โโโโ | 190/500 [00:57<01:15, 4.09it/s]
Requesting API: 38%|โโโโ | 191/500 [00:58<02:06, 2.45it/s]
Requesting API: 38%|โโโโ | 192/500 [00:58<01:46, 2.90it/s]
Requesting API: 39%|โโโโ | 195/500 [00:58<01:15, 4.02it/s]
Requesting API: 39%|โโโโ | 196/500 [00:59<01:51, 2.72it/s]
Requesting API: 39%|โโโโ | 197/500 [01:00<01:45, 2.86it/s]
Requesting API: 40%|โโโโ | 198/500 [01:00<01:33, 3.23it/s]
Requesting API: 40%|โโโโ | 199/500 [01:00<01:23, 3.62it/s]
Requesting API: 40%|โโโโ | 200/500 [01:00<01:28, 3.37it/s]
Requesting API: 40%|โโโโ | 201/500 [01:01<02:27, 2.03it/s]
Requesting API: 41%|โโโโ | 205/500 [01:01<01:06, 4.46it/s]
Requesting API: 41%|โโโโ | 206/500 [01:02<01:40, 2.92it/s]
Requesting API: 41%|โโโโโ | 207/500 [01:04<02:36, 1.87it/s]
Requesting API: 42%|โโโโโ | 208/500 [01:04<02:26, 1.99it/s]
Requesting API: 42%|โโโโโ | 210/500 [01:04<01:54, 2.53it/s]
Requesting API: 42%|โโโโโ | 211/500 [01:05<01:51, 2.59it/s]
Requesting API: 42%|โโโโโ | 212/500 [01:05<01:39, 2.91it/s]
Requesting API: 43%|โโโโโ | 213/500 [01:05<01:26, 3.31it/s]
Requesting API: 43%|โโโโโ | 214/500 [01:05<01:17, 3.71it/s]
Requesting API: 43%|โโโโโ | 215/500 [01:06<01:07, 4.21it/s]
Requesting API: 43%|โโโโโ | 216/500 [01:06<01:20, 3.54it/s]
Requesting API: 43%|โโโโโ | 217/500 [01:07<02:21, 2.00it/s]
Requesting API: 44%|โโโโโ | 218/500 [01:07<02:02, 2.31it/s]
Requesting API: 44%|โโโโโ | 220/500 [01:08<01:37, 2.88it/s]
Requesting API: 44%|โโโโโ | 221/500 [01:08<01:31, 3.05it/s]
Requesting API: 44%|โโโโโ | 222/500 [01:08<01:33, 2.97it/s]
Requesting API: 45%|โโโโโ | 223/500 [01:09<01:31, 3.03it/s]
Requesting API: 45%|โโโโโ | 225/500 [01:10<01:43, 2.64it/s]
Requesting API: 45%|โโโโโ | 226/500 [01:10<01:51, 2.46it/s]
Requesting API: 46%|โโโโโ | 228/500 [01:10<01:13, 3.71it/s]
Requesting API: 46%|โโโโโ | 229/500 [01:10<01:12, 3.73it/s]
Requesting API: 46%|โโโโโ | 230/500 [01:11<01:20, 3.37it/s]
Requesting API: 47%|โโโโโ | 233/500 [01:11<00:43, 6.12it/s]
Requesting API: 47%|โโโโโ | 235/500 [01:12<01:21, 3.26it/s]
Requesting API: 47%|โโโโโ | 236/500 [01:12<01:10, 3.72it/s]
Requesting API: 48%|โโโโโ | 238/500 [01:12<00:50, 5.19it/s]
Requesting API: 48%|โโโโโ | 240/500 [01:13<01:04, 4.02it/s]
Requesting API: 48%|โโโโโ | 241/500 [01:13<01:05, 3.98it/s]
Requesting API: 48%|โโโโโ | 242/500 [01:14<01:12, 3.57it/s]
Requesting API: 49%|โโโโโ | 243/500 [01:14<01:09, 3.72it/s]
Requesting API: 49%|โโโโโ | 244/500 [01:14<01:21, 3.16it/s]
Requesting API: 49%|โโโโโ | 245/500 [01:15<01:16, 3.33it/s]
Requesting API: 49%|โโโโโ | 246/500 [01:15<01:04, 3.94it/s]
Requesting API: 49%|โโโโโ | 247/500 [01:15<01:02, 4.03it/s]
Requesting API: 50%|โโโโโ | 249/500 [01:15<00:43, 5.80it/s]
Requesting API: 50%|โโโโโ | 250/500 [01:16<01:00, 4.14it/s]
Requesting API: 50%|โโโโโ | 251/500 [01:16<00:53, 4.69it/s]
Requesting API: 51%|โโโโโ | 253/500 [01:16<00:43, 5.62it/s]
Requesting API: 51%|โโโโโ | 254/500 [01:17<01:16, 3.22it/s]
Requesting API: 51%|โโโโโ | 255/500 [01:17<01:35, 2.57it/s]
Requesting API: 51%|โโโโโ | 256/500 [01:18<01:21, 3.00it/s]
Requesting API: 51%|โโโโโโ | 257/500 [01:18<01:33, 2.61it/s]
Requesting API: 52%|โโโโโโ | 258/500 [01:18<01:29, 2.71it/s]
Requesting API: 52%|โโโโโโ | 259/500 [01:19<01:12, 3.32it/s]
Requesting API: 52%|โโโโโโ | 260/500 [01:19<01:02, 3.87it/s]
Requesting API: 52%|โโโโโโ | 262/500 [01:19<00:59, 3.97it/s]
Requesting API: 53%|โโโโโโ | 264/500 [01:20<00:57, 4.11it/s]
Requesting API: 53%|โโโโโโ | 265/500 [01:20<01:00, 3.89it/s]
Requesting API: 53%|โโโโโโ | 266/500 [01:20<01:03, 3.66it/s]
Requesting API: 53%|โโโโโโ | 267/500 [01:21<01:01, 3.81it/s]
Requesting API: 54%|โโโโโโ | 268/500 [01:21<00:57, 4.05it/s]
Requesting API: 54%|โโโโโโ | 269/500 [01:21<01:18, 2.95it/s]
Requesting API: 54%|โโโโโโ | 270/500 [01:22<01:12, 3.17it/s]
Requesting API: 54%|โโโโโโ | 271/500 [01:22<01:03, 3.62it/s]
Requesting API: 55%|โโโโโโ | 273/500 [01:22<00:52, 4.31it/s]
Requesting API: 55%|โโโโโโ | 274/500 [01:22<00:45, 4.95it/s]
Requesting API: 55%|โโโโโโ | 276/500 [01:22<00:33, 6.63it/s]
Requesting API: 55%|โโโโโโ | 277/500 [01:23<00:46, 4.82it/s]
Requesting API: 56%|โโโโโโ | 278/500 [01:23<00:42, 5.27it/s]
Requesting API: 56%|โโโโโโ | 279/500 [01:24<01:05, 3.39it/s]
Requesting API: 56%|โโโโโโ | 280/500 [01:24<01:21, 2.71it/s]
Requesting API: 56%|โโโโโโ | 281/500 [01:24<01:23, 2.61it/s]
Requesting API: 56%|โโโโโโ | 282/500 [01:25<01:16, 2.84it/s]
Requesting API: 57%|โโโโโโ | 283/500 [01:25<01:03, 3.41it/s]
Requesting API: 57%|โโโโโโ | 284/500 [01:25<01:02, 3.48it/s]
Requesting API: 57%|โโโโโโ | 286/500 [01:26<01:04, 3.31it/s]
Requesting API: 57%|โโโโโโ | 287/500 [01:26<00:56, 3.77it/s]
Requesting API: 58%|โโโโโโ | 289/500 [01:26<00:37, 5.65it/s]
Requesting API: 58%|โโโโโโ | 291/500 [01:26<00:32, 6.34it/s]
Requesting API: 59%|โโโโโโ | 294/500 [01:27<00:28, 7.14it/s]
Requesting API: 59%|โโโโโโ | 295/500 [01:27<00:31, 6.47it/s]
Requesting API: 59%|โโโโโโ | 297/500 [01:28<00:40, 4.97it/s]
Requesting API: 60%|โโโโโโ | 299/500 [01:28<00:59, 3.40it/s]
Requesting API: 60%|โโโโโโ | 300/500 [01:29<00:55, 3.62it/s]
Requesting API: 60%|โโโโโโ | 301/500 [01:29<01:04, 3.06it/s]
Requesting API: 60%|โโโโโโ | 302/500 [01:30<01:46, 1.86it/s]
Requesting API: 61%|โโโโโโ | 303/500 [01:31<01:27, 2.26it/s]
Requesting API: 61%|โโโโโโ | 305/500 [01:31<01:03, 3.08it/s]
Requesting API: 61%|โโโโโโโ | 307/500 [01:31<00:54, 3.52it/s]
Requesting API: 62%|โโโโโโโ | 308/500 [01:32<00:53, 3.61it/s]
Requesting API: 62%|โโโโโโโ | 310/500 [01:32<00:39, 4.84it/s]
Requesting API: 62%|โโโโโโโ | 312/500 [01:32<00:37, 5.00it/s]
Requesting API: 63%|โโโโโโโ | 313/500 [01:33<00:53, 3.53it/s]
Requesting API: 63%|โโโโโโโ | 315/500 [01:34<01:06, 2.80it/s]
Requesting API: 63%|โโโโโโโ | 316/500 [01:34<00:56, 3.28it/s]
Requesting API: 63%|โโโโโโโ | 317/500 [01:35<01:44, 1.76it/s]
Requesting API: 64%|โโโโโโโ | 320/500 [01:36<01:03, 2.85it/s]
Requesting API: 64%|โโโโโโโ | 321/500 [01:36<00:56, 3.15it/s]
Requesting API: 64%|โโโโโโโ | 322/500 [01:36<00:58, 3.04it/s]
Requesting API: 65%|โโโโโโโ | 323/500 [01:36<00:54, 3.26it/s]
Requesting API: 65%|โโโโโโโ | 324/500 [01:37<00:48, 3.65it/s]
Requesting API: 65%|โโโโโโโ | 325/500 [01:37<00:47, 3.65it/s]
Requesting API: 65%|โโโโโโโ | 326/500 [01:37<00:41, 4.23it/s]
Requesting API: 65%|โโโโโโโ | 327/500 [01:37<00:49, 3.48it/s]
Requesting API: 66%|โโโโโโโ | 329/500 [01:38<00:40, 4.22it/s]
Requesting API: 66%|โโโโโโโ | 330/500 [01:38<00:46, 3.69it/s]
Requesting API: 66%|โโโโโโโ | 331/500 [01:38<00:43, 3.84it/s]
Requesting API: 67%|โโโโโโโ | 333/500 [01:39<00:34, 4.88it/s]
Requesting API: 67%|โโโโโโโ | 335/500 [01:39<00:31, 5.29it/s]
Requesting API: 67%|โโโโโโโ | 336/500 [01:39<00:29, 5.48it/s]
Requesting API: 67%|โโโโโโโ | 337/500 [01:40<00:36, 4.52it/s]
Requesting API: 68%|โโโโโโโ | 338/500 [01:40<00:35, 4.62it/s]
Requesting API: 68%|โโโโโโโ | 341/500 [01:40<00:23, 6.70it/s]
Requesting API: 68%|โโโโโโโ | 342/500 [01:40<00:22, 6.92it/s]
Requesting API: 69%|โโโโโโโ | 343/500 [01:40<00:22, 7.07it/s]
Requesting API: 69%|โโโโโโโ | 344/500 [01:41<00:29, 5.22it/s]
Requesting API: 69%|โโโโโโโ | 346/500 [01:41<00:34, 4.48it/s]
Requesting API: 69%|โโโโโโโ | 347/500 [01:42<00:42, 3.57it/s]
Requesting API: 70%|โโโโโโโ | 348/500 [01:42<00:39, 3.83it/s]
Requesting API: 70%|โโโโโโโ | 350/500 [01:42<00:26, 5.56it/s]
Requesting API: 70%|โโโโโโโ | 352/500 [01:42<00:26, 5.67it/s]
Requesting API: 71%|โโโโโโโ | 353/500 [01:43<00:28, 5.22it/s]
Requesting API: 71%|โโโโโโโ | 354/500 [01:43<00:47, 3.04it/s]
Requesting API: 71%|โโโโโโโ | 355/500 [01:44<00:56, 2.56it/s]
Requesting API: 72%|โโโโโโโโ | 358/500 [01:44<00:33, 4.29it/s]
Requesting API: 72%|โโโโโโโโ | 360/500 [01:44<00:29, 4.76it/s]
Requesting API: 72%|โโโโโโโโ | 361/500 [01:45<00:29, 4.79it/s]
Requesting API: 73%|โโโโโโโโ | 363/500 [01:45<00:23, 5.71it/s]
Requesting API: 73%|โโโโโโโโ | 364/500 [01:46<00:44, 3.04it/s]
Requesting API: 73%|โโโโโโโโ | 365/500 [01:47<01:07, 2.01it/s]
Requesting API: 73%|โโโโโโโโ | 366/500 [01:47<00:54, 2.45it/s]
Requesting API: 73%|โโโโโโโโ | 367/500 [01:47<00:49, 2.71it/s]
Requesting API: 74%|โโโโโโโโ | 369/500 [01:48<00:43, 2.99it/s]
Requesting API: 74%|โโโโโโโโ | 372/500 [01:48<00:28, 4.48it/s]
Requesting API: 75%|โโโโโโโโ | 373/500 [01:48<00:26, 4.76it/s]
Requesting API: 75%|โโโโโโโโ | 374/500 [01:49<00:39, 3.22it/s]
Requesting API: 75%|โโโโโโโโ | 376/500 [01:49<00:27, 4.46it/s]
Requesting API: 75%|โโโโโโโโ | 377/500 [01:50<00:32, 3.76it/s]
Requesting API: 76%|โโโโโโโโ | 378/500 [01:50<00:29, 4.17it/s]
Requesting API: 76%|โโโโโโโโ | 381/500 [01:51<00:38, 3.06it/s]
Requesting API: 77%|โโโโโโโโ | 383/500 [01:51<00:28, 4.05it/s]
Requesting API: 77%|โโโโโโโโ | 385/500 [01:52<00:26, 4.39it/s]
Requesting API: 77%|โโโโโโโโ | 387/500 [01:53<00:40, 2.81it/s]
Requesting API: 78%|โโโโโโโโ | 388/500 [01:53<00:44, 2.49it/s]
Requesting API: 78%|โโโโโโโโ | 389/500 [01:54<00:39, 2.81it/s]
Requesting API: 78%|โโโโโโโโ | 390/500 [01:54<00:42, 2.57it/s]
Requesting API: 78%|โโโโโโโโ | 391/500 [01:54<00:40, 2.66it/s]
Requesting API: 78%|โโโโโโโโ | 392/500 [01:55<00:43, 2.48it/s]
Requesting API: 79%|โโโโโโโโ | 393/500 [01:56<00:48, 2.20it/s]
Requesting API: 79%|โโโโโโโโ | 394/500 [01:56<00:40, 2.64it/s]
Requesting API: 79%|โโโโโโโโ | 395/500 [01:56<00:38, 2.73it/s]
Requesting API: 79%|โโโโโโโโ | 396/500 [01:56<00:35, 2.93it/s]
Requesting API: 79%|โโโโโโโโ | 397/500 [01:57<00:35, 2.88it/s]
Requesting API: 80%|โโโโโโโโ | 400/500 [01:57<00:18, 5.36it/s]
Requesting API: 80%|โโโโโโโโ | 401/500 [01:57<00:17, 5.73it/s]
Requesting API: 80%|โโโโโโโโ | 402/500 [01:57<00:17, 5.69it/s]
Requesting API: 81%|โโโโโโโโ | 403/500 [01:57<00:17, 5.67it/s]
Requesting API: 81%|โโโโโโโโ | 405/500 [01:58<00:13, 6.84it/s]
Requesting API: 81%|โโโโโโโโ | 406/500 [01:58<00:13, 7.06it/s]
Requesting API: 81%|โโโโโโโโโ | 407/500 [01:58<00:17, 5.19it/s]
Requesting API: 82%|โโโโโโโโโ | 408/500 [01:59<00:26, 3.49it/s]
Requesting API: 82%|โโโโโโโโโ | 409/500 [01:59<00:30, 2.97it/s]
Requesting API: 82%|โโโโโโโโโ | 410/500 [02:00<00:38, 2.36it/s]
Requesting API: 82%|โโโโโโโโโ | 411/500 [02:00<00:47, 1.88it/s]
Requesting API: 82%|โโโโโโโโโ | 412/500 [02:01<00:46, 1.88it/s]
Requesting API: 83%|โโโโโโโโโ | 413/500 [02:01<00:37, 2.33it/s]
Requesting API: 83%|โโโโโโโโโ | 415/500 [02:02<00:32, 2.62it/s]
Requesting API: 83%|โโโโโโโโโ | 417/500 [02:02<00:22, 3.74it/s]
Requesting API: 84%|โโโโโโโโโ | 419/500 [02:02<00:17, 4.59it/s]
Requesting API: 84%|โโโโโโโโโ | 420/500 [02:03<00:17, 4.51it/s]
Requesting API: 84%|โโโโโโโโโ | 421/500 [02:03<00:16, 4.81it/s]
Requesting API: 84%|โโโโโโโโโ | 422/500 [02:03<00:14, 5.29it/s]
Requesting API: 85%|โโโโโโโโโ | 424/500 [02:03<00:14, 5.11it/s]
Requesting API: 85%|โโโโโโโโโ | 426/500 [02:04<00:14, 5.07it/s]
Requesting API: 85%|โโโโโโโโโ | 427/500 [02:04<00:15, 4.64it/s]
Requesting API: 86%|โโโโโโโโโ | 429/500 [02:04<00:14, 4.96it/s]
Requesting API: 86%|โโโโโโโโโ | 431/500 [02:04<00:11, 5.99it/s]
Requesting API: 86%|โโโโโโโโโ | 432/500 [02:05<00:15, 4.39it/s]
Requesting API: 87%|โโโโโโโโโ | 433/500 [02:05<00:14, 4.62it/s]
Requesting API: 87%|โโโโโโโโโ | 434/500 [02:06<00:19, 3.32it/s]
Requesting API: 87%|โโโโโโโโโ | 435/500 [02:06<00:25, 2.56it/s]
Requesting API: 87%|โโโโโโโโโ | 436/500 [02:07<00:21, 3.00it/s]
Requesting API: 88%|โโโโโโโโโ | 438/500 [02:07<00:13, 4.62it/s]
Requesting API: 88%|โโโโโโโโโ | 440/500 [02:07<00:09, 6.45it/s]
Requesting API: 88%|โโโโโโโโโ | 442/500 [02:08<00:17, 3.39it/s]
Requesting API: 89%|โโโโโโโโโ | 443/500 [02:08<00:17, 3.20it/s]
Requesting API: 89%|โโโโโโโโโ | 445/500 [02:09<00:15, 3.48it/s]
Requesting API: 89%|โโโโโโโโโ | 447/500 [02:09<00:12, 4.15it/s]
Requesting API: 90%|โโโโโโโโโ | 448/500 [02:10<00:24, 2.13it/s]
Requesting API: 90%|โโโโโโโโโ | 449/500 [02:11<00:21, 2.40it/s]
Requesting API: 90%|โโโโโโโโโ | 450/500 [02:11<00:17, 2.83it/s]
Requesting API: 90%|โโโโโโโโโ | 451/500 [02:11<00:16, 2.89it/s]
Requesting API: 91%|โโโโโโโโโ | 453/500 [02:12<00:16, 2.87it/s]
Requesting API: 91%|โโโโโโโโโ | 454/500 [02:13<00:20, 2.25it/s]
Requesting API: 91%|โโโโโโโโโโ| 457/500 [02:13<00:11, 3.62it/s]
Requesting API: 92%|โโโโโโโโโโ| 458/500 [02:13<00:11, 3.78it/s]
Requesting API: 92%|โโโโโโโโโโ| 459/500 [02:15<00:25, 1.60it/s]
Requesting API: 92%|โโโโโโโโโโ| 460/500 [02:16<00:22, 1.74it/s]
Requesting API: 92%|โโโโโโโโโโ| 462/500 [02:16<00:16, 2.26it/s]
Requesting API: 93%|โโโโโโโโโโ| 463/500 [02:16<00:15, 2.34it/s]
Requesting API: 93%|โโโโโโโโโโ| 464/500 [02:17<00:19, 1.82it/s]
Requesting API: 93%|โโโโโโโโโโ| 465/500 [02:18<00:17, 2.02it/s]
Requesting API: 93%|โโโโโโโโโโ| 466/500 [02:18<00:17, 1.94it/s]
Requesting API: 93%|โโโโโโโโโโ| 467/500 [02:18<00:14, 2.24it/s]
Requesting API: 94%|โโโโโโโโโโ| 468/500 [02:19<00:13, 2.45it/s]
Requesting API: 94%|โโโโโโโโโโ| 470/500 [02:19<00:08, 3.42it/s]
Requesting API: 94%|โโโโโโโโโโ| 471/500 [02:19<00:07, 3.75it/s]
Requesting API: 94%|โโโโโโโโโโ| 472/500 [02:20<00:08, 3.20it/s]
Requesting API: 95%|โโโโโโโโโโ| 473/500 [02:21<00:12, 2.19it/s]
Requesting API: 95%|โโโโโโโโโโ| 474/500 [02:21<00:10, 2.38it/s]
Requesting API: 95%|โโโโโโโโโโ| 475/500 [02:21<00:09, 2.62it/s]
Requesting API: 95%|โโโโโโโโโโ| 476/500 [02:22<00:08, 2.67it/s]
Requesting API: 95%|โโโโโโโโโโ| 477/500 [02:22<00:07, 2.89it/s]
Requesting API: 96%|โโโโโโโโโโ| 479/500 [02:22<00:06, 3.36it/s]
Requesting API: 96%|โโโโโโโโโโ| 481/500 [02:23<00:04, 4.24it/s]
Requesting API: 96%|โโโโโโโโโโ| 482/500 [02:23<00:06, 2.73it/s]
Requesting API: 97%|โโโโโโโโโโ| 483/500 [02:24<00:06, 2.56it/s]
Requesting API: 97%|โโโโโโโโโโ| 485/500 [02:24<00:04, 3.53it/s]
Requesting API: 97%|โโโโโโโโโโ| 486/500 [02:24<00:03, 3.87it/s]
Requesting API: 97%|โโโโโโโโโโ| 487/500 [02:25<00:04, 2.72it/s]
Requesting API: 98%|โโโโโโโโโโ| 489/500 [02:25<00:02, 3.88it/s]
Requesting API: 98%|โโโโโโโโโโ| 490/500 [02:25<00:02, 4.33it/s]
Requesting API: 98%|โโโโโโโโโโ| 491/500 [02:26<00:03, 2.55it/s]
Requesting API: 98%|โโโโโโโโโโ| 492/500 [02:27<00:03, 2.64it/s]
Requesting API: 99%|โโโโโโโโโโ| 493/500 [02:27<00:02, 2.53it/s]
Requesting API: 99%|โโโโโโโโโโ| 494/500 [02:27<00:01, 3.04it/s]
Requesting API: 99%|โโโโโโโโโโ| 495/500 [02:28<00:02, 2.08it/s]
Requesting API: 99%|โโโโโโโโโโ| 496/500 [02:29<00:01, 2.00it/s]
Requesting API: 100%|โโโโโโโโโโ| 498/500 [02:29<00:00, 3.00it/s]
Requesting API: 100%|โโโโโโโโโโ| 499/500 [02:29<00:00, 2.98it/s]
Requesting API: 100%|โโโโโโโโโโ| 500/500 [02:31<00:00, 1.45it/s]
Requesting API: 100%|โโโโโโโโโโ| 500/500 [02:31<00:00, 3.30it/s]
Requesting API: 0%| | 0/541 [00:00<?, ?it/s]
Requesting API: 0%| | 1/541 [00:00<03:34, 2.52it/s]
Requesting API: 1%| | 4/541 [00:00<00:58, 9.25it/s]
Requesting API: 1%| | 6/541 [00:00<01:24, 6.31it/s]
Requesting API: 1%|โ | 8/541 [00:01<01:07, 7.94it/s]
Requesting API: 2%|โ | 10/541 [00:01<01:04, 8.20it/s]
Requesting API: 2%|โ | 12/541 [00:01<01:06, 7.95it/s]
Requesting API: 3%|โ | 14/541 [00:02<01:24, 6.21it/s]
Requesting API: 3%|โ | 15/541 [00:02<01:26, 6.05it/s]
Requesting API: 3%|โ | 16/541 [00:02<01:28, 5.92it/s]
Requesting API: 4%|โ | 19/541 [00:02<01:25, 6.11it/s]
Requesting API: 4%|โ | 22/541 [00:03<01:05, 7.97it/s]
Requesting API: 4%|โ | 23/541 [00:03<01:19, 6.53it/s]
Requesting API: 4%|โ | 24/541 [00:03<01:22, 6.27it/s]
Requesting API: 5%|โ | 26/541 [00:03<01:07, 7.67it/s]
Requesting API: 5%|โ | 28/541 [00:04<01:34, 5.42it/s]
Requesting API: 6%|โ | 30/541 [00:04<01:43, 4.91it/s]
Requesting API: 6%|โ | 31/541 [00:05<01:44, 4.87it/s]
Requesting API: 6%|โ | 33/541 [00:05<01:34, 5.37it/s]
Requesting API: 6%|โ | 34/541 [00:05<02:05, 4.05it/s]
Requesting API: 7%|โ | 36/541 [00:06<01:53, 4.45it/s]
Requesting API: 7%|โ | 37/541 [00:06<01:59, 4.22it/s]
Requesting API: 7%|โ | 38/541 [00:06<02:18, 3.64it/s]
Requesting API: 7%|โ | 40/541 [00:07<01:38, 5.09it/s]
Requesting API: 8%|โ | 41/541 [00:07<02:14, 3.73it/s]
Requesting API: 8%|โ | 42/541 [00:07<01:56, 4.27it/s]
Requesting API: 8%|โ | 44/541 [00:08<02:04, 3.98it/s]
Requesting API: 8%|โ | 45/541 [00:08<01:55, 4.28it/s]
Requesting API: 9%|โ | 47/541 [00:08<01:20, 6.17it/s]
Requesting API: 9%|โ | 49/541 [00:08<01:21, 6.03it/s]
Requesting API: 9%|โ | 50/541 [00:09<01:19, 6.16it/s]
Requesting API: 10%|โ | 53/541 [00:09<01:22, 5.92it/s]
Requesting API: 10%|โ | 54/541 [00:09<01:41, 4.81it/s]
Requesting API: 10%|โ | 55/541 [00:10<01:37, 4.97it/s]
Requesting API: 10%|โ | 56/541 [00:10<02:38, 3.05it/s]
Requesting API: 11%|โ | 58/541 [00:11<02:14, 3.60it/s]
Requesting API: 11%|โ | 59/541 [00:11<02:08, 3.76it/s]
Requesting API: 11%|โ | 60/541 [00:11<01:49, 4.39it/s]
Requesting API: 11%|โโ | 61/541 [00:12<02:18, 3.45it/s]
Requesting API: 11%|โโ | 62/541 [00:12<02:58, 2.69it/s]
Requesting API: 12%|โโ | 63/541 [00:12<02:25, 3.29it/s]
Requesting API: 12%|โโ | 65/541 [00:12<01:35, 5.01it/s]
Requesting API: 12%|โโ | 67/541 [00:13<01:19, 5.96it/s]
Requesting API: 13%|โโ | 69/541 [00:13<01:14, 6.31it/s]
Requesting API: 13%|โโ | 70/541 [00:13<01:18, 5.98it/s]
Requesting API: 13%|โโ | 71/541 [00:14<01:51, 4.23it/s]
Requesting API: 13%|โโ | 73/541 [00:14<01:21, 5.71it/s]
Requesting API: 14%|โโ | 74/541 [00:14<01:19, 5.85it/s]
Requesting API: 14%|โโ | 76/541 [00:14<01:05, 7.14it/s]
Requesting API: 14%|โโ | 77/541 [00:15<01:31, 5.09it/s]
Requesting API: 15%|โโ | 80/541 [00:15<01:02, 7.38it/s]
Requesting API: 15%|โโ | 81/541 [00:15<00:59, 7.70it/s]
Requesting API: 15%|โโ | 82/541 [00:16<01:51, 4.11it/s]
Requesting API: 15%|โโ | 83/541 [00:16<01:36, 4.74it/s]
Requesting API: 16%|โโ | 85/541 [00:16<02:06, 3.61it/s]
Requesting API: 16%|โโ | 87/541 [00:17<01:33, 4.85it/s]
Requesting API: 16%|โโ | 88/541 [00:17<01:49, 4.13it/s]
Requesting API: 16%|โโ | 89/541 [00:17<01:53, 3.98it/s]
Requesting API: 17%|โโ | 91/541 [00:17<01:31, 4.91it/s]
Requesting API: 17%|โโ | 94/541 [00:18<01:29, 5.02it/s]
Requesting API: 18%|โโ | 96/541 [00:19<01:34, 4.71it/s]
Requesting API: 18%|โโ | 98/541 [00:19<01:14, 5.94it/s]
Requesting API: 18%|โโ | 99/541 [00:19<01:29, 4.96it/s]
Requesting API: 18%|โโ | 100/541 [00:19<01:22, 5.34it/s]
Requesting API: 19%|โโ | 103/541 [00:19<01:05, 6.72it/s]
Requesting API: 19%|โโ | 104/541 [00:20<01:21, 5.37it/s]
Requesting API: 20%|โโ | 106/541 [00:21<02:03, 3.51it/s]
Requesting API: 20%|โโ | 108/541 [00:22<02:18, 3.14it/s]
Requesting API: 20%|โโ | 109/541 [00:22<02:04, 3.48it/s]
Requesting API: 21%|โโ | 112/541 [00:22<01:26, 4.97it/s]
Requesting API: 21%|โโ | 113/541 [00:22<01:33, 4.57it/s]
Requesting API: 21%|โโ | 114/541 [00:22<01:25, 4.98it/s]
Requesting API: 21%|โโโ | 116/541 [00:23<01:37, 4.36it/s]
Requesting API: 22%|โโโ | 117/541 [00:23<01:57, 3.62it/s]
Requesting API: 22%|โโโ | 118/541 [00:24<02:29, 2.84it/s]
Requesting API: 22%|โโโ | 120/541 [00:24<02:06, 3.34it/s]
Requesting API: 23%|โโโ | 122/541 [00:25<01:36, 4.35it/s]
Requesting API: 23%|โโโ | 125/541 [00:25<01:26, 4.81it/s]
Requesting API: 23%|โโโ | 126/541 [00:26<01:43, 4.00it/s]
Requesting API: 24%|โโโ | 129/541 [00:26<01:14, 5.52it/s]
Requesting API: 24%|โโโ | 130/541 [00:27<01:47, 3.83it/s]
Requesting API: 24%|โโโ | 132/541 [00:27<01:49, 3.73it/s]
Requesting API: 25%|โโโ | 134/541 [00:27<01:28, 4.61it/s]
Requesting API: 25%|โโโ | 136/541 [00:28<01:10, 5.73it/s]
Requesting API: 25%|โโโ | 137/541 [00:28<01:20, 5.03it/s]
Requesting API: 26%|โโโ | 138/541 [00:29<01:59, 3.37it/s]
Requesting API: 26%|โโโ | 140/541 [00:29<01:28, 4.52it/s]
Requesting API: 26%|โโโ | 141/541 [00:29<01:44, 3.83it/s]
Requesting API: 26%|โโโ | 142/541 [00:29<01:34, 4.23it/s]
Requesting API: 26%|โโโ | 143/541 [00:30<01:34, 4.23it/s]
Requesting API: 27%|โโโ | 145/541 [00:30<01:48, 3.64it/s]
Requesting API: 27%|โโโ | 147/541 [00:30<01:18, 5.05it/s]
Requesting API: 28%|โโโ | 149/541 [00:31<01:10, 5.57it/s]
Requesting API: 28%|โโโ | 151/541 [00:31<00:58, 6.65it/s]
Requesting API: 28%|โโโ | 152/541 [00:31<00:55, 7.07it/s]
Requesting API: 28%|โโโ | 153/541 [00:31<01:23, 4.67it/s]
Requesting API: 28%|โโโ | 154/541 [00:32<01:26, 4.47it/s]
Requesting API: 29%|โโโ | 155/541 [00:32<01:24, 4.57it/s]
Requesting API: 29%|โโโ | 156/541 [00:32<01:20, 4.78it/s]
Requesting API: 29%|โโโ | 158/541 [00:32<01:13, 5.23it/s]
Requesting API: 29%|โโโ | 159/541 [00:33<01:12, 5.30it/s]
Requesting API: 30%|โโโ | 161/541 [00:33<01:00, 6.24it/s]
Requesting API: 30%|โโโ | 162/541 [00:33<00:56, 6.74it/s]
Requesting API: 30%|โโโ | 164/541 [00:33<00:43, 8.60it/s]
Requesting API: 30%|โโโ | 165/541 [00:33<00:47, 7.95it/s]
Requesting API: 31%|โโโ | 166/541 [00:33<00:58, 6.39it/s]
Requesting API: 31%|โโโ | 167/541 [00:34<01:10, 5.32it/s]
Requesting API: 31%|โโโ | 169/541 [00:34<00:56, 6.54it/s]
Requesting API: 31%|โโโโ | 170/541 [00:34<01:12, 5.14it/s]
Requesting API: 32%|โโโโ | 173/541 [00:35<01:05, 5.60it/s]
Requesting API: 32%|โโโโ | 175/541 [00:35<00:52, 7.03it/s]
Requesting API: 33%|โโโโ | 176/541 [00:35<01:04, 5.63it/s]
Requesting API: 33%|โโโโ | 177/541 [00:36<01:56, 3.12it/s]
Requesting API: 33%|โโโโ | 178/541 [00:36<01:42, 3.54it/s]
Requesting API: 33%|โโโโ | 180/541 [00:36<01:14, 4.82it/s]
Requesting API: 33%|โโโโ | 181/541 [00:37<01:08, 5.25it/s]
Requesting API: 34%|โโโโ | 182/541 [00:37<01:33, 3.82it/s]
Requesting API: 34%|โโโโ | 184/541 [00:37<01:05, 5.47it/s]
Requesting API: 34%|โโโโ | 185/541 [00:37<01:07, 5.31it/s]
Requesting API: 35%|โโโโ | 187/541 [00:37<00:49, 7.14it/s]
Requesting API: 35%|โโโโ | 188/541 [00:38<00:47, 7.48it/s]
Requesting API: 35%|โโโโ | 189/541 [00:38<00:44, 7.87it/s]
Requesting API: 35%|โโโโ | 191/541 [00:38<00:34, 10.26it/s]
Requesting API: 36%|โโโโ | 193/541 [00:38<00:29, 11.69it/s]
Requesting API: 36%|โโโโ | 195/541 [00:38<00:33, 10.38it/s]
Requesting API: 36%|โโโโ | 197/541 [00:38<00:33, 10.15it/s]
Requesting API: 37%|โโโโ | 199/541 [00:39<00:32, 10.55it/s]
Requesting API: 37%|โโโโ | 201/541 [00:39<00:31, 10.77it/s]
Requesting API: 38%|โโโโ | 203/541 [00:39<00:41, 8.24it/s]
Requesting API: 38%|โโโโ | 204/541 [00:39<00:51, 6.48it/s]
Requesting API: 38%|โโโโ | 205/541 [00:40<00:53, 6.30it/s]
Requesting API: 38%|โโโโ | 207/541 [00:40<00:41, 8.01it/s]
Requesting API: 38%|โโโโ | 208/541 [00:40<00:47, 7.06it/s]
Requesting API: 39%|โโโโ | 209/541 [00:40<00:47, 6.95it/s]
Requesting API: 39%|โโโโ | 210/541 [00:40<00:46, 7.13it/s]
Requesting API: 39%|โโโโ | 212/541 [00:40<00:42, 7.69it/s]
Requesting API: 39%|โโโโ | 213/541 [00:41<00:42, 7.73it/s]
Requesting API: 40%|โโโโ | 214/541 [00:41<00:58, 5.62it/s]
Requesting API: 40%|โโโโ | 215/541 [00:41<01:08, 4.77it/s]
Requesting API: 40%|โโโโ | 217/541 [00:41<00:51, 6.29it/s]
Requesting API: 40%|โโโโ | 218/541 [00:42<01:01, 5.21it/s]
Requesting API: 41%|โโโโ | 220/541 [00:42<00:46, 6.86it/s]
Requesting API: 41%|โโโโ | 221/541 [00:42<01:02, 5.08it/s]
Requesting API: 41%|โโโโ | 222/541 [00:42<01:03, 5.04it/s]
Requesting API: 41%|โโโโ | 223/541 [00:43<01:49, 2.89it/s]
Requesting API: 41%|โโโโโ | 224/541 [00:43<01:31, 3.48it/s]
Requesting API: 42%|โโโโโ | 225/541 [00:44<01:40, 3.14it/s]
Requesting API: 42%|โโโโโ | 226/541 [00:44<01:30, 3.49it/s]
Requesting API: 42%|โโโโโ | 228/541 [00:44<01:06, 4.74it/s]
Requesting API: 42%|โโโโโ | 229/541 [00:44<00:57, 5.40it/s]
Requesting API: 43%|โโโโโ | 230/541 [00:45<01:06, 4.67it/s]
Requesting API: 43%|โโโโโ | 231/541 [00:45<01:17, 3.98it/s]
Requesting API: 43%|โโโโโ | 232/541 [00:45<01:49, 2.82it/s]
Requesting API: 43%|โโโโโ | 233/541 [00:46<01:35, 3.22it/s]
Requesting API: 43%|โโโโโ | 234/541 [00:46<02:15, 2.27it/s]
Requesting API: 43%|โโโโโ | 235/541 [00:47<01:46, 2.88it/s]
Requesting API: 44%|โโโโโ | 237/541 [00:47<01:25, 3.55it/s]
Requesting API: 44%|โโโโโ | 238/541 [00:47<01:21, 3.72it/s]
Requesting API: 44%|โโโโโ | 239/541 [00:48<02:16, 2.22it/s]
Requesting API: 45%|โโโโโ | 241/541 [00:49<01:38, 3.04it/s]
Requesting API: 45%|โโโโโ | 243/541 [00:49<01:07, 4.39it/s]
Requesting API: 45%|โโโโโ | 244/541 [00:49<01:03, 4.71it/s]
Requesting API: 45%|โโโโโ | 245/541 [00:49<01:02, 4.73it/s]
Requesting API: 45%|โโโโโ | 246/541 [00:49<01:04, 4.61it/s]
Requesting API: 46%|โโโโโ | 247/541 [00:49<00:58, 5.04it/s]
Requesting API: 46%|โโโโโ | 250/541 [00:50<00:49, 5.83it/s]
Requesting API: 47%|โโโโโ | 252/541 [00:50<00:41, 6.95it/s]
Requesting API: 47%|โโโโโ | 254/541 [00:50<00:35, 8.13it/s]
Requesting API: 47%|โโโโโ | 255/541 [00:50<00:42, 6.70it/s]
Requesting API: 48%|โโโโโ | 257/541 [00:51<00:52, 5.45it/s]
Requesting API: 48%|โโโโโ | 259/541 [00:51<00:45, 6.17it/s]
Requesting API: 48%|โโโโโ | 261/541 [00:51<00:41, 6.74it/s]
Requesting API: 48%|โโโโโ | 262/541 [00:52<00:51, 5.42it/s]
Requesting API: 49%|โโโโโ | 264/541 [00:52<00:41, 6.60it/s]
Requesting API: 49%|โโโโโ | 265/541 [00:52<00:41, 6.63it/s]
Requesting API: 49%|โโโโโ | 266/541 [00:52<00:41, 6.65it/s]
Requesting API: 50%|โโโโโ | 269/541 [00:52<00:28, 9.48it/s]
Requesting API: 50%|โโโโโ | 271/541 [00:53<00:49, 5.51it/s]
Requesting API: 51%|โโโโโ | 274/541 [00:53<00:36, 7.30it/s]
Requesting API: 51%|โโโโโ | 275/541 [00:53<00:35, 7.48it/s]
Requesting API: 51%|โโโโโ | 277/541 [00:54<00:28, 9.13it/s]
Requesting API: 52%|โโโโโโ | 279/541 [00:54<00:27, 9.41it/s]
Requesting API: 52%|โโโโโโ | 281/541 [00:54<00:32, 7.96it/s]
Requesting API: 52%|โโโโโโ | 283/541 [00:54<00:36, 7.01it/s]
Requesting API: 52%|โโโโโโ | 284/541 [00:55<00:40, 6.34it/s]
Requesting API: 53%|โโโโโโ | 286/541 [00:55<00:32, 7.80it/s]
Requesting API: 53%|โโโโโโ | 288/541 [00:55<00:27, 9.09it/s]
Requesting API: 54%|โโโโโโ | 290/541 [00:55<00:27, 9.01it/s]
Requesting API: 54%|โโโโโโ | 292/541 [00:55<00:32, 7.74it/s]
Requesting API: 54%|โโโโโโ | 293/541 [00:56<00:34, 7.09it/s]
Requesting API: 54%|โโโโโโ | 294/541 [00:56<00:42, 5.76it/s]
Requesting API: 55%|โโโโโโ | 296/541 [00:56<00:45, 5.40it/s]
Requesting API: 55%|โโโโโโ | 297/541 [00:58<01:33, 2.61it/s]
Requesting API: 55%|โโโโโโ | 299/541 [00:58<01:05, 3.69it/s]
Requesting API: 56%|โโโโโโ | 302/541 [00:58<00:55, 4.30it/s]
Requesting API: 56%|โโโโโโ | 305/541 [00:59<00:42, 5.50it/s]
Requesting API: 57%|โโโโโโ | 306/541 [00:59<00:47, 4.98it/s]
Requesting API: 57%|โโโโโโ | 309/541 [00:59<00:37, 6.19it/s]
Requesting API: 57%|โโโโโโ | 310/541 [01:00<00:48, 4.75it/s]
Requesting API: 58%|โโโโโโ | 312/541 [01:00<00:46, 4.97it/s]
Requesting API: 58%|โโโโโโ | 313/541 [01:00<00:44, 5.12it/s]
Requesting API: 58%|โโโโโโ | 314/541 [01:00<00:40, 5.61it/s]
Requesting API: 58%|โโโโโโ | 316/541 [01:00<00:32, 6.92it/s]
Requesting API: 59%|โโโโโโ | 318/541 [01:01<00:43, 5.14it/s]
Requesting API: 59%|โโโโโโ | 320/541 [01:01<00:33, 6.51it/s]
Requesting API: 59%|โโโโโโ | 321/541 [01:01<00:39, 5.60it/s]
Requesting API: 60%|โโโโโโ | 322/541 [01:02<00:37, 5.87it/s]
Requesting API: 60%|โโโโโโ | 324/541 [01:02<00:29, 7.48it/s]
Requesting API: 60%|โโโโโโ | 326/541 [01:02<00:33, 6.50it/s]
Requesting API: 60%|โโโโโโ | 327/541 [01:03<01:19, 2.71it/s]
Requesting API: 61%|โโโโโโ | 329/541 [01:04<01:14, 2.84it/s]
Requesting API: 61%|โโโโโโ | 330/541 [01:04<01:07, 3.12it/s]
Requesting API: 61%|โโโโโโ | 331/541 [01:04<00:57, 3.64it/s]
Requesting API: 61%|โโโโโโโ | 332/541 [01:04<00:52, 4.01it/s]
Requesting API: 62%|โโโโโโโ | 335/541 [01:05<00:40, 5.11it/s]
Requesting API: 62%|โโโโโโโ | 338/541 [01:05<00:30, 6.71it/s]
Requesting API: 63%|โโโโโโโ | 339/541 [01:05<00:28, 6.97it/s]
Requesting API: 63%|โโโโโโโ | 341/541 [01:06<00:26, 7.48it/s]
Requesting API: 63%|โโโโโโโ | 342/541 [01:06<00:30, 6.43it/s]
Requesting API: 63%|โโโโโโโ | 343/541 [01:06<00:33, 5.90it/s]
Requesting API: 64%|โโโโโโโ | 344/541 [01:06<00:30, 6.38it/s]
Requesting API: 64%|โโโโโโโ | 345/541 [01:06<00:31, 6.27it/s]
Requesting API: 64%|โโโโโโโ | 346/541 [01:06<00:30, 6.50it/s]
Requesting API: 64%|โโโโโโโ | 347/541 [01:07<00:37, 5.15it/s]
Requesting API: 64%|โโโโโโโ | 348/541 [01:07<00:41, 4.62it/s]
Requesting API: 65%|โโโโโโโ | 349/541 [01:07<00:38, 4.94it/s]
Requesting API: 65%|โโโโโโโ | 351/541 [01:08<00:45, 4.15it/s]
Requesting API: 65%|โโโโโโโ | 353/541 [01:08<00:33, 5.55it/s]
Requesting API: 66%|โโโโโโโ | 355/541 [01:08<00:30, 6.07it/s]
Requesting API: 66%|โโโโโโโ | 357/541 [01:08<00:29, 6.23it/s]
Requesting API: 66%|โโโโโโโ | 359/541 [01:09<00:24, 7.39it/s]
Requesting API: 67%|โโโโโโโ | 360/541 [01:09<00:30, 5.86it/s]
Requesting API: 67%|โโโโโโโ | 362/541 [01:09<00:28, 6.27it/s]
Requesting API: 67%|โโโโโโโ | 365/541 [01:10<00:22, 7.67it/s]
Requesting API: 68%|โโโโโโโ | 366/541 [01:10<00:34, 5.13it/s]
Requesting API: 68%|โโโโโโโ | 367/541 [01:10<00:33, 5.14it/s]
Requesting API: 68%|โโโโโโโ | 368/541 [01:11<00:48, 3.56it/s]
Requesting API: 68%|โโโโโโโ | 369/541 [01:11<00:53, 3.20it/s]
Requesting API: 68%|โโโโโโโ | 370/541 [01:11<00:49, 3.46it/s]
Requesting API: 69%|โโโโโโโ | 372/541 [01:12<00:34, 4.91it/s]
Requesting API: 69%|โโโโโโโ | 374/541 [01:12<00:30, 5.40it/s]
Requesting API: 69%|โโโโโโโ | 375/541 [01:12<00:38, 4.29it/s]
Requesting API: 70%|โโโโโโโ | 376/541 [01:13<00:55, 2.96it/s]
Requesting API: 70%|โโโโโโโ | 377/541 [01:14<01:03, 2.60it/s]
Requesting API: 70%|โโโโโโโ | 378/541 [01:14<00:55, 2.91it/s]
Requesting API: 70%|โโโโโโโ | 379/541 [01:14<01:04, 2.50it/s]
Requesting API: 70%|โโโโโโโ | 381/541 [01:15<00:47, 3.39it/s]
Requesting API: 71%|โโโโโโโ | 382/541 [01:15<00:53, 2.96it/s]
Requesting API: 71%|โโโโโโโ | 383/541 [01:15<00:47, 3.31it/s]
Requesting API: 71%|โโโโโโโ | 385/541 [01:16<00:41, 3.78it/s]
Requesting API: 71%|โโโโโโโโ | 386/541 [01:16<00:37, 4.12it/s]
Requesting API: 72%|โโโโโโโโ | 387/541 [01:17<01:00, 2.56it/s]
Requesting API: 72%|โโโโโโโโ | 388/541 [01:17<00:52, 2.93it/s]
Requesting API: 72%|โโโโโโโโ | 389/541 [01:17<00:50, 3.00it/s]
Requesting API: 72%|โโโโโโโโ | 390/541 [01:17<00:42, 3.55it/s]
Requesting API: 73%|โโโโโโโโ | 393/541 [01:18<00:26, 5.66it/s]
Requesting API: 73%|โโโโโโโโ | 394/541 [01:18<00:32, 4.51it/s]
Requesting API: 73%|โโโโโโโโ | 395/541 [01:19<00:45, 3.20it/s]
Requesting API: 73%|โโโโโโโโ | 396/541 [01:19<00:41, 3.49it/s]
Requesting API: 73%|โโโโโโโโ | 397/541 [01:19<00:49, 2.89it/s]
Requesting API: 74%|โโโโโโโโ | 398/541 [01:20<00:48, 2.96it/s]
Requesting API: 74%|โโโโโโโโ | 400/541 [01:20<00:49, 2.82it/s]
Requesting API: 74%|โโโโโโโโ | 402/541 [01:21<00:38, 3.63it/s]
Requesting API: 75%|โโโโโโโโ | 405/541 [01:21<00:27, 4.86it/s]
Requesting API: 75%|โโโโโโโโ | 406/541 [01:21<00:28, 4.75it/s]
Requesting API: 75%|โโโโโโโโ | 407/541 [01:22<00:28, 4.65it/s]
Requesting API: 75%|โโโโโโโโ | 408/541 [01:22<00:31, 4.20it/s]
Requesting API: 76%|โโโโโโโโ | 409/541 [01:23<00:42, 3.12it/s]
Requesting API: 76%|โโโโโโโโ | 411/541 [01:23<00:27, 4.65it/s]
Requesting API: 76%|โโโโโโโโ | 412/541 [01:23<00:27, 4.69it/s]
Requesting API: 76%|โโโโโโโโ | 413/541 [01:23<00:28, 4.43it/s]
Requesting API: 77%|โโโโโโโโ | 414/541 [01:23<00:27, 4.54it/s]
Requesting API: 77%|โโโโโโโโ | 416/541 [01:24<00:27, 4.55it/s]
Requesting API: 77%|โโโโโโโโ | 418/541 [01:24<00:22, 5.50it/s]
Requesting API: 77%|โโโโโโโโ | 419/541 [01:24<00:24, 5.03it/s]
Requesting API: 78%|โโโโโโโโ | 421/541 [01:25<00:33, 3.54it/s]
Requesting API: 78%|โโโโโโโโ | 423/541 [01:25<00:24, 4.77it/s]
Requesting API: 78%|โโโโโโโโ | 424/541 [01:25<00:23, 4.89it/s]
Requesting API: 79%|โโโโโโโโ | 425/541 [01:26<00:26, 4.34it/s]
Requesting API: 79%|โโโโโโโโ | 426/541 [01:26<00:25, 4.44it/s]
Requesting API: 79%|โโโโโโโโ | 427/541 [01:26<00:22, 5.04it/s]
Requesting API: 79%|โโโโโโโโ | 428/541 [01:26<00:25, 4.45it/s]
Requesting API: 79%|โโโโโโโโ | 429/541 [01:27<00:24, 4.53it/s]
Requesting API: 79%|โโโโโโโโ | 430/541 [01:27<00:23, 4.77it/s]
Requesting API: 80%|โโโโโโโโ | 431/541 [01:27<00:25, 4.30it/s]
Requesting API: 80%|โโโโโโโโ | 433/541 [01:27<00:16, 6.38it/s]
Requesting API: 80%|โโโโโโโโ | 435/541 [01:27<00:14, 7.29it/s]
Requesting API: 81%|โโโโโโโโ | 436/541 [01:28<00:17, 5.87it/s]
Requesting API: 81%|โโโโโโโโ | 437/541 [01:28<00:20, 5.03it/s]
Requesting API: 81%|โโโโโโโโ | 439/541 [01:28<00:21, 4.74it/s]
Requesting API: 81%|โโโโโโโโโ | 440/541 [01:29<00:20, 4.94it/s]
Requesting API: 82%|โโโโโโโโโ | 441/541 [01:29<00:22, 4.37it/s]
Requesting API: 82%|โโโโโโโโโ | 443/541 [01:29<00:15, 6.31it/s]
Requesting API: 82%|โโโโโโโโโ | 444/541 [01:30<00:24, 3.91it/s]
Requesting API: 82%|โโโโโโโโโ | 445/541 [01:30<00:27, 3.47it/s]
Requesting API: 83%|โโโโโโโโโ | 447/541 [01:30<00:18, 5.02it/s]
Requesting API: 83%|โโโโโโโโโ | 448/541 [01:31<00:24, 3.81it/s]
Requesting API: 83%|โโโโโโโโโ | 449/541 [01:31<00:26, 3.41it/s]
Requesting API: 83%|โโโโโโโโโ | 450/541 [01:31<00:23, 3.82it/s]
Requesting API: 83%|โโโโโโโโโ | 451/541 [01:31<00:21, 4.10it/s]
Requesting API: 84%|โโโโโโโโโ | 453/541 [01:32<00:15, 5.53it/s]
Requesting API: 84%|โโโโโโโโโ | 454/541 [01:32<00:14, 5.82it/s]
Requesting API: 84%|โโโโโโโโโ | 455/541 [01:32<00:14, 5.82it/s]
Requesting API: 84%|โโโโโโโโโ | 456/541 [01:32<00:22, 3.76it/s]
Requesting API: 84%|โโโโโโโโโ | 457/541 [01:33<00:22, 3.70it/s]
Requesting API: 85%|โโโโโโโโโ | 459/541 [01:33<00:15, 5.27it/s]
Requesting API: 85%|โโโโโโโโโ | 460/541 [01:33<00:14, 5.58it/s]
Requesting API: 86%|โโโโโโโโโ | 463/541 [01:33<00:12, 6.40it/s]
Requesting API: 86%|โโโโโโโโโ | 464/541 [01:34<00:20, 3.68it/s]
Requesting API: 86%|โโโโโโโโโ | 465/541 [01:34<00:18, 4.00it/s]
Requesting API: 86%|โโโโโโโโโ | 467/541 [01:35<00:21, 3.45it/s]
Requesting API: 87%|โโโโโโโโโ | 468/541 [01:35<00:19, 3.69it/s]
Requesting API: 87%|โโโโโโโโโ | 469/541 [01:36<00:26, 2.72it/s]
Requesting API: 87%|โโโโโโโโโ | 470/541 [01:37<00:30, 2.33it/s]
Requesting API: 87%|โโโโโโโโโ | 472/541 [01:37<00:21, 3.27it/s]
Requesting API: 88%|โโโโโโโโโ | 474/541 [01:37<00:16, 3.95it/s]
Requesting API: 88%|โโโโโโโโโ | 476/541 [01:37<00:14, 4.51it/s]
Requesting API: 88%|โโโโโโโโโ | 477/541 [01:38<00:12, 4.96it/s]
Requesting API: 88%|โโโโโโโโโ | 478/541 [01:38<00:13, 4.65it/s]
Requesting API: 89%|โโโโโโโโโ | 479/541 [01:38<00:13, 4.56it/s]
Requesting API: 89%|โโโโโโโโโ | 480/541 [01:38<00:12, 4.97it/s]
Requesting API: 89%|โโโโโโโโโ | 481/541 [01:38<00:11, 5.15it/s]
Requesting API: 89%|โโโโโโโโโ | 482/541 [01:39<00:12, 4.89it/s]
Requesting API: 89%|โโโโโโโโโ | 483/541 [01:39<00:14, 3.96it/s]
Requesting API: 89%|โโโโโโโโโ | 484/541 [01:40<00:18, 3.02it/s]
Requesting API: 90%|โโโโโโโโโ | 485/541 [01:40<00:15, 3.60it/s]
Requesting API: 90%|โโโโโโโโโ | 486/541 [01:40<00:13, 4.15it/s]
Requesting API: 90%|โโโโโโโโโ | 488/541 [01:40<00:09, 5.79it/s]
Requesting API: 91%|โโโโโโโโโ | 490/541 [01:40<00:06, 7.75it/s]
Requesting API: 91%|โโโโโโโโโ | 491/541 [01:40<00:06, 7.76it/s]
Requesting API: 91%|โโโโโโโโโ | 492/541 [01:41<00:07, 6.51it/s]
Requesting API: 91%|โโโโโโโโโโ| 494/541 [01:41<00:05, 8.65it/s]
Requesting API: 92%|โโโโโโโโโโ| 496/541 [01:41<00:06, 7.05it/s]
Requesting API: 92%|โโโโโโโโโโ| 497/541 [01:41<00:07, 5.84it/s]
Requesting API: 92%|โโโโโโโโโโ| 498/541 [01:42<00:08, 5.26it/s]
Requesting API: 92%|โโโโโโโโโโ| 499/541 [01:42<00:10, 4.15it/s]
Requesting API: 92%|โโโโโโโโโโ| 500/541 [01:42<00:09, 4.21it/s]
Requesting API: 93%|โโโโโโโโโโ| 502/541 [01:43<00:08, 4.54it/s]
Requesting API: 93%|โโโโโโโโโโ| 504/541 [01:43<00:07, 5.12it/s]
Requesting API: 94%|โโโโโโโโโโ| 506/541 [01:43<00:05, 6.83it/s]
Requesting API: 94%|โโโโโโโโโโ| 507/541 [01:43<00:06, 5.32it/s]
Requesting API: 94%|โโโโโโโโโโ| 509/541 [01:44<00:10, 3.13it/s]
Requesting API: 95%|โโโโโโโโโโ| 514/541 [01:45<00:04, 5.47it/s]
Requesting API: 95%|โโโโโโโโโโ| 515/541 [01:45<00:04, 5.61it/s]
Requesting API: 95%|โโโโโโโโโโ| 516/541 [01:45<00:04, 5.25it/s]
Requesting API: 96%|โโโโโโโโโโ| 517/541 [01:45<00:04, 5.21it/s]
Requesting API: 96%|โโโโโโโโโโ| 518/541 [01:46<00:04, 4.81it/s]
Requesting API: 96%|โโโโโโโโโโ| 519/541 [01:47<00:09, 2.28it/s]
Requesting API: 96%|โโโโโโโโโโ| 520/541 [01:47<00:08, 2.62it/s]
Requesting API: 96%|โโโโโโโโโโ| 521/541 [01:48<00:10, 1.88it/s]
Requesting API: 96%|โโโโโโโโโโ| 522/541 [01:48<00:08, 2.17it/s]
Requesting API: 97%|โโโโโโโโโโ| 523/541 [01:49<00:10, 1.76it/s]
Requesting API: 97%|โโโโโโโโโโ| 524/541 [01:49<00:07, 2.22it/s]
Requesting API: 97%|โโโโโโโโโโ| 526/541 [01:50<00:05, 2.64it/s]
Requesting API: 97%|โโโโโโโโโโ| 527/541 [01:50<00:04, 3.17it/s]
Requesting API: 98%|โโโโโโโโโโ| 528/541 [01:51<00:05, 2.39it/s]
Requesting API: 98%|โโโโโโโโโโ| 530/541 [01:51<00:03, 3.18it/s]
Requesting API: 98%|โโโโโโโโโโ| 531/541 [01:51<00:03, 2.99it/s]
Requesting API: 98%|โโโโโโโโโโ| 532/541 [01:52<00:02, 3.03it/s]
Requesting API: 99%|โโโโโโโโโโ| 533/541 [01:52<00:02, 3.64it/s]
Requesting API: 99%|โโโโโโโโโโ| 534/541 [01:52<00:01, 3.93it/s]
Requesting API: 99%|โโโโโโโโโโ| 535/541 [01:53<00:02, 2.47it/s]
Requesting API: 99%|โโโโโโโโโโ| 536/541 [01:55<00:04, 1.12it/s]
Requesting API: 99%|โโโโโโโโโโ| 537/541 [01:56<00:03, 1.27it/s]
Requesting API: 99%|โโโโโโโโโโ| 538/541 [01:59<00:04, 1.54s/it]
Requesting API: 100%|โโโโโโโโโโ| 539/541 [02:00<00:02, 1.31s/it]
Requesting API: 100%|โโโโโโโโโโ| 540/541 [02:01<00:01, 1.39s/it]
Requesting API: 100%|โโโโโโโโโโ| 541/541 [02:02<00:00, 1.13s/it]
Requesting API: 100%|โโโโโโโโโโ| 541/541 [02:02<00:00, 4.42it/s]
2026-08-08:22:22:07 ERROR [tasks.ifeval.instructions:189] Unable to detect language for text "เถฝเทเถเท เถเทเถฉเทเถธเทเถฑเท เถธเทเถเทเถบเทเถธเทเถเทเถบเท เถฝเทเถเท เถเทเถเทเถธเทเถเทเถบเทเถธเทเถเทเถบเท เถฝเทเถเท เถเทเถเถเทเถเถธเทเถเทเถบเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท due to No features in text.
2026-08-08:22:22:07 ERROR [tasks.ifeval.instructions:189] Unable to detect language for text "เถฝเทเถเท เถเทเถฉเทเถธเทเถฑเท เถธเทเถเทเถบเทเถธเทเถเทเถบเท เถฝเทเถเท เถเทเถเทเถธเทเถเทเถบเทเถธเทเถเทเถบเท เถฝเทเถเท เถเทเถเถเทเถเถธเทเถเทเถบเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท เถฝเทเถเท เถธเทเถเทเถธเทเถเทเถบเท due to No features in text.
2026-08-08:22:22:08 INFO [loggers.evaluation_tracker:247] Saving results aggregated
2026-08-08:22:22:08 INFO [loggers.evaluation_tracker:119] Saving per-task samples to outputs/evals/release/math-keep75-step0150/student/*.jsonl
local-chat-completions ({'model': 'student', 'base_url': 'http://127.0.0.1:8460/v1/chat/completions', 'num_concurrent': 48, 'tokenized_requests': False, 'max_retries': 3}), gen_kwargs: ({'max_gen_toks': 1280}), limit: None, num_fewshot: None, batch_size: 1
| Tasks |Version| Filter |n-shot| Metric | |Value | |Stderr|
|------------------|------:|----------------|-----:|-----------------------|---|-----:|---|------|
|gsm8k_cot_zeroshot| 3|flexible-extract| 0|exact_match |โ |0.6846|ยฑ |0.0128|
| | |strict-match | 0|exact_match |โ |0.0000|ยฑ | 0|
|ifeval | 4|none | 0|inst_level_loose_acc |โ |0.6847|ยฑ | N/A|
| | |none | 0|inst_level_strict_acc |โ |0.6415|ยฑ | N/A|
| | |none | 0|prompt_level_loose_acc |โ |0.5619|ยฑ |0.0214|
| | |none | 0|prompt_level_strict_acc|โ |0.5176|ยฑ |0.0215|
|minerva_math500 | 3|none | 4|exact_match |โ |0.1740|ยฑ |0.0170|
| | |none | 4|math_verify |โ |0.2580|ยฑ |0.0196|
2026-08-08T22:22:10-07:00 code pass [humaneval,mbpp] via /v1/completions (function-continuation)
2026-08-08:22:22:17 INFO [_cli.run:388] Selected Tasks: ['humaneval', 'mbpp']
2026-08-08:22:22:19 INFO [evaluator:214] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234
2026-08-08:22:22:19 INFO [evaluator:239] Initializing local-completions model, with arguments: {'model': 'student', 'base_url': 'http://127.0.0.1:8460/v1/completions', 'tokenizer': 'outputs/release/healed/release-offpolicy-math-keep75/step0150', 'num_concurrent': 48, 'tokenized_requests': False, 'max_retries': 3}
2026-08-08:22:22:19 INFO [models.openai_completions:42] Remote tokenizer not supported. Using huggingface tokenizer backend.
2026-08-08:22:22:19 INFO [models.api_models:179] Using max length 2048 - 1
2026-08-08:22:22:19 INFO [models.api_models:200] Using tokenizer huggingface
2026-08-08:22:22:26 INFO [evaluator_utils:446] Selected tasks:
2026-08-08:22:22:26 INFO [evaluator_utils:480] Task: humaneval (humaneval/humaneval.yaml)
2026-08-08:22:22:26 INFO [evaluator_utils:480] Task: mbpp (mbpp/mbpp.yaml)
2026-08-08:22:22:26 INFO [evaluator:314] humaneval: Using gen_kwargs: {'until': ['\nclass', '\ndef', '\n#', '\nif', '\nprint'], 'max_gen_toks': 1024, 'do_sample': False}
2026-08-08:22:22:26 INFO [evaluator:314] mbpp: Using gen_kwargs: {'until': ['[DONE]'], 'do_sample': False}
2026-08-08:22:22:26 INFO [api.task:312] Building contexts for humaneval on rank 0...
0%| | 0/164 [00:00<?, ?it/s]
88%|โโโโโโโโโ | 145/164 [00:00<00:00, 1444.89it/s]
100%|โโโโโโโโโโ| 164/164 [00:00<00:00, 1476.50it/s]
2026-08-08:22:22:26 INFO [api.task:312] Building contexts for mbpp on rank 0...
0%| | 0/500 [00:00<?, ?it/s]
3%|โ | 17/500 [00:00<00:02, 162.52it/s]
7%|โ | 34/500 [00:00<00:02, 163.57it/s]
10%|โ | 51/500 [00:00<00:02, 163.84it/s]
14%|โโ | 68/500 [00:00<00:02, 163.63it/s]
17%|โโ | 85/500 [00:00<00:02, 163.54it/s]
20%|โโ | 102/500 [00:00<00:02, 163.70it/s]
24%|โโโ | 119/500 [00:00<00:02, 163.63it/s]
27%|โโโ | 136/500 [00:00<00:02, 164.21it/s]
31%|โโโ | 153/500 [00:00<00:02, 164.55it/s]
34%|โโโโ | 170/500 [00:01<00:02, 164.83it/s]
37%|โโโโ | 187/500 [00:01<00:01, 164.74it/s]
41%|โโโโ | 204/500 [00:01<00:01, 165.03it/s]
44%|โโโโโ | 221/500 [00:01<00:01, 165.10it/s]
48%|โโโโโ | 238/500 [00:01<00:01, 164.55it/s]
51%|โโโโโ | 255/500 [00:01<00:01, 164.65it/s]
54%|โโโโโโ | 272/500 [00:01<00:01, 164.82it/s]
58%|โโโโโโ | 289/500 [00:01<00:01, 164.92it/s]
61%|โโโโโโ | 306/500 [00:01<00:01, 164.88it/s]
65%|โโโโโโโ | 323/500 [00:01<00:01, 165.02it/s]
68%|โโโโโโโ | 340/500 [00:02<00:00, 165.10it/s]
71%|โโโโโโโโ | 357/500 [00:02<00:00, 165.14it/s]
75%|โโโโโโโโ | 374/500 [00:02<00:00, 165.25it/s]
78%|โโโโโโโโ | 391/500 [00:02<00:00, 165.28it/s]
82%|โโโโโโโโโ | 408/500 [00:02<00:00, 165.39it/s]
85%|โโโโโโโโโ | 425/500 [00:02<00:00, 165.71it/s]
88%|โโโโโโโโโ | 442/500 [00:02<00:00, 166.16it/s]
92%|โโโโโโโโโโ| 459/500 [00:02<00:00, 165.99it/s]
95%|โโโโโโโโโโ| 476/500 [00:02<00:00, 165.78it/s]
99%|โโโโโโโโโโ| 493/500 [00:02<00:00, 165.64it/s]
100%|โโโโโโโโโโ| 500/500 [00:03<00:00, 164.91it/s]
2026-08-08:22:22:29 INFO [evaluator:585] Running generate_until requests
2026-08-08:22:22:29 INFO [models.api_models:747] Tokenized requests are disabled. Context + generation length is not checked.
Requesting API: 0%| | 0/164 [00:00<?, ?it/s]
Requesting API: 1%| | 1/164 [00:00<02:39, 1.02it/s]
Requesting API: 6%|โ | 10/164 [00:01<00:15, 10.22it/s]
Requesting API: 8%|โ | 13/164 [00:01<00:13, 11.53it/s]
Requesting API: 9%|โ | 15/164 [00:01<00:12, 12.36it/s]
Requesting API: 11%|โ | 18/164 [00:01<00:10, 14.46it/s]
Requesting API: 13%|โโ | 22/164 [00:01<00:07, 17.82it/s]
Requesting API: 15%|โโ | 25/164 [00:01<00:07, 19.18it/s]
Requesting API: 17%|โโ | 28/164 [00:02<00:06, 20.93it/s]
Requesting API: 19%|โโ | 31/164 [00:02<00:06, 20.30it/s]
Requesting API: 22%|โโโ | 36/164 [00:02<00:05, 24.13it/s]
Requesting API: 24%|โโโ | 39/164 [00:02<00:06, 20.50it/s]
Requesting API: 26%|โโโ | 43/164 [00:02<00:05, 23.89it/s]
Requesting API: 30%|โโโ | 49/164 [00:02<00:03, 29.63it/s]
Requesting API: 34%|โโโโ | 55/164 [00:02<00:03, 32.73it/s]
Requesting API: 38%|โโโโ | 62/164 [00:03<00:02, 38.54it/s]
Requesting API: 41%|โโโโ | 67/164 [00:03<00:02, 39.48it/s]
Requesting API: 44%|โโโโโ | 72/164 [00:03<00:02, 34.72it/s]
Requesting API: 47%|โโโโโ | 77/164 [00:03<00:02, 37.01it/s]
Requesting API: 51%|โโโโโ | 83/164 [00:03<00:02, 37.01it/s]
Requesting API: 55%|โโโโโโ | 90/164 [00:03<00:01, 43.94it/s]
Requesting API: 59%|โโโโโโ | 96/164 [00:03<00:01, 43.57it/s]
Requesting API: 62%|โโโโโโโ | 101/164 [00:04<00:01, 38.40it/s]
Requesting API: 65%|โโโโโโโ | 107/164 [00:04<00:01, 42.24it/s]
Requesting API: 69%|โโโโโโโ | 113/164 [00:04<00:01, 43.81it/s]
Requesting API: 76%|โโโโโโโโ | 124/164 [00:04<00:00, 58.62it/s]
Requesting API: 80%|โโโโโโโโ | 131/164 [00:04<00:00, 61.05it/s]
Requesting API: 85%|โโโโโโโโโ | 139/164 [00:04<00:00, 63.96it/s]
Requesting API: 89%|โโโโโโโโโ | 146/164 [00:04<00:00, 45.53it/s]
Requesting API: 93%|โโโโโโโโโโ| 152/164 [00:05<00:00, 29.40it/s]
Requesting API: 96%|โโโโโโโโโโ| 157/164 [00:05<00:00, 30.88it/s]
Requesting API: 99%|โโโโโโโโโโ| 162/164 [00:06<00:00, 17.88it/s]
Requesting API: 100%|โโโโโโโโโโ| 164/164 [00:15<00:00, 10.58it/s]
Requesting API: 0%| | 0/500 [00:00<?, ?it/s]
Requesting API: 0%| | 1/500 [00:01<09:28, 1.14s/it]
Requesting API: 1%| | 4/500 [00:01<02:01, 4.07it/s]
Requesting API: 2%|โ | 8/500 [00:01<00:56, 8.65it/s]
Requesting API: 4%|โ | 18/500 [00:01<00:23, 20.83it/s]
Requesting API: 4%|โ | 22/500 [00:01<00:20, 22.95it/s]
Requesting API: 5%|โ | 27/500 [00:01<00:21, 22.22it/s]
Requesting API: 6%|โ | 31/500 [00:02<00:21, 21.86it/s]
Requesting API: 8%|โ | 38/500 [00:02<00:16, 28.14it/s]
Requesting API: 9%|โ | 43/500 [00:02<00:14, 30.76it/s]
Requesting API: 9%|โ | 47/500 [00:02<00:15, 28.50it/s]
Requesting API: 11%|โ | 54/500 [00:02<00:12, 35.97it/s]
Requesting API: 12%|โโ | 59/500 [00:02<00:11, 38.55it/s]
Requesting API: 13%|โโ | 64/500 [00:02<00:11, 38.17it/s]
Requesting API: 14%|โโ | 71/500 [00:03<00:09, 45.19it/s]
Requesting API: 15%|โโ | 76/500 [00:03<00:14, 29.85it/s]
Requesting API: 16%|โโ | 80/500 [00:03<00:13, 31.20it/s]
Requesting API: 17%|โโ | 84/500 [00:03<00:13, 31.64it/s]
Requesting API: 18%|โโ | 88/500 [00:03<00:13, 30.24it/s]
Requesting API: 18%|โโ | 92/500 [00:03<00:13, 29.65it/s]
Requesting API: 20%|โโ | 98/500 [00:03<00:12, 33.22it/s]
Requesting API: 21%|โโโ | 107/500 [00:04<00:09, 43.23it/s]
Requesting API: 22%|โโโ | 112/500 [00:04<00:08, 43.49it/s]
Requesting API: 23%|โโโ | 117/500 [00:04<00:09, 40.92it/s]
Requesting API: 24%|โโโ | 122/500 [00:04<00:14, 25.72it/s]
Requesting API: 25%|โโโ | 126/500 [00:04<00:13, 26.94it/s]
Requesting API: 26%|โโโ | 132/500 [00:04<00:11, 32.29it/s]
Requesting API: 27%|โโโ | 136/500 [00:05<00:10, 33.43it/s]
Requesting API: 28%|โโโ | 141/500 [00:05<00:09, 36.93it/s]
Requesting API: 29%|โโโ | 146/500 [00:05<00:09, 35.49it/s]
Requesting API: 30%|โโโ | 150/500 [00:05<00:14, 24.77it/s]
Requesting API: 32%|โโโโ | 159/500 [00:05<00:10, 33.90it/s]
Requesting API: 33%|โโโโ | 164/500 [00:06<00:10, 31.40it/s]
Requesting API: 34%|โโโโ | 168/500 [00:06<00:10, 30.67it/s]
Requesting API: 35%|โโโโ | 173/500 [00:06<00:09, 33.72it/s]
Requesting API: 36%|โโโโ | 178/500 [00:06<00:08, 37.30it/s]
Requesting API: 37%|โโโโ | 183/500 [00:06<00:08, 36.04it/s]
Requesting API: 37%|โโโโ | 187/500 [00:06<00:09, 34.36it/s]
Requesting API: 38%|โโโโ | 191/500 [00:06<00:10, 29.10it/s]
Requesting API: 39%|โโโโ | 195/500 [00:06<00:09, 30.57it/s]
Requesting API: 40%|โโโโ | 199/500 [00:07<00:10, 29.96it/s]
Requesting API: 41%|โโโโ | 203/500 [00:07<00:09, 29.71it/s]
Requesting API: 41%|โโโโโ | 207/500 [00:07<00:09, 30.69it/s]
Requesting API: 43%|โโโโโ | 214/500 [00:07<00:07, 39.23it/s]
Requesting API: 44%|โโโโโ | 219/500 [00:07<00:07, 37.54it/s]
Requesting API: 45%|โโโโโ | 225/500 [00:07<00:06, 41.36it/s]
Requesting API: 46%|โโโโโ | 230/500 [00:08<00:09, 29.13it/s]
Requesting API: 47%|โโโโโ | 236/500 [00:08<00:07, 33.84it/s]
Requesting API: 48%|โโโโโ | 240/500 [00:08<00:08, 32.41it/s]
Requesting API: 49%|โโโโโ | 244/500 [00:08<00:07, 33.17it/s]
Requesting API: 50%|โโโโโ | 249/500 [00:08<00:08, 30.67it/s]
Requesting API: 51%|โโโโโ | 254/500 [00:08<00:07, 34.66it/s]
Requesting API: 52%|โโโโโโ | 258/500 [00:08<00:07, 32.54it/s]
Requesting API: 52%|โโโโโโ | 262/500 [00:08<00:07, 31.93it/s]
Requesting API: 54%|โโโโโโ | 268/500 [00:09<00:06, 37.34it/s]
Requesting API: 54%|โโโโโโ | 272/500 [00:09<00:06, 34.10it/s]
Requesting API: 55%|โโโโโโ | 276/500 [00:09<00:07, 31.52it/s]
Requesting API: 56%|โโโโโโ | 280/500 [00:09<00:06, 31.64it/s]
Requesting API: 57%|โโโโโโ | 284/500 [00:09<00:06, 32.42it/s]
Requesting API: 58%|โโโโโโ | 288/500 [00:09<00:07, 29.29it/s]
Requesting API: 59%|โโโโโโ | 295/500 [00:09<00:05, 37.92it/s]
Requesting API: 60%|โโโโโโ | 300/500 [00:09<00:04, 40.82it/s]
Requesting API: 61%|โโโโโโ | 305/500 [00:10<00:04, 42.35it/s]
Requesting API: 62%|โโโโโโโ | 312/500 [00:10<00:03, 47.43it/s]
Requesting API: 63%|โโโโโโโ | 317/500 [00:10<00:04, 37.86it/s]
Requesting API: 65%|โโโโโโโ | 323/500 [00:10<00:04, 41.71it/s]
Requesting API: 66%|โโโโโโโ | 328/500 [00:10<00:04, 38.55it/s]
Requesting API: 67%|โโโโโโโ | 333/500 [00:10<00:04, 38.38it/s]
Requesting API: 68%|โโโโโโโ | 338/500 [00:10<00:04, 38.23it/s]
Requesting API: 69%|โโโโโโโ | 343/500 [00:11<00:03, 40.29it/s]
Requesting API: 70%|โโโโโโโ | 348/500 [00:11<00:04, 37.85it/s]
Requesting API: 71%|โโโโโโโ | 355/500 [00:11<00:03, 44.87it/s]
Requesting API: 72%|โโโโโโโโ | 360/500 [00:11<00:03, 43.75it/s]
Requesting API: 73%|โโโโโโโโ | 366/500 [00:11<00:03, 40.52it/s]
Requesting API: 74%|โโโโโโโโ | 372/500 [00:11<00:03, 40.31it/s]
Requesting API: 75%|โโโโโโโโ | 377/500 [00:11<00:03, 39.43it/s]
Requesting API: 77%|โโโโโโโโ | 384/500 [00:12<00:02, 43.70it/s]
Requesting API: 78%|โโโโโโโโ | 390/500 [00:12<00:02, 46.35it/s]
Requesting API: 79%|โโโโโโโโ | 395/500 [00:12<00:02, 46.86it/s]
Requesting API: 80%|โโโโโโโโ | 400/500 [00:12<00:02, 46.69it/s]
Requesting API: 81%|โโโโโโโโโ | 407/500 [00:12<00:01, 51.19it/s]
Requesting API: 83%|โโโโโโโโโ | 414/500 [00:12<00:01, 51.13it/s]
Requesting API: 84%|โโโโโโโโโ | 421/500 [00:12<00:01, 48.89it/s]
Requesting API: 85%|โโโโโโโโโ | 426/500 [00:12<00:01, 39.13it/s]
Requesting API: 87%|โโโโโโโโโ | 436/500 [00:13<00:01, 51.11it/s]
Requesting API: 88%|โโโโโโโโโ | 442/500 [00:13<00:01, 48.57it/s]
Requesting API: 90%|โโโโโโโโโ | 452/500 [00:13<00:00, 59.31it/s]
Requesting API: 92%|โโโโโโโโโโ| 459/500 [00:13<00:00, 59.08it/s]
Requesting API: 94%|โโโโโโโโโโ| 468/500 [00:13<00:00, 66.24it/s]
Requesting API: 95%|โโโโโโโโโโ| 475/500 [00:13<00:00, 59.32it/s]
Requesting API: 97%|โโโโโโโโโโ| 483/500 [00:13<00:00, 56.83it/s]
Requesting API: 98%|โโโโโโโโโโ| 490/500 [00:13<00:00, 53.66it/s]
Requesting API: 100%|โโโโโโโโโโ| 498/500 [00:14<00:00, 46.72it/s]
Requesting API: 100%|โโโโโโโโโโ| 500/500 [00:16<00:00, 30.65it/s]
2026-08-08:22:26:28 INFO [loggers.evaluation_tracker:247] Saving results aggregated
2026-08-08:22:26:28 INFO [loggers.evaluation_tracker:119] Saving per-task samples to outputs/evals/release/math-keep75-step0150/student/*.jsonl
local-completions ({'model': 'student', 'base_url': 'http://127.0.0.1:8460/v1/completions', 'tokenizer': 'outputs/release/healed/release-offpolicy-math-keep75/step0150', 'num_concurrent': 48, 'tokenized_requests': False, 'max_retries': 3}), gen_kwargs: ({}), limit: None, num_fewshot: None, batch_size: 1
| Tasks |Version| Filter |n-shot| Metric | |Value | |Stderr|
|---------|------:|-----------|-----:|---------|---|-----:|---|-----:|
|humaneval| 1|create_test| 0|pass@1 |โ |0.2744|ยฑ |0.0349|
|mbpp | 1|none | 3|pass_at_1|โ |0.2420|ยฑ |0.0192|
2026-08-08T22:26:29-07:00 lm_eval exit=0 -> outputs/evals/release/math-keep75-step0150
|