| 2026-08-08T22:01:57-07:00 serving outputs/release/healed/release-offpolicy-math-keep50/step0150 on GPU 1 port 8461 (pp=1 think=template-default) |
| 2026-08-08T22:01:57-07:00 waiting for server /health ... |
| 2026-08-08T22:02:32-07:00 server up; chat pass [gsm8k_cot_zeroshot,minerva_math500,ifeval] |
| 2026-08-08:22:02:39 INFO [_cli.run:388] Selected Tasks: ['gsm8k_cot_zeroshot', 'minerva_math500', 'ifeval'] |
| 2026-08-08:22:02:41 INFO [evaluator:214] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234 |
| 2026-08-08:22:02:41 WARNING [evaluator:226] generation_kwargs: {'max_gen_toks': 1280} specified through cli, these settings will update set parameters in yaml tasks. Ensure 'do_sample=True' for non-greedy decoding! |
| 2026-08-08:22:02:41 INFO [evaluator:239] Initializing local-chat-completions model, with arguments: {'model': 'student', 'base_url': 'http://127.0.0.1:8461/v1/chat/completions', 'num_concurrent': 48, 'tokenized_requests': False, 'max_retries': 3} |
| 2026-08-08:22:02:41 INFO [models.api_models:179] Using max length 2048 - 1 |
| 2026-08-08:22:02:41 INFO [models.api_models:200] Using tokenizer None |
| 2026-08-08:22:02:46 INFO [evaluator_utils:446] Selected tasks: |
| 2026-08-08:22:02:46 INFO [evaluator_utils:480] Task: gsm8k_cot_zeroshot (gsm8k/gsm8k-cot-zeroshot.yaml) |
| 2026-08-08:22:02:46 INFO [evaluator_utils:480] Task: ifeval (ifeval/ifeval.yaml) |
| 2026-08-08:22:02:46 INFO [evaluator_utils:480] Task: minerva_math500 (minerva_math/minerva_math500.yaml) |
| 2026-08-08:22:02:46 INFO [evaluator:314] gsm8k_cot_zeroshot: Using gen_kwargs: {'until': ['Q:', '</s>', '<|im_end|>'], 'do_sample': False, 'max_gen_toks': 1280} |
| 2026-08-08:22:02:46 INFO [evaluator:314] minerva_math500: Using gen_kwargs: {'until': ['Problem:'], 'do_sample': False, 'temperature': 0.0, 'max_gen_toks': 1280} |
| 2026-08-08:22:02:46 INFO [evaluator:314] ifeval: Using gen_kwargs: {'until': [], 'do_sample': False, 'temperature': 0.0, 'max_gen_toks': 1280} |
| 2026-08-08:22:02:46 INFO [api.task:312] Building contexts for gsm8k_cot_zeroshot on rank 0... |
|
0%| | 0/1319 [00:00<?, ?it/s]
14%|ββ | 191/1319 [00:00<00:00, 1904.84it/s]
29%|βββ | 386/1319 [00:00<00:00, 1929.14it/s]
44%|βββββ | 583/1319 [00:00<00:00, 1944.57it/s]
59%|ββββββ | 779/1319 [00:00<00:00, 1950.29it/s]
74%|ββββββββ | 975/1319 [00:00<00:00, 1953.64it/s]
89%|βββββββββ | 1171/1319 [00:00<00:00, 1953.28it/s]
100%|ββββββββββ| 1319/1319 [00:00<00:00, 1948.61it/s] |
| 2026-08-08:22:02:46 INFO [api.task:312] Building contexts for minerva_math500 on rank 0... |
|
0%| | 0/500 [00:00<?, ?it/s]
8%|β | 42/500 [00:00<00:01, 410.86it/s]
17%|ββ | 85/500 [00:00<00:00, 416.47it/s]
26%|βββ | 128/500 [00:00<00:00, 420.05it/s]
34%|ββββ | 171/500 [00:00<00:00, 422.38it/s]
43%|βββββ | 214/500 [00:00<00:00, 423.69it/s]
51%|ββββββ | 257/500 [00:00<00:00, 424.61it/s]
60%|ββββββ | 300/500 [00:00<00:00, 425.43it/s]
69%|βββββββ | 343/500 [00:00<00:00, 424.97it/s]
77%|ββββββββ | 386/500 [00:00<00:00, 426.02it/s]
86%|βββββββββ | 429/500 [00:01<00:00, 402.05it/s]
94%|ββββββββββ| 472/500 [00:01<00:00, 409.89it/s]
100%|ββββββββββ| 500/500 [00:01<00:00, 417.73it/s] |
| 2026-08-08:22:02:48 INFO [api.task:312] Building contexts for ifeval on rank 0... |
|
0%| | 0/541 [00:00<?, ?it/s]
100%|ββββββββββ| 541/541 [00:00<00:00, 70590.09it/s] |
| 2026-08-08:22:02:48 INFO [evaluator:585] Running generate_until requests |
| 2026-08-08:22:02:48 INFO [models.api_models:747] Tokenized requests are disabled. Context + generation length is not checked. |
|
Requesting API: 0%| | 0/1319 [00:00<?, ?it/s]
Requesting API: 0%| | 1/1319 [00:01<34:02, 1.55s/it]
Requesting API: 0%| | 2/1319 [00:01<15:49, 1.39it/s]
Requesting API: 0%| | 6/1319 [00:01<04:02, 5.40it/s]
Requesting API: 1%| | 9/1319 [00:01<02:33, 8.54it/s]
Requesting API: 1%| | 12/1319 [00:02<02:16, 9.60it/s]
Requesting API: 1%| | 16/1319 [00:02<01:58, 10.97it/s]
Requesting API: 1%|β | 18/1319 [00:02<01:48, 12.00it/s]
Requesting API: 2%|β | 20/1319 [00:02<01:37, 13.34it/s]
Requesting API: 2%|β | 22/1319 [00:02<01:32, 13.99it/s]
Requesting API: 2%|β | 24/1319 [00:03<02:12, 9.74it/s]
Requesting API: 2%|β | 27/1319 [00:03<01:46, 12.15it/s]
Requesting API: 2%|β | 31/1319 [00:03<01:19, 16.20it/s]
Requesting API: 3%|β | 35/1319 [00:03<01:06, 19.39it/s]
Requesting API: 3%|β | 38/1319 [00:03<01:13, 17.39it/s]
Requesting API: 3%|β | 41/1319 [00:03<01:14, 17.23it/s]
Requesting API: 3%|β | 43/1319 [00:04<01:15, 16.87it/s]
Requesting API: 3%|β | 45/1319 [00:04<01:30, 14.13it/s]
Requesting API: 4%|β | 52/1319 [00:04<00:51, 24.53it/s]
Requesting API: 4%|β | 56/1319 [00:04<01:00, 20.82it/s]
Requesting API: 5%|β | 61/1319 [00:04<00:51, 24.51it/s]
Requesting API: 5%|β | 64/1319 [00:05<01:04, 19.42it/s]
Requesting API: 5%|β | 67/1319 [00:05<01:26, 14.54it/s]
Requesting API: 5%|β | 69/1319 [00:05<01:21, 15.30it/s]
Requesting API: 5%|β | 71/1319 [00:05<01:22, 15.22it/s]
Requesting API: 6%|β | 75/1319 [00:05<01:12, 17.24it/s]
Requesting API: 6%|β | 77/1319 [00:05<01:12, 17.23it/s]
Requesting API: 6%|β | 79/1319 [00:06<01:14, 16.55it/s]
Requesting API: 6%|β | 83/1319 [00:06<01:10, 17.63it/s]
Requesting API: 6%|β | 85/1319 [00:06<01:14, 16.65it/s]
Requesting API: 7%|β | 87/1319 [00:06<01:23, 14.72it/s]
Requesting API: 7%|β | 92/1319 [00:06<01:06, 18.36it/s]
Requesting API: 7%|β | 94/1319 [00:07<01:15, 16.30it/s]
Requesting API: 7%|β | 96/1319 [00:07<01:12, 16.90it/s]
Requesting API: 7%|β | 98/1319 [00:07<01:16, 15.97it/s]
Requesting API: 8%|β | 100/1319 [00:07<01:13, 16.56it/s]
Requesting API: 8%|β | 105/1319 [00:07<00:51, 23.77it/s]
Requesting API: 8%|β | 108/1319 [00:07<00:54, 22.40it/s]
Requesting API: 8%|β | 111/1319 [00:07<01:02, 19.20it/s]
Requesting API: 9%|β | 114/1319 [00:08<01:03, 18.86it/s]
Requesting API: 9%|β | 117/1319 [00:08<01:04, 18.55it/s]
Requesting API: 9%|β | 119/1319 [00:08<01:06, 18.08it/s]
Requesting API: 9%|β | 122/1319 [00:08<01:05, 18.14it/s]
Requesting API: 9%|β | 124/1319 [00:08<01:04, 18.43it/s]
Requesting API: 10%|β | 126/1319 [00:08<01:04, 18.55it/s]
Requesting API: 10%|β | 128/1319 [00:08<01:10, 17.01it/s]
Requesting API: 10%|β | 130/1319 [00:08<01:15, 15.83it/s]
Requesting API: 10%|β | 132/1319 [00:09<01:11, 16.63it/s]
Requesting API: 10%|β | 134/1319 [00:09<01:15, 15.62it/s]
Requesting API: 10%|β | 138/1319 [00:09<00:59, 19.85it/s]
Requesting API: 11%|β | 141/1319 [00:09<01:12, 16.16it/s]
Requesting API: 11%|β | 143/1319 [00:09<01:26, 13.61it/s]
Requesting API: 11%|β | 148/1319 [00:09<01:01, 19.03it/s]
Requesting API: 11%|ββ | 151/1319 [00:10<01:00, 19.36it/s]
Requesting API: 12%|ββ | 154/1319 [00:10<00:56, 20.72it/s]
Requesting API: 12%|ββ | 159/1319 [00:10<00:46, 25.01it/s]
Requesting API: 12%|ββ | 162/1319 [00:10<01:04, 17.95it/s]
Requesting API: 13%|ββ | 165/1319 [00:11<01:21, 14.21it/s]
Requesting API: 13%|ββ | 168/1319 [00:11<01:29, 12.92it/s]
Requesting API: 13%|ββ | 170/1319 [00:11<01:36, 11.90it/s]
Requesting API: 13%|ββ | 174/1319 [00:11<01:18, 14.50it/s]
Requesting API: 13%|ββ | 176/1319 [00:11<01:23, 13.72it/s]
Requesting API: 13%|ββ | 178/1319 [00:12<01:27, 13.06it/s]
Requesting API: 14%|ββ | 182/1319 [00:12<01:26, 13.21it/s]
Requesting API: 14%|ββ | 184/1319 [00:12<01:43, 10.99it/s]
Requesting API: 14%|ββ | 186/1319 [00:12<01:42, 11.04it/s]
Requesting API: 14%|ββ | 190/1319 [00:12<01:13, 15.42it/s]
Requesting API: 15%|ββ | 192/1319 [00:13<01:09, 16.12it/s]
Requesting API: 15%|ββ | 195/1319 [00:13<01:05, 17.05it/s]
Requesting API: 15%|ββ | 198/1319 [00:13<01:04, 17.26it/s]
Requesting API: 15%|ββ | 200/1319 [00:13<01:12, 15.35it/s]
Requesting API: 15%|ββ | 202/1319 [00:13<01:17, 14.48it/s]
Requesting API: 16%|ββ | 206/1319 [00:13<01:00, 18.33it/s]
Requesting API: 16%|ββ | 208/1319 [00:14<01:27, 12.64it/s]
Requesting API: 16%|ββ | 210/1319 [00:14<01:58, 9.33it/s]
Requesting API: 16%|ββ | 212/1319 [00:14<01:51, 9.92it/s]
Requesting API: 16%|ββ | 215/1319 [00:14<01:27, 12.60it/s]
Requesting API: 16%|ββ | 217/1319 [00:15<01:34, 11.64it/s]
Requesting API: 17%|ββ | 220/1319 [00:15<01:21, 13.54it/s]
Requesting API: 17%|ββ | 224/1319 [00:15<01:00, 18.12it/s]
Requesting API: 17%|ββ | 227/1319 [00:15<01:17, 14.18it/s]
Requesting API: 18%|ββ | 231/1319 [00:15<01:04, 16.95it/s]
Requesting API: 18%|ββ | 234/1319 [00:16<01:16, 14.27it/s]
Requesting API: 18%|ββ | 236/1319 [00:16<01:31, 11.87it/s]
Requesting API: 18%|ββ | 241/1319 [00:16<01:01, 17.41it/s]
Requesting API: 18%|ββ | 244/1319 [00:16<00:57, 18.62it/s]
Requesting API: 19%|ββ | 247/1319 [00:16<01:05, 16.43it/s]
Requesting API: 19%|ββ | 250/1319 [00:16<01:01, 17.36it/s]
Requesting API: 19%|ββ | 253/1319 [00:17<01:20, 13.25it/s]
Requesting API: 19%|ββ | 255/1319 [00:17<01:19, 13.46it/s]
Requesting API: 20%|ββ | 259/1319 [00:17<00:59, 17.70it/s]
Requesting API: 20%|ββ | 262/1319 [00:17<01:03, 16.55it/s]
Requesting API: 20%|ββ | 264/1319 [00:17<01:02, 16.91it/s]
Requesting API: 20%|ββ | 267/1319 [00:17<00:54, 19.35it/s]
Requesting API: 20%|ββ | 270/1319 [00:18<01:08, 15.32it/s]
Requesting API: 21%|ββ | 272/1319 [00:18<01:14, 14.12it/s]
Requesting API: 21%|ββ | 274/1319 [00:18<01:11, 14.61it/s]
Requesting API: 21%|ββ | 278/1319 [00:18<00:56, 18.31it/s]
Requesting API: 21%|βββ | 281/1319 [00:19<01:12, 14.31it/s]
Requesting API: 22%|βββ | 284/1319 [00:19<01:11, 14.55it/s]
Requesting API: 22%|βββ | 286/1319 [00:19<01:09, 14.91it/s]
Requesting API: 22%|βββ | 291/1319 [00:19<00:55, 18.65it/s]
Requesting API: 22%|βββ | 293/1319 [00:19<00:58, 17.64it/s]
Requesting API: 23%|βββ | 298/1319 [00:19<00:45, 22.34it/s]
Requesting API: 23%|βββ | 301/1319 [00:20<01:18, 13.03it/s]
Requesting API: 23%|βββ | 303/1319 [00:20<01:28, 11.47it/s]
Requesting API: 23%|βββ | 305/1319 [00:20<01:22, 12.32it/s]
Requesting API: 23%|βββ | 307/1319 [00:20<01:30, 11.23it/s]
Requesting API: 24%|βββ | 311/1319 [00:21<01:07, 14.83it/s]
Requesting API: 24%|βββ | 316/1319 [00:21<00:55, 18.23it/s]
Requesting API: 24%|βββ | 319/1319 [00:21<01:13, 13.52it/s]
Requesting API: 24%|βββ | 322/1319 [00:21<01:03, 15.62it/s]
Requesting API: 25%|βββ | 326/1319 [00:21<00:52, 18.94it/s]
Requesting API: 25%|βββ | 329/1319 [00:22<01:05, 15.20it/s]
Requesting API: 25%|βββ | 331/1319 [00:22<01:13, 13.49it/s]
Requesting API: 25%|βββ | 334/1319 [00:22<01:06, 14.88it/s]
Requesting API: 25%|βββ | 336/1319 [00:22<01:07, 14.47it/s]
Requesting API: 26%|βββ | 341/1319 [00:22<00:51, 19.00it/s]
Requesting API: 26%|βββ | 344/1319 [00:23<00:53, 18.11it/s]
Requesting API: 26%|βββ | 346/1319 [00:23<01:20, 12.02it/s]
Requesting API: 26%|βββ | 348/1319 [00:23<01:14, 13.05it/s]
Requesting API: 27%|βββ | 350/1319 [00:23<01:16, 12.68it/s]
Requesting API: 27%|βββ | 352/1319 [00:23<01:12, 13.39it/s]
Requesting API: 27%|βββ | 355/1319 [00:23<00:58, 16.39it/s]
Requesting API: 27%|βββ | 357/1319 [00:24<00:58, 16.32it/s]
Requesting API: 27%|βββ | 359/1319 [00:24<01:11, 13.46it/s]
Requesting API: 27%|βββ | 361/1319 [00:24<01:48, 8.80it/s]
Requesting API: 28%|βββ | 363/1319 [00:24<01:37, 9.82it/s]
Requesting API: 28%|βββ | 365/1319 [00:25<01:35, 9.99it/s]
Requesting API: 28%|βββ | 369/1319 [00:25<01:06, 14.26it/s]
Requesting API: 28%|βββ | 372/1319 [00:25<01:04, 14.73it/s]
Requesting API: 28%|βββ | 375/1319 [00:25<01:13, 12.83it/s]
Requesting API: 29%|βββ | 377/1319 [00:25<01:12, 13.04it/s]
Requesting API: 29%|βββ | 380/1319 [00:25<01:00, 15.62it/s]
Requesting API: 29%|βββ | 383/1319 [00:26<00:53, 17.39it/s]
Requesting API: 29%|βββ | 386/1319 [00:26<00:57, 16.34it/s]
Requesting API: 29%|βββ | 388/1319 [00:26<01:33, 9.94it/s]
Requesting API: 30%|βββ | 391/1319 [00:26<01:24, 11.02it/s]
Requesting API: 30%|βββ | 396/1319 [00:27<00:56, 16.27it/s]
Requesting API: 30%|βββ | 400/1319 [00:27<00:50, 18.23it/s]
Requesting API: 31%|βββ | 403/1319 [00:27<00:45, 20.08it/s]
Requesting API: 31%|βββ | 406/1319 [00:27<01:12, 12.67it/s]
Requesting API: 31%|βββ | 409/1319 [00:28<01:09, 13.19it/s]
Requesting API: 31%|βββ | 411/1319 [00:28<01:22, 11.03it/s]
Requesting API: 31%|ββββ | 414/1319 [00:28<01:08, 13.12it/s]
Requesting API: 32%|ββββ | 416/1319 [00:28<01:04, 14.05it/s]
Requesting API: 32%|ββββ | 418/1319 [00:28<01:00, 14.79it/s]
Requesting API: 32%|ββββ | 422/1319 [00:28<00:46, 19.41it/s]
Requesting API: 32%|ββββ | 426/1319 [00:28<00:41, 21.66it/s]
Requesting API: 33%|ββββ | 429/1319 [00:29<00:47, 18.71it/s]
Requesting API: 33%|ββββ | 432/1319 [00:29<00:43, 20.51it/s]
Requesting API: 33%|ββββ | 435/1319 [00:29<00:48, 18.04it/s]
Requesting API: 33%|ββββ | 438/1319 [00:29<00:57, 15.39it/s]
Requesting API: 33%|ββββ | 440/1319 [00:29<01:08, 12.77it/s]
Requesting API: 34%|ββββ | 442/1319 [00:30<01:13, 11.93it/s]
Requesting API: 34%|ββββ | 444/1319 [00:30<01:13, 11.84it/s]
Requesting API: 34%|ββββ | 447/1319 [00:30<01:07, 12.94it/s]
Requesting API: 34%|ββββ | 450/1319 [00:30<00:57, 15.20it/s]
Requesting API: 34%|ββββ | 453/1319 [00:30<00:49, 17.64it/s]
Requesting API: 35%|ββββ | 456/1319 [00:30<00:45, 18.97it/s]
Requesting API: 35%|ββββ | 459/1319 [00:31<00:42, 20.24it/s]
Requesting API: 35%|ββββ | 462/1319 [00:31<01:00, 14.26it/s]
Requesting API: 35%|ββββ | 464/1319 [00:31<01:10, 12.15it/s]
Requesting API: 35%|ββββ | 467/1319 [00:31<00:57, 14.87it/s]
Requesting API: 36%|ββββ | 471/1319 [00:31<00:48, 17.61it/s]
Requesting API: 36%|ββββ | 474/1319 [00:32<00:47, 17.97it/s]
Requesting API: 36%|ββββ | 477/1319 [00:32<00:55, 15.30it/s]
Requesting API: 36%|ββββ | 479/1319 [00:32<01:11, 11.75it/s]
Requesting API: 37%|ββββ | 482/1319 [00:32<01:02, 13.32it/s]
Requesting API: 37%|ββββ | 484/1319 [00:32<01:03, 13.23it/s]
Requesting API: 37%|ββββ | 486/1319 [00:33<01:07, 12.41it/s]
Requesting API: 37%|ββββ | 493/1319 [00:33<00:44, 18.40it/s]
Requesting API: 38%|ββββ | 497/1319 [00:33<00:40, 20.13it/s]
Requesting API: 38%|ββββ | 501/1319 [00:33<00:34, 23.39it/s]
Requesting API: 38%|ββββ | 504/1319 [00:34<00:49, 16.35it/s]
Requesting API: 38%|ββββ | 507/1319 [00:34<00:49, 16.29it/s]
Requesting API: 39%|ββββ | 510/1319 [00:34<00:45, 17.97it/s]
Requesting API: 39%|ββββ | 513/1319 [00:34<00:45, 17.55it/s]
Requesting API: 39%|ββββ | 515/1319 [00:34<00:49, 16.10it/s]
Requesting API: 39%|ββββ | 517/1319 [00:34<00:47, 16.72it/s]
Requesting API: 39%|ββββ | 519/1319 [00:34<00:48, 16.61it/s]
Requesting API: 40%|ββββ | 522/1319 [00:35<00:43, 18.14it/s]
Requesting API: 40%|ββββ | 525/1319 [00:35<00:40, 19.75it/s]
Requesting API: 40%|ββββ | 528/1319 [00:35<00:41, 19.12it/s]
Requesting API: 40%|ββββ | 530/1319 [00:35<00:41, 19.03it/s]
Requesting API: 40%|ββββ | 534/1319 [00:35<00:35, 21.89it/s]
Requesting API: 41%|ββββ | 537/1319 [00:35<00:35, 22.02it/s]
Requesting API: 41%|ββββ | 541/1319 [00:35<00:32, 23.67it/s]
Requesting API: 41%|ββββ | 544/1319 [00:36<00:39, 19.45it/s]
Requesting API: 42%|βββββ | 548/1319 [00:36<00:43, 17.85it/s]
Requesting API: 42%|βββββ | 552/1319 [00:36<00:36, 21.00it/s]
Requesting API: 42%|βββββ | 555/1319 [00:36<00:54, 13.91it/s]
Requesting API: 42%|βββββ | 558/1319 [00:37<00:48, 15.67it/s]
Requesting API: 43%|βββββ | 561/1319 [00:37<00:52, 14.31it/s]
Requesting API: 43%|βββββ | 563/1319 [00:37<00:59, 12.68it/s]
Requesting API: 43%|βββββ | 566/1319 [00:37<00:57, 13.06it/s]
Requesting API: 43%|βββββ | 568/1319 [00:37<00:53, 14.01it/s]
Requesting API: 43%|βββββ | 570/1319 [00:37<00:51, 14.49it/s]
Requesting API: 43%|βββββ | 573/1319 [00:38<00:44, 16.75it/s]
Requesting API: 44%|βββββ | 576/1319 [00:38<00:49, 14.95it/s]
Requesting API: 44%|βββββ | 578/1319 [00:38<00:59, 12.53it/s]
Requesting API: 44%|βββββ | 580/1319 [00:38<01:01, 12.11it/s]
Requesting API: 44%|βββββ | 582/1319 [00:38<01:04, 11.50it/s]
Requesting API: 44%|βββββ | 584/1319 [00:39<01:01, 11.89it/s]
Requesting API: 44%|βββββ | 586/1319 [00:39<01:28, 8.24it/s]
Requesting API: 45%|βββββ | 588/1319 [00:39<01:19, 9.21it/s]
Requesting API: 45%|βββββ | 592/1319 [00:39<00:53, 13.48it/s]
Requesting API: 45%|βββββ | 594/1319 [00:39<00:51, 14.00it/s]
Requesting API: 45%|βββββ | 596/1319 [00:40<00:49, 14.69it/s]
Requesting API: 45%|βββββ | 598/1319 [00:40<00:48, 15.02it/s]
Requesting API: 45%|βββββ | 600/1319 [00:40<00:45, 15.84it/s]
Requesting API: 46%|βββββ | 602/1319 [00:40<01:05, 10.96it/s]
Requesting API: 46%|βββββ | 607/1319 [00:40<00:42, 16.60it/s]
Requesting API: 46%|βββββ | 609/1319 [00:40<00:46, 15.21it/s]
Requesting API: 46%|βββββ | 612/1319 [00:41<00:43, 16.33it/s]
Requesting API: 47%|βββββ | 614/1319 [00:41<00:42, 16.40it/s]
Requesting API: 47%|βββββ | 618/1319 [00:41<00:33, 21.19it/s]
Requesting API: 47%|βββββ | 621/1319 [00:41<00:35, 19.64it/s]
Requesting API: 47%|βββββ | 624/1319 [00:41<00:42, 16.52it/s]
Requesting API: 48%|βββββ | 627/1319 [00:41<00:39, 17.42it/s]
Requesting API: 48%|βββββ | 629/1319 [00:42<00:41, 16.81it/s]
Requesting API: 48%|βββββ | 631/1319 [00:42<00:50, 13.57it/s]
Requesting API: 48%|βββββ | 633/1319 [00:42<00:54, 12.59it/s]
Requesting API: 48%|βββββ | 636/1319 [00:42<00:44, 15.30it/s]
Requesting API: 48%|βββββ | 638/1319 [00:42<00:56, 12.16it/s]
Requesting API: 49%|βββββ | 641/1319 [00:42<00:50, 13.48it/s]
Requesting API: 49%|βββββ | 643/1319 [00:43<00:55, 12.25it/s]
Requesting API: 49%|βββββ | 646/1319 [00:43<00:45, 14.92it/s]
Requesting API: 49%|βββββ | 651/1319 [00:43<00:34, 19.34it/s]
Requesting API: 50%|βββββ | 654/1319 [00:43<00:34, 19.54it/s]
Requesting API: 50%|βββββ | 657/1319 [00:43<00:35, 18.68it/s]
Requesting API: 50%|βββββ | 662/1319 [00:43<00:27, 23.98it/s]
Requesting API: 50%|βββββ | 665/1319 [00:44<00:38, 16.96it/s]
Requesting API: 51%|βββββ | 669/1319 [00:44<00:35, 18.38it/s]
Requesting API: 51%|βββββ | 672/1319 [00:44<00:41, 15.74it/s]
Requesting API: 51%|βββββ | 675/1319 [00:44<00:38, 16.75it/s]
Requesting API: 51%|ββββββ | 677/1319 [00:45<00:51, 12.38it/s]
Requesting API: 51%|ββββββ | 679/1319 [00:45<00:57, 11.17it/s]
Requesting API: 52%|ββββββ | 682/1319 [00:45<00:46, 13.65it/s]
Requesting API: 52%|ββββββ | 684/1319 [00:45<00:48, 12.98it/s]
Requesting API: 52%|ββββββ | 689/1319 [00:45<00:33, 18.93it/s]
Requesting API: 52%|ββββββ | 692/1319 [00:46<00:40, 15.52it/s]
Requesting API: 53%|ββββββ | 694/1319 [00:46<00:39, 15.78it/s]
Requesting API: 53%|ββββββ | 696/1319 [00:46<00:48, 12.79it/s]
Requesting API: 53%|ββββββ | 698/1319 [00:46<00:52, 11.80it/s]
Requesting API: 53%|ββββββ | 700/1319 [00:46<00:47, 13.12it/s]
Requesting API: 53%|ββββββ | 702/1319 [00:46<00:44, 13.95it/s]
Requesting API: 54%|ββββββ | 706/1319 [00:47<00:39, 15.71it/s]
Requesting API: 54%|ββββββ | 709/1319 [00:47<00:34, 17.77it/s]
Requesting API: 54%|ββββββ | 711/1319 [00:47<00:39, 15.57it/s]
Requesting API: 54%|ββββββ | 713/1319 [00:47<00:44, 13.47it/s]
Requesting API: 54%|ββββββ | 716/1319 [00:47<00:39, 15.20it/s]
Requesting API: 54%|ββββββ | 718/1319 [00:47<00:41, 14.31it/s]
Requesting API: 55%|ββββββ | 720/1319 [00:48<00:47, 12.68it/s]
Requesting API: 55%|ββββββ | 723/1319 [00:48<00:37, 15.82it/s]
Requesting API: 55%|ββββββ | 727/1319 [00:48<00:31, 18.96it/s]
Requesting API: 55%|ββββββ | 730/1319 [00:48<00:28, 20.52it/s]
Requesting API: 56%|ββββββ | 733/1319 [00:49<00:47, 12.42it/s]
Requesting API: 56%|ββββββ | 737/1319 [00:49<00:41, 14.14it/s]
Requesting API: 56%|ββββββ | 742/1319 [00:49<00:29, 19.47it/s]
Requesting API: 57%|ββββββ | 746/1319 [00:49<00:25, 22.63it/s]
Requesting API: 57%|ββββββ | 751/1319 [00:49<00:20, 27.20it/s]
Requesting API: 57%|ββββββ | 755/1319 [00:49<00:25, 22.00it/s]
Requesting API: 57%|ββββββ | 758/1319 [00:50<00:32, 17.19it/s]
Requesting API: 58%|ββββββ | 761/1319 [00:50<00:30, 18.11it/s]
Requesting API: 58%|ββββββ | 764/1319 [00:50<00:39, 14.18it/s]
Requesting API: 58%|ββββββ | 767/1319 [00:50<00:34, 16.20it/s]
Requesting API: 58%|ββββββ | 770/1319 [00:50<00:29, 18.36it/s]
Requesting API: 59%|ββββββ | 773/1319 [00:50<00:28, 19.26it/s]
Requesting API: 59%|ββββββ | 776/1319 [00:51<00:34, 15.69it/s]
Requesting API: 59%|ββββββ | 778/1319 [00:51<00:34, 15.90it/s]
Requesting API: 59%|ββββββ | 781/1319 [00:51<00:30, 17.77it/s]
Requesting API: 59%|ββββββ | 783/1319 [00:51<00:39, 13.49it/s]
Requesting API: 60%|ββββββ | 785/1319 [00:51<00:36, 14.46it/s]
Requesting API: 60%|ββββββ | 790/1319 [00:52<00:35, 14.71it/s]
Requesting API: 60%|ββββββ | 792/1319 [00:52<00:38, 13.75it/s]
Requesting API: 60%|ββββββ | 796/1319 [00:52<00:31, 16.39it/s]
Requesting API: 61%|ββββββ | 799/1319 [00:52<00:41, 12.66it/s]
Requesting API: 61%|ββββββ | 801/1319 [00:53<00:39, 13.04it/s]
Requesting API: 61%|ββββββ | 805/1319 [00:53<00:31, 16.14it/s]
Requesting API: 61%|βββββββ | 808/1319 [00:53<00:33, 15.46it/s]
Requesting API: 61%|βββββββ | 811/1319 [00:53<00:37, 13.60it/s]
Requesting API: 62%|βββββββ | 814/1319 [00:53<00:38, 12.97it/s]
Requesting API: 62%|βββββββ | 816/1319 [00:54<00:39, 12.70it/s]
Requesting API: 62%|βββββββ | 818/1319 [00:54<00:40, 12.48it/s]
Requesting API: 62%|βββββββ | 822/1319 [00:54<00:33, 14.65it/s]
Requesting API: 62%|βββββββ | 824/1319 [00:54<00:33, 14.63it/s]
Requesting API: 63%|βββββββ | 827/1319 [00:54<00:28, 17.29it/s]
Requesting API: 63%|βββββββ | 829/1319 [00:54<00:34, 14.07it/s]
Requesting API: 63%|βββββββ | 831/1319 [00:55<00:32, 14.96it/s]
Requesting API: 63%|βββββββ | 834/1319 [00:55<00:27, 17.79it/s]
Requesting API: 64%|βββββββ | 838/1319 [00:55<00:32, 14.84it/s]
Requesting API: 64%|βββββββ | 841/1319 [00:55<00:27, 17.33it/s]
Requesting API: 64%|βββββββ | 844/1319 [00:56<00:37, 12.83it/s]
Requesting API: 64%|βββββββ | 847/1319 [00:56<00:32, 14.64it/s]
Requesting API: 64%|βββββββ | 850/1319 [00:56<00:29, 15.82it/s]
Requesting API: 65%|βββββββ | 855/1319 [00:56<00:23, 20.03it/s]
Requesting API: 65%|βββββββ | 858/1319 [00:56<00:26, 17.27it/s]
Requesting API: 65%|βββββββ | 862/1319 [00:56<00:24, 18.59it/s]
Requesting API: 66%|βββββββ | 865/1319 [00:57<00:38, 11.87it/s]
Requesting API: 66%|βββββββ | 867/1319 [00:57<00:37, 12.14it/s]
Requesting API: 66%|βββββββ | 871/1319 [00:57<00:27, 16.02it/s]
Requesting API: 66%|βββββββ | 876/1319 [00:57<00:23, 18.96it/s]
Requesting API: 67%|βββββββ | 879/1319 [00:57<00:22, 19.55it/s]
Requesting API: 67%|βββββββ | 882/1319 [00:58<00:24, 17.87it/s]
Requesting API: 67%|βββββββ | 885/1319 [00:58<00:26, 16.62it/s]
Requesting API: 67%|βββββββ | 888/1319 [00:58<00:31, 13.87it/s]
Requesting API: 67%|βββββββ | 890/1319 [00:58<00:33, 12.78it/s]
Requesting API: 68%|βββββββ | 892/1319 [00:59<00:32, 13.11it/s]
Requesting API: 68%|βββββββ | 895/1319 [00:59<00:30, 13.91it/s]
Requesting API: 68%|βββββββ | 897/1319 [00:59<00:31, 13.33it/s]
Requesting API: 68%|βββββββ | 899/1319 [00:59<00:35, 11.76it/s]
Requesting API: 68%|βββββββ | 901/1319 [00:59<00:41, 10.05it/s]
Requesting API: 68%|βββββββ | 903/1319 [01:00<00:40, 10.22it/s]
Requesting API: 69%|βββββββ | 905/1319 [01:00<00:35, 11.61it/s]
Requesting API: 69%|βββββββ | 908/1319 [01:00<00:28, 14.35it/s]
Requesting API: 69%|βββββββ | 910/1319 [01:00<00:44, 9.24it/s]
Requesting API: 69%|βββββββ | 912/1319 [01:00<00:38, 10.64it/s]
Requesting API: 69%|βββββββ | 915/1319 [01:01<00:29, 13.50it/s]
Requesting API: 70%|βββββββ | 918/1319 [01:01<00:25, 15.81it/s]
Requesting API: 70%|βββββββ | 921/1319 [01:01<00:25, 15.72it/s]
Requesting API: 70%|βββββββ | 927/1319 [01:01<00:18, 21.16it/s]
Requesting API: 71%|βββββββ | 930/1319 [01:01<00:18, 20.56it/s]
Requesting API: 71%|βββββββ | 933/1319 [01:01<00:24, 15.82it/s]
Requesting API: 71%|βββββββ | 938/1319 [01:02<00:23, 16.13it/s]
Requesting API: 71%|ββββββββ | 940/1319 [01:02<00:28, 13.20it/s]
Requesting API: 71%|ββββββββ | 942/1319 [01:02<00:27, 13.67it/s]
Requesting API: 72%|ββββββββ | 944/1319 [01:02<00:26, 14.12it/s]
Requesting API: 72%|ββββββββ | 948/1319 [01:03<00:23, 15.73it/s]
Requesting API: 72%|ββββββββ | 951/1319 [01:03<00:22, 16.57it/s]
Requesting API: 72%|ββββββββ | 953/1319 [01:03<00:22, 16.48it/s]
Requesting API: 72%|ββββββββ | 956/1319 [01:03<00:22, 16.05it/s]
Requesting API: 73%|ββββββββ | 959/1319 [01:03<00:19, 18.55it/s]
Requesting API: 73%|ββββββββ | 962/1319 [01:03<00:20, 17.04it/s]
Requesting API: 73%|ββββββββ | 964/1319 [01:03<00:23, 15.28it/s]
Requesting API: 73%|ββββββββ | 966/1319 [01:04<00:26, 13.19it/s]
Requesting API: 73%|ββββββββ | 968/1319 [01:04<00:27, 12.84it/s]
Requesting API: 74%|ββββββββ | 971/1319 [01:04<00:24, 14.00it/s]
Requesting API: 74%|ββββββββ | 974/1319 [01:04<00:20, 16.85it/s]
Requesting API: 74%|ββββββββ | 976/1319 [01:04<00:27, 12.59it/s]
Requesting API: 74%|ββββββββ | 978/1319 [01:05<00:25, 13.13it/s]
Requesting API: 74%|ββββββββ | 981/1319 [01:05<00:21, 15.66it/s]
Requesting API: 75%|ββββββββ | 984/1319 [01:05<00:18, 17.67it/s]
Requesting API: 75%|ββββββββ | 986/1319 [01:05<00:20, 16.36it/s]
Requesting API: 75%|ββββββββ | 989/1319 [01:05<00:17, 19.06it/s]
Requesting API: 75%|ββββββββ | 992/1319 [01:05<00:23, 13.78it/s]
Requesting API: 75%|ββββββββ | 994/1319 [01:06<00:23, 13.99it/s]
Requesting API: 76%|ββββββββ | 996/1319 [01:06<00:25, 12.79it/s]
Requesting API: 76%|ββββββββ | 998/1319 [01:06<00:24, 13.25it/s]
Requesting API: 76%|ββββββββ | 1001/1319 [01:06<00:24, 13.19it/s]
Requesting API: 76%|ββββββββ | 1003/1319 [01:06<00:23, 13.24it/s]
Requesting API: 76%|ββββββββ | 1006/1319 [01:06<00:20, 15.33it/s]
Requesting API: 76%|ββββββββ | 1009/1319 [01:07<00:17, 17.52it/s]
Requesting API: 77%|ββββββββ | 1012/1319 [01:07<00:19, 15.80it/s]
Requesting API: 77%|ββββββββ | 1014/1319 [01:07<00:19, 16.02it/s]
Requesting API: 77%|ββββββββ | 1016/1319 [01:07<00:18, 16.54it/s]
Requesting API: 77%|ββββββββ | 1018/1319 [01:07<00:21, 14.20it/s]
Requesting API: 77%|ββββββββ | 1021/1319 [01:07<00:20, 14.24it/s]
Requesting API: 78%|ββββββββ | 1023/1319 [01:08<00:26, 11.21it/s]
Requesting API: 78%|ββββββββ | 1025/1319 [01:08<00:26, 11.11it/s]
Requesting API: 78%|ββββββββ | 1028/1319 [01:08<00:22, 12.82it/s]
Requesting API: 78%|ββββββββ | 1032/1319 [01:08<00:16, 17.38it/s]
Requesting API: 78%|ββββββββ | 1035/1319 [01:08<00:18, 15.04it/s]
Requesting API: 79%|ββββββββ | 1038/1319 [01:09<00:25, 10.85it/s]
Requesting API: 79%|ββββββββ | 1041/1319 [01:09<00:21, 13.00it/s]
Requesting API: 79%|ββββββββ | 1044/1319 [01:09<00:18, 14.63it/s]
Requesting API: 79%|ββββββββ | 1046/1319 [01:09<00:22, 11.95it/s]
Requesting API: 80%|ββββββββ | 1049/1319 [01:10<00:19, 14.19it/s]
Requesting API: 80%|ββββββββ | 1052/1319 [01:10<00:16, 15.81it/s]
Requesting API: 80%|ββββββββ | 1054/1319 [01:10<00:19, 13.53it/s]
Requesting API: 80%|ββββββββ | 1057/1319 [01:10<00:17, 14.58it/s]
Requesting API: 80%|ββββββββ | 1060/1319 [01:10<00:15, 16.66it/s]
Requesting API: 81%|ββββββββ | 1062/1319 [01:10<00:17, 14.44it/s]
Requesting API: 81%|ββββββββ | 1064/1319 [01:11<00:18, 13.44it/s]
Requesting API: 81%|ββββββββ | 1066/1319 [01:11<00:18, 13.33it/s]
Requesting API: 81%|ββββββββ | 1068/1319 [01:11<00:21, 11.59it/s]
Requesting API: 82%|βββββββββ | 1075/1319 [01:11<00:12, 19.54it/s]
Requesting API: 82%|βββββββββ | 1078/1319 [01:11<00:11, 20.56it/s]
Requesting API: 82%|βββββββββ | 1081/1319 [01:11<00:11, 21.37it/s]
Requesting API: 82%|βββββββββ | 1084/1319 [01:12<00:19, 12.31it/s]
Requesting API: 82%|βββββββββ | 1086/1319 [01:12<00:19, 12.02it/s]
Requesting API: 82%|βββββββββ | 1088/1319 [01:12<00:19, 12.00it/s]
Requesting API: 83%|βββββββββ | 1092/1319 [01:12<00:15, 15.03it/s]
Requesting API: 83%|βββββββββ | 1095/1319 [01:13<00:13, 17.09it/s]
Requesting API: 83%|βββββββββ | 1098/1319 [01:13<00:12, 17.78it/s]
Requesting API: 83%|βββββββββ | 1101/1319 [01:13<00:10, 19.96it/s]
Requesting API: 84%|βββββββββ | 1104/1319 [01:13<00:15, 13.98it/s]
Requesting API: 84%|βββββββββ | 1106/1319 [01:13<00:14, 14.98it/s]
Requesting API: 84%|βββββββββ | 1111/1319 [01:13<00:09, 20.86it/s]
Requesting API: 84%|βββββββββ | 1114/1319 [01:14<00:12, 16.05it/s]
Requesting API: 85%|βββββββββ | 1117/1319 [01:14<00:13, 15.21it/s]
Requesting API: 85%|βββββββββ | 1119/1319 [01:14<00:13, 15.18it/s]
Requesting API: 85%|βββββββββ | 1121/1319 [01:14<00:13, 15.11it/s]
Requesting API: 85%|βββββββββ | 1123/1319 [01:14<00:12, 15.63it/s]
Requesting API: 85%|βββββββββ | 1125/1319 [01:14<00:13, 13.90it/s]
Requesting API: 86%|βββββββββ | 1128/1319 [01:15<00:11, 17.13it/s]
Requesting API: 86%|βββββββββ | 1130/1319 [01:15<00:11, 16.44it/s]
Requesting API: 86%|βββββββββ | 1132/1319 [01:15<00:12, 15.08it/s]
Requesting API: 86%|βββββββββ | 1135/1319 [01:15<00:10, 16.95it/s]
Requesting API: 86%|βββββββββ | 1138/1319 [01:15<00:10, 17.28it/s]
Requesting API: 86%|βββββββββ | 1140/1319 [01:15<00:11, 16.26it/s]
Requesting API: 87%|βββββββββ | 1143/1319 [01:16<00:11, 15.63it/s]
Requesting API: 87%|βββββββββ | 1145/1319 [01:16<00:12, 13.58it/s]
Requesting API: 87%|βββββββββ | 1147/1319 [01:16<00:11, 14.61it/s]
Requesting API: 87%|βββββββββ | 1149/1319 [01:16<00:18, 8.96it/s]
Requesting API: 87%|βββββββββ | 1152/1319 [01:17<00:17, 9.31it/s]
Requesting API: 87%|βββββββββ | 1154/1319 [01:17<00:15, 10.67it/s]
Requesting API: 88%|βββββββββ | 1156/1319 [01:17<00:13, 11.96it/s]
Requesting API: 88%|βββββββββ | 1160/1319 [01:17<00:10, 15.51it/s]
Requesting API: 88%|βββββββββ | 1162/1319 [01:17<00:10, 15.30it/s]
Requesting API: 88%|βββββββββ | 1166/1319 [01:17<00:08, 17.20it/s]
Requesting API: 89%|βββββββββ | 1169/1319 [01:17<00:08, 18.32it/s]
Requesting API: 89%|βββββββββ | 1174/1319 [01:18<00:06, 24.09it/s]
Requesting API: 89%|βββββββββ | 1177/1319 [01:18<00:06, 22.95it/s]
Requesting API: 89%|βββββββββ | 1180/1319 [01:18<00:07, 17.47it/s]
Requesting API: 90%|βββββββββ | 1183/1319 [01:18<00:10, 12.77it/s]
Requesting API: 90%|βββββββββ | 1187/1319 [01:19<00:09, 14.64it/s]
Requesting API: 90%|βββββββββ | 1191/1319 [01:19<00:07, 17.83it/s]
Requesting API: 91%|βββββββββ | 1194/1319 [01:19<00:06, 18.30it/s]
Requesting API: 91%|βββββββββ | 1199/1319 [01:19<00:05, 23.70it/s]
Requesting API: 91%|βββββββββ | 1202/1319 [01:19<00:05, 23.15it/s]
Requesting API: 91%|ββββββββββ| 1205/1319 [01:19<00:05, 20.60it/s]
Requesting API: 92%|ββββββββββ| 1208/1319 [01:20<00:05, 18.83it/s]
Requesting API: 92%|ββββββββββ| 1211/1319 [01:20<00:06, 16.18it/s]
Requesting API: 92%|ββββββββββ| 1214/1319 [01:20<00:05, 18.40it/s]
Requesting API: 92%|ββββββββββ| 1217/1319 [01:20<00:07, 14.20it/s]
Requesting API: 92%|ββββββββββ| 1219/1319 [01:20<00:07, 13.98it/s]
Requesting API: 93%|ββββββββββ| 1221/1319 [01:20<00:06, 14.49it/s]
Requesting API: 93%|ββββββββββ| 1223/1319 [01:21<00:06, 14.99it/s]
Requesting API: 93%|ββββββββββ| 1225/1319 [01:21<00:06, 13.68it/s]
Requesting API: 93%|ββββββββββ| 1230/1319 [01:21<00:04, 20.09it/s]
Requesting API: 93%|ββββββββββ| 1233/1319 [01:21<00:05, 16.69it/s]
Requesting API: 94%|ββββββββββ| 1235/1319 [01:21<00:05, 14.75it/s]
Requesting API: 94%|ββββββββββ| 1238/1319 [01:21<00:04, 17.44it/s]
Requesting API: 94%|ββββββββββ| 1241/1319 [01:22<00:06, 12.74it/s]
Requesting API: 94%|ββββββββββ| 1244/1319 [01:22<00:05, 14.96it/s]
Requesting API: 94%|ββββββββββ| 1246/1319 [01:22<00:04, 14.96it/s]
Requesting API: 95%|ββββββββββ| 1249/1319 [01:22<00:04, 14.59it/s]
Requesting API: 95%|ββββββββββ| 1251/1319 [01:22<00:04, 14.19it/s]
Requesting API: 95%|ββββββββββ| 1253/1319 [01:23<00:05, 12.13it/s]
Requesting API: 95%|ββββββββββ| 1257/1319 [01:23<00:03, 16.33it/s]
Requesting API: 95%|ββββββββββ| 1259/1319 [01:23<00:03, 16.87it/s]
Requesting API: 96%|ββββββββββ| 1261/1319 [01:23<00:03, 16.22it/s]
Requesting API: 96%|ββββββββββ| 1265/1319 [01:23<00:02, 19.16it/s]
Requesting API: 96%|ββββββββββ| 1268/1319 [01:23<00:02, 18.85it/s]
Requesting API: 96%|ββββββββββ| 1270/1319 [01:24<00:02, 17.22it/s]
Requesting API: 97%|ββββββββββ| 1273/1319 [01:24<00:02, 19.81it/s]
Requesting API: 97%|ββββββββββ| 1277/1319 [01:24<00:02, 17.83it/s]
Requesting API: 97%|ββββββββββ| 1280/1319 [01:24<00:02, 15.80it/s]
Requesting API: 97%|ββββββββββ| 1282/1319 [01:24<00:02, 15.89it/s]
Requesting API: 97%|ββββββββββ| 1285/1319 [01:24<00:01, 18.44it/s]
Requesting API: 98%|ββββββββββ| 1288/1319 [01:25<00:02, 15.41it/s]
Requesting API: 98%|ββββββββββ| 1290/1319 [01:25<00:01, 16.19it/s]
Requesting API: 98%|ββββββββββ| 1293/1319 [01:25<00:01, 18.95it/s]
Requesting API: 98%|ββββββββββ| 1296/1319 [01:25<00:01, 16.86it/s]
Requesting API: 98%|ββββββββββ| 1299/1319 [01:25<00:01, 15.88it/s]
Requesting API: 99%|ββββββββββ| 1301/1319 [01:25<00:01, 15.48it/s]
Requesting API: 99%|ββββββββββ| 1304/1319 [01:26<00:00, 16.07it/s]
Requesting API: 99%|ββββββββββ| 1306/1319 [01:26<00:01, 7.29it/s]
Requesting API: 99%|ββββββββββ| 1308/1319 [01:27<00:01, 7.47it/s]
Requesting API: 99%|ββββββββββ| 1310/1319 [01:27<00:01, 7.40it/s]
Requesting API: 99%|ββββββββββ| 1312/1319 [01:27<00:01, 6.79it/s]
Requesting API: 100%|ββββββββββ| 1313/1319 [01:28<00:01, 5.04it/s]
Requesting API: 100%|ββββββββββ| 1314/1319 [01:28<00:01, 3.53it/s]
Requesting API: 100%|ββββββββββ| 1315/1319 [01:29<00:01, 2.78it/s]
Requesting API: 100%|ββββββββββ| 1316/1319 [01:29<00:00, 3.17it/s]
Requesting API: 100%|ββββββββββ| 1317/1319 [01:29<00:00, 3.38it/s]
Requesting API: 100%|ββββββββββ| 1318/1319 [01:30<00:00, 2.55it/s]
Requesting API: 100%|ββββββββββ| 1319/1319 [01:33<00:00, 1.10s/it]
Requesting API: 100%|ββββββββββ| 1319/1319 [01:33<00:00, 14.11it/s] |
|
Requesting API: 0%| | 0/500 [00:00<?, ?it/s]
Requesting API: 0%| | 1/500 [00:02<24:40, 2.97s/it]
Requesting API: 1%| | 3/500 [00:03<08:01, 1.03it/s]
Requesting API: 1%| | 5/500 [00:03<04:27, 1.85it/s]
Requesting API: 1%| | 6/500 [00:03<03:33, 2.31it/s]
Requesting API: 2%|β | 8/500 [00:04<02:23, 3.43it/s]
Requesting API: 2%|β | 9/500 [00:04<02:25, 3.37it/s]
Requesting API: 2%|β | 11/500 [00:04<01:40, 4.86it/s]
Requesting API: 2%|β | 12/500 [00:04<02:02, 3.98it/s]
Requesting API: 3%|β | 13/500 [00:05<02:02, 3.96it/s]
Requesting API: 3%|β | 15/500 [00:05<01:36, 5.03it/s]
Requesting API: 3%|β | 16/500 [00:05<01:36, 5.01it/s]
Requesting API: 3%|β | 17/500 [00:05<01:24, 5.69it/s]
Requesting API: 4%|β | 18/500 [00:06<01:59, 4.02it/s]
Requesting API: 4%|β | 19/500 [00:06<01:56, 4.15it/s]
Requesting API: 4%|β | 20/500 [00:06<02:30, 3.18it/s]
Requesting API: 4%|β | 21/500 [00:07<02:12, 3.61it/s]
Requesting API: 5%|β | 23/500 [00:07<01:28, 5.38it/s]
Requesting API: 5%|β | 24/500 [00:07<01:18, 6.03it/s]
Requesting API: 5%|β | 26/500 [00:07<01:25, 5.53it/s]
Requesting API: 6%|β | 29/500 [00:08<01:00, 7.78it/s]
Requesting API: 6%|β | 30/500 [00:08<00:58, 8.08it/s]
Requesting API: 6%|β | 31/500 [00:08<00:59, 7.83it/s]
Requesting API: 7%|β | 33/500 [00:08<00:50, 9.29it/s]
Requesting API: 7%|β | 35/500 [00:08<00:42, 10.87it/s]
Requesting API: 7%|β | 37/500 [00:10<02:23, 3.23it/s]
Requesting API: 8%|β | 38/500 [00:10<02:30, 3.07it/s]
Requesting API: 8%|β | 39/500 [00:10<02:26, 3.15it/s]
Requesting API: 8%|β | 41/500 [00:10<01:43, 4.46it/s]
Requesting API: 8%|β | 42/500 [00:11<02:09, 3.54it/s]
Requesting API: 9%|β | 43/500 [00:11<02:29, 3.05it/s]
Requesting API: 9%|β | 44/500 [00:12<02:20, 3.24it/s]
Requesting API: 9%|β | 45/500 [00:12<02:46, 2.74it/s]
Requesting API: 10%|β | 49/500 [00:12<01:14, 6.07it/s]
Requesting API: 10%|β | 51/500 [00:13<01:13, 6.14it/s]
Requesting API: 11%|β | 53/500 [00:13<01:20, 5.56it/s]
Requesting API: 11%|β | 55/500 [00:13<01:08, 6.52it/s]
Requesting API: 11%|β | 56/500 [00:14<01:42, 4.35it/s]
Requesting API: 11%|ββ | 57/500 [00:15<02:31, 2.93it/s]
Requesting API: 12%|ββ | 60/500 [00:15<01:41, 4.32it/s]
Requesting API: 12%|ββ | 61/500 [00:15<02:00, 3.65it/s]
Requesting API: 12%|ββ | 62/500 [00:16<01:54, 3.82it/s]
Requesting API: 13%|ββ | 63/500 [00:16<02:19, 3.13it/s]
Requesting API: 13%|ββ | 64/500 [00:17<02:39, 2.74it/s]
Requesting API: 13%|ββ | 66/500 [00:17<01:43, 4.21it/s]
Requesting API: 13%|ββ | 67/500 [00:17<02:22, 3.05it/s]
Requesting API: 14%|ββ | 69/500 [00:18<01:59, 3.60it/s]
Requesting API: 14%|ββ | 70/500 [00:18<02:37, 2.73it/s]
Requesting API: 14%|ββ | 71/500 [00:19<02:20, 3.06it/s]
Requesting API: 14%|ββ | 72/500 [00:19<02:32, 2.81it/s]
Requesting API: 15%|ββ | 73/500 [00:19<02:35, 2.75it/s]
Requesting API: 15%|ββ | 74/500 [00:20<02:23, 2.96it/s]
Requesting API: 15%|ββ | 75/500 [00:20<02:09, 3.27it/s]
Requesting API: 15%|ββ | 76/500 [00:21<03:24, 2.07it/s]
Requesting API: 15%|ββ | 77/500 [00:22<04:11, 1.68it/s]
Requesting API: 16%|ββ | 78/500 [00:22<03:11, 2.20it/s]
Requesting API: 16%|ββ | 80/500 [00:23<02:49, 2.48it/s]
Requesting API: 16%|ββ | 81/500 [00:23<02:33, 2.72it/s]
Requesting API: 16%|ββ | 82/500 [00:23<02:45, 2.52it/s]
Requesting API: 17%|ββ | 85/500 [00:24<01:44, 3.96it/s]
Requesting API: 17%|ββ | 87/500 [00:24<01:37, 4.22it/s]
Requesting API: 18%|ββ | 89/500 [00:25<01:37, 4.20it/s]
Requesting API: 18%|ββ | 90/500 [00:25<01:38, 4.14it/s]
Requesting API: 18%|ββ | 92/500 [00:26<02:22, 2.86it/s]
Requesting API: 19%|ββ | 93/500 [00:26<02:14, 3.02it/s]
Requesting API: 19%|ββ | 95/500 [00:26<01:49, 3.71it/s]
Requesting API: 19%|ββ | 96/500 [00:27<01:36, 4.20it/s]
Requesting API: 19%|ββ | 97/500 [00:27<01:39, 4.04it/s]
Requesting API: 20%|ββ | 100/500 [00:27<00:57, 6.92it/s]
Requesting API: 20%|ββ | 102/500 [00:27<00:48, 8.23it/s]
Requesting API: 21%|ββ | 106/500 [00:27<00:37, 10.37it/s]
Requesting API: 22%|βββ | 108/500 [00:28<01:11, 5.46it/s]
Requesting API: 22%|βββ | 109/500 [00:29<01:32, 4.24it/s]
Requesting API: 22%|βββ | 111/500 [00:29<01:22, 4.71it/s]
Requesting API: 22%|βββ | 112/500 [00:30<01:53, 3.43it/s]
Requesting API: 23%|βββ | 113/500 [00:30<01:54, 3.38it/s]
Requesting API: 23%|βββ | 114/500 [00:31<02:16, 2.82it/s]
Requesting API: 23%|βββ | 117/500 [00:31<01:30, 4.25it/s]
Requesting API: 24%|βββ | 120/500 [00:32<01:52, 3.37it/s]
Requesting API: 24%|βββ | 122/500 [00:32<01:36, 3.93it/s]
Requesting API: 25%|βββ | 123/500 [00:33<01:28, 4.27it/s]
Requesting API: 25%|βββ | 125/500 [00:33<01:08, 5.44it/s]
Requesting API: 25%|βββ | 127/500 [00:33<00:54, 6.83it/s]
Requesting API: 26%|βββ | 129/500 [00:34<01:46, 3.47it/s]
Requesting API: 26%|βββ | 131/500 [00:35<01:58, 3.11it/s]
Requesting API: 26%|βββ | 132/500 [00:35<01:50, 3.34it/s]
Requesting API: 27%|βββ | 134/500 [00:35<01:32, 3.94it/s]
Requesting API: 27%|βββ | 135/500 [00:36<01:25, 4.27it/s]
Requesting API: 27%|βββ | 136/500 [00:36<01:20, 4.54it/s]
Requesting API: 27%|βββ | 137/500 [00:36<01:14, 4.89it/s]
Requesting API: 28%|βββ | 139/500 [00:36<00:53, 6.74it/s]
Requesting API: 28%|βββ | 140/500 [00:36<00:53, 6.72it/s]
Requesting API: 28%|βββ | 141/500 [00:36<01:06, 5.40it/s]
Requesting API: 28%|βββ | 142/500 [00:37<01:03, 5.61it/s]
Requesting API: 29%|βββ | 144/500 [00:37<01:33, 3.81it/s]
Requesting API: 29%|βββ | 145/500 [00:37<01:22, 4.31it/s]
Requesting API: 29%|βββ | 146/500 [00:38<01:38, 3.61it/s]
Requesting API: 29%|βββ | 147/500 [00:38<01:40, 3.51it/s]
Requesting API: 30%|βββ | 149/500 [00:38<01:05, 5.36it/s]
Requesting API: 30%|βββ | 150/500 [00:38<01:00, 5.77it/s]
Requesting API: 30%|βββ | 151/500 [00:39<01:17, 4.52it/s]
Requesting API: 30%|βββ | 152/500 [00:39<01:16, 4.55it/s]
Requesting API: 31%|βββ | 153/500 [00:39<01:15, 4.58it/s]
Requesting API: 31%|βββ | 154/500 [00:40<01:34, 3.67it/s]
Requesting API: 31%|βββ | 155/500 [00:40<01:41, 3.40it/s]
Requesting API: 31%|ββββ | 157/500 [00:40<01:10, 4.84it/s]
Requesting API: 32%|ββββ | 160/500 [00:40<00:43, 7.82it/s]
Requesting API: 32%|ββββ | 162/500 [00:41<01:03, 5.33it/s]
Requesting API: 33%|ββββ | 163/500 [00:41<01:17, 4.37it/s]
Requesting API: 33%|ββββ | 164/500 [00:42<01:13, 4.57it/s]
Requesting API: 33%|ββββ | 165/500 [00:42<01:58, 2.83it/s]
Requesting API: 33%|ββββ | 166/500 [00:43<01:45, 3.17it/s]
Requesting API: 33%|ββββ | 167/500 [00:43<01:32, 3.58it/s]
Requesting API: 34%|ββββ | 168/500 [00:43<01:37, 3.41it/s]
Requesting API: 34%|ββββ | 170/500 [00:43<01:15, 4.39it/s]
Requesting API: 34%|ββββ | 172/500 [00:44<01:21, 4.02it/s]
Requesting API: 35%|ββββ | 173/500 [00:44<01:15, 4.35it/s]
Requesting API: 35%|ββββ | 174/500 [00:45<02:04, 2.61it/s]
Requesting API: 35%|ββββ | 176/500 [00:45<01:35, 3.41it/s]
Requesting API: 35%|ββββ | 177/500 [00:46<01:34, 3.42it/s]
Requesting API: 36%|ββββ | 178/500 [00:46<01:21, 3.94it/s]
Requesting API: 36%|ββββ | 179/500 [00:46<01:42, 3.14it/s]
Requesting API: 36%|ββββ | 180/500 [00:46<01:33, 3.41it/s]
Requesting API: 36%|ββββ | 182/500 [00:47<01:28, 3.59it/s]
Requesting API: 37%|ββββ | 184/500 [00:47<01:20, 3.94it/s]
Requesting API: 37%|ββββ | 185/500 [00:48<01:27, 3.62it/s]
Requesting API: 37%|ββββ | 187/500 [00:48<01:03, 4.94it/s]
Requesting API: 38%|ββββ | 188/500 [00:48<01:00, 5.20it/s]
Requesting API: 38%|ββββ | 190/500 [00:48<00:46, 6.69it/s]
Requesting API: 38%|ββββ | 191/500 [00:49<01:47, 2.87it/s]
Requesting API: 38%|ββββ | 192/500 [00:50<01:41, 3.03it/s]
Requesting API: 39%|ββββ | 193/500 [00:50<01:40, 3.06it/s]
Requesting API: 39%|ββββ | 194/500 [00:50<01:50, 2.77it/s]
Requesting API: 39%|ββββ | 197/500 [00:50<01:01, 4.95it/s]
Requesting API: 40%|ββββ | 198/500 [00:51<01:47, 2.82it/s]
Requesting API: 40%|ββββ | 200/500 [00:52<01:15, 3.99it/s]
Requesting API: 40%|ββββ | 201/500 [00:52<01:25, 3.48it/s]
Requesting API: 40%|ββββ | 202/500 [00:52<01:22, 3.59it/s]
Requesting API: 41%|ββββ | 203/500 [00:53<01:22, 3.61it/s]
Requesting API: 41%|ββββ | 204/500 [00:53<01:09, 4.25it/s]
Requesting API: 41%|ββββ | 205/500 [00:53<01:10, 4.18it/s]
Requesting API: 41%|ββββ | 206/500 [00:53<01:22, 3.57it/s]
Requesting API: 41%|βββββ | 207/500 [00:54<01:36, 3.03it/s]
Requesting API: 42%|βββββ | 208/500 [00:54<01:18, 3.73it/s]
Requesting API: 42%|βββββ | 209/500 [00:54<01:37, 2.98it/s]
Requesting API: 42%|βββββ | 211/500 [00:55<01:07, 4.26it/s]
Requesting API: 42%|βββββ | 212/500 [00:55<01:13, 3.91it/s]
Requesting API: 43%|βββββ | 213/500 [00:55<01:04, 4.45it/s]
Requesting API: 43%|βββββ | 214/500 [00:55<01:11, 4.01it/s]
Requesting API: 43%|βββββ | 216/500 [00:56<00:53, 5.27it/s]
Requesting API: 44%|βββββ | 219/500 [00:56<00:32, 8.73it/s]
Requesting API: 44%|βββββ | 221/500 [00:57<00:59, 4.70it/s]
Requesting API: 45%|βββββ | 223/500 [00:57<01:08, 4.02it/s]
Requesting API: 45%|βββββ | 225/500 [00:57<00:54, 5.01it/s]
Requesting API: 45%|βββββ | 226/500 [00:58<01:09, 3.94it/s]
Requesting API: 45%|βββββ | 227/500 [00:59<01:43, 2.63it/s]
Requesting API: 46%|βββββ | 228/500 [00:59<01:33, 2.90it/s]
Requesting API: 46%|βββββ | 230/500 [00:59<01:19, 3.38it/s]
Requesting API: 47%|βββββ | 233/500 [01:00<00:52, 5.11it/s]
Requesting API: 47%|βββββ | 234/500 [01:00<01:14, 3.59it/s]
Requesting API: 47%|βββββ | 236/500 [01:01<01:01, 4.31it/s]
Requesting API: 47%|βββββ | 237/500 [01:01<01:28, 2.99it/s]
Requesting API: 48%|βββββ | 239/500 [01:02<01:03, 4.08it/s]
Requesting API: 48%|βββββ | 240/500 [01:02<01:05, 3.99it/s]
Requesting API: 48%|βββββ | 241/500 [01:02<00:57, 4.54it/s]
Requesting API: 49%|βββββ | 243/500 [01:02<00:51, 4.97it/s]
Requesting API: 49%|βββββ | 244/500 [01:02<00:50, 5.09it/s]
Requesting API: 49%|βββββ | 245/500 [01:03<01:01, 4.15it/s]
Requesting API: 49%|βββββ | 246/500 [01:03<01:10, 3.59it/s]
Requesting API: 49%|βββββ | 247/500 [01:03<01:10, 3.61it/s]
Requesting API: 50%|βββββ | 248/500 [01:04<01:20, 3.13it/s]
Requesting API: 50%|βββββ | 250/500 [01:04<01:05, 3.83it/s]
Requesting API: 50%|βββββ | 251/500 [01:04<01:01, 4.03it/s]
Requesting API: 51%|βββββ | 254/500 [01:05<00:39, 6.15it/s]
Requesting API: 51%|βββββ | 255/500 [01:05<00:47, 5.15it/s]
Requesting API: 52%|ββββββ | 258/500 [01:06<01:12, 3.32it/s]
Requesting API: 52%|ββββββ | 259/500 [01:07<01:36, 2.51it/s]
Requesting API: 52%|ββββββ | 260/500 [01:08<01:42, 2.34it/s]
Requesting API: 53%|ββββββ | 263/500 [01:08<01:01, 3.83it/s]
Requesting API: 53%|ββββββ | 264/500 [01:08<01:13, 3.20it/s]
Requesting API: 53%|ββββββ | 265/500 [01:09<01:03, 3.68it/s]
Requesting API: 53%|ββββββ | 266/500 [01:09<01:10, 3.31it/s]
Requesting API: 53%|ββββββ | 267/500 [01:09<01:20, 2.91it/s]
Requesting API: 54%|ββββββ | 268/500 [01:10<01:14, 3.13it/s]
Requesting API: 54%|ββββββ | 270/500 [01:11<01:25, 2.70it/s]
Requesting API: 54%|ββββββ | 271/500 [01:11<01:19, 2.88it/s]
Requesting API: 54%|ββββββ | 272/500 [01:11<01:05, 3.46it/s]
Requesting API: 55%|ββββββ | 274/500 [01:11<00:46, 4.81it/s]
Requesting API: 55%|ββββββ | 275/500 [01:12<00:55, 4.04it/s]
Requesting API: 55%|ββββββ | 276/500 [01:12<01:06, 3.38it/s]
Requesting API: 55%|ββββββ | 277/500 [01:12<01:01, 3.62it/s]
Requesting API: 56%|ββββββ | 278/500 [01:12<00:50, 4.37it/s]
Requesting API: 56%|ββββββ | 282/500 [01:13<00:39, 5.58it/s]
Requesting API: 57%|ββββββ | 283/500 [01:13<00:41, 5.25it/s]
Requesting API: 57%|ββββββ | 284/500 [01:13<00:41, 5.19it/s]
Requesting API: 57%|ββββββ | 285/500 [01:14<00:49, 4.36it/s]
Requesting API: 57%|ββββββ | 286/500 [01:14<00:58, 3.65it/s]
Requesting API: 57%|ββββββ | 287/500 [01:15<01:18, 2.71it/s]
Requesting API: 58%|ββββββ | 288/500 [01:15<01:35, 2.22it/s]
Requesting API: 58%|ββββββ | 289/500 [01:16<01:43, 2.05it/s]
Requesting API: 58%|ββββββ | 291/500 [01:16<01:05, 3.20it/s]
Requesting API: 59%|ββββββ | 293/500 [01:17<01:19, 2.60it/s]
Requesting API: 59%|ββββββ | 294/500 [01:17<01:15, 2.74it/s]
Requesting API: 59%|ββββββ | 296/500 [01:18<01:01, 3.34it/s]
Requesting API: 59%|ββββββ | 297/500 [01:18<01:11, 2.84it/s]
Requesting API: 60%|ββββββ | 298/500 [01:19<01:21, 2.48it/s]
Requesting API: 60%|ββββββ | 299/500 [01:19<01:10, 2.83it/s]
Requesting API: 60%|ββββββ | 300/500 [01:19<01:01, 3.26it/s]
Requesting API: 60%|ββββββ | 301/500 [01:20<01:11, 2.80it/s]
Requesting API: 60%|ββββββ | 302/500 [01:20<01:00, 3.25it/s]
Requesting API: 61%|ββββββ | 303/500 [01:20<01:04, 3.05it/s]
Requesting API: 61%|ββββββ | 305/500 [01:21<00:49, 3.96it/s]
Requesting API: 61%|ββββββ | 306/500 [01:21<00:44, 4.31it/s]
Requesting API: 61%|βββββββ | 307/500 [01:21<00:44, 4.34it/s]
Requesting API: 62%|βββββββ | 309/500 [01:21<00:39, 4.81it/s]
Requesting API: 62%|βββββββ | 310/500 [01:22<01:01, 3.08it/s]
Requesting API: 62%|βββββββ | 311/500 [01:23<01:06, 2.86it/s]
Requesting API: 63%|βββββββ | 313/500 [01:23<00:47, 3.96it/s]
Requesting API: 63%|βββββββ | 314/500 [01:23<00:44, 4.19it/s]
Requesting API: 63%|βββββββ | 315/500 [01:23<00:49, 3.74it/s]
Requesting API: 63%|βββββββ | 316/500 [01:24<00:42, 4.29it/s]
Requesting API: 63%|βββββββ | 317/500 [01:24<00:38, 4.70it/s]
Requesting API: 64%|βββββββ | 318/500 [01:24<00:37, 4.90it/s]
Requesting API: 64%|βββββββ | 319/500 [01:24<00:37, 4.76it/s]
Requesting API: 64%|βββββββ | 321/500 [01:24<00:34, 5.22it/s]
Requesting API: 64%|βββββββ | 322/500 [01:25<00:39, 4.56it/s]
Requesting API: 65%|βββββββ | 323/500 [01:25<00:55, 3.20it/s]
Requesting API: 65%|βββββββ | 324/500 [01:26<00:50, 3.47it/s]
Requesting API: 65%|βββββββ | 325/500 [01:26<00:41, 4.18it/s]
Requesting API: 65%|βββββββ | 327/500 [01:26<00:52, 3.27it/s]
Requesting API: 66%|βββββββ | 328/500 [01:27<00:46, 3.72it/s]
Requesting API: 66%|βββββββ | 329/500 [01:27<00:45, 3.74it/s]
Requesting API: 66%|βββββββ | 331/500 [01:27<00:31, 5.31it/s]
Requesting API: 66%|βββββββ | 332/500 [01:27<00:28, 5.88it/s]
Requesting API: 67%|βββββββ | 334/500 [01:27<00:21, 7.67it/s]
Requesting API: 67%|βββββββ | 336/500 [01:28<00:21, 7.57it/s]
Requesting API: 67%|βββββββ | 337/500 [01:28<00:24, 6.68it/s]
Requesting API: 68%|βββββββ | 338/500 [01:28<00:41, 3.86it/s]
Requesting API: 68%|βββββββ | 339/500 [01:29<00:38, 4.19it/s]
Requesting API: 68%|βββββββ | 341/500 [01:29<00:30, 5.13it/s]
Requesting API: 68%|βββββββ | 342/500 [01:29<00:30, 5.24it/s]
Requesting API: 69%|βββββββ | 343/500 [01:29<00:28, 5.47it/s]
Requesting API: 69%|βββββββ | 346/500 [01:29<00:18, 8.40it/s]
Requesting API: 70%|βββββββ | 348/500 [01:30<00:20, 7.48it/s]
Requesting API: 70%|βββββββ | 350/500 [01:30<00:18, 8.09it/s]
Requesting API: 70%|βββββββ | 351/500 [01:30<00:26, 5.54it/s]
Requesting API: 71%|βββββββ | 354/500 [01:31<00:21, 6.72it/s]
Requesting API: 71%|βββββββ | 355/500 [01:31<00:20, 7.08it/s]
Requesting API: 71%|ββββββββ | 357/500 [01:32<00:38, 3.67it/s]
Requesting API: 72%|ββββββββ | 358/500 [01:32<00:36, 3.89it/s]
Requesting API: 72%|ββββββββ | 359/500 [01:32<00:35, 3.96it/s]
Requesting API: 72%|ββββββββ | 360/500 [01:32<00:30, 4.57it/s]
Requesting API: 72%|ββββββββ | 362/500 [01:33<00:25, 5.46it/s]
Requesting API: 73%|ββββββββ | 363/500 [01:33<00:31, 4.38it/s]
Requesting API: 73%|ββββββββ | 365/500 [01:34<00:33, 3.97it/s]
Requesting API: 74%|ββββββββ | 368/500 [01:34<00:21, 6.10it/s]
Requesting API: 74%|ββββββββ | 369/500 [01:34<00:23, 5.54it/s]
Requesting API: 74%|ββββββββ | 371/500 [01:34<00:21, 6.00it/s]
Requesting API: 74%|ββββββββ | 372/500 [01:35<00:25, 5.08it/s]
Requesting API: 75%|ββββββββ | 373/500 [01:35<00:30, 4.19it/s]
Requesting API: 75%|ββββββββ | 374/500 [01:36<00:40, 3.12it/s]
Requesting API: 75%|ββββββββ | 376/500 [01:36<00:40, 3.05it/s]
Requesting API: 75%|ββββββββ | 377/500 [01:37<00:44, 2.78it/s]
Requesting API: 76%|ββββββββ | 380/500 [01:37<00:26, 4.54it/s]
Requesting API: 76%|ββββββββ | 381/500 [01:37<00:32, 3.68it/s]
Requesting API: 76%|ββββββββ | 382/500 [01:38<00:41, 2.87it/s]
Requesting API: 77%|ββββββββ | 383/500 [01:38<00:35, 3.30it/s]
Requesting API: 77%|ββββββββ | 384/500 [01:38<00:31, 3.69it/s]
Requesting API: 77%|ββββββββ | 385/500 [01:39<00:36, 3.13it/s]
Requesting API: 77%|ββββββββ | 386/500 [01:39<00:37, 3.03it/s]
Requesting API: 77%|ββββββββ | 387/500 [01:40<00:42, 2.65it/s]
Requesting API: 78%|ββββββββ | 388/500 [01:40<00:40, 2.79it/s]
Requesting API: 78%|ββββββββ | 389/500 [01:40<00:33, 3.34it/s]
Requesting API: 78%|ββββββββ | 391/500 [01:40<00:24, 4.36it/s]
Requesting API: 78%|ββββββββ | 392/500 [01:41<00:30, 3.55it/s]
Requesting API: 79%|ββββββββ | 393/500 [01:41<00:37, 2.83it/s]
Requesting API: 79%|ββββββββ | 396/500 [01:42<00:20, 5.13it/s]
Requesting API: 80%|ββββββββ | 398/500 [01:42<00:15, 6.56it/s]
Requesting API: 80%|ββββββββ | 400/500 [01:42<00:13, 7.59it/s]
Requesting API: 80%|ββββββββ | 402/500 [01:42<00:12, 7.75it/s]
Requesting API: 81%|ββββββββ | 403/500 [01:42<00:15, 6.18it/s]
Requesting API: 81%|ββββββββ | 404/500 [01:43<00:23, 4.07it/s]
Requesting API: 81%|ββββββββ | 405/500 [01:43<00:27, 3.45it/s]
Requesting API: 81%|ββββββββ | 406/500 [01:44<00:23, 4.07it/s]
Requesting API: 82%|βββββββββ | 408/500 [01:44<00:15, 5.80it/s]
Requesting API: 82%|βββββββββ | 410/500 [01:44<00:11, 7.56it/s]
Requesting API: 82%|βββββββββ | 412/500 [01:45<00:25, 3.41it/s]
Requesting API: 83%|βββββββββ | 413/500 [01:45<00:22, 3.89it/s]
Requesting API: 83%|βββββββββ | 414/500 [01:45<00:23, 3.72it/s]
Requesting API: 83%|βββββββββ | 415/500 [01:46<00:19, 4.33it/s]
Requesting API: 83%|βββββββββ | 416/500 [01:46<00:18, 4.62it/s]
Requesting API: 84%|βββββββββ | 418/500 [01:46<00:15, 5.15it/s]
Requesting API: 84%|βββββββββ | 419/500 [01:46<00:16, 5.01it/s]
Requesting API: 84%|βββββββββ | 421/500 [01:47<00:14, 5.47it/s]
Requesting API: 84%|βββββββββ | 422/500 [01:47<00:15, 4.99it/s]
Requesting API: 85%|βββββββββ | 423/500 [01:47<00:16, 4.64it/s]
Requesting API: 85%|βββββββββ | 425/500 [01:47<00:12, 5.78it/s]
Requesting API: 85%|βββββββββ | 427/500 [01:48<00:10, 6.78it/s]
Requesting API: 86%|βββββββββ | 428/500 [01:48<00:13, 5.42it/s]
Requesting API: 86%|βββββββββ | 429/500 [01:48<00:16, 4.19it/s]
Requesting API: 86%|βββββββββ | 430/500 [01:48<00:14, 4.70it/s]
Requesting API: 86%|βββββββββ | 431/500 [01:49<00:14, 4.67it/s]
Requesting API: 86%|βββββββββ | 432/500 [01:49<00:14, 4.64it/s]
Requesting API: 87%|βββββββββ | 434/500 [01:49<00:09, 6.61it/s]
Requesting API: 87%|βββββββββ | 437/500 [01:49<00:07, 8.00it/s]
Requesting API: 88%|βββββββββ | 438/500 [01:49<00:07, 7.94it/s]
Requesting API: 88%|βββββββββ | 439/500 [01:50<00:11, 5.09it/s]
Requesting API: 88%|βββββββββ | 440/500 [01:50<00:10, 5.50it/s]
Requesting API: 88%|βββββββββ | 441/500 [01:50<00:12, 4.82it/s]
Requesting API: 89%|βββββββββ | 443/500 [01:51<00:10, 5.41it/s]
Requesting API: 89%|βββββββββ | 444/500 [01:51<00:12, 4.42it/s]
Requesting API: 89%|βββββββββ | 446/500 [01:52<00:17, 3.09it/s]
Requesting API: 90%|βββββββββ | 449/500 [01:52<00:10, 4.92it/s]
Requesting API: 90%|βββββββββ | 450/500 [01:53<00:12, 4.09it/s]
Requesting API: 90%|βββββββββ | 451/500 [01:53<00:11, 4.43it/s]
Requesting API: 90%|βββββββββ | 452/500 [01:53<00:16, 2.93it/s]
Requesting API: 91%|βββββββββ | 454/500 [01:54<00:10, 4.36it/s]
Requesting API: 91%|βββββββββ | 456/500 [01:54<00:12, 3.48it/s]
Requesting API: 92%|ββββββββββ| 458/500 [01:55<00:11, 3.68it/s]
Requesting API: 92%|ββββββββββ| 460/500 [01:55<00:09, 4.10it/s]
Requesting API: 92%|ββββββββββ| 461/500 [01:55<00:09, 4.09it/s]
Requesting API: 93%|ββββββββββ| 463/500 [01:57<00:15, 2.37it/s]
Requesting API: 93%|ββββββββββ| 464/500 [01:57<00:13, 2.68it/s]
Requesting API: 93%|ββββββββββ| 465/500 [01:58<00:13, 2.59it/s]
Requesting API: 93%|ββββββββββ| 466/500 [01:58<00:11, 2.90it/s]
Requesting API: 93%|ββββββββββ| 467/500 [01:58<00:09, 3.42it/s]
Requesting API: 94%|ββββββββββ| 468/500 [01:58<00:07, 4.08it/s]
Requesting API: 94%|ββββββββββ| 469/500 [01:59<00:13, 2.27it/s]
Requesting API: 94%|ββββββββββ| 470/500 [01:59<00:12, 2.45it/s]
Requesting API: 94%|ββββββββββ| 471/500 [02:00<00:12, 2.30it/s]
Requesting API: 94%|ββββββββββ| 472/500 [02:01<00:17, 1.57it/s]
Requesting API: 95%|ββββββββββ| 473/500 [02:02<00:18, 1.43it/s]
Requesting API: 95%|ββββββββββ| 474/500 [02:03<00:18, 1.42it/s]
Requesting API: 95%|ββββββββββ| 477/500 [02:03<00:09, 2.45it/s]
Requesting API: 96%|ββββββββββ| 478/500 [02:04<00:09, 2.33it/s]
Requesting API: 96%|ββββββββββ| 480/500 [02:04<00:07, 2.77it/s]
Requesting API: 96%|ββββββββββ| 482/500 [02:06<00:09, 1.86it/s]
Requesting API: 97%|ββββββββββ| 483/500 [02:06<00:08, 2.10it/s]
Requesting API: 97%|ββββββββββ| 486/500 [02:06<00:04, 3.32it/s]
Requesting API: 97%|ββββββββββ| 487/500 [02:07<00:03, 3.45it/s]
Requesting API: 98%|ββββββββββ| 488/500 [02:07<00:04, 2.88it/s]
Requesting API: 98%|ββββββββββ| 491/500 [02:08<00:02, 4.03it/s]
Requesting API: 98%|ββββββββββ| 492/500 [02:08<00:02, 3.01it/s]
Requesting API: 99%|ββββββββββ| 493/500 [02:08<00:02, 3.42it/s]
Requesting API: 99%|ββββββββββ| 495/500 [02:09<00:01, 2.69it/s]
Requesting API: 99%|ββββββββββ| 496/500 [02:10<00:01, 2.53it/s]
Requesting API: 99%|ββββββββββ| 497/500 [02:10<00:01, 2.29it/s]
Requesting API: 100%|ββββββββββ| 498/500 [02:11<00:00, 2.74it/s]
Requesting API: 100%|ββββββββββ| 499/500 [02:11<00:00, 3.36it/s]
Requesting API: 100%|ββββββββββ| 500/500 [02:12<00:00, 2.02it/s]
Requesting API: 100%|ββββββββββ| 500/500 [02:12<00:00, 3.78it/s] |
|
Requesting API: 0%| | 0/541 [00:00<?, ?it/s]
Requesting API: 0%| | 1/541 [00:00<03:27, 2.60it/s]
Requesting API: 1%| | 4/541 [00:00<00:53, 10.01it/s]
Requesting API: 1%| | 6/541 [00:00<00:54, 9.74it/s]
Requesting API: 2%|β | 10/541 [00:00<00:32, 16.24it/s]
Requesting API: 2%|β | 13/541 [00:01<00:38, 13.86it/s]
Requesting API: 3%|β | 15/541 [00:01<00:49, 10.58it/s]
Requesting API: 3%|β | 17/541 [00:01<01:09, 7.52it/s]
Requesting API: 4%|β | 19/541 [00:02<01:02, 8.34it/s]
Requesting API: 4%|β | 21/541 [00:02<01:23, 6.19it/s]
Requesting API: 4%|β | 24/541 [00:02<00:59, 8.71it/s]
Requesting API: 5%|β | 26/541 [00:02<01:03, 8.15it/s]
Requesting API: 5%|β | 28/541 [00:03<01:18, 6.54it/s]
Requesting API: 5%|β | 29/541 [00:03<01:32, 5.55it/s]
Requesting API: 6%|β | 31/541 [00:03<01:13, 6.93it/s]
Requesting API: 6%|β | 34/541 [00:04<01:09, 7.33it/s]
Requesting API: 6%|β | 35/541 [00:04<01:06, 7.61it/s]
Requesting API: 7%|β | 36/541 [00:04<01:26, 5.85it/s]
Requesting API: 7%|β | 38/541 [00:04<01:10, 7.13it/s]
Requesting API: 7%|β | 40/541 [00:05<01:14, 6.70it/s]
Requesting API: 8%|β | 41/541 [00:05<01:12, 6.94it/s]
Requesting API: 8%|β | 42/541 [00:05<01:32, 5.39it/s]
Requesting API: 8%|β | 43/541 [00:05<01:23, 5.96it/s]
Requesting API: 9%|β | 46/541 [00:05<00:50, 9.80it/s]
Requesting API: 9%|β | 48/541 [00:06<00:56, 8.74it/s]
Requesting API: 9%|β | 50/541 [00:06<01:20, 6.10it/s]
Requesting API: 9%|β | 51/541 [00:06<01:15, 6.49it/s]
Requesting API: 10%|β | 55/541 [00:06<00:45, 10.70it/s]
Requesting API: 11%|β | 57/541 [00:07<00:42, 11.40it/s]
Requesting API: 11%|β | 59/541 [00:07<00:56, 8.52it/s]
Requesting API: 11%|ββ | 61/541 [00:07<00:54, 8.85it/s]
Requesting API: 12%|ββ | 63/541 [00:08<01:02, 7.68it/s]
Requesting API: 12%|ββ | 65/541 [00:08<00:59, 7.99it/s]
Requesting API: 12%|ββ | 66/541 [00:08<01:09, 6.80it/s]
Requesting API: 12%|ββ | 67/541 [00:08<01:26, 5.46it/s]
Requesting API: 13%|ββ | 69/541 [00:09<01:09, 6.82it/s]
Requesting API: 13%|ββ | 71/541 [00:09<00:54, 8.58it/s]
Requesting API: 13%|ββ | 73/541 [00:09<00:46, 10.03it/s]
Requesting API: 14%|ββ | 75/541 [00:09<00:42, 10.93it/s]
Requesting API: 14%|ββ | 77/541 [00:09<00:57, 8.13it/s]
Requesting API: 15%|ββ | 80/541 [00:10<01:02, 7.43it/s]
Requesting API: 15%|ββ | 81/541 [00:10<01:00, 7.62it/s]
Requesting API: 15%|ββ | 82/541 [00:10<01:22, 5.59it/s]
Requesting API: 16%|ββ | 84/541 [00:11<01:23, 5.47it/s]
Requesting API: 16%|ββ | 86/541 [00:11<01:10, 6.43it/s]
Requesting API: 16%|ββ | 89/541 [00:11<00:52, 8.54it/s]
Requesting API: 17%|ββ | 91/541 [00:11<00:48, 9.34it/s]
Requesting API: 17%|ββ | 93/541 [00:11<00:41, 10.80it/s]
Requesting API: 18%|ββ | 96/541 [00:11<00:33, 13.17it/s]
Requesting API: 18%|ββ | 98/541 [00:12<00:38, 11.37it/s]
Requesting API: 18%|ββ | 100/541 [00:12<00:42, 10.29it/s]
Requesting API: 19%|ββ | 102/541 [00:12<00:47, 9.22it/s]
Requesting API: 19%|ββ | 104/541 [00:13<01:22, 5.28it/s]
Requesting API: 20%|ββ | 106/541 [00:13<01:10, 6.21it/s]
Requesting API: 20%|ββ | 107/541 [00:13<01:07, 6.41it/s]
Requesting API: 20%|ββ | 109/541 [00:14<01:22, 5.21it/s]
Requesting API: 20%|ββ | 110/541 [00:14<01:15, 5.73it/s]
Requesting API: 21%|ββ | 111/541 [00:14<01:12, 5.90it/s]
Requesting API: 21%|ββ | 113/541 [00:14<00:54, 7.84it/s]
Requesting API: 21%|βββ | 115/541 [00:15<01:16, 5.59it/s]
Requesting API: 21%|βββ | 116/541 [00:15<01:18, 5.43it/s]
Requesting API: 22%|βββ | 117/541 [00:16<01:58, 3.58it/s]
Requesting API: 22%|βββ | 119/541 [00:17<02:47, 2.52it/s]
Requesting API: 23%|βββ | 123/541 [00:17<01:26, 4.83it/s]
Requesting API: 23%|βββ | 125/541 [00:17<01:33, 4.45it/s]
Requesting API: 23%|βββ | 127/541 [00:18<01:27, 4.75it/s]
Requesting API: 24%|βββ | 130/541 [00:18<01:12, 5.70it/s]
Requesting API: 24%|βββ | 131/541 [00:18<01:23, 4.89it/s]
Requesting API: 24%|βββ | 132/541 [00:19<01:57, 3.48it/s]
Requesting API: 25%|βββ | 133/541 [00:19<01:42, 3.98it/s]
Requesting API: 25%|βββ | 135/541 [00:20<01:22, 4.94it/s]
Requesting API: 25%|βββ | 136/541 [00:20<01:18, 5.15it/s]
Requesting API: 26%|βββ | 140/541 [00:20<00:43, 9.15it/s]
Requesting API: 26%|βββ | 142/541 [00:20<00:44, 9.00it/s]
Requesting API: 27%|βββ | 144/541 [00:20<00:40, 9.72it/s]
Requesting API: 27%|βββ | 148/541 [00:20<00:33, 11.70it/s]
Requesting API: 28%|βββ | 150/541 [00:21<00:42, 9.10it/s]
Requesting API: 28%|βββ | 152/541 [00:21<00:45, 8.55it/s]
Requesting API: 28%|βββ | 153/541 [00:21<00:50, 7.65it/s]
Requesting API: 28%|βββ | 154/541 [00:22<00:57, 6.78it/s]
Requesting API: 29%|βββ | 155/541 [00:22<01:01, 6.25it/s]
Requesting API: 29%|βββ | 157/541 [00:22<00:49, 7.73it/s]
Requesting API: 29%|βββ | 159/541 [00:23<01:19, 4.81it/s]
Requesting API: 30%|βββ | 161/541 [00:23<00:59, 6.39it/s]
Requesting API: 30%|βββ | 163/541 [00:23<00:55, 6.76it/s]
Requesting API: 30%|βββ | 165/541 [00:23<00:46, 8.06it/s]
Requesting API: 31%|βββ | 168/541 [00:24<00:51, 7.27it/s]
Requesting API: 31%|ββββ | 170/541 [00:24<00:47, 7.78it/s]
Requesting API: 32%|ββββ | 171/541 [00:24<00:48, 7.66it/s]
Requesting API: 32%|ββββ | 173/541 [00:24<00:41, 8.97it/s]
Requesting API: 32%|ββββ | 175/541 [00:24<00:44, 8.29it/s]
Requesting API: 33%|ββββ | 176/541 [00:25<00:47, 7.61it/s]
Requesting API: 33%|ββββ | 179/541 [00:25<00:38, 9.37it/s]
Requesting API: 33%|ββββ | 180/541 [00:25<00:39, 9.13it/s]
Requesting API: 34%|ββββ | 183/541 [00:25<00:33, 10.83it/s]
Requesting API: 34%|ββββ | 185/541 [00:25<00:38, 9.27it/s]
Requesting API: 35%|ββββ | 187/541 [00:26<00:43, 8.22it/s]
Requesting API: 35%|ββββ | 191/541 [00:26<00:28, 12.09it/s]
Requesting API: 36%|ββββ | 193/541 [00:26<00:31, 11.12it/s]
Requesting API: 36%|ββββ | 195/541 [00:26<00:34, 10.01it/s]
Requesting API: 36%|ββββ | 197/541 [00:27<00:36, 9.52it/s]
Requesting API: 37%|ββββ | 199/541 [00:27<00:30, 11.10it/s]
Requesting API: 37%|ββββ | 201/541 [00:27<00:45, 7.55it/s]
Requesting API: 38%|ββββ | 203/541 [00:27<00:40, 8.25it/s]
Requesting API: 38%|ββββ | 205/541 [00:28<00:47, 7.13it/s]
Requesting API: 38%|ββββ | 206/541 [00:28<00:49, 6.74it/s]
Requesting API: 38%|ββββ | 207/541 [00:28<00:46, 7.18it/s]
Requesting API: 39%|ββββ | 209/541 [00:28<00:37, 8.77it/s]
Requesting API: 39%|ββββ | 211/541 [00:28<00:31, 10.46it/s]
Requesting API: 40%|ββββ | 214/541 [00:28<00:25, 13.00it/s]
Requesting API: 40%|ββββ | 216/541 [00:29<00:35, 9.18it/s]
Requesting API: 40%|ββββ | 218/541 [00:29<00:34, 9.38it/s]
Requesting API: 41%|ββββ | 220/541 [00:29<00:32, 9.77it/s]
Requesting API: 41%|ββββ | 222/541 [00:30<01:21, 3.92it/s]
Requesting API: 41%|ββββ | 223/541 [00:31<01:16, 4.15it/s]
Requesting API: 42%|βββββ | 225/541 [00:31<00:58, 5.44it/s]
Requesting API: 42%|βββββ | 226/541 [00:31<01:16, 4.13it/s]
Requesting API: 42%|βββββ | 227/541 [00:31<01:09, 4.53it/s]
Requesting API: 43%|βββββ | 231/541 [00:32<00:42, 7.35it/s]
Requesting API: 43%|βββββ | 233/541 [00:32<00:35, 8.69it/s]
Requesting API: 43%|βββββ | 235/541 [00:32<00:48, 6.31it/s]
Requesting API: 44%|βββββ | 238/541 [00:33<00:38, 7.87it/s]
Requesting API: 44%|βββββ | 240/541 [00:33<00:40, 7.40it/s]
Requesting API: 45%|βββββ | 243/541 [00:33<00:41, 7.16it/s]
Requesting API: 45%|βββββ | 246/541 [00:34<00:34, 8.45it/s]
Requesting API: 46%|βββββ | 249/541 [00:34<00:26, 10.97it/s]
Requesting API: 46%|βββββ | 251/541 [00:34<00:29, 10.00it/s]
Requesting API: 47%|βββββ | 253/541 [00:34<00:32, 8.96it/s]
Requesting API: 47%|βββββ | 255/541 [00:35<00:45, 6.35it/s]
Requesting API: 47%|βββββ | 256/541 [00:35<00:58, 4.85it/s]
Requesting API: 48%|βββββ | 258/541 [00:35<00:44, 6.33it/s]
Requesting API: 48%|βββββ | 262/541 [00:36<00:31, 8.77it/s]
Requesting API: 49%|βββββ | 264/541 [00:36<00:30, 9.04it/s]
Requesting API: 49%|βββββ | 266/541 [00:36<00:32, 8.46it/s]
Requesting API: 50%|βββββ | 268/541 [00:37<00:41, 6.50it/s]
Requesting API: 50%|βββββ | 271/541 [00:37<00:33, 8.08it/s]
Requesting API: 50%|βββββ | 272/541 [00:37<00:34, 7.69it/s]
Requesting API: 51%|βββββ | 274/541 [00:37<00:28, 9.24it/s]
Requesting API: 51%|βββββ | 276/541 [00:37<00:25, 10.42it/s]
Requesting API: 51%|ββββββ | 278/541 [00:37<00:27, 9.55it/s]
Requesting API: 52%|ββββββ | 281/541 [00:38<00:21, 11.87it/s]
Requesting API: 52%|ββββββ | 284/541 [00:38<00:19, 13.43it/s]
Requesting API: 53%|ββββββ | 286/541 [00:38<00:27, 9.22it/s]
Requesting API: 53%|ββββββ | 288/541 [00:38<00:23, 10.72it/s]
Requesting API: 54%|ββββββ | 290/541 [00:39<00:26, 9.54it/s]
Requesting API: 54%|ββββββ | 292/541 [00:39<00:27, 9.21it/s]
Requesting API: 54%|ββββββ | 294/541 [00:39<00:24, 10.10it/s]
Requesting API: 55%|ββββββ | 296/541 [00:39<00:24, 10.11it/s]
Requesting API: 55%|ββββββ | 298/541 [00:39<00:22, 10.62it/s]
Requesting API: 55%|ββββββ | 300/541 [00:40<00:31, 7.69it/s]
Requesting API: 56%|ββββββ | 303/541 [00:40<00:23, 10.34it/s]
Requesting API: 56%|ββββββ | 305/541 [00:40<00:29, 8.06it/s]
Requesting API: 57%|ββββββ | 307/541 [00:40<00:24, 9.46it/s]
Requesting API: 57%|ββββββ | 309/541 [00:41<00:31, 7.34it/s]
Requesting API: 57%|ββββββ | 311/541 [00:41<00:27, 8.47it/s]
Requesting API: 58%|ββββββ | 313/541 [00:41<00:28, 7.92it/s]
Requesting API: 58%|ββββββ | 315/541 [00:41<00:24, 9.20it/s]
Requesting API: 59%|ββββββ | 317/541 [00:42<00:23, 9.63it/s]
Requesting API: 59%|ββββββ | 319/541 [00:42<00:21, 10.50it/s]
Requesting API: 59%|ββββββ | 321/541 [00:42<00:24, 9.17it/s]
Requesting API: 60%|ββββββ | 323/541 [00:42<00:23, 9.42it/s]
Requesting API: 60%|ββββββ | 325/541 [00:42<00:23, 9.18it/s]
Requesting API: 60%|ββββββ | 326/541 [00:43<00:29, 7.35it/s]
Requesting API: 60%|ββββββ | 327/541 [00:43<00:35, 6.08it/s]
Requesting API: 61%|ββββββ | 328/541 [00:44<00:54, 3.94it/s]
Requesting API: 61%|ββββββ | 331/541 [00:44<00:33, 6.24it/s]
Requesting API: 62%|βββββββ | 333/541 [00:44<00:33, 6.29it/s]
Requesting API: 62%|βββββββ | 335/541 [00:45<00:54, 3.77it/s]
Requesting API: 62%|βββββββ | 336/541 [00:45<00:48, 4.25it/s]
Requesting API: 62%|βββββββ | 337/541 [00:45<00:44, 4.59it/s]
Requesting API: 63%|βββββββ | 339/541 [00:45<00:34, 5.82it/s]
Requesting API: 63%|βββββββ | 340/541 [00:46<00:34, 5.83it/s]
Requesting API: 63%|βββββββ | 343/541 [00:46<00:32, 6.15it/s]
Requesting API: 64%|βββββββ | 344/541 [00:46<00:32, 5.99it/s]
Requesting API: 64%|βββββββ | 345/541 [00:46<00:34, 5.74it/s]
Requesting API: 64%|βββββββ | 346/541 [00:47<00:32, 6.03it/s]
Requesting API: 65%|βββββββ | 349/541 [00:47<00:23, 8.27it/s]
Requesting API: 65%|βββββββ | 351/541 [00:47<00:20, 9.16it/s]
Requesting API: 65%|βββββββ | 353/541 [00:47<00:19, 9.60it/s]
Requesting API: 65%|βββββββ | 354/541 [00:47<00:22, 8.21it/s]
Requesting API: 66%|βββββββ | 355/541 [00:47<00:21, 8.52it/s]
Requesting API: 66%|βββββββ | 356/541 [00:48<00:21, 8.79it/s]
Requesting API: 66%|βββββββ | 357/541 [00:48<00:20, 9.05it/s]
Requesting API: 67%|βββββββ | 360/541 [00:48<00:22, 8.17it/s]
Requesting API: 67%|βββββββ | 361/541 [00:48<00:26, 6.79it/s]
Requesting API: 67%|βββββββ | 362/541 [00:49<00:35, 4.99it/s]
Requesting API: 67%|βββββββ | 364/541 [00:49<00:29, 6.02it/s]
Requesting API: 68%|βββββββ | 366/541 [00:49<00:29, 5.88it/s]
Requesting API: 68%|βββββββ | 367/541 [00:50<00:42, 4.10it/s]
Requesting API: 68%|βββββββ | 370/541 [00:50<00:28, 5.94it/s]
Requesting API: 69%|βββββββ | 373/541 [00:50<00:22, 7.38it/s]
Requesting API: 69%|βββββββ | 374/541 [00:51<00:26, 6.25it/s]
Requesting API: 69%|βββββββ | 375/541 [00:51<00:26, 6.28it/s]
Requesting API: 70%|βββββββ | 377/541 [00:51<00:20, 8.17it/s]
Requesting API: 70%|βββββββ | 380/541 [00:52<00:29, 5.51it/s]
Requesting API: 70%|βββββββ | 381/541 [00:52<00:38, 4.14it/s]
Requesting API: 71%|βββββββ | 382/541 [00:52<00:34, 4.65it/s]
Requesting API: 71%|βββββββ | 384/541 [00:52<00:25, 6.14it/s]
Requesting API: 71%|βββββββ | 385/541 [00:53<00:26, 5.84it/s]
Requesting API: 72%|ββββββββ | 387/541 [00:53<00:30, 5.07it/s]
Requesting API: 72%|ββββββββ | 389/541 [00:53<00:25, 5.96it/s]
Requesting API: 72%|ββββββββ | 391/541 [00:54<00:25, 5.94it/s]
Requesting API: 72%|ββββββββ | 392/541 [00:54<00:23, 6.41it/s]
Requesting API: 73%|ββββββββ | 393/541 [00:54<00:23, 6.25it/s]
Requesting API: 73%|ββββββββ | 394/541 [00:54<00:24, 5.99it/s]
Requesting API: 73%|ββββββββ | 396/541 [00:54<00:19, 7.63it/s]
Requesting API: 73%|ββββββββ | 397/541 [00:55<00:20, 6.96it/s]
Requesting API: 74%|ββββββββ | 399/541 [00:55<00:20, 7.07it/s]
Requesting API: 74%|ββββββββ | 400/541 [00:55<00:25, 5.58it/s]
Requesting API: 75%|ββββββββ | 405/541 [00:55<00:15, 8.86it/s]
Requesting API: 75%|ββββββββ | 406/541 [00:56<00:18, 7.47it/s]
Requesting API: 75%|ββββββββ | 408/541 [00:56<00:14, 9.11it/s]
Requesting API: 76%|ββββββββ | 410/541 [00:56<00:19, 6.58it/s]
Requesting API: 76%|ββββββββ | 412/541 [00:57<00:22, 5.85it/s]
Requesting API: 76%|ββββββββ | 413/541 [00:57<00:21, 5.82it/s]
Requesting API: 77%|ββββββββ | 414/541 [00:57<00:22, 5.56it/s]
Requesting API: 77%|ββββββββ | 418/541 [00:57<00:12, 9.94it/s]
Requesting API: 78%|ββββββββ | 420/541 [00:58<00:13, 9.26it/s]
Requesting API: 78%|ββββββββ | 422/541 [00:58<00:13, 8.81it/s]
Requesting API: 78%|ββββββββ | 424/541 [00:58<00:11, 9.99it/s]
Requesting API: 79%|ββββββββ | 426/541 [00:58<00:11, 10.41it/s]
Requesting API: 79%|ββββββββ | 428/541 [00:58<00:12, 8.74it/s]
Requesting API: 79%|ββββββββ | 430/541 [00:59<00:13, 8.48it/s]
Requesting API: 80%|ββββββββ | 431/541 [00:59<00:12, 8.50it/s]
Requesting API: 80%|ββββββββ | 434/541 [00:59<00:15, 7.02it/s]
Requesting API: 81%|ββββββββ | 436/541 [01:00<00:18, 5.65it/s]
Requesting API: 81%|ββββββββ | 437/541 [01:00<00:18, 5.49it/s]
Requesting API: 81%|ββββββββ | 438/541 [01:00<00:18, 5.54it/s]
Requesting API: 81%|ββββββββ | 439/541 [01:01<00:23, 4.34it/s]
Requesting API: 82%|βββββββββ | 441/541 [01:01<00:16, 6.06it/s]
Requesting API: 82%|βββββββββ | 443/541 [01:01<00:13, 7.18it/s]
Requesting API: 82%|βββββββββ | 444/541 [01:01<00:13, 7.21it/s]
Requesting API: 82%|βββββββββ | 445/541 [01:01<00:13, 7.24it/s]
Requesting API: 82%|βββββββββ | 446/541 [01:01<00:16, 5.88it/s]
Requesting API: 83%|βββββββββ | 447/541 [01:02<00:15, 6.22it/s]
Requesting API: 83%|βββββββββ | 448/541 [01:02<00:15, 5.84it/s]
Requesting API: 83%|βββββββββ | 450/541 [01:02<00:13, 6.58it/s]
Requesting API: 83%|βββββββββ | 451/541 [01:02<00:14, 6.40it/s]
Requesting API: 84%|βββββββββ | 453/541 [01:02<00:09, 8.80it/s]
Requesting API: 84%|βββββββββ | 455/541 [01:03<00:12, 7.03it/s]
Requesting API: 84%|βββββββββ | 457/541 [01:03<00:09, 8.59it/s]
Requesting API: 85%|βββββββββ | 459/541 [01:04<00:16, 4.99it/s]
Requesting API: 85%|βββββββββ | 461/541 [01:04<00:12, 6.29it/s]
Requesting API: 86%|βββββββββ | 463/541 [01:04<00:12, 6.26it/s]
Requesting API: 86%|βββββββββ | 464/541 [01:04<00:12, 6.18it/s]
Requesting API: 86%|βββββββββ | 465/541 [01:04<00:13, 5.73it/s]
Requesting API: 86%|βββββββββ | 466/541 [01:05<00:20, 3.69it/s]
Requesting API: 86%|βββββββββ | 467/541 [01:05<00:19, 3.85it/s]
Requesting API: 87%|βββββββββ | 469/541 [01:05<00:13, 5.50it/s]
Requesting API: 87%|βββββββββ | 471/541 [01:06<00:11, 6.12it/s]
Requesting API: 87%|βββββββββ | 472/541 [01:06<00:10, 6.46it/s]
Requesting API: 87%|βββββββββ | 473/541 [01:06<00:15, 4.39it/s]
Requesting API: 88%|βββββββββ | 475/541 [01:06<00:12, 5.45it/s]
Requesting API: 88%|βββββββββ | 476/541 [01:07<00:20, 3.21it/s]
Requesting API: 88%|βββββββββ | 478/541 [01:08<00:15, 4.16it/s]
Requesting API: 89%|βββββββββ | 479/541 [01:08<00:13, 4.71it/s]
Requesting API: 89%|βββββββββ | 480/541 [01:08<00:14, 4.29it/s]
Requesting API: 89%|βββββββββ | 482/541 [01:08<00:11, 5.17it/s]
Requesting API: 89%|βββββββββ | 484/541 [01:08<00:08, 6.88it/s]
Requesting API: 90%|βββββββββ | 486/541 [01:09<00:07, 7.36it/s]
Requesting API: 90%|βββββββββ | 488/541 [01:09<00:06, 8.73it/s]
Requesting API: 91%|βββββββββ | 490/541 [01:09<00:06, 8.34it/s]
Requesting API: 91%|βββββββββ | 491/541 [01:09<00:07, 6.38it/s]
Requesting API: 91%|βββββββββ | 493/541 [01:09<00:06, 7.48it/s]
Requesting API: 91%|ββββββββββ| 494/541 [01:10<00:06, 7.38it/s]
Requesting API: 91%|ββββββββββ| 495/541 [01:10<00:07, 5.82it/s]
Requesting API: 92%|ββββββββββ| 496/541 [01:10<00:08, 5.05it/s]
Requesting API: 92%|ββββββββββ| 499/541 [01:11<00:06, 6.52it/s]
Requesting API: 92%|ββββββββββ| 500/541 [01:11<00:07, 5.71it/s]
Requesting API: 93%|ββββββββββ| 502/541 [01:11<00:05, 6.57it/s]
Requesting API: 93%|ββββββββββ| 504/541 [01:11<00:04, 7.41it/s]
Requesting API: 93%|ββββββββββ| 505/541 [01:11<00:05, 6.63it/s]
Requesting API: 94%|ββββββββββ| 507/541 [01:12<00:04, 7.21it/s]
Requesting API: 94%|ββββββββββ| 509/541 [01:12<00:04, 7.33it/s]
Requesting API: 94%|ββββββββββ| 510/541 [01:12<00:04, 6.62it/s]
Requesting API: 94%|ββββββββββ| 511/541 [01:12<00:05, 5.42it/s]
Requesting API: 95%|ββββββββββ| 512/541 [01:13<00:06, 4.67it/s]
Requesting API: 95%|ββββββββββ| 514/541 [01:13<00:04, 5.65it/s]
Requesting API: 95%|ββββββββββ| 515/541 [01:13<00:04, 5.47it/s]
Requesting API: 96%|ββββββββββ| 517/541 [01:13<00:03, 7.54it/s]
Requesting API: 96%|ββββββββββ| 518/541 [01:14<00:06, 3.57it/s]
Requesting API: 96%|ββββββββββ| 519/541 [01:15<00:10, 2.12it/s]
Requesting API: 96%|ββββββββββ| 520/541 [01:16<00:09, 2.13it/s]
Requesting API: 96%|ββββββββββ| 521/541 [01:16<00:08, 2.23it/s]
Requesting API: 96%|ββββββββββ| 522/541 [01:16<00:07, 2.70it/s]
Requesting API: 97%|ββββββββββ| 524/541 [01:17<00:04, 3.68it/s]
Requesting API: 97%|ββββββββββ| 525/541 [01:17<00:04, 3.82it/s]
Requesting API: 97%|ββββββββββ| 527/541 [01:18<00:04, 3.07it/s]
Requesting API: 98%|ββββββββββ| 528/541 [01:18<00:05, 2.31it/s]
Requesting API: 98%|ββββββββββ| 529/541 [01:18<00:04, 2.82it/s]
Requesting API: 98%|ββββββββββ| 530/541 [01:19<00:04, 2.65it/s]
Requesting API: 98%|ββββββββββ| 531/541 [01:19<00:03, 2.61it/s]
Requesting API: 98%|ββββββββββ| 532/541 [01:20<00:03, 3.00it/s]
Requesting API: 99%|ββββββββββ| 534/541 [01:20<00:01, 4.50it/s]
Requesting API: 99%|ββββββββββ| 535/541 [01:21<00:03, 1.86it/s]
Requesting API: 99%|ββββββββββ| 536/541 [01:21<00:02, 2.19it/s]
Requesting API: 99%|ββββββββββ| 537/541 [01:23<00:02, 1.45it/s]
Requesting API: 99%|ββββββββββ| 538/541 [01:25<00:03, 1.01s/it]
Requesting API: 100%|ββββββββββ| 539/541 [01:26<00:01, 1.01it/s]
Requesting API: 100%|ββββββββββ| 540/541 [01:26<00:00, 1.09it/s]
Requesting API: 100%|ββββββββββ| 541/541 [01:27<00:00, 1.09it/s]
Requesting API: 100%|ββββββββββ| 541/541 [01:27<00:00, 6.17it/s] |
| 2026-08-08:22:08:18 INFO [loggers.evaluation_tracker:247] Saving results aggregated |
| 2026-08-08:22:08:18 INFO [loggers.evaluation_tracker:119] Saving per-task samples to outputs/evals/release/math-keep50-step0150/student/*.jsonl |
| local-chat-completions ({'model': 'student', 'base_url': 'http://127.0.0.1:8461/v1/chat/completions', 'num_concurrent': 48, 'tokenized_requests': False, 'max_retries': 3}), gen_kwargs: ({'max_gen_toks': 1280}), limit: None, num_fewshot: None, batch_size: 1 |
| | Tasks |Version| Filter |n-shot| Metric | |Value | |Stderr| |
| |------------------|------:|----------------|-----:|-----------------------|---|-----:|---|------| |
| |gsm8k_cot_zeroshot| 3|flexible-extract| 0|exact_match |β |0.6058|Β± |0.0135| |
| | | |strict-match | 0|exact_match |β |0.0000|Β± | 0| |
| |ifeval | 4|none | 0|inst_level_loose_acc |β |0.5276|Β± | N/A| |
| | | |none | 0|inst_level_strict_acc |β |0.4892|Β± | N/A| |
| | | |none | 0|prompt_level_loose_acc |β |0.4104|Β± |0.0212| |
| | | |none | 0|prompt_level_strict_acc|β |0.3789|Β± |0.0209| |
| |minerva_math500 | 3|none | 4|exact_match |β |0.1420|Β± |0.0156| |
| | | |none | 4|math_verify |β |0.2100|Β± |0.0182| |
|
|
| 2026-08-08T22:08:19-07:00 code pass [humaneval,mbpp] via /v1/completions (function-continuation) |
| 2026-08-08:22:08:27 INFO [_cli.run:388] Selected Tasks: ['humaneval', 'mbpp'] |
| 2026-08-08:22:08:28 INFO [evaluator:214] Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234 | Setting fewshot manual seed to 1234 |
| 2026-08-08:22:08:28 INFO [evaluator:239] Initializing local-completions model, with arguments: {'model': 'student', 'base_url': 'http://127.0.0.1:8461/v1/completions', 'tokenizer': 'outputs/release/healed/release-offpolicy-math-keep50/step0150', 'num_concurrent': 48, 'tokenized_requests': False, 'max_retries': 3} |
| 2026-08-08:22:08:28 INFO [models.openai_completions:42] Remote tokenizer not supported. Using huggingface tokenizer backend. |
| 2026-08-08:22:08:28 INFO [models.api_models:179] Using max length 2048 - 1 |
| 2026-08-08:22:08:28 INFO [models.api_models:200] Using tokenizer huggingface |
| 2026-08-08:22:08:41 INFO [evaluator_utils:446] Selected tasks: |
| 2026-08-08:22:08:41 INFO [evaluator_utils:480] Task: humaneval (humaneval/humaneval.yaml) |
| 2026-08-08:22:08:41 INFO [evaluator_utils:480] Task: mbpp (mbpp/mbpp.yaml) |
| 2026-08-08:22:08:41 INFO [evaluator:314] humaneval: Using gen_kwargs: {'until': ['\nclass', '\ndef', '\n#', '\nif', '\nprint'], 'max_gen_toks': 1024, 'do_sample': False} |
| 2026-08-08:22:08:41 INFO [evaluator:314] mbpp: Using gen_kwargs: {'until': ['[DONE]'], 'do_sample': False} |
| 2026-08-08:22:08:41 INFO [api.task:312] Building contexts for humaneval on rank 0... |
|
0%| | 0/164 [00:00<?, ?it/s]
82%|βββββββββ | 134/164 [00:00<00:00, 1337.47it/s]
100%|ββββββββββ| 164/164 [00:00<00:00, 1391.86it/s] |
| 2026-08-08:22:08:41 INFO [api.task:312] Building contexts for mbpp on rank 0... |
|
0%| | 0/500 [00:00<?, ?it/s]
3%|β | 15/500 [00:00<00:03, 144.07it/s]
6%|β | 30/500 [00:00<00:03, 146.74it/s]
9%|β | 46/500 [00:00<00:03, 148.96it/s]
12%|ββ | 61/500 [00:00<00:02, 149.28it/s]
15%|ββ | 77/500 [00:00<00:02, 149.71it/s]
19%|ββ | 93/500 [00:00<00:02, 149.64it/s]
22%|βββ | 109/500 [00:00<00:02, 150.14it/s]
25%|βββ | 125/500 [00:00<00:02, 150.51it/s]
28%|βββ | 141/500 [00:00<00:02, 150.98it/s]
31%|ββββ | 157/500 [00:01<00:02, 151.60it/s]
35%|ββββ | 173/500 [00:01<00:02, 151.58it/s]
38%|ββββ | 189/500 [00:01<00:02, 150.79it/s]
41%|ββββ | 205/500 [00:01<00:01, 150.61it/s]
44%|βββββ | 221/500 [00:01<00:01, 150.63it/s]
47%|βββββ | 237/500 [00:01<00:01, 152.02it/s]
51%|βββββ | 253/500 [00:01<00:01, 151.92it/s]
54%|ββββββ | 269/500 [00:01<00:01, 152.62it/s]
57%|ββββββ | 285/500 [00:01<00:01, 152.93it/s]
60%|ββββββ | 301/500 [00:01<00:01, 152.21it/s]
63%|βββββββ | 317/500 [00:02<00:01, 152.12it/s]
67%|βββββββ | 333/500 [00:02<00:01, 151.84it/s]
70%|βββββββ | 349/500 [00:02<00:00, 152.76it/s]
73%|ββββββββ | 365/500 [00:02<00:00, 153.54it/s]
76%|ββββββββ | 381/500 [00:02<00:00, 152.49it/s]
79%|ββββββββ | 397/500 [00:02<00:00, 151.06it/s]
83%|βββββββββ | 413/500 [00:02<00:00, 151.07it/s]
86%|βββββββββ | 429/500 [00:02<00:00, 150.52it/s]
89%|βββββββββ | 445/500 [00:02<00:00, 152.29it/s]
92%|ββββββββββ| 461/500 [00:03<00:00, 151.39it/s]
95%|ββββββββββ| 477/500 [00:03<00:00, 152.15it/s]
99%|ββββββββββ| 493/500 [00:03<00:00, 151.93it/s]
100%|ββββββββββ| 500/500 [00:03<00:00, 151.33it/s] |
| 2026-08-08:22:08:44 INFO [evaluator:585] Running generate_until requests |
| 2026-08-08:22:08:44 INFO [models.api_models:747] Tokenized requests are disabled. Context + generation length is not checked. |
|
Requesting API: 0%| | 0/164 [00:00<?, ?it/s]
Requesting API: 1%| | 1/164 [00:00<02:24, 1.13it/s]
Requesting API: 2%|β | 3/164 [00:01<00:46, 3.44it/s]
Requesting API: 2%|β | 4/164 [00:01<00:41, 3.90it/s]
Requesting API: 3%|β | 5/164 [00:01<00:35, 4.52it/s]
Requesting API: 7%|β | 11/164 [00:01<00:11, 13.61it/s]
Requesting API: 9%|β | 14/164 [00:01<00:09, 15.37it/s]
Requesting API: 10%|β | 17/164 [00:01<00:10, 14.59it/s]
Requesting API: 12%|ββ | 19/164 [00:02<00:10, 14.29it/s]
Requesting API: 13%|ββ | 22/164 [00:02<00:08, 16.46it/s]
Requesting API: 16%|ββ | 26/164 [00:02<00:06, 20.87it/s]
Requesting API: 18%|ββ | 29/164 [00:02<00:06, 22.35it/s]
Requesting API: 20%|ββ | 33/164 [00:02<00:05, 24.68it/s]
Requesting API: 22%|βββ | 36/164 [00:02<00:05, 23.81it/s]
Requesting API: 26%|βββ | 42/164 [00:02<00:03, 31.57it/s]
Requesting API: 28%|βββ | 46/164 [00:02<00:04, 26.94it/s]
Requesting API: 31%|βββ | 51/164 [00:03<00:03, 29.88it/s]
Requesting API: 34%|ββββ | 55/164 [00:03<00:03, 31.28it/s]
Requesting API: 36%|ββββ | 59/164 [00:03<00:04, 24.14it/s]
Requesting API: 38%|ββββ | 63/164 [00:03<00:03, 27.00it/s]
Requesting API: 42%|βββββ | 69/164 [00:03<00:02, 33.72it/s]
Requesting API: 46%|βββββ | 76/164 [00:03<00:02, 39.61it/s]
Requesting API: 50%|βββββ | 82/164 [00:03<00:01, 44.15it/s]
Requesting API: 53%|ββββββ | 87/164 [00:04<00:02, 37.51it/s]
Requesting API: 56%|ββββββ | 92/164 [00:04<00:02, 33.74it/s]
Requesting API: 60%|ββββββ | 98/164 [00:04<00:01, 35.97it/s]
Requesting API: 66%|βββββββ | 109/164 [00:04<00:01, 50.57it/s]
Requesting API: 70%|βββββββ | 115/164 [00:04<00:00, 50.20it/s]
Requesting API: 74%|ββββββββ | 121/164 [00:04<00:00, 48.56it/s]
Requesting API: 79%|ββββββββ | 129/164 [00:04<00:00, 55.69it/s]
Requesting API: 82%|βββββββββ | 135/164 [00:05<00:00, 56.46it/s]
Requesting API: 86%|βββββββββ | 141/164 [00:05<00:00, 53.32it/s]
Requesting API: 90%|βββββββββ | 147/164 [00:05<00:00, 45.36it/s]
Requesting API: 93%|ββββββββββ| 152/164 [00:05<00:00, 38.86it/s]
Requesting API: 96%|ββββββββββ| 157/164 [00:06<00:00, 18.86it/s]
Requesting API: 98%|ββββββββββ| 161/164 [00:07<00:00, 7.09it/s]
Requesting API: 100%|ββββββββββ| 164/164 [00:18<00:00, 1.27it/s]
Requesting API: 100%|ββββββββββ| 164/164 [00:18<00:00, 9.09it/s] |
|
Requesting API: 0%| | 0/500 [00:00<?, ?it/s]
Requesting API: 0%| | 1/500 [00:00<07:55, 1.05it/s]
Requesting API: 1%| | 3/500 [00:01<02:21, 3.52it/s]
Requesting API: 1%| | 5/500 [00:01<01:29, 5.52it/s]
Requesting API: 2%|β | 12/500 [00:01<00:30, 15.78it/s]
Requesting API: 4%|β | 20/500 [00:01<00:18, 25.41it/s]
Requesting API: 5%|β | 26/500 [00:01<00:14, 31.68it/s]
Requesting API: 6%|β | 31/500 [00:01<00:15, 30.70it/s]
Requesting API: 7%|β | 35/500 [00:01<00:15, 30.12it/s]
Requesting API: 8%|β | 39/500 [00:02<00:14, 31.37it/s]
Requesting API: 9%|β | 47/500 [00:02<00:11, 40.58it/s]
Requesting API: 10%|β | 52/500 [00:02<00:12, 34.93it/s]
Requesting API: 12%|ββ | 59/500 [00:02<00:11, 38.92it/s]
Requesting API: 13%|ββ | 64/500 [00:02<00:12, 36.03it/s]
Requesting API: 14%|ββ | 70/500 [00:02<00:11, 37.33it/s]
Requesting API: 15%|ββ | 75/500 [00:02<00:12, 34.04it/s]
Requesting API: 16%|ββ | 80/500 [00:03<00:11, 35.66it/s]
Requesting API: 17%|ββ | 86/500 [00:03<00:10, 39.81it/s]
Requesting API: 18%|ββ | 91/500 [00:03<00:10, 39.09it/s]
Requesting API: 20%|ββ | 98/500 [00:03<00:09, 41.38it/s]
Requesting API: 21%|ββ | 105/500 [00:03<00:09, 40.45it/s]
Requesting API: 22%|βββ | 110/500 [00:03<00:10, 37.23it/s]
Requesting API: 23%|βββ | 116/500 [00:03<00:09, 40.31it/s]
Requesting API: 24%|βββ | 121/500 [00:04<00:09, 40.27it/s]
Requesting API: 25%|βββ | 126/500 [00:04<00:10, 36.38it/s]
Requesting API: 26%|βββ | 130/500 [00:04<00:10, 35.72it/s]
Requesting API: 27%|βββ | 135/500 [00:04<00:10, 33.60it/s]
Requesting API: 28%|βββ | 139/500 [00:04<00:11, 32.34it/s]
Requesting API: 29%|βββ | 143/500 [00:04<00:11, 30.23it/s]
Requesting API: 30%|βββ | 150/500 [00:05<00:10, 33.29it/s]
Requesting API: 31%|βββ | 154/500 [00:05<00:10, 34.51it/s]
Requesting API: 32%|ββββ | 158/500 [00:05<00:10, 33.69it/s]
Requesting API: 34%|ββββ | 169/500 [00:05<00:06, 48.07it/s]
Requesting API: 35%|ββββ | 174/500 [00:05<00:09, 36.21it/s]
Requesting API: 36%|ββββ | 179/500 [00:05<00:09, 35.66it/s]
Requesting API: 37%|ββββ | 183/500 [00:05<00:09, 33.87it/s]
Requesting API: 38%|ββββ | 189/500 [00:06<00:09, 34.02it/s]
Requesting API: 39%|ββββ | 193/500 [00:06<00:08, 34.22it/s]
Requesting API: 40%|ββββ | 199/500 [00:06<00:08, 36.20it/s]
Requesting API: 41%|ββββ | 203/500 [00:06<00:08, 36.22it/s]
Requesting API: 42%|βββββ | 208/500 [00:06<00:08, 36.35it/s]
Requesting API: 42%|βββββ | 212/500 [00:06<00:08, 34.55it/s]
Requesting API: 43%|βββββ | 217/500 [00:06<00:08, 32.70it/s]
Requesting API: 45%|βββββ | 225/500 [00:07<00:06, 42.86it/s]
Requesting API: 46%|βββββ | 231/500 [00:07<00:06, 44.44it/s]
Requesting API: 47%|βββββ | 236/500 [00:07<00:05, 44.17it/s]
Requesting API: 49%|βββββ | 243/500 [00:07<00:05, 44.09it/s]
Requesting API: 50%|βββββ | 248/500 [00:07<00:05, 44.69it/s]
Requesting API: 51%|βββββ | 253/500 [00:07<00:05, 43.69it/s]
Requesting API: 52%|ββββββ | 258/500 [00:07<00:06, 38.29it/s]
Requesting API: 53%|ββββββ | 263/500 [00:07<00:05, 40.16it/s]
Requesting API: 54%|ββββββ | 269/500 [00:08<00:05, 41.35it/s]
Requesting API: 55%|ββββββ | 274/500 [00:08<00:05, 38.60it/s]
Requesting API: 56%|ββββββ | 280/500 [00:08<00:05, 42.64it/s]
Requesting API: 57%|ββββββ | 285/500 [00:08<00:04, 44.16it/s]
Requesting API: 58%|ββββββ | 290/500 [00:08<00:05, 40.74it/s]
Requesting API: 59%|ββββββ | 295/500 [00:08<00:05, 40.46it/s]
Requesting API: 60%|ββββββ | 301/500 [00:08<00:04, 43.30it/s]
Requesting API: 62%|βββββββ | 309/500 [00:08<00:03, 50.29it/s]
Requesting API: 63%|βββββββ | 315/500 [00:09<00:04, 46.12it/s]
Requesting API: 64%|βββββββ | 321/500 [00:09<00:04, 40.90it/s]
Requesting API: 65%|βββββββ | 326/500 [00:09<00:04, 40.70it/s]
Requesting API: 67%|βββββββ | 334/500 [00:09<00:04, 41.42it/s]
Requesting API: 68%|βββββββ | 341/500 [00:09<00:03, 46.79it/s]
Requesting API: 69%|βββββββ | 346/500 [00:09<00:03, 43.64it/s]
Requesting API: 71%|βββββββ | 353/500 [00:09<00:03, 46.38it/s]
Requesting API: 72%|ββββββββ | 360/500 [00:10<00:02, 50.00it/s]
Requesting API: 74%|ββββββββ | 369/500 [00:10<00:02, 54.63it/s]
Requesting API: 76%|ββββββββ | 378/500 [00:10<00:01, 62.68it/s]
Requesting API: 77%|ββββββββ | 385/500 [00:10<00:02, 48.71it/s]
Requesting API: 78%|ββββββββ | 391/500 [00:10<00:02, 50.13it/s]
Requesting API: 80%|ββββββββ | 399/500 [00:10<00:01, 54.98it/s]
Requesting API: 82%|βββββββββ | 408/500 [00:10<00:01, 60.57it/s]
Requesting API: 83%|βββββββββ | 416/500 [00:11<00:01, 60.48it/s]
Requesting API: 85%|βββββββββ | 423/500 [00:11<00:01, 55.32it/s]
Requesting API: 86%|βββββββββ | 430/500 [00:11<00:01, 53.28it/s]
Requesting API: 88%|βββββββββ | 441/500 [00:11<00:00, 66.39it/s]
Requesting API: 90%|βββββββββ | 449/500 [00:11<00:00, 66.25it/s]
Requesting API: 91%|ββββββββββ| 457/500 [00:11<00:00, 68.19it/s]
Requesting API: 93%|ββββββββββ| 465/500 [00:11<00:00, 65.58it/s]
Requesting API: 94%|ββββββββββ| 472/500 [00:11<00:00, 59.48it/s]
Requesting API: 97%|ββββββββββ| 483/500 [00:12<00:00, 67.30it/s]
Requesting API: 98%|ββββββββββ| 490/500 [00:12<00:00, 61.75it/s]
Requesting API: 99%|ββββββββββ| 497/500 [00:12<00:00, 35.28it/s]
Requesting API: 100%|ββββββββββ| 500/500 [00:14<00:00, 34.19it/s] |
| 2026-08-08:22:14:13 INFO [loggers.evaluation_tracker:247] Saving results aggregated |
| 2026-08-08:22:14:13 INFO [loggers.evaluation_tracker:119] Saving per-task samples to outputs/evals/release/math-keep50-step0150/student/*.jsonl |
| local-completions ({'model': 'student', 'base_url': 'http://127.0.0.1:8461/v1/completions', 'tokenizer': 'outputs/release/healed/release-offpolicy-math-keep50/step0150', 'num_concurrent': 48, 'tokenized_requests': False, 'max_retries': 3}), gen_kwargs: ({}), limit: None, num_fewshot: None, batch_size: 1 |
| | Tasks |Version| Filter |n-shot| Metric | |Value| |Stderr| |
| |---------|------:|-----------|-----:|---------|---|----:|---|-----:| |
| |humaneval| 1|create_test| 0|pass@1 |β |0.189|Β± |0.0307| |
| |mbpp | 1|none | 3|pass_at_1|β |0.150|Β± |0.0160| |
|
|
| 2026-08-08T22:14:14-07:00 lm_eval exit=0 -> outputs/evals/release/math-keep50-step0150 |
|
|