eval_mm_niah/counting-text-test.log

language_model.model.layers.0 4
language_model.model.layers.1 4
language_model.model.layers.2 4
language_model.model.layers.3 4
language_model.model.layers.4 4
language_model.model.layers.5 4
language_model.model.layers.6 4
language_model.model.layers.7 4
language_model.model.layers.8 4
language_model.model.layers.9 4
language_model.model.layers.10 4
language_model.model.layers.11 4
language_model.model.layers.12 4
language_model.model.layers.13 4
language_model.model.layers.14 4
language_model.model.layers.15 4
language_model.model.layers.16 4
language_model.model.layers.17 4
language_model.model.layers.18 4
language_model.model.layers.19 4
language_model.model.layers.20 4
language_model.model.layers.21 4
language_model.model.layers.22 4
language_model.model.layers.23 4
vision_model.encoder.layers.0 0
vision_model.encoder.layers.1 0
vision_model.encoder.layers.2 0
vision_model.encoder.layers.3 0
vision_model.encoder.layers.4 0
vision_model.encoder.layers.5 0
vision_model.encoder.layers.6 0
vision_model.encoder.layers.7 0
vision_model.encoder.layers.8 0
vision_model.encoder.layers.9 0
vision_model.encoder.layers.10 0
vision_model.encoder.layers.11 0
vision_model.encoder.layers.12 0
vision_model.encoder.layers.13 0
vision_model.encoder.layers.14 0
vision_model.encoder.layers.15 0
vision_model.encoder.layers.16 0
vision_model.encoder.layers.17 0
vision_model.encoder.layers.18 0
vision_model.encoder.layers.19 0
vision_model.encoder.layers.20 0
vision_model.encoder.layers.21 0
vision_model.encoder.layers.22 0
vision_model.encoder.layers.23 0
vision_model.embeddings 0
mlp1 0
language_model.model.tok_embeddings 4
language_model.model.norm 4
language_model.output 4
language_model.model.embed_tokens 4
language_model.lm_head 4
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [0] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task counting-text-test, devices: {device(type='cuda', index=0), device(type='cuda', index=4)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [2] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task counting-text-test, devices: {device(type='cuda', index=2), device(type='cuda', index=6)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [1] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task counting-text-test, devices: {device(type='cuda', index=1), device(type='cuda', index=5)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [3] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task counting-text-test, devices: {device(type='cuda', index=3), device(type='cuda', index=7)}
Rank 3 len(skip_idx)=0
Rank 0 len(skip_idx)=0
Rank 2 len(skip_idx)=0
Rank 1 len(skip_idx)=0
[2024-08-03 15:13:16] [Rank 2] totoal_tokens=612, outputs='[1, 1, 1]'
[2024-08-03 15:13:16] [Rank 0] totoal_tokens=621, outputs='[1, 1, 1]'
[2024-08-03 15:13:16] [Rank 1] totoal_tokens=621, outputs='[1, 1, 1]'
[2024-08-03 15:13:16] [Rank 3] totoal_tokens=611, outputs='[2, 2, 2]'
[2024-08-03 15:13:16] [Rank 2] totoal_tokens=621, outputs='[2, 3, 4]'
[2024-08-03 15:13:16] [Rank 3] totoal_tokens=626, outputs='[1, 1, 1]'
[2024-08-03 15:13:16] [Rank 0] totoal_tokens=623, outputs='[1, 2, 3]'
[2024-08-03 15:13:16] [Rank 1] totoal_tokens=622, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:13:17] [Rank 2] totoal_tokens=624, outputs='[1, 1, 1]'
[2024-08-03 15:13:17] [Rank 0] totoal_tokens=624, outputs='[2, 3, 3]'
[2024-08-03 15:13:17] [Rank 3] totoal_tokens=641, outputs='[2, 2, 2]'
[2024-08-03 15:13:17] [Rank 1] totoal_tokens=643, outputs='{"number of keys": 4}'
[2024-08-03 15:13:17] [Rank 0] totoal_tokens=626, outputs='[3, 3, 3]'
[2024-08-03 15:13:17] [Rank 2] totoal_tokens=661, outputs='[2, 2, 2]'
[2024-08-03 15:13:17] [Rank 3] totoal_tokens=653, outputs='[3, 3, 3]'
[2024-08-03 15:13:17] [Rank 1] totoal_tokens=661, outputs='[4, 3, 2]'
[2024-08-03 15:13:17] [Rank 2] totoal_tokens=674, outputs='[1, 1, 1]'
[2024-08-03 15:13:17] [Rank 0] totoal_tokens=637, outputs='[1, 2, 3]'
[2024-08-03 15:13:17] [Rank 3] totoal_tokens=661, outputs='[2, 2, 2]'
[2024-08-03 15:13:17] [Rank 1] totoal_tokens=683, outputs='[2, 2, 2]'
[2024-08-03 15:13:17] [Rank 0] totoal_tokens=663, outputs='[1, 1, 1]'
[2024-08-03 15:13:18] [Rank 3] totoal_tokens=661, outputs='[3, 3, 3]'
[2024-08-03 15:13:18] [Rank 2] totoal_tokens=704, outputs='```json\n{\n  "score": 4\n}\n```'
[2024-08-03 15:13:18] [Rank 1] totoal_tokens=683, outputs='[2, 0, 3]'
[2024-08-03 15:13:18] [Rank 0] totoal_tokens=672, outputs='[1, 1, 1]'
[2024-08-03 15:13:18] [Rank 1] totoal_tokens=685, outputs='[2, 2, 2]'
[2024-08-03 15:13:18] [Rank 3] totoal_tokens=685, outputs='```json\n{\n  "trees": 6\n}\n```'
[2024-08-03 15:13:18] [Rank 0] totoal_tokens=683, outputs='[2, 4, 4]'
[2024-08-03 15:13:18] [Rank 2] totoal_tokens=708, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:13:18] [Rank 1] totoal_tokens=740, outputs='[4, 1, 0]'
[2024-08-03 15:13:18] [Rank 2] totoal_tokens=819, outputs='[1, 1, 1]'
[2024-08-03 15:13:18] [Rank 3] totoal_tokens=740, outputs='[1, 1, 1]'
[2024-08-03 15:13:18] [Rank 0] totoal_tokens=731, outputs='[3, 2, 1]'
[2024-08-03 15:13:18] [Rank 1] totoal_tokens=779, outputs='[2, 3]'
[2024-08-03 15:13:19] [Rank 1] totoal_tokens=782, outputs='[4, 2]'
[2024-08-03 15:13:19] [Rank 0] totoal_tokens=740, outputs='[2, 2, 2]'

Processing InternVL2-2B_counting-text-test.jsonl:   0%|          | 0/765 [00:00<?, ?it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   0%|          | 1/765 [00:01<14:34,  1.14s/it]
Processing InternVL2-2B_counting-text-test.jsonl:   0%|          | 2/765 [00:01<08:31,  1.49it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   0%|          | 3/765 [00:01<06:22,  1.99it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   1%|          | 4/765 [00:02<05:18,  2.39it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   1%|          | 5/765 [00:02<04:47,  2.64it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   1%|          | 6/765 [00:02<04:31,  2.80it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   1%|          | 7/765 [00:02<04:16,  2.96it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   1%|          | 8/765 [00:03<04:07,  3.06it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   1%|          | 9/765 [00:03<04:08,  3.05it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  [2024-08-03 15:13:19] [Rank 3] totoal_tokens=769, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:13:19] [Rank 2] totoal_tokens=827, outputs='```json\n{\n  "vases": 3\n}\n```'
[2024-08-03 15:13:19] [Rank 0] totoal_tokens=762, outputs='[1, 3, 1]'
[2024-08-03 15:13:19] [Rank 2] totoal_tokens=831, outputs='[4, 3, 1]'
[2024-08-03 15:13:19] [Rank 3] totoal_tokens=780, outputs='[1, 1, 1]'
[2024-08-03 15:13:19] [Rank 0] totoal_tokens=763, outputs='[2, 2, 2]'
[2024-08-03 15:13:19] [Rank 1] totoal_tokens=816, outputs='```json\n{\n  "count": 3,\n  "total": 4\n}\n```'
[2024-08-03 15:13:20] [Rank 3] totoal_tokens=790, outputs='[1, 1, 1]'
[2024-08-03 15:13:20] [Rank 2] totoal_tokens=850, outputs='[1, 2, 2, 1]'
[2024-08-03 15:13:20] [Rank 0] totoal_tokens=779, outputs='[3, 2, 4]'
[2024-08-03 15:13:20] [Rank 0] totoal_tokens=793, outputs='[1, 2, 3]'
[2024-08-03 15:13:20] [Rank 3] totoal_tokens=819, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:13:20] [Rank 2] totoal_tokens=871, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:13:20] [Rank 1] totoal_tokens=830, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:20] [Rank 0] totoal_tokens=800, outputs='[3, 3, 3]'
[2024-08-03 15:13:20] [Rank 3] totoal_tokens=829, outputs='[1, 1, 1]'
[2024-08-03 15:13:20] [Rank 2] totoal_tokens=879, outputs='[1, 1, 1]'
[2024-08-03 15:13:21] [Rank 1] totoal_tokens=842, outputs='[4, 2, 4]'
[2024-08-03 15:13:21] [Rank 0] totoal_tokens=800, outputs='{"number_of_owls": 4}'
[2024-08-03 15:13:21] [Rank 3] totoal_tokens=879, outputs='[1, 1, 1]'
[2024-08-03 15:13:21] [Rank 2] totoal_tokens=889, outputs='[4, 9, 9]'
[2024-08-03 15:13:21] [Rank 3] totoal_tokens=889, outputs='[2, 3, 2]'
[2024-08-03 15:13:21] [Rank 0] totoal_tokens=802, outputs='[3, 1, 4]'
[2024-08-03 15:13:21] [Rank 2] totoal_tokens=889, outputs='[4, 4, 4]'
[2024-08-03 15:13:21] [Rank 3] totoal_tokens=891, outputs='[1, 1, 1]'
[2024-08-03 15:13:21] [Rank 0] totoal_tokens=809, outputs='[1, 1, 1]'
[2024-08-03 15:13:21] [Rank 2] totoal_tokens=890, outputs='[1, 1, 1]'
[2024-08-03 15:13:21] [Rank 1] totoal_tokens=850, outputs='```json\n{\n  "Tony Curtis": 4,\n  "Burt Lancaster": 3,\n  "John Wayne": 2\n}'
[2024-08-03 15:13:22] [Rank 3] totoal_tokens=891, outputs='[3, 4, 1]'
[2024-08-03 15:13:22] [Rank 0] totoal_tokens=831, outputs='[2, 2, 2]'
[2024-08-03 15:13:22] [Rank 2] totoal_tokens=901, outputs='[1, 1, 1]'
[2024-08-03 15:13:22] [Rank 1] totoal_tokens=879, outputs='[1, 1, 1]'
[2024-08-03 15:13:22] [Rank 3] totoal_tokens=892, outputs='[4, 3, 1]'
[2024-08-03 15:13:22] [Rank 0] totoal_tokens=868, outputs='[1, 1, 1]'
 1%|▏         | 10/765 [00:03<04:07,  3.05it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   1%|▏         | 11/765 [00:04<04:02,  3.11it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   2%|▏         | 12/765 [00:04<03:57,  3.17it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   2%|▏         | 13/765 [00:04<03:54,  3.21it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   2%|▏         | 14/765 [00:05<03:59,  3.14it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   2%|▏         | 15/765 [00:05<04:03,  3.09it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   2%|▏         | 16/765 [00:05<04:03,  3.08it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   2%|▏         | 17/765 [00:06<04:12,  2.96it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   2%|▏         | 18/765 [00:06<04:05,  3.04it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   2%|▏         | 19/765 [00:06<04:00,  3.10it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   3%|▎       [2024-08-03 15:13:22] [Rank 1] totoal_tokens=879, outputs='[2, 2, 2]'
[2024-08-03 15:13:22] [Rank 2] totoal_tokens=927, outputs='```json\n{\n  "computers": 3\n}\n```'
[2024-08-03 15:13:22] [Rank 3] totoal_tokens=899, outputs='[1, 1, 1]'
[2024-08-03 15:13:22] [Rank 1] totoal_tokens=886, outputs='[4, 1, 4]'
[2024-08-03 15:13:23] [Rank 3] totoal_tokens=899, outputs='[4, 4, 4]'
[2024-08-03 15:13:23] [Rank 2] totoal_tokens=936, outputs='[3, 1, 1]'
[2024-08-03 15:13:23] [Rank 1] totoal_tokens=889, outputs='[2, 3, 4]'
[2024-08-03 15:13:23] [Rank 3] totoal_tokens=901, outputs='[3, 1, 4]'
[2024-08-03 15:13:23] [Rank 0] totoal_tokens=869, outputs='```json\n{\n  "text": "A Throne of Ruin The little penguin counted 1 ★.\\nA Throne of Ru'
[2024-08-03 15:13:23] [Rank 3] totoal_tokens=904, outputs='[2, 1]'
[2024-08-03 15:13:23] [Rank 0] totoal_tokens=869, outputs='[1, 1, 1]'
[2024-08-03 15:13:23] [Rank 1] totoal_tokens=890, outputs='```json\n{\n  "total_★": 3\n}\n```'
[2024-08-03 15:13:23] [Rank 3] totoal_tokens=914, outputs='[4, 3, 3]'
[2024-08-03 15:13:23] [Rank 2] totoal_tokens=961, outputs='```json\n{\n  "title": "Verity",\n  "author": "Colleen Hoover",\n  "genre": "Drama",'
[2024-08-03 15:13:23] [Rank 0] totoal_tokens=890, outputs='[3, 1, 4]'
[2024-08-03 15:13:24] [Rank 3] totoal_tokens=950, outputs='[1, 1, 1]'
[2024-08-03 15:13:24] [Rank 2] totoal_tokens=964, outputs='[3, 3, 3]'
[2024-08-03 15:13:24] [Rank 0] totoal_tokens=891, outputs='[1, 1, 1]'
[2024-08-03 15:13:24] [Rank 3] totoal_tokens=961, outputs='[2, 2, 2]'
[2024-08-03 15:13:24] [Rank 0] totoal_tokens=895, outputs='[4, 3, 4]'
[2024-08-03 15:13:24] [Rank 1] totoal_tokens=890, outputs='```json\n{\n  "computer_count": 3,\n  "computer_count_2": 3,\n  "computer_count_3": 4'
[2024-08-03 15:13:24] [Rank 0] totoal_tokens=897, outputs='[2, 2, 2]'
[2024-08-03 15:13:24] [Rank 1] totoal_tokens=891, outputs='[3, 3, 3]'
[2024-08-03 15:13:25] [Rank 2] totoal_tokens=981, outputs='```json\n{\n  "title": "Verity",\n  "author": "Colleen Hoover",\n  "genre": "Drama",'
[2024-08-03 15:13:25] [Rank 0] totoal_tokens=912, outputs='[3, 1, 1]'
[2024-08-03 15:13:25] [Rank 1] totoal_tokens=896, outputs='[1, 1, 1]'
[2024-08-03 15:13:25] [Rank 3] totoal_tokens=1018, outputs='```json\n{\n  "min": 0.5,\n  "max": 2.5,\n  "min_2": 0.'
[2024-08-03 15:13:25] [Rank 2] totoal_tokens=982, outputs='[1, 1, 1]'
[2024-08-03 15:13:25] [Rank 0] totoal_tokens=913, outputs='[1, 1, 1]'
[2024-08-03 15:13:25] [Rank 1] totoal_tokens=901, outputs='[3, 3, 3]'
[2024-08-03 15:13:25] [Rank 3] totoal_tokens=1022, outputs='[27, 90, 50]'
[2024-08-03 15:13:25] [Rank 1] totoal_tokens=904, outputs='[2, 2, 4]'
[2024-08-03 15:13:25] [Rank 0] totoal_tokens=946, outputs='{\n  "number_of_★": 2\n}'
[2024-08-03 15:13:25] [Rank 2] totoal_tokens=1002, outputs='```json\n{\n  "counted_apples": 3\n}\n```'
[2024-08-03 15:13:25] [Rank 3] totoal_tokens=1024, outputs='[3, 3, 3]'
[2024-08-03 15:13:26] [Rank 1] totoal_tokens=912, outputs='[3, 3, 3]'
[2024-08-03 15:13:26] [Rank 0] totoal_tokens=994, outputs='[2, 3, 1]'
  | 20/765 [00:07<04:04,  3.05it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   3%|▎         | 21/765 [00:08<06:11,  2.00it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   3%|▎         | 22/765 [00:08<05:31,  2.24it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   3%|▎         | 23/765 [00:08<04:59,  2.47it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   3%|▎         | 24/765 [00:09<04:36,  2.68it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   3%|▎         | 25/765 [00:09<04:21,  2.83it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   3%|▎         | 26/765 [00:09<04:11,  2.93it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   4%|▎         | 27/765 [00:09<04:03,  3.03it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   4%|▎         | 28/765 [00:10<03:58,  3.09it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   4%|▍         | 29/765 [00:10<04:12,  2.91it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   4%|▍         | 30/765 [00[2024-08-03 15:13:26] [Rank 2] totoal_tokens=1014, outputs='[2, 3, 3]'
[2024-08-03 15:13:26] [Rank 3] totoal_tokens=1026, outputs='[2, 1, 2]'
[2024-08-03 15:13:26] [Rank 1] totoal_tokens=924, outputs='[4, 2, 2]'
[2024-08-03 15:13:26] [Rank 2] totoal_tokens=1016, outputs='[1, 1, 1]'
[2024-08-03 15:13:26] [Rank 0] totoal_tokens=1002, outputs='[1, 1, 1]'
[2024-08-03 15:13:26] [Rank 1] totoal_tokens=927, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:13:26] [Rank 3] totoal_tokens=1035, outputs='[1, 1, 3]'
[2024-08-03 15:13:27] [Rank 0] totoal_tokens=1017, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:13:27] [Rank 2] totoal_tokens=1019, outputs='```json\n{\n  "vase_count": 3\n}\n```'
[2024-08-03 15:13:27] [Rank 1] totoal_tokens=932, outputs='[3, 3, 3]'
[2024-08-03 15:13:27] [Rank 3] totoal_tokens=1036, outputs='[3, 1, 3]'
[2024-08-03 15:13:27] [Rank 3] totoal_tokens=1041, outputs='{"x": 1}'
[2024-08-03 15:13:27] [Rank 1] totoal_tokens=955, outputs='[2, 2, 2]'
[2024-08-03 15:13:27] [Rank 2] totoal_tokens=1021, outputs='```json\n{\n  "BricsCAD Mechanical": "30,000",\n  "BricsCAD": "4"\n}\n```'
[2024-08-03 15:13:27] [Rank 3] totoal_tokens=1042, outputs='[2, 2, 2]'
[2024-08-03 15:13:27] [Rank 0] totoal_tokens=1018, outputs='```json\n{\n  "mining_investment": 0.5,\n  "forecast": 6,\n  "mining_investment'
[2024-08-03 15:13:27] [Rank 1] totoal_tokens=959, outputs='[2, 2, 2]'
[2024-08-03 15:13:28] [Rank 0] totoal_tokens=1022, outputs='[4, 4, 4]'
[2024-08-03 15:13:28] [Rank 3] totoal_tokens=1048, outputs='[1, 1, 1]'
[2024-08-03 15:13:28] [Rank 2] totoal_tokens=1025, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:13:28] [Rank 1] totoal_tokens=981, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:13:28] [Rank 3] totoal_tokens=1048, outputs='[3, 3, 3]'
[2024-08-03 15:13:28] [Rank 2] totoal_tokens=1028, outputs='[1, 1, 1]'
[2024-08-03 15:13:28] [Rank 3] totoal_tokens=1049, outputs='[4, 4, 4]'
[2024-08-03 15:13:28] [Rank 1] totoal_tokens=992, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:13:29] [Rank 3] totoal_tokens=1074, outputs='[1, 1, 4]'
[2024-08-03 15:13:29] [Rank 1] totoal_tokens=1002, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:13:29] [Rank 0] totoal_tokens=1024, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:29] [Rank 3] totoal_tokens=1075, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:13:29] [Rank 0] totoal_tokens=1025, outputs='[3, 3, 3]'
[2024-08-03 15:13:29] [Rank 2] totoal_tokens=1034, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:30] [Rank 0] totoal_tokens=1031, outputs='[1, 1, 1]'
[2024-08-03 15:13:30] [Rank 2] totoal_tokens=1048, outputs='[3, 1, 0]'
[2024-08-03 15:13:30] [Rank 1] totoal_tokens=1008, outputs='```json\n{\n  "min": 0.5,\n  "max": 2.5,\n  "average": 1.5'
[2024-08-03 15:13:30] [Rank 2] totoal_tokens=1049, outputs='[1, 1, 1]'
[2024-08-03 15:13:30] [Rank 3] totoal_tokens=1076, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:13:30] [Rank 0] totoal_tokens=1032, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:13:30] [Rank 3] totoal_tokens=1077, outputs='[2, 2, 2]'
[2024-08-03 15:13:30] [Rank 2] totoal_tokens=1049, outputs='[3, 1, 1]'
[2024-08-03 15:13:30] [Rank 0] totoal_tokens=1039, outputs='[4, 4, 2]'
[2024-08-03 15:13:31] [Rank 2] totoal_tokens=1052, outputs='[3, 3, 4]'
[2024-08-03 15:13:31] [Rank 1] totoal_tokens=1010, outputs='```json\n{\n  "min": 0.5,\n  "max": 2.5,\n  "min_2": 0.'
[2024-08-03 15:13:31] [Rank 3] totoal_tokens=1077, outputs='```json\n{\n  "vases": 7\n}\n```'
[2024-08-03 15:13:31] [Rank 0] totoal_tokens=1045, outputs='```json\n{\n  "computer_count": 3\n}\n```'
:10<04:03,  3.01it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   4%|▍         | 31/765 [00:11<04:00,  3.05it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   4%|▍         | 32/765 [00:11<04:33,  2.68it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   4%|▍         | 33/765 [00:12<06:22,  1.91it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   4%|▍         | 34/765 [00:12<05:36,  2.17it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   5%|▍         | 35/765 [00:14<08:37,  1.41it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   5%|▍         | 36/765 [00:14<07:12,  1.69it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   5%|▍         | 37/765 [00:14<06:07,  1.98it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   5%|▍         | 38/765 [00:15<06:03,  2.00it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   5%|▌         | 39/765 [00:15<05:22,  2.25it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   5%|▌         | 40/765 [00:16<05:31,  2.[2024-08-03 15:13:31] [Rank 1] totoal_tokens=1019, outputs='{"apple": 3}'
[2024-08-03 15:13:31] [Rank 2] totoal_tokens=1060, outputs='[1, 4, 4]'
[2024-08-03 15:13:31] [Rank 0] totoal_tokens=1076, outputs='[3, 3, 3]'
[2024-08-03 15:13:31] [Rank 1] totoal_tokens=1019, outputs='[1, 3, 0]'
[2024-08-03 15:13:31] [Rank 2] totoal_tokens=1061, outputs='[2, 1, 1]'
[2024-08-03 15:13:32] [Rank 1] totoal_tokens=1029, outputs='[1, 1, 1]'
[2024-08-03 15:13:32] [Rank 2] totoal_tokens=1063, outputs='[3, 3, 3]'
[2024-08-03 15:13:32] [Rank 0] totoal_tokens=1079, outputs='```json\n{\n  "key_count": 1\n}\n```'
[2024-08-03 15:13:32] [Rank 3] totoal_tokens=1083, outputs='[2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2'
[2024-08-03 15:13:32] [Rank 1] totoal_tokens=1031, outputs='[2, 2, 2]'
[2024-08-03 15:13:32] [Rank 2] totoal_tokens=1067, outputs='[4, 3, 2]'
[2024-08-03 15:13:32] [Rank 0] totoal_tokens=1079, outputs='[1, 1, 1]'
[2024-08-03 15:13:32] [Rank 3] totoal_tokens=1083, outputs='[4, 2, 3]'
[2024-08-03 15:13:32] [Rank 2] totoal_tokens=1070, outputs='[2, 3]'
[2024-08-03 15:13:32] [Rank 1] totoal_tokens=1037, outputs='[1, 1, 1]'
[2024-08-03 15:13:32] [Rank 0] totoal_tokens=1083, outputs='[1, 1, 1]'
[2024-08-03 15:13:32] [Rank 3] totoal_tokens=1086, outputs='[2, 1, 1]'
[2024-08-03 15:13:32] [Rank 2] totoal_tokens=1077, outputs='[3, 1, 1]'
[2024-08-03 15:13:33] [Rank 1] totoal_tokens=1042, outputs='[2, 3, 3]'
[2024-08-03 15:13:33] [Rank 1] totoal_tokens=1056, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:13:33] [Rank 2] totoal_tokens=1080, outputs='[1, 1, 1]'
[2024-08-03 15:13:33] [Rank 3] totoal_tokens=1089, outputs='```json\n{\n  "lighthouse_count": [\n    4,\n    1,\n    1\n  ]\n}\n```'
[2024-08-03 15:13:33] [Rank 0] totoal_tokens=1084, outputs='[2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2'
[2024-08-03 15:13:33] [Rank 1] totoal_tokens=1058, outputs='[3, 3, 3]'
[2024-08-03 15:13:34] [Rank 3] totoal_tokens=1091, outputs='[4, 2, 2]'
[2024-08-03 15:13:34] [Rank 1] totoal_tokens=1061, outputs='[3, 3, 3]'
[2024-08-03 15:13:34] [Rank 0] totoal_tokens=1085, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:13:34] [Rank 2] totoal_tokens=1085, outputs='```json\n{\n  "count": 4,\n  "count2": 2,\n  "count3": 3\n}\n```'
[2024-08-03 15:13:34] [Rank 1] totoal_tokens=1072, outputs='[1, 1, 1]'
[2024-08-03 15:13:34] [Rank 0] totoal_tokens=1086, outputs='[3, 1, 1]'
[2024-08-03 15:13:34] [Rank 2] totoal_tokens=1090, outputs='[2, 3, 2]'
[2024-08-03 15:13:34] [Rank 1] totoal_tokens=1073, outputs='[1, 1, 1]'
[2024-08-03 15:13:34] [Rank 3] totoal_tokens=1096, outputs='```json\n{\n  "count": 2\n}\n```'
[2024-08-03 15:13:34] [Rank 0] totoal_tokens=1094, outputs='[2, 1, 4]'
[2024-08-03 15:13:35] [Rank 2] totoal_tokens=1094, outputs='[3, 1, 3]'
[2024-08-03 15:13:35] [Rank 1] totoal_tokens=1079, outputs='[1, 1, 1]'
[2024-08-03 15:13:35] [Rank 0] totoal_tokens=1095, outputs='[2, 4, 3]'
[2024-08-03 15:13:35] [Rank 1] totoal_tokens=1084, outputs='[2, 4, 6]'
[2024-08-03 15:13:35] [Rank 0] totoal_tokens=1099, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:13:35] [Rank 3] totoal_tokens=1098, outputs='```json\n{\n  "vases": 2\n}\n```'
[2024-08-03 15:13:36] [Rank 0] totoal_tokens=1120, outputs='[3, 3, 3]'
19it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   5%|▌         | 41/765 [00:16<05:00,  2.41it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   5%|▌         | 42/765 [00:16<05:18,  2.27it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   6%|▌         | 43/765 [00:17<04:51,  2.48it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   6%|▌         | 44/765 [00:17<04:34,  2.62it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   6%|▌         | 45/765 [00:18<06:25,  1.87it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   6%|▌         | 46/765 [00:19<06:23,  1.88it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   6%|▌         | 47/765 [00:19<05:44,  2.08it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   6%|▋         | 48/765 [00:19<05:09,  2.32it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   6%|▋         | 49/765 [00:20<04:46,  2.50it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   7%|▋         | 50/765 [00:20<05:06,  2.33it/s]
Proces[2024-08-03 15:13:36] [Rank 2] totoal_tokens=1095, outputs='```json\n{\n  "bananas": 1,\n  "penguins": 0\n}\n```'
[2024-08-03 15:13:36] [Rank 3] totoal_tokens=1100, outputs='2'
[2024-08-03 15:13:36] [Rank 1] totoal_tokens=1100, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:13:36] [Rank 0] totoal_tokens=1168, outputs='[4, 1]'
[2024-08-03 15:13:36] [Rank 3] totoal_tokens=1101, outputs='[1, 2, 3]'
[2024-08-03 15:13:36] [Rank 0] totoal_tokens=1168, outputs='[4, 2, 4]'
[2024-08-03 15:13:36] [Rank 1] totoal_tokens=1117, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:13:36] [Rank 3] totoal_tokens=1121, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:13:37] [Rank 2] totoal_tokens=1096, outputs='```json\n{\n  "vases": 1,\n  "vases": 3\n}\n```'
[2024-08-03 15:13:37] [Rank 0] totoal_tokens=1173, outputs='```json\n{\n  "number_of_vases": 1\n}\n```'
[2024-08-03 15:13:37] [Rank 1] totoal_tokens=1117, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:13:37] [Rank 3] totoal_tokens=1132, outputs='```json\n{\n  "tree_count": 2\n}\n```'
[2024-08-03 15:13:37] [Rank 3] totoal_tokens=1152, outputs='[4, 2, 4]'
[2024-08-03 15:13:37] [Rank 0] totoal_tokens=1178, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:13:38] [Rank 2] totoal_tokens=1096, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:13:38] [Rank 1] totoal_tokens=1128, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:38] [Rank 3] totoal_tokens=1160, outputs='```json\n{\n  "chest_count": [\n    1,\n    2\n  ]\n}\n```'
[2024-08-03 15:13:38] [Rank 2] totoal_tokens=1098, outputs='[1, 2, 3]'
[2024-08-03 15:13:38] [Rank 0] totoal_tokens=1180, outputs='```json\n{\n  "number_of_owls": 4\n}\n```'
[2024-08-03 15:13:38] [Rank 2] totoal_tokens=1114, outputs='[1, 1, 1]'
[2024-08-03 15:13:38] [Rank 3] totoal_tokens=1163, outputs='```json\n{\n  "count": 3\n}\n```'
[2024-08-03 15:13:39] [Rank 1] totoal_tokens=1160, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:13:39] [Rank 2] totoal_tokens=1119, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:13:39] [Rank 0] totoal_tokens=1215, outputs='```json\n{\n  "chests": [\n    "3.4%",\n    "3%",\n    "3%",\n    "1.8%",'
[2024-08-03 15:13:39] [Rank 1] totoal_tokens=1162, outputs='```json\n{\n  "brush_count": 6\n}\n```'
[2024-08-03 15:13:39] [Rank 3] totoal_tokens=1185, outputs='```json\n{\n  "compasses": 4\n}\n```'
[2024-08-03 15:13:39] [Rank 2] totoal_tokens=1121, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:13:39] [Rank 1] totoal_tokens=1167, outputs='[1, 1, 1]'
[2024-08-03 15:13:40] [Rank 3] totoal_tokens=1210, outputs='```json\n{\n  "vases": 1\n}\n```'
[2024-08-03 15:13:40] [Rank 0] totoal_tokens=1215, outputs='```json\n{\n  "key_points": [\n    {\n      "title": "Australian real GDP growth",\n      "description": "After several years'
[2024-08-03 15:13:40] [Rank 2] totoal_tokens=1129, outputs='```json\n{\n  "vases": 2\n}\n```'
[2024-08-03 15:13:40] [Rank 3] totoal_tokens=1216, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:13:40] [Rank 0] totoal_tokens=1216, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:13:40] [Rank 2] totoal_tokens=1133, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:13:41] [Rank 1] totoal_tokens=1176, outputs='```json\n{\n  "number_of_owls": 3,\n  "number_of_owls": 2\n}\n```'
[2024-08-03 15:13:41] [Rank 0] totoal_tokens=1232, outputs='[3, 3, 3]'
[2024-08-03 15:13:41] [Rank 3] totoal_tokens=1216, outputs='```json\n{\n  "key_count": 4\n}\n```'
[2024-08-03 15:13:41] [Rank 2] totoal_tokens=1141, outputs='```json\n{\n  "keys": 3\n}\n```'
[2024-08-03 15:13:41] [Rank 1] totoal_tokens=1178, outputs='[3, 2, 2]'
[2024-08-03 15:13:41] [Rank 0] totoal_tokens=1233, outputs='[2, 2, 2]'
sing InternVL2-2B_counting-text-test.jsonl:   7%|▋         | 51/765 [00:20<04:42,  2.53it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   7%|▋         | 52/765 [00:21<04:12,  2.83it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   7%|▋         | 53/765 [00:21<04:06,  2.88it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   7%|▋         | 54/765 [00:21<04:53,  2.42it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   7%|▋         | 55/765 [00:22<05:33,  2.13it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   7%|▋         | 56/765 [00:23<05:59,  1.97it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   7%|▋         | 57/765 [00:24<07:26,  1.58it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   8%|▊         | 58/765 [00:24<08:18,  1.42it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   8%|▊         | 59/765 [00:25<07:46,  1.51it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   8%|▊         | 60/765 [00:25<06:31,  1.80it/s]
Processing InternVL2[2024-08-03 15:13:41] [Rank 0] totoal_tokens=1248, outputs='[4, 2]'
[2024-08-03 15:13:41] [Rank 1] totoal_tokens=1178, outputs='{"number_of_★": 4}'
[2024-08-03 15:13:41] [Rank 3] totoal_tokens=1217, outputs='```json\n{\n  "vase_count": 2\n}\n```'
[2024-08-03 15:13:41] [Rank 2] totoal_tokens=1141, outputs='```json\n{\n  "counted_apples": 4\n}\n```'
[2024-08-03 15:13:41] [Rank 0] totoal_tokens=1257, outputs='[1, 1, 1]'
[2024-08-03 15:13:42] [Rank 3] totoal_tokens=1233, outputs='[4, 2, 4]'
[2024-08-03 15:13:42] [Rank 2] totoal_tokens=1148, outputs='[2, 2, 2]'
[2024-08-03 15:13:42] [Rank 3] totoal_tokens=1243, outputs='[3, 4, 4]'
[2024-08-03 15:13:42] [Rank 2] totoal_tokens=1151, outputs='[4, 1]'
[2024-08-03 15:13:42] [Rank 0] totoal_tokens=1258, outputs='```json\n{\n  "compass_count": 1\n}\n```'
[2024-08-03 15:13:42] [Rank 3] totoal_tokens=1248, outputs='[2, 1]'
[2024-08-03 15:13:42] [Rank 1] totoal_tokens=1197, outputs='```json\n{\n  "compass_count": [\n    {\n      "x": 1,\n      "y": 1,\n      "z":'
[2024-08-03 15:13:42] [Rank 0] totoal_tokens=1328, outputs='[1, 1, 1]'
[2024-08-03 15:13:43] [Rank 2] totoal_tokens=1184, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:13:43] [Rank 0] totoal_tokens=1349, outputs='[4, 4, 4]'
[2024-08-03 15:13:43] [Rank 1] totoal_tokens=1206, outputs='```json\n{\n  "key_count": 1\n}\n```'
[2024-08-03 15:13:43] [Rank 3] totoal_tokens=1310, outputs='```json\n{\n  "questions": [\n    "Who is and isn\'t a sex worker in the production is something Knox and Etchart have worked hard'
[2024-08-03 15:13:43] [Rank 1] totoal_tokens=1208, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:13:43] [Rank 0] totoal_tokens=1366, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:13:43] [Rank 2] totoal_tokens=1184, outputs='```json\n{\n  "number_of_apples": 6\n}\n```'
[2024-08-03 15:13:44] [Rank 1] totoal_tokens=1210, outputs='[3, 3, 3]'
[2024-08-03 15:13:44] [Rank 2] totoal_tokens=1210, outputs='[1, 1, 1]'
[2024-08-03 15:13:44] [Rank 3] totoal_tokens=1376, outputs='```json\n{\n  "keys": 3 + 1 + 1\n}\n```'
[2024-08-03 15:13:44] [Rank 1] totoal_tokens=1220, outputs='```json\n{\n  "adamsalinas": 1\n}\n```'
[2024-08-03 15:13:44] [Rank 0] totoal_tokens=1397, outputs='```json\n{\n  "vases": [\n    "2",\n    "3",\n    "4"\n  ]\n}\n```'
[2024-08-03 15:13:44] [Rank 3] totoal_tokens=1407, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:13:45] [Rank 1] totoal_tokens=1233, outputs='[4, 3, 0]'
[2024-08-03 15:13:45] [Rank 2] totoal_tokens=1216, outputs='```json\n{\n  "trees": 3,\n  "total": 1500\n}\n```'
[2024-08-03 15:13:45] [Rank 0] totoal_tokens=1404, outputs='```json\n{\n  "apple_count": 3\n}\n```'
[2024-08-03 15:13:45] [Rank 2] totoal_tokens=1230, outputs='[1, 4]'
[2024-08-03 15:13:45] [Rank 3] totoal_tokens=1449, outputs='```json\n{\n  "number_of_brushes": 1\n}\n```'
[2024-08-03 15:13:45] [Rank 1] totoal_tokens=1235, outputs='```json\n{\n  "compass_count": 2\n}\n```'
[2024-08-03 15:13:45] [Rank 0] totoal_tokens=1462, outputs='[1, 1, 1]'
[2024-08-03 15:13:45] [Rank 2] totoal_tokens=1230, outputs='[1, 4]'
[2024-08-03 15:13:45] [Rank 1] totoal_tokens=1235, outputs='[1, 2, 3]'
[2024-08-03 15:13:46] [Rank 2] totoal_tokens=1236, outputs='[2, 2, 2]'
[2024-08-03 15:13:46] [Rank 1] totoal_tokens=1258, outputs='{"count": 3}'
[2024-08-03 15:13:46] [Rank 2] totoal_tokens=1256, outputs='[4, 3, 3]'
[2024-08-03 15:13:46] [Rank 3] totoal_tokens=1449, outputs='```json\n{\n  "keys": [\n    "303.8",\n    "Chip Kelly",\n    "Eugene",\n    "Oregon",'
[2024-08-03 15:13:46] [Rank 1] totoal_tokens=1262, outputs='[2, 4, 0]'
[2024-08-03 15:13:46] [Rank 0] totoal_tokens=1474, outputs='```json\n{\n  "categories": [\n    "crowdfunding",\n    "microfinance",\n    "crowdsourcing"\n  ]\n}'
-2B_counting-text-test.jsonl:   8%|▊         | 61/765 [00:26<05:39,  2.07it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   8%|▊         | 62/765 [00:26<04:49,  2.43it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   8%|▊         | 63/765 [00:26<04:28,  2.62it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   8%|▊         | 64/765 [00:27<04:58,  2.35it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   8%|▊         | 65/765 [00:27<04:46,  2.44it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   9%|▊         | 66/765 [00:27<04:37,  2.52it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   9%|▉         | 67/765 [00:28<05:04,  2.29it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   9%|▉         | 68/765 [00:29<06:50,  1.70it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   9%|▉         | 69/765 [00:30<06:39,  1.74it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   9%|▉         | 70/765 [00:30<05:49,  1.99it/s]
Processing InternVL2-2B_counting-t[2024-08-03 15:13:46] [Rank 2] totoal_tokens=1259, outputs='[2, 2, 3]'
[2024-08-03 15:13:46] [Rank 1] totoal_tokens=1348, outputs='[1, 1, 1]'
[2024-08-03 15:13:46] [Rank 2] totoal_tokens=1264, outputs='[3, 2, 4]'
[2024-08-03 15:13:47] [Rank 0] totoal_tokens=1485, outputs='```json\n{\n  "key_count": 4\n}\n```'
[2024-08-03 15:13:47] [Rank 3] totoal_tokens=1449, outputs='```json\n{\n  "number_of_bananas": 4\n}\n```'
[2024-08-03 15:13:47] [Rank 2] totoal_tokens=1348, outputs='[1, 1, 1]'
[2024-08-03 15:13:47] [Rank 3] totoal_tokens=1451, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:13:47] [Rank 0] totoal_tokens=1490, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:13:47] [Rank 2] totoal_tokens=1350, outputs='[2, 1, 1]'
[2024-08-03 15:13:47] [Rank 1] totoal_tokens=1464, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:48] [Rank 3] totoal_tokens=1459, outputs='```json\n{\n  "number_of_bananas": 4\n}\n```'
[2024-08-03 15:13:48] [Rank 2] totoal_tokens=1461, outputs='```json\n{\n  "vases": 2\n}\n```'
[2024-08-03 15:13:48] [Rank 0] totoal_tokens=1506, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:48] [Rank 3] totoal_tokens=1459, outputs='```json\n{\n  "trees": 4\n}\n```'
[2024-08-03 15:13:48] [Rank 2] totoal_tokens=1487, outputs='```json\n{\n  "vases": 2\n}\n```'
[2024-08-03 15:13:48] [Rank 1] totoal_tokens=1479, outputs='```json\n{\n  "key": "Bryson DeChambeau",\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:13:49] [Rank 3] totoal_tokens=1464, outputs='```json\n{\n  "lighthouses": 2\n}\n```'
[2024-08-03 15:13:49] [Rank 0] totoal_tokens=1514, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:49] [Rank 2] totoal_tokens=1513, outputs='[2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2'
[2024-08-03 15:13:49] [Rank 1] totoal_tokens=1491, outputs='```json\n{\n  "compass_count": 1,\n  "penguin_name": "Dennis"\n}\n```'
[2024-08-03 15:13:49] [Rank 3] totoal_tokens=1485, outputs='```json\n{\n  "number_of_chests": 1\n}\n```'
[2024-08-03 15:13:50] [Rank 0] totoal_tokens=1571, outputs='```json\n{\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:13:50] [Rank 2] totoal_tokens=1529, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:13:50] [Rank 0] totoal_tokens=1598, outputs='[3, 3, 3]'
[2024-08-03 15:13:50] [Rank 1] totoal_tokens=1502, outputs='```json\n{\n  "vases": [\n    "3",\n    "4"\n  ]\n}\n```'
[2024-08-03 15:13:50] [Rank 3] totoal_tokens=1498, outputs='```json\n{\n  "bananas": 3,\n  "total": 3\n}\n```'
[2024-08-03 15:13:50] [Rank 2] totoal_tokens=1549, outputs='```json\n{\n  "brush_count": 1\n}\n```'
[2024-08-03 15:13:50] [Rank 0] totoal_tokens=1630, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:13:50] [Rank 1] totoal_tokens=1505, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:13:51] [Rank 3] totoal_tokens=1571, outputs='```json\n{\n  "number_of_★": 1\n}\n```'
[2024-08-03 15:13:51] [Rank 2] totoal_tokens=1609, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:13:51] [Rank 1] totoal_tokens=1514, outputs='[1, 1, 1]'
[2024-08-03 15:13:51] [Rank 0] totoal_tokens=1691, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:13:51] [Rank 2] totoal_tokens=1751, outputs='[3, 3, 3]'
[2024-08-03 15:13:51] [Rank 1] totoal_tokens=1588, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:13:51] [Rank 3] totoal_tokens=1628, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:52] [Rank 2] totoal_tokens=1751, outputs='[3, 4, 5]'
[2024-08-03 15:13:52] [Rank 0] totoal_tokens=1701, outputs='```json\n{\n  "number_of_bananas": 3\n}\n```'
[2024-08-03 15:13:52] [Rank 2] totoal_tokens=1846, outputs='[2, 2, 2]'
[2024-08-03 15:13:52] [Rank 1] totoal_tokens=1595, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:13:52] [Rank 3] totoal_tokens=1692, outputs='```json\n{\n  "number_of_owls": 3\n}\n```'
[2024-08-03 15:13:52] [Rank 2] totoal_tokens=1848, outputs='[0, 0, 0]'
[2024-08-03 15:13:52] [Rank 0] totoal_tokens=1710, outputs='```json\n{\n  "chest_count": 1\n}\n```'
ext-test.jsonl:   9%|▉         | 71/765 [00:31<07:09,  1.61it/s]
Processing InternVL2-2B_counting-text-test.jsonl:   9%|▉         | 72/765 [00:31<06:47,  1.70it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  10%|▉         | 73/765 [00:32<06:54,  1.67it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  10%|▉         | 74/765 [00:33<07:56,  1.45it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  10%|▉         | 75/765 [00:34<08:43,  1.32it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  10%|▉         | 76/765 [00:34<07:57,  1.44it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  10%|█         | 77/765 [00:35<06:43,  1.70it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  10%|█         | 78/765 [00:35<06:38,  1.72it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  10%|█         | 79/765 [00:36<06:38,  1.72it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  10%|█         | 80/765 [00:36<06:43,  1.70it/s]
Processing InternVL2-2B_counting-text-test.jsonl[2024-08-03 15:13:53] [Rank 2] totoal_tokens=1887, outputs='[1, 1, 1]'
[2024-08-03 15:13:53] [Rank 3] totoal_tokens=1710, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:13:53] [Rank 1] totoal_tokens=1692, outputs='```json\n{\n  "title": "Darcy vs. Bennet",\n  "author": "Victoria Kincaid",\n  "extract'
[2024-08-03 15:13:53] [Rank 0] totoal_tokens=1712, outputs='```json\n{\n  "vases": [\n    "3",\n    "2",\n    "1"\n  ]\n}\n```'
[2024-08-03 15:13:53] [Rank 3] totoal_tokens=1850, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:13:53] [Rank 0] totoal_tokens=1750, outputs='[2, 2, 2]'
[2024-08-03 15:13:53] [Rank 2] totoal_tokens=1899, outputs='```json\n{\n  "title": "Civic Engagement in Contemporary Japan",\n  "subtitle": "Established and Emerging Repertoire",'
[2024-08-03 15:13:54] [Rank 1] totoal_tokens=1704, outputs='```json\n{\n  "number_of_owls": 3\n}\n```'
[2024-08-03 15:13:54] [Rank 2] totoal_tokens=1906, outputs='[3, 4, 5]'
[2024-08-03 15:13:54] [Rank 1] totoal_tokens=1748, outputs='[2, 2, 2]'
[2024-08-03 15:13:54] [Rank 0] totoal_tokens=1948, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:13:54] [Rank 3] totoal_tokens=1881, outputs='```json\n{\n  "results": [\n    {\n      "description": "An interesting and melancholic photo, with almost surreal elements to it'
[2024-08-03 15:13:54] [Rank 0] totoal_tokens=1951, outputs='```json\n{\n  "key_count": 0\n}\n```'
[2024-08-03 15:13:54] [Rank 2] totoal_tokens=1919, outputs='```json\n{\n  "compass_count": [\n    "1",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:13:55] [Rank 1] totoal_tokens=1751, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:13:55] [Rank 0] totoal_tokens=1972, outputs='[1, 1, 1]'
[2024-08-03 15:13:55] [Rank 3] totoal_tokens=1901, outputs='```json\n{\n  "judges": [\n    {\n      "photo": "Janet Haney",\n      "description": "A photo full of'
[2024-08-03 15:13:55] [Rank 1] totoal_tokens=1859, outputs='[1, 1, 1]'
[2024-08-03 15:13:55] [Rank 0] totoal_tokens=1991, outputs='[1, 1, 1]'
[2024-08-03 15:13:55] [Rank 3] totoal_tokens=1903, outputs='[3, 4, 4]'
[2024-08-03 15:13:55] [Rank 2] totoal_tokens=1928, outputs='```json\n{\n  "crime_zone": "The green bounty of earth",\n  "rank": "Bow to me now or have your soul'
[2024-08-03 15:13:55] [Rank 1] totoal_tokens=1897, outputs='[2, 2, 2]'
[2024-08-03 15:13:56] [Rank 3] totoal_tokens=1907, outputs='[2, 2, 2]'
[2024-08-03 15:13:56] [Rank 0] totoal_tokens=2036, outputs='```json\n{\n  "computer_count": 2\n}\n```'
[2024-08-03 15:13:56] [Rank 1] totoal_tokens=1904, outputs='[3, 2, 2]'
[2024-08-03 15:13:56] [Rank 3] totoal_tokens=1917, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:13:56] [Rank 2] totoal_tokens=1947, outputs='```json\n{\n  "brushes": [\n    "2",\n    "2",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:13:56] [Rank 0] totoal_tokens=2049, outputs='```json\n{\n  "compass_count": 1\n}\n```'
[2024-08-03 15:13:57] [Rank 2] totoal_tokens=1948, outputs='{"number of ★": 1}'
[2024-08-03 15:13:57] [Rank 0] totoal_tokens=2054, outputs='[0, 0, 0]'
[2024-08-03 15:13:57] [Rank 1] totoal_tokens=1908, outputs='```json\n{\n  "crime_zone": "The green bounty of earth",\n  "rank": "Bow to me now or have your soul'
[2024-08-03 15:13:57] [Rank 2] totoal_tokens=1958, outputs='[1, 1, 1]'
[2024-08-03 15:13:57] [Rank 3] totoal_tokens=1919, outputs='```json\n{\n  "title": "Civic Engagement in Contemporary Japan",\n  "subtitle": "Established and Emerging Repertoire",'
[2024-08-03 15:13:57] [Rank 0] totoal_tokens=2058, outputs='```json\n{\n  "tree_count": 1\n}\n```'
:  11%|█         | 81/765 [00:37<06:40,  1.71it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  11%|█         | 82/765 [00:38<07:43,  1.47it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  11%|█         | 83/765 [00:38<06:31,  1.74it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  11%|█         | 84/765 [00:39<06:16,  1.81it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  11%|█         | 85/765 [00:39<06:08,  1.84it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  11%|█         | 86/765 [00:40<05:29,  2.06it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  11%|█▏        | 87/765 [00:40<05:00,  2.26it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  12%|█▏        | 88/765 [00:40<05:25,  2.08it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  12%|█▏        | 89/765 [00:41<05:40,  1.99it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  12%|█▏        | 90/765 [00:41<05:12,  2.16it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  12%[2024-08-03 15:13:57] [Rank 1] totoal_tokens=1922, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:13:57] [Rank 2] totoal_tokens=1977, outputs='[1, 1, 1]'
[2024-08-03 15:13:58] [Rank 0] totoal_tokens=2066, outputs='[1, 1, 1]'
[2024-08-03 15:13:58] [Rank 2] totoal_tokens=1978, outputs='[1, 1, 1]'
[2024-08-03 15:13:58] [Rank 1] totoal_tokens=1946, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:13:58] [Rank 0] totoal_tokens=2067, outputs='[2, 2, 2]'
[2024-08-03 15:13:58] [Rank 2] totoal_tokens=1982, outputs='[2, 2, 2]'
[2024-08-03 15:13:58] [Rank 3] totoal_tokens=1919, outputs='```json\n{\n  "title": "Civic Engagement in Contemporary Japan",\n  "subtitle": "Established and Emerging Repertoire",'
[2024-08-03 15:13:58] [Rank 1] totoal_tokens=1947, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:13:58] [Rank 2] totoal_tokens=2035, outputs='[2, 2, 2]'
[2024-08-03 15:13:59] [Rank 1] totoal_tokens=1961, outputs='{"owl": 4}'
[2024-08-03 15:13:59] [Rank 3] totoal_tokens=1926, outputs='```json\n{\n  "brushes": 1\n}\n```'
[2024-08-03 15:13:59] [Rank 2] totoal_tokens=2036, outputs='[1, 1, 1]'
[2024-08-03 15:13:59] [Rank 1] totoal_tokens=1972, outputs='[1, 1, 1]'
[2024-08-03 15:13:59] [Rank 0] totoal_tokens=2075, outputs='```json\n{\n  "comics": [\n    {\n      "title": "CFN",\n      "description": "The comic world is very special'
[2024-08-03 15:13:59] [Rank 3] totoal_tokens=1947, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:13:59] [Rank 1] totoal_tokens=2025, outputs='[1, 1, 1]'
[2024-08-03 15:13:59] [Rank 0] totoal_tokens=2084, outputs='[0, 0, 0]'
[2024-08-03 15:13:59] [Rank 3] totoal_tokens=1950, outputs='[1, 1, 1]'
[2024-08-03 15:14:00] [Rank 1] totoal_tokens=2035, outputs='[0, 0, 0]'
[2024-08-03 15:14:00] [Rank 2] totoal_tokens=2042, outputs='```json\n{\n  "title": "Dissesting Japan",\n  "author": "William Andrews",\n  "abstract": "This book is'
[2024-08-03 15:14:00] [Rank 0] totoal_tokens=2089, outputs='```json\n{\n  "keys": [\n    "2",\n    "1"\n  ]\n}\n```'
[2024-08-03 15:14:00] [Rank 2] totoal_tokens=2046, outputs='```json\n{\n  "count": 2\n}\n```'
[2024-08-03 15:14:00] [Rank 1] totoal_tokens=2035, outputs='```json\n{\n  "number_of_keys": 12\n}\n```'
[2024-08-03 15:14:00] [Rank 3] totoal_tokens=1960, outputs='```json\n{\n  "vases": [\n    {"x": 1},\n    {"x": 2},\n    {"x": 3},'
[2024-08-03 15:14:01] [Rank 0] totoal_tokens=2091, outputs='```json\n{\n  "count": 3\n}\n```'
[2024-08-03 15:14:01] [Rank 1] totoal_tokens=2036, outputs='```json\n{\n  "owl_count": 5\n}\n```'
[2024-08-03 15:14:01] [Rank 3] totoal_tokens=2026, outputs='```json\n{\n  "owl": 1\n}\n```'
[2024-08-03 15:14:01] [Rank 2] totoal_tokens=2059, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:14:01] [Rank 3] totoal_tokens=2031, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:14:01] [Rank 1] totoal_tokens=2037, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:14:01] [Rank 2] totoal_tokens=2067, outputs='[3, 2, 1]'
[2024-08-03 15:14:02] [Rank 0] totoal_tokens=2102, outputs='```json\n{\n  "key1": 2,\n  "key2": 1,\n  "key3": 1,\n  "key'
[2024-08-03 15:14:02] [Rank 3] totoal_tokens=2034, outputs='```json\n{\n  "number_of_trees": 4\n}\n```'
[2024-08-03 15:14:02] [Rank 2] totoal_tokens=2074, outputs='```json\n{\n  "number_of_keys": 2\n}\n```'
[2024-08-03 15:14:02] [Rank 1] totoal_tokens=2037, outputs='```json\n{\n  "vases": [\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:14:02] [Rank 0] totoal_tokens=2114, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:14:03] [Rank 3] totoal_tokens=2035, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:14:03] [Rank 2] totoal_tokens=2077, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:14:03] [Rank 0] totoal_tokens=2123, outputs='```json\n{\n  "trees": 3\n}\n```'
[2024-08-03 15:14:03] [Rank 1] totoal_tokens=2057, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1\n    }\n  ]\n}\n```'
[2024-08-03 15:14:03] [Rank 3] totoal_tokens=2035, outputs='[2, 3, 4]'
[2024-08-03 15:14:03] [Rank 2] totoal_tokens=2092, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:14:03] [Rank 3] totoal_tokens=2064, outputs='[1, 1, 1]'
[2024-08-03 15:14:03] [Rank 0] totoal_tokens=2131, outputs='```json\n{\n  "computer_count": 3\n}\n```'
|█▏        | 91/765 [00:42<05:27,  2.06it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  12%|█▏        | 92/765 [00:42<04:59,  2.24it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  12%|█▏        | 93/765 [00:43<04:39,  2.41it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  12%|█▏        | 94/765 [00:44<06:45,  1.66it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  12%|█▏        | 95/765 [00:44<05:59,  1.86it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  13%|█▎        | 96/765 [00:45<06:43,  1.66it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  13%|█▎        | 97/765 [00:45<06:30,  1.71it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  13%|█▎        | 98/765 [00:46<07:42,  1.44it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  13%|█▎        | 99/765 [00:47<07:24,  1.50it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  13%|█▎        | 100/765 [00:47<07:02,  1.57it/s]
Processing InternVL2-2B_counting-text-test.json[2024-08-03 15:14:03] [Rank 1] totoal_tokens=2058, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:14:04] [Rank 3] totoal_tokens=2065, outputs='[1, 1, 1]'
[2024-08-03 15:14:04] [Rank 2] totoal_tokens=2105, outputs='```json\n{\n  "brushes": 3\n}\n```'
[2024-08-03 15:14:04] [Rank 1] totoal_tokens=2071, outputs='[3, 3, 3]'
[2024-08-03 15:14:04] [Rank 0] totoal_tokens=2139, outputs='```json\n{\n  "compasses": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:14:04] [Rank 2] totoal_tokens=2111, outputs='```json\n{\n  "number_of_apples": 2\n}\n```'
[2024-08-03 15:14:04] [Rank 3] totoal_tokens=2072, outputs='```json\n{\n  "keys": [\n    "1",\n    "4"\n  ]\n}\n```'
[2024-08-03 15:14:04] [Rank 1] totoal_tokens=2072, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:14:05] [Rank 0] totoal_tokens=2146, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:14:05] [Rank 1] totoal_tokens=2073, outputs='```json\n{\n  "brushes": 4\n}\n```'
[2024-08-03 15:14:05] [Rank 3] totoal_tokens=2074, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:14:05] [Rank 2] totoal_tokens=2131, outputs='```json\n{\n  "vases": [\n    "3",\n    "2",\n    "1"\n  ]\n}\n```'
[2024-08-03 15:14:05] [Rank 1] totoal_tokens=2086, outputs='[2, 4, 4]'
[2024-08-03 15:14:05] [Rank 0] totoal_tokens=2180, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:14:06] [Rank 3] totoal_tokens=2084, outputs='```json\n{\n  "compass_count": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:14:06] [Rank 2] totoal_tokens=2139, outputs='[1, 1, 1, 1, 1, 1, 1, 1]'
[2024-08-03 15:14:06] [Rank 1] totoal_tokens=2091, outputs='```json\n{\n  "number_of_hospitalizations": 1000,\n  "number_of_businesses": 1\n}\n```'
[2024-08-03 15:14:06] [Rank 3] totoal_tokens=2092, outputs='```json\n{\n  "keys": 3\n}\n```'
[2024-08-03 15:14:06] [Rank 0] totoal_tokens=2200, outputs='```json\n{\n  "vases": [\n    {\n      "mode": "air",\n      "scenario": "A1",\n      "impact":'
[2024-08-03 15:14:06] [Rank 2] totoal_tokens=2143, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:14:07] [Rank 3] totoal_tokens=2094, outputs='[1, 1, 1]'
[2024-08-03 15:14:07] [Rank 1] totoal_tokens=2091, outputs='```json\n{\n  "keys": 4\n}\n```'
[2024-08-03 15:14:07] [Rank 0] totoal_tokens=2262, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:07] [Rank 3] totoal_tokens=2099, outputs='```json\n{\n  "adamsalinas": 3\n}\n```'
[2024-08-03 15:14:07] [Rank 0] totoal_tokens=2378, outputs='```json\n{\n  "count": 3\n}\n```'
[2024-08-03 15:14:07] [Rank 2] totoal_tokens=2144, outputs='```json\n{\n  "numbers": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:14:08] [Rank 1] totoal_tokens=2101, outputs='```json\n{\n  "number_of_hospitalizations": 1000,\n  "number_of_businesses": 1\n}\n```'
[2024-08-03 15:14:08] [Rank 2] totoal_tokens=2161, outputs='[1, 1, 1]'
[2024-08-03 15:14:08] [Rank 0] totoal_tokens=2431, outputs='```json\n{\n  "★": 4\n}\n```'
[2024-08-03 15:14:08] [Rank 3] totoal_tokens=2111, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:08] [Rank 2] totoal_tokens=2163, outputs='[2, 2, 2]'
[2024-08-03 15:14:09] [Rank 1] totoal_tokens=2102, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "The little penguin counted 3'
[2024-08-03 15:14:09] [Rank 3] totoal_tokens=2118, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:14:09] [Rank 0] totoal_tokens=2478, outputs='```json\n{\n  "numbers": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:14:09] [Rank 2] totoal_tokens=2168, outputs='```json\n{\n  "keys": [\n    "303.8",\n    "Chip Kelly",\n    "Eugene",\n    "Oregon",'
[2024-08-03 15:14:09] [Rank 3] totoal_tokens=2118, outputs='```json\n{\n  "adamsalinas": "true"\n}\n```'
[2024-08-03 15:14:10] [Rank 1] totoal_tokens=2109, outputs='```json\n{\n  "brushes": 1,\n  "number_of_brushes": 1\n}\n```'
[2024-08-03 15:14:10] [Rank 0] totoal_tokens=2488, outputs='```json\n{\n  "bananas": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:14:10] [Rank 3] totoal_tokens=2129, outputs='```json\n{\n  "number_of_★": 1\n}\n```'
[2024-08-03 15:14:10] [Rank 2] totoal_tokens=2236, outputs='```json\n{\n  "text": "The deal, concluded on July 14, 2015, provides for the gradual lifting of the economic and'
[2024-08-03 15:14:10] [Rank 3] totoal_tokens=2133, outputs='```json\n{\n  "result": 6\n}\n```'
[2024-08-03 15:14:11] [Rank 0] totoal_tokens=2507, outputs='```json\n{\n  "number_of_bananas": 2\n}\n```'
l:  13%|█▎        | 101/765 [00:48<06:56,  1.59it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  13%|█▎        | 102/765 [00:49<07:42,  1.43it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  13%|█▎        | 103/765 [00:49<07:21,  1.50it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  14%|█▎        | 104/765 [00:50<07:06,  1.55it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  14%|█▎        | 105/765 [00:51<08:08,  1.35it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  14%|█▍        | 106/765 [00:52<07:34,  1.45it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  14%|█▍        | 107/765 [00:52<07:04,  1.55it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  14%|█▍        | 108/765 [00:53<06:38,  1.65it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  14%|█▍        | 109/765 [00:54<07:39,  1.43it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  14%|█▍        | 110/765 [00:55<08:32,  1.28it/s]
Processing InternVL2-2B_countin[2024-08-03 15:14:11] [Rank 1] totoal_tokens=2111, outputs='```json\n{\n  "number_of_owls": 2\n}\n```'
[2024-08-03 15:14:11] [Rank 2] totoal_tokens=2267, outputs='```json\n{\n  "number_of_★": 2\n}\n```'
[2024-08-03 15:14:11] [Rank 0] totoal_tokens=2508, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:11] [Rank 1] totoal_tokens=2124, outputs='```json\n{\n  "brushes": 2\n}\n```'
[2024-08-03 15:14:11] [Rank 3] totoal_tokens=2143, outputs='```json\n{\n  "chest_count": [0, 0, 0]\n}\n```'
[2024-08-03 15:14:11] [Rank 2] totoal_tokens=2277, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:14:12] [Rank 3] totoal_tokens=2148, outputs='```json\n{\n  "keys": 2\n}\n```'
[2024-08-03 15:14:12] [Rank 0] totoal_tokens=2537, outputs='```json\n{\n  "bananas": 2\n}\n```'
[2024-08-03 15:14:12] [Rank 1] totoal_tokens=2126, outputs='[1, 1, 1, 1, 1, 1, 1, 1]'
[2024-08-03 15:14:12] [Rank 3] totoal_tokens=2187, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:14:12] [Rank 0] totoal_tokens=2537, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:14:12] [Rank 2] totoal_tokens=2297, outputs='```json\n{\n  "49th & Main": {\n    "esns": "1 ★",\n    "style": "indie-rock'
[2024-08-03 15:14:13] [Rank 3] totoal_tokens=2191, outputs='```json\n{\n  "compass_count": 1\n}\n```'
[2024-08-03 15:14:13] [Rank 0] totoal_tokens=2565, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:14:13] [Rank 1] totoal_tokens=2127, outputs='```json\n{\n  "books": [\n    {\n      "title": "The Sellout",\n      "author": "Paul Beatty",\n      "'
[2024-08-03 15:14:13] [Rank 2] totoal_tokens=2468, outputs='```json\n{\n  "numbers": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:14:13] [Rank 0] totoal_tokens=2585, outputs='[1, 1, 1]'
[2024-08-03 15:14:13] [Rank 3] totoal_tokens=2198, outputs='```json\n{\n  "number_of_bananas": 2\n}\n```'
[2024-08-03 15:14:14] [Rank 1] totoal_tokens=2133, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:14:14] [Rank 0] totoal_tokens=2587, outputs='```json\n{\n  "number_of_owls": 3\n}\n```'
[2024-08-03 15:14:14] [Rank 3] totoal_tokens=2231, outputs='```json\n{\n  "number_of_owl": 1\n}\n```'
[2024-08-03 15:14:14] [Rank 2] totoal_tokens=2490, outputs='```json\n{\n  "numbers": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:14:14] [Rank 1] totoal_tokens=2136, outputs='[1, 1, 1, 1, 1, 1, 1, 1]'
[2024-08-03 15:14:14] [Rank 3] totoal_tokens=2248, outputs='```json\n{\n  "count": 1\n}\n```'
[2024-08-03 15:14:15] [Rank 0] totoal_tokens=2609, outputs='```json\n{\n  "KFC Canada": "Yes",\n  "Subway": "Yes",\n  "Virgin Galactic": "Yes",'
[2024-08-03 15:14:15] [Rank 1] totoal_tokens=2156, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:14:15] [Rank 2] totoal_tokens=2512, outputs='```json\n{\n  "location": "ANNAPOL",\n  "title": "PET SEMATARY II",\n  "date": "3'
[2024-08-03 15:14:15] [Rank 3] totoal_tokens=2297, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:14:15] [Rank 1] totoal_tokens=2170, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:14:16] [Rank 3] totoal_tokens=2299, outputs='```json\n{\n  "vases": 4\n}\n```'
[2024-08-03 15:14:16] [Rank 2] totoal_tokens=2584, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:14:16] [Rank 0] totoal_tokens=2611, outputs='```json\n{\n  "compasses": [\n    {"x": 1, "x": 2, "x": 3},\n    {"'
[2024-08-03 15:14:16] [Rank 1] totoal_tokens=2188, outputs='```json\n{\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:14:16] [Rank 3] totoal_tokens=2474, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:14:16] [Rank 2] totoal_tokens=2585, outputs='```json\n{\n  "number_of_apples": 4\n}\n```'
[2024-08-03 15:14:17] [Rank 1] totoal_tokens=2200, outputs='[1, 1, 1, 1, 1]'
[2024-08-03 15:14:17] [Rank 0] totoal_tokens=2618, outputs='```json\n{\n  "KFC Canada": "Yes",\n  "Subway": "Yes",\n  "Virgin Galactic": "Yes",'
[2024-08-03 15:14:17] [Rank 2] totoal_tokens=2649, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:14:17] [Rank 3] totoal_tokens=2488, outputs='```json\n{\n  "number_of_chests": 1\n}\n```'
[2024-08-03 15:14:17] [Rank 1] totoal_tokens=2215, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:14:17] [Rank 2] totoal_tokens=2652, outputs='```json\n{\n  "number_of_keys": 2\n}\n```'
[2024-08-03 15:14:18] [Rank 0] totoal_tokens=2618, outputs='```json\n{\n  "KFC Canada": "Yes",\n  "Subway": "Yes",\n  "Virgin Galactic": "Yes",'
g-text-test.jsonl:  15%|█▍        | 111/765 [00:55<08:09,  1.33it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  15%|█▍        | 112/765 [00:56<07:33,  1.44it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  15%|█▍        | 113/765 [00:56<07:05,  1.53it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  15%|█▍        | 114/765 [00:57<06:45,  1.61it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  15%|█▌        | 115/765 [00:58<06:43,  1.61it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  15%|█▌        | 116/765 [00:58<05:54,  1.83it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  15%|█▌        | 117/765 [00:59<06:11,  1.75it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  15%|█▌        | 118/765 [00:59<07:22,  1.46it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  16%|█▌        | 119/765 [01:00<08:13,  1.31it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  16%|█▌        | 120/765 [01:01<08:49,  1.22it/s]
Processing Inte[2024-08-03 15:14:18] [Rank 1] totoal_tokens=2295, outputs='```json\n{\n  "count": 2\n}\n```'
[2024-08-03 15:14:18] [Rank 3] totoal_tokens=2498, outputs='```json\n{\n  "vases": [\n    "2",\n    "3",\n    "4"\n  ]\n}\n```'
[2024-08-03 15:14:18] [Rank 2] totoal_tokens=2667, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:14:18] [Rank 0] totoal_tokens=2629, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:14:19] [Rank 2] totoal_tokens=2686, outputs='```json\n{\n  "key_count": 4\n}\n```'
[2024-08-03 15:14:19] [Rank 1] totoal_tokens=2381, outputs='```json\n{\n  "vases": [\n    {"x": 1, "y": 1},\n    {"x": 1, "'
[2024-08-03 15:14:19] [Rank 3] totoal_tokens=2521, outputs='```json\n{\n  "location": "Annapol",\n  "title": "Pet Sematary II",\n  "date": "3-22'
[2024-08-03 15:14:19] [Rank 0] totoal_tokens=2672, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:14:19] [Rank 2] totoal_tokens=2686, outputs='```json\n{\n  "key_count": 4\n}\n```'
[2024-08-03 15:14:19] [Rank 1] totoal_tokens=2431, outputs='```json\n{\n  "keys": 1\n}\n```'
[2024-08-03 15:14:19] [Rank 0] totoal_tokens=2674, outputs='```json\n{\n  "compass_count": 1\n}\n```'
[2024-08-03 15:14:19] [Rank 3] totoal_tokens=2624, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:14:20] [Rank 3] totoal_tokens=2629, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:14:20] [Rank 2] totoal_tokens=2695, outputs='```json\n{\n  "vases": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:14:20] [Rank 1] totoal_tokens=2478, outputs='```json\n{\n  "numbers": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:14:20] [Rank 0] totoal_tokens=2685, outputs='```json\n{\n  "compasses": [\n    {\n      "number": 1,\n      "description": "Little penguin"\n    },'
[2024-08-03 15:14:20] [Rank 3] totoal_tokens=2659, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:14:21] [Rank 1] totoal_tokens=2498, outputs='```json\n{\n  "number_of_★": 2\n}\n```'
[2024-08-03 15:14:21] [Rank 3] totoal_tokens=2669, outputs='[1, 1, 1]'
[2024-08-03 15:14:21] [Rank 2] totoal_tokens=2706, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:21] [Rank 0] totoal_tokens=2686, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:14:21] [Rank 1] totoal_tokens=2503, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:14:21] [Rank 3] totoal_tokens=2680, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:14:21] [Rank 2] totoal_tokens=2778, outputs='```json\n{\n  "number_of_apples": 0\n}\n```'
[2024-08-03 15:14:22] [Rank 0] totoal_tokens=2696, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:14:22] [Rank 1] totoal_tokens=2576, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:14:22] [Rank 3] totoal_tokens=2759, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:14:22] [Rank 0] totoal_tokens=2706, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:14:22] [Rank 1] totoal_tokens=2598, outputs='[0, 0, 0]'
[2024-08-03 15:14:23] [Rank 2] totoal_tokens=2852, outputs='```json\n{\n  "discoveries": {\n    "title": "Discoveries",\n    "artist": "Josh Nelson",\n    "release_date'
[2024-08-03 15:14:23] [Rank 3] totoal_tokens=2852, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:14:23] [Rank 3] totoal_tokens=2868, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:14:23] [Rank 0] totoal_tokens=2851, outputs='```json\n{\n  "text": "Bryson DeChambeau has hit the golf world like a tornado, because his strength training,'
[2024-08-03 15:14:23] [Rank 1] totoal_tokens=2676, outputs='```json\n{\n  "brushes": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:14:24] [Rank 2] totoal_tokens=2859, outputs='```json\n{\n  "Featherstone": {\n    "population": 15244,\n    "historical_significance": "Featherstone'
[2024-08-03 15:14:24] [Rank 0] totoal_tokens=2858, outputs='```json\n{\n  "bananas": 2\n}\n```'
rnVL2-2B_counting-text-test.jsonl:  16%|█▌        | 121/765 [01:02<09:14,  1.16it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  16%|█▌        | 122/765 [01:03<08:17,  1.29it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  16%|█▌        | 123/765 [01:04<07:44,  1.38it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  16%|█▌        | 124/765 [01:04<07:11,  1.49it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  16%|█▋        | 125/765 [01:05<08:06,  1.31it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  16%|█▋        | 126/765 [01:06<07:39,  1.39it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  17%|█▋        | 127/765 [01:06<07:15,  1.47it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  17%|█▋        | 128/765 [01:07<06:58,  1.52it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  17%|█▋        | 129/765 [01:08<08:17,  1.28it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  17%|█▋        | 130/765 [01:08<07:35,  1.39it/s][2024-08-03 15:14:24] [Rank 3] totoal_tokens=2901, outputs='```json\n{\n  "number_of_chests": 2\n}\n```'
[2024-08-03 15:14:24] [Rank 1] totoal_tokens=2706, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:24] [Rank 0] totoal_tokens=2870, outputs='```json\n{\n  "apple_count": 3\n}\n```'
[2024-08-03 15:14:25] [Rank 2] totoal_tokens=2869, outputs='```json\n{\n  "Featherstone": {\n    "population": 15244,\n    "historical_significance": "Featherstone'
[2024-08-03 15:14:25] [Rank 3] totoal_tokens=2902, outputs='```json\n{\n  "number_of_bananas": 4\n}\n```'
[2024-08-03 15:14:25] [Rank 3] totoal_tokens=2914, outputs='```json\n{\n  "count": 1\n}\n```'
[2024-08-03 15:14:25] [Rank 1] totoal_tokens=2746, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:25] [Rank 0] totoal_tokens=2872, outputs='```json\n{\n  "Featherstone": {\n    "population": 15244,\n    "historical_significance": "Featherstone'
[2024-08-03 15:14:26] [Rank 2] totoal_tokens=2881, outputs='```json\n{\n  "lighthouses": [\n    {\n      "number": 1,\n      "location": "Lighthouse 1"'
[2024-08-03 15:14:26] [Rank 3] totoal_tokens=2927, outputs='```json\n{\n  "number_of_lighthouses": 4\n}\n```'
[2024-08-03 15:14:26] [Rank 1] totoal_tokens=2840, outputs='```json\n{\n  "count": 2\n}\n```'
[2024-08-03 15:14:26] [Rank 0] totoal_tokens=2880, outputs='```json\n{\n  "compass": 3\n}\n```'
[2024-08-03 15:14:26] [Rank 2] totoal_tokens=2905, outputs='[1, 1, 1]'
[2024-08-03 15:14:26] [Rank 3] totoal_tokens=2931, outputs='[3, 3, 3]'
[2024-08-03 15:14:26] [Rank 2] totoal_tokens=2957, outputs='{"number of ★": 2}'
[2024-08-03 15:14:26] [Rank 1] totoal_tokens=2857, outputs='```json\n{\n  "trees": 4\n}\n```'
[2024-08-03 15:14:26] [Rank 0] totoal_tokens=2900, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:14:27] [Rank 1] totoal_tokens=2872, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:14:27] [Rank 3] totoal_tokens=2936, outputs='[3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3'
[2024-08-03 15:14:27] [Rank 2] totoal_tokens=2960, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:27] [Rank 0] totoal_tokens=2923, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:28] [Rank 1] totoal_tokens=2872, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:14:28] [Rank 3] totoal_tokens=2943, outputs='```json\n{\n  "number_of_chests": 2\n}\n```'
[2024-08-03 15:14:28] [Rank 0] totoal_tokens=2928, outputs='[2, 2, 2]'
[2024-08-03 15:14:28] [Rank 3] totoal_tokens=2953, outputs='[3, 3, 3]'
[2024-08-03 15:14:28] [Rank 0] totoal_tokens=2943, outputs='[1, 1, 1]'
[2024-08-03 15:14:28] [Rank 1] totoal_tokens=2878, outputs='```json\n{\n  "brushes": 2\n}\n```'
[2024-08-03 15:14:28] [Rank 2] totoal_tokens=2999, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:29] [Rank 2] totoal_tokens=3013, outputs='[2, 3, 4]'
[2024-08-03 15:14:29] [Rank 3] totoal_tokens=2962, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:29] [Rank 0] totoal_tokens=2957, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:29] [Rank 1] totoal_tokens=2882, outputs='```json\n{\n  "title": "Making Rights Claims",\n  "subtitle": "A Practice of Democratic Citizenship",\n  "author": "K'
[2024-08-03 15:14:29] [Rank 2] totoal_tokens=3024, outputs='```json\n{\n  "number_of_owls": 0\n}\n```'
[2024-08-03 15:14:29] [Rank 3] totoal_tokens=3008, outputs='[1, 2, 3]'
[2024-08-03 15:14:30] [Rank 1] totoal_tokens=2922, outputs='```json\n{\n  "key_count": 1\n}\n```'
[2024-08-03 15:14:30] [Rank 0] totoal_tokens=2982, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:14:30] [Rank 3] totoal_tokens=3022, outputs='[2, 3, 4]'
[2024-08-03 15:14:30] [Rank 2] totoal_tokens=3029, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:14:30] [Rank 0] totoal_tokens=3018, outputs='[3, 3, 3]'

Processing InternVL2-2B_counting-text-test.jsonl:  17%|█▋        | 131/765 [01:09<07:08,  1.48it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  17%|█▋        | 132/765 [01:10<08:04,  1.31it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  17%|█▋        | 133/765 [01:11<07:20,  1.43it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  18%|█▊        | 134/765 [01:11<06:52,  1.53it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  18%|█▊        | 135/765 [01:12<07:49,  1.34it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  18%|█▊        | 136/765 [01:12<06:38,  1.58it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  18%|█▊        | 137/765 [01:13<05:48,  1.80it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  18%|█▊        | 138/765 [01:14<07:04,  1.48it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  18%|█▊        | 139/765 [01:14<06:59,  1.49it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  18%|█▊        | 140/765 [01:15<0[2024-08-03 15:14:30] [Rank 3] totoal_tokens=3045, outputs='```json\n{\n  "number_of_bananas": 4\n}\n```'
[2024-08-03 15:14:31] [Rank 1] totoal_tokens=2957, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:31] [Rank 0] totoal_tokens=3036, outputs='```json\n{\n  "number_of_vases": 3\n}\n```'
[2024-08-03 15:14:31] [Rank 2] totoal_tokens=3031, outputs='```json\n{\n  "vases": [\n    1,\n    1,\n    1,\n    1,\n    1,\n    1,\n    1,'
[2024-08-03 15:14:31] [Rank 0] totoal_tokens=3038, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:14:31] [Rank 3] totoal_tokens=3056, outputs='```json\n{\n  "trees": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:14:32] [Rank 1] totoal_tokens=2963, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:32] [Rank 0] totoal_tokens=3044, outputs='[3, 3, 3]'
[2024-08-03 15:14:32] [Rank 3] totoal_tokens=3057, outputs='[1, 1, 1]'
[2024-08-03 15:14:32] [Rank 3] totoal_tokens=3059, outputs='[1, 1, 1]'
[2024-08-03 15:14:32] [Rank 0] totoal_tokens=3055, outputs='[2, 2, 2]'
[2024-08-03 15:14:32] [Rank 1] totoal_tokens=2994, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:32] [Rank 2] totoal_tokens=3066, outputs='```json\n{\n  "cubes": [\n    {\n      "x": 1,\n      "y": 1,\n      "z":'
[2024-08-03 15:14:33] [Rank 3] totoal_tokens=3061, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:14:33] [Rank 0] totoal_tokens=3071, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:14:33] [Rank 1] totoal_tokens=3002, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:14:33] [Rank 1] totoal_tokens=3024, outputs='[3, 3, 3]'
[2024-08-03 15:14:33] [Rank 3] totoal_tokens=3069, outputs='```json\n{\n  "bananas": 2\n}\n```'
[2024-08-03 15:14:33] [Rank 2] totoal_tokens=3077, outputs='```json\n{\n  "title": "The Sellout",\n  "author": "Paul Beatty",\n  "year": "2017",'
[2024-08-03 15:14:34] [Rank 0] totoal_tokens=3073, outputs='```json\n{\n  "Red Bull": 1,\n  "RB16B": 1\n}\n```'
[2024-08-03 15:14:34] [Rank 3] totoal_tokens=3079, outputs='```json\n{\n  "keys": 10\n}\n```'
[2024-08-03 15:14:34] [Rank 1] totoal_tokens=3030, outputs='```json\n{\n  "owl_count": 6\n}\n```'
[2024-08-03 15:14:34] [Rank 2] totoal_tokens=3079, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:14:34] [Rank 0] totoal_tokens=3074, outputs='```json\n{\n  "lighthouse": 1\n}\n```'
[2024-08-03 15:14:34] [Rank 3] totoal_tokens=3089, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:14:35] [Rank 2] totoal_tokens=3081, outputs='```json\n{\n  "keys": "4"\n}\n```'
[2024-08-03 15:14:35] [Rank 1] totoal_tokens=3046, outputs='```json\n{\n  "x": 1,\n  "x": 4,\n  "x": 1\n}\n```'
[2024-08-03 15:14:35] [Rank 3] totoal_tokens=3093, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:14:35] [Rank 0] totoal_tokens=3086, outputs='```json\n{\n  "Flappase_expression_contraints": "IPTG",\n  "optimal_growth_conditions": "0mM'
[2024-08-03 15:14:35] [Rank 2] totoal_tokens=3081, outputs='```json\n{\n  "number_of_brushes": 5\n}\n```'
[2024-08-03 15:14:36] [Rank 1] totoal_tokens=3058, outputs='```json\n{\n  "vases": [\n    "2",\n    "3",\n    "4"\n  ]\n}\n```'
[2024-08-03 15:14:36] [Rank 3] totoal_tokens=3106, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, green v'
[2024-08-03 15:14:36] [Rank 0] totoal_tokens=3086, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:36] [Rank 2] totoal_tokens=3084, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:14:36] [Rank 1] totoal_tokens=3067, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:14:36] [Rank 0] totoal_tokens=3088, outputs='```json\n{\n  "lighthouses": 3\n}\n```'
6:04,  1.72it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  18%|█▊        | 141/765 [01:16<06:27,  1.61it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  19%|█▊        | 142/765 [01:16<06:16,  1.66it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  19%|█▊        | 143/765 [01:16<05:34,  1.86it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  19%|█▉        | 144/765 [01:17<05:04,  2.04it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  19%|█▉        | 145/765 [01:18<05:33,  1.86it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  19%|█▉        | 146/765 [01:18<06:28,  1.59it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  19%|█▉        | 147/765 [01:19<06:30,  1.58it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  19%|█▉        | 148/765 [01:20<07:36,  1.35it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  19%|█▉        | 149/765 [01:21<07:10,  1.43it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  20%|█▉        | [2024-08-03 15:14:37] [Rank 2] totoal_tokens=3086, outputs='```json\n{\n  "Red Bull": 4,\n  "Mercedes": 0\n}\n```'
[2024-08-03 15:14:37] [Rank 3] totoal_tokens=3126, outputs='```json\n{\n  "vases": [\n    "8",\n    "8",\n    "8"\n  ]\n}\n```'
[2024-08-03 15:14:37] [Rank 1] totoal_tokens=3068, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:14:37] [Rank 3] totoal_tokens=3200, outputs='{"total": 3}'
[2024-08-03 15:14:37] [Rank 0] totoal_tokens=3097, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:14:37] [Rank 2] totoal_tokens=3088, outputs='{"number_of_puppies": 2, "number_of_vases": 1}'
[2024-08-03 15:14:37] [Rank 1] totoal_tokens=3076, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:14:38] [Rank 0] totoal_tokens=3164, outputs='```json\n{\n  "owl": 4\n}\n```'
[2024-08-03 15:14:38] [Rank 3] totoal_tokens=3205, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:38] [Rank 2] totoal_tokens=3091, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:14:38] [Rank 3] totoal_tokens=3210, outputs='[1, 1, 1]'
[2024-08-03 15:14:38] [Rank 1] totoal_tokens=3080, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:14:38] [Rank 0] totoal_tokens=3203, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:14:39] [Rank 2] totoal_tokens=3093, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:14:39] [Rank 1] totoal_tokens=3081, outputs='```json\n{\n  "number_of_brushes": 3\n}\n```'
[2024-08-03 15:14:39] [Rank 3] totoal_tokens=3280, outputs='```json\n{\n  "Square_of_Miracles": "The Leaning Tower of Pisa and Square of Miracles is one of the most popular'
[2024-08-03 15:14:39] [Rank 2] totoal_tokens=3093, outputs='```json\n{\n  "number_of_chests": 3\n}\n```'
[2024-08-03 15:14:39] [Rank 0] totoal_tokens=3210, outputs='```json\n{\n  "20": "Ford v Ferrari",\n  "19": "The Nightingale",\n  "18": "Official Secrets",'
[2024-08-03 15:14:39] [Rank 1] totoal_tokens=3095, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:14:40] [Rank 3] totoal_tokens=3299, outputs='```json\n{\n  "number_of_bananas": 4\n}\n```'
[2024-08-03 15:14:40] [Rank 2] totoal_tokens=3096, outputs='```json\n{\n  "number_of_brushes": 2\n}\n```'
[2024-08-03 15:14:40] [Rank 1] totoal_tokens=3109, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:14:40] [Rank 0] totoal_tokens=3250, outputs='```json\n{\n  "keys": [\n    "O",\n    "E",\n    "R",\n    "T",\n    "Y",\n    "'
[2024-08-03 15:14:40] [Rank 3] totoal_tokens=3301, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:14:40] [Rank 2] totoal_tokens=3098, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:14:41] [Rank 1] totoal_tokens=3190, outputs='```json\n{\n  "chest_count": "0"\n}\n```'
[2024-08-03 15:14:41] [Rank 3] totoal_tokens=3314, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:14:41] [Rank 2] totoal_tokens=3106, outputs='```json\n{\n  "stevenson-valdez": 1\n}\n```'
[2024-08-03 15:14:41] [Rank 0] totoal_tokens=3279, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:42] [Rank 1] totoal_tokens=3203, outputs='```json\n{\n  "vases": [\n    {"x": 1, "y": 1},\n    {"x": 1, "'
[2024-08-03 15:14:42] [Rank 2] totoal_tokens=3172, outputs='```json\n{\n  "vases": 4\n}\n```'
[2024-08-03 15:14:42] [Rank 3] totoal_tokens=3320, outputs='```json\n{\n  "buildings": [\n    {\n      "name": "Little Traverse History Museum",\n      "description": "Hemingway'
[2024-08-03 15:14:42] [Rank 0] totoal_tokens=3325, outputs='```json\n{\n  "Fitbit Force": "I was one of the customers who complained about skin irritation after wearing the Force for extended periods of'
[2024-08-03 15:14:42] [Rank 2] totoal_tokens=3186, outputs='```json\n{\n  "number_of_trees": 4\n}\n```'
[2024-08-03 15:14:43] [Rank 1] totoal_tokens=3210, outputs='```json\n{\n  "20": "The Nightingale",\n  "19": "Ford v Ferrari",\n  "18": "Florence'
[2024-08-03 15:14:43] [Rank 0] totoal_tokens=3368, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:14:43] [Rank 3] totoal_tokens=3379, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:43] [Rank 2] totoal_tokens=3211, outputs='```json\n{\n  "20": "The Nightingale",\n  "19": "Ford v Ferrari",\n  "18": "The Babad'
[2024-08-03 15:14:43] [Rank 0] totoal_tokens=3413, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:14:44] [Rank 1] totoal_tokens=3270, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:44] [Rank 3] totoal_tokens=3419, outputs='```json\n{\n  "result": 1\n}\n```'
[2024-08-03 15:14:44] [Rank 2] totoal_tokens=3239, outputs='```json\n{\n  "apple_count": 2\n}\n```'
[2024-08-03 15:14:44] [Rank 0] totoal_tokens=3413, outputs='```json\n{\n  "count": 3\n}\n```'
150/765 [01:21<06:58,  1.47it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  20%|█▉        | 151/765 [01:22<06:39,  1.54it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  20%|█▉        | 152/765 [01:22<06:19,  1.62it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  20%|██        | 153/765 [01:23<06:12,  1.64it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  20%|██        | 154/765 [01:24<07:17,  1.40it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  20%|██        | 155/765 [01:25<08:05,  1.26it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  20%|██        | 156/765 [01:26<08:39,  1.17it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  21%|██        | 157/765 [01:27<09:02,  1.12it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  21%|██        | 158/765 [01:27<08:04,  1.25it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  21%|██        | 159/765 [01:28<07:28,  1.35it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  21%|[2024-08-03 15:14:44] [Rank 3] totoal_tokens=3440, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:14:44] [Rank 1] totoal_tokens=3271, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:45] [Rank 0] totoal_tokens=3436, outputs='```json\n{\n  "brush_count": 2\n}\n```'
[2024-08-03 15:14:45] [Rank 1] totoal_tokens=3290, outputs='[0, 0, 0]'
[2024-08-03 15:14:45] [Rank 3] totoal_tokens=3440, outputs='```json\n{\n  "result": 3\n}\n```'
[2024-08-03 15:14:45] [Rank 2] totoal_tokens=3240, outputs='```json\n{\n  "bananas": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:14:45] [Rank 1] totoal_tokens=3337, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:14:45] [Rank 3] totoal_tokens=3447, outputs='```json\n{\n  "trees": 1\n}\n```'
[2024-08-03 15:14:45] [Rank 2] totoal_tokens=3250, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:14:46] [Rank 0] totoal_tokens=3464, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 2'
[2024-08-03 15:14:46] [Rank 1] totoal_tokens=3413, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:14:46] [Rank 2] totoal_tokens=3269, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:14:46] [Rank 3] totoal_tokens=3452, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:46] [Rank 0] totoal_tokens=3469, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:14:47] [Rank 2] totoal_tokens=3275, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:14:47] [Rank 3] totoal_tokens=3470, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:47] [Rank 1] totoal_tokens=3414, outputs='```json\n{\n  "animals": [\n    {\n      "name": "Jackrabbit",\n      "description": "Despite their name, jackrab'
[2024-08-03 15:14:47] [Rank 2] totoal_tokens=3281, outputs='```json\n{\n  "count": 0\n}\n```'
[2024-08-03 15:14:47] [Rank 3] totoal_tokens=3509, outputs='```json\n{\n  "count": 1\n}\n```'
[2024-08-03 15:14:47] [Rank 0] totoal_tokens=3619, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:14:48] [Rank 1] totoal_tokens=3415, outputs='```json\n{\n  "computer_count": [\n    "1",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:14:48] [Rank 2] totoal_tokens=3321, outputs='```json\n{\n  "number_of_key": 1\n}\n```'
[2024-08-03 15:14:48] [Rank 3] totoal_tokens=3558, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:48] [Rank 0] totoal_tokens=3624, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:14:48] [Rank 2] totoal_tokens=3380, outputs='```json\n{\n  "compass_count": 1\n}\n```'
[2024-08-03 15:14:48] [Rank 1] totoal_tokens=3421, outputs='```json\n{\n  "vases": [\n    "2",\n    "4"\n  ]\n}\n```'
[2024-08-03 15:14:49] [Rank 0] totoal_tokens=3647, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:14:49] [Rank 1] totoal_tokens=3448, outputs='[1, 1, 1]'
[2024-08-03 15:14:49] [Rank 3] totoal_tokens=3573, outputs='```json\n{\n  "lighthouse_count": [\n    "1",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:14:49] [Rank 2] totoal_tokens=3400, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:14:49] [Rank 0] totoal_tokens=3658, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:14:49] [Rank 3] totoal_tokens=3643, outputs='```json\n{\n  "brush_count": 4\n}\n```'
[2024-08-03 15:14:50] [Rank 0] totoal_tokens=3674, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:14:50] [Rank 2] totoal_tokens=3404, outputs='```json\n{\n  "equity_crowdfunding": 209000,\n  "total_crowdfunding": 15860000,'
[2024-08-03 15:14:50] [Rank 1] totoal_tokens=3584, outputs='```json\n{\n  "keys": [\n    "10",\n    "10",\n    "10",\n    "10",\n    "10",\n    "'
[2024-08-03 15:14:50] [Rank 3] totoal_tokens=3863, outputs='```json\n{\n  "key_count": 3\n}\n```'
[2024-08-03 15:14:50] [Rank 0] totoal_tokens=3684, outputs='```json\n{\n  "number_of_★": 2\n}\n```'
[2024-08-03 15:14:51] [Rank 2] totoal_tokens=3417, outputs='```json\n{\n  "number_of_vases": 5\n}\n```'
[2024-08-03 15:14:51] [Rank 1] totoal_tokens=3600, outputs='```json\n{\n  "number_of_brushes": 2\n}\n```'
[2024-08-03 15:14:51] [Rank 3] totoal_tokens=3931, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:14:51] [Rank 2] totoal_tokens=3417, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:14:51] [Rank 0] totoal_tokens=3802, outputs='```json\n{\n  "number_of_owls": [\n    "10",\n    "7",\n    "6",\n    "5",\n    "'
██        | 160/765 [01:29<07:02,  1.43it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  21%|██        | 161/765 [01:29<06:44,  1.49it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  21%|██        | 162/765 [01:30<08:02,  1.25it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  21%|██▏       | 163/765 [01:31<07:38,  1.31it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  21%|██▏       | 164/765 [01:32<08:20,  1.20it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  22%|██▏       | 165/765 [01:33<07:41,  1.30it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  22%|██▏       | 166/765 [01:33<07:10,  1.39it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  22%|██▏       | 167/765 [01:34<06:47,  1.47it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  22%|██▏       | 168/765 [01:34<06:41,  1.49it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  22%|██▏       | 169/765 [01:35<06:34,  1.51it/s]
Processing InternVL2-2B_c[2024-08-03 15:14:52] [Rank 1] totoal_tokens=3623, outputs='```json\n{\n  "favorite_film": "The Shawshank Redemption",\n  "favorite_book": "Wild Swans",\n  "favorite'
[2024-08-03 15:14:52] [Rank 3] totoal_tokens=3957, outputs='```json\n{\n  "vases": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:14:52] [Rank 2] totoal_tokens=3488, outputs='```json\n{\n  "key_count": 3\n}\n```'
[2024-08-03 15:14:52] [Rank 1] totoal_tokens=3806, outputs='[1, 1, 1]'
[2024-08-03 15:14:52] [Rank 0] totoal_tokens=3808, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:14:52] [Rank 3] totoal_tokens=3967, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:14:53] [Rank 0] totoal_tokens=3921, outputs='```json\n{\n  "count": 0\n}\n```'
[2024-08-03 15:14:53] [Rank 2] totoal_tokens=3557, outputs='```json\n{\n  "compass_count": [\n    {\n      "x": 1,\n      "y": 1,\n      "z":'
[2024-08-03 15:14:53] [Rank 3] totoal_tokens=4034, outputs='```json\n{\n  "keys": 4\n}\n```'
[2024-08-03 15:14:53] [Rank 1] totoal_tokens=3875, outputs='```json\n{\n  "best_hotels": [\n    "Hotel Royal London",\n    "Hotel Royal London",\n    "Hotel Royal London",\n    "'
[2024-08-03 15:14:53] [Rank 2] totoal_tokens=3593, outputs='[1, 1, 1]'
[2024-08-03 15:14:53] [Rank 3] totoal_tokens=4088, outputs='[0, 0, 0]'
[2024-08-03 15:14:54] [Rank 2] totoal_tokens=3613, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:14:54] [Rank 0] totoal_tokens=3938, outputs='```json\n{\n  "title": "The Gloaming",\n  "description": "A not an often-used word, but its meaning is so'
[2024-08-03 15:14:54] [Rank 1] totoal_tokens=3953, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:14:54] [Rank 3] totoal_tokens=4094, outputs='```json\n{\n  "number_of_★": 0\n}\n```'
[2024-08-03 15:14:54] [Rank 2] totoal_tokens=3694, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:14:54] [Rank 0] totoal_tokens=3981, outputs='```json\n{\n  "result": 3\n}\n```'
[2024-08-03 15:14:54] [Rank 1] totoal_tokens=3983, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:14:55] [Rank 2] totoal_tokens=3784, outputs='[1, 2, 3]'
[2024-08-03 15:14:55] [Rank 3] totoal_tokens=4097, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:14:55] [Rank 1] totoal_tokens=4025, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:14:55] [Rank 3] totoal_tokens=4107, outputs='```json\n{\n  "trees": 2\n}\n```'
[2024-08-03 15:14:55] [Rank 0] totoal_tokens=4017, outputs='```json\n{\n  "1": "Bloodborne",\n  "2": "Legion",\n  "3": "The Burning Crusade",'
[2024-08-03 15:14:56] [Rank 2] totoal_tokens=3887, outputs='```json\n{\n  "questions": [\n    "Who is Nikky Finney?",\n    "Who is Jericho Brown?",\n    "Who is'
[2024-08-03 15:14:56] [Rank 1] totoal_tokens=4035, outputs='```json\n{\n  "number_of_bananas": 4\n}\n```'
[2024-08-03 15:14:56] [Rank 3] totoal_tokens=4158, outputs='```json\n{\n  "number_of_vases": 3\n}\n```'
[2024-08-03 15:14:56] [Rank 0] totoal_tokens=4036, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 4}\n  ]\n}\n```'
[2024-08-03 15:14:57] [Rank 1] totoal_tokens=4046, outputs='```json\n{\n  "number_of_★": 1\n}\n```'
[2024-08-03 15:14:57] [Rank 3] totoal_tokens=4164, outputs='```json\n{\n  "vases": 1\n}\n```'
[2024-08-03 15:14:57] [Rank 2] totoal_tokens=3958, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:57] [Rank 0] totoal_tokens=4090, outputs='```json\n{\n  "brush_count": 1\n}\n```'
[2024-08-03 15:14:57] [Rank 1] totoal_tokens=4066, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:14:57] [Rank 3] totoal_tokens=4177, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:14:58] [Rank 2] totoal_tokens=3961, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:58] [Rank 0] totoal_tokens=4219, outputs='```json\n{\n  "brush_count": 3\n}\n```'
[2024-08-03 15:14:58] [Rank 3] totoal_tokens=4201, outputs='```json\n{\n  "lighthouse_count": [\n    "2",\n    "2",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:14:58] [Rank 2] totoal_tokens=4035, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:14:58] [Rank 1] totoal_tokens=4233, outputs='```json\n{\n  "title": "The Outsider 2",\n  "release_date": "March 9, 2018",'
[2024-08-03 15:14:59] [Rank 0] totoal_tokens=4225, outputs='```json\n{\n  "number_of_bananas": 3\n}\n```'
ounting-text-test.jsonl:  22%|██▏       | 170/765 [01:36<07:34,  1.31it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  22%|██▏       | 171/765 [01:37<07:16,  1.36it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  22%|██▏       | 172/765 [01:37<06:47,  1.46it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  23%|██▎       | 173/765 [01:38<07:49,  1.26it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  23%|██▎       | 174/765 [01:39<07:15,  1.36it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  23%|██▎       | 175/765 [01:40<08:19,  1.18it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  23%|██▎       | 176/765 [01:41<08:59,  1.09it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  23%|██▎       | 177/765 [01:42<08:24,  1.16it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  23%|██▎       | 178/765 [01:43<07:42,  1.27it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  23%|██▎       | 179/765 [01:43<07:24, [2024-08-03 15:14:59] [Rank 1] totoal_tokens=4237, outputs='```json\n{\n  "Outsider 2": "March 9, 2018"\n}\n```'
[2024-08-03 15:14:59] [Rank 3] totoal_tokens=4205, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:14:59] [Rank 2] totoal_tokens=4037, outputs='```json\n{\n  "1": "Bloodborne",\n  "2": "Legion",\n  "3": "The Burning Crusade",'
[2024-08-03 15:15:00] [Rank 0] totoal_tokens=4275, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:00] [Rank 1] totoal_tokens=4390, outputs='```json\n{\n  "tree_count": 2\n}\n```'
[2024-08-03 15:15:00] [Rank 0] totoal_tokens=4371, outputs='[0, 0, 0]'
[2024-08-03 15:15:00] [Rank 2] totoal_tokens=4071, outputs='```json\n{\n  "compass_count": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:15:00] [Rank 3] totoal_tokens=4225, outputs='```json\n{\n  "computer_count": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:15:01] [Rank 1] totoal_tokens=4471, outputs='```json\n{\n  "brush_count": 4\n}\n```'
[2024-08-03 15:15:01] [Rank 2] totoal_tokens=4471, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:15:01] [Rank 0] totoal_tokens=4515, outputs='```json\n{\n  "vases": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:15:01] [Rank 3] totoal_tokens=4236, outputs='```json\n{\n  "judges": [\n    {\n      "photo": "Janet Haney for mobility scooters",\n      "rating":'
[2024-08-03 15:15:01] [Rank 2] totoal_tokens=4549, outputs='[3, 3, 3]'
[2024-08-03 15:15:02] [Rank 1] totoal_tokens=4512, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:02] [Rank 0] totoal_tokens=4522, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:15:02] [Rank 3] totoal_tokens=4400, outputs='```json\n{\n  "tree_count": 2\n}\n```'
[2024-08-03 15:15:02] [Rank 0] totoal_tokens=4527, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:15:02] [Rank 1] totoal_tokens=4534, outputs='```json\n{\n  "number_of_bananas": 1\n}\n```'
[2024-08-03 15:15:03] [Rank 2] totoal_tokens=4675, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:03] [Rank 3] totoal_tokens=4535, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:15:03] [Rank 0] totoal_tokens=4537, outputs='```json\n{\n  "vases": [\n    "4",\n    "3",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:15:03] [Rank 1] totoal_tokens=4541, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:04] [Rank 2] totoal_tokens=4795, outputs='```json\n{\n  "results": [\n    "Tiffany Haddish",\n    "Common",\n    "Tiffany Haddish",\n    "'
[2024-08-03 15:15:04] [Rank 3] totoal_tokens=4535, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:04] [Rank 1] totoal_tokens=4596, outputs='{"number_of_★": 1}'
[2024-08-03 15:15:04] [Rank 0] totoal_tokens=4555, outputs='```json\n{\n  "results": [\n    {\n      "title": "The Lag Song",\n      "performer": "Luke Kelly",\n      "'
[2024-08-03 15:15:04] [Rank 2] totoal_tokens=4944, outputs='```json\n{\n  "vase_count": 2\n}\n```'
[2024-08-03 15:15:05] [Rank 3] totoal_tokens=4548, outputs='```json\n{\n  "brushes": [\n    {\n      "x": 1,\n      "number_of_brushes": 1'
[2024-08-03 15:15:05] [Rank 0] totoal_tokens=4596, outputs='```json\n{\n  "brushes": 3\n}\n```'
[2024-08-03 15:15:05] [Rank 1] totoal_tokens=4649, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:05] [Rank 2] totoal_tokens=4973, outputs='```json\n{\n  "compass_count": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:15:05] [Rank 3] totoal_tokens=4548, outputs='```json\n{\n  "count": 2\n}\n```'
[2024-08-03 15:15:06] [Rank 0] totoal_tokens=4611, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:15:06] [Rank 1] totoal_tokens=4774, outputs='```json\n{\n  "count": 3\n}\n```'
[2024-08-03 15:15:06] [Rank 2] totoal_tokens=5001, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:15:06] [Rank 3] totoal_tokens=4617, outputs='```json\n{\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:15:06] [Rank 1] totoal_tokens=4796, outputs='```json\n{\n  "computer": 0\n}\n```'
[2024-08-03 15:15:07] [Rank 0] totoal_tokens=4651, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
 1.32it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  24%|██▎       | 180/765 [01:44<08:28,  1.15it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  24%|██▎       | 181/765 [01:45<07:12,  1.35it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  24%|██▍       | 182/765 [01:46<07:47,  1.25it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  24%|██▍       | 183/765 [01:46<07:15,  1.33it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  24%|██▍       | 184/765 [01:47<06:55,  1.40it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  24%|██▍       | 185/765 [01:48<07:35,  1.27it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  24%|██▍       | 186/765 [01:49<08:20,  1.16it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  24%|██▍       | 187/765 [01:50<07:40,  1.26it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  25%|██▍       | 188/765 [01:50<07:16,  1.32it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  25%|█�[2024-08-03 15:15:07] [Rank 2] totoal_tokens=5025, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:15:07] [Rank 3] totoal_tokens=4628, outputs='```json\n{\n  "number_of_bananas": 3\n}\n```'
[2024-08-03 15:15:07] [Rank 1] totoal_tokens=4859, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:07] [Rank 2] totoal_tokens=5045, outputs='```json\n{\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:15:07] [Rank 3] totoal_tokens=4777, outputs='```json\n{\n  "brushes": 3\n}\n```'
[2024-08-03 15:15:08] [Rank 0] totoal_tokens=4767, outputs='```json\n{\n  "results": [\n    {"number": 1, "value": 1},\n    {"number": 2, "value'
[2024-08-03 15:15:08] [Rank 1] totoal_tokens=4891, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:15:08] [Rank 3] totoal_tokens=4863, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:15:08] [Rank 0] totoal_tokens=4785, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:15:08] [Rank 2] totoal_tokens=5048, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:09] [Rank 3] totoal_tokens=4863, outputs='```json\n{\n  "vases": 2\n}\n```'
[2024-08-03 15:15:09] [Rank 0] totoal_tokens=4854, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:15:09] [Rank 1] totoal_tokens=4923, outputs='```json\n{\n  "numbers": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:15:09] [Rank 2] totoal_tokens=5065, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:15:10] [Rank 0] totoal_tokens=4860, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:15:10] [Rank 1] totoal_tokens=4938, outputs='```json\n{\n  "trees": 2\n}\n```'
[2024-08-03 15:15:10] [Rank 2] totoal_tokens=5086, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:15:10] [Rank 3] totoal_tokens=4999, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:10] [Rank 0] totoal_tokens=4942, outputs='```json\n{\n  "brush_count": 1\n}\n```'
[2024-08-03 15:15:11] [Rank 3] totoal_tokens=5078, outputs='```json\n{\n  "number_of_★": 0\n}\n```'
[2024-08-03 15:15:11] [Rank 2] totoal_tokens=5121, outputs='```json\n{\n  "animals": [\n    {\n      "name": "Jackrabbit",\n      "description": "hares, long ears,'
[2024-08-03 15:15:11] [Rank 1] totoal_tokens=5014, outputs='```json\n{\n  "text": "His injury was with the mentality of the players… they saw it was a big injury",\n  "translation":'
[2024-08-03 15:15:11] [Rank 0] totoal_tokens=4991, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:15:12] [Rank 2] totoal_tokens=5121, outputs='```json\n{\n  "trees": 4\n}\n```'
[2024-08-03 15:15:12] [Rank 3] totoal_tokens=5144, outputs='```json\n{\n  "brushes": [\n    {"x": 0, "y": 0},\n    {"x": 0, "'
[2024-08-03 15:15:12] [Rank 0] totoal_tokens=5014, outputs='```json\n{\n  "vases": 4\n}\n```'
[2024-08-03 15:15:12] [Rank 1] totoal_tokens=5015, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:12] [Rank 2] totoal_tokens=5131, outputs='```json\n{\n  "number_of_chests": 1\n}\n```'
[2024-08-03 15:15:12] [Rank 3] totoal_tokens=5224, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:15:12] [Rank 0] totoal_tokens=5046, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:15:13] [Rank 3] totoal_tokens=5269, outputs='[0, 0, 0]'
[2024-08-03 15:15:13] [Rank 1] totoal_tokens=5071, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:15:13] [Rank 2] totoal_tokens=5132, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:15:13] [Rank 0] totoal_tokens=5071, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:15:14] [Rank 2] totoal_tokens=5157, outputs='```json\n{\n  "compass_count": 1\n}\n```'
[2024-08-03 15:15:14] [Rank 1] totoal_tokens=5089, outputs='```json\n{\n  "title": "Father X",\n  "description": "Father X is a collection of 30 paintings created by Joan Gait'
[2024-08-03 15:15:14] [Rank 3] totoal_tokens=5308, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:14] [Rank 0] totoal_tokens=5133, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
��▍       | 189/765 [01:51<08:04,  1.19it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  25%|██▍       | 190/765 [01:52<08:37,  1.11it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  25%|██▍       | 191/765 [01:53<07:51,  1.22it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  25%|██▌       | 192/765 [01:54<07:20,  1.30it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  25%|██▌       | 193/765 [01:54<07:17,  1.31it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  25%|██▌       | 194/765 [01:55<06:56,  1.37it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  25%|██▌       | 195/765 [01:56<06:47,  1.40it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  26%|██▌       | 196/765 [01:56<06:41,  1.42it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  26%|██▌       | 197/765 [01:57<06:31,  1.45it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  26%|██▌       | 198/765 [01:58<06:30,  1.45it/s]
Processing InternVL2-2B[2024-08-03 15:15:14] [Rank 2] totoal_tokens=5244, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:15:15] [Rank 1] totoal_tokens=5124, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:15:15] [Rank 3] totoal_tokens=5371, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:15:15] [Rank 2] totoal_tokens=5250, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:15:15] [Rank 0] totoal_tokens=5144, outputs='```json\n{\n  "number_of_brushes": 2\n}\n```'
[2024-08-03 15:15:15] [Rank 3] totoal_tokens=5391, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:15:15] [Rank 2] totoal_tokens=5281, outputs='```json\n{\n  "brush_count": 4\n}\n```'
[2024-08-03 15:15:16] [Rank 1] totoal_tokens=5133, outputs='```json\n{\n  "vases": [\n    {\n      "x": 1,\n      "x": 2,\n      "x":'
[2024-08-03 15:15:16] [Rank 0] totoal_tokens=5237, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3",\n    "4",\n    "5",\n    "'
[2024-08-03 15:15:16] [Rank 3] totoal_tokens=5434, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:15:16] [Rank 2] totoal_tokens=5289, outputs='```json\n{\n  "count": 3\n}\n```'
[2024-08-03 15:15:17] [Rank 0] totoal_tokens=5279, outputs='```json\n{\n  "count": 1\n}\n```'
[2024-08-03 15:15:17] [Rank 3] totoal_tokens=5475, outputs='```json\n{\n  "count": 5\n}\n```'
[2024-08-03 15:15:17] [Rank 1] totoal_tokens=5173, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:17] [Rank 2] totoal_tokens=5303, outputs='```json\n{\n  "vases": [\n    "4",\n    "8",\n    "12"\n  ]\n}\n```'
[2024-08-03 15:15:17] [Rank 3] totoal_tokens=5630, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:15:18] [Rank 0] totoal_tokens=5392, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:18] [Rank 1] totoal_tokens=5183, outputs='```json\n{\n  "Shitamachi": 3,\n  "Suburban Tokyo": 2,\n  "Suburban Tokyo": 2'
[2024-08-03 15:15:18] [Rank 2] totoal_tokens=5380, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:15:18] [Rank 3] totoal_tokens=5732, outputs='```json\n{\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:15:19] [Rank 0] totoal_tokens=5393, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:19] [Rank 2] totoal_tokens=5411, outputs='```json\n{\n  "Optometrist": 79,\n  "Other Jobs": 0\n}\n```'
[2024-08-03 15:15:19] [Rank 1] totoal_tokens=5221, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:19] [Rank 3] totoal_tokens=5837, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:15:19] [Rank 2] totoal_tokens=5424, outputs='```json\n{\n  "computer_count": 2\n}\n```'
[2024-08-03 15:15:20] [Rank 1] totoal_tokens=5259, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:15:20] [Rank 0] totoal_tokens=5505, outputs='```json\n{\n  "1": 2,\n  "2": 3,\n  "3": 4,\n  "4": 5'
[2024-08-03 15:15:20] [Rank 2] totoal_tokens=5426, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:15:20] [Rank 3] totoal_tokens=5838, outputs='```json\n{\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:15:20] [Rank 1] totoal_tokens=5304, outputs='```json\n{\n  "bananas": 2\n}\n```'
[2024-08-03 15:15:21] [Rank 0] totoal_tokens=5554, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:15:21] [Rank 1] totoal_tokens=5356, outputs='[1, 1, 1]'
[2024-08-03 15:15:21] [Rank 3] totoal_tokens=5848, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:15:21] [Rank 2] totoal_tokens=5449, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:21] [Rank 0] totoal_tokens=5587, outputs='[2, 2, 2]'
[2024-08-03 15:15:22] [Rank 3] totoal_tokens=5918, outputs='```json\n{\n  "count": 1\n}\n```'
[2024-08-03 15:15:22] [Rank 2] totoal_tokens=5511, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:15:22] [Rank 1] totoal_tokens=5400, outputs='```json\n{\n  "keys": [\n    "Fighting for principle matters",\n    "Verb",\n    "Reimagining: Sculptures'
[2024-08-03 15:15:22] [Rank 0] totoal_tokens=5600, outputs='[4, 3, 2, 1, 2, 1, 1, 1, 1, 1, 1'
_counting-text-test.jsonl:  26%|██▌       | 199/765 [01:59<07:40,  1.23it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  26%|██▌       | 200/765 [02:00<07:26,  1.27it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  26%|██▋       | 201/765 [02:01<08:13,  1.14it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  26%|██▋       | 202/765 [02:01<07:29,  1.25it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  27%|██▋       | 203/765 [02:02<08:16,  1.13it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  27%|██▋       | 204/765 [02:03<08:48,  1.06it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  27%|██▋       | 205/765 [02:05<09:15,  1.01it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  27%|██▋       | 206/765 [02:05<08:45,  1.06it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  27%|██▋       | 207/765 [02:06<07:29,  1.24it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  27%|██▋       | 208/765 [02:07<08:31[2024-08-03 15:15:22] [Rank 1] totoal_tokens=5409, outputs='{"Optometrist": 79, "Other Jobs": 0}'
[2024-08-03 15:15:23] [Rank 2] totoal_tokens=5546, outputs='```json\n{\n  "brush_count": 1\n}\n```'
[2024-08-03 15:15:23] [Rank 1] totoal_tokens=5426, outputs='[1, 1, 1]'
[2024-08-03 15:15:23] [Rank 3] totoal_tokens=6078, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 2'
[2024-08-03 15:15:23] [Rank 0] totoal_tokens=5601, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:15:23] [Rank 2] totoal_tokens=5546, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:15:24] [Rank 1] totoal_tokens=5436, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:15:24] [Rank 0] totoal_tokens=5629, outputs='```json\n{\n  "lighthouse_count": 26\n}\n```'
[2024-08-03 15:15:24] [Rank 2] totoal_tokens=5620, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:15:24] [Rank 3] totoal_tokens=6081, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:24] [Rank 1] totoal_tokens=5439, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:15:25] [Rank 0] totoal_tokens=5713, outputs='[1, 1, 1]'
[2024-08-03 15:15:25] [Rank 2] totoal_tokens=5900, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:15:25] [Rank 3] totoal_tokens=6108, outputs='```json\n{\n  "brush_count": 1\n}\n```'
[2024-08-03 15:15:25] [Rank 3] totoal_tokens=6123, outputs='[2, 2, 2]'
[2024-08-03 15:15:26] [Rank 0] totoal_tokens=5744, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:26] [Rank 1] totoal_tokens=5535, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:26] [Rank 2] totoal_tokens=5920, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:26] [Rank 1] totoal_tokens=5601, outputs='[2, 2, 2]'
[2024-08-03 15:15:26] [Rank 3] totoal_tokens=6123, outputs='```json\n{\n  "nymphs": 2\n}\n```'
[2024-08-03 15:15:26] [Rank 0] totoal_tokens=5768, outputs='```json\n{\n  "computer": 3\n}\n```'
[2024-08-03 15:15:27] [Rank 2] totoal_tokens=5941, outputs='```json\n{\n  "number_of_★": 2\n}\n```'
[2024-08-03 15:15:27] [Rank 1] totoal_tokens=5612, outputs='```json\n{\n  "bananas": 2\n}\n```'
[2024-08-03 15:15:27] [Rank 0] totoal_tokens=5839, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:15:27] [Rank 2] totoal_tokens=5952, outputs='```json\n{\n  "number_of_owls": 3\n}\n```'
[2024-08-03 15:15:27] [Rank 3] totoal_tokens=6165, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:28] [Rank 1] totoal_tokens=5612, outputs='```json\n{\n  "apple_count": 2\n}\n```'
[2024-08-03 15:15:28] [Rank 2] totoal_tokens=5961, outputs='[2, 2, 2]'
[2024-08-03 15:15:28] [Rank 0] totoal_tokens=5913, outputs='[3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3'
[2024-08-03 15:15:28] [Rank 3] totoal_tokens=6241, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:15:28] [Rank 1] totoal_tokens=5623, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:15:29] [Rank 3] totoal_tokens=6318, outputs='```json\n{\n  "trees": 4\n}\n```'
[2024-08-03 15:15:29] [Rank 2] totoal_tokens=6028, outputs='```json\n{\n  "windsor_airport_trends": {\n    "10_minutes": {\n      "number_of_keys": 1'
[2024-08-03 15:15:29] [Rank 0] totoal_tokens=5928, outputs='```json\n{\n  "count": 0\n}\n```'
[2024-08-03 15:15:29] [Rank 1] totoal_tokens=5712, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "A small vase placed on the ground next to'
[2024-08-03 15:15:30] [Rank 2] totoal_tokens=6083, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:15:30] [Rank 3] totoal_tokens=6511, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:30] [Rank 0] totoal_tokens=5943, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:30] [Rank 1] totoal_tokens=5839, outputs='```json\n{\n  "vase_count": 3\n}\n```'
[2024-08-03 15:15:30] [Rank 2] totoal_tokens=6088, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:15:31] [Rank 0] totoal_tokens=6014, outputs='[1, 2, 3, 4, 5]'
,  1.09it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  27%|██▋       | 209/765 [02:08<08:04,  1.15it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  27%|██▋       | 210/765 [02:09<07:45,  1.19it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  28%|██▊       | 211/765 [02:09<07:16,  1.27it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  28%|██▊       | 212/765 [02:10<08:03,  1.14it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  28%|██▊       | 213/765 [02:11<07:28,  1.23it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  28%|██▊       | 214/765 [02:12<07:08,  1.29it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  28%|██▊       | 215/765 [02:13<07:59,  1.15it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  28%|██▊       | 216/765 [02:14<07:48,  1.17it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  28%|██▊       | 217/765 [02:15<08:27,  1.08it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  28%|�[2024-08-03 15:15:31] [Rank 3] totoal_tokens=6625, outputs='```json\n{\n  "bars": [\n    {\n      "name": "The Edge",\n      "location": "The Castro",\n      "features": "'
[2024-08-03 15:15:31] [Rank 2] totoal_tokens=6124, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:15:31] [Rank 1] totoal_tokens=5939, outputs='```json\n{\n  "trees": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:15:32] [Rank 1] totoal_tokens=5942, outputs='[1, 1, 1]'
[2024-08-03 15:15:32] [Rank 0] totoal_tokens=6083, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:32] [Rank 3] totoal_tokens=6752, outputs='```json\n{\n  "compasses": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:15:32] [Rank 2] totoal_tokens=6173, outputs='```json\n{\n  "numbers": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:15:33] [Rank 0] totoal_tokens=6124, outputs='```json\n{\n  "number_of_chests": 4\n}\n```'
[2024-08-03 15:15:33] [Rank 1] totoal_tokens=6014, outputs='```json\n{\n  "trees": [\n    {"x": 0, "count": 1},\n    {"x": 100, "'
[2024-08-03 15:15:33] [Rank 2] totoal_tokens=6178, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:15:33] [Rank 3] totoal_tokens=7015, outputs='```json\n{\n  "chest_count": [\n    {\n      "x": 1,\n      "y": 1,\n      "z":'
[2024-08-03 15:15:34] [Rank 0] totoal_tokens=6236, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "computer": "1"},\n    {"number": 2, "computer'
[2024-08-03 15:15:34] [Rank 2] totoal_tokens=6245, outputs='```json\n{\n  "computers": [\n    {\n      "number": 1,\n      "color": "red"\n    },\n    {'
[2024-08-03 15:15:34] [Rank 1] totoal_tokens=6044, outputs='{"product": "Nike\'s new Colin Kaepernick advert has been effective at provoking the desired political controversy and polarised opinion: 30%'
[2024-08-03 15:15:34] [Rank 3] totoal_tokens=7017, outputs='```json\n{\n  "keys": [\n    {"number": 1, "description": "Ancient Japanese temple"},\n    {"number":'
[2024-08-03 15:15:35] [Rank 2] totoal_tokens=6251, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:15:35] [Rank 1] totoal_tokens=6078, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:15:35] [Rank 0] totoal_tokens=6362, outputs='```json\n{\n  "title": "Does it Hurt",\n  "author": "H.D. Carlton",\n  "genre": "dark'
[2024-08-03 15:15:36] [Rank 3] totoal_tokens=7029, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1},'
[2024-08-03 15:15:36] [Rank 1] totoal_tokens=6124, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:15:36] [Rank 2] totoal_tokens=6264, outputs='```json\n{\n  "trees": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:15:36] [Rank 0] totoal_tokens=6363, outputs='```json\n{\n  "compasses": [\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:15:36] [Rank 3] totoal_tokens=7059, outputs='```json\n{\n  "count": 2\n}\n```'
[2024-08-03 15:15:36] [Rank 1] totoal_tokens=6150, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:15:37] [Rank 2] totoal_tokens=6320, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:15:37] [Rank 0] totoal_tokens=6531, outputs='```json\n{\n  "chest_count": 4\n}\n```'
[2024-08-03 15:15:37] [Rank 1] totoal_tokens=6174, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:15:37] [Rank 2] totoal_tokens=6322, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:15:38] [Rank 3] totoal_tokens=7072, outputs='```json\n{\n  "Fitbit Force": "I moved to Fitbit after complaints about skin irritation after wearing the Force for extended periods of time'
[2024-08-03 15:15:38] [Rank 0] totoal_tokens=6557, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:15:38] [Rank 1] totoal_tokens=6184, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:15:38] [Rank 3] totoal_tokens=7097, outputs='```json\n{\n  "brushes": 0\n}\n```'
[2024-08-03 15:15:38] [Rank 2] totoal_tokens=6545, outputs='```json\n{\n  "vases": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:15:38] [Rank 0] totoal_tokens=6623, outputs='```json\n{\n  "number_of_vases": 1\n}\n```'
[2024-08-03 15:15:39] [Rank 1] totoal_tokens=6294, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:15:39] [Rank 0] totoal_tokens=6729, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:15:39] [Rank 3] totoal_tokens=7134, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:15:39] [Rank 1] totoal_tokens=6309, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:15:40] [Rank 2] totoal_tokens=6547, outputs='```json\n{\n  "questions": [\n    "Who is the coach of Manchester City?",\n    "Who is the coach of Southampton?",\n    "Who'
[2024-08-03 15:15:40] [Rank 3] totoal_tokens=7179, outputs='```json\n{\n  "number_of_computers": 1\n}\n```'
[2024-08-03 15:15:40] [Rank 1] totoal_tokens=6313, outputs='```json\n{\n  "vases": [3, 2, 1]\n}\n```'
[2024-08-03 15:15:40] [Rank 0] totoal_tokens=6734, outputs='```json\n{\n  "SPBS_stations": [\n    "ID 5034",\n    "International Education Center station",\n    "Le Qiao'
�█▊       | 218/765 [02:15<08:06,  1.13it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  29%|██▊       | 219/765 [02:17<08:52,  1.03it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  29%|██▉       | 220/765 [02:18<08:27,  1.07it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  29%|██▉       | 221/765 [02:19<09:15,  1.02s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  29%|██▉       | 222/765 [02:20<09:44,  1.08s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  29%|██▉       | 223/765 [02:21<09:20,  1.03s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  29%|██▉       | 224/765 [02:22<08:26,  1.07it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  29%|██▉       | 225/765 [02:22<07:51,  1.15it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  30%|██▉       | 226/765 [02:23<07:44,  1.16it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  30%|██▉       | 227/765 [02:24<07:34,  1.18it/s]
Processing InternVL2-[2024-08-03 15:15:40] [Rank 2] totoal_tokens=6615, outputs='```json\n{\n  "numbers": [\n    4,\n    4,\n    4...\n  ]\n}\n```'
[2024-08-03 15:15:41] [Rank 1] totoal_tokens=6419, outputs='```json\n{\n  "bananas": 2\n}\n```'
[2024-08-03 15:15:41] [Rank 0] totoal_tokens=6801, outputs='```json\n{\n  "chest_count": 4\n}\n```'
[2024-08-03 15:15:41] [Rank 3] totoal_tokens=7283, outputs='```json\n{\n  "brushes": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:15:41] [Rank 2] totoal_tokens=6715, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:15:42] [Rank 2] totoal_tokens=6903, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:15:42] [Rank 1] totoal_tokens=6480, outputs='```json\n{\n  "compass_count": 2\n}\n```'
[2024-08-03 15:15:42] [Rank 0] totoal_tokens=6979, outputs='{\n  "title": "Jamun Honey for Diabetes",\n  "description": "Jamun Honey is a natural sweetener that is rich in antioxid'
[2024-08-03 15:15:42] [Rank 3] totoal_tokens=7288, outputs='```json\n{\n  "trees": [\n    {"x": 1, "count": 1},\n    {"x": 2, "'
[2024-08-03 15:15:43] [Rank 1] totoal_tokens=6506, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:15:43] [Rank 2] totoal_tokens=6980, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:43] [Rank 0] totoal_tokens=7095, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:43] [Rank 3] totoal_tokens=7292, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:44] [Rank 1] totoal_tokens=6514, outputs='```json\n{\n  "chest_count": 4\n}\n```'
[2024-08-03 15:15:44] [Rank 2] totoal_tokens=6983, outputs='[1, 2, 3, 4, 5, 6]'
[2024-08-03 15:15:44] [Rank 0] totoal_tokens=7106, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:15:45] [Rank 2] totoal_tokens=6983, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:15:45] [Rank 1] totoal_tokens=6654, outputs='```json\n{\n  "numbers": [\n    {"x": 3, "x": 3, "x": 3},\n    {"x'
[2024-08-03 15:15:45] [Rank 0] totoal_tokens=7125, outputs='{\n  "number_of_brushes": 3\n}'
[2024-08-03 15:15:45] [Rank 3] totoal_tokens=7296, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "x": 2, "x": 3},\n    {"x'
[2024-08-03 15:15:46] [Rank 2] totoal_tokens=7077, outputs='```json\n{\n  "vases": [\n    {"x": 2, "x": 2, "x": 2},\n    {"'
[2024-08-03 15:15:46] [Rank 0] totoal_tokens=7279, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:15:46] [Rank 1] totoal_tokens=6694, outputs='```json\n{\n  "compass": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:15:46] [Rank 3] totoal_tokens=7342, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:47] [Rank 2] totoal_tokens=7077, outputs='```json\n{\n  "vases": 0\n}\n```'
[2024-08-03 15:15:47] [Rank 0] totoal_tokens=7350, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:15:47] [Rank 1] totoal_tokens=6842, outputs='```json\n{\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:15:48] [Rank 3] totoal_tokens=7366, outputs='```json\n{\n  "successes": [\n    "Groups are meeting up",\n    "Groups are discussing their challenges",\n    "Groups are sharing their'
[2024-08-03 15:15:48] [Rank 1] totoal_tokens=6864, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:15:48] [Rank 2] totoal_tokens=7094, outputs='[4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4'
[2024-08-03 15:15:48] [Rank 0] totoal_tokens=7366, outputs='```json\n{\n  "successes": [\n    "Groups are meeting up",\n    "Good idea",\n    "Many groups are doing great things",'
[2024-08-03 15:15:49] [Rank 1] totoal_tokens=6889, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:15:49] [Rank 3] totoal_tokens=7379, outputs='```json\n{\n  "successes": [\n    "Groups are meeting up",\n    "Good idea",\n    "Many groups are doing great things",'
[2024-08-03 15:15:49] [Rank 0] totoal_tokens=7373, outputs='[0, 0, 0]'
2B_counting-text-test.jsonl:  30%|██▉       | 228/765 [02:25<08:19,  1.08it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  30%|██▉       | 229/765 [02:26<07:55,  1.13it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  30%|███       | 230/765 [02:27<08:29,  1.05it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  30%|███       | 231/765 [02:28<09:09,  1.03s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  30%|███       | 232/765 [02:29<08:40,  1.02it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  30%|███       | 233/765 [02:30<07:47,  1.14it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  31%|███       | 234/765 [02:31<08:32,  1.04it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  31%|███       | 235/765 [02:32<08:16,  1.07it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  31%|███       | 236/765 [02:33<08:51,  1.00s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  31%|███       | 237/765 [02:34<08:[2024-08-03 15:15:49] [Rank 2] totoal_tokens=7124, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round vase with'
[2024-08-03 15:15:50] [Rank 0] totoal_tokens=7380, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:15:50] [Rank 1] totoal_tokens=7022, outputs='[3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3'
[2024-08-03 15:15:50] [Rank 2] totoal_tokens=7159, outputs='```json\n{\n  "trees": 3\n}\n```'
[2024-08-03 15:15:50] [Rank 3] totoal_tokens=7477, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "value": 1},\n    {"number": 2, "value'
[2024-08-03 15:15:50] [Rank 0] totoal_tokens=7466, outputs='[1, 2, 3]'
[2024-08-03 15:15:51] [Rank 1] totoal_tokens=7023, outputs='```json\n{\n  "trees": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:15:51] [Rank 2] totoal_tokens=7168, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:51] [Rank 3] totoal_tokens=7545, outputs='```json\n{\n  "trees": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:15:51] [Rank 0] totoal_tokens=7478, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, green v'
[2024-08-03 15:15:52] [Rank 1] totoal_tokens=7027, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:15:52] [Rank 2] totoal_tokens=7236, outputs='```json\n{\n  "questions": [\n    "Who is the owner of Favorite Hunks?",\n    "Who is Olkesandr?",\n    "'
[2024-08-03 15:15:52] [Rank 3] totoal_tokens=7558, outputs='```json\n{\n  "fighters": [\n    {\n      "name": "Oleksandr Usyk",\n      "status": "co'
[2024-08-03 15:15:53] [Rank 0] totoal_tokens=7525, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "A small, round, green vase"},'
[2024-08-03 15:15:53] [Rank 2] totoal_tokens=7254, outputs='{"key_count": 3}'
[2024-08-03 15:15:53] [Rank 1] totoal_tokens=7050, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:15:53] [Rank 2] totoal_tokens=7264, outputs='[1, 1, 1]'
[2024-08-03 15:15:53] [Rank 0] totoal_tokens=7541, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:15:54] [Rank 3] totoal_tokens=7627, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:54] [Rank 1] totoal_tokens=7087, outputs='```json\n{\n  "computer_count": [\n    {\n      "x": 1,\n      "x": 2,\n      "x":'
[2024-08-03 15:15:55] [Rank 2] totoal_tokens=7315, outputs='[2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2'
[2024-08-03 15:15:55] [Rank 0] totoal_tokens=7566, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3",\n    "4",\n    "5",\n    "'
[2024-08-03 15:15:55] [Rank 3] totoal_tokens=7666, outputs='```json\n{\n  "Pokémon Brilliant Diamond": 0,\n  "Pokémon Shining Pearl": 0,'
[2024-08-03 15:15:55] [Rank 1] totoal_tokens=7134, outputs='```json\n{\n  "chest_count": [\n    1,\n    1,\n    1\n  ]\n}\n```'
[2024-08-03 15:15:56] [Rank 3] totoal_tokens=7726, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:15:56] [Rank 2] totoal_tokens=7316, outputs='[3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3'
[2024-08-03 15:15:56] [Rank 0] totoal_tokens=7725, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:15:56] [Rank 3] totoal_tokens=7735, outputs='[1, 1, 1]'
[2024-08-03 15:15:56] [Rank 1] totoal_tokens=7294, outputs='```json\n{\n  "albums": [\n    {\n      "name": "The Beatles",\n      "tracks": [\n        "Let It Be",\n        "'
[2024-08-03 15:15:57] [Rank 0] totoal_tokens=7746, outputs='[1, 1, 1]'
[2024-08-03 15:15:57] [Rank 2] totoal_tokens=7355, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1}'
[2024-08-03 15:15:57] [Rank 3] totoal_tokens=7735, outputs='[1, 1, 1]'
[2024-08-03 15:15:57] [Rank 0] totoal_tokens=7785, outputs='[1, 2, 3]'
[2024-08-03 15:15:58] [Rank 1] totoal_tokens=7522, outputs='```json\n{\n  "vases": [\n    {"count": 1, "location": "Bangkok"},\n    {"count": 2'
[2024-08-03 15:15:58] [Rank 3] totoal_tokens=7775, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:15:58] [Rank 2] totoal_tokens=7520, outputs='```json\n{\n  "Bangkok": 0,\n  "Thailand": 0\n}\n```'
[2024-08-03 15:15:58] [Rank 1] totoal_tokens=7540, outputs='[0, 0, 0]'
[2024-08-03 15:15:59] [Rank 0] totoal_tokens=7868, outputs='```json\n{\n  "data": [\n    {\n      "label": "London",\n      "key": 4\n    },\n    {\n      "'
04,  1.09it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  31%|███       | 238/765 [02:34<07:45,  1.13it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  31%|███       | 239/765 [02:35<07:00,  1.25it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  31%|███▏      | 240/765 [02:36<07:59,  1.09it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  32%|███▏      | 241/765 [02:37<08:43,  1.00it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  32%|███▏      | 242/765 [02:38<08:16,  1.05it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  32%|███▏      | 243/765 [02:39<08:56,  1.03s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  32%|███▏      | 244/765 [02:41<09:43,  1.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  32%|███▏      | 245/765 [02:41<08:38,  1.00it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  32%|███▏      | 246/765 [02:42<07:33,  1.15it/s]
Processing InternVL2-2B_counting-text-tes[2024-08-03 15:15:59] [Rank 3] totoal_tokens=7893, outputs='```json\n{\n  "number_of_bananas": 1\n}\n```'
[2024-08-03 15:15:59] [Rank 2] totoal_tokens=7599, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:15:59] [Rank 1] totoal_tokens=7570, outputs='```json\n{\n  "apple_count": 3\n}\n```'
[2024-08-03 15:15:59] [Rank 3] totoal_tokens=7926, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:15:59] [Rank 0] totoal_tokens=7919, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:15:59] [Rank 2] totoal_tokens=7711, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:16:00] [Rank 1] totoal_tokens=7725, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:01] [Rank 0] totoal_tokens=7932, outputs='```json\n{\n  "vases": [\n    {"count": 3},\n    {"count": 1}\n  ]\n}\n```'
[2024-08-03 15:16:01] [Rank 3] totoal_tokens=7940, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:01] [Rank 2] totoal_tokens=7747, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:01] [Rank 1] totoal_tokens=7734, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:16:01] [Rank 3] totoal_tokens=7943, outputs='[1, 2, 3]'
[2024-08-03 15:16:01] [Rank 0] totoal_tokens=7945, outputs='```json\n{\n  "computer": 0\n}\n```'
[2024-08-03 15:16:02] [Rank 1] totoal_tokens=7755, outputs='[1, 1, 1]'
[2024-08-03 15:16:02] [Rank 3] totoal_tokens=7943, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:16:02] [Rank 2] totoal_tokens=7778, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:16:03] [Rank 0] totoal_tokens=7951, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:16:03] [Rank 3] totoal_tokens=8044, outputs='```json\n{\n  "result": 2\n}\n```'
[2024-08-03 15:16:03] [Rank 2] totoal_tokens=7937, outputs='```json\n{\n  "tree_count": 2\n}\n```'
[2024-08-03 15:16:03] [Rank 1] totoal_tokens=7775, outputs='```json\n{\n  "numbers": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:16:04] [Rank 2] totoal_tokens=7943, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:16:04] [Rank 0] totoal_tokens=7998, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:16:04] [Rank 3] totoal_tokens=8050, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, red and'
[2024-08-03 15:16:04] [Rank 1] totoal_tokens=7785, outputs='```json\n{\n  "compass_count": 1\n}\n```'
[2024-08-03 15:16:05] [Rank 2] totoal_tokens=8043, outputs='```json\n{\n  "computer_count": 2\n}\n```'
[2024-08-03 15:16:05] [Rank 1] totoal_tokens=7908, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:16:05] [Rank 3] totoal_tokens=8053, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:05] [Rank 0] totoal_tokens=8018, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "y": 1},\n    {"x": 1, "y'
[2024-08-03 15:16:06] [Rank 2] totoal_tokens=8066, outputs='```json\n{\n  "compass_count": [\n    {"x": 1, "y": 1},\n    {"x": 1, "'
[2024-08-03 15:16:06] [Rank 1] totoal_tokens=7925, outputs='```json\n{\n  "keys": [1, 2, 3]\n}\n```'
[2024-08-03 15:16:06] [Rank 0] totoal_tokens=8045, outputs='```json\n{\n  "number_of_trees": 0\n}\n```'
[2024-08-03 15:16:06] [Rank 3] totoal_tokens=8292, outputs='```json\n{\n  "vases": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:16:07] [Rank 1] totoal_tokens=7936, outputs='```json\n{\n  "tree_count": 2\n}\n```'
[2024-08-03 15:16:07] [Rank 0] totoal_tokens=8070, outputs='```json\n{\n  "brush_count": 3\n}\n```'
[2024-08-03 15:16:07] [Rank 2] totoal_tokens=8123, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small white vase."'
[2024-08-03 15:16:08] [Rank 1] totoal_tokens=7937, outputs='[0, 0, 0]'
[2024-08-03 15:16:08] [Rank 3] totoal_tokens=8319, outputs='```json\n{\n  "players": [\n    {\n      "name": "Steve Smith",\n      "position": "Batsman",\n      "team":'
[2024-08-03 15:16:08] [Rank 2] totoal_tokens=8279, outputs='```json\n{\n  "compass_count": 1\n}\n```'
[2024-08-03 15:16:08] [Rank 0] totoal_tokens=8310, outputs='```json\n{\n  "trees": 1\n}\n```'
t.jsonl:  32%|███▏      | 247/765 [02:43<08:26,  1.02it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  32%|███▏      | 248/765 [02:44<07:59,  1.08it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  33%|███▎      | 249/765 [02:45<08:41,  1.01s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  33%|███▎      | 250/765 [02:46<08:11,  1.05it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  33%|███▎      | 251/765 [02:47<08:42,  1.02s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  33%|███▎      | 252/765 [02:49<09:53,  1.16s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  33%|███▎      | 253/765 [02:50<10:17,  1.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  33%|███▎      | 254/765 [02:51<09:26,  1.11s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  33%|███▎      | 255/765 [02:52<08:42,  1.02s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  33%|███▎      | 256/765 [02:53<08:[2024-08-03 15:16:08] [Rank 3] totoal_tokens=8360, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:16:09] [Rank 1] totoal_tokens=7947, outputs='```json\n{\n  "number_of_apples": 0\n}\n```'
[2024-08-03 15:16:09] [Rank 2] totoal_tokens=8280, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:16:09] [Rank 0] totoal_tokens=8335, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:09] [Rank 3] totoal_tokens=8397, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:16:10] [Rank 1] totoal_tokens=8030, outputs='```json\n{\n  "Optometrist": 79,\n  "Other Jobs": 0\n}\n```'
[2024-08-03 15:16:10] [Rank 2] totoal_tokens=8293, outputs='```json\n{\n  "vases": [\n    {"x": 1, "x": 2, "x": 3},\n    {"'
[2024-08-03 15:16:10] [Rank 3] totoal_tokens=8410, outputs='```json\n{\n  "number_of_★": 0\n}\n```'
[2024-08-03 15:16:10] [Rank 0] totoal_tokens=8352, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:11] [Rank 2] totoal_tokens=8360, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:16:11] [Rank 1] totoal_tokens=8040, outputs='```json\n{\n  "Optometrist": 79,\n  "Other Jobs": 0\n}\n```'
[2024-08-03 15:16:11] [Rank 3] totoal_tokens=8460, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:16:11] [Rank 1] totoal_tokens=8069, outputs='[1, 1, 1]'
[2024-08-03 15:16:12] [Rank 0] totoal_tokens=8354, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:12] [Rank 2] totoal_tokens=8371, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:12] [Rank 3] totoal_tokens=8489, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:16:13] [Rank 1] totoal_tokens=8077, outputs='```json\n{\n  "Exaktbox 6": 1,\n  "Exaktbox 10": 2\n}\n```'
[2024-08-03 15:16:13] [Rank 0] totoal_tokens=8355, outputs='```json\n{\n  "vases": [\n    {"x": 1, "count": 1},\n    {"x": 2, "'
[2024-08-03 15:16:13] [Rank 3] totoal_tokens=8534, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "count": 1},\n    {"number": 2, "'
[2024-08-03 15:16:14] [Rank 0] totoal_tokens=8397, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:16:14] [Rank 1] totoal_tokens=8114, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:16:14] [Rank 3] totoal_tokens=8725, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:16:14] [Rank 2] totoal_tokens=8390, outputs='```json\n{\n  "number_of_bananas": 0\n}\n```'
[2024-08-03 15:16:15] [Rank 3] totoal_tokens=8765, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:16:15] [Rank 2] totoal_tokens=8432, outputs='```json\n{\n  "vases": 3\n}\n```'
[2024-08-03 15:16:15] [Rank 0] totoal_tokens=8437, outputs='```json\n{\n  "characters": [\n    "Edgar Mitchell",\n    "Neville Longbottom",\n    "Lily Potter",\n    "'
[2024-08-03 15:16:15] [Rank 1] totoal_tokens=8147, outputs='```json\n{\n  "vases": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:16:16] [Rank 0] totoal_tokens=8457, outputs='[0, 0, 0]'
[2024-08-03 15:16:16] [Rank 3] totoal_tokens=8912, outputs='```json\n{\n  "brush_count": 1\n}\n```'
[2024-08-03 15:16:16] [Rank 2] totoal_tokens=8472, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:16] [Rank 1] totoal_tokens=8243, outputs='```json\n{\n  "number_of_owl": 1\n}\n```'
[2024-08-03 15:16:16] [Rank 0] totoal_tokens=8708, outputs='```json\n{\n  "count": 4\n}\n```'
[2024-08-03 15:16:17] [Rank 3] totoal_tokens=8971, outputs='```json\n{\n  "computer_count": 2\n}\n```'
[2024-08-03 15:16:17] [Rank 1] totoal_tokens=8291, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:16:17] [Rank 2] totoal_tokens=8570, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:16:17] [Rank 0] totoal_tokens=8921, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:16:18] [Rank 3] totoal_tokens=8979, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1},'
[2024-08-03 15:16:18] [Rank 0] totoal_tokens=8992, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
15,  1.03it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  34%|███▎      | 257/765 [02:54<08:50,  1.04s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  34%|███▎      | 258/765 [02:55<09:18,  1.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  34%|███▍      | 259/765 [02:56<09:33,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  34%|███▍      | 260/765 [02:58<10:03,  1.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  34%|███▍      | 261/765 [02:58<09:00,  1.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  34%|███▍      | 262/765 [03:00<09:33,  1.14s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  34%|███▍      | 263/765 [03:00<08:14,  1.02it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  35%|███▍      | 264/765 [03:01<07:42,  1.08it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  35%|███▍      | 265/765 [03:02<07:31,  1.11it/s]
Processing InternVL2-2B_counting-text[2024-08-03 15:16:18] [Rank 2] totoal_tokens=8577, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:18] [Rank 1] totoal_tokens=8352, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:19] [Rank 1] totoal_tokens=8370, outputs='[3, 3, 3]'
[2024-08-03 15:16:19] [Rank 3] totoal_tokens=8995, outputs='```json\n{\n  "brushes": 4\n}\n```'
[2024-08-03 15:16:19] [Rank 0] totoal_tokens=8997, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:16:19] [Rank 2] totoal_tokens=8580, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:16:20] [Rank 3] totoal_tokens=9018, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:16:20] [Rank 0] totoal_tokens=9022, outputs='[0, 0, 0]'
[2024-08-03 15:16:20] [Rank 1] totoal_tokens=8467, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:21] [Rank 2] totoal_tokens=8933, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:21] [Rank 0] totoal_tokens=9062, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:16:21] [Rank 3] totoal_tokens=9076, outputs='```json\n{\n  "keys": [\n    "2",\n    "2",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:16:21] [Rank 1] totoal_tokens=8519, outputs='```json\n{\n  "keys": [\n    "9",\n    "19",\n    "1",\n    "3",\n    "5",\n    "'
[2024-08-03 15:16:22] [Rank 2] totoal_tokens=8944, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "count": 1},\n    {"x": 2, "'
[2024-08-03 15:16:22] [Rank 0] totoal_tokens=9166, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:16:22] [Rank 3] totoal_tokens=9082, outputs='```json\n{\n  "number_of_brushes": 1\n}\n```'
[2024-08-03 15:16:22] [Rank 1] totoal_tokens=8729, outputs='```json\n{\n  "keys": 4\n}\n```'
[2024-08-03 15:16:23] [Rank 2] totoal_tokens=8954, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:16:23] [Rank 0] totoal_tokens=9191, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:23] [Rank 3] totoal_tokens=9194, outputs='```json\n{\n  "apple_count": 3\n}\n```'
[2024-08-03 15:16:24] [Rank 1] totoal_tokens=8818, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:24] [Rank 2] totoal_tokens=8971, outputs='```json\n{\n  "trees": [\n    {"x": 0, "count": 0},\n    {"x": 1, "'
[2024-08-03 15:16:24] [Rank 0] totoal_tokens=9236, outputs='```json\n{\n  "brush_count": 2\n}\n```'
[2024-08-03 15:16:24] [Rank 3] totoal_tokens=9258, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:16:24] [Rank 2] totoal_tokens=8989, outputs='{"x": 3}'
[2024-08-03 15:16:24] [Rank 1] totoal_tokens=8854, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:16:25] [Rank 0] totoal_tokens=9326, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:25] [Rank 3] totoal_tokens=9279, outputs='```json\n{\n  "vases": [\n    {"number": 1, "count": 1},\n    {"number": 2, "'
[2024-08-03 15:16:26] [Rank 2] totoal_tokens=8998, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:26] [Rank 1] totoal_tokens=8888, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A blue vase"\n    },'
[2024-08-03 15:16:26] [Rank 2] totoal_tokens=9056, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:16:27] [Rank 3] totoal_tokens=9316, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:16:27] [Rank 0] totoal_tokens=9342, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:27] [Rank 1] totoal_tokens=8914, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:16:28] [Rank 0] totoal_tokens=9394, outputs='```json\n{\n  "count": 1\n}\n```'
-test.jsonl:  35%|███▍      | 266/765 [03:03<07:31,  1.11it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  35%|███▍      | 267/765 [03:04<07:37,  1.09it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  35%|███▌      | 268/765 [03:05<07:08,  1.16it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  35%|███▌      | 269/765 [03:05<07:08,  1.16it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  35%|███▌      | 270/765 [03:07<07:46,  1.06it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  35%|███▌      | 271/765 [03:08<08:48,  1.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  36%|███▌      | 272/765 [03:09<08:14,  1.00s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  36%|███▌      | 273/765 [03:10<09:11,  1.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  36%|███▌      | 274/765 [03:12<09:43,  1.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  36%|███▌      | 275/765 [03:12[2024-08-03 15:16:28] [Rank 3] totoal_tokens=9450, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:16:28] [Rank 2] totoal_tokens=9167, outputs='```json\n{\n  "artist": "Muddy Waters",\n  "title": "A Street In Bronzeville",\n  "year": "1945'
[2024-08-03 15:16:28] [Rank 1] totoal_tokens=8934, outputs='```json\n{\n  "keys": [\n    {"x": 1, "y": 1},\n    {"x": 1, "y'
[2024-08-03 15:16:29] [Rank 0] totoal_tokens=9395, outputs='```json\n{\n  "number_of_vases": 3\n}\n```'
[2024-08-03 15:16:29] [Rank 3] totoal_tokens=9483, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:16:29] [Rank 2] totoal_tokens=9172, outputs='```json\n{\n  "vases": [\n    {"count": 1, "vase": "vase1"},\n    {"count":'
[2024-08-03 15:16:29] [Rank 1] totoal_tokens=9018, outputs='```json\n{\n  "compasses": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:16:30] [Rank 0] totoal_tokens=9456, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:30] [Rank 3] totoal_tokens=9512, outputs='```json\n{\n  "numbers": [\n    2,\n    2,\n    2,\n    2,\n    2,\n    2,\n    2,'
[2024-08-03 15:16:30] [Rank 1] totoal_tokens=9041, outputs='[0, 0, 0]'
[2024-08-03 15:16:31] [Rank 2] totoal_tokens=9215, outputs='```json\n{\n  "key_count": 0\n}\n```'
[2024-08-03 15:16:31] [Rank 1] totoal_tokens=9189, outputs='[1, 1, 1]'
[2024-08-03 15:16:31] [Rank 0] totoal_tokens=9456, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:31] [Rank 3] totoal_tokens=9515, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:32] [Rank 2] totoal_tokens=9238, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1},'
[2024-08-03 15:16:32] [Rank 1] totoal_tokens=9218, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:16:32] [Rank 0] totoal_tokens=9467, outputs='```json\n{\n  "Smart Watches": [\n    {\n      "Name": "Nike+ Fuelband",\n      "Description": "It tracked'
[2024-08-03 15:16:33] [Rank 3] totoal_tokens=9559, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:33] [Rank 2] totoal_tokens=9280, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:16:33] [Rank 3] totoal_tokens=9645, outputs='```json\n{\n  "key_count": 4\n}\n```'
[2024-08-03 15:16:33] [Rank 1] totoal_tokens=9244, outputs='```json\n{\n  "compass_count": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:16:34] [Rank 0] totoal_tokens=9489, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:34] [Rank 2] totoal_tokens=9280, outputs='```json\n{\n  "activity_suggestions": [\n    "explore Tokyo",\n    "visit your neighborhood sento",\n    "spend the night'
[2024-08-03 15:16:34] [Rank 1] totoal_tokens=9287, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:16:34] [Rank 3] totoal_tokens=9745, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:16:35] [Rank 0] totoal_tokens=9500, outputs='[9, 9, 9]'
[2024-08-03 15:16:35] [Rank 2] totoal_tokens=9322, outputs='```json\n{\n  "trees": 0\n}\n```'
[2024-08-03 15:16:35] [Rank 3] totoal_tokens=9862, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:16:35] [Rank 0] totoal_tokens=9540, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:16:36] [Rank 1] totoal_tokens=9533, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:36] [Rank 2] totoal_tokens=9342, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:36] [Rank 0] totoal_tokens=9641, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:16:37] [Rank 1] totoal_tokens=9615, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:16:37] [Rank 3] totoal_tokens=9994, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:16:37] [Rank 0] totoal_tokens=9683, outputs='```json\n{\n  "number_of_apples": 1\n}\n```'
[2024-08-03 15:16:37] [Rank 2] totoal_tokens=9362, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:38] [Rank 3] totoal_tokens=10026, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:16:38] [Rank 0] totoal_tokens=9899, outputs='[1, 2, 3, 4, 5]'
<08:50,  1.08s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  36%|███▌      | 276/765 [03:13<08:23,  1.03s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  36%|███▌      | 277/765 [03:14<08:52,  1.09s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  36%|███▋      | 278/765 [03:16<09:14,  1.14s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  36%|███▋      | 279/765 [03:17<09:37,  1.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  37%|███▋      | 280/765 [03:18<09:47,  1.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  37%|███▋      | 281/765 [03:19<09:06,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  37%|███▋      | 282/765 [03:20<08:36,  1.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  37%|███▋      | 283/765 [03:21<08:07,  1.01s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  37%|███▋      | 284/765 [03:22<07:54,  1.01it/s]
Processing InternVL2-2B_counting-[2024-08-03 15:16:38] [Rank 1] totoal_tokens=9616, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:38] [Rank 2] totoal_tokens=9528, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:16:38] [Rank 3] totoal_tokens=10183, outputs='[2, 2, 2]'
[2024-08-03 15:16:39] [Rank 0] totoal_tokens=9907, outputs='[1, 2, 3]'
[2024-08-03 15:16:39] [Rank 2] totoal_tokens=9629, outputs='```json\n{\n  "brush_count": 0\n}\n```'
[2024-08-03 15:16:39] [Rank 3] totoal_tokens=10185, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:16:40] [Rank 1] totoal_tokens=9618, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:40] [Rank 0] totoal_tokens=10035, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:16:40] [Rank 2] totoal_tokens=9734, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:16:41] [Rank 1] totoal_tokens=9623, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:16:41] [Rank 3] totoal_tokens=10185, outputs='```json\n{\n  "vases": [\n    "2",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:16:41] [Rank 0] totoal_tokens=10104, outputs='[0, 0, 0]'
[2024-08-03 15:16:41] [Rank 2] totoal_tokens=9911, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:16:41] [Rank 1] totoal_tokens=9663, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:16:42] [Rank 2] totoal_tokens=10034, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:16:42] [Rank 3] totoal_tokens=10196, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:42] [Rank 0] totoal_tokens=10117, outputs='[4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4'
[2024-08-03 15:16:42] [Rank 1] totoal_tokens=9664, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:16:43] [Rank 2] totoal_tokens=10046, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:16:43] [Rank 3] totoal_tokens=10216, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:16:43] [Rank 0] totoal_tokens=10139, outputs='```json\n{\n  "keys": 3\n}\n```'
[2024-08-03 15:16:43] [Rank 2] totoal_tokens=10047, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:16:44] [Rank 3] totoal_tokens=10229, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:16:44] [Rank 1] totoal_tokens=9714, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:44] [Rank 0] totoal_tokens=10193, outputs='```json\n{\n  "cities": [\n    "Oslo",\n    "Bodo",\n    "Stavanger",\n    "Trondheim",'
[2024-08-03 15:16:45] [Rank 2] totoal_tokens=10067, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:16:45] [Rank 3] totoal_tokens=10258, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:16:45] [Rank 1] totoal_tokens=10046, outputs='```json\n{\n  "number_of_brushes": 2\n}\n```'
[2024-08-03 15:16:45] [Rank 2] totoal_tokens=10084, outputs='[1, 1, 1]'
[2024-08-03 15:16:46] [Rank 0] totoal_tokens=10207, outputs='```json\n{\n  "keys": [\n    "2",\n    "2",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:16:46] [Rank 3] totoal_tokens=10319, outputs='[1, 1, 1]'
[2024-08-03 15:16:46] [Rank 2] totoal_tokens=10184, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:16:46] [Rank 3] totoal_tokens=10320, outputs='[1, 1, 1]'
[2024-08-03 15:16:47] [Rank 1] totoal_tokens=10055, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:47] [Rank 0] totoal_tokens=10232, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the island where Spiaggia della Pelosa is'
[2024-08-03 15:16:47] [Rank 3] totoal_tokens=10325, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:16:48] [Rank 1] totoal_tokens=10063, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:16:48] [Rank 2] totoal_tokens=10199, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:48] [Rank 3] totoal_tokens=10406, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:16:48] [Rank 0] totoal_tokens=10251, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
text-test.jsonl:  37%|███▋      | 285/765 [03:23<07:32,  1.06it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  37%|███▋      | 286/765 [03:23<06:52,  1.16it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  38%|███▊      | 287/765 [03:24<07:01,  1.13it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  38%|███▊      | 288/765 [03:25<07:26,  1.07it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  38%|███▊      | 289/765 [03:27<08:26,  1.06s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  38%|███▊      | 290/765 [03:28<08:02,  1.01s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  38%|███▊      | 291/765 [03:29<08:41,  1.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  38%|███▊      | 292/765 [03:30<09:02,  1.15s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  38%|███▊      | 293/765 [03:32<09:50,  1.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  38%|███▊      | 294/765 [0[2024-08-03 15:16:49] [Rank 1] totoal_tokens=10101, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, golden v'
[2024-08-03 15:16:49] [Rank 2] totoal_tokens=10307, outputs='```json\n{\n  "vases": [\n    "2",\n    "2",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:16:50] [Rank 3] totoal_tokens=10416, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:16:50] [Rank 0] totoal_tokens=10288, outputs='```json\n{\n  "numbers": [\n    {"computer": 1},\n    {"computer": 2},\n    {"computer": 3},'
[2024-08-03 15:16:50] [Rank 2] totoal_tokens=10325, outputs='```json\n{\n  "results": [\n    {\n      "key": 1,\n      "description": "Smart lyrics, a real passion and strength'
[2024-08-03 15:16:51] [Rank 1] totoal_tokens=10104, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:51] [Rank 3] totoal_tokens=10436, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:16:51] [Rank 0] totoal_tokens=10300, outputs='```json\n{\n  "compasses": [\n    {"x": 1, "x": 2, "x": 3},\n    {"'
[2024-08-03 15:16:52] [Rank 2] totoal_tokens=10340, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:52] [Rank 1] totoal_tokens=10183, outputs='```json\n{\n  "cities": [\n    "Oslo",\n    "Bodo",\n    "Stavanger",\n    "Trondheim",'
[2024-08-03 15:16:52] [Rank 0] totoal_tokens=10377, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:16:52] [Rank 3] totoal_tokens=10440, outputs='```json\n{\n  "x": 1,\n  "x": 2,\n  "x": 3\n}\n```'
[2024-08-03 15:16:53] [Rank 1] totoal_tokens=10207, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:16:53] [Rank 2] totoal_tokens=10343, outputs='```json\n{\n  "lighthouse_count": [\n    "3",\n    "2",\n    "1"\n  ]\n}\n```'
[2024-08-03 15:16:53] [Rank 0] totoal_tokens=10398, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:53] [Rank 3] totoal_tokens=10440, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:16:54] [Rank 1] totoal_tokens=10229, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:16:54] [Rank 2] totoal_tokens=10398, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:55] [Rank 3] totoal_tokens=10482, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:16:55] [Rank 0] totoal_tokens=10554, outputs='```json\n{\n  "keys": [\n    "MLB 060",\n    "Control",\n    "Sem",\n    "Control",\n    "Sem'
[2024-08-03 15:16:55] [Rank 1] totoal_tokens=10324, outputs='```json\n{\n  "trees": [\n    {"x": 1, "count": 1},\n    {"x": 2, "'
[2024-08-03 15:16:55] [Rank 3] totoal_tokens=10543, outputs='{"x": 4}'
[2024-08-03 15:16:55] [Rank 2] totoal_tokens=10417, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:16:55] [Rank 0] totoal_tokens=10573, outputs='[1, 1, 1]'
[2024-08-03 15:16:56] [Rank 1] totoal_tokens=10371, outputs='```json\n{\n  "apple_count": 5\n}\n```'
[2024-08-03 15:16:56] [Rank 3] totoal_tokens=10615, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:16:56] [Rank 0] totoal_tokens=10639, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:16:57] [Rank 2] totoal_tokens=10455, outputs='```json\n{\n  "birds": [\n    "white-winged duck",\n    "Storm\'s stork",\n    "white-bellied bust'
[2024-08-03 15:16:57] [Rank 1] totoal_tokens=10417, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:16:57] [Rank 3] totoal_tokens=10638, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:16:57] [Rank 0] totoal_tokens=10894, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:16:58] [Rank 2] totoal_tokens=10561, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:16:58] [Rank 3] totoal_tokens=10638, outputs='```json\n{\n  "bananas": 20\n}\n```'
[2024-08-03 15:16:58] [Rank 1] totoal_tokens=10456, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:16:58] [Rank 0] totoal_tokens=11021, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:16:59] [Rank 2] totoal_tokens=10629, outputs='```json\n{\n  "number_of_★": 2\n}\n```'
[2024-08-03 15:16:59] [Rank 3] totoal_tokens=10740, outputs='```json\n{\n  "lighthouse_count": 95\n}\n```'
[2024-08-03 15:16:59] [Rank 0] totoal_tokens=11047, outputs='```json\n{\n  "number_of_trees": 2\n}\n```'
3:33<10:11,  1.30s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  39%|███▊      | 295/765 [03:34<10:08,  1.30s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  39%|███▊      | 296/765 [03:36<10:03,  1.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  39%|███▉      | 297/765 [03:37<09:04,  1.16s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  39%|███▉      | 298/765 [03:38<09:24,  1.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  39%|███▉      | 299/765 [03:39<09:40,  1.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  39%|███▉      | 300/765 [03:40<08:40,  1.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  39%|███▉      | 301/765 [03:41<08:24,  1.09s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  39%|███▉      | 302/765 [03:42<08:00,  1.04s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  40%|███▉      | 303/765 [03:43<08:02,  1.05s/it]
Processing InternVL2-2B_count[2024-08-03 15:17:00] [Rank 1] totoal_tokens=10470, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:00] [Rank 3] totoal_tokens=10838, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:17:00] [Rank 2] totoal_tokens=10735, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "count": 1},\n    {"x": 2, "'
[2024-08-03 15:17:01] [Rank 1] totoal_tokens=10567, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:17:01] [Rank 0] totoal_tokens=11104, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:01] [Rank 3] totoal_tokens=10876, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:17:01] [Rank 2] totoal_tokens=10741, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:17:02] [Rank 0] totoal_tokens=11148, outputs='[1, 1, 1]'
[2024-08-03 15:17:02] [Rank 1] totoal_tokens=10657, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:17:02] [Rank 3] totoal_tokens=11013, outputs='```json\n{\n  "chest_count": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:17:02] [Rank 2] totoal_tokens=10767, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:17:02] [Rank 0] totoal_tokens=11164, outputs='```json\n{\n  "bananas": 2\n}\n```'
[2024-08-03 15:17:03] [Rank 1] totoal_tokens=10745, outputs='```json\n{\n  "count": 5\n}\n```'
[2024-08-03 15:17:03] [Rank 2] totoal_tokens=10778, outputs='```json\n{\n  "chest_count": 4\n}\n```'
[2024-08-03 15:17:04] [Rank 3] totoal_tokens=11037, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:17:04] [Rank 0] totoal_tokens=11182, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1}'
[2024-08-03 15:17:04] [Rank 1] totoal_tokens=10843, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:04] [Rank 2] totoal_tokens=10779, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:17:05] [Rank 3] totoal_tokens=11078, outputs='```json\n{\n  "result": 2\n}\n```'
[2024-08-03 15:17:05] [Rank 1] totoal_tokens=10891, outputs='```json\n{\n  "brush_count": 1\n}\n```'
[2024-08-03 15:17:05] [Rank 0] totoal_tokens=11209, outputs='```json\n{\n  "stream": "Stream in Southbury, US"\n}\n```'
[2024-08-03 15:17:05] [Rank 2] totoal_tokens=10985, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:17:06] [Rank 1] totoal_tokens=10957, outputs='```json\n{\n  "★": 3\n}\n```'
[2024-08-03 15:17:06] [Rank 3] totoal_tokens=11130, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:06] [Rank 0] totoal_tokens=11250, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "computer_count": 1},\n    {"number": 2, "'
[2024-08-03 15:17:06] [Rank 2] totoal_tokens=11021, outputs='```json\n{\n  "keys": [\n    {"number": 1, "value": 1},\n    {"number": 2, "value'
[2024-08-03 15:17:07] [Rank 3] totoal_tokens=11145, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:17:07] [Rank 1] totoal_tokens=11040, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:07] [Rank 2] totoal_tokens=11047, outputs='```json\n{\n  "number_of_★": 1\n}\n```'
[2024-08-03 15:17:08] [Rank 3] totoal_tokens=11188, outputs='```json\n{\n  "result": 1\n}\n```'
[2024-08-03 15:17:08] [Rank 0] totoal_tokens=11264, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:08] [Rank 1] totoal_tokens=11089, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:17:09] [Rank 2] totoal_tokens=11101, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:09] [Rank 3] totoal_tokens=11209, outputs='```json\n{\n  "result": 3\n}\n```'
[2024-08-03 15:17:09] [Rank 0] totoal_tokens=11279, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:17:09] [Rank 1] totoal_tokens=11100, outputs='[1, 1, 1]'
[2024-08-03 15:17:10] [Rank 0] totoal_tokens=11300, outputs='[0, 0, 0]'
ing-text-test.jsonl:  40%|███▉      | 304/765 [03:44<08:03,  1.05s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  40%|███▉      | 305/765 [03:45<08:41,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  40%|████      | 306/765 [03:46<07:56,  1.04s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  40%|████      | 307/765 [03:47<07:35,  1.01it/s]
Processing InternVL2-2B_counting-text-test.jsonl:  40%|████      | 308/765 [03:49<08:24,  1.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  40%|████      | 309/765 [03:50<08:29,  1.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  41%|████      | 310/765 [03:51<08:54,  1.17s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  41%|████      | 311/765 [03:53<09:51,  1.30s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  41%|████      | 312/765 [03:54<09:04,  1.20s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  41%|████      | 313/76[2024-08-03 15:17:10] [Rank 2] totoal_tokens=11199, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:17:10] [Rank 1] totoal_tokens=11137, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:17:10] [Rank 3] totoal_tokens=11211, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:11] [Rank 2] totoal_tokens=11210, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:17:11] [Rank 0] totoal_tokens=11331, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:17:11] [Rank 1] totoal_tokens=11189, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:17:11] [Rank 3] totoal_tokens=11274, outputs='```json\n{\n  "key": "Bakhmut"\n}\n```'
[2024-08-03 15:17:11] [Rank 2] totoal_tokens=11218, outputs='[1, 1, 1]'
[2024-08-03 15:17:12] [Rank 1] totoal_tokens=11192, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:17:12] [Rank 0] totoal_tokens=11444, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, red v'
[2024-08-03 15:17:12] [Rank 2] totoal_tokens=11225, outputs='```json\n{\n  "number_of_apples": 2\n}\n```'
[2024-08-03 15:17:12] [Rank 3] totoal_tokens=11331, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:17:13] [Rank 1] totoal_tokens=11208, outputs='```json\n{\n  "number_of_★": 10\n}\n```'
[2024-08-03 15:17:13] [Rank 0] totoal_tokens=11447, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:17:13] [Rank 2] totoal_tokens=11253, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:17:14] [Rank 1] totoal_tokens=11236, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:17:14] [Rank 3] totoal_tokens=11333, outputs='```json\n{\n  "title": "The Americanization Of Shadrach Cohen",\n  "author": "Bruno Lessing",\n  "'
[2024-08-03 15:17:14] [Rank 2] totoal_tokens=11260, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:17:14] [Rank 0] totoal_tokens=11450, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:17:15] [Rank 3] totoal_tokens=11352, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:17:15] [Rank 1] totoal_tokens=11331, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A penguin holding a brush."'
[2024-08-03 15:17:15] [Rank 0] totoal_tokens=11646, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:17:16] [Rank 2] totoal_tokens=11300, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:16] [Rank 0] totoal_tokens=11696, outputs='```json\n{\n  "result": 4\n}\n```'
[2024-08-03 15:17:16] [Rank 3] totoal_tokens=11427, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:16] [Rank 1] totoal_tokens=11437, outputs='```json\n{\n  "keys": [\n    "3",\n    "3",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:17:17] [Rank 2] totoal_tokens=11301, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:17:17] [Rank 0] totoal_tokens=11862, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:17:17] [Rank 2] totoal_tokens=11323, outputs='[0, 0, 0]'
[2024-08-03 15:17:17] [Rank 1] totoal_tokens=11439, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:17:18] [Rank 3] totoal_tokens=11530, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:17:18] [Rank 2] totoal_tokens=11331, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:17:19] [Rank 3] totoal_tokens=11533, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:17:19] [Rank 1] totoal_tokens=11441, outputs='```json\n{\n  "vases": [\n    "2",\n    "2",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:17:19] [Rank 0] totoal_tokens=11902, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:19] [Rank 2] totoal_tokens=11337, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:17:20] [Rank 3] totoal_tokens=11614, outputs='```json\n{\n  "assault_rifles": 1,\n  "assault_pistols": 1,\n  "assault":'
[2024-08-03 15:17:20] [Rank 0] totoal_tokens=12052, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:17:20] [Rank 1] totoal_tokens=11556, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:17:20] [Rank 2] totoal_tokens=11342, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:17:21] [Rank 3] totoal_tokens=11646, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:17:21] [Rank 0] totoal_tokens=12073, outputs='```json\n{\n  "number_of_bananas": 4\n}\n```'
5 [03:54<08:13,  1.09s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  41%|████      | 314/765 [03:55<08:07,  1.08s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  41%|████      | 315/765 [03:57<08:46,  1.17s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  41%|████▏     | 316/765 [03:58<08:28,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  41%|████▏     | 317/765 [03:59<08:25,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  42%|████▏     | 318/765 [04:00<08:16,  1.11s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  42%|████▏     | 319/765 [04:01<07:54,  1.06s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  42%|████▏     | 320/765 [04:02<07:49,  1.06s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  42%|████▏     | 321/765 [04:04<08:47,  1.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  42%|████▏     | 322/765 [04:05<08:43,  1.18s/it]
Processing [2024-08-03 15:17:21] [Rank 2] totoal_tokens=11417, outputs='[3, 3, 3]'
[2024-08-03 15:17:22] [Rank 1] totoal_tokens=11622, outputs='[2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2'
[2024-08-03 15:17:22] [Rank 3] totoal_tokens=11712, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:17:22] [Rank 2] totoal_tokens=11455, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:17:23] [Rank 0] totoal_tokens=12081, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:23] [Rank 3] totoal_tokens=11947, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:17:23] [Rank 1] totoal_tokens=11626, outputs='```json\n{\n  "x": 0,\n  "x": 0,\n  "x": 0\n}\n```'
[2024-08-03 15:17:23] [Rank 2] totoal_tokens=11585, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:17:24] [Rank 0] totoal_tokens=12115, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:17:24] [Rank 1] totoal_tokens=11659, outputs='```json\n{\n  "number_of_trees": 4\n}\n```'
[2024-08-03 15:17:25] [Rank 2] totoal_tokens=11598, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:25] [Rank 3] totoal_tokens=11982, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:17:25] [Rank 1] totoal_tokens=11717, outputs='```json\n{\n  "vases": 2\n}\n```'
[2024-08-03 15:17:25] [Rank 0] totoal_tokens=12139, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:26] [Rank 2] totoal_tokens=11641, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:17:26] [Rank 1] totoal_tokens=11824, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:17:27] [Rank 0] totoal_tokens=12228, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "count": 1},\n    {"number": 2, "count'
[2024-08-03 15:17:27] [Rank 3] totoal_tokens=12000, outputs='[3, 3, 3]'
[2024-08-03 15:17:27] [Rank 2] totoal_tokens=12064, outputs='[1, 2, 3]'
[2024-08-03 15:17:28] [Rank 1] totoal_tokens=11872, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "key": "1"},\n    {"number": 2, "key'
[2024-08-03 15:17:28] [Rank 0] totoal_tokens=12228, outputs='[3, 4, 5]'
[2024-08-03 15:17:28] [Rank 2] totoal_tokens=12115, outputs='```json\n{\n  "keys": [\n    {"number": 1, "description": "The little penguin counted 1 key."},'
[2024-08-03 15:17:28] [Rank 3] totoal_tokens=12127, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:29] [Rank 0] totoal_tokens=12234, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:17:29] [Rank 1] totoal_tokens=11876, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:29] [Rank 2] totoal_tokens=12129, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:17:30] [Rank 3] totoal_tokens=12139, outputs='[3, 3, 3, 3, 3, 3]'
[2024-08-03 15:17:30] [Rank 1] totoal_tokens=11971, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:17:30] [Rank 0] totoal_tokens=12261, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:31] [Rank 1] totoal_tokens=12064, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:17:31] [Rank 3] totoal_tokens=12222, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:31] [Rank 0] totoal_tokens=12262, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:32] [Rank 2] totoal_tokens=12170, outputs='{"name": "Krishna Raj Bungalow", "description": "The bungalow will be named after Ranbir Kapoor\'s grandparents,'
[2024-08-03 15:17:32] [Rank 1] totoal_tokens=12086, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:17:33] [Rank 3] totoal_tokens=12233, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:33] [Rank 0] totoal_tokens=12289, outputs='```json\n{\n  "trees": [\n    [0, 0, 0],\n    [0, 0, 0],'
InternVL2-2B_counting-text-test.jsonl:  42%|████▏     | 323/765 [04:06<08:59,  1.22s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  42%|████▏     | 324/765 [04:07<09:15,  1.26s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  42%|████▏     | 325/765 [04:08<08:42,  1.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  43%|████▎     | 326/765 [04:10<09:44,  1.33s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  43%|████▎     | 327/765 [04:12<09:55,  1.36s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  43%|████▎     | 328/765 [04:12<08:45,  1.20s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  43%|████▎     | 329/765 [04:13<08:23,  1.16s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  43%|████▎     | 330/765 [04:15<08:52,  1.22s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  43%|████▎     | 331/765 [04:16<09:18,  1.29s/it]
Processing InternVL2-2B_counting-text-test.js[2024-08-03 15:17:33] [Rank 2] totoal_tokens=12178, outputs='```json\n{\n  "title": "The Outsider 2",\n  "release_date": "March 9, 2018",'
[2024-08-03 15:17:34] [Rank 1] totoal_tokens=12105, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "color": "white"},\n    {"number": 2, "'
[2024-08-03 15:17:34] [Rank 0] totoal_tokens=12346, outputs='```json\n{\n  "apple_count": 3\n}\n```'
[2024-08-03 15:17:34] [Rank 3] totoal_tokens=12343, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:17:34] [Rank 2] totoal_tokens=12256, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, white v'
[2024-08-03 15:17:35] [Rank 3] totoal_tokens=12372, outputs='```json\n{\n  "result": 5\n}\n```'
[2024-08-03 15:17:35] [Rank 1] totoal_tokens=12112, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:35] [Rank 0] totoal_tokens=12358, outputs='```json\n{\n  "brushes": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:17:36] [Rank 2] totoal_tokens=12397, outputs='```json\n{\n  "lighthouse_count": 1,\n  "lighthouse_count_2": 2,\n  "lighthouse_count_3'
[2024-08-03 15:17:36] [Rank 3] totoal_tokens=12375, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:17:37] [Rank 1] totoal_tokens=12128, outputs='```json\n{\n  "key": 1,\n  "key": 2,\n  "key": 3\n}\n```'
[2024-08-03 15:17:37] [Rank 0] totoal_tokens=12369, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:17:37] [Rank 2] totoal_tokens=12419, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:37] [Rank 3] totoal_tokens=12418, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:37] [Rank 1] totoal_tokens=12133, outputs='[0, 0, 0]'
[2024-08-03 15:17:38] [Rank 0] totoal_tokens=12401, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:17:38] [Rank 2] totoal_tokens=12571, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:17:38] [Rank 3] totoal_tokens=12690, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:17:39] [Rank 1] totoal_tokens=12141, outputs='[3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3'
[2024-08-03 15:17:39] [Rank 0] totoal_tokens=12414, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:17:39] [Rank 2] totoal_tokens=12583, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:17:39] [Rank 3] totoal_tokens=12692, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:17:40] [Rank 2] totoal_tokens=12644, outputs='[1, 1, 1]'
[2024-08-03 15:17:40] [Rank 0] totoal_tokens=12449, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:17:40] [Rank 3] totoal_tokens=12816, outputs='[0, 0, 0]'
[2024-08-03 15:17:41] [Rank 1] totoal_tokens=12146, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3}'
[2024-08-03 15:17:41] [Rank 0] totoal_tokens=12557, outputs='```json\n{\n  "trees": 2\n}\n```'
[2024-08-03 15:17:41] [Rank 3] totoal_tokens=12989, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:17:42] [Rank 2] totoal_tokens=12655, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:42] [Rank 1] totoal_tokens=12154, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:17:43] [Rank 0] totoal_tokens=12565, outputs='```json\n{\n  "brush_count": 3\n}\n```'
[2024-08-03 15:17:43] [Rank 3] totoal_tokens=13001, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:17:43] [Rank 2] totoal_tokens=12684, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:43] [Rank 1] totoal_tokens=12234, outputs='```json\n{\n  "number_of_moroccan_women_in_agg_occupations": 1756\n}\n```'
[2024-08-03 15:17:44] [Rank 0] totoal_tokens=12571, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
onl:  43%|████▎     | 332/765 [04:18<09:38,  1.34s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  44%|████▎     | 333/765 [04:19<08:55,  1.24s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  44%|████▎     | 334/765 [04:20<09:31,  1.33s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  44%|████▍     | 335/765 [04:22<09:29,  1.32s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  44%|████▍     | 336/765 [04:23<09:35,  1.34s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  44%|████▍     | 337/765 [04:24<08:53,  1.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  44%|████▍     | 338/765 [04:25<08:30,  1.20s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  44%|████▍     | 339/765 [04:26<08:25,  1.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  44%|████▍     | 340/765 [04:27<08:15,  1.16s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  45%|████▍     | 34[2024-08-03 15:17:44] [Rank 3] totoal_tokens=13016, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:44] [Rank 2] totoal_tokens=12702, outputs='```json\n{\n  "vases": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:17:45] [Rank 1] totoal_tokens=12351, outputs='```json\n{\n  "SPBS_stations": 84,\n  "M4_stations": 84,\n  "SPBS_trips":'
[2024-08-03 15:17:45] [Rank 0] totoal_tokens=12755, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:45] [Rank 2] totoal_tokens=12702, outputs='```json\n{\n  "result": 3\n}\n```'
[2024-08-03 15:17:46] [Rank 3] totoal_tokens=13045, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:17:46] [Rank 1] totoal_tokens=12355, outputs='{"x": 2, "x": 2, "x": 2}'
[2024-08-03 15:17:46] [Rank 0] totoal_tokens=12766, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:17:46] [Rank 2] totoal_tokens=12713, outputs='```json\n{\n  "brushes": 2\n}\n```'
[2024-08-03 15:17:47] [Rank 1] totoal_tokens=12645, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:17:47] [Rank 0] totoal_tokens=12769, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:17:47] [Rank 3] totoal_tokens=13057, outputs='```json\n{\n  "top_ten": [\n    {\n      "title": "Ford v Ferrari",\n      "year": "2019",'
[2024-08-03 15:17:48] [Rank 2] totoal_tokens=12887, outputs='```json\n{\n  "trees": [\n    4,\n    4,\n    4,\n    4,\n    4,\n    4,\n    4,'
[2024-08-03 15:17:48] [Rank 1] totoal_tokens=12663, outputs='```json\n{\n  "computer_count": 4\n}\n```'
[2024-08-03 15:17:48] [Rank 0] totoal_tokens=12773, outputs='```json\n{\n  "brush_count": 3\n}\n```'
[2024-08-03 15:17:48] [Rank 3] totoal_tokens=13150, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:17:49] [Rank 0] totoal_tokens=12812, outputs='```json\n{\n  "result": 5\n}\n```'
[2024-08-03 15:17:49] [Rank 1] totoal_tokens=12813, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:17:50] [Rank 2] totoal_tokens=12917, outputs='```json\n{\n  "brushes": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:17:50] [Rank 3] totoal_tokens=13164, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:51] [Rank 1] totoal_tokens=12952, outputs='```json\n{\n  "count": 0\n}\n```'
[2024-08-03 15:17:51] [Rank 0] totoal_tokens=12831, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:51] [Rank 2] totoal_tokens=13100, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:51] [Rank 3] totoal_tokens=13257, outputs='```json\n{\n  "brushes": [\n    {\n      "x": 1,\n      "x": 1,\n      "x":'
[2024-08-03 15:17:52] [Rank 1] totoal_tokens=13038, outputs='```json\n{\n  "numbers": [\n    [1, 2, 3],\n    [4, 5, 6],\n    ['
[2024-08-03 15:17:52] [Rank 0] totoal_tokens=12855, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:17:52] [Rank 2] totoal_tokens=13107, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:17:53] [Rank 3] totoal_tokens=13295, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:17:53] [Rank 2] totoal_tokens=13135, outputs='[2, 2, 2]'
[2024-08-03 15:17:53] [Rank 0] totoal_tokens=13045, outputs='```json\n{\n  "brushes": 2\n}\n```'
[2024-08-03 15:17:54] [Rank 1] totoal_tokens=13066, outputs='```json\n{\n  "keys": [\n    "Fire",\n    "Nature",\n    "Lobby",\n    "Content"\n  ]\n}\n``'
[2024-08-03 15:17:54] [Rank 3] totoal_tokens=13334, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:17:54] [Rank 2] totoal_tokens=13244, outputs='[0, 0, 0]'
[2024-08-03 15:17:54] [Rank 0] totoal_tokens=13113, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:17:55] [Rank 3] totoal_tokens=13387, outputs='[3, 3, 3]'
[2024-08-03 15:17:55] [Rank 1] totoal_tokens=13122, outputs='```json\n{\n  "trees": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:17:56] [Rank 2] totoal_tokens=13316, outputs='```json\n{\n  "vases": [\n    {"x": 1, "y": 1},\n    {"x": 1, "'
[2024-08-03 15:17:56] [Rank 3] totoal_tokens=13419, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:17:56] [Rank 0] totoal_tokens=13188, outputs='```json\n{\n  "chest_count": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
1/765 [04:28<07:57,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  45%|████▍     | 342/765 [04:30<08:34,  1.22s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  45%|████▍     | 343/765 [04:31<08:16,  1.18s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  45%|████▍     | 344/765 [04:32<07:57,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  45%|████▌     | 345/765 [04:33<07:54,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  45%|████▌     | 346/765 [04:34<07:39,  1.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  45%|████▌     | 347/765 [04:36<09:15,  1.33s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  45%|████▌     | 348/765 [04:37<08:41,  1.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  46%|████▌     | 349/765 [04:38<08:23,  1.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  46%|████▌     | 350/765 [04:39<08:05,  1.17s/it]
Pro[2024-08-03 15:17:56] [Rank 1] totoal_tokens=13285, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:17:57] [Rank 0] totoal_tokens=13345, outputs='[0, 0, 0]'
[2024-08-03 15:17:57] [Rank 2] totoal_tokens=13366, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:17:57] [Rank 3] totoal_tokens=13438, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:17:58] [Rank 2] totoal_tokens=13373, outputs='[3, 3, 3]'
[2024-08-03 15:17:58] [Rank 1] totoal_tokens=13338, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:17:58] [Rank 0] totoal_tokens=13366, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:17:59] [Rank 3] totoal_tokens=13582, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:17:59] [Rank 0] totoal_tokens=13380, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:17:59] [Rank 2] totoal_tokens=13378, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 1'
[2024-08-03 15:17:59] [Rank 1] totoal_tokens=13376, outputs='```json\n{\n  "vases": [\n    {"x": 1, "x": 2, "x": 3},\n    {"'
[2024-08-03 15:18:00] [Rank 3] totoal_tokens=13662, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:18:00] [Rank 0] totoal_tokens=13400, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:18:00] [Rank 1] totoal_tokens=13390, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:18:01] [Rank 2] totoal_tokens=13450, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:01] [Rank 3] totoal_tokens=13720, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:18:01] [Rank 1] totoal_tokens=13396, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:18:02] [Rank 0] totoal_tokens=13440, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:18:02] [Rank 2] totoal_tokens=13464, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:18:02] [Rank 3] totoal_tokens=13799, outputs='```json\n{\n  "brushes": [\n    "1",\n    "2",\n    "3",\n    "4",\n    "5",'
[2024-08-03 15:18:03] [Rank 2] totoal_tokens=13507, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:18:03] [Rank 0] totoal_tokens=13492, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:18:03] [Rank 1] totoal_tokens=13546, outputs='[3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3'
[2024-08-03 15:18:04] [Rank 3] totoal_tokens=13958, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:18:04] [Rank 0] totoal_tokens=13535, outputs='[0, 0, 0]'
[2024-08-03 15:18:04] [Rank 2] totoal_tokens=13589, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:05] [Rank 1] totoal_tokens=13576, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:18:05] [Rank 3] totoal_tokens=13969, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:18:05] [Rank 0] totoal_tokens=13560, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "A small, round, white vase with a'
[2024-08-03 15:18:06] [Rank 1] totoal_tokens=13621, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:18:06] [Rank 2] totoal_tokens=13615, outputs='```json\n{\n  "computer": 3\n}\n```'
[2024-08-03 15:18:06] [Rank 0] totoal_tokens=13714, outputs='[0, 0, 0]'
cessing InternVL2-2B_counting-text-test.jsonl:  46%|████▌     | 351/765 [04:41<08:38,  1.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  46%|████▌     | 352/765 [04:41<07:44,  1.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  46%|████▌     | 353/765 [04:43<07:40,  1.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  46%|████▋     | 354/765 [04:44<07:38,  1.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  46%|████▋     | 355/765 [04:45<07:36,  1.11s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  47%|████▋     | 356/765 [04:46<08:21,  1.23s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  47%|████▋     | 357/765 [04:48<08:41,  1.28s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  47%|████▋     | 358/765 [04:49<07:49,  1.15s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  47%|████▋     | 359/765 [04:50<08:24,  1.24s/it]
Processing InternVL2-2B_counting-text[2024-08-03 15:18:06] [Rank 3] totoal_tokens=14057, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:07] [Rank 2] totoal_tokens=13699, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:18:07] [Rank 1] totoal_tokens=13651, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A black Crate and Barrel'
[2024-08-03 15:18:08] [Rank 0] totoal_tokens=13757, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:18:08] [Rank 3] totoal_tokens=14059, outputs='```json\n{\n  "x": 1,\n  "x": 2,\n  "x": 3,\n  "x": 4'
[2024-08-03 15:18:08] [Rank 2] totoal_tokens=13807, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:18:09] [Rank 0] totoal_tokens=13816, outputs='[1, 1, 1]'
[2024-08-03 15:18:09] [Rank 1] totoal_tokens=13715, outputs='```json\n{\n  "keys": [\n    "Nanook",\n    "of the North",\n    "A story of life and love in the actual'
[2024-08-03 15:18:09] [Rank 2] totoal_tokens=13814, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:18:09] [Rank 3] totoal_tokens=14196, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:10] [Rank 0] totoal_tokens=13927, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:18:10] [Rank 2] totoal_tokens=14038, outputs='[4, 4, 4...]'
[2024-08-03 15:18:11] [Rank 3] totoal_tokens=14247, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:18:11] [Rank 1] totoal_tokens=13747, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 2'
[2024-08-03 15:18:11] [Rank 0] totoal_tokens=13947, outputs='```json\n{\n  "vases": [\n    "2",\n    "2",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:18:12] [Rank 1] totoal_tokens=13813, outputs='[1, 1, 1]'
[2024-08-03 15:18:12] [Rank 2] totoal_tokens=14076, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:12] [Rank 3] totoal_tokens=14260, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:13] [Rank 1] totoal_tokens=13947, outputs='```json\n{\n  "x": 3\n}\n```'
[2024-08-03 15:18:13] [Rank 2] totoal_tokens=14131, outputs='[1, 1, 1]'
[2024-08-03 15:18:13] [Rank 0] totoal_tokens=13963, outputs='```json\n{\n  "keys": [\n    "Accident",\n    "Drane House",\n    "Garrett County",\n    "National Register of'
[2024-08-03 15:18:14] [Rank 3] totoal_tokens=14279, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:18:14] [Rank 2] totoal_tokens=14252, outputs='```json\n{\n  "lighthouse_count": [\n    "3",\n    "3",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:18:14] [Rank 0] totoal_tokens=13978, outputs='```json\n{\n  "number_of_apples": 2\n}\n```'
[2024-08-03 15:18:14] [Rank 1] totoal_tokens=14039, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "x": 2, "x": 3},\n    {"x'
[2024-08-03 15:18:15] [Rank 3] totoal_tokens=14304, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:18:15] [Rank 2] totoal_tokens=14284, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:18:16] [Rank 0] totoal_tokens=14110, outputs='[0, 0, 0]'
[2024-08-03 15:18:16] [Rank 3] totoal_tokens=14383, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:18:16] [Rank 1] totoal_tokens=14098, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "y": 1},\n    {"x": 1, "'
[2024-08-03 15:18:17] [Rank 2] totoal_tokens=14435, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:18:17] [Rank 3] totoal_tokens=14383, outputs='```json\n{\n  "number_of_bananas": 3\n}\n```'
[2024-08-03 15:18:17] [Rank 0] totoal_tokens=14186, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:17] [Rank 1] totoal_tokens=14110, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 2'
[2024-08-03 15:18:18] [Rank 2] totoal_tokens=14461, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:18:19] [Rank 1] totoal_tokens=14117, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:18:19] [Rank 3] totoal_tokens=14518, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, white v'
[2024-08-03 15:18:19] [Rank 0] totoal_tokens=14189, outputs='```json\n{\n  "numbers": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
-test.jsonl:  47%|████▋     | 360/765 [04:51<07:42,  1.14s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  47%|████▋     | 361/765 [04:52<08:40,  1.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  47%|████▋     | 362/765 [04:53<07:50,  1.17s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  47%|████▋     | 363/765 [04:55<07:53,  1.18s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  48%|████▊     | 364/765 [04:56<08:29,  1.27s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  48%|████▊     | 365/765 [04:58<09:20,  1.40s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  48%|████▊     | 366/765 [04:59<09:00,  1.35s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  48%|████▊     | 367/765 [05:00<09:08,  1.38s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  48%|████▊     | 368/765 [05:02<09:27,  1.43s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  48%|████▊ [2024-08-03 15:18:20] [Rank 2] totoal_tokens=14463, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:20] [Rank 3] totoal_tokens=14523, outputs='```json\n{\n  "number_of_keys": 2\n}\n```'
[2024-08-03 15:18:20] [Rank 1] totoal_tokens=14144, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:18:21] [Rank 0] totoal_tokens=14384, outputs='```json\n{\n  "brushes": [\n    "4 Gauge",\n    "4 Gauge",\n    "4 Gauge",\n    "4'
[2024-08-03 15:18:21] [Rank 3] totoal_tokens=14582, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:18:21] [Rank 1] totoal_tokens=14153, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:18:21] [Rank 2] totoal_tokens=14537, outputs='```json\n{\n  "results": [\n    {\n      "key": 1,\n      "description": "Kingston"\n    },\n    {'
[2024-08-03 15:18:22] [Rank 0] totoal_tokens=14459, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:18:22] [Rank 3] totoal_tokens=14630, outputs='[1, 2, 3]'
[2024-08-03 15:18:22] [Rank 2] totoal_tokens=14659, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:18:23] [Rank 2] totoal_tokens=14698, outputs='[0, 0, 0]'
[2024-08-03 15:18:24] [Rank 3] totoal_tokens=14638, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:24] [Rank 0] totoal_tokens=14510, outputs='```json\n{\n  "compasses": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:18:24] [Rank 1] totoal_tokens=14204, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:18:25] [Rank 3] totoal_tokens=14731, outputs='```json\n{\n  "bananas": 4\n}\n```'
[2024-08-03 15:18:25] [Rank 2] totoal_tokens=14736, outputs='```json\n{\n  "compass_count": "2"\n}\n```'
[2024-08-03 15:18:25] [Rank 1] totoal_tokens=14206, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:18:26] [Rank 0] totoal_tokens=14642, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:26] [Rank 3] totoal_tokens=14878, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:18:26] [Rank 2] totoal_tokens=14842, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:27] [Rank 1] totoal_tokens=14247, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:18:27] [Rank 0] totoal_tokens=14665, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:18:28] [Rank 3] totoal_tokens=15202, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:28] [Rank 1] totoal_tokens=14247, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:18:28] [Rank 2] totoal_tokens=14882, outputs='```json\n{\n  "Superchargers": 200,\n  "Manchester Originals": 131\n}\n```'
[2024-08-03 15:18:28] [Rank 0] totoal_tokens=14725, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:18:29] [Rank 2] totoal_tokens=14943, outputs='```json\n{\n  "key_count": 1\n}\n```'
[2024-08-03 15:18:29] [Rank 3] totoal_tokens=15218, outputs='```json\n{\n  "compasses": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:18:29] [Rank 0] totoal_tokens=14765, outputs='```json\n{\n  "count": 0\n}\n```'
[2024-08-03 15:18:29] [Rank 1] totoal_tokens=14284, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "A small, round, golden vase"},'
[2024-08-03 15:18:30] [Rank 0] totoal_tokens=14838, outputs='[1, 1, 1]'
[2024-08-03 15:18:31] [Rank 2] totoal_tokens=15095, outputs='```json\n{\n  "keys": [\n    "2",\n    "2",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:18:31] [Rank 3] totoal_tokens=15261, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:31] [Rank 1] totoal_tokens=14580, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:32] [Rank 0] totoal_tokens=15035, outputs='```json\n{\n  "compass_count": 3\n}\n```'
    | 369/765 [05:04<09:50,  1.49s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  48%|████▊     | 370/765 [05:05<10:06,  1.54s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  48%|████▊     | 371/765 [05:06<09:23,  1.43s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  49%|████▊     | 372/765 [05:09<11:05,  1.69s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  49%|████▉     | 373/765 [05:10<10:41,  1.64s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  49%|████▉     | 374/765 [05:12<09:53,  1.52s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  49%|████▉     | 375/765 [05:13<09:27,  1.45s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  49%|████▉     | 376/765 [05:14<08:51,  1.37s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  49%|████▉     | 377/765 [05:15<08:17,  1.28s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  49%|████▉     | 378/765 [05:16<08:06,  1.26s[2024-08-03 15:18:32] [Rank 2] totoal_tokens=15156, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:18:32] [Rank 3] totoal_tokens=15270, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:18:32] [Rank 1] totoal_tokens=14628, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:18:33] [Rank 0] totoal_tokens=15077, outputs='```json\n{\n  "number_of_★": 2\n}\n```'
[2024-08-03 15:18:33] [Rank 2] totoal_tokens=15174, outputs='```json\n{\n  "computer_count": 2\n}\n```'
[2024-08-03 15:18:33] [Rank 3] totoal_tokens=15271, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:18:34] [Rank 1] totoal_tokens=14637, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:18:34] [Rank 0] totoal_tokens=15174, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:18:34] [Rank 2] totoal_tokens=15191, outputs='[0, 0, 0]'
[2024-08-03 15:18:35] [Rank 1] totoal_tokens=14688, outputs='[1, 1, 1]'
[2024-08-03 15:18:35] [Rank 0] totoal_tokens=15175, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:18:35] [Rank 3] totoal_tokens=15351, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:18:35] [Rank 2] totoal_tokens=15519, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:18:36] [Rank 1] totoal_tokens=14688, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:18:36] [Rank 0] totoal_tokens=15189, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:18:36] [Rank 3] totoal_tokens=15416, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:18:36] [Rank 2] totoal_tokens=15683, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:18:37] [Rank 1] totoal_tokens=14876, outputs='```json\n{\n  "apple_count": 2\n}\n```'
[2024-08-03 15:18:37] [Rank 0] totoal_tokens=15212, outputs='```json\n{\n  "number_of_★": 2\n}\n```'
[2024-08-03 15:18:38] [Rank 1] totoal_tokens=14879, outputs='```json\n{\n  "key_count": 3\n}\n```'
[2024-08-03 15:18:38] [Rank 2] totoal_tokens=15840, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:18:38] [Rank 3] totoal_tokens=15429, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:18:39] [Rank 0] totoal_tokens=15360, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:18:39] [Rank 1] totoal_tokens=15158, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:18:40] [Rank 3] totoal_tokens=15529, outputs='```json\n{\n  "result": 5\n}\n```'
[2024-08-03 15:18:40] [Rank 2] totoal_tokens=15884, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:40] [Rank 0] totoal_tokens=15479, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:40] [Rank 1] totoal_tokens=15212, outputs='```json\n{\n  "key_count": 1\n}\n```'
[2024-08-03 15:18:41] [Rank 3] totoal_tokens=15536, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:18:41] [Rank 2] totoal_tokens=15991, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:42] [Rank 1] totoal_tokens=15215, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:18:42] [Rank 0] totoal_tokens=15553, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:42] [Rank 2] totoal_tokens=16225, outputs='[0, 0, 0]'
[2024-08-03 15:18:43] [Rank 1] totoal_tokens=15429, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:18:43] [Rank 3] totoal_tokens=15537, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:18:44] [Rank 2] totoal_tokens=16241, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:18:44] [Rank 3] totoal_tokens=15542, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:18:44] [Rank 0] totoal_tokens=15898, outputs='```json\n{\n  "compasses": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:18:44] [Rank 1] totoal_tokens=15464, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:46] [Rank 3] totoal_tokens=15663, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:18:46] [Rank 0] totoal_tokens=16070, outputs='```json\n{\n  "owl_count": 0\n}\n```'
/it]
Processing InternVL2-2B_counting-text-test.jsonl:  50%|████▉     | 379/765 [05:17<07:57,  1.24s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  50%|████▉     | 380/765 [05:19<07:46,  1.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  50%|████▉     | 381/765 [05:20<07:36,  1.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  50%|████▉     | 382/765 [05:21<07:26,  1.16s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  50%|█████     | 383/765 [05:22<07:34,  1.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  50%|█████     | 384/765 [05:23<07:48,  1.23s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  50%|█████     | 385/765 [05:25<08:37,  1.36s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  50%|█████     | 386/765 [05:27<09:49,  1.56s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  51%|█████     | 387/765 [05:29<10:27,  1.66s/it]
Processing InternVL2-2B_count[2024-08-03 15:18:46] [Rank 1] totoal_tokens=15664, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:18:46] [Rank 2] totoal_tokens=16246, outputs='```json\n{\n  "keys": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:18:47] [Rank 3] totoal_tokens=15709, outputs='[1, 1, 1]'
[2024-08-03 15:18:47] [Rank 1] totoal_tokens=15680, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3}'
[2024-08-03 15:18:47] [Rank 0] totoal_tokens=16116, outputs='```json\n{\n  "fragrances": [\n    "Fragrance of the Past",\n    "Fragrance of the Present",\n    "'
[2024-08-03 15:18:48] [Rank 3] totoal_tokens=16042, outputs='```json\n{\n  "count": 2\n}\n```'
[2024-08-03 15:18:49] [Rank 0] totoal_tokens=16128, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:18:49] [Rank 1] totoal_tokens=16033, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:49] [Rank 2] totoal_tokens=16430, outputs='```json\n{\n  "vases": [\n    {"count": 1, "vase": "vase1"},\n    {"count":'
[2024-08-03 15:18:50] [Rank 3] totoal_tokens=16045, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:50] [Rank 0] totoal_tokens=16133, outputs='```json\n{\n  "number_of_★": 0\n}\n```'
[2024-08-03 15:18:51] [Rank 2] totoal_tokens=16461, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:18:51] [Rank 1] totoal_tokens=16117, outputs='```json\n{\n  "chest_count": [\n    "Ziyad Almaayouf",\n    "Ben Whittaker",\n    "Andrew'
[2024-08-03 15:18:51] [Rank 3] totoal_tokens=16208, outputs='```json\n{\n  "number_of_computers": 4\n}\n```'
[2024-08-03 15:18:51] [Rank 0] totoal_tokens=16246, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:18:52] [Rank 2] totoal_tokens=16554, outputs='```json\n{\n  "trees": 4\n}\n```'
[2024-08-03 15:18:52] [Rank 3] totoal_tokens=16241, outputs='```json\n{\n  "compass_count": 2\n}\n```'
[2024-08-03 15:18:52] [Rank 1] totoal_tokens=16154, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:18:53] [Rank 0] totoal_tokens=16255, outputs='```json\n{\n  "brushes": [\n    {"x": 0, "y": 0},\n    {"x": 1, "'
[2024-08-03 15:18:53] [Rank 2] totoal_tokens=16578, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:54] [Rank 3] totoal_tokens=16286, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "color": "black"},\n    {"number": 2, "'
[2024-08-03 15:18:54] [Rank 1] totoal_tokens=16406, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:18:54] [Rank 2] totoal_tokens=16598, outputs='```json\n{\n  "brushes": 0\n}\n```'
[2024-08-03 15:18:55] [Rank 0] totoal_tokens=16396, outputs='[1, 1, 1]'
[2024-08-03 15:18:56] [Rank 0] totoal_tokens=16416, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:18:56] [Rank 3] totoal_tokens=16385, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:56] [Rank 1] totoal_tokens=16584, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:56] [Rank 2] totoal_tokens=16643, outputs='```json\n{\n  "vases": [\n    {"x": 1, "x": 2, "x": 3},\n    {"'
[2024-08-03 15:18:57] [Rank 3] totoal_tokens=16453, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:18:57] [Rank 2] totoal_tokens=17193, outputs='[0, 0, 0]'
[2024-08-03 15:18:57] [Rank 0] totoal_tokens=16419, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "number_of_brushes": 1},\n    {"x":'
[2024-08-03 15:18:58] [Rank 1] totoal_tokens=16781, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:18:58] [Rank 3] totoal_tokens=16547, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:18:59] [Rank 2] totoal_tokens=17327, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:18:59] [Rank 0] totoal_tokens=16452, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
ing-text-test.jsonl:  51%|█████     | 388/765 [05:30<09:54,  1.58s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  51%|█████     | 389/765 [05:32<09:58,  1.59s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  51%|█████     | 390/765 [05:33<09:25,  1.51s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  51%|█████     | 391/765 [05:35<08:58,  1.44s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  51%|█████     | 392/765 [05:36<08:47,  1.41s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  51%|█████▏    | 393/765 [05:38<09:21,  1.51s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  52%|█████▏    | 394/765 [05:39<09:32,  1.54s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  52%|█████▏    | 395/765 [05:41<08:53,  1.44s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  52%|█████▏    | 396/765 [05:42<09:09,  1.49s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  52%|[2024-08-03 15:18:59] [Rank 1] totoal_tokens=17127, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:19:00] [Rank 3] totoal_tokens=16562, outputs='```json\n{\n  "vases": [\n    "3",\n    "3",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:19:00] [Rank 0] totoal_tokens=16516, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:19:00] [Rank 2] totoal_tokens=17367, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:19:01] [Rank 1] totoal_tokens=17132, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:19:01] [Rank 0] totoal_tokens=16544, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:19:01] [Rank 3] totoal_tokens=16618, outputs='```json\n{\n  "trees": 4\n}\n```'
[2024-08-03 15:19:02] [Rank 2] totoal_tokens=17615, outputs='```json\n{\n  "chest_count": 1,\n  "additional_chests": 1,\n  "additional_chests": 1'
[2024-08-03 15:19:02] [Rank 1] totoal_tokens=17161, outputs='```json\n{\n  "number_of_bananas": 0\n}\n```'
[2024-08-03 15:19:03] [Rank 3] totoal_tokens=16637, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:19:03] [Rank 0] totoal_tokens=16596, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:19:04] [Rank 3] totoal_tokens=16655, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:19:04] [Rank 2] totoal_tokens=17686, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:04] [Rank 1] totoal_tokens=17202, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:04] [Rank 0] totoal_tokens=16700, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:06] [Rank 3] totoal_tokens=16684, outputs='```json\n{\n  "trees": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1},'
[2024-08-03 15:19:06] [Rank 1] totoal_tokens=17237, outputs='```json\n{\n  "lighthouse": [\n    "Brent Gehring",\n    "James Koh",\n    "Ismail Gafoor",'
[2024-08-03 15:19:06] [Rank 0] totoal_tokens=16926, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:19:06] [Rank 2] totoal_tokens=17721, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, golden v'
[2024-08-03 15:19:07] [Rank 3] totoal_tokens=16688, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:19:07] [Rank 2] totoal_tokens=17820, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:19:07] [Rank 0] totoal_tokens=17347, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:19:08] [Rank 1] totoal_tokens=17268, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:09] [Rank 3] totoal_tokens=17020, outputs='```json\n{\n  "key1": 1,\n  "key2": 2,\n  "key3": 3\n}\n```'
[2024-08-03 15:19:09] [Rank 2] totoal_tokens=17879, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:19:09] [Rank 1] totoal_tokens=17268, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:19:09] [Rank 0] totoal_tokens=17355, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:10] [Rank 3] totoal_tokens=17066, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:19:10] [Rank 2] totoal_tokens=18064, outputs='[1, 2, 3, 4]'
[2024-08-03 15:19:11] [Rank 1] totoal_tokens=17310, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:11] [Rank 0] totoal_tokens=17382, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:19:12] [Rank 0] totoal_tokens=17393, outputs='```json\n{\n  "computer_count": 2\n}\n```'
█████▏    | 397/765 [05:44<09:02,  1.48s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  52%|█████▏    | 398/765 [05:45<08:44,  1.43s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  52%|█████▏    | 399/765 [05:46<08:19,  1.36s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  52%|█████▏    | 400/765 [05:47<08:14,  1.35s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  52%|█████▏    | 401/765 [05:49<09:00,  1.49s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  53%|█████▎    | 402/765 [05:51<08:42,  1.44s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  53%|█████▎    | 403/765 [05:52<08:41,  1.44s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  53%|█████▎    | 404/765 [05:54<10:04,  1.68s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  53%|█████▎    | 405/765 [05:56<09:25,  1.57s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  53%|█████�[2024-08-03 15:19:12] [Rank 3] totoal_tokens=17133, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:19:12] [Rank 2] totoal_tokens=18085, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:19:12] [Rank 1] totoal_tokens=17481, outputs='```json\n{\n  "tree_count": 2\n}\n```'
[2024-08-03 15:19:14] [Rank 2] totoal_tokens=18100, outputs='```json\n{\n  "vases": 1\n}\n```'
[2024-08-03 15:19:14] [Rank 3] totoal_tokens=17325, outputs='```json\n{\n  "vases": 5\n}\n```'
[2024-08-03 15:19:14] [Rank 0] totoal_tokens=17451, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:19:15] [Rank 1] totoal_tokens=17498, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:15] [Rank 2] totoal_tokens=18150, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "A small, round, white vase with a'
[2024-08-03 15:19:16] [Rank 3] totoal_tokens=17438, outputs='```json\n{\n  "numbers": [\n    [1, 2, 3],\n    [4, 5, 6],\n    ['
[2024-08-03 15:19:16] [Rank 0] totoal_tokens=17456, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small vase with a red'
[2024-08-03 15:19:16] [Rank 1] totoal_tokens=17500, outputs='```json\n{\n  "vases": 1\n}\n```'
[2024-08-03 15:19:17] [Rank 2] totoal_tokens=18198, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:19:17] [Rank 3] totoal_tokens=17452, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:19:17] [Rank 0] totoal_tokens=17457, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:18] [Rank 1] totoal_tokens=17502, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:19:18] [Rank 2] totoal_tokens=18234, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:19] [Rank 3] totoal_tokens=17454, outputs='```json\n{\n  "compass": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:19:19] [Rank 0] totoal_tokens=17499, outputs='[7, 7, 7]'
[2024-08-03 15:19:19] [Rank 1] totoal_tokens=17605, outputs='```json\n{\n  "keys": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:19:20] [Rank 3] totoal_tokens=17467, outputs='[0, 0, 0]'
[2024-08-03 15:19:20] [Rank 2] totoal_tokens=18238, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:19:21] [Rank 0] totoal_tokens=17596, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:19:21] [Rank 1] totoal_tokens=17701, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:19:21] [Rank 3] totoal_tokens=17535, outputs='[0, 0, 0]'
[2024-08-03 15:19:21] [Rank 2] totoal_tokens=18281, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:19:22] [Rank 0] totoal_tokens=17692, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:19:22] [Rank 1] totoal_tokens=17762, outputs='```json\n{\n  "trees": 1\n}\n```'
[2024-08-03 15:19:23] [Rank 3] totoal_tokens=17543, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:19:23] [Rank 2] totoal_tokens=18321, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:19:24] [Rank 0] totoal_tokens=17702, outputs='```json\n{\n  "brushes": [\n    "4",\n    "3",\n    "2"\n  ]\n}\n```'
[2024-08-03 15:19:24] [Rank 3] totoal_tokens=17669, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:19:24] [Rank 1] totoal_tokens=17767, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:25] [Rank 2] totoal_tokens=18335, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:19:25] [Rank 0] totoal_tokens=17707, outputs='```json\n{\n  "lighthouse_count": 2\n}\n```'
[2024-08-03 15:19:26] [Rank 3] totoal_tokens=17762, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:19:26] [Rank 1] totoal_tokens=17771, outputs='```json\n{\n  "keys": [\n    "Grimaldi",\n    "Bentley",\n    "Dickens",\n    "Pantomime'
[2024-08-03 15:19:27] [Rank 2] totoal_tokens=18364, outputs='```json\n{\n  "lighthouse": [\n    {\n      "number": 1,\n      "description": "Guardian"\n    },\n    {'
[2024-08-03 15:19:27] [Rank 0] totoal_tokens=17758, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "count": 1},\n    {"x": 2, "count'
��    | 406/765 [05:57<09:11,  1.54s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  53%|█████▎    | 407/765 [05:59<09:34,  1.61s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  53%|█████▎    | 408/765 [06:00<09:45,  1.64s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  53%|█████▎    | 409/765 [06:02<09:44,  1.64s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  54%|█████▎    | 410/765 [06:04<10:11,  1.72s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  54%|█████▎    | 411/765 [06:05<09:22,  1.59s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  54%|█████▍    | 412/765 [06:07<08:53,  1.51s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  54%|█████▍    | 413/765 [06:08<09:04,  1.55s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  54%|█████▍    | 414/765 [06:10<08:40,  1.48s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  54%|█████▍    | 415/765 [2024-08-03 15:19:27] [Rank 3] totoal_tokens=17985, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:19:28] [Rank 1] totoal_tokens=17842, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:19:28] [Rank 2] totoal_tokens=18373, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:19:28] [Rank 0] totoal_tokens=17767, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:29] [Rank 1] totoal_tokens=18080, outputs='[1, 2, 3]'
[2024-08-03 15:19:29] [Rank 3] totoal_tokens=18007, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:29] [Rank 2] totoal_tokens=18450, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:19:30] [Rank 1] totoal_tokens=18093, outputs='```json\n{\n  "key_count": 4\n}\n```'
[2024-08-03 15:19:31] [Rank 0] totoal_tokens=17912, outputs='```json\n{\n  "vases": [\n    {"count": 2},\n    {"count": 2},\n    {"count": 2}'
[2024-08-03 15:19:31] [Rank 2] totoal_tokens=18450, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:19:31] [Rank 3] totoal_tokens=18093, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:32] [Rank 2] totoal_tokens=18534, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:19:33] [Rank 0] totoal_tokens=18007, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:33] [Rank 1] totoal_tokens=18187, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:33] [Rank 3] totoal_tokens=18101, outputs='```json\n{\n  "chest": [\n    {"x": 1, "x": 1, "x": 1},\n    {"x'
[2024-08-03 15:19:34] [Rank 2] totoal_tokens=18561, outputs='```json\n{\n  "key_count": 3\n}\n```'
[2024-08-03 15:19:34] [Rank 0] totoal_tokens=18154, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:19:35] [Rank 1] totoal_tokens=18187, outputs='[3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3'
[2024-08-03 15:19:35] [Rank 3] totoal_tokens=18110, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:35] [Rank 0] totoal_tokens=18278, outputs='```json\n{\n  "total_apples": 0\n}\n```'
[2024-08-03 15:19:35] [Rank 2] totoal_tokens=18698, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:19:36] [Rank 1] totoal_tokens=18301, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:19:36] [Rank 3] totoal_tokens=18112, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:19:37] [Rank 0] totoal_tokens=18324, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:19:37] [Rank 2] totoal_tokens=18846, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:19:38] [Rank 3] totoal_tokens=18174, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:19:38] [Rank 1] totoal_tokens=18311, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:39] [Rank 0] totoal_tokens=18338, outputs='```json\n{\n  "vases": [\n    {\n      "x": 1,\n      "y": 1,\n      "z":'
[2024-08-03 15:19:39] [Rank 3] totoal_tokens=18225, outputs='```json\n{\n  "key": "1, 2, 3, 4, 5, 6, 7, 8'
[2024-08-03 15:19:40] [Rank 2] totoal_tokens=18926, outputs='```json\n{\n  "chest_count": 4\n}\n```'
[2024-08-03 15:19:40] [Rank 1] totoal_tokens=18318, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:40] [Rank 0] totoal_tokens=18369, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:19:41] [Rank 3] totoal_tokens=18333, outputs='```json\n{\n  "book1": "The Savage Detectives",\n  "book2": "Cormac McCarthy",\n  "book3":'
[2024-08-03 15:19:41] [Rank 2] totoal_tokens=19011, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "color": "red"},\n    {"number": 2, "'
[2024-08-03 15:19:42] [Rank 1] totoal_tokens=18323, outputs='```json\n{\n  "keys": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:19:42] [Rank 0] totoal_tokens=18456, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[06:11<09:18,  1.60s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  54%|█████▍    | 416/765 [06:13<09:27,  1.63s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  55%|█████▍    | 417/765 [06:15<10:15,  1.77s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  55%|█████▍    | 418/765 [06:17<10:40,  1.85s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  55%|█████▍    | 419/765 [06:19<09:51,  1.71s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  55%|█████▍    | 420/765 [06:20<09:23,  1.63s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  55%|█████▌    | 421/765 [06:22<09:02,  1.58s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  55%|█████▌    | 422/765 [06:24<09:49,  1.72s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  55%|█████▌    | 423/765 [06:25<09:02,  1.59s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  55%|█████▌    | 424/765 [06:27<10:14,  1[2024-08-03 15:19:43] [Rank 2] totoal_tokens=19038, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, ornate vase'
[2024-08-03 15:19:43] [Rank 1] totoal_tokens=18656, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:19:43] [Rank 3] totoal_tokens=18780, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:44] [Rank 0] totoal_tokens=18493, outputs='```json\n{\n  "number_of_★": 2\n}\n```'
[2024-08-03 15:19:45] [Rank 1] totoal_tokens=18735, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:19:45] [Rank 3] totoal_tokens=19028, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:19:45] [Rank 2] totoal_tokens=19091, outputs='```json\n{\n  "chest_count": 2\n}\n```'
[2024-08-03 15:19:46] [Rank 0] totoal_tokens=18507, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "color": "red"},\n    {"number": 2, "'
[2024-08-03 15:19:46] [Rank 1] totoal_tokens=18872, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:19:46] [Rank 3] totoal_tokens=19044, outputs='```json\n{\n  "number_of_trees": 3\n}\n```'
[2024-08-03 15:19:47] [Rank 2] totoal_tokens=19299, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:48] [Rank 1] totoal_tokens=18928, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:19:48] [Rank 2] totoal_tokens=19321, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:19:48] [Rank 3] totoal_tokens=19060, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:49] [Rank 0] totoal_tokens=18511, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:19:50] [Rank 1] totoal_tokens=19047, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:50] [Rank 2] totoal_tokens=19456, outputs='```json\n{\n  "keys": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:19:50] [Rank 3] totoal_tokens=19111, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:19:51] [Rank 0] totoal_tokens=18547, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:19:51] [Rank 1] totoal_tokens=19074, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:19:51] [Rank 2] totoal_tokens=19462, outputs='```json\n{\n  "lighthouses": [\n    "4"\n  ]\n}\n```'
[2024-08-03 15:19:51] [Rank 3] totoal_tokens=19115, outputs='[1, 1, 1]'
[2024-08-03 15:19:52] [Rank 1] totoal_tokens=19101, outputs='[0, 0, 0]'
[2024-08-03 15:19:53] [Rank 0] totoal_tokens=18549, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:53] [Rank 2] totoal_tokens=19492, outputs='```json\n{\n  "Apple Count": 0\n}\n```'
[2024-08-03 15:19:53] [Rank 3] totoal_tokens=19230, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:19:54] [Rank 1] totoal_tokens=19102, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:19:55] [Rank 2] totoal_tokens=19510, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:19:55] [Rank 0] totoal_tokens=18916, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:19:55] [Rank 3] totoal_tokens=19261, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:55] [Rank 1] totoal_tokens=19126, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:19:56] [Rank 2] totoal_tokens=19517, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:19:56] [Rank 0] totoal_tokens=19054, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:19:57] [Rank 3] totoal_tokens=19333, outputs='```json\n{\n  "number_of_vases": 1\n}\n```'
[2024-08-03 15:19:57] [Rank 1] totoal_tokens=19377, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:19:58] [Rank 1] totoal_tokens=19377, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:19:58] [Rank 3] totoal_tokens=19345, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:19:58] [Rank 0] totoal_tokens=19080, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:19:59] [Rank 2] totoal_tokens=19520, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3",\n    "4",\n    "5",\n    "'
[2024-08-03 15:20:00] [Rank 1] totoal_tokens=19469, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:20:00] [Rank 0] totoal_tokens=19101, outputs='```json\n{\n  "Apple Count": 0\n}\n```'
[2024-08-03 15:20:00] [Rank 2] totoal_tokens=19697, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:20:00] [Rank 3] totoal_tokens=19502, outputs='```json\n{\n  "key1": 1,\n  "key2": 2,\n  "key3": 3\n}\n```'
[2024-08-03 15:20:01] [Rank 1] totoal_tokens=19470, outputs='```json\n{\n  "banana_count": 4\n}\n```'
[2024-08-03 15:20:02] [Rank 3] totoal_tokens=19738, outputs='```json\n{\n  "chest_count": 4\n}\n```'
[2024-08-03 15:20:02] [Rank 2] totoal_tokens=19984, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:20:02] [Rank 0] totoal_tokens=19103, outputs='```json\n{\n  "owl_count": 3\n}\n```'
.80s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  56%|█████▌    | 425/765 [06:29<09:39,  1.70s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  56%|█████▌    | 426/765 [06:31<09:51,  1.74s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  56%|█████▌    | 427/765 [06:34<12:47,  2.27s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  56%|█████▌    | 428/765 [06:36<11:33,  2.06s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  56%|█████▌    | 429/765 [06:37<10:58,  1.96s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  56%|█████▌    | 430/765 [06:40<11:36,  2.08s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  56%|█████▋    | 431/765 [06:41<10:24,  1.87s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  56%|█████▋    | 432/765 [06:43<10:46,  1.94s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  57%|█████▋    | 433/765 [06:45<10:09,  1.83s/it]
Process[2024-08-03 15:20:03] [Rank 1] totoal_tokens=19541, outputs='```json\n{\n  "key_count": 2\n}\n```'
[2024-08-03 15:20:03] [Rank 3] totoal_tokens=20205, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:20:03] [Rank 2] totoal_tokens=20108, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:20:04] [Rank 0] totoal_tokens=19118, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, golden v'
[2024-08-03 15:20:05] [Rank 1] totoal_tokens=19573, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "a small penguin counted 1 vase"},'
[2024-08-03 15:20:05] [Rank 3] totoal_tokens=20206, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:05] [Rank 0] totoal_tokens=19230, outputs='```json\n{\n  "compass_count": 4\n}\n```'
[2024-08-03 15:20:06] [Rank 2] totoal_tokens=20193, outputs='```json\n{\n  "compass_count": 3\n}\n```'
[2024-08-03 15:20:06] [Rank 1] totoal_tokens=19622, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:20:07] [Rank 0] totoal_tokens=19424, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:20:07] [Rank 3] totoal_tokens=20217, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:20:08] [Rank 3] totoal_tokens=20245, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:20:08] [Rank 1] totoal_tokens=19738, outputs='```json\n{\n  "compass": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:20:08] [Rank 2] totoal_tokens=20209, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:20:08] [Rank 0] totoal_tokens=19865, outputs='```json\n{\n  "method": "mouse",\n  "keys": "x, x, x..."\n}\n```'
[2024-08-03 15:20:10] [Rank 1] totoal_tokens=19748, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:20:10] [Rank 3] totoal_tokens=20314, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:20:10] [Rank 2] totoal_tokens=20259, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:20:11] [Rank 0] totoal_tokens=20095, outputs='```json\n{\n  "lighthouses": [\n    [0, 0, 0],\n    [0, 0, 0],'
[2024-08-03 15:20:11] [Rank 1] totoal_tokens=20124, outputs='```json\n{\n  "total_★": 5\n}\n```'
[2024-08-03 15:20:12] [Rank 3] totoal_tokens=20792, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "count": 1},\n    {"x": 2, "count'
[2024-08-03 15:20:12] [Rank 2] totoal_tokens=20395, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:12] [Rank 0] totoal_tokens=20117, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:20:13] [Rank 1] totoal_tokens=20159, outputs='```json\n{\n  "bananas": 1\n}\n```'
[2024-08-03 15:20:13] [Rank 3] totoal_tokens=20905, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:20:14] [Rank 0] totoal_tokens=20171, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:20:14] [Rank 2] totoal_tokens=20408, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:15] [Rank 1] totoal_tokens=20180, outputs='```json\n{\n  "number_of_brushes": 2\n}\n```'
[2024-08-03 15:20:15] [Rank 3] totoal_tokens=21055, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:20:15] [Rank 2] totoal_tokens=20453, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:20:16] [Rank 0] totoal_tokens=20251, outputs='```json\n{\n  "x": 1,\n  "x": 2,\n  "x": 3,\n  "x": 4'
[2024-08-03 15:20:17] [Rank 1] totoal_tokens=20197, outputs='```json\n{\n  "keys": [\n    {"x": 1, "y": 1},\n    {"x": 1, "y'
[2024-08-03 15:20:17] [Rank 2] totoal_tokens=20567, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:20:17] [Rank 3] totoal_tokens=21145, outputs='```json\n{\n  "trees": [\n    {\n      "x": 1,\n      "y": 1,\n      "z":'
[2024-08-03 15:20:17] [Rank 0] totoal_tokens=20312, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
ing InternVL2-2B_counting-text-test.jsonl:  57%|█████▋    | 434/765 [06:47<10:04,  1.83s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  57%|█████▋    | 435/765 [06:49<10:18,  1.87s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  57%|█████▋    | 436/765 [06:50<09:29,  1.73s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  57%|█████▋    | 437/765 [06:51<09:04,  1.66s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  57%|█████▋    | 438/765 [06:53<09:13,  1.69s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  57%|█████▋    | 439/765 [06:56<10:13,  1.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  58%|█████▊    | 440/765 [06:57<09:41,  1.79s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  58%|█████▊    | 441/765 [06:59<09:07,  1.69s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  58%|█████▊    | 442/765 [07:01<09:37,  1.79s/it]
Processing InternVL2-2B[2024-08-03 15:20:18] [Rank 1] totoal_tokens=20206, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:20:18] [Rank 2] totoal_tokens=20817, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:20:19] [Rank 3] totoal_tokens=21166, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:20:20] [Rank 1] totoal_tokens=20207, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:20:20] [Rank 0] totoal_tokens=20502, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:20] [Rank 3] totoal_tokens=21190, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:20:20] [Rank 2] totoal_tokens=20896, outputs='```json\n{\n  "title": "Football as a tool for Peace: How Les Éléphants Inspired a Nation",\n  "'
[2024-08-03 15:20:22] [Rank 1] totoal_tokens=20399, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:22] [Rank 0] totoal_tokens=20625, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:20:22] [Rank 3] totoal_tokens=21286, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:20:23] [Rank 2] totoal_tokens=21030, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:23] [Rank 0] totoal_tokens=20745, outputs='```json\n{\n  "vase_count": 1\n}\n```'
[2024-08-03 15:20:23] [Rank 1] totoal_tokens=20400, outputs='```json\n{\n  "lighthouses": [\n    {\n      "number": 1,\n      "location": "Harworth",\n      "description'
[2024-08-03 15:20:24] [Rank 3] totoal_tokens=21656, outputs='```json\n{\n  "signs_and_symptoms_of_lymphoma": [\n    "swollen lymph nodes",\n    "fatigue",'
[2024-08-03 15:20:25] [Rank 0] totoal_tokens=20996, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:20:25] [Rank 2] totoal_tokens=21057, outputs='```json\n{\n  "lighthouse": [\n    "Lighthouse 1",\n    "Lighthouse 2",\n    "Lighthouse 3"'
[2024-08-03 15:20:26] [Rank 3] totoal_tokens=21677, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:26] [Rank 1] totoal_tokens=20402, outputs='```json\n{\n  "brushes": 5\n}\n```'
[2024-08-03 15:20:27] [Rank 2] totoal_tokens=21277, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:20:27] [Rank 0] totoal_tokens=21021, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:28] [Rank 3] totoal_tokens=21687, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:20:28] [Rank 1] totoal_tokens=20405, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:20:29] [Rank 2] totoal_tokens=21280, outputs='```json\n{\n  "compasses": [\n    {"x": 4, "x": 4, "x": 4},\n    {"'
[2024-08-03 15:20:29] [Rank 0] totoal_tokens=21127, outputs='[3, 3, 3]'
[2024-08-03 15:20:30] [Rank 1] totoal_tokens=20503, outputs='[0, 0, 0]'
[2024-08-03 15:20:30] [Rank 3] totoal_tokens=21784, outputs='[0, 0, 0]'
[2024-08-03 15:20:30] [Rank 2] totoal_tokens=21288, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:20:31] [Rank 0] totoal_tokens=21189, outputs='```json\n{\n  "vases": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:20:32] [Rank 3] totoal_tokens=22038, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:20:32] [Rank 1] totoal_tokens=20546, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:32] [Rank 2] totoal_tokens=21480, outputs='```json\n{\n  "keys": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:20:33] [Rank 0] totoal_tokens=21210, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:20:33] [Rank 1] totoal_tokens=20722, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:20:34] [Rank 3] totoal_tokens=22084, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:34] [Rank 2] totoal_tokens=21502, outputs='```json\n{\n  "compasses": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:20:35] [Rank 1] totoal_tokens=20755, outputs='```json\n{\n  "chest_count": 4\n}\n```'
[2024-08-03 15:20:35] [Rank 0] totoal_tokens=21478, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
_counting-text-test.jsonl:  58%|█████▊    | 443/765 [07:02<09:02,  1.69s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  58%|█████▊    | 444/765 [07:05<10:53,  2.04s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  58%|█████▊    | 445/765 [07:07<10:35,  1.99s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  58%|█████▊    | 446/765 [07:08<09:40,  1.82s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  58%|█████▊    | 447/765 [07:10<09:10,  1.73s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  59%|█████▊    | 448/765 [07:12<10:09,  1.92s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  59%|█████▊    | 449/765 [07:14<09:28,  1.80s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  59%|█████▉    | 450/765 [07:16<10:00,  1.91s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  59%|█████▉    | 451/765 [07:17<09:28,  1.81s/it]
Processing InternVL2-2B_counting-text-t[2024-08-03 15:20:35] [Rank 3] totoal_tokens=22283, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:20:36] [Rank 2] totoal_tokens=21502, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:37] [Rank 1] totoal_tokens=21160, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:20:37] [Rank 0] totoal_tokens=21499, outputs='```json\n{\n  "x": 1,\n  "x": 2,\n  "x": 3,\n  "x": 4'
[2024-08-03 15:20:37] [Rank 3] totoal_tokens=22303, outputs='[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0'
[2024-08-03 15:20:38] [Rank 2] totoal_tokens=21783, outputs='[3, 3, 3]'
[2024-08-03 15:20:38] [Rank 0] totoal_tokens=21545, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:20:39] [Rank 1] totoal_tokens=21214, outputs='```json\n{\n  "trees": [\n    {\n      "x": 1,\n      "y": 1,\n      "z":'
[2024-08-03 15:20:39] [Rank 3] totoal_tokens=22426, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:40] [Rank 2] totoal_tokens=22061, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:20:40] [Rank 0] totoal_tokens=21587, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:41] [Rank 1] totoal_tokens=21325, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 1'
[2024-08-03 15:20:41] [Rank 3] totoal_tokens=22557, outputs='```json\n{\n  "key": "Solvusoft Corporation",\n  "value": "Gold Certified Independent Software Vendor",\n  "value2":'
[2024-08-03 15:20:41] [Rank 2] totoal_tokens=22065, outputs='```json\n{\n  "number_of_circles": 3\n}\n```'
[2024-08-03 15:20:42] [Rank 0] totoal_tokens=22017, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:20:43] [Rank 3] totoal_tokens=22796, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:20:43] [Rank 1] totoal_tokens=21335, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:44] [Rank 2] totoal_tokens=22100, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:20:44] [Rank 0] totoal_tokens=22069, outputs='```json\n{\n  "chest": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:20:44] [Rank 3] totoal_tokens=23123, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:20:45] [Rank 1] totoal_tokens=21346, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:20:46] [Rank 0] totoal_tokens=22085, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 1, "x": 2},\n    {"'
[2024-08-03 15:20:46] [Rank 1] totoal_tokens=21351, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:20:47] [Rank 3] totoal_tokens=23184, outputs='```json\n{\n  "location": "Dunsborough, Western Australia",\n  "features": [\n    "health retreat",\n    "yoga",'
[2024-08-03 15:20:48] [Rank 2] totoal_tokens=22111, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:48] [Rank 1] totoal_tokens=21562, outputs='```json\n{\n  "compass": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:20:49] [Rank 3] totoal_tokens=23210, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:20:49] [Rank 2] totoal_tokens=22372, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:20:50] [Rank 0] totoal_tokens=22140, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 1'
[2024-08-03 15:20:50] [Rank 1] totoal_tokens=22039, outputs='```json\n{\n  "vases": [\n    {"count": 1, "location": "left"},\n    {"count": 1, "'
[2024-08-03 15:20:50] [Rank 3] totoal_tokens=23251, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:20:51] [Rank 2] totoal_tokens=22373, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:20:51] [Rank 0] totoal_tokens=22277, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:20:52] [Rank 1] totoal_tokens=22077, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:20:53] [Rank 3] totoal_tokens=23254, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:20:53] [Rank 2] totoal_tokens=22428, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:20:53] [Rank 0] totoal_tokens=22284, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
est.jsonl:  59%|█████▉    | 452/765 [07:20<10:12,  1.96s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  59%|█████▉    | 453/765 [07:22<10:07,  1.95s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  59%|█████▉    | 454/765 [07:23<09:19,  1.80s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  59%|█████▉    | 455/765 [07:25<09:44,  1.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  60%|█████▉    | 456/765 [07:27<09:01,  1.75s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  60%|█████▉    | 457/765 [07:29<09:39,  1.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  60%|█████▉    | 458/765 [07:31<09:52,  1.93s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  60%|██████    | 459/765 [07:34<12:24,  2.43s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  60%|██████    | 460/765 [07:36<11:13,  2.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  60%|[2024-08-03 15:20:54] [Rank 3] totoal_tokens=23284, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:20:54] [Rank 1] totoal_tokens=22119, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:55] [Rank 2] totoal_tokens=22466, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:20:56] [Rank 0] totoal_tokens=22429, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:56] [Rank 3] totoal_tokens=23304, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:20:56] [Rank 2] totoal_tokens=22847, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:20:57] [Rank 0] totoal_tokens=22536, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:20:58] [Rank 1] totoal_tokens=22121, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:59] [Rank 3] totoal_tokens=23369, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "color": "red"},\n    {"number": 2, "'
[2024-08-03 15:20:59] [Rank 2] totoal_tokens=23116, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:20:59] [Rank 0] totoal_tokens=22580, outputs='```json\n{\n  "compass": [\n    {\n      "x": 1,\n      "y": 1,\n      "z": 1'
[2024-08-03 15:21:00] [Rank 1] totoal_tokens=22165, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:21:00] [Rank 3] totoal_tokens=23688, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:21:01] [Rank 2] totoal_tokens=23124, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:01] [Rank 0] totoal_tokens=22794, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A small, round, wooden pl'
[2024-08-03 15:21:02] [Rank 1] totoal_tokens=22210, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:21:03] [Rank 3] totoal_tokens=23783, outputs='```json\n{\n  "chest_count": 1\n}\n```'
[2024-08-03 15:21:03] [Rank 2] totoal_tokens=23171, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:21:03] [Rank 1] totoal_tokens=22265, outputs='```json\n{\n  "number_of_★": 4\n}\n```'
[2024-08-03 15:21:04] [Rank 0] totoal_tokens=22822, outputs='```json\n{\n  "compass": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:21:05] [Rank 3] totoal_tokens=24028, outputs='```json\n{\n  "tree_count": 2\n}\n```'
[2024-08-03 15:21:05] [Rank 2] totoal_tokens=23311, outputs='```json\n{\n  "key_count": 3\n}\n```'
[2024-08-03 15:21:05] [Rank 1] totoal_tokens=22277, outputs='```json\n{\n  "key_count": 2\n}\n```'
[2024-08-03 15:21:06] [Rank 0] totoal_tokens=23111, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "count": 1},\n    {"number": 2, "count'
[2024-08-03 15:21:07] [Rank 3] totoal_tokens=24030, outputs='```json\n{\n  "soils_and_climate_change": {\n    "current_climate_change": "likely to have an impact on organic matter levels'
[2024-08-03 15:21:07] [Rank 1] totoal_tokens=22300, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:21:07] [Rank 2] totoal_tokens=23514, outputs='```json\n{\n  "lighthouse": 1\n}\n```'
[2024-08-03 15:21:07] [Rank 0] totoal_tokens=23181, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:21:08] [Rank 1] totoal_tokens=22304, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:21:09] [Rank 3] totoal_tokens=24111, outputs='```json\n{\n  "card": "The Magus",\n  "meaning": "Danger, destruction, quarrel, combat, ambition. Escape'
[2024-08-03 15:21:09] [Rank 2] totoal_tokens=23947, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:21:09] [Rank 0] totoal_tokens=23213, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:11] [Rank 1] totoal_tokens=22320, outputs='```json\n{\n  "popular idioms": [\n    "Don\'t count your chickens before they hatch",\n    "Don\'t count your friends before they'
[2024-08-03 15:21:11] [Rank 3] totoal_tokens=24128, outputs='```json\n{\n  "vases": 4\n}\n```'
[2024-08-03 15:21:11] [Rank 0] totoal_tokens=23292, outputs='```json\n{\n  "title": "The Haute Grandeur Global Awards",\n  "description": "The Haute Grandeur Global Awards concept is'
██████    | 461/765 [07:38<10:51,  2.14s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  60%|██████    | 462/765 [07:41<11:18,  2.24s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  61%|██████    | 463/765 [07:42<10:10,  2.02s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  61%|██████    | 464/765 [07:44<10:09,  2.03s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  61%|██████    | 465/765 [07:46<10:14,  2.05s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  61%|██████    | 466/765 [07:48<10:32,  2.11s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  61%|██████    | 467/765 [07:50<10:19,  2.08s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  61%|██████    | 468/765 [07:52<09:38,  1.95s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  61%|██████▏   | 469/765 [07:54<09:34,  1.94s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  61%|████�[2024-08-03 15:21:12] [Rank 2] totoal_tokens=24051, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:12] [Rank 1] totoal_tokens=22464, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:21:13] [Rank 2] totoal_tokens=24053, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:21:13] [Rank 0] totoal_tokens=23315, outputs='```json\n{\n  "results": [\n    {\n      "date": "2019-01-14",\n      "result": "MultiStem'
[2024-08-03 15:21:14] [Rank 1] totoal_tokens=22687, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:21:14] [Rank 3] totoal_tokens=24129, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:21:15] [Rank 2] totoal_tokens=24058, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:21:15] [Rank 0] totoal_tokens=23400, outputs='```json\n{\n  "brushes": 3\n}\n```'
[2024-08-03 15:21:16] [Rank 3] totoal_tokens=24227, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:21:16] [Rank 1] totoal_tokens=22692, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:21:17] [Rank 0] totoal_tokens=23473, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:21:18] [Rank 2] totoal_tokens=24208, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:18] [Rank 1] totoal_tokens=22701, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "Lady Gaga concert in Jak'
[2024-08-03 15:21:18] [Rank 3] totoal_tokens=24324, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:19] [Rank 0] totoal_tokens=23544, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:20] [Rank 2] totoal_tokens=24474, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:21:20] [Rank 3] totoal_tokens=24369, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:21:20] [Rank 0] totoal_tokens=23747, outputs='```json\n{\n  "key_count": 0\n}\n```'
[2024-08-03 15:21:21] [Rank 1] totoal_tokens=22843, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "description": "a small penguin"},\n    {"number":'
[2024-08-03 15:21:22] [Rank 3] totoal_tokens=24403, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:21:22] [Rank 2] totoal_tokens=24479, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "count": 1},\n    {"number": 2, "count'
[2024-08-03 15:21:23] [Rank 0] totoal_tokens=23764, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "count": 1},\n    {"number": 2, "count'
[2024-08-03 15:21:23] [Rank 1] totoal_tokens=23055, outputs='```json\n{\n  "brushes": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:21:24] [Rank 2] totoal_tokens=24492, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:21:24] [Rank 3] totoal_tokens=24421, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "a small, round, white vase"},'
[2024-08-03 15:21:25] [Rank 0] totoal_tokens=23779, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:25] [Rank 1] totoal_tokens=23076, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "x": 2, "x": 3},\n    {"'
[2024-08-03 15:21:25] [Rank 2] totoal_tokens=24519, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:21:26] [Rank 3] totoal_tokens=24456, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:21:27] [Rank 0] totoal_tokens=24371, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:21:27] [Rank 1] totoal_tokens=23086, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:21:28] [Rank 3] totoal_tokens=24480, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:28] [Rank 2] totoal_tokens=24540, outputs='```json\n{\n  "boost": 5,\n  "mindstorms": 5\n}\n```'
[2024-08-03 15:21:29] [Rank 0] totoal_tokens=24384, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
�█▏   | 470/765 [07:56<09:48,  2.00s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  62%|██████▏   | 471/765 [07:58<09:56,  2.03s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  62%|██████▏   | 472/765 [08:00<09:23,  1.92s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  62%|██████▏   | 473/765 [08:02<08:56,  1.84s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  62%|██████▏   | 474/765 [08:04<09:07,  1.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  62%|██████▏   | 475/765 [08:05<08:49,  1.82s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  62%|██████▏   | 476/765 [08:07<09:14,  1.92s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  62%|██████▏   | 477/765 [08:10<09:52,  2.06s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  62%|██████▏   | 478/765 [08:11<09:18,  1.95s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  63%|████[2024-08-03 15:21:29] [Rank 1] totoal_tokens=23260, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:30] [Rank 2] totoal_tokens=24751, outputs='[0, 0, 0]'
[2024-08-03 15:21:31] [Rank 1] totoal_tokens=23369, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:21:31] [Rank 3] totoal_tokens=24542, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:21:31] [Rank 0] totoal_tokens=24471, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:21:32] [Rank 3] totoal_tokens=25063, outputs='[1, 1, 1]'
[2024-08-03 15:21:32] [Rank 1] totoal_tokens=23484, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:21:33] [Rank 2] totoal_tokens=24776, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:34] [Rank 0] totoal_tokens=24577, outputs='```json\n{\n  "results": [\n    {"number": 1, "text": "Star Girl"},\n    {"number": 2, "'
[2024-08-03 15:21:34] [Rank 1] totoal_tokens=23484, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:21:35] [Rank 3] totoal_tokens=25097, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:21:35] [Rank 2] totoal_tokens=25030, outputs='[0, 0, 0]'
[2024-08-03 15:21:36] [Rank 0] totoal_tokens=24636, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:21:36] [Rank 1] totoal_tokens=23499, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:21:37] [Rank 3] totoal_tokens=25149, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:21:37] [Rank 2] totoal_tokens=25230, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:21:38] [Rank 1] totoal_tokens=23514, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:21:38] [Rank 0] totoal_tokens=24760, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:21:39] [Rank 2] totoal_tokens=25237, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:21:40] [Rank 3] totoal_tokens=25196, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:21:40] [Rank 0] totoal_tokens=25084, outputs='```json\n{\n  "key_count": 0\n}\n```'
[2024-08-03 15:21:40] [Rank 1] totoal_tokens=24042, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:21:41] [Rank 2] totoal_tokens=25303, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:42] [Rank 3] totoal_tokens=25463, outputs='```json\n{\n  "trees": 4\n}\n```'
[2024-08-03 15:21:42] [Rank 1] totoal_tokens=24125, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:21:42] [Rank 0] totoal_tokens=25088, outputs='```json\n{\n  "computer": 3\n}\n```'
[2024-08-03 15:21:44] [Rank 2] totoal_tokens=25314, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:44] [Rank 1] totoal_tokens=24223, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:21:44] [Rank 3] totoal_tokens=25545, outputs='```json\n{\n  "results": [\n    {\n      "number_of_chests": 3\n    },\n    {\n      "number_of_c'
[2024-08-03 15:21:44] [Rank 0] totoal_tokens=25110, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:21:46] [Rank 1] totoal_tokens=24377, outputs='```json\n{\n  "number_of_★": 47\n}\n```'
[2024-08-03 15:21:46] [Rank 2] totoal_tokens=25369, outputs='```json\n{\n  "vases": [\n    {"count": 1, "color": "blue", "shape": "square"},\n    {"'
[2024-08-03 15:21:46] [Rank 3] totoal_tokens=25546, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:21:46] [Rank 0] totoal_tokens=25170, outputs='```json\n{\n  "Jonathan Linnell jr. (11a,b1)": "1723",\n  "Jonathan Linn'
[2024-08-03 15:21:48] [Rank 3] totoal_tokens=25696, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:21:48] [Rank 1] totoal_tokens=24399, outputs='```json\n{\n  "owl": 0\n}\n```'
[2024-08-03 15:21:48] [Rank 2] totoal_tokens=25453, outputs='```json\n{\n  "top_10_reasons_science_is_another_religion": [\n    "Science thinks humans are all the same and'
[2024-08-03 15:21:48] [Rank 0] totoal_tokens=25224, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
██▎   | 479/765 [08:13<09:27,  1.98s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  63%|██████▎   | 480/765 [08:16<09:57,  2.09s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  63%|██████▎   | 481/765 [08:19<10:54,  2.31s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  63%|██████▎   | 482/765 [08:20<09:59,  2.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  63%|██████▎   | 483/765 [08:23<10:44,  2.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  63%|██████▎   | 484/765 [08:25<09:58,  2.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  63%|██████▎   | 485/765 [08:27<10:01,  2.15s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  64%|██████▎   | 486/765 [08:29<09:22,  2.02s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  64%|██████▎   | 487/765 [08:31<09:40,  2.09s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  64%|███�[2024-08-03 15:21:49] [Rank 1] totoal_tokens=24472, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:21:50] [Rank 3] totoal_tokens=26023, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:21:50] [Rank 0] totoal_tokens=25264, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:21:50] [Rank 2] totoal_tokens=25560, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "x": 2, "x": 3},\n    {"x'
[2024-08-03 15:21:51] [Rank 3] totoal_tokens=26078, outputs='[1, 1, 1]'
[2024-08-03 15:21:52] [Rank 1] totoal_tokens=24731, outputs='```json\n{\n  "keys": [\n    {"value": 1, "location": "Farmington State Bank"},\n    {"value":'
[2024-08-03 15:21:52] [Rank 0] totoal_tokens=25265, outputs='```json\n{\n  "keto_esters": {\n    "KE1": "30 grams of ketone ester per bottle",\n    "KE'
[2024-08-03 15:21:52] [Rank 2] totoal_tokens=25626, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:21:53] [Rank 3] totoal_tokens=26085, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:21:53] [Rank 1] totoal_tokens=25122, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:21:55] [Rank 0] totoal_tokens=25345, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:21:55] [Rank 2] totoal_tokens=25825, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:56] [Rank 1] totoal_tokens=25128, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:21:56] [Rank 3] totoal_tokens=26167, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:21:57] [Rank 2] totoal_tokens=26117, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:21:57] [Rank 0] totoal_tokens=25401, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:21:58] [Rank 3] totoal_tokens=26225, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:21:59] [Rank 1] totoal_tokens=25214, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:21:59] [Rank 0] totoal_tokens=25462, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:22:00] [Rank 2] totoal_tokens=26167, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:22:00] [Rank 3] totoal_tokens=26394, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:22:00] [Rank 1] totoal_tokens=25239, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:22:01] [Rank 0] totoal_tokens=25490, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:22:02] [Rank 3] totoal_tokens=26420, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:22:03] [Rank 1] totoal_tokens=25299, outputs='[1, 1, 1]'
[2024-08-03 15:22:03] [Rank 2] totoal_tokens=26263, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:22:03] [Rank 0] totoal_tokens=25626, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:22:04] [Rank 3] totoal_tokens=26831, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:22:05] [Rank 2] totoal_tokens=26472, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:22:05] [Rank 1] totoal_tokens=25329, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, white v'
[2024-08-03 15:22:05] [Rank 0] totoal_tokens=26071, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:22:06] [Rank 3] totoal_tokens=27055, outputs='```json\n{\n  "swastikas": [\n    "4",\n    "4",\n    "4"\n  ]\n}\n```'
[2024-08-03 15:22:07] [Rank 1] totoal_tokens=25424, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:22:07] [Rank 0] totoal_tokens=26074, outputs='[0, 0, 0]'
��██▍   | 488/765 [08:33<09:40,  2.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  64%|██████▍   | 489/765 [08:35<09:13,  2.01s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  64%|██████▍   | 490/765 [08:37<09:30,  2.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  64%|██████▍   | 491/765 [08:39<09:47,  2.14s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  64%|██████▍   | 492/765 [08:42<10:34,  2.32s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  64%|██████▍   | 493/765 [08:44<09:44,  2.15s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  65%|██████▍   | 494/765 [08:46<09:19,  2.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  65%|██████▍   | 495/765 [08:48<09:46,  2.17s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  65%|██████▍   | 496/765 [08:50<09:27,  2.11s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  65%|██�[2024-08-03 15:22:08] [Rank 3] totoal_tokens=27057, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:22:08] [Rank 2] totoal_tokens=26516, outputs='```json\n{\n  "number_of_compasses": 3\n}\n```'
[2024-08-03 15:22:09] [Rank 1] totoal_tokens=25463, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:22:09] [Rank 0] totoal_tokens=26104, outputs='```json\n{\n  "brushes": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:22:10] [Rank 3] totoal_tokens=27089, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:22:10] [Rank 2] totoal_tokens=26814, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "color": "black"},\n    {"number": 2, "'
[2024-08-03 15:22:11] [Rank 1] totoal_tokens=25522, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:22:12] [Rank 0] totoal_tokens=26170, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:22:12] [Rank 3] totoal_tokens=27132, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "y": 0, "z": 0},\n    {"'
[2024-08-03 15:22:12] [Rank 2] totoal_tokens=26851, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:22:13] [Rank 1] totoal_tokens=25545, outputs='```json\n{\n  "results": [\n    {\n      "x": 1,\n      "x": 1,\n      "x": 1'
[2024-08-03 15:22:14] [Rank 3] totoal_tokens=27133, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:22:14] [Rank 0] totoal_tokens=26294, outputs='```json\n{\n  "lighthouses": [\n    {"x": 1, "x": 1, "x": 1},'
[2024-08-03 15:22:15] [Rank 2] totoal_tokens=26921, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "computer_count": 1},\n    {"number": 2, "'
[2024-08-03 15:22:16] [Rank 1] totoal_tokens=26167, outputs='```json\n{\n  "x": 2,\n  "x": 3,\n  "x": 4\n}\n```'
[2024-08-03 15:22:16] [Rank 3] totoal_tokens=27176, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:22:17] [Rank 0] totoal_tokens=26478, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:22:18] [Rank 1] totoal_tokens=26223, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:22:18] [Rank 3] totoal_tokens=27186, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:22:19] [Rank 2] totoal_tokens=27062, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:22:20] [Rank 0] totoal_tokens=26921, outputs='```json\n{\n  "results": [\n    {\n      "number_of_chests": 4\n    },\n    {\n      "number_of_chests'
[2024-08-03 15:22:20] [Rank 1] totoal_tokens=26300, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:22:20] [Rank 3] totoal_tokens=27212, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:22:21] [Rank 2] totoal_tokens=27068, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:22:22] [Rank 1] totoal_tokens=26349, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:22:22] [Rank 0] totoal_tokens=27069, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:22:22] [Rank 2] totoal_tokens=27100, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:22:23] [Rank 3] totoal_tokens=27307, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "A small, round, white vase"},'
[2024-08-03 15:22:24] [Rank 1] totoal_tokens=26365, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:22:24] [Rank 0] totoal_tokens=27117, outputs='```json\n{\n  "tree_count": 4\n}\n```'
[2024-08-03 15:22:25] [Rank 3] totoal_tokens=27367, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:22:25] [Rank 2] totoal_tokens=27292, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:22:26] [Rank 1] totoal_tokens=26377, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 2},\n    {"count": 3},'
[2024-08-03 15:22:27] [Rank 0] totoal_tokens=27151, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:22:27] [Rank 3] totoal_tokens=27419, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:22:27] [Rank 2] totoal_tokens=27336, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:22:28] [Rank 0] totoal_tokens=27186, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
�███▍   | 497/765 [08:52<09:00,  2.02s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  65%|██████▌   | 498/765 [08:54<09:13,  2.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  65%|██████▌   | 499/765 [08:57<09:47,  2.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  65%|██████▌   | 500/765 [08:59<10:08,  2.30s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  65%|██████▌   | 501/765 [09:01<10:01,  2.28s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  66%|██████▌   | 502/765 [09:04<11:05,  2.53s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  66%|██████▌   | 503/765 [09:07<10:54,  2.50s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  66%|██████▌   | 504/765 [09:09<10:04,  2.32s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  66%|██████▌   | 505/765 [09:11<10:17,  2.37s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  66%|██[2024-08-03 15:22:29] [Rank 1] totoal_tokens=26921, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:22:29] [Rank 3] totoal_tokens=27537, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A small, round, wooden brush'
[2024-08-03 15:22:29] [Rank 2] totoal_tokens=27350, outputs='```json\n{\n  "vases": [\n    {"x": 1, "x": 1, "x": 1},\n    {"'
[2024-08-03 15:22:30] [Rank 0] totoal_tokens=27265, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:22:31] [Rank 1] totoal_tokens=27090, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:22:31] [Rank 2] totoal_tokens=27453, outputs='```json\n{\n  "owl_count": 4\n}\n```'
[2024-08-03 15:22:31] [Rank 3] totoal_tokens=28054, outputs='```json\n{\n  "lighthouse": 3\n}\n```'
[2024-08-03 15:22:32] [Rank 0] totoal_tokens=27282, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:22:33] [Rank 1] totoal_tokens=27107, outputs='```json\n{\n  "key_count": 0\n}\n```'
[2024-08-03 15:22:33] [Rank 3] totoal_tokens=28130, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:22:34] [Rank 2] totoal_tokens=27831, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the person who was born in the United States and'
[2024-08-03 15:22:34] [Rank 0] totoal_tokens=27926, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:22:35] [Rank 1] totoal_tokens=27187, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:22:36] [Rank 3] totoal_tokens=28267, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:22:36] [Rank 0] totoal_tokens=28118, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:22:36] [Rank 1] totoal_tokens=27265, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:22:36] [Rank 2] totoal_tokens=28075, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:22:38] [Rank 1] totoal_tokens=27291, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:22:39] [Rank 2] totoal_tokens=28094, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:22:39] [Rank 0] totoal_tokens=28184, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:22:40] [Rank 3] totoal_tokens=28296, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A white porcelain vase with'
[2024-08-03 15:22:40] [Rank 1] totoal_tokens=27381, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:22:41] [Rank 2] totoal_tokens=28167, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:22:41] [Rank 0] totoal_tokens=28196, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:22:42] [Rank 3] totoal_tokens=28510, outputs='```json\n{\n  "compasses": [\n    {\n      "number": 1,\n      "description": "The first compass is a simple,'
[2024-08-03 15:22:43] [Rank 1] totoal_tokens=27538, outputs='```json\n{\n  "x": 4,\n  "x": 3,\n  "x": 2,\n  "x": 1'
[2024-08-03 15:22:43] [Rank 2] totoal_tokens=28175, outputs='```json\n{\n  "lighthouse": [\n    {\n      "x": 0,\n      "x": 0,\n      "x":'
[2024-08-03 15:22:44] [Rank 3] totoal_tokens=28521, outputs='[1, 2, 3]'
[2024-08-03 15:22:45] [Rank 2] totoal_tokens=28196, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:22:45] [Rank 0] totoal_tokens=28198, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "count": 1},\n    {"x": 2, "count'
[2024-08-03 15:22:45] [Rank 1] totoal_tokens=28024, outputs='```json\n{\n  "vases": [\n    "Ziyad Almaayouf",\n    "Ben Whittaker",\n    "Andrew'
[2024-08-03 15:22:47] [Rank 3] totoal_tokens=29025, outputs='```json\n{\n  "brushes": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1},'
[2024-08-03 15:22:47] [Rank 2] totoal_tokens=28229, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "x": 2, "x": 3},\n    {"'
[2024-08-03 15:22:47] [Rank 0] totoal_tokens=28294, outputs='```json\n{\n  "brushes": [\n    {"x": 0, "y": 0, "z": 0},\n    {"'
[2024-08-03 15:22:49] [Rank 3] totoal_tokens=29052, outputs='```json\n{\n  "apple_count": 1\n}\n```'
[2024-08-03 15:22:49] [Rank 1] totoal_tokens=28029, outputs='```json\n{\n  "lighthouse": [\n    "Lighthouse 1",\n    "Lighthouse 2",\n    "Lighthouse 3"'
[2024-08-03 15:22:50] [Rank 2] totoal_tokens=28339, outputs='```json\n{\n  "x": 1,\n  "x": 2,\n  "x": 3\n}\n```'
[2024-08-03 15:22:50] [Rank 0] totoal_tokens=28514, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
████▌   | 506/765 [09:13<09:35,  2.22s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  66%|██████▋   | 507/765 [09:15<08:59,  2.09s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  66%|██████▋   | 508/765 [09:17<09:00,  2.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  67%|██████▋   | 509/765 [09:19<08:46,  2.06s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  67%|██████▋   | 510/765 [09:21<08:39,  2.04s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  67%|██████▋   | 511/765 [09:24<09:36,  2.27s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  67%|██████▋   | 512/765 [09:26<09:07,  2.17s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  67%|██████▋   | 513/765 [09:30<11:15,  2.68s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  67%|██████▋   | 514/765 [09:32<10:57,  2.62s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  67%|█�[2024-08-03 15:22:51] [Rank 3] totoal_tokens=29060, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:22:52] [Rank 1] totoal_tokens=28118, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:22:52] [Rank 2] totoal_tokens=28376, outputs='```json\n{\n  "trees": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1},'
[2024-08-03 15:22:53] [Rank 3] totoal_tokens=29081, outputs='```json\n{\n  "computer_count": 3\n}\n```'
[2024-08-03 15:22:53] [Rank 2] totoal_tokens=28396, outputs='[1, 2, 3]'
[2024-08-03 15:22:54] [Rank 0] totoal_tokens=28529, outputs='```json\n{\n  "compass": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:22:55] [Rank 3] totoal_tokens=29180, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:22:55] [Rank 1] totoal_tokens=28163, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:22:56] [Rank 2] totoal_tokens=28409, outputs='```json\n{\n  "brushes": [\n    {"x": 1, "x": 2, "x": 3},\n    {"'
[2024-08-03 15:22:56] [Rank 0] totoal_tokens=28561, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:22:58] [Rank 2] totoal_tokens=28561, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:22:58] [Rank 1] totoal_tokens=28282, outputs='```json\n{\n  "title": "How Bankers Use Andi 101",\n  "description": "Andi is a virtual coach that helps'
[2024-08-03 15:22:58] [Rank 3] totoal_tokens=29201, outputs='```json\n{\n  "chest_count": 4\n}\n```'
[2024-08-03 15:23:00] [Rank 0] totoal_tokens=28670, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3",\n    "4",\n    "5",\n    "'
[2024-08-03 15:23:01] [Rank 2] totoal_tokens=29033, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, white ceramic vase'
[2024-08-03 15:23:01] [Rank 3] totoal_tokens=29274, outputs='```json\n{\n  "bananas": [\n    {\n      "number": 1,\n      "description": "A small banana."\n    },'
[2024-08-03 15:23:01] [Rank 1] totoal_tokens=28357, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:02] [Rank 0] totoal_tokens=29081, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:23:03] [Rank 2] totoal_tokens=29082, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:23:03] [Rank 3] totoal_tokens=29287, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:03] [Rank 1] totoal_tokens=28404, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "color": "black"},\n    {"number": 2, "'
[2024-08-03 15:23:04] [Rank 0] totoal_tokens=29340, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:23:05] [Rank 2] totoal_tokens=29315, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:23:06] [Rank 1] totoal_tokens=28532, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:07] [Rank 3] totoal_tokens=30144, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:23:07] [Rank 2] totoal_tokens=29341, outputs='```json\n{\n  "vases": [\n    {"count": 1, "vase": "vase1"},\n    {"count":'
[2024-08-03 15:23:08] [Rank 0] totoal_tokens=29371, outputs='```json\n{\n  "vases": [\n    {"count": 1, "description": "small, clear glass vase"},\n    {"count'
[2024-08-03 15:23:09] [Rank 1] totoal_tokens=29140, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:10] [Rank 0] totoal_tokens=29409, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:23:10] [Rank 3] totoal_tokens=30532, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:23:11] [Rank 2] totoal_tokens=30133, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:12] [Rank 1] totoal_tokens=29178, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "description": "The first number in the list."},\n    {"number'
[2024-08-03 15:23:12] [Rank 0] totoal_tokens=29801, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:23:13] [Rank 3] totoal_tokens=30982, outputs='```json\n{\n  "brushes": [\n    "Gondola Gondola",\n    "Pink Moon Saloon",\n    "Level One'
[2024-08-03 15:23:14] [Rank 2] totoal_tokens=30357, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:23:14] [Rank 0] totoal_tokens=29835, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
��████▋   | 515/765 [09:35<10:57,  2.63s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  67%|██████▋   | 516/765 [09:39<12:57,  3.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  68%|██████▊   | 517/765 [09:41<11:30,  2.78s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  68%|██████▊   | 518/765 [09:45<12:18,  2.99s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  68%|██████▊   | 519/765 [09:46<10:56,  2.67s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  68%|██████▊   | 520/765 [09:48<10:02,  2.46s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  68%|██████▊   | 521/765 [09:52<11:42,  2.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  68%|██████▊   | 522/765 [09:54<10:41,  2.64s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  68%|██████▊   | 523/765 [09:57<10:26,  2.59s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  68%|�[2024-08-03 15:23:15] [Rank 1] totoal_tokens=29277, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:16] [Rank 3] totoal_tokens=31151, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:23:16] [Rank 2] totoal_tokens=30472, outputs='```json\n{\n  "lighthouse_count": 4\n}\n```'
[2024-08-03 15:23:16] [Rank 0] totoal_tokens=29903, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:23:17] [Rank 1] totoal_tokens=30022, outputs='[1, 2, 3]'
[2024-08-03 15:23:18] [Rank 3] totoal_tokens=31306, outputs='```json\n{\n  "winner": "Miedema",\n  "runner-up": "Rapinoe",\n  "third-place": "R'
[2024-08-03 15:23:19] [Rank 2] totoal_tokens=30950, outputs='```json\n{\n  "brushes": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:23:19] [Rank 1] totoal_tokens=30046, outputs='```json\n{\n  "vases": 0\n}\n```'
[2024-08-03 15:23:19] [Rank 0] totoal_tokens=30033, outputs='```json\n{\n  "key": 1,\n  "key": 2,\n  "key": 3\n}\n```'
[2024-08-03 15:23:21] [Rank 3] totoal_tokens=31317, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:23:21] [Rank 0] totoal_tokens=30041, outputs='[1, 2, 3]'
[2024-08-03 15:23:22] [Rank 1] totoal_tokens=30066, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:23:22] [Rank 2] totoal_tokens=31125, outputs='```json\n{\n  "answer": 2\n}\n```'
[2024-08-03 15:23:23] [Rank 0] totoal_tokens=30320, outputs='[0, 0, 0]'
[2024-08-03 15:23:23] [Rank 3] totoal_tokens=31704, outputs='```json\n{\n  "number_of_computers": 3\n}\n```'
[2024-08-03 15:23:24] [Rank 1] totoal_tokens=30106, outputs='```json\n{\n  "brushes": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:23:24] [Rank 2] totoal_tokens=31132, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:25] [Rank 3] totoal_tokens=32057, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:23:25] [Rank 0] totoal_tokens=30446, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:23:27] [Rank 2] totoal_tokens=31307, outputs='```json\n{\n  "results": [\n    {"x": 1, "x": 1, "x": 1},\n    {"x'
[2024-08-03 15:23:27] [Rank 1] totoal_tokens=30144, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:23:28] [Rank 0] totoal_tokens=30730, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:23:28] [Rank 3] totoal_tokens=32117, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:29] [Rank 2] totoal_tokens=31587, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:23:29] [Rank 1] totoal_tokens=30630, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:23:30] [Rank 3] totoal_tokens=32189, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:23:30] [Rank 0] totoal_tokens=31235, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:23:31] [Rank 1] totoal_tokens=30639, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:23:32] [Rank 2] totoal_tokens=32037, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 1'
[2024-08-03 15:23:33] [Rank 0] totoal_tokens=31236, outputs='```json\n{\n  "keys": [\n    {"value": 1, "location": "left"},\n    {"value": 2, "location'
[2024-08-03 15:23:33] [Rank 3] totoal_tokens=32265, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "bananas": 1},\n    {"number": 2, "'
[2024-08-03 15:23:34] [Rank 1] totoal_tokens=30899, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:23:35] [Rank 2] totoal_tokens=32057, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:35] [Rank 3] totoal_tokens=32374, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:23:36] [Rank 0] totoal_tokens=31287, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
�█████▊   | 524/765 [09:59<09:44,  2.42s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  69%|██████▊   | 525/765 [10:01<09:26,  2.36s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  69%|██████▉   | 526/765 [10:04<10:00,  2.51s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  69%|██████▉   | 527/765 [10:06<09:14,  2.33s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  69%|██████▉   | 528/765 [10:08<08:29,  2.15s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  69%|██████▉   | 529/765 [10:10<08:50,  2.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  69%|██████▉   | 530/765 [10:12<08:55,  2.28s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  69%|██████▉   | 531/765 [10:15<09:16,  2.38s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  70%|██████▉   | 532/765 [10:18<09:33,  2.46s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  70%|[2024-08-03 15:23:37] [Rank 2] totoal_tokens=32115, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:23:37] [Rank 1] totoal_tokens=31104, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:23:38] [Rank 3] totoal_tokens=32466, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:23:38] [Rank 0] totoal_tokens=31321, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:23:39] [Rank 2] totoal_tokens=32115, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:23:40] [Rank 1] totoal_tokens=31719, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:41] [Rank 2] totoal_tokens=32466, outputs='[4, 4, 4]'
[2024-08-03 15:23:41] [Rank 0] totoal_tokens=31383, outputs='```json\n{\n  "keys": [\n    "1",\n    "2",\n    "3",\n    "4",\n    "5",\n    "'
[2024-08-03 15:23:42] [Rank 3] totoal_tokens=32626, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:42] [Rank 1] totoal_tokens=32182, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:23:44] [Rank 0] totoal_tokens=32155, outputs='[1, 2, 3]'
[2024-08-03 15:23:44] [Rank 3] totoal_tokens=32938, outputs='[1, 2, 3]'
[2024-08-03 15:23:44] [Rank 2] totoal_tokens=33028, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "description": "Owl 1"},\n    {"number": 2'
[2024-08-03 15:23:45] [Rank 1] totoal_tokens=32210, outputs='```json\n{\n  "apple_count": 2\n}\n```'
[2024-08-03 15:23:46] [Rank 0] totoal_tokens=32206, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:23:47] [Rank 3] totoal_tokens=34574, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:47] [Rank 2] totoal_tokens=33188, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 2'
[2024-08-03 15:23:48] [Rank 1] totoal_tokens=32285, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:23:49] [Rank 0] totoal_tokens=32568, outputs='```json\n{\n  "keys": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:23:50] [Rank 2] totoal_tokens=33295, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:50] [Rank 3] totoal_tokens=34662, outputs='```json\n{\n  "vases": [\n    {"count": 1, "vase": "vase1"},\n    {"count":'
[2024-08-03 15:23:50] [Rank 1] totoal_tokens=32457, outputs='```json\n{\n  "result": 0\n}\n```'
[2024-08-03 15:23:51] [Rank 0] totoal_tokens=32651, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:23:52] [Rank 2] totoal_tokens=33412, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:23:53] [Rank 3] totoal_tokens=34672, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:23:53] [Rank 1] totoal_tokens=33041, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:23:54] [Rank 0] totoal_tokens=32866, outputs='[1, 2, 3]'
[2024-08-03 15:23:56] [Rank 3] totoal_tokens=35037, outputs='[1, 1, 1]'
[2024-08-03 15:23:56] [Rank 2] totoal_tokens=33645, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "description": "A pink brush with a white handle and a blue'
[2024-08-03 15:23:56] [Rank 0] totoal_tokens=33064, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:23:56] [Rank 1] totoal_tokens=33092, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:23:58] [Rank 0] totoal_tokens=33180, outputs='```json\n{\n  "bananas": 0\n}\n```'
██████▉   | 533/765 [10:21<09:59,  2.59s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  70%|██████▉   | 534/765 [10:23<09:45,  2.53s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  70%|██████▉   | 535/765 [10:26<10:15,  2.67s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  70%|███████   | 536/765 [10:28<09:45,  2.56s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  70%|███████   | 537/765 [10:30<09:13,  2.43s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  70%|███████   | 538/765 [10:34<10:07,  2.68s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  70%|███████   | 539/765 [10:36<09:57,  2.64s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  71%|███████   | 540/765 [10:38<09:14,  2.46s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  71%|███████   | 541/765 [10:41<09:09,  2.45s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  71[2024-08-03 15:23:58] [Rank 3] totoal_tokens=35053, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:23:59] [Rank 1] totoal_tokens=33197, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:23:59] [Rank 2] totoal_tokens=34012, outputs='```json\n{\n  "number_of_computers": 3\n}\n```'
[2024-08-03 15:24:01] [Rank 1] totoal_tokens=33489, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:01] [Rank 2] totoal_tokens=34140, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:24:02] [Rank 3] totoal_tokens=35149, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, white ceramic vase'
[2024-08-03 15:24:03] [Rank 0] totoal_tokens=33231, outputs='```json\n{\n  "lighthouse": [\n    "Penn in Touch",\n    "Billions",\n    "George",\n    "George",'
[2024-08-03 15:24:04] [Rank 1] totoal_tokens=33492, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:24:04] [Rank 2] totoal_tokens=34201, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:24:06] [Rank 3] totoal_tokens=35272, outputs='```json\n{\n  "number_of_★": 12\n}\n```'
[2024-08-03 15:24:06] [Rank 0] totoal_tokens=33285, outputs='```json\n{\n  "Apple Count": 0\n}\n```'
[2024-08-03 15:24:06] [Rank 2] totoal_tokens=34273, outputs='```json\n{\n  "lighthouse": 1\n}\n```'
[2024-08-03 15:24:06] [Rank 1] totoal_tokens=34087, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:24:08] [Rank 3] totoal_tokens=35371, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:24:09] [Rank 2] totoal_tokens=34520, outputs='```json\n{\n  "result": 3\n}\n```'
[2024-08-03 15:24:09] [Rank 1] totoal_tokens=34184, outputs='[1, 1, 1]'
[2024-08-03 15:24:09] [Rank 0] totoal_tokens=34083, outputs='```json\n{\n  "number_of_bananas": 0\n}\n```'
[2024-08-03 15:24:11] [Rank 3] totoal_tokens=35462, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:24:11] [Rank 0] totoal_tokens=34157, outputs='```json\n{\n  "number_of_keys": 0\n}\n```'
[2024-08-03 15:24:12] [Rank 2] totoal_tokens=34780, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "description": "Rose City Open in the Flight Crew\'s Back Yard'
[2024-08-03 15:24:12] [Rank 1] totoal_tokens=34585, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:14] [Rank 0] totoal_tokens=34191, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:24:15] [Rank 3] totoal_tokens=36033, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:24:16] [Rank 2] totoal_tokens=35067, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:24:16] [Rank 1] totoal_tokens=34850, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:24:16] [Rank 0] totoal_tokens=34243, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:24:18] [Rank 0] totoal_tokens=34282, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:24:18] [Rank 2] totoal_tokens=35122, outputs='[1, 1, 1]'
[2024-08-03 15:24:18] [Rank 3] totoal_tokens=36113, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:19] [Rank 1] totoal_tokens=34861, outputs='```json\n{\n  "lighthouse": [\n    {\n      "number": 1,\n      "description": "A family of four lives in a'
[2024-08-03 15:24:21] [Rank 0] totoal_tokens=34609, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "description": "Willow Tit"},\n    {"number": 2'
[2024-08-03 15:24:22] [Rank 2] totoal_tokens=35194, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "count": 1},\n    {"x": 2, "count'
[2024-08-03 15:24:22] [Rank 1] totoal_tokens=35043, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "description": "The first number is 1."},\n    {"number'
[2024-08-03 15:24:24] [Rank 0] totoal_tokens=35075, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
%|███████   | 542/765 [10:43<08:56,  2.40s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  71%|███████   | 543/765 [10:48<11:21,  3.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  71%|███████   | 544/765 [10:51<11:23,  3.09s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  71%|███████   | 545/765 [10:53<10:52,  2.97s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  71%|███████▏  | 546/765 [10:56<10:29,  2.87s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  72%|███████▏  | 547/765 [10:58<09:54,  2.73s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  72%|███████▏  | 548/765 [11:01<09:28,  2.62s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  72%|███████▏  | 549/765 [11:03<08:52,  2.47s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  72%|███████▏  | 550/765 [11:06<09:23,  2.62s/it]
Processing InternVL2-2B_counting-text-tes[2024-08-03 15:24:24] [Rank 3] totoal_tokens=36196, outputs='```json\n{\n  "computer_count": 0\n}\n```'
[2024-08-03 15:24:26] [Rank 2] totoal_tokens=35345, outputs='```json\n{\n  "questions": [\n    "Who invented Battle Golfer Yui?",\n    "Why is Battle Golfer Yui different from other'
[2024-08-03 15:24:26] [Rank 1] totoal_tokens=35096, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:27] [Rank 0] totoal_tokens=35562, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:28] [Rank 3] totoal_tokens=36309, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:29] [Rank 2] totoal_tokens=35497, outputs='{\n  "compass": [\n    {"x": 0, "x": 0, "x": 0},\n    {"x": 0,'
[2024-08-03 15:24:29] [Rank 1] totoal_tokens=35201, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:30] [Rank 0] totoal_tokens=35760, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the Power Not Paranoia framework?",\n      "answer": "'
[2024-08-03 15:24:31] [Rank 3] totoal_tokens=36569, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:32] [Rank 2] totoal_tokens=36036, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, dark, enclosed space'
[2024-08-03 15:24:32] [Rank 1] totoal_tokens=35212, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "x": 1, "x": 1},\n    {"x'
[2024-08-03 15:24:33] [Rank 0] totoal_tokens=35992, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:34] [Rank 3] totoal_tokens=36661, outputs='[1, 2, 3]'
[2024-08-03 15:24:35] [Rank 1] totoal_tokens=35971, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:38] [Rank 0] totoal_tokens=36090, outputs='```json\n{\n  "number_of_apples": 4\n}\n```'
[2024-08-03 15:24:39] [Rank 3] totoal_tokens=36710, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A beautiful vase with a floral'
[2024-08-03 15:24:39] [Rank 2] totoal_tokens=36066, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:39] [Rank 1] totoal_tokens=35979, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:42] [Rank 3] totoal_tokens=36720, outputs='```json\n{\n  "compass": [\n    {\n      "x": 0,\n      "x": 0,\n      "x": 0'
[2024-08-03 15:24:42] [Rank 1] totoal_tokens=36054, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:24:42] [Rank 2] totoal_tokens=36196, outputs='```json\n{\n  "title": "Tokyo Zombie",\n  "description": "A Japanese manga penned by U-saku Hanakuma,'
[2024-08-03 15:24:42] [Rank 0] totoal_tokens=36285, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:44] [Rank 3] totoal_tokens=36732, outputs='```json\n{\n  "apple_count": 2\n}\n```'
[2024-08-03 15:24:45] [Rank 2] totoal_tokens=36232, outputs='[1, 2, 3]'
[2024-08-03 15:24:45] [Rank 1] totoal_tokens=36094, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:45] [Rank 0] totoal_tokens=36393, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:24:47] [Rank 3] totoal_tokens=37021, outputs='[1, 1, 1]'
[2024-08-03 15:24:47] [Rank 2] totoal_tokens=36323, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:24:48] [Rank 1] totoal_tokens=36116, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:48] [Rank 0] totoal_tokens=36472, outputs='```json\n{\n  "brushes": 4\n}\n```'
[2024-08-03 15:24:50] [Rank 3] totoal_tokens=37084, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A black and white painting of a'
[2024-08-03 15:24:50] [Rank 2] totoal_tokens=36469, outputs='```json\n{\n  "brushes": [\n    {\n      "description": "A small, round brush with a black handle and a white bristle'
[2024-08-03 15:24:51] [Rank 1] totoal_tokens=36199, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:24:51] [Rank 0] totoal_tokens=36676, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:52] [Rank 3] totoal_tokens=37161, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:24:53] [Rank 2] totoal_tokens=36717, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:24:54] [Rank 1] totoal_tokens=36309, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:54] [Rank 0] totoal_tokens=36968, outputs='```json\n{\n  "key": "1, 2, 3, 4, 5, 6, 7, 8'
t.jsonl:  72%|███████▏  | 551/765 [11:09<09:43,  2.73s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  72%|███████▏  | 552/765 [11:12<09:53,  2.79s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  72%|███████▏  | 553/765 [11:15<09:58,  2.82s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  72%|███████▏  | 554/765 [11:18<10:23,  2.95s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  73%|███████▎  | 555/765 [11:23<12:24,  3.55s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  73%|███████▎  | 556/765 [11:27<13:05,  3.76s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  73%|███████▎  | 557/765 [11:30<12:05,  3.49s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  73%|███████▎  | 558/765 [11:33<11:29,  3.33s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  73%|███████▎  | 559/765 [11:36<10:59,  3.20s/it]
Processing InternVL2-[2024-08-03 15:24:55] [Rank 3] totoal_tokens=37247, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:57] [Rank 1] totoal_tokens=36311, outputs='```json\n{\n  "title": "Jane Goodall\'s Books, Through a Window, In the Shadow of Man, and The Chimpan'
[2024-08-03 15:24:57] [Rank 0] totoal_tokens=37034, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:24:58] [Rank 3] totoal_tokens=37262, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:24:58] [Rank 2] totoal_tokens=36740, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:24:59] [Rank 1] totoal_tokens=36429, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:25:00] [Rank 0] totoal_tokens=37035, outputs='```json\n{\n  "result": 3\n}\n```'
[2024-08-03 15:25:01] [Rank 3] totoal_tokens=37307, outputs='```json\n{\n  "number_of_trees": 0\n}\n```'
[2024-08-03 15:25:01] [Rank 2] totoal_tokens=36768, outputs='```json\n{\n  "total": 0\n}\n```'
[2024-08-03 15:25:01] [Rank 1] totoal_tokens=36480, outputs='[1, 1, 1]'
[2024-08-03 15:25:02] [Rank 0] totoal_tokens=37040, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:25:03] [Rank 2] totoal_tokens=36773, outputs='[1, 2, 3]'
[2024-08-03 15:25:04] [Rank 1] totoal_tokens=36631, outputs='[1, 1, 1]'
[2024-08-03 15:25:04] [Rank 3] totoal_tokens=37507, outputs='```json\n{\n  "characters": [\n    "Thor Odinson",\n    "Kevin Ayers",\n    "Odin",\n    "Hela'
[2024-08-03 15:25:05] [Rank 0] totoal_tokens=37156, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:06] [Rank 2] totoal_tokens=36940, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:06] [Rank 1] totoal_tokens=36670, outputs='[1, 1, 1]'
[2024-08-03 15:25:07] [Rank 3] totoal_tokens=37663, outputs='[1, 1, 1]'
[2024-08-03 15:25:08] [Rank 0] totoal_tokens=37174, outputs='[1, 1, 1]'
[2024-08-03 15:25:09] [Rank 2] totoal_tokens=37031, outputs='[1, 1, 1]'
[2024-08-03 15:25:09] [Rank 1] totoal_tokens=36801, outputs='[1, 2, 3]'
[2024-08-03 15:25:10] [Rank 3] totoal_tokens=37680, outputs='```json\n{\n  "apple_count": 3\n}\n```'
[2024-08-03 15:25:12] [Rank 2] totoal_tokens=37215, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:13] [Rank 3] totoal_tokens=37800, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:25:13] [Rank 1] totoal_tokens=36852, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, white ceramic vase'
[2024-08-03 15:25:14] [Rank 0] totoal_tokens=37226, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:15] [Rank 2] totoal_tokens=37224, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:25:15] [Rank 1] totoal_tokens=36981, outputs='[3, 3, 3]'
[2024-08-03 15:25:16] [Rank 3] totoal_tokens=38025, outputs='{"Apple": 3, "iPhones": 3, "AirPods": 3}'
[2024-08-03 15:25:17] [Rank 0] totoal_tokens=37303, outputs='[1, 2, 3]'
[2024-08-03 15:25:18] [Rank 2] totoal_tokens=37327, outputs='```json\n{\n  "brushes": [\n    {\n      "x": 0,\n      "y": 0,\n      "width":'
[2024-08-03 15:25:18] [Rank 1] totoal_tokens=37006, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:18] [Rank 3] totoal_tokens=38155, outputs='```json\n{\n  "number_of_apples": 0\n}\n```'
[2024-08-03 15:25:20] [Rank 0] totoal_tokens=37441, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A small brush with a white handle'
[2024-08-03 15:25:21] [Rank 2] totoal_tokens=37388, outputs='```json\n{\n  "items": [\n    {\n      "name": "Lost Ark",\n      "item_level": 1\n    },\n    {'
[2024-08-03 15:25:21] [Rank 1] totoal_tokens=37302, outputs='```json\n{\n  "number_of_★": 1\n}\n```'
[2024-08-03 15:25:21] [Rank 3] totoal_tokens=38220, outputs='[1, 2, 3]'
[2024-08-03 15:25:22] [Rank 0] totoal_tokens=37546, outputs='[1, 1, 1]'
2B_counting-text-test.jsonl:  73%|███████▎  | 560/765 [11:39<10:45,  3.15s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  73%|███████▎  | 561/765 [11:42<10:39,  3.14s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  73%|███████▎  | 562/765 [11:44<09:57,  2.94s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  74%|███████▎  | 563/765 [11:47<09:24,  2.79s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  74%|███████▎  | 564/765 [11:50<09:39,  2.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  74%|███████▍  | 565/765 [11:53<09:36,  2.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  74%|███████▍  | 566/765 [11:59<12:51,  3.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  74%|███████▍  | 567/765 [12:01<11:16,  3.42s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  74%|███████▍  | 568/765 [12:05<10:53,  3.32s/it]
P[2024-08-03 15:25:24] [Rank 1] totoal_tokens=37379, outputs='```json\n{\n  "compass": [\n    {"x": 0, "x": 0, "x": 0},\n    {"x'
[2024-08-03 15:25:24] [Rank 2] totoal_tokens=37627, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:25:24] [Rank 3] totoal_tokens=38351, outputs='[1, 1, 1]'
[2024-08-03 15:25:26] [Rank 0] totoal_tokens=37601, outputs='```json\n{\n  "stepwells": 1,\n  "vavs": 1,\n  "baolis": 1\n}'
[2024-08-03 15:25:27] [Rank 1] totoal_tokens=37643, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:25:27] [Rank 3] totoal_tokens=38352, outputs='```json\n{\n  "number_of_keys": 5\n}\n```'
[2024-08-03 15:25:27] [Rank 2] totoal_tokens=37700, outputs='```json\n{\n  "excess_kurtosis": 0.5\n}\n```'
[2024-08-03 15:25:29] [Rank 0] totoal_tokens=37609, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:30] [Rank 1] totoal_tokens=37724, outputs='```json\n{\n  "keys": [\n    "0",\n    "1",\n    "2",\n    "3",\n    "4",\n    "'
[2024-08-03 15:25:30] [Rank 2] totoal_tokens=38087, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the ghost town that was once called Maori Creek'
[2024-08-03 15:25:30] [Rank 3] totoal_tokens=38382, outputs='```json\n{\n  "lighthouse": [\n    "Antara",\n    "Jakarta",\n    "Johan Budi",\n    "'
[2024-08-03 15:25:32] [Rank 0] totoal_tokens=37630, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the museum?",\n      "answer": "The National'
[2024-08-03 15:25:33] [Rank 1] totoal_tokens=37960, outputs='```json\n{\n  "number_of_owls": 0\n}\n```'
[2024-08-03 15:25:33] [Rank 3] totoal_tokens=38394, outputs='```json\n{\n  "lighthouse": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:25:34] [Rank 2] totoal_tokens=38299, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:25:36] [Rank 1] totoal_tokens=37978, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:25:36] [Rank 0] totoal_tokens=37753, outputs='```json\n{\n  "lighthouses": [\n    {\n      "location": "Kilimanjaro",\n      "description": "Aster'
[2024-08-03 15:25:36] [Rank 3] totoal_tokens=38412, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:25:36] [Rank 2] totoal_tokens=38441, outputs='[1, 1, 1]'
[2024-08-03 15:25:38] [Rank 3] totoal_tokens=38494, outputs='[1, 2, 3]'
[2024-08-03 15:25:38] [Rank 0] totoal_tokens=37844, outputs='```json\n{\n  "number_of_computers": 3\n}\n```'
[2024-08-03 15:25:39] [Rank 2] totoal_tokens=38442, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:25:39] [Rank 1] totoal_tokens=38049, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "description": "The number 1"},\n    {"number": 2'
[2024-08-03 15:25:41] [Rank 0] totoal_tokens=37869, outputs='[1, 2, 3]'
[2024-08-03 15:25:41] [Rank 3] totoal_tokens=38650, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:25:41] [Rank 2] totoal_tokens=38485, outputs='[1, 2, 3]'
[2024-08-03 15:25:42] [Rank 1] totoal_tokens=38100, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:25:44] [Rank 3] totoal_tokens=38827, outputs='[1, 2, 3]'
[2024-08-03 15:25:45] [Rank 0] totoal_tokens=38211, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "description": "The first number in the list"},\n    {"number":'
[2024-08-03 15:25:45] [Rank 1] totoal_tokens=38154, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:25:45] [Rank 2] totoal_tokens=38511, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:47] [Rank 3] totoal_tokens=39131, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:48] [Rank 1] totoal_tokens=38689, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:25:48] [Rank 0] totoal_tokens=38350, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the new version of Messenger for iOS?",\n      "'
rocessing InternVL2-2B_counting-text-test.jsonl:  74%|███████▍  | 569/765 [12:07<10:09,  3.11s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  75%|███████▍  | 570/765 [12:10<10:17,  3.17s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  75%|███████▍  | 571/765 [12:13<10:05,  3.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  75%|███████▍  | 572/765 [12:17<09:57,  3.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  75%|███████▍  | 573/765 [12:20<10:33,  3.30s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  75%|███████▌  | 574/765 [12:23<09:57,  3.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  75%|███████▌  | 575/765 [12:25<09:15,  2.92s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  75%|███████▌  | 576/765 [12:29<10:02,  3.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  75%|███████▌  | 577/765 [12:33[2024-08-03 15:25:49] [Rank 2] totoal_tokens=38555, outputs='```json\n{\n  "compass": [\n    {\n      "x": 0,\n      "x": 0,\n      "x": 0'
[2024-08-03 15:25:50] [Rank 3] totoal_tokens=39271, outputs='```json\n{\n  "number_of_bananas": 4\n}\n```'
[2024-08-03 15:25:51] [Rank 0] totoal_tokens=38352, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:25:51] [Rank 1] totoal_tokens=38914, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:25:52] [Rank 2] totoal_tokens=38561, outputs='```json\n{\n  "number_of_★": 10\n}\n```'
[2024-08-03 15:25:53] [Rank 3] totoal_tokens=39281, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:25:53] [Rank 0] totoal_tokens=38509, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:25:55] [Rank 2] totoal_tokens=39215, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A plastic skeleton"\n    },'
[2024-08-03 15:25:56] [Rank 3] totoal_tokens=39341, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:25:56] [Rank 1] totoal_tokens=39078, outputs='```json\n{\n  "vases": [\n    {"number": 1, "description": "A small, round, black vase"},'
[2024-08-03 15:25:56] [Rank 0] totoal_tokens=38688, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:25:59] [Rank 0] totoal_tokens=38919, outputs='[1, 2, 3]'
[2024-08-03 15:25:59] [Rank 3] totoal_tokens=39346, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:25:59] [Rank 1] totoal_tokens=39110, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:25:59] [Rank 2] totoal_tokens=39242, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A small brush with a pink handle'
[2024-08-03 15:26:02] [Rank 0] totoal_tokens=38927, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:02] [Rank 3] totoal_tokens=39390, outputs='```json\n{\n  "computer_count": 1\n}\n```'
[2024-08-03 15:26:02] [Rank 1] totoal_tokens=39191, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:26:02] [Rank 2] totoal_tokens=39256, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:26:05] [Rank 3] totoal_tokens=39721, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:26:05] [Rank 1] totoal_tokens=39242, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:26:06] [Rank 0] totoal_tokens=39250, outputs='```json\n{\n  "lighthouse": [\n    "Lighthouse 1",\n    "Lighthouse 2",\n    "Lighthouse 3"'
[2024-08-03 15:26:06] [Rank 2] totoal_tokens=39284, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:26:08] [Rank 3] totoal_tokens=39993, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:26:08] [Rank 1] totoal_tokens=39343, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:26:09] [Rank 0] totoal_tokens=39269, outputs='```json\n{\n  "compass": [\n    {\n      "number": 1,\n      "description": "Carlin"\n    },\n    {'
[2024-08-03 15:26:09] [Rank 2] totoal_tokens=39341, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, clear vase with'
[2024-08-03 15:26:11] [Rank 1] totoal_tokens=39508, outputs='[1, 1, 1]'
[2024-08-03 15:26:11] [Rank 3] totoal_tokens=40013, outputs='```json\n{\n  "penguins": [\n    {\n      "name": "Augustina Higuera",\n      "age": 29,\n      "'
[2024-08-03 15:26:12] [Rank 0] totoal_tokens=39786, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:13] [Rank 2] totoal_tokens=39492, outputs='```json\n{\n  "computer": 3,\n  "computer_by": 3,\n  "computer_by_and": 3,\n  "computer'
[2024-08-03 15:26:15] [Rank 1] totoal_tokens=39717, outputs='```json\n{\n  "apple_count": 4\n}\n```'
[2024-08-03 15:26:15] [Rank 3] totoal_tokens=40298, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:26:15] [Rank 0] totoal_tokens=39835, outputs='```json\n{\n  "key": "1, 2, 3, 4, 5, 6, 7, 8'
<10:22,  3.31s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  76%|███████▌  | 578/765 [12:35<09:40,  3.11s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  76%|███████▌  | 579/765 [12:38<09:16,  2.99s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  76%|███████▌  | 580/765 [12:41<08:50,  2.87s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  76%|███████▌  | 581/765 [12:43<08:27,  2.76s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  76%|███████▌  | 582/765 [12:47<08:55,  2.93s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  76%|███████▌  | 583/765 [12:50<09:36,  3.17s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  76%|███████▋  | 584/765 [12:54<09:36,  3.18s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  76%|███████▋  | 585/765 [12:57<09:45,  3.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  77%|███████�[2024-08-03 15:26:17] [Rank 2] totoal_tokens=39659, outputs='{\n  "miles": 40,\n  "segments": [\n    {\n      "origin": "Chicago",\n      "destination": "New York",'
[2024-08-03 15:26:18] [Rank 1] totoal_tokens=40003, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:19] [Rank 3] totoal_tokens=40356, outputs='```json\n{\n  "vases": [\n    {"count": 1},\n    {"count": 1},\n    {"count": 1}'
[2024-08-03 15:26:19] [Rank 2] totoal_tokens=39971, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:26:21] [Rank 1] totoal_tokens=40338, outputs='```json\n{\n  "vases": [\n    "1",\n    "2",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:26:22] [Rank 0] totoal_tokens=40021, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:22] [Rank 3] totoal_tokens=40375, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:23] [Rank 2] totoal_tokens=40048, outputs='```json\n{\n  "number_of_keys": 1\n}\n```'
[2024-08-03 15:26:24] [Rank 1] totoal_tokens=40353, outputs='```json\n{\n  "key": 0\n}\n```'
[2024-08-03 15:26:25] [Rank 0] totoal_tokens=40102, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:26:25] [Rank 3] totoal_tokens=40530, outputs='[1, 1, 1]'
[2024-08-03 15:26:27] [Rank 2] totoal_tokens=40156, outputs='```json\n{\n  "Chet Baker": 1,\n  "Chet Baker: His Life and Music": 1,\n  "Chet'
[2024-08-03 15:26:28] [Rank 0] totoal_tokens=40191, outputs='```json\n{\n  "results": [\n    {\n      "match": "Firefly Lane",\n      "key": 1\n    },\n    {'
[2024-08-03 15:26:28] [Rank 3] totoal_tokens=40999, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:26:28] [Rank 1] totoal_tokens=40420, outputs='```json\n{\n  "question": "What is the name of the woman who served as an unofficial social liaison for U.S. Central Command during'
[2024-08-03 15:26:29] [Rank 2] totoal_tokens=40359, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:26:31] [Rank 1] totoal_tokens=40484, outputs='[1, 2, 3]'
[2024-08-03 15:26:31] [Rank 0] totoal_tokens=40410, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "description": "A red and white painted mansion"},\n    {"number'
[2024-08-03 15:26:32] [Rank 3] totoal_tokens=41093, outputs='```json\n{\n  "keys": [\n    {"value": 1},\n    {"value": 2},\n    {"value": 3},'
[2024-08-03 15:26:33] [Rank 2] totoal_tokens=40382, outputs='```json\n{\n  "key": "Marshall created a name for herself through her hard work and creativity at a time when female filmmakers were even'
[2024-08-03 15:26:34] [Rank 0] totoal_tokens=40599, outputs='[1, 1, 1]'
[2024-08-03 15:26:34] [Rank 1] totoal_tokens=40527, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A vase with a floral design'
[2024-08-03 15:26:35] [Rank 3] totoal_tokens=41168, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:26:37] [Rank 2] totoal_tokens=40488, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:26:37] [Rank 0] totoal_tokens=40748, outputs='```json\n{\n  "characters": [\n    {\n      "name": "Ellie",\n      "role": "Voice Actress"\n    },\n    {'
[2024-08-03 15:26:38] [Rank 1] totoal_tokens=40587, outputs='```json\n{\n  "title": "Happy and Glorious",\n  "items": [\n    {\n      "description": "Prince of Wales Invest'
[2024-08-03 15:26:38] [Rank 3] totoal_tokens=41337, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the festival that was held in San Francisco?",'
[2024-08-03 15:26:39] [Rank 2] totoal_tokens=40532, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:26:40] [Rank 0] totoal_tokens=40820, outputs='```json\n{\n  "text": "The question is: can an old man who knows nothing about mobile phones, the internet or social media possibly solve'
[2024-08-03 15:26:42] [Rank 1] totoal_tokens=40597, outputs='```json\n{\n  "key": "1, 2, 3, 4, 5, 6, 7, 8'
[2024-08-03 15:26:42] [Rank 3] totoal_tokens=41622, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:26:42] [Rank 2] totoal_tokens=40785, outputs='```json\n{\n  "compass_count": 0\n}\n```'
[2024-08-03 15:26:44] [Rank 0] totoal_tokens=41011, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:45] [Rank 1] totoal_tokens=40769, outputs='```json\n{\n  "vases": [\n    {"number": 1, "vase": "vase1"},\n    {"number":'
[2024-08-03 15:26:45] [Rank 3] totoal_tokens=41856, outputs='```json\n{\n  "number_of_apples": 0\n}\n```'
[2024-08-03 15:26:45] [Rank 2] totoal_tokens=40870, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A black and white picture of Ven'
[2024-08-03 15:26:46] [Rank 0] totoal_tokens=41168, outputs='```json\n{\n  "number_of_owls": 0\n}\n```'
��  | 586/765 [13:00<09:38,  3.23s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  77%|███████▋  | 587/765 [13:07<12:21,  4.17s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  77%|███████▋  | 588/765 [13:09<11:05,  3.76s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  77%|███████▋  | 589/765 [13:12<10:30,  3.58s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  77%|███████▋  | 590/765 [13:16<10:29,  3.60s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  77%|███████▋  | 591/765 [13:19<09:27,  3.26s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  77%|███████▋  | 592/765 [13:22<09:20,  3.24s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  78%|███████▊  | 593/765 [13:25<09:23,  3.28s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  78%|███████▊  | 594/765 [13:28<09:15,  3.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  78%|�[2024-08-03 15:26:48] [Rank 1] totoal_tokens=40819, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:48] [Rank 3] totoal_tokens=42030, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:26:50] [Rank 2] totoal_tokens=41106, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:50] [Rank 0] totoal_tokens=41444, outputs='```json\n{\n  "title": "The Bugatti Trust",\n  "description": "The Bugatti Trust is an independent Charitable Trust whose objectives'
[2024-08-03 15:26:51] [Rank 1] totoal_tokens=41011, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:52] [Rank 3] totoal_tokens=42142, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the company that offers balloon animals?",\n      "answer'
[2024-08-03 15:26:53] [Rank 2] totoal_tokens=41110, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A red and white striped brush'
[2024-08-03 15:26:54] [Rank 3] totoal_tokens=42199, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:26:54] [Rank 0] totoal_tokens=41563, outputs='```json\n{\n  "number_of_bananas": 1\n}\n```'
[2024-08-03 15:26:55] [Rank 1] totoal_tokens=41570, outputs='```json\n{\n  "key": 1,\n  "key": 2,\n  "key": 3,\n  "key": 4'
[2024-08-03 15:26:57] [Rank 2] totoal_tokens=41230, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:26:58] [Rank 1] totoal_tokens=42057, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:26:58] [Rank 0] totoal_tokens=41736, outputs='```json\n{\n  "title": "Quadrophenia",\n  "release_date": "1972",\n  "followed_by": "Who'
[2024-08-03 15:26:58] [Rank 3] totoal_tokens=42343, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:27:01] [Rank 1] totoal_tokens=42952, outputs='[1, 1, 1]'
[2024-08-03 15:27:01] [Rank 2] totoal_tokens=41341, outputs='```json\n{\n  "number_of_computers": 1\n}\n```'
[2024-08-03 15:27:01] [Rank 0] totoal_tokens=41892, outputs='```json\n{\n  "key": 1\n}\n```'
[2024-08-03 15:27:01] [Rank 3] totoal_tokens=42355, outputs='[1, 1, 1]'
[2024-08-03 15:27:04] [Rank 3] totoal_tokens=42689, outputs='[1, 1, 1]'
[2024-08-03 15:27:04] [Rank 2] totoal_tokens=41497, outputs='```json\n{\n  "trees": [\n    {\n      "number": 1,\n      "description": "Tinkerbell and friends name a'
[2024-08-03 15:27:04] [Rank 1] totoal_tokens=43153, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:27:04] [Rank 0] totoal_tokens=42074, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A simple white vase"'
[2024-08-03 15:27:08] [Rank 2] totoal_tokens=41672, outputs='```json\n{\n  "lighthouse": [\n    "Three Vajras",\n    "Three Roots",\n    "Three Mysteries",\n    "'
[2024-08-03 15:27:08] [Rank 3] totoal_tokens=43202, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:27:08] [Rank 1] totoal_tokens=43184, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:27:09] [Rank 0] totoal_tokens=42128, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:27:10] [Rank 3] totoal_tokens=43299, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:27:11] [Rank 2] totoal_tokens=42051, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:27:13] [Rank 0] totoal_tokens=42288, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:27:13] [Rank 1] totoal_tokens=43263, outputs='```json\n{\n  "number_of_apples": 3\n}\n```'
[2024-08-03 15:27:14] [Rank 3] totoal_tokens=43397, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:27:14] [Rank 2] totoal_tokens=42064, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:27:16] [Rank 0] totoal_tokens=42396, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:27:16] [Rank 1] totoal_tokens=43444, outputs='```json\n{\n  "owl_count": 3\n}\n```'
[2024-08-03 15:27:17] [Rank 3] totoal_tokens=43658, outputs='```json\n{\n  "Sydney": 11,\n  "Melbourne": 29\n}\n```'
[2024-08-03 15:27:18] [Rank 2] totoal_tokens=42071, outputs='```json\n{\n  "compasses": [\n    {\n      "number": 1,\n      "description": "The first compass is a 4'
[2024-08-03 15:27:19] [Rank 1] totoal_tokens=43450, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:27:20] [Rank 0] totoal_tokens=42766, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
�██████▊  | 595/765 [13:31<08:47,  3.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  78%|███████▊  | 596/765 [13:35<09:16,  3.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  78%|███████▊  | 597/765 [13:39<10:06,  3.61s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  78%|███████▊  | 598/765 [13:43<09:53,  3.56s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  78%|███████▊  | 599/765 [13:46<09:24,  3.40s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  78%|███████▊  | 600/765 [13:49<09:28,  3.45s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  79%|███████▊  | 601/765 [13:54<10:41,  3.91s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  79%|███████▊  | 602/765 [13:58<10:13,  3.77s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  79%|███████▉  | 603/765 [14:01<09:32,  3.54s/it]
Processing InternVL2-2B_counting-text[2024-08-03 15:27:20] [Rank 3] totoal_tokens=44057, outputs='[1, 1, 1]'
[2024-08-03 15:27:21] [Rank 2] totoal_tokens=42117, outputs='```json\n{\n  "brushes": [\n    "3",\n    "3",\n    "3"\n  ]\n}\n```'
[2024-08-03 15:27:23] [Rank 0] totoal_tokens=43014, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:27:23] [Rank 1] totoal_tokens=43567, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:27:23] [Rank 3] totoal_tokens=44085, outputs='```json\n{\n  "lighthouses": [\n    {\n      "location": "South Atlantic Ocean",\n      "description": "The shipwreck'
[2024-08-03 15:27:24] [Rank 2] totoal_tokens=42308, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:27:26] [Rank 0] totoal_tokens=43077, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:27:26] [Rank 1] totoal_tokens=44063, outputs='```json\n{\n  "number_of_trees": 0\n}\n```'
[2024-08-03 15:27:28] [Rank 3] totoal_tokens=44968, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A black and white photo of a'
[2024-08-03 15:27:28] [Rank 2] totoal_tokens=42794, outputs='```json\n{\n  "brushes": [\n    {"number": 1, "description": "Shameka Pollard"},\n    {"number":'
[2024-08-03 15:27:29] [Rank 0] totoal_tokens=43105, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:27:30] [Rank 1] totoal_tokens=44394, outputs='```json\n{\n  "compass": [\n    [0, 0, 0],\n    [0, 0, 0],\n    ['
[2024-08-03 15:27:31] [Rank 3] totoal_tokens=45018, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:27:31] [Rank 2] totoal_tokens=42934, outputs='```json\n{\n  "brushes": [\n    {"count": 1, "color": "red"},\n    {"count": 1, "'
[2024-08-03 15:27:32] [Rank 0] totoal_tokens=43262, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:27:33] [Rank 1] totoal_tokens=44572, outputs='```json\n{\n  "number_of_lighthouses": 0\n}\n```'
[2024-08-03 15:27:35] [Rank 2] totoal_tokens=42952, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:27:35] [Rank 3] totoal_tokens=45507, outputs='{"text": "I have no answer to your question at this time.", "confidence": 0.9}'
[2024-08-03 15:27:36] [Rank 0] totoal_tokens=43692, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:27:36] [Rank 1] totoal_tokens=44606, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:27:40] [Rank 2] totoal_tokens=43164, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:27:40] [Rank 0] totoal_tokens=44178, outputs='```json\n{\n  "builds": [\n    {\n      "build": "Spark Plug",\n      "star_power": "Energize"'
[2024-08-03 15:27:40] [Rank 1] totoal_tokens=44661, outputs='```json\n{\n  "question": "What is the name of the house where Jill Kelley and her family live?",\n  "answer": "The'
[2024-08-03 15:27:40] [Rank 3] totoal_tokens=45517, outputs='```json\n{\n  "lighthouse": [\n    "Blore Bay",\n    "Burnt Bridge",\n    "Burnt Bridge",'
[2024-08-03 15:27:44] [Rank 0] totoal_tokens=44391, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A beautiful vase with a floral'
[2024-08-03 15:27:44] [Rank 2] totoal_tokens=43294, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:27:44] [Rank 3] totoal_tokens=46078, outputs='```json\n{\n  "number_of_vases": 5\n}\n```'
[2024-08-03 15:27:44] [Rank 1] totoal_tokens=45037, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:27:47] [Rank 2] totoal_tokens=43425, outputs='```json\n{\n  "key_count": 4\n}\n```'
[2024-08-03 15:27:48] [Rank 1] totoal_tokens=45234, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:27:48] [Rank 3] totoal_tokens=46590, outputs='```json\n{\n  "number_of_brushes": 0\n}\n```'
[2024-08-03 15:27:49] [Rank 0] totoal_tokens=44502, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 1, "x": 2, "x'
[2024-08-03 15:27:50] [Rank 2] totoal_tokens=43832, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "Task Force for Global Health"'
[2024-08-03 15:27:51] [Rank 3] totoal_tokens=46632, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:27:52] [Rank 1] totoal_tokens=45409, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "description": "The first number in the list"},\n    {"number":'
[2024-08-03 15:27:52] [Rank 0] totoal_tokens=44530, outputs='```json\n{\n  "computer_count": 3\n}\n```'
-test.jsonl:  79%|███████▉  | 604/765 [14:04<09:35,  3.57s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  79%|███████▉  | 605/765 [14:07<09:07,  3.42s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  79%|███████▉  | 606/765 [14:10<08:40,  3.27s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  79%|███████▉  | 607/765 [14:14<08:56,  3.40s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  79%|███████▉  | 608/765 [14:17<08:27,  3.23s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  80%|███████▉  | 609/765 [14:21<08:50,  3.40s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  80%|███████▉  | 610/765 [14:25<09:19,  3.61s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  80%|███████▉  | 611/765 [14:28<09:16,  3.62s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  80%|████████  | 612/765 [14:34<10:33,  4.14s/it]
Processing Intern[2024-08-03 15:27:53] [Rank 2] totoal_tokens=43854, outputs='[1, 1, 1]'
[2024-08-03 15:27:54] [Rank 3] totoal_tokens=47091, outputs='[1, 2, 3]'
[2024-08-03 15:27:55] [Rank 1] totoal_tokens=45494, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:27:56] [Rank 2] totoal_tokens=43997, outputs='{"x": 1}'
[2024-08-03 15:27:56] [Rank 0] totoal_tokens=44657, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the festival celebrated by the Oromo people?",'
[2024-08-03 15:27:58] [Rank 3] totoal_tokens=47928, outputs='{"x": 2, "x": 2, "x": 2}'
[2024-08-03 15:27:59] [Rank 2] totoal_tokens=44083, outputs='[1, 1, 1]'
[2024-08-03 15:27:59] [Rank 0] totoal_tokens=44699, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:27:59] [Rank 1] totoal_tokens=45720, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:28:02] [Rank 3] totoal_tokens=48099, outputs='```json\n{\n  "compass": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:28:03] [Rank 2] totoal_tokens=45038, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 0, "x": 0},\n    {"'
[2024-08-03 15:28:03] [Rank 1] totoal_tokens=46295, outputs='```json\n{\n  "compass": [\n    {\n      "number": 1,\n      "description": "A compass is a device used to determine'
[2024-08-03 15:28:04] [Rank 0] totoal_tokens=45190, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:28:06] [Rank 2] totoal_tokens=45312, outputs='{"bananas": 3}'
[2024-08-03 15:28:06] [Rank 3] totoal_tokens=48123, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the ship that was captured by the 54 Afr'
[2024-08-03 15:28:07] [Rank 1] totoal_tokens=46412, outputs='```json\n{\n  "vases": [\n    "vase1",\n    "vase2",\n    "vase3"\n  ]\n}'
[2024-08-03 15:28:07] [Rank 0] totoal_tokens=45454, outputs='```json\n{\n  "lighthouse_count": 1\n}\n```'
[2024-08-03 15:28:09] [Rank 2] totoal_tokens=46264, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:28:09] [Rank 3] totoal_tokens=48181, outputs='[1, 1, 1]'
[2024-08-03 15:28:10] [Rank 1] totoal_tokens=46572, outputs='```json\n{\n  "Tom Brady Childhood Story": "Tom Brady was born on August 3, 1977, in San Mateo,'
[2024-08-03 15:28:12] [Rank 0] totoal_tokens=45478, outputs='{\n  "questions": [\n    "what is a multimodal system?",\n    "why are multimodal systems important?",\n    "what is a mult'
[2024-08-03 15:28:13] [Rank 2] totoal_tokens=47095, outputs='```json\n{\n  "monkies": [\n    {\n      "label": "Monkey",\n      "description": "Monkey is a puzzle'
[2024-08-03 15:28:13] [Rank 3] totoal_tokens=48375, outputs='{"brushes": [1, 2, 3]}'
[2024-08-03 15:28:14] [Rank 1] totoal_tokens=46581, outputs='```json\n{\n  "Tom Brady Childhood Story": "Tom Brady was born on August 3, 1977, in San Mateo,'
[2024-08-03 15:28:15] [Rank 0] totoal_tokens=45653, outputs='```json\n{\n  "number_of_trees": 0\n}\n```'
[2024-08-03 15:28:17] [Rank 3] totoal_tokens=48499, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:28:17] [Rank 2] totoal_tokens=47392, outputs='```json\n{\n  "owl_count": 2\n}\n```'
[2024-08-03 15:28:18] [Rank 1] totoal_tokens=46763, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:28:18] [Rank 0] totoal_tokens=46215, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:28:20] [Rank 3] totoal_tokens=48577, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:28:21] [Rank 2] totoal_tokens=47526, outputs='```json\n{\n  "chests": [\n    {\n      "number": 1,\n      "description": "Netta Barzilai"'
[2024-08-03 15:28:22] [Rank 0] totoal_tokens=46852, outputs='```json\n{\n  "owl_count": 3\n}\n```'
VL2-2B_counting-text-test.jsonl:  80%|████████  | 613/765 [14:37<09:53,  3.91s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  80%|████████  | 614/765 [14:41<09:51,  3.92s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  80%|████████  | 615/765 [14:44<09:06,  3.65s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  81%|████████  | 616/765 [14:49<09:44,  3.92s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  81%|████████  | 617/765 [14:52<09:12,  3.74s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  81%|████████  | 618/765 [14:56<09:44,  3.98s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  81%|████████  | 619/765 [15:00<09:12,  3.78s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  81%|████████  | 620/765 [15:03<08:50,  3.66s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  81%|████████  | 621/765 [15:07<08:38,  3.60s/i[2024-08-03 15:28:23] [Rank 1] totoal_tokens=46802, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:28:25] [Rank 3] totoal_tokens=48688, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:28:26] [Rank 2] totoal_tokens=47607, outputs='```json\n{\n  "vases": [\n    "vase1",\n    "vase2",\n    "vase3"\n  ]\n}'
[2024-08-03 15:28:26] [Rank 0] totoal_tokens=46954, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:28:28] [Rank 3] totoal_tokens=48962, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:28:28] [Rank 1] totoal_tokens=46967, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:28:30] [Rank 2] totoal_tokens=47611, outputs='```json\n{\n  "owl_count": 1\n}\n```'
[2024-08-03 15:28:30] [Rank 0] totoal_tokens=47205, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:28:32] [Rank 3] totoal_tokens=49025, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:28:32] [Rank 1] totoal_tokens=46969, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A single brush"\n    },'
[2024-08-03 15:28:33] [Rank 2] totoal_tokens=47735, outputs='[1, 1, 1]'
[2024-08-03 15:28:34] [Rank 0] totoal_tokens=47720, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:28:35] [Rank 1] totoal_tokens=46980, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:28:35] [Rank 3] totoal_tokens=49467, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:28:37] [Rank 2] totoal_tokens=48303, outputs='```json\n{\n  "lighthouse": [\n    {\n      "number": 1,\n      "description": "The pastor was arrested for soliciting'
[2024-08-03 15:28:38] [Rank 0] totoal_tokens=47743, outputs='[1, 1, 1]'
[2024-08-03 15:28:39] [Rank 3] totoal_tokens=49485, outputs='```json\n{\n  "vases": [\n    "Ultramarines",\n    "Ultramarines",\n    "Ultr'
[2024-08-03 15:28:40] [Rank 1] totoal_tokens=47078, outputs='```json\n{\n  "tree_count": 3\n}\n```'
[2024-08-03 15:28:40] [Rank 2] totoal_tokens=48519, outputs='```json\n{\n  "number_of_computers": 3\n}\n```'
[2024-08-03 15:28:41] [Rank 0] totoal_tokens=48742, outputs='```json\n{\n  "number_of_owls": 0\n}\n```'
[2024-08-03 15:28:42] [Rank 3] totoal_tokens=49493, outputs='```json\n{\n  "Ultramarines": 1,\n  "Space Marines": 1\n}\n```'
[2024-08-03 15:28:45] [Rank 1] totoal_tokens=47141, outputs='```json\n{\n  "compass": [\n    "N",\n    "N",\n    "N",\n    "N",\n    "N",\n    "'
[2024-08-03 15:28:45] [Rank 2] totoal_tokens=48687, outputs='[1, 1, 1]'
[2024-08-03 15:28:46] [Rank 3] totoal_tokens=49682, outputs='```json\n{\n  "Apple": 3,\n  "Pokémon Go": 3\n}\n```'
[2024-08-03 15:28:48] [Rank 2] totoal_tokens=48815, outputs='{"x": 3}'
[2024-08-03 15:28:48] [Rank 1] totoal_tokens=47667, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:28:49] [Rank 0] totoal_tokens=48767, outputs='```json\n{\n  "chest": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:28:51] [Rank 2] totoal_tokens=49105, outputs='[1, 1, 1]'
[2024-08-03 15:28:51] [Rank 3] totoal_tokens=49743, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:28:52] [Rank 0] totoal_tokens=48815, outputs='[1, 1, 1]'
[2024-08-03 15:28:53] [Rank 1] totoal_tokens=48346, outputs='```json\n{\n  "numbers": [\n    {"number": 1, "description": "The first wave of names"},\n    {"number":'
[2024-08-03 15:28:55] [Rank 0] totoal_tokens=48948, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:28:55] [Rank 2] totoal_tokens=49694, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:28:56] [Rank 3] totoal_tokens=49914, outputs='[1, 1, 1]'
[2024-08-03 15:28:57] [Rank 1] totoal_tokens=48509, outputs='```json\n{\n  "number_of_owls": 4\n}\n```'
[2024-08-03 15:28:59] [Rank 0] totoal_tokens=48972, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
t]
Processing InternVL2-2B_counting-text-test.jsonl:  81%|████████▏ | 622/765 [15:11<09:17,  3.90s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  81%|████████▏ | 623/765 [15:15<09:04,  3.83s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  82%|████████▏ | 624/765 [15:18<08:48,  3.75s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  82%|████████▏ | 625/765 [15:23<09:03,  3.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  82%|████████▏ | 626/765 [15:26<08:46,  3.79s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  82%|████████▏ | 627/765 [15:33<11:07,  4.84s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  82%|████████▏ | 628/765 [15:36<09:48,  4.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  82%|████████▏ | 629/765 [15:40<09:01,  3.98s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  82%|███████�[2024-08-03 15:28:59] [Rank 2] totoal_tokens=49766, outputs='```json\n{\n  "number_of_computer": 3\n}\n```'
[2024-08-03 15:29:00] [Rank 3] totoal_tokens=50122, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:29:01] [Rank 1] totoal_tokens=49217, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:29:02] [Rank 0] totoal_tokens=49025, outputs='```json\n{\n  "title": "Sophie Howe is the world\'s only future generations commissioner",\n  "description": "Sophie'
[2024-08-03 15:29:03] [Rank 2] totoal_tokens=49815, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:29:05] [Rank 1] totoal_tokens=49926, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:29:05] [Rank 3] totoal_tokens=50268, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:29:07] [Rank 2] totoal_tokens=50396, outputs='```json\n{\n  "brushes": [\n    {\n      "description": "A giant fountains/torches/plumes of methane entering the'
[2024-08-03 15:29:08] [Rank 3] totoal_tokens=50708, outputs='{"compass": 0}'
[2024-08-03 15:29:09] [Rank 0] totoal_tokens=49073, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, round, white v'
[2024-08-03 15:29:09] [Rank 1] totoal_tokens=50209, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:29:11] [Rank 2] totoal_tokens=50413, outputs='```json\n{\n  "number_of_apples": 0\n}\n```'
[2024-08-03 15:29:12] [Rank 0] totoal_tokens=49491, outputs='```json\n{\n  "title": "Hopton Street",\n  "description": "The G 310 twins from BMW are an important milestone in'
[2024-08-03 15:29:13] [Rank 3] totoal_tokens=50764, outputs='```json\n{\n  "4TB WD Black": {\n    "max_latency": 50003,\n    "max_latency_stddev'
[2024-08-03 15:29:13] [Rank 1] totoal_tokens=50315, outputs='```json\n{\n  "odds": [\n    "5.00",\n    "4.00",\n    "3.00",\n    "2'
[2024-08-03 15:29:15] [Rank 2] totoal_tokens=50777, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the person who is the head of the company?",'
[2024-08-03 15:29:16] [Rank 0] totoal_tokens=49752, outputs='[1, 2, 3]'
[2024-08-03 15:29:16] [Rank 3] totoal_tokens=51038, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:29:17] [Rank 1] totoal_tokens=50503, outputs='[1, 1, 1]'
[2024-08-03 15:29:20] [Rank 2] totoal_tokens=51570, outputs='```json\n{\n  "results": [\n    {"name": "Coffea Arabica", "count": 1},\n    {"name": "'
[2024-08-03 15:29:20] [Rank 0] totoal_tokens=49802, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:29:21] [Rank 3] totoal_tokens=51231, outputs='[1, 2, 3]'
[2024-08-03 15:29:22] [Rank 1] totoal_tokens=50835, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:29:24] [Rank 3] totoal_tokens=51386, outputs='[1, 1, 1]'
[2024-08-03 15:29:24] [Rank 2] totoal_tokens=51664, outputs='```json\n{\n  "places_to_visit": [\n    "Amsterdam",\n    "Dunes and Tulips",\n    "King’s Day and S'
[2024-08-03 15:29:24] [Rank 0] totoal_tokens=51086, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:29:25] [Rank 1] totoal_tokens=51223, outputs='[1, 1, 1]'
[2024-08-03 15:29:28] [Rank 3] totoal_tokens=51602, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:29:28] [Rank 2] totoal_tokens=51677, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:29:29] [Rank 1] totoal_tokens=51852, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:29:29] [Rank 0] totoal_tokens=51198, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the company that is currently buying a place in the'
[2024-08-03 15:29:32] [Rank 3] totoal_tokens=51665, outputs='{"number_of_apples": 1}'
[2024-08-03 15:29:32] [Rank 2] totoal_tokens=52082, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10]'
[2024-08-03 15:29:33] [Rank 1] totoal_tokens=51964, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:29:33] [Rank 0] totoal_tokens=51354, outputs='{"x": 1, "x": 2, "x": 3, "x": 4, "x": 5, "x'
[2024-08-03 15:29:36] [Rank 3] totoal_tokens=51814, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:29:37] [Rank 2] totoal_tokens=52413, outputs='[1, 2, 3]'
[2024-08-03 15:29:37] [Rank 1] totoal_tokens=52024, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "x": 1, "x": 2},\n    {"'
[2024-08-03 15:29:37] [Rank 0] totoal_tokens=51398, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
��▏ | 630/765 [15:43<08:43,  3.87s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  82%|████████▏ | 631/765 [15:47<08:35,  3.85s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  83%|████████▎ | 632/765 [15:53<10:07,  4.57s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  83%|████████▎ | 633/765 [15:57<09:29,  4.31s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  83%|████████▎ | 634/765 [16:01<08:59,  4.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  83%|████████▎ | 635/765 [16:05<09:07,  4.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  83%|████████▎ | 636/765 [16:09<08:53,  4.14s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  83%|████████▎ | 637/765 [16:14<09:16,  4.35s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  83%|████████▎ | 638/765 [16:18<08:53,  4.20s/it]
Processing InternVL2-2B_counting-text-t[2024-08-03 15:29:41] [Rank 2] totoal_tokens=52453, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:29:41] [Rank 3] totoal_tokens=52002, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:29:41] [Rank 1] totoal_tokens=52066, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:29:43] [Rank 0] totoal_tokens=51429, outputs='```json\n{\n  "numbers": [\n    {"x": 1, "x": 2, "x": 3},\n    {"x'
[2024-08-03 15:29:45] [Rank 2] totoal_tokens=52598, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:29:45] [Rank 3] totoal_tokens=52063, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:29:45] [Rank 1] totoal_tokens=52203, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:29:48] [Rank 0] totoal_tokens=52196, outputs='```json\n{\n  "brushes": [\n    {\n      "description": "A small brush with a red and white pattern",\n      "number_of'
[2024-08-03 15:29:49] [Rank 3] totoal_tokens=52068, outputs='{"vase_count": 0}'
[2024-08-03 15:29:50] [Rank 1] totoal_tokens=52514, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:29:50] [Rank 2] totoal_tokens=53497, outputs='```json\n{\n  "locations": [\n    {\n      "location": "Chennai",\n      "description": "The Sunrise in Chennai"'
[2024-08-03 15:29:52] [Rank 0] totoal_tokens=52444, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:29:53] [Rank 3] totoal_tokens=52069, outputs='```json\n{\n  "number_of_★": 5\n}\n```'
[2024-08-03 15:29:54] [Rank 2] totoal_tokens=53871, outputs='```json\n{\n  "number_of_keys": 4\n}\n```'
[2024-08-03 15:29:54] [Rank 1] totoal_tokens=52590, outputs='```json\n{\n  "bananas": 0\n}\n```'
[2024-08-03 15:29:57] [Rank 3] totoal_tokens=52158, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, white ceramic vase'
[2024-08-03 15:29:58] [Rank 0] totoal_tokens=52749, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A small brush with a white handle'
[2024-08-03 15:29:58] [Rank 1] totoal_tokens=52748, outputs='[1, 1, 1]'
[2024-08-03 15:29:59] [Rank 2] totoal_tokens=54029, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A small brush with a white handle'
[2024-08-03 15:30:01] [Rank 3] totoal_tokens=52195, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:30:02] [Rank 0] totoal_tokens=52769, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:30:03] [Rank 2] totoal_tokens=54081, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:30:04] [Rank 1] totoal_tokens=52863, outputs='{"lighthouse": "1"}'
[2024-08-03 15:30:06] [Rank 3] totoal_tokens=52198, outputs='[1, 1, 1]'
[2024-08-03 15:30:07] [Rank 0] totoal_tokens=52805, outputs='{"x": 4, "x": 4, "x": 4}'
[2024-08-03 15:30:07] [Rank 2] totoal_tokens=54274, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:30:10] [Rank 1] totoal_tokens=53247, outputs='```json\n{\n  "compasses": [\n    {\n      "x": 0,\n      "x": 0,\n      "x":'
[2024-08-03 15:30:10] [Rank 3] totoal_tokens=52202, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:30:11] [Rank 0] totoal_tokens=52906, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:30:14] [Rank 2] totoal_tokens=54365, outputs='```json\n{\n  "vase_count": 0\n}\n```'
[2024-08-03 15:30:14] [Rank 3] totoal_tokens=52231, outputs='{\n  "number_of_computers": 0\n}'
[2024-08-03 15:30:15] [Rank 1] totoal_tokens=53471, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:30:15] [Rank 0] totoal_tokens=52974, outputs='[1, 1, 1]'
[2024-08-03 15:30:17] [Rank 3] totoal_tokens=52374, outputs='{"apple": 3}'
[2024-08-03 15:30:18] [Rank 2] totoal_tokens=54394, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:30:19] [Rank 1] totoal_tokens=53555, outputs='```json\n{\n  "number_of_computers": 20\n}\n```'
[2024-08-03 15:30:20] [Rank 0] totoal_tokens=53246, outputs='```json\n{\n  "compasses": [\n    {\n      "number": 1,\n      "description": "The compass is pointing north."'
est.jsonl:  84%|████████▎ | 639/765 [16:22<08:51,  4.22s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  84%|████████▎ | 640/765 [16:28<09:39,  4.63s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  84%|████████▍ | 641/765 [16:33<09:44,  4.72s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  84%|████████▍ | 642/765 [16:36<09:03,  4.42s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  84%|████████▍ | 643/765 [16:42<09:59,  4.91s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  84%|████████▍ | 644/765 [16:47<09:37,  4.77s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  84%|████████▍ | 645/765 [16:52<09:27,  4.73s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  84%|████████▍ | 646/765 [16:56<09:19,  4.70s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  85%|████████▍ | 647/765 [17:00<08:49,  4.49s/it]
P[2024-08-03 15:30:21] [Rank 3] totoal_tokens=52598, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:30:22] [Rank 2] totoal_tokens=54678, outputs='```json\n{\n  "compasses": [\n    {"x": 0, "y": 0, "z": 0},\n    {"'
[2024-08-03 15:30:23] [Rank 1] totoal_tokens=53565, outputs='[1, 1, 1]'
[2024-08-03 15:30:26] [Rank 3] totoal_tokens=53199, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:30:26] [Rank 0] totoal_tokens=53441, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:30:26] [Rank 1] totoal_tokens=53760, outputs='{"lighthouse": 3}'
[2024-08-03 15:30:27] [Rank 2] totoal_tokens=55073, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:30:29] [Rank 3] totoal_tokens=53305, outputs='[1, 2, 3]'
[2024-08-03 15:30:30] [Rank 0] totoal_tokens=53493, outputs='```json\n{\n  "number_of_trees": 0\n}\n```'
[2024-08-03 15:30:30] [Rank 1] totoal_tokens=53830, outputs='```json\n{\n  "owl_count": 0\n}\n```'
[2024-08-03 15:30:31] [Rank 2] totoal_tokens=55244, outputs='[1, 1, 1]'
[2024-08-03 15:30:34] [Rank 0] totoal_tokens=53920, outputs='[1, 1, 1]'
[2024-08-03 15:30:34] [Rank 1] totoal_tokens=53871, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:30:34] [Rank 3] totoal_tokens=53493, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:30:35] [Rank 2] totoal_tokens=55381, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:30:38] [Rank 1] totoal_tokens=53986, outputs='[1, 2, 3]'
[2024-08-03 15:30:38] [Rank 3] totoal_tokens=53871, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:30:38] [Rank 0] totoal_tokens=54397, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:30:39] [Rank 2] totoal_tokens=55395, outputs='{\n  "number_of_★": 5\n}'
[2024-08-03 15:30:42] [Rank 1] totoal_tokens=54121, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:30:42] [Rank 3] totoal_tokens=54049, outputs='{"x": 2, "x": 2, "x": 2}'
[2024-08-03 15:30:43] [Rank 0] totoal_tokens=54729, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:30:43] [Rank 2] totoal_tokens=55597, outputs='{"brushes": [{"name": "Brush 1", "count": 1}, {"name": "Brush 2", "count": 1'
[2024-08-03 15:30:46] [Rank 3] totoal_tokens=54155, outputs='[1, 1, 1]'
[2024-08-03 15:30:47] [Rank 0] totoal_tokens=54832, outputs='[1, 1, 1]'
[2024-08-03 15:30:47] [Rank 1] totoal_tokens=54333, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10]'
[2024-08-03 15:30:49] [Rank 2] totoal_tokens=55629, outputs='[1, 2, 3]'
[2024-08-03 15:30:50] [Rank 3] totoal_tokens=54670, outputs='{"x": 2, "x": 2, "x": 2}'
[2024-08-03 15:30:51] [Rank 0] totoal_tokens=54944, outputs='[1, 1, 1]'
[2024-08-03 15:30:52] [Rank 1] totoal_tokens=54351, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:30:53] [Rank 2] totoal_tokens=55725, outputs='```json\n{\n  "compass": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:30:54] [Rank 3] totoal_tokens=54842, outputs='[1, 1, 1]'
[2024-08-03 15:30:55] [Rank 0] totoal_tokens=54946, outputs='{"x": 3, "x": 3, "x": 3}'
rocessing InternVL2-2B_counting-text-test.jsonl:  85%|████████▍ | 648/765 [17:05<08:59,  4.61s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  85%|████████▍ | 649/765 [17:11<09:31,  4.93s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  85%|████████▍ | 650/765 [17:15<08:52,  4.63s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  85%|████████▌ | 651/765 [17:19<08:23,  4.42s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  85%|████████▌ | 652/765 [17:23<08:18,  4.41s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  85%|████████▌ | 653/765 [17:27<08:18,  4.45s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  85%|████████▌ | 654/765 [17:31<07:52,  4.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  86%|████████▌ | 655/765 [17:36<08:02,  4.39s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  86%|████████�[2024-08-03 15:30:58] [Rank 1] totoal_tokens=54539, outputs='```json\n{\n  "key": "Alpha",\n  "key": "Beta",\n  "key": "Gamma",\n  "key": "'
[2024-08-03 15:30:59] [Rank 0] totoal_tokens=55119, outputs='[1, 1, 1]'
[2024-08-03 15:30:59] [Rank 2] totoal_tokens=55770, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:31:00] [Rank 3] totoal_tokens=55472, outputs='```json\n{\n  "number_of_countries_with_johnson_and_johnson_vaccine": 100,\n  "number_of_countries'
[2024-08-03 15:31:02] [Rank 1] totoal_tokens=54933, outputs='```json\n{\n  "brushes": [\n    {\n      "description": "The little penguin collected 2 brushes.",\n      "number_of_br'
[2024-08-03 15:31:03] [Rank 0] totoal_tokens=55212, outputs='```json\n{\n  "lighthouse_count": 0\n}\n```'
[2024-08-03 15:31:04] [Rank 2] totoal_tokens=55829, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:31:04] [Rank 3] totoal_tokens=55652, outputs='```json\n{\n  "number_of_trees": 0\n}\n```'
[2024-08-03 15:31:06] [Rank 1] totoal_tokens=54961, outputs='[1, 1, 1]'
[2024-08-03 15:31:07] [Rank 0] totoal_tokens=55266, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:31:08] [Rank 2] totoal_tokens=55849, outputs='{"name":"Ramen Road","description":"An alley filled with small shops that typically serve food and drinks.","location":"Waikiki Shopping Plaza","year'
[2024-08-03 15:31:09] [Rank 3] totoal_tokens=56421, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:31:10] [Rank 1] totoal_tokens=54973, outputs='```json\n{\n  "bananas": 3\n}\n```'
[2024-08-03 15:31:13] [Rank 0] totoal_tokens=55709, outputs='```json\n{\n  "lighthouse_count": 3\n}\n```'
[2024-08-03 15:31:13] [Rank 2] totoal_tokens=55874, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:31:13] [Rank 3] totoal_tokens=57131, outputs='[1, 1, 1]'
[2024-08-03 15:31:14] [Rank 1] totoal_tokens=55606, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:31:17] [Rank 0] totoal_tokens=55843, outputs='[1, 1, 1]'
[2024-08-03 15:31:18] [Rank 2] totoal_tokens=56180, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the holiday that commemorates the liberation of Israel'
[2024-08-03 15:31:19] [Rank 1] totoal_tokens=56216, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:31:20] [Rank 3] totoal_tokens=57377, outputs='{"name":"Shah Rukh Khan","age":30,"occupation":"actor","nationality":"indian","ethnicity":"indian","rel'
[2024-08-03 15:31:21] [Rank 0] totoal_tokens=56067, outputs='[1, 2, 3, 4, 5, 6]'
[2024-08-03 15:31:24] [Rank 2] totoal_tokens=56185, outputs='```json\n{\n  "vases": [\n    {"count": 1, "name": "vase1"},\n    {"count": 2'
[2024-08-03 15:31:24] [Rank 1] totoal_tokens=56357, outputs='[1, 1, 1]'
[2024-08-03 15:31:25] [Rank 0] totoal_tokens=56128, outputs='{"x": 3}'
[2024-08-03 15:31:25] [Rank 3] totoal_tokens=57593, outputs='```json\n{\n  "villagers": [\n    {\n      "name": "Mikhail Gorbachev",\n      "location": "Go'
[2024-08-03 15:31:29] [Rank 1] totoal_tokens=56386, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:31:29] [Rank 2] totoal_tokens=56635, outputs='```json\n{\n  "brushes": [\n    "x",\n    "x",\n    "x"\n  ]\n}\n```'
[2024-08-03 15:31:29] [Rank 0] totoal_tokens=56693, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:31:31] [Rank 3] totoal_tokens=57714, outputs='{"apple": 3}'
[2024-08-03 15:31:33] [Rank 2] totoal_tokens=56813, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:31:33] [Rank 1] totoal_tokens=56565, outputs='{ "number_of_owls": 0 }'
[2024-08-03 15:31:34] [Rank 0] totoal_tokens=56841, outputs='```json\n{\n  "bananas": 3\n}\n```'
� | 656/765 [17:40<07:40,  4.23s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  86%|████████▌ | 657/765 [17:44<07:22,  4.10s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  86%|████████▌ | 658/765 [17:48<07:10,  4.03s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  86%|████████▌ | 659/765 [17:51<07:04,  4.00s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  86%|████████▋ | 660/765 [17:58<08:06,  4.63s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  86%|████████▋ | 661/765 [18:01<07:32,  4.35s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  87%|████████▋ | 662/765 [18:05<07:16,  4.24s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  87%|████████▋ | 663/765 [18:10<07:17,  4.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  87%|████████▋ | 664/765 [18:14<07:17,  4.34s/it]
Processing InternVL2-2B_counting-text-test.[2024-08-03 15:31:36] [Rank 3] totoal_tokens=57855, outputs='[1, 2, 3]'
[2024-08-03 15:31:38] [Rank 2] totoal_tokens=56874, outputs='```json\n{\n  "number_of_people_in_hospital": 2,\n  "location_of_shooting": "central_wellington",'
[2024-08-03 15:31:38] [Rank 0] totoal_tokens=57005, outputs='{"brushes": 3}'
[2024-08-03 15:31:38] [Rank 1] totoal_tokens=56670, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A small brush with a pink and'
[2024-08-03 15:31:41] [Rank 3] totoal_tokens=57930, outputs='[1, 2, 3]'
[2024-08-03 15:31:42] [Rank 0] totoal_tokens=57030, outputs='[1, 2, 3]'
[2024-08-03 15:31:42] [Rank 1] totoal_tokens=56707, outputs="God's Trigger"
[2024-08-03 15:31:42] [Rank 2] totoal_tokens=57165, outputs='```json\n{\n  "brushes": [\n    {\n      "number": 1,\n      "description": "A pair of blue earphones."'
[2024-08-03 15:31:45] [Rank 3] totoal_tokens=57972, outputs='```json\n{\n  "restaurant": "Power Plant",\n  "location": "Atlanta, GA",\n  "features": "Vegan food,'
[2024-08-03 15:31:46] [Rank 0] totoal_tokens=57269, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:31:46] [Rank 1] totoal_tokens=57260, outputs='```json\n{\n  "total_chest_count": 4\n}\n```'
[2024-08-03 15:31:48] [Rank 2] totoal_tokens=57266, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:31:50] [Rank 3] totoal_tokens=58358, outputs='```json\n{\n  "goal": 229,\n  "top_5": [\n    {\n      "name": "Raul",\n      "number_of'
[2024-08-03 15:31:50] [Rank 1] totoal_tokens=57266, outputs='[1, 1, 1]'
[2024-08-03 15:31:50] [Rank 0] totoal_tokens=57854, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:31:52] [Rank 2] totoal_tokens=57350, outputs='```json\n{\n  "number_of_computers": 1\n}\n```'
[2024-08-03 15:31:55] [Rank 1] totoal_tokens=57332, outputs='```json\n{\n  "apple_count": 0\n}\n```'
[2024-08-03 15:31:55] [Rank 0] totoal_tokens=57924, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:31:55] [Rank 3] totoal_tokens=58448, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
[2024-08-03 15:31:58] [Rank 2] totoal_tokens=57885, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:31:59] [Rank 0] totoal_tokens=57993, outputs='{"total_unique_source_ip_addresses": 45393}'
[2024-08-03 15:32:00] [Rank 1] totoal_tokens=57374, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:32:00] [Rank 3] totoal_tokens=58770, outputs='```json\n{\n  "number_of_keys": 3\n}\n```'
[2024-08-03 15:32:02] [Rank 2] totoal_tokens=57918, outputs='{"lighthouse": 3}'
[2024-08-03 15:32:04] [Rank 1] totoal_tokens=57436, outputs='[1, 1, 1]'
[2024-08-03 15:32:05] [Rank 3] totoal_tokens=58869, outputs='{"x": 0, "x": 0, "x": 0}'
[2024-08-03 15:32:05] [Rank 0] totoal_tokens=57996, outputs='```json\n{\n  "vases": [\n    {\n      "number": 1,\n      "description": "A small, brown ceramic vase'
[2024-08-03 15:32:06] [Rank 2] totoal_tokens=58460, outputs='{"x": 4}'
[2024-08-03 15:32:09] [Rank 3] totoal_tokens=59229, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:32:09] [Rank 1] totoal_tokens=57853, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the movie?",\n      "answer": "The H'
[2024-08-03 15:32:10] [Rank 0] totoal_tokens=58350, outputs='{"name":"Yandex","type":"search engine","country":"Russia","market_share":"42.35%","traffic":"2.9 billion searches per day'
[2024-08-03 15:32:11] [Rank 2] totoal_tokens=58750, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:32:13] [Rank 3] totoal_tokens=59250, outputs='[2, 2, 2]'
[2024-08-03 15:32:14] [Rank 0] totoal_tokens=59218, outputs='{"x": 3, "x": 2, "x": 1}'
jsonl:  87%|████████▋ | 665/765 [18:18<07:10,  4.30s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  87%|████████▋ | 666/765 [18:23<07:08,  4.33s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  87%|████████▋ | 667/765 [18:27<06:55,  4.24s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  87%|████████▋ | 668/765 [18:31<06:47,  4.20s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  87%|████████▋ | 669/765 [18:35<06:48,  4.25s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  88%|████████▊ | 670/765 [18:40<06:47,  4.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  88%|████████▊ | 671/765 [18:44<06:37,  4.23s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  88%|████████▊ | 672/765 [18:50<07:33,  4.88s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  88%|████████▊ | 673/765 [18:55<07:19,  4.78s/it]
Proce[2024-08-03 15:32:15] [Rank 1] totoal_tokens=58526, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the first place where Alfred Hitchcock directed a'
[2024-08-03 15:32:17] [Rank 3] totoal_tokens=59825, outputs='[1, 2, 3]'
[2024-08-03 15:32:17] [Rank 2] totoal_tokens=59171, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:32:18] [Rank 0] totoal_tokens=59222, outputs='[1, 2, 3]'
[2024-08-03 15:32:20] [Rank 1] totoal_tokens=58755, outputs='```json\n{\n  "title": "Modern Times",\n  "director": "Neven Maguire",\n  "year": 2022,'
[2024-08-03 15:32:22] [Rank 3] totoal_tokens=60071, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:32:22] [Rank 2] totoal_tokens=59237, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:32:23] [Rank 0] totoal_tokens=59517, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:32:24] [Rank 1] totoal_tokens=59304, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:32:27] [Rank 3] totoal_tokens=60096, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:32:28] [Rank 2] totoal_tokens=59939, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:32:28] [Rank 0] totoal_tokens=59693, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:32:30] [Rank 1] totoal_tokens=59769, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:32:32] [Rank 2] totoal_tokens=60373, outputs='{"x": 3}'
[2024-08-03 15:32:32] [Rank 0] totoal_tokens=59852, outputs='[1, 1, 1]'
[2024-08-03 15:32:34] [Rank 3] totoal_tokens=60347, outputs='{"number_of_computers": 3}'
[2024-08-03 15:32:35] [Rank 1] totoal_tokens=60181, outputs='[1, 2, 3]'
[2024-08-03 15:32:37] [Rank 0] totoal_tokens=60484, outputs='{"x": 3}'
[2024-08-03 15:32:39] [Rank 3] totoal_tokens=60576, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:32:39] [Rank 2] totoal_tokens=60647, outputs='{"name":"Lucas di Grassi","position":"driver","team":"Abt","season":"2018-19","results":"4","pole positions'
[2024-08-03 15:32:40] [Rank 1] totoal_tokens=60193, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:32:41] [Rank 0] totoal_tokens=60586, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:32:43] [Rank 3] totoal_tokens=60917, outputs='{"x": 4, "x": 4, "x": 4}'
[2024-08-03 15:32:44] [Rank 2] totoal_tokens=60758, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:32:44] [Rank 1] totoal_tokens=60229, outputs='The answer is 0.'
[2024-08-03 15:32:45] [Rank 0] totoal_tokens=61048, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:32:47] [Rank 3] totoal_tokens=61209, outputs='NA: Ascension: Sphere of Influence'
[2024-08-03 15:32:49] [Rank 1] totoal_tokens=60351, outputs='```json\n{\n  "number_of_vases": 0\n}\n```'
[2024-08-03 15:32:49] [Rank 2] totoal_tokens=60813, outputs='[1, 2, 3]'
[2024-08-03 15:32:50] [Rank 0] totoal_tokens=61289, outputs='```json\n{\n  "lighthouse": 0\n}\n```'
ssing InternVL2-2B_counting-text-test.jsonl:  88%|████████▊ | 674/765 [18:59<07:04,  4.66s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  88%|████████▊ | 675/765 [19:03<06:37,  4.42s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  88%|████████▊ | 676/765 [19:08<06:51,  4.63s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  88%|████████▊ | 677/765 [19:12<06:42,  4.58s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  89%|████████▊ | 678/765 [19:17<06:28,  4.47s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  89%|████████▉ | 679/765 [19:21<06:27,  4.51s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  89%|████████▉ | 680/765 [19:25<06:16,  4.43s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  89%|████████▉ | 681/765 [19:30<06:10,  4.42s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  89%|████████▉ | [2024-08-03 15:32:52] [Rank 3] totoal_tokens=62104, outputs='```json\n{\n  "number_of_chests": 1\n}\n```'
[2024-08-03 15:32:54] [Rank 2] totoal_tokens=61237, outputs='```json\n{\n  "chest_count": 3\n}\n```'
[2024-08-03 15:32:54] [Rank 0] totoal_tokens=61439, outputs='{"x": 3}'
[2024-08-03 15:32:55] [Rank 1] totoal_tokens=60416, outputs='[1, 2, 3]'
[2024-08-03 15:32:59] [Rank 3] totoal_tokens=62335, outputs='{\n  "computer": 0,\n  "x": 0,\n  "x": 0,\n  "x": 0,\n  "x'
[2024-08-03 15:32:59] [Rank 2] totoal_tokens=61397, outputs='[1, 1, 1]'
[2024-08-03 15:32:59] [Rank 1] totoal_tokens=60636, outputs='[1, 2, 3]'
[2024-08-03 15:33:00] [Rank 0] totoal_tokens=61745, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:04] [Rank 1] totoal_tokens=60673, outputs='[1, 1, 1]'
[2024-08-03 15:33:04] [Rank 2] totoal_tokens=61581, outputs='```json\n{\n  "number_of_trees": 0\n}\n```'
[2024-08-03 15:33:06] [Rank 3] totoal_tokens=62428, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:06] [Rank 0] totoal_tokens=62151, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:33:09] [Rank 2] totoal_tokens=62058, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:33:10] [Rank 1] totoal_tokens=61015, outputs='```json\n{\n  "title": "West Side Story",\n  "description": "A Broadway musical adaptation of the 1957 film of the same'
[2024-08-03 15:33:10] [Rank 0] totoal_tokens=62320, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:11] [Rank 3] totoal_tokens=62749, outputs='```json\n{\n  "tree_count": 0\n}\n```'
[2024-08-03 15:33:13] [Rank 2] totoal_tokens=62090, outputs='{ "x": 3 }'
[2024-08-03 15:33:14] [Rank 1] totoal_tokens=61255, outputs='{"x": 0, "x": 0, "x": 0}'
[2024-08-03 15:33:15] [Rank 0] totoal_tokens=62348, outputs='{\n  "number_of_apples": 0\n}'
[2024-08-03 15:33:16] [Rank 3] totoal_tokens=63272, outputs='```json\n{\n  "captain": "Marianne Danissen",\n  "captain_name": "Marianne Danissen",\n  "'
[2024-08-03 15:33:19] [Rank 2] totoal_tokens=62144, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:33:20] [Rank 1] totoal_tokens=61371, outputs='```json\n{\n  "number_of_bananas": 3\n}\n```'
[2024-08-03 15:33:20] [Rank 0] totoal_tokens=62815, outputs='{"number_of_trees": 4}'
[2024-08-03 15:33:21] [Rank 3] totoal_tokens=63294, outputs='[1, 2, 3]'
[2024-08-03 15:33:25] [Rank 2] totoal_tokens=62218, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:26] [Rank 1] totoal_tokens=61529, outputs='[1, 2, 3]'
[2024-08-03 15:33:26] [Rank 3] totoal_tokens=63302, outputs="['x', 'x', 'x']"
[2024-08-03 15:33:26] [Rank 0] totoal_tokens=63213, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:33:30] [Rank 1] totoal_tokens=61911, outputs='```json\n{\n  "tree_count": 1\n}\n```'
[2024-08-03 15:33:31] [Rank 0] totoal_tokens=63464, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:33:33] [Rank 3] totoal_tokens=63673, outputs='```json\n{\n  "computer": "3",\n  "number_of_computers": 3\n}\n```'
[2024-08-03 15:33:34] [Rank 2] totoal_tokens=62283, outputs='```json\n{\n  "episode": "9",\n  "release_date": "2021-08-30",\n  "summary": "The show'
[2024-08-03 15:33:35] [Rank 1] totoal_tokens=61957, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:33:36] [Rank 0] totoal_tokens=63739, outputs='{"x": 3, "x": 2, "x": 1}'
682/765 [19:34<06:08,  4.44s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  89%|████████▉ | 683/765 [19:38<05:54,  4.33s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  89%|████████▉ | 684/765 [19:44<06:28,  4.80s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  90%|████████▉ | 685/765 [19:50<06:55,  5.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  90%|████████▉ | 686/765 [19:55<06:34,  4.99s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  90%|████████▉ | 687/765 [19:59<06:15,  4.81s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  90%|████████▉ | 688/765 [20:04<06:14,  4.86s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  90%|█████████ | 689/765 [20:11<06:55,  5.46s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  90%|█████████ | 690/765 [20:16<06:32,  5.24s/it]
Processing InternVL2-2B_counting-text-test.json[2024-08-03 15:33:37] [Rank 3] totoal_tokens=63852, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:33:40] [Rank 2] totoal_tokens=62463, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:33:40] [Rank 1] totoal_tokens=62259, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:42] [Rank 0] totoal_tokens=64075, outputs='```json\n{\n  "title": "The Secret Life of Marilyn Monroe",\n  "description": "A musical comedy about the life of Mar'
[2024-08-03 15:33:42] [Rank 3] totoal_tokens=63959, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:33:44] [Rank 2] totoal_tokens=62816, outputs='{"brushes": 1, "brushes": 1, "brushes": 1}'
[2024-08-03 15:33:45] [Rank 1] totoal_tokens=62952, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:47] [Rank 3] totoal_tokens=63996, outputs='```json\n{\n  "number_of_owls": 3\n}\n```'
[2024-08-03 15:33:47] [Rank 0] totoal_tokens=64079, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:50] [Rank 1] totoal_tokens=63086, outputs='{"x": 3}'
[2024-08-03 15:33:52] [Rank 2] totoal_tokens=63485, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:52] [Rank 3] totoal_tokens=64098, outputs='{"brushes": 0}'
[2024-08-03 15:33:53] [Rank 0] totoal_tokens=64201, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:33:55] [Rank 1] totoal_tokens=63121, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:33:56] [Rank 3] totoal_tokens=64267, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:33:57] [Rank 2] totoal_tokens=63594, outputs='```json\n{\n  "lighthouse": "Lighthouse 1"\n}\n```'
[2024-08-03 15:33:59] [Rank 0] totoal_tokens=64218, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:34:00] [Rank 1] totoal_tokens=63365, outputs='[1, 1, 1]'
[2024-08-03 15:34:02] [Rank 3] totoal_tokens=64333, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:34:02] [Rank 2] totoal_tokens=63645, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:34:04] [Rank 0] totoal_tokens=64300, outputs='{"x": 420}'
[2024-08-03 15:34:04] [Rank 1] totoal_tokens=63866, outputs='[1, 1, 1]'
[2024-08-03 15:34:06] [Rank 2] totoal_tokens=63782, outputs='[1, 1, 1]'
[2024-08-03 15:34:07] [Rank 3] totoal_tokens=64405, outputs='[1, 2, 3]'
[2024-08-03 15:34:10] [Rank 0] totoal_tokens=64384, outputs='[1, 2, 3]'
[2024-08-03 15:34:10] [Rank 1] totoal_tokens=64181, outputs='{"brushes": [1, 2, 3]}'
[2024-08-03 15:34:11] [Rank 2] totoal_tokens=63841, outputs='{"name":"Bilgola Beach","location":"Bilgola Beach","date":"2022-07-01","time":"10:00 AM'
[2024-08-03 15:34:11] [Rank 3] totoal_tokens=64565, outputs='[1, 2, 3]'
[2024-08-03 15:34:15] [Rank 0] totoal_tokens=64534, outputs='[1, 2, 3]'
[2024-08-03 15:34:16] [Rank 1] totoal_tokens=64229, outputs='```json\n{\n  "brushes": [\n    "4",\n    "4",\n    "4"\n  ]\n}\n```'
[2024-08-03 15:34:17] [Rank 3] totoal_tokens=64578, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:34:18] [Rank 2] totoal_tokens=64338, outputs='[1, 2, 3]'
[2024-08-03 15:34:20] [Rank 0] totoal_tokens=64591, outputs='```json\n{\n  "title": "Island Man",\n  "author": "Grace Nichols",\n  "lines": [\n    "Is'
[2024-08-03 15:34:22] [Rank 1] totoal_tokens=64326, outputs='{\n  "title": "Blind Dating",\n  "description": "A story about a man who falls in love with a woman he meets on a blind'
[2024-08-03 15:34:23] [Rank 3] totoal_tokens=64657, outputs='{"number_of_brush": 2}'
[2024-08-03 15:34:25] [Rank 0] totoal_tokens=64756, outputs='No'
l:  90%|█████████ | 691/765 [20:21<06:19,  5.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  90%|█████████ | 692/765 [20:27<06:35,  5.41s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  91%|█████████ | 693/765 [20:32<06:24,  5.34s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  91%|█████████ | 694/765 [20:37<06:15,  5.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  91%|█████████ | 695/765 [20:44<06:42,  5.75s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  91%|█████████ | 696/765 [20:49<06:11,  5.38s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  91%|█████████ | 697/765 [20:55<06:18,  5.56s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  91%|█████████ | 698/765 [21:00<06:04,  5.44s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  91%|█████████▏| 699/765 [21:05<05:56,  5.39s/it]
Process[2024-08-03 15:34:25] [Rank 2] totoal_tokens=64868, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:34:28] [Rank 1] totoal_tokens=64368, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:34:28] [Rank 3] totoal_tokens=64743, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10]'
[2024-08-03 15:34:29] [Rank 0] totoal_tokens=64841, outputs='[1, 1, 1]'
[2024-08-03 15:34:30] [Rank 2] totoal_tokens=64881, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:34:34] [Rank 3] totoal_tokens=64792, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:34:34] [Rank 1] totoal_tokens=64497, outputs='[1, 2, 3]'
[2024-08-03 15:34:34] [Rank 0] totoal_tokens=65236, outputs='{\n  "title": "The Jon Stickley Trio",\n  "year": "2018",\n  "genre": "Comedy",\n  "direct'
[2024-08-03 15:34:36] [Rank 2] totoal_tokens=64887, outputs='{\n  "Car rental companies": [\n    {\n      "name": "Budget",\n      "address": "3035 Airport Rd, Kamloops, Canada'
[2024-08-03 15:34:39] [Rank 0] totoal_tokens=65334, outputs='{"vase_count": 0}'
[2024-08-03 15:34:40] [Rank 1] totoal_tokens=64572, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:34:40] [Rank 3] totoal_tokens=64881, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:34:41] [Rank 2] totoal_tokens=64949, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:34:44] [Rank 0] totoal_tokens=65409, outputs='[0, 0, 0]'
[2024-08-03 15:34:44] [Rank 1] totoal_tokens=64617, outputs='{"x": 3}'
[2024-08-03 15:34:45] [Rank 3] totoal_tokens=65183, outputs='{\n  "lighthouse": 0\n}'
[2024-08-03 15:34:45] [Rank 2] totoal_tokens=65011, outputs='{"x": 2, "x": 2, "x": 2}'
[2024-08-03 15:34:49] [Rank 1] totoal_tokens=64752, outputs="I'm sorry, I can't help with that."
[2024-08-03 15:34:49] [Rank 0] totoal_tokens=65574, outputs='[1, 1, 1]'
[2024-08-03 15:34:50] [Rank 3] totoal_tokens=65321, outputs='[1, 2, 3]'
[2024-08-03 15:34:50] [Rank 2] totoal_tokens=65172, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:34:54] [Rank 1] totoal_tokens=64943, outputs='[1, 1, 1]'
[2024-08-03 15:34:54] [Rank 3] totoal_tokens=65399, outputs='[1, 2, 3]'
[2024-08-03 15:34:55] [Rank 0] totoal_tokens=65594, outputs='Russian dating in south dublin'
[2024-08-03 15:34:55] [Rank 2] totoal_tokens=65331, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:35:00] [Rank 0] totoal_tokens=65812, outputs='{"x": 3}'
[2024-08-03 15:35:00] [Rank 3] totoal_tokens=65463, outputs='[1, 2, 3]'
[2024-08-03 15:35:00] [Rank 1] totoal_tokens=65297, outputs='{"name":"Bengaluru FC","team":"FC Goa","matchday":1,"date":"September 29th","time":"6:00'
[2024-08-03 15:35:01] [Rank 2] totoal_tokens=65543, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:35:06] [Rank 1] totoal_tokens=65468, outputs='[1, 2, 3]'
[2024-08-03 15:35:06] [Rank 0] totoal_tokens=66390, outputs='[1, 2, 3]'
ing InternVL2-2B_counting-text-test.jsonl:  92%|█████████▏| 700/765 [21:09<05:29,  5.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  92%|█████████▏| 701/765 [21:14<05:15,  4.93s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  92%|█████████▏| 702/765 [21:19<05:16,  5.02s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  92%|█████████▏| 703/765 [21:24<05:01,  4.87s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  92%|█████████▏| 704/765 [21:29<04:58,  4.90s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  92%|█████████▏| 705/765 [21:34<05:04,  5.07s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  92%|█████████▏| 706/765 [21:40<05:07,  5.21s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  92%|█████████▏| 707/765 [21:45<05:04,  5.26s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  93%|█████�[2024-08-03 15:35:07] [Rank 3] totoal_tokens=66221, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:35:07] [Rank 2] totoal_tokens=65751, outputs='{"brushes": [1, 2, 3]}'
[2024-08-03 15:35:11] [Rank 1] totoal_tokens=65588, outputs='{"x": 2, "x": 2, "x": 2}'
[2024-08-03 15:35:12] [Rank 3] totoal_tokens=67082, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:35:13] [Rank 2] totoal_tokens=66142, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:35:15] [Rank 0] totoal_tokens=66611, outputs='{"x": 0, "x": 0, "x": 0}'
[2024-08-03 15:35:16] [Rank 1] totoal_tokens=65818, outputs='```json\n{\n  "questions": [\n    {\n      "question": "What is the name of the person who is the son of the founder of'
[2024-08-03 15:35:17] [Rank 3] totoal_tokens=68490, outputs='[1, 2, 3]'
[2024-08-03 15:35:19] [Rank 2] totoal_tokens=66184, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:35:21] [Rank 1] totoal_tokens=66068, outputs='[1, 2, 3]'
[2024-08-03 15:35:21] [Rank 0] totoal_tokens=67202, outputs="I'm not sure what you're asking for."
[2024-08-03 15:35:23] [Rank 3] totoal_tokens=68903, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:35:25] [Rank 1] totoal_tokens=66409, outputs='[1, 2, 3]'
[2024-08-03 15:35:26] [Rank 2] totoal_tokens=66991, outputs='{"name":"MSAR","description":"A company that makes a type of rifle","year":"2012","production":"Yes","invented":"Yes","'
[2024-08-03 15:35:27] [Rank 0] totoal_tokens=67222, outputs="I'm not sure what you're asking for."
[2024-08-03 15:35:30] [Rank 3] totoal_tokens=68951, outputs='[2, 2, 2]'
[2024-08-03 15:35:31] [Rank 1] totoal_tokens=66554, outputs='{"x": 3}'
[2024-08-03 15:35:33] [Rank 2] totoal_tokens=67571, outputs='{\n  "number_of_vases": 0\n}'
[2024-08-03 15:35:33] [Rank 0] totoal_tokens=67674, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:35:36] [Rank 3] totoal_tokens=69071, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:35:37] [Rank 1] totoal_tokens=66828, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:35:38] [Rank 0] totoal_tokens=67979, outputs='[1, 2, 3]'
[2024-08-03 15:35:40] [Rank 2] totoal_tokens=67990, outputs='```json\n{\n  "chest_count": 0\n}\n```'
[2024-08-03 15:35:42] [Rank 3] totoal_tokens=69348, outputs='[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0'
[2024-08-03 15:35:44] [Rank 1] totoal_tokens=66916, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:35:44] [Rank 0] totoal_tokens=68069, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:35:45] [Rank 2] totoal_tokens=67994, outputs='[1, 2, 3]'
[2024-08-03 15:35:47] [Rank 3] totoal_tokens=69502, outputs='{"Symbols": ["x", "x", "x"]}'
[2024-08-03 15:35:49] [Rank 1] totoal_tokens=67128, outputs='[1, 2, 3]'
[2024-08-03 15:35:49] [Rank 0] totoal_tokens=68497, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:35:51] [Rank 2] totoal_tokens=67995, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:35:52] [Rank 3] totoal_tokens=69638, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:35:53] [Rank 1] totoal_tokens=67179, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:35:55] [Rank 0] totoal_tokens=69161, outputs='{"x": 3}'
[2024-08-03 15:35:56] [Rank 2] totoal_tokens=68433, outputs="I'm not sure I understand your question. Could you please rephrase it?"
[2024-08-03 15:35:58] [Rank 3] totoal_tokens=70051, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:36:00] [Rank 1] totoal_tokens=67565, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:36:01] [Rank 0] totoal_tokens=69499, outputs='{"x": 3, "x": 2, "x": 1}'
��███▎| 708/765 [21:51<05:10,  5.44s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  93%|█████████▎| 709/765 [21:59<05:56,  6.36s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  93%|█████████▎| 710/765 [22:06<05:50,  6.38s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  93%|█████████▎| 711/765 [22:12<05:43,  6.36s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  93%|█████████▎| 712/765 [22:18<05:28,  6.19s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  93%|█████████▎| 713/765 [22:23<05:02,  5.81s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  93%|█████████▎| 714/765 [22:28<04:52,  5.74s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  93%|█████████▎| 715/765 [22:34<04:38,  5.57s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  94%|█████████▎| 716/765 [22:40<04:44,  5.80s/it]
Processing Inte[2024-08-03 15:36:01] [Rank 2] totoal_tokens=68651, outputs='The answer is 0.'
[2024-08-03 15:36:03] [Rank 3] totoal_tokens=70131, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:36:06] [Rank 0] totoal_tokens=69540, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:36:07] [Rank 1] totoal_tokens=68065, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:36:07] [Rank 2] totoal_tokens=68776, outputs='[1, 2, 3]'
[2024-08-03 15:36:09] [Rank 3] totoal_tokens=70188, outputs='[1, 2, 3]'
[2024-08-03 15:36:12] [Rank 0] totoal_tokens=69559, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10]'
[2024-08-03 15:36:12] [Rank 2] totoal_tokens=69114, outputs="I'm sorry, but I cannot provide a response to that question."
[2024-08-03 15:36:12] [Rank 1] totoal_tokens=68137, outputs='{"name":"Autagavaia Tipi Autagavaia","age":37,"occupation":"politician","party":"HRPP","party_affiliation'
[2024-08-03 15:36:14] [Rank 3] totoal_tokens=70197, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:36:17] [Rank 1] totoal_tokens=68352, outputs='[1, 2, 3]'
[2024-08-03 15:36:17] [Rank 0] totoal_tokens=69566, outputs='"Punishing Maverick"'
[2024-08-03 15:36:19] [Rank 2] totoal_tokens=69141, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:36:19] [Rank 3] totoal_tokens=70400, outputs='[1, 1, 1]'
[2024-08-03 15:36:22] [Rank 0] totoal_tokens=69682, outputs='[1, 2, 3]'
[2024-08-03 15:36:23] [Rank 1] totoal_tokens=68501, outputs='[1, 2, 3]'
[2024-08-03 15:36:25] [Rank 3] totoal_tokens=70524, outputs='[0, 0, 0]'
[2024-08-03 15:36:26] [Rank 2] totoal_tokens=69164, outputs='[2, 2, 2]'
[2024-08-03 15:36:27] [Rank 0] totoal_tokens=69798, outputs='[1, 2, 3]'
[2024-08-03 15:36:30] [Rank 1] totoal_tokens=68619, outputs='```json\n{\n  "questions": [\n    {\n      "question": "Who is the head coach of the United States?",\n      "answer": "'
[2024-08-03 15:36:31] [Rank 2] totoal_tokens=69227, outputs='[1, 2, 3]'
[2024-08-03 15:36:32] [Rank 3] totoal_tokens=70784, outputs='[1, 2, 3]'
[2024-08-03 15:36:33] [Rank 0] totoal_tokens=69862, outputs='{"name":"Haute Grandeur","year":2019,"awards":null}'
[2024-08-03 15:36:36] [Rank 1] totoal_tokens=68718, outputs='[1, 2, 3]'
[2024-08-03 15:36:36] [Rank 2] totoal_tokens=69329, outputs='[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0'
[2024-08-03 15:36:38] [Rank 3] totoal_tokens=70825, outputs='[1, 2, 3]'
[2024-08-03 15:36:38] [Rank 0] totoal_tokens=69897, outputs='[1, 2, 3]'
[2024-08-03 15:36:41] [Rank 1] totoal_tokens=69165, outputs='{"x": 3, "x": 5, "x": 7}'
[2024-08-03 15:36:41] [Rank 2] totoal_tokens=69356, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:36:43] [Rank 3] totoal_tokens=70829, outputs='[1, 2, 3]'
[2024-08-03 15:36:46] [Rank 1] totoal_tokens=69374, outputs='[1, 2, 3]'
[2024-08-03 15:36:47] [Rank 2] totoal_tokens=69370, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:36:48] [Rank 0] totoal_tokens=70511, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
rnVL2-2B_counting-text-test.jsonl:  94%|█████████▎| 717/765 [22:45<04:31,  5.66s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  94%|█████████▍| 718/765 [22:50<04:19,  5.53s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  94%|█████████▍| 719/765 [22:56<04:17,  5.61s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  94%|█████████▍| 720/765 [23:02<04:11,  5.60s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  94%|█████████▍| 721/765 [23:07<04:00,  5.46s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  94%|█████████▍| 722/765 [23:12<03:50,  5.37s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  95%|█████████▍| 723/765 [23:17<03:45,  5.36s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  95%|█████████▍| 724/765 [23:23<03:36,  5.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  95%|████████[2024-08-03 15:36:49] [Rank 3] totoal_tokens=70923, outputs="I'm sorry, I can't help with that."
[2024-08-03 15:36:51] [Rank 1] totoal_tokens=69446, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:36:53] [Rank 2] totoal_tokens=69470, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:36:54] [Rank 0] totoal_tokens=70525, outputs="I'm sorry, I can't help with that."
[2024-08-03 15:36:54] [Rank 3] totoal_tokens=70949, outputs='[1, 2, 3]'
[2024-08-03 15:36:57] [Rank 1] totoal_tokens=69585, outputs='[1, 2, 3]'
[2024-08-03 15:36:58] [Rank 2] totoal_tokens=69563, outputs='{"number_of_lighthouses": 1}'
[2024-08-03 15:37:00] [Rank 0] totoal_tokens=70811, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:37:00] [Rank 3] totoal_tokens=71069, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:37:03] [Rank 2] totoal_tokens=69783, outputs='{ "chest": 6 }'
[2024-08-03 15:37:03] [Rank 1] totoal_tokens=69634, outputs="I'm sorry, I can't help with that."
[2024-08-03 15:37:06] [Rank 0] totoal_tokens=71069, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:37:06] [Rank 3] totoal_tokens=71629, outputs='{"kurtosis": 3.0}'
[2024-08-03 15:37:08] [Rank 2] totoal_tokens=69846, outputs='420'
[2024-08-03 15:37:09] [Rank 1] totoal_tokens=69689, outputs='The answer is 1.'
[2024-08-03 15:37:11] [Rank 3] totoal_tokens=72605, outputs='[1, 2, 3]'
[2024-08-03 15:37:11] [Rank 0] totoal_tokens=71106, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:37:13] [Rank 2] totoal_tokens=70711, outputs='{"x": 2, "x": 2, "x": 2}'
[2024-08-03 15:37:16] [Rank 1] totoal_tokens=69704, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:37:16] [Rank 3] totoal_tokens=72751, outputs='The answer is 0.'
[2024-08-03 15:37:17] [Rank 0] totoal_tokens=71225, outputs='[1, 2, 3]'
[2024-08-03 15:37:18] [Rank 2] totoal_tokens=70740, outputs='[1, 2, 3]'
[2024-08-03 15:37:22] [Rank 3] totoal_tokens=72873, outputs='[1, 2, 3]'
[2024-08-03 15:37:22] [Rank 0] totoal_tokens=71248, outputs='The newest Revenge of your own Unbelievable Hulk'
[2024-08-03 15:37:23] [Rank 1] totoal_tokens=69847, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:37:24] [Rank 2] totoal_tokens=70805, outputs='[1, 2, 3]'
[2024-08-03 15:37:27] [Rank 3] totoal_tokens=72930, outputs='{ "x": 3, "x": 2, "x": 1 }'
[2024-08-03 15:37:28] [Rank 0] totoal_tokens=71387, outputs='[1, 2, 3]'
[2024-08-03 15:37:29] [Rank 2] totoal_tokens=71014, outputs='{"vases": [1, 2, 3]}'
[2024-08-03 15:37:29] [Rank 1] totoal_tokens=70011, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:37:34] [Rank 3] totoal_tokens=73057, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:37:34] [Rank 0] totoal_tokens=71972, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 15:37:35] [Rank 1] totoal_tokens=70069, outputs='{\n  "title": "The Knight of Wands",\n  "description": "The Knight of Wands rides a white horse charging forward. The white horse'
[2024-08-03 15:37:36] [Rank 2] totoal_tokens=71289, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:37:39] [Rank 3] totoal_tokens=73194, outputs='[1, 2, 3]'
[2024-08-03 15:37:40] [Rank 0] totoal_tokens=72538, outputs='[1, 2, 3]'
█▍| 725/765 [23:32<04:24,  6.62s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  95%|█████████▍| 726/765 [23:39<04:15,  6.56s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  95%|█████████▌| 727/765 [23:44<03:57,  6.24s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  95%|█████████▌| 728/765 [23:50<03:48,  6.18s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  95%|█████████▌| 729/765 [23:56<03:35,  5.98s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  95%|█████████▌| 730/765 [24:01<03:24,  5.84s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  96%|█████████▌| 731/765 [24:07<03:18,  5.83s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  96%|█████████▌| 732/765 [24:12<03:05,  5.62s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  96%|█████████▌| 733/765 [24:19<03:07,  5.86s/it]
Processing InternVL2-2B[2024-08-03 15:37:41] [Rank 1] totoal_tokens=70306, outputs='{"x": 0, "x": 0, "x": 0}'
[2024-08-03 15:37:42] [Rank 2] totoal_tokens=71594, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:37:46] [Rank 0] totoal_tokens=72621, outputs='[1, 2, 3]'
[2024-08-03 15:37:46] [Rank 3] totoal_tokens=73206, outputs='{ "name": "Agnes Lattauer Sweitzer", "age": "46", "gender": "female", "occupation": "teacher", "'
[2024-08-03 15:37:47] [Rank 1] totoal_tokens=70534, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:37:49] [Rank 2] totoal_tokens=71753, outputs="I'm sorry, I can't help with that."
[2024-08-03 15:37:52] [Rank 0] totoal_tokens=72637, outputs='[1, 2, 3]'
[2024-08-03 15:37:53] [Rank 1] totoal_tokens=71316, outputs='[1, 2, 3]'
[2024-08-03 15:37:55] [Rank 3] totoal_tokens=73647, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:37:55] [Rank 2] totoal_tokens=71982, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:37:57] [Rank 0] totoal_tokens=72862, outputs='{"x": 3}'
[2024-08-03 15:38:00] [Rank 1] totoal_tokens=71515, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:38:01] [Rank 2] totoal_tokens=72036, outputs='[1, 2, 3]'
[2024-08-03 15:38:03] [Rank 0] totoal_tokens=72863, outputs='[1, 2, 3]'
[2024-08-03 15:38:03] [Rank 3] totoal_tokens=73826, outputs='I am an honest person.'
[2024-08-03 15:38:05] [Rank 1] totoal_tokens=71755, outputs='```json\n{\n  "number_of_★": 3\n}\n```'
[2024-08-03 15:38:07] [Rank 2] totoal_tokens=72656, outputs="I'm sorry, I can't help you with that."
[2024-08-03 15:38:08] [Rank 0] totoal_tokens=73196, outputs='[1, 2, 3]'
[2024-08-03 15:38:10] [Rank 3] totoal_tokens=74741, outputs="I'm sorry, I can't help with that."
[2024-08-03 15:38:12] [Rank 1] totoal_tokens=71791, outputs='Abbott Laboratories'
[2024-08-03 15:38:12] [Rank 2] totoal_tokens=72905, outputs='The answer is “Yes”.'
[2024-08-03 15:38:14] [Rank 0] totoal_tokens=73232, outputs='```json\n{\n  "number_of_apples": 0\n}\n```'
[2024-08-03 15:38:17] [Rank 3] totoal_tokens=74896, outputs="I'm not sure he will be able to serve successfully under Trump, as U.S. Secretary of State Mike Pompeo has, or follows his successor out the"
[2024-08-03 15:38:18] [Rank 1] totoal_tokens=71924, outputs='The answer is 2.'
[2024-08-03 15:38:18] [Rank 2] totoal_tokens=72954, outputs='```json\n{\n  "number_of_computers": 0\n}\n```'
[2024-08-03 15:38:20] [Rank 0] totoal_tokens=73256, outputs='[1, 2, 3]'
[2024-08-03 15:38:24] [Rank 2] totoal_tokens=73077, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:38:24] [Rank 3] totoal_tokens=75290, outputs='[1, 2, 3]'
[2024-08-03 15:38:24] [Rank 1] totoal_tokens=72643, outputs='The answer is 0.'
[2024-08-03 15:38:28] [Rank 0] totoal_tokens=73275, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
_counting-text-test.jsonl:  96%|█████████▌| 734/765 [24:25<03:05,  6.00s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  96%|█████████▌| 735/765 [24:31<02:58,  5.94s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  96%|█████████▌| 736/765 [24:37<02:54,  6.03s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  96%|█████████▋| 737/765 [24:42<02:41,  5.76s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  96%|█████████▋| 738/765 [24:47<02:31,  5.60s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  97%|█████████▋| 739/765 [24:53<02:26,  5.63s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  97%|█████████▋| 740/765 [24:58<02:18,  5.55s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  97%|█████████▋| 741/765 [25:05<02:19,  5.82s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  97%|█████████▋| [2024-08-03 15:38:30] [Rank 2] totoal_tokens=73093, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:38:30] [Rank 1] totoal_tokens=72715, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 15:38:31] [Rank 3] totoal_tokens=75537, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:38:33] [Rank 0] totoal_tokens=73673, outputs='[1, 2, 3]'
[2024-08-03 15:38:36] [Rank 1] totoal_tokens=73048, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:38:37] [Rank 2] totoal_tokens=73144, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:38:37] [Rank 3] totoal_tokens=75587, outputs='[1, 1, 1]'
[2024-08-03 15:38:39] [Rank 0] totoal_tokens=73851, outputs='[0, 0, 0]'
[2024-08-03 15:38:42] [Rank 1] totoal_tokens=73469, outputs='Magene Noir'
[2024-08-03 15:38:42] [Rank 2] totoal_tokens=73213, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:38:43] [Rank 3] totoal_tokens=75623, outputs='The United States Department of Education has awarded Northeastern a five-year, $1,161,325 Ronald E. McNair Postbaccalaureate Achie'
[2024-08-03 15:38:47] [Rank 0] totoal_tokens=73900, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10]'
[2024-08-03 15:38:48] [Rank 1] totoal_tokens=73753, outputs='{"name":"Bhanu Athaiya","occupation":"costume designer","birth_date":"1909-10-10","death_date":"1990'
[2024-08-03 15:38:49] [Rank 2] totoal_tokens=73262, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:38:50] [Rank 3] totoal_tokens=76237, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 15:38:55] [Rank 0] totoal_tokens=74316, outputs='[1, 2, 3]'
[2024-08-03 15:38:56] [Rank 2] totoal_tokens=73452, outputs='I am a native English speaker.'
[2024-08-03 15:38:56] [Rank 1] totoal_tokens=74377, outputs="I'm sorry, I can't help with that."
[2024-08-03 15:38:56] [Rank 3] totoal_tokens=76252, outputs='The Canucks officially embraced the idea of embracing a mascot when Brian Burke took over the reigns as general manager. Although he wasn’t the biggest fan'
[2024-08-03 15:39:01] [Rank 0] totoal_tokens=74846, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:39:02] [Rank 2] totoal_tokens=74307, outputs='[1, 2, 3]'
[2024-08-03 15:39:03] [Rank 3] totoal_tokens=76650, outputs='The answer is “I love it when the internet tells me who I’m dating. Good one,” Tomi Lahren, 28, posted'
[2024-08-03 15:39:03] [Rank 1] totoal_tokens=74766, outputs='[1, 2, 3]'
[2024-08-03 15:39:08] [Rank 0] totoal_tokens=74884, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:39:08] [Rank 2] totoal_tokens=74308, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:39:08] [Rank 3] totoal_tokens=76790, outputs='[1, 2, 3]'
[2024-08-03 15:39:09] [Rank 1] totoal_tokens=75162, outputs='[1, 2, 3]'
[2024-08-03 15:39:14] [Rank 0] totoal_tokens=74951, outputs='I am not a fan of this.'
[2024-08-03 15:39:15] [Rank 3] totoal_tokens=76882, outputs='[0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0'
[2024-08-03 15:39:15] [Rank 2] totoal_tokens=74846, outputs='[1, 2, 3]'
[2024-08-03 15:39:16] [Rank 1] totoal_tokens=75468, outputs='[1, 2, 3]'
[2024-08-03 15:39:22] [Rank 1] totoal_tokens=75502, outputs='Dr. Saeed I. Latif'
[2024-08-03 15:39:23] [Rank 2] totoal_tokens=74921, outputs='[0, 0, 0]'
[2024-08-03 15:39:24] [Rank 3] totoal_tokens=77101, outputs='{\n  "vases": [\n    "vase1",\n    "vase2",\n    "vase3"\n  ]\n}'
[2024-08-03 15:39:24] [Rank 0] totoal_tokens=75277, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:39:29] [Rank 1] totoal_tokens=75562, outputs='Grace and Frankie'
[2024-08-03 15:39:29] [Rank 2] totoal_tokens=74947, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:39:30] [Rank 3] totoal_tokens=77266, outputs='[1, 2, 3]'
[2024-08-03 15:39:30] [Rank 0] totoal_tokens=75615, outputs='The United States Department of Education has awarded Northeastern a five-year, $1,161,325 Ronald E. McNair Postbaccalaureate Achie'
742/765 [25:12<02:24,  6.29s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  97%|█████████▋| 743/765 [25:18<02:14,  6.12s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  97%|█████████▋| 744/765 [25:24<02:08,  6.13s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  97%|█████████▋| 745/765 [25:32<02:12,  6.62s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  98%|█████████▊| 746/765 [25:40<02:12,  6.97s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  98%|█████████▊| 747/765 [25:46<02:02,  6.82s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  98%|█████████▊| 748/765 [25:52<01:52,  6.60s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  98%|█████████▊| 749/765 [25:59<01:43,  6.50s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  98%|█████████▊| 750/765 [26:09<01:53,  7.55s/it]
Processing InternVL2-2B_countin[2024-08-03 15:39:35] [Rank 1] totoal_tokens=75797, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:39:36] [Rank 2] totoal_tokens=75372, outputs='[1, 2, 3]'
[2024-08-03 15:39:36] [Rank 0] totoal_tokens=75974, outputs='Peter'
[2024-08-03 15:39:36] [Rank 3] totoal_tokens=77535, outputs='[1, 2, 3]'
[2024-08-03 15:39:41] [Rank 1] totoal_tokens=76225, outputs='I am a fan of the show.'
[2024-08-03 15:39:43] [Rank 3] totoal_tokens=77547, outputs='[1, 2, 3]'
[2024-08-03 15:39:43] [Rank 2] totoal_tokens=75441, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:39:43] [Rank 0] totoal_tokens=76145, outputs='[1, 2, 3]'
[2024-08-03 15:39:48] [Rank 1] totoal_tokens=76253, outputs='$0.00\nReply\n[-]\nfiberfrau (64) 3 months ago\n\n$0.00\nReply\n[-]\nfiber'
[2024-08-03 15:39:49] [Rank 0] totoal_tokens=76287, outputs='{"lighthouse": "Castelao", "location": "Silvarrei"}'
[2024-08-03 15:39:50] [Rank 3] totoal_tokens=77671, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:39:50] [Rank 2] totoal_tokens=75941, outputs='“The 4000 was definitely a very popular machine and it eventually became the best-selling tractor in the 6X range.”'
[2024-08-03 15:39:54] [Rank 1] totoal_tokens=76302, outputs='I am a male.'
[2024-08-03 15:39:55] [Rank 0] totoal_tokens=76334, outputs='The answer is 0.'
[2024-08-03 15:39:56] [Rank 3] totoal_tokens=77979, outputs='The answer is 0.'
[2024-08-03 15:39:56] [Rank 2] totoal_tokens=76206, outputs='[1, 2, 3]'
[2024-08-03 15:40:01] [Rank 0] totoal_tokens=76659, outputs='[1, 2, 3]'
[2024-08-03 15:40:01] [Rank 1] totoal_tokens=76580, outputs='{\n  "vpc_ping": "1",\n  "vpc_ping": "1",\n  "vpc_ping": "1"\n}'
[2024-08-03 15:40:03] [Rank 3] totoal_tokens=78171, outputs='[1, 2, 3]'
[2024-08-03 15:40:04] [Rank 2] totoal_tokens=76834, outputs='[1, 2, 3]'
[2024-08-03 15:40:08] [Rank 0] totoal_tokens=78356, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 15:40:09] [Rank 3] totoal_tokens=78227, outputs='[1, 2, 3]'
[2024-08-03 15:40:09] [Rank 1] totoal_tokens=76770, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 15:40:09] [Rank 2] totoal_tokens=76860, outputs="I'm sorry, but I cannot provide you with the answer to that question."
[2024-08-03 15:40:15] [Rank 0] totoal_tokens=78433, outputs='[1, 2, 3]'
[2024-08-03 15:40:16] [Rank 1] totoal_tokens=76921, outputs='[1, 2, 3]'
[2024-08-03 15:40:16] [Rank 2] totoal_tokens=77329, outputs='[1, 2, 3]'
[2024-08-03 15:40:16] [Rank 3] totoal_tokens=78454, outputs='I am a champion procrastinator when it comes to exercise as I’ve already said. But the best way is to bat away the excuses. There'
[2024-08-03 15:40:22] [Rank 0] totoal_tokens=79052, outputs='[1, 2, 3]'
g-text-test.jsonl:  98%|█████████▊| 751/765 [26:15<01:41,  7.24s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  98%|█████████▊| 752/765 [26:20<01:27,  6.70s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  98%|█████████▊| 753/765 [26:28<01:22,  6.85s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  99%|█████████▊| 754/765 [26:34<01:14,  6.73s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  99%|█████████▊| 755/765 [26:40<01:03,  6.39s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  99%|█████████▉| 756/765 [26:46<00:56,  6.26s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  99%|█████████▉| 757/765 [26:53<00:52,  6.57s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  99%|█████████▉| 758/765 [27:00<00:46,  6.66s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  99%|█████████▉| 759/765 [2024-08-03 15:40:22] [Rank 2] totoal_tokens=77684, outputs='The answer is 0.'
[2024-08-03 15:40:23] [Rank 1] totoal_tokens=77388, outputs='I am a good person.'
[2024-08-03 15:40:24] [Rank 3] totoal_tokens=78859, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:40:31] [Rank 2] totoal_tokens=77824, outputs="The worst part of DragonMeet is that it is always over for another year so quickly. I know it's not practical for a one-day convention to start before"
[2024-08-03 15:40:32] [Rank 1] totoal_tokens=78742, outputs='{"x": 0, "x": 0, "x": 0}'
[2024-08-03 15:40:33] [Rank 0] totoal_tokens=79333, outputs='{"x": 4}'
[2024-08-03 15:40:33] [Rank 3] totoal_tokens=78868, outputs='{"x": 2, "x": 2, "x": 2}'
[2024-08-03 15:40:33] Rank 3 Finish
[2024-08-03 15:40:39] [Rank 2] totoal_tokens=77863, outputs='The answer is 0.'
[2024-08-03 15:40:40] [Rank 1] totoal_tokens=78987, outputs="I'm sorry, but I can't help you with that."
[2024-08-03 15:40:40] [Rank 0] totoal_tokens=79406, outputs="I'm sorry, I can't help with that."
[2024-08-03 15:40:46] [Rank 2] totoal_tokens=77875, outputs='{\n  "username": "yallapapi70",\n  "achievement": "Microdosing Day 2",\n  "badge": "3 steps'
[2024-08-03 15:40:47] [Rank 0] totoal_tokens=79426, outputs='The answer is 0.'
[2024-08-03 15:40:48] [Rank 1] totoal_tokens=79012, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:40:52] [Rank 2] totoal_tokens=77885, outputs="I am not sure if you are referring to the game's mechanics or the game's story."
[2024-08-03 15:40:53] [Rank 0] totoal_tokens=79471, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 15:40:54] [Rank 1] totoal_tokens=79035, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 15:40:58] [Rank 2] totoal_tokens=78376, outputs='[1, 2, 3]'
[2024-08-03 15:41:00] [Rank 0] totoal_tokens=79724, outputs='[1, 2, 3]'
[2024-08-03 15:41:02] [Rank 1] totoal_tokens=79431, outputs='“Power is everything. You only think you have it.”\n\nNatalie “Wattson” Paquette is a familiar face in the Ap'
[2024-08-03 15:41:05] [Rank 2] totoal_tokens=79428, outputs='The answer is 0.'
[2024-08-03 15:41:06] [Rank 0] totoal_tokens=79861, outputs='[1, 2, 3]'
[27:07<00:40,  6.72s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  99%|█████████▉| 760/765 [27:17<00:39,  7.89s/it]
Processing InternVL2-2B_counting-text-test.jsonl:  99%|█████████▉| 761/765 [27:25<00:30,  7.72s/it]
Processing InternVL2-2B_counting-text-test.jsonl: 100%|█████████▉| 762/765 [27:32<00:22,  7.52s/it]
Processing InternVL2-2B_counting-text-test.jsonl: 100%|█████████▉| 763/765 [27:38<00:14,  7.20s/it]
Processing InternVL2-2B_counting-text-test.jsonl: 100%|█████████▉| 764/765 [27:44<00:06,  6.87s/it]
Processing InternVL2-2B_counting-text-test.jsonl: 100%|██████████| 765/765 [27:51<00:00,  6.80s/it]
Processing InternVL2-2B_counting-text-test.jsonl: 100%|██████████| 765/765 [27:51<00:00,  2.18s/it]
[2024-08-03 15:41:06] Rank 0 Finish
[2024-08-03 15:41:09] [Rank 1] totoal_tokens=79633, outputs='[1, 2, 3]'
[2024-08-03 15:41:13] [Rank 2] totoal_tokens=79460, outputs='[1, 2, 3]'
[2024-08-03 15:41:16] [Rank 1] totoal_tokens=79776, outputs='The answer is 3.'
[2024-08-03 15:41:19] [Rank 2] totoal_tokens=79533, outputs="I don't have any information about the number of brushes."
[2024-08-03 15:41:22] [Rank 1] totoal_tokens=79786, outputs='[0, 0, 0]'
[2024-08-03 15:41:22] Rank 1 Finish
[2024-08-03 15:41:27] [Rank 2] totoal_tokens=79841, outputs='```json\n{\n  "title": "The Brothers Grimm",\n  "author": "Franz Xaver Von Schonwerth",'
[2024-08-03 15:41:27] Rank 2 Finish
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/temp_InternVL2-2B_counting-text-test/* >  work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/InternVL2-2B_counting-text-test.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/temp_InternVL2-2B_counting-text-test/* >  work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/InternVL2-2B_counting-text-test.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/temp_InternVL2-2B_counting-text-test/* >  work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/InternVL2-2B_counting-text-test.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/temp_InternVL2-2B_counting-text-test/* >  work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/InternVL2-2B_counting-text-test.jsonl
python eval/mm_niah/calculate_scores.py --outputs-dir   work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test
python eval/mm_niah/calculate_scores.py --outputs-dir   work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test
python eval/mm_niah/calculate_scores.py --outputs-dir   work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test
python eval/mm_niah/calculate_scores.py --outputs-dir   work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.

results on test split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/results/InternVL2-2B/scores_test.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.

results on test split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/results/InternVL2-2B/scores_test.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.

results on test split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/results/InternVL2-2B/scores_test.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.

results on test split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-test/results/InternVL2-2B/scores_test.json