Hugging Face's logo

OpenGVLab
/
InternVL2-2B

Image-Text-to-Text
Transformers
Safetensors
multilingual
internvl_chat
feature-extraction
internvl
custom_code
conversational
Model card Files
xet
 Community
7
InternVL2-2B / eval_mm_niah /counting-text-val.log
cuierfei's picture
cuierfei
Upload folder using huggingface_hub
b537a0f verified
raw
history blame
72.3 kB
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
language_model.model.layers.0 4
language_model.model.layers.1 4
language_model.model.layers.2 4
language_model.model.layers.3 4
language_model.model.layers.4 4
language_model.model.layers.5 4
language_model.model.layers.6 4
language_model.model.layers.7 4
language_model.model.layers.8 4
language_model.model.layers.9 4
language_model.model.layers.10 4
language_model.model.layers.11 4
language_model.model.layers.12 4
language_model.model.layers.13 4
language_model.model.layers.14 4
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
language_model.model.layers.15 4
language_model.model.layers.16 4
language_model.model.layers.17 4
language_model.model.layers.18 4
language_model.model.layers.19 4
language_model.model.layers.20 4
language_model.model.layers.21 4
language_model.model.layers.22 4
language_model.model.layers.23 4
vision_model.encoder.layers.0 0
vision_model.encoder.layers.1 0
vision_model.encoder.layers.2 0
vision_model.encoder.layers.3 0
vision_model.encoder.layers.4 0
vision_model.encoder.layers.5 0
vision_model.encoder.layers.6 0
vision_model.encoder.layers.7 0
vision_model.encoder.layers.8 0
vision_model.encoder.layers.9 0
vision_model.encoder.layers.10 0
vision_model.encoder.layers.11 0
vision_model.encoder.layers.12 0
vision_model.encoder.layers.13 0
vision_model.encoder.layers.14 0
vision_model.encoder.layers.15 0
vision_model.encoder.layers.16 0
vision_model.encoder.layers.17 0
vision_model.encoder.layers.18 0
vision_model.encoder.layers.19 0
vision_model.encoder.layers.20 0
vision_model.encoder.layers.21 0
vision_model.encoder.layers.22 0
vision_model.encoder.layers.23 0
vision_model.embeddings 0
mlp1 0
language_model.model.tok_embeddings 4
language_model.model.norm 4
language_model.output 4
language_model.model.embed_tokens 4
language_model.lm_head 4
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [3] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task counting-text-val, devices: {device(type='cuda', index=3), device(type='cuda', index=7)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [1] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task counting-text-val, devices: {device(type='cuda', index=1), device(type='cuda', index=5)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [2] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task counting-text-val, devices: {device(type='cuda', index=2), device(type='cuda', index=6)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [0] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task counting-text-val, devices: {device(type='cuda', index=0), device(type='cuda', index=4)}
Rank 3 len(skip_idx)=0
Rank 0 len(skip_idx)=0
Rank 1 len(skip_idx)=0
Rank 2 len(skip_idx)=0
[2024-08-03 12:40:38] [Rank 0] totoal_tokens=648, outputs='[4, 2, 0]'
[2024-08-03 12:40:38] [Rank 2] totoal_tokens=601, outputs='[2, 2, 2]'
[2024-08-03 12:40:38] [Rank 3] totoal_tokens=706, outputs='```json\n{\n "sun_count": 4\n}\n```'
[2024-08-03 12:40:38] [Rank 1] totoal_tokens=704, outputs='```json\n{\n "book_count": 4\n}\n```'
[2024-08-03 12:40:38] [Rank 0] totoal_tokens=663, outputs='[1, 1, 1]'
[2024-08-03 12:40:39] [Rank 2] totoal_tokens=620, outputs='```json\n{\n "cup": 1\n}\n```'
[2024-08-03 12:40:39] [Rank 1] totoal_tokens=886, outputs='[3, 4, 5]'
[2024-08-03 12:40:39] [Rank 3] totoal_tokens=1026, outputs='```json\n{\n "sun_count": 14\n}\n```'
[2024-08-03 12:40:39] [Rank 0] totoal_tokens=695, outputs='```json\n{\n "score": 2\n}\n```'
[2024-08-03 12:40:39] [Rank 2] totoal_tokens=628, outputs='[2, 2, 2]'
[2024-08-03 12:40:39] [Rank 1] totoal_tokens=889, outputs='[1, 1, 1]'
[2024-08-03 12:40:39] [Rank 3] totoal_tokens=1031, outputs='[1, 1, 1]'
[2024-08-03 12:40:39] [Rank 0] totoal_tokens=780, outputs='[2, 2, 2]'
[2024-08-03 12:40:39] [Rank 2] totoal_tokens=682, outputs='[1, 1, 1]'
[2024-08-03 12:40:39] [Rank 3] totoal_tokens=1041, outputs='[1, 1, 1]'
[2024-08-03 12:40:39] [Rank 1] totoal_tokens=971, outputs='```json\n{\n "number_of_hearts": 2\n}\n```'
[2024-08-03 12:40:39] [Rank 2] totoal_tokens=731, outputs='[3, 3, 3]'
[2024-08-03 12:40:40] [Rank 1] totoal_tokens=1021, outputs='[1, 1, 1]'
[2024-08-03 12:40:40] [Rank 3] totoal_tokens=1140, outputs='```json\n{\n "sun_count": 2\n}\n```'
[2024-08-03 12:40:40] [Rank 2] totoal_tokens=739, outputs='[3, 3, 3]'
[2024-08-03 12:40:40] [Rank 0] totoal_tokens=1025, outputs='```json\n{\n "clouds": [\n {\n "date": "Aug 07",\n "percentage": 85\n },'
[2024-08-03 12:40:40] [Rank 1] totoal_tokens=1035, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:40:40] [Rank 0] totoal_tokens=1027, outputs='[1, 1, 1]'
[2024-08-03 12:40:40] [Rank 3] totoal_tokens=1206, outputs='```json\n{\n "ship_count": 2\n}\n```'
[2024-08-03 12:40:40] [Rank 2] totoal_tokens=870, outputs='```json\n{\n "clouds": 1\n}\n```'
[2024-08-03 12:40:41] [Rank 0] totoal_tokens=1036, outputs='[3, 1, 3]'
[2024-08-03 12:40:41] [Rank 1] totoal_tokens=1035, outputs='```json\n{\n "number_of_pens": 1\n}\n```'
[2024-08-03 12:40:41] [Rank 3] totoal_tokens=1212, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:40:41] [Rank 3] totoal_tokens=1233, outputs='[4]'
[2024-08-03 12:40:41] [Rank 0] totoal_tokens=1086, outputs='[1, 1, 1]'
[2024-08-03 12:40:41] [Rank 1] totoal_tokens=1085, outputs='[3, 2, 3]'
[2024-08-03 12:40:41] [Rank 2] totoal_tokens=998, outputs='```json\n{\n "min": 0.5,\n "max": 2.5,\n "average": 1.5'
[2024-08-03 12:40:41] [Rank 3] totoal_tokens=1238, outputs='[1, 1, 1]'
[2024-08-03 12:40:41] [Rank 0] totoal_tokens=1094, outputs='[1, 1, 1]'
[2024-08-03 12:40:42] [Rank 1] totoal_tokens=1099, outputs='[1, 1, 1]'
[2024-08-03 12:40:42] [Rank 2] totoal_tokens=1150, outputs='```json\n{\n "pen_count": 2\n}\n```'
[2024-08-03 12:40:42] [Rank 3] totoal_tokens=1367, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:40:42] [Rank 0] totoal_tokens=1183, outputs='```json\n{\n "cloud_count": 4\n}\n```'
 Processing InternVL2-2B_counting-text-val.jsonl: 0%| | 0/130 [00:00<?, ?it/s] Processing InternVL2-2B_counting-text-val.jsonl: 1%| | 1/130 [00:01<02:29, 1.16s/it] Processing InternVL2-2B_counting-text-val.jsonl: 2%|▏ | 2/130 [00:01<01:24, 1.52it/s] Processing InternVL2-2B_counting-text-val.jsonl: 2%|▏ | 3/130 [00:01<01:11, 1.77it/s] Processing InternVL2-2B_counting-text-val.jsonl: 3%|β–Ž | 4/130 [00:02<01:00, 2.10it/s] Processing InternVL2-2B_counting-text-val.jsonl: 4%|▍ | 5/130 [00:03<01:17, 1.62it/s] Processing InternVL2-2B_counting-text-val.jsonl: 5%|▍ | 6/130 [00:03<01:05, 1.91it/s] Processing InternVL2-2B_counting-text-val.jsonl: 5%|β–Œ | 7/130 [00:03<00:57, 2.16it/s] Processing InternVL2-2B_counting-text-val.jsonl: 6%|β–Œ | 8/130 [00:04<00:52, 2.32it/s] Processing InternVL2-2B_counting-text-val.jsonl: 7%|β–‹ | 9/130 [00:04<00:48, 2.51it/s] Processing InternVL2-2B_counting-text-val.jso[2024-08-03 12:40:42] [Rank 1] totoal_tokens=1114, outputs='[4, 3, 2]'
[2024-08-03 12:40:42] [Rank 2] totoal_tokens=1248, outputs='[3, 3, 3]'
[2024-08-03 12:40:42] [Rank 0] totoal_tokens=1232, outputs='[4, 4, 4]'
[2024-08-03 12:40:42] [Rank 3] totoal_tokens=1405, outputs='```json\n{\n "pen_count": 3\n}\n```'
[2024-08-03 12:40:43] [Rank 1] totoal_tokens=1206, outputs='```json\n{\n "heart_count": 3\n}\n```'
[2024-08-03 12:40:43] [Rank 2] totoal_tokens=1539, outputs='```json\n{\n "clouds": 4\n}\n```'
[2024-08-03 12:40:43] [Rank 0] totoal_tokens=1385, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:40:43] [Rank 3] totoal_tokens=1449, outputs='```json\n{\n "cup": 2\n}\n```'
[2024-08-03 12:40:43] [Rank 1] totoal_tokens=1261, outputs='```json\n{\n "sun_count": 4\n}\n```'
[2024-08-03 12:40:43] [Rank 2] totoal_tokens=1548, outputs='```json\n{\n "heart_count": 4\n}\n```'
[2024-08-03 12:40:43] [Rank 0] totoal_tokens=1405, outputs='```json\n{\n "book_count": 1\n}\n```'
[2024-08-03 12:40:43] [Rank 3] totoal_tokens=1499, outputs='```json\n{\n "pen_count": 3\n}\n```'
[2024-08-03 12:40:43] [Rank 1] totoal_tokens=1327, outputs='[1, 1, 1]'
[2024-08-03 12:40:44] [Rank 2] totoal_tokens=1549, outputs='```json\n{\n "number_of_ships": 4\n}\n```'
[2024-08-03 12:40:44] [Rank 3] totoal_tokens=1548, outputs='```json\n{\n "count": 3\n}\n```'
[2024-08-03 12:40:44] [Rank 0] totoal_tokens=1548, outputs='```json\n{\n "clouds": 1\n}\n```'
[2024-08-03 12:40:44] [Rank 1] totoal_tokens=1449, outputs='```json\n{\n "ship_count": 2\n}\n```'
[2024-08-03 12:40:44] [Rank 2] totoal_tokens=1549, outputs='```json\n{\n "book_count": 1\n}\n```'
[2024-08-03 12:40:44] [Rank 3] totoal_tokens=1549, outputs='```json\n{\n "ship_count": 4\n}\n```'
[2024-08-03 12:40:44] [Rank 0] totoal_tokens=1549, outputs='```json\n{\n "number_of_hearts": 4\n}\n```'
[2024-08-03 12:40:45] [Rank 1] totoal_tokens=1549, outputs='```json\n{\n "clouds": 3\n}\n```'
[2024-08-03 12:40:45] [Rank 2] totoal_tokens=1549, outputs='```json\n{\n "book_count": 2\n}\n```'
[2024-08-03 12:40:45] [Rank 3] totoal_tokens=1549, outputs='```json\n{\n "book_count": 4\n}\n```'
[2024-08-03 12:40:45] [Rank 0] totoal_tokens=1549, outputs='```json\n{\n "book_count": 4\n}\n```'
[2024-08-03 12:40:45] [Rank 1] totoal_tokens=1549, outputs='```json\n{\n "number_of_hearts": 4\n}\n```'
[2024-08-03 12:40:45] [Rank 2] totoal_tokens=1551, outputs='```json\n{\n "sun_count": 4\n}\n```'
[2024-08-03 12:40:45] [Rank 0] totoal_tokens=1549, outputs='```json\n{\n "pen_count": 4\n}\n```'
[2024-08-03 12:40:45] [Rank 3] totoal_tokens=2053, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:40:46] [Rank 1] totoal_tokens=1551, outputs='```json\n{\n "sun_count": 3\n}\n```'
[2024-08-03 12:40:46] [Rank 2] totoal_tokens=1628, outputs='[2, 2, 2]'
[2024-08-03 12:40:46] [Rank 3] totoal_tokens=2095, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:40:46] [Rank 0] totoal_tokens=1575, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:40:47] [Rank 3] totoal_tokens=2257, outputs='```json\n{\n "number_of_books": 1\n}\n```'
[2024-08-03 12:40:47] [Rank 1] totoal_tokens=1628, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:40:47] [Rank 2] totoal_tokens=2011, outputs='```json\n{\n "clouds": [\n {\n "number": 1,\n "color": "red"\n },\n {'
[2024-08-03 12:40:47] [Rank 0] totoal_tokens=1869, outputs='The Met Live in HD is a live broadcast from the Metropolitan Opera House in New York that is recorded in high definition (HD) and broadcast to different cinemas'
[2024-08-03 12:40:47] [Rank 3] totoal_tokens=2495, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:40:47] [Rank 2] totoal_tokens=2190, outputs='[2, 2, 2, 2, 2]'
[2024-08-03 12:40:48] [Rank 1] totoal_tokens=1908, outputs='```json\n{\n "MobsterName": "La-mina Monoyra",\n "Rank": "Bow to me now or have your'
[2024-08-03 12:40:48] [Rank 0] totoal_tokens=2488, outputs='```json\n{\n "number_of_books": 4\n}\n```'
nl: 8%|β–Š | 10/130 [00:04<00:51, 2.34it/s] Processing InternVL2-2B_counting-text-val.jsonl: 8%|β–Š | 11/130 [00:05<00:47, 2.49it/s] Processing InternVL2-2B_counting-text-val.jsonl: 9%|β–‰ | 12/130 [00:05<00:53, 2.22it/s] Processing InternVL2-2B_counting-text-val.jsonl: 10%|β–ˆ | 13/130 [00:06<00:56, 2.07it/s] Processing InternVL2-2B_counting-text-val.jsonl: 11%|β–ˆ | 14/130 [00:07<00:58, 1.98it/s] Processing InternVL2-2B_counting-text-val.jsonl: 12%|β–ˆβ– | 15/130 [00:07<01:00, 1.91it/s] Processing InternVL2-2B_counting-text-val.jsonl: 12%|β–ˆβ– | 16/130 [00:08<00:59, 1.93it/s] Processing InternVL2-2B_counting-text-val.jsonl: 13%|β–ˆβ–Ž | 17/130 [00:08<00:58, 1.95it/s] Processing InternVL2-2B_counting-text-val.jsonl: 14%|β–ˆβ– | 18/130 [00:09<00:59, 1.89it/s] Processing InternVL2-2B_counting-text-val.jsonl: 15%|β–ˆβ– | 19/130 [00:10<01:14, 1.49it/s] Processing InternVL2-2B_counting-text-val.jsonl: 15%|β–ˆοΏ½[2024-08-03 12:40:48] [Rank 2] totoal_tokens=2726, outputs='[1, 2, 3]'
[2024-08-03 12:40:48] [Rank 3] totoal_tokens=2778, outputs='```json\n{\n "cloud": 1\n}\n```'
[2024-08-03 12:40:48] [Rank 1] totoal_tokens=1938, outputs='[2, 2, 2]'
[2024-08-03 12:40:48] [Rank 3] totoal_tokens=3008, outputs='[1, 2, 3]'
[2024-08-03 12:40:48] [Rank 2] totoal_tokens=2858, outputs='```json\n{\n "result": 1\n}\n```'
[2024-08-03 12:40:48] [Rank 0] totoal_tokens=2849, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:40:49] [Rank 3] totoal_tokens=3045, outputs='[1, 1, 1]'
[2024-08-03 12:40:49] [Rank 1] totoal_tokens=2127, outputs='```json\n{\n "book_count": 2\n}\n```'
[2024-08-03 12:40:49] [Rank 2] totoal_tokens=2900, outputs='```json\n{\n "cup_count": 4\n}\n```'
[2024-08-03 12:40:49] [Rank 0] totoal_tokens=2891, outputs='```json\n{\n "book_count": 4\n}\n```'
[2024-08-03 12:40:49] [Rank 1] totoal_tokens=2521, outputs='```json\n{\n "cloud_count": 1\n}\n```'
[2024-08-03 12:40:49] [Rank 3] totoal_tokens=3081, outputs='```json\n{\n "number_of_hearts": 3\n}\n```'
[2024-08-03 12:40:49] [Rank 2] totoal_tokens=2922, outputs='[1, 2, 3]'
[2024-08-03 12:40:50] [Rank 0] totoal_tokens=2922, outputs='```json\n{\n "number_of_ships": 1\n}\n```'
[2024-08-03 12:40:50] [Rank 1] totoal_tokens=2615, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:40:50] [Rank 2] totoal_tokens=3025, outputs='```json\n{\n "result": 0\n}\n```'
[2024-08-03 12:40:50] [Rank 3] totoal_tokens=3088, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:40:50] [Rank 0] totoal_tokens=2955, outputs='[4, 4, 4]'
[2024-08-03 12:40:50] [Rank 3] totoal_tokens=3098, outputs='```json\n{\n "cup": 1\n}\n```'
[2024-08-03 12:40:50] [Rank 2] totoal_tokens=3059, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:40:50] [Rank 1] totoal_tokens=2859, outputs='```json\n{\n "result": 15\n}\n```'
[2024-08-03 12:40:50] [Rank 0] totoal_tokens=3025, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:40:51] [Rank 2] totoal_tokens=3088, outputs='```json\n{\n "heart_count": 1\n}\n```'
[2024-08-03 12:40:51] [Rank 1] totoal_tokens=3025, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:40:51] [Rank 0] totoal_tokens=3052, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:40:51] [Rank 3] totoal_tokens=3098, outputs='```json\n{\n "cup": 1,\n "cup": 1,\n "cup": 1\n}\n```'
[2024-08-03 12:40:51] [Rank 2] totoal_tokens=3097, outputs='```json\n{\n "pen_count": 3\n}\n```'
[2024-08-03 12:40:51] [Rank 1] totoal_tokens=3052, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:40:52] [Rank 0] totoal_tokens=3077, outputs='```json\n{\n "heart_count": 5\n}\n```'
[2024-08-03 12:40:52] [Rank 3] totoal_tokens=3600, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:40:52] [Rank 2] totoal_tokens=3098, outputs='```json\n{\n "cup_count": 3\n}\n```'
[2024-08-03 12:40:52] [Rank 0] totoal_tokens=3096, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:40:52] [Rank 1] totoal_tokens=3081, outputs='```json\n{\n "book_count": 0\n}\n```'
[2024-08-03 12:40:53] [Rank 0] totoal_tokens=3096, outputs='[2, 2, 2]'
[2024-08-03 12:40:53] [Rank 2] totoal_tokens=3144, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:40:53] [Rank 3] totoal_tokens=3680, outputs='```json\n{\n "number_of_hearts": 2\n}\n```'
[2024-08-03 12:40:53] [Rank 1] totoal_tokens=3088, outputs='```json\n{\n "clouds": [\n "3",\n "4"\n ]\n}\n```'
[2024-08-03 12:40:53] [Rank 0] totoal_tokens=3190, outputs='{\n "number_of_books": 2\n}'
οΏ½ | 20/130 [00:10<01:15, 1.47it/s] Processing InternVL2-2B_counting-text-val.jsonl: 16%|β–ˆβ–Œ | 21/130 [00:11<01:14, 1.47it/s] Processing InternVL2-2B_counting-text-val.jsonl: 17%|β–ˆβ–‹ | 22/130 [00:12<01:09, 1.56it/s] Processing InternVL2-2B_counting-text-val.jsonl: 18%|β–ˆβ–Š | 23/130 [00:12<01:07, 1.59it/s] Processing InternVL2-2B_counting-text-val.jsonl: 18%|β–ˆβ–Š | 24/130 [00:13<00:58, 1.82it/s] Processing InternVL2-2B_counting-text-val.jsonl: 19%|β–ˆβ–‰ | 25/130 [00:13<00:57, 1.82it/s] Processing InternVL2-2B_counting-text-val.jsonl: 20%|β–ˆβ–ˆ | 26/130 [00:14<00:57, 1.82it/s] Processing InternVL2-2B_counting-text-val.jsonl: 21%|β–ˆβ–ˆ | 27/130 [00:14<00:56, 1.82it/s] Processing InternVL2-2B_counting-text-val.jsonl: 22%|β–ˆβ–ˆβ– | 28/130 [00:15<00:56, 1.82it/s] Processing InternVL2-2B_counting-text-val.jsonl: 22%|β–ˆβ–ˆβ– | 29/130 [00:15<00:52, 1.91it/s] Processing InternVL2-2B_counting-text-val.jsonl: 23%|β–ˆοΏ½[2024-08-03 12:40:53] [Rank 3] totoal_tokens=3704, outputs='```json\n{\n "ship_count": 4\n}\n```'
[2024-08-03 12:40:54] [Rank 1] totoal_tokens=3239, outputs='```json\n{\n "book_count": 1\n}\n```'
[2024-08-03 12:40:54] [Rank 2] totoal_tokens=3191, outputs='```json\n{\n "title": "Sword of the Necromancer",\n "platforms": ["PlayStation 4", "Play'
[2024-08-03 12:40:54] [Rank 3] totoal_tokens=3945, outputs='[1, 1, 1]'
[2024-08-03 12:40:54] [Rank 0] totoal_tokens=3393, outputs='```json\n{\n "books": [\n "Society for the Protection of Animals",\n "The Society for the Protection of Animals by J. I'
[2024-08-03 12:40:54] [Rank 1] totoal_tokens=3328, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:40:54] [Rank 3] totoal_tokens=4516, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:40:55] [Rank 0] totoal_tokens=3421, outputs='```json\n{\n "heart_count": 4\n}\n```'
[2024-08-03 12:40:55] [Rank 2] totoal_tokens=3210, outputs='```json\n{\n "ships": [\n "2",\n "2",\n "2"\n ]\n}\n```'
[2024-08-03 12:40:55] [Rank 1] totoal_tokens=3441, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:40:55] [Rank 3] totoal_tokens=4792, outputs='```json\n{\n "book_count": 0\n}\n```'
[2024-08-03 12:40:55] [Rank 0] totoal_tokens=4177, outputs='```json\n{\n "ship_count": 4\n}\n```'
[2024-08-03 12:40:55] [Rank 1] totoal_tokens=3613, outputs='```json\n{\n "heart_count": 1\n}\n```'
[2024-08-03 12:40:56] [Rank 2] totoal_tokens=3762, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:40:56] [Rank 3] totoal_tokens=5445, outputs='```json\n{\n "cup": 1\n}\n```'
[2024-08-03 12:40:56] [Rank 1] totoal_tokens=3674, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:40:56] [Rank 2] totoal_tokens=3797, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:40:56] [Rank 0] totoal_tokens=4736, outputs='```json\n{\n "John Cena": "8.5 Million per year",\n "Kevin Owens": "2 Million",\n "The Und'
[2024-08-03 12:40:57] [Rank 3] totoal_tokens=5555, outputs='```json\n{\n "heart_count": 1\n}\n```'
[2024-08-03 12:40:57] [Rank 1] totoal_tokens=4499, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:40:57] [Rank 2] totoal_tokens=4767, outputs='```json\n{\n "cup_count": 3\n}\n```'
[2024-08-03 12:40:57] [Rank 0] totoal_tokens=5110, outputs='```json\n{\n "number_of_books": 1\n}\n```'
[2024-08-03 12:40:57] [Rank 1] totoal_tokens=4522, outputs='```json\n{\n "book_count": 3\n}\n```'
[2024-08-03 12:40:57] [Rank 3] totoal_tokens=5916, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:40:58] [Rank 2] totoal_tokens=5046, outputs='```json\n{\n "clouds": 4\n}\n```'
[2024-08-03 12:40:58] [Rank 1] totoal_tokens=4907, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:40:58] [Rank 3] totoal_tokens=6149, outputs='```json\n{\n "book": 1\n}\n```'
[2024-08-03 12:40:58] [Rank 0] totoal_tokens=5183, outputs='[3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3'
[2024-08-03 12:40:59] [Rank 2] totoal_tokens=5120, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:40:59] [Rank 1] totoal_tokens=5115, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:40:59] [Rank 0] totoal_tokens=5336, outputs='[1, 1, 1]'
[2024-08-03 12:40:59] [Rank 3] totoal_tokens=6165, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:40:59] [Rank 2] totoal_tokens=5281, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:40:59] [Rank 1] totoal_tokens=6034, outputs='```json\n{\n "ship_count": 3\n}\n```'
[2024-08-03 12:41:00] [Rank 0] totoal_tokens=6131, outputs='```json\n{\n "clouds": [\n {\n "position": "top left",\n "number_of_clouds": 1'
[2024-08-03 12:41:00] [Rank 2] totoal_tokens=6049, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:00] [Rank 3] totoal_tokens=6847, outputs='```json\n{\n "result": 0\n}\n```'
[2024-08-03 12:41:00] [Rank 1] totoal_tokens=6310, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:41:01] [Rank 0] totoal_tokens=6374, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:01] [Rank 2] totoal_tokens=6194, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 12:41:01] [Rank 3] totoal_tokens=7471, outputs='```json\n{\n "title": "Troubadours Sailing Hibiscus Seas: Meditations on Post Abortion Trauma",'
[2024-08-03 12:41:01] [Rank 0] totoal_tokens=6495, outputs='```json\n{\n "pen_count": 0\n}\n```'
οΏ½β–Ž | 30/130 [00:16<00:50, 1.98it/s] Processing InternVL2-2B_counting-text-val.jsonl: 24%|β–ˆβ–ˆβ– | 31/130 [00:17<01:06, 1.50it/s] Processing InternVL2-2B_counting-text-val.jsonl: 25%|β–ˆβ–ˆβ– | 32/130 [00:17<01:02, 1.57it/s] Processing InternVL2-2B_counting-text-val.jsonl: 25%|β–ˆβ–ˆβ–Œ | 33/130 [00:18<01:02, 1.56it/s] Processing InternVL2-2B_counting-text-val.jsonl: 26%|β–ˆβ–ˆβ–Œ | 34/130 [00:19<01:15, 1.28it/s] Processing InternVL2-2B_counting-text-val.jsonl: 27%|β–ˆβ–ˆβ–‹ | 35/130 [00:20<01:13, 1.30it/s] Processing InternVL2-2B_counting-text-val.jsonl: 28%|β–ˆβ–ˆβ–Š | 36/130 [00:21<01:22, 1.14it/s] Processing InternVL2-2B_counting-text-val.jsonl: 28%|β–ˆβ–ˆβ–Š | 37/130 [00:21<01:10, 1.32it/s] Processing InternVL2-2B_counting-text-val.jsonl: 29%|β–ˆβ–ˆβ–‰ | 38/130 [00:23<01:23, 1.11it/s] Processing InternVL2-2B_counting-text-val.jsonl: 30%|β–ˆβ–ˆβ–ˆ | 39/130 [00:23<01:17, 1.17it/s] Processing InternVL2-2B_counting-text-val.j[2024-08-03 12:41:01] [Rank 1] totoal_tokens=6490, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:41:02] [Rank 2] totoal_tokens=6320, outputs='```json\n{\n "pen_count": 2\n}\n```'
[2024-08-03 12:41:02] [Rank 3] totoal_tokens=7562, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:02] [Rank 0] totoal_tokens=7021, outputs='[0, 0, 0]'
[2024-08-03 12:41:02] [Rank 2] totoal_tokens=6865, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:03] [Rank 1] totoal_tokens=6882, outputs='```json\n{\n "results": [\n {"x": 1, "x": 1, "x": 1},\n {"x'
[2024-08-03 12:41:03] [Rank 0] totoal_tokens=7087, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:03] [Rank 3] totoal_tokens=7570, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:41:03] [Rank 2] totoal_tokens=7701, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:04] [Rank 3] totoal_tokens=7670, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:41:04] [Rank 1] totoal_tokens=7083, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:04] [Rank 2] totoal_tokens=7709, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:04] [Rank 0] totoal_tokens=7269, outputs='```json\n{\n "books": [\n {\n "title": "I’m So Lonely: Sad Dog Has Been Waiting for Owner at'
[2024-08-03 12:41:04] [Rank 3] totoal_tokens=7701, outputs='[1, 1, 1]'
[2024-08-03 12:41:05] [Rank 1] totoal_tokens=7288, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:05] [Rank 3] totoal_tokens=7855, outputs='```json\n{\n "ship_count": 2\n}\n```'
[2024-08-03 12:41:05] [Rank 0] totoal_tokens=7446, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:05] [Rank 2] totoal_tokens=7917, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:06] [Rank 1] totoal_tokens=8500, outputs='```json\n{\n "ship_count": 2\n}\n```'
[2024-08-03 12:41:06] [Rank 0] totoal_tokens=8032, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:06] [Rank 3] totoal_tokens=7874, outputs='```json\n{\n "result": 0\n}\n```'
[2024-08-03 12:41:07] [Rank 2] totoal_tokens=8057, outputs='```json\n{\n "clouds": [\n {\n "position": "top left",\n "number_of_clouds": 1'
[2024-08-03 12:41:07] [Rank 1] totoal_tokens=9125, outputs='```json\n{\n "cup_count": 2\n}\n```'
[2024-08-03 12:41:08] [Rank 2] totoal_tokens=8689, outputs='```json\n{\n "book_count": 0\n}\n```'
[2024-08-03 12:41:08] [Rank 0] totoal_tokens=8257, outputs='```json\n{\n "clouds": [\n {\n "position": "top left",\n "number_of_clouds": 1'
[2024-08-03 12:41:08] [Rank 3] totoal_tokens=8166, outputs='```json\n{\n "clouds": [\n {\n "number": 1,\n "description": "The little penguin counted 1'
[2024-08-03 12:41:08] [Rank 3] totoal_tokens=8252, outputs='[2, 2, 2]'
[2024-08-03 12:41:08] [Rank 0] totoal_tokens=8863, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:08] [Rank 2] totoal_tokens=8859, outputs='```json\n{\n "heart_count": 5\n}\n```'
[2024-08-03 12:41:08] [Rank 1] totoal_tokens=9190, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:09] [Rank 1] totoal_tokens=9517, outputs='[0, 0, 0]'
[2024-08-03 12:41:09] [Rank 0] totoal_tokens=8969, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:09] [Rank 3] totoal_tokens=8713, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:41:10] [Rank 2] totoal_tokens=9571, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:10] [Rank 0] totoal_tokens=9077, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:41:11] [Rank 1] totoal_tokens=9574, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:11] [Rank 3] totoal_tokens=9342, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:11] [Rank 2] totoal_tokens=9658, outputs='```json\n{\n "pen_count": [\n [0, 0, 0],\n [0, 0, 0],'
[2024-08-03 12:41:12] [Rank 0] totoal_tokens=9296, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
sonl: 31%|β–ˆβ–ˆβ–ˆ | 40/130 [00:24<01:14, 1.21it/s] Processing InternVL2-2B_counting-text-val.jsonl: 32%|β–ˆβ–ˆβ–ˆβ– | 41/130 [00:25<01:14, 1.20it/s] Processing InternVL2-2B_counting-text-val.jsonl: 32%|β–ˆβ–ˆβ–ˆβ– | 42/130 [00:26<01:11, 1.24it/s] Processing InternVL2-2B_counting-text-val.jsonl: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 43/130 [00:27<01:19, 1.10it/s] Processing InternVL2-2B_counting-text-val.jsonl: 34%|β–ˆβ–ˆβ–ˆβ– | 44/130 [00:28<01:24, 1.01it/s] Processing InternVL2-2B_counting-text-val.jsonl: 35%|β–ˆβ–ˆβ–ˆβ– | 45/130 [00:29<01:18, 1.08it/s] Processing InternVL2-2B_counting-text-val.jsonl: 35%|β–ˆβ–ˆβ–ˆβ–Œ | 46/130 [00:30<01:28, 1.06s/it] Processing InternVL2-2B_counting-text-val.jsonl: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 47/130 [00:31<01:23, 1.01s/it] Processing InternVL2-2B_counting-text-val.jsonl: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 48/130 [00:32<01:19, 1.03it/s] Processing InternVL2-2B_counting-text-val.jsonl: 38%|β–ˆβ–ˆβ–ˆβ–Š | 49/130 [00:33<01:17, 1.05it/s] Processin[2024-08-03 12:41:12] [Rank 1] totoal_tokens=10204, outputs='```json\n{\n "clouds": [\n {\n "position": "top left",\n "number_of_clouds": 1'
[2024-08-03 12:41:12] [Rank 3] totoal_tokens=10490, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:12] [Rank 2] totoal_tokens=9824, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:13] [Rank 0] totoal_tokens=10488, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:13] [Rank 2] totoal_tokens=10305, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:41:13] [Rank 1] totoal_tokens=10239, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:14] [Rank 3] totoal_tokens=11129, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:14] [Rank 0] totoal_tokens=10521, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:14] [Rank 2] totoal_tokens=10430, outputs='```json\n{\n "cup_count": 3\n}\n```'
[2024-08-03 12:41:15] [Rank 1] totoal_tokens=10371, outputs='```json\n{\n "clouds": [\n "1",\n "2",\n "3"\n ]\n}\n```'
[2024-08-03 12:41:15] [Rank 3] totoal_tokens=11523, outputs='```json\n{\n "heart_count": 2\n}\n```'
[2024-08-03 12:41:15] [Rank 0] totoal_tokens=10833, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:41:15] [Rank 2] totoal_tokens=10756, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:16] [Rank 0] totoal_tokens=11153, outputs='```json\n{\n "cup_count": 2\n}\n```'
[2024-08-03 12:41:16] [Rank 1] totoal_tokens=10843, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:16] [Rank 2] totoal_tokens=10818, outputs='```json\n{\n "result": 0\n}\n```'
[2024-08-03 12:41:16] [Rank 3] totoal_tokens=11554, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:17] [Rank 0] totoal_tokens=11188, outputs='```json\n{\n "cup_count": 3\n}\n```'
[2024-08-03 12:41:17] [Rank 3] totoal_tokens=12071, outputs='[1, 1, 1]'
[2024-08-03 12:41:18] [Rank 2] totoal_tokens=12005, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:18] [Rank 1] totoal_tokens=11191, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:18] [Rank 0] totoal_tokens=11404, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:18] [Rank 3] totoal_tokens=12145, outputs='```json\n{\n "sun_count": 3\n}\n```'
[2024-08-03 12:41:19] [Rank 1] totoal_tokens=11882, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:19] [Rank 0] totoal_tokens=12603, outputs='```json\n{\n "number_of_books": 3\n}\n```'
[2024-08-03 12:41:19] [Rank 2] totoal_tokens=12243, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:19] [Rank 3] totoal_tokens=12391, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:20] [Rank 0] totoal_tokens=12762, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:20] [Rank 1] totoal_tokens=12003, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:20] [Rank 2] totoal_tokens=12499, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:21] [Rank 3] totoal_tokens=13144, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:21] [Rank 0] totoal_tokens=13025, outputs='```json\n{\n "pen_count": 0\n}\n```'
g InternVL2-2B_counting-text-val.jsonl: 38%|β–ˆβ–ˆβ–ˆβ–Š | 50/130 [00:34<01:24, 1.06s/it] Processing InternVL2-2B_counting-text-val.jsonl: 39%|β–ˆβ–ˆβ–ˆβ–‰ | 51/130 [00:36<01:31, 1.15s/it] Processing InternVL2-2B_counting-text-val.jsonl: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 52/130 [00:37<01:25, 1.10s/it] Processing InternVL2-2B_counting-text-val.jsonl: 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 53/130 [00:37<01:20, 1.04s/it] Processing InternVL2-2B_counting-text-val.jsonl: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 54/130 [00:38<01:16, 1.01s/it] Processing InternVL2-2B_counting-text-val.jsonl: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 55/130 [00:39<01:15, 1.01s/it] Processing InternVL2-2B_counting-text-val.jsonl: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 56/130 [00:40<01:14, 1.00s/it] Processing InternVL2-2B_counting-text-val.jsonl: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 57/130 [00:41<01:15, 1.04s/it] Processing InternVL2-2B_counting-text-val.jsonl: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 58/130 [00:43<01:17, 1.07s/it] Processing InternVL2-2B_counting-text-val.jsonl: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ[2024-08-03 12:41:21] [Rank 1] totoal_tokens=12354, outputs='```json\n{\n "book_count": 2\n}\n```'
[2024-08-03 12:41:21] [Rank 2] totoal_tokens=12917, outputs='```json\n{\n "heart_count": 4\n}\n```'
[2024-08-03 12:41:22] [Rank 3] totoal_tokens=13201, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:22] [Rank 0] totoal_tokens=13695, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:22] [Rank 1] totoal_tokens=12360, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:23] [Rank 3] totoal_tokens=13441, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:23] [Rank 2] totoal_tokens=13104, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:23] [Rank 1] totoal_tokens=12603, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:41:23] [Rank 0] totoal_tokens=14236, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:41:24] [Rank 1] totoal_tokens=12635, outputs='[1, 1, 1]'
[2024-08-03 12:41:24] [Rank 0] totoal_tokens=14239, outputs='```json\n{\n "heart": 0\n}\n```'
[2024-08-03 12:41:25] [Rank 2] totoal_tokens=13349, outputs='```json\n{\n "clouds": [\n {\n "x": 0,\n "y": 0,\n "z":'
[2024-08-03 12:41:25] [Rank 3] totoal_tokens=13562, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:41:26] [Rank 1] totoal_tokens=13122, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:26] [Rank 0] totoal_tokens=14339, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:41:26] [Rank 2] totoal_tokens=13492, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:26] [Rank 3] totoal_tokens=14195, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:27] [Rank 0] totoal_tokens=14745, outputs='```json\n{\n "cloud_count": 1\n}\n```'
[2024-08-03 12:41:27] [Rank 2] totoal_tokens=13725, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:27] [Rank 1] totoal_tokens=13791, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:28] [Rank 3] totoal_tokens=15431, outputs='```json\n{\n "clouds": [\n {\n "x": 0,\n "y": 0,\n "z":'
[2024-08-03 12:41:28] [Rank 2] totoal_tokens=13793, outputs='[1, 1, 1]'
[2024-08-03 12:41:28] [Rank 1] totoal_tokens=13959, outputs='```json\n{\n "ship_count": 526\n}\n```'
[2024-08-03 12:41:29] [Rank 0] totoal_tokens=16098, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:29] [Rank 3] totoal_tokens=16024, outputs='[1, 1, 1]'
[2024-08-03 12:41:29] [Rank 2] totoal_tokens=14579, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:30] [Rank 0] totoal_tokens=16184, outputs='```json\n{\n "book_count": 1\n}\n```'
[2024-08-03 12:41:30] [Rank 3] totoal_tokens=16055, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:41:31] [Rank 1] totoal_tokens=14039, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:31] [Rank 0] totoal_tokens=16287, outputs='```json\n{\n "books": [\n {\n "title": "The Sugarless Plum",\n "author": "Zippora Kar'
[2024-08-03 12:41:32] [Rank 2] totoal_tokens=15305, outputs='```json\n{\n "clouds": [\n [0, 0, 0],\n [0, 0, 0],'
[2024-08-03 12:41:32] [Rank 3] totoal_tokens=16385, outputs='[1, 1, 1]'
[2024-08-03 12:41:33] [Rank 0] totoal_tokens=16386, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:33] [Rank 1] totoal_tokens=16305, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:33] [Rank 3] totoal_tokens=16800, outputs='```json\n{\n "cup": 5\n}\n```'
[2024-08-03 12:41:33] [Rank 2] totoal_tokens=15535, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:41:34] [Rank 0] totoal_tokens=16793, outputs='[0, 0, 0]'
 | 59/130 [00:44<01:14, 1.05s/it] Processing InternVL2-2B_counting-text-val.jsonl: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 60/130 [00:45<01:18, 1.12s/it] Processing InternVL2-2B_counting-text-val.jsonl: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 61/130 [00:46<01:17, 1.13s/it] Processing InternVL2-2B_counting-text-val.jsonl: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 62/130 [00:47<01:15, 1.11s/it] Processing InternVL2-2B_counting-text-val.jsonl: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 63/130 [00:48<01:15, 1.12s/it] Processing InternVL2-2B_counting-text-val.jsonl: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 64/130 [00:50<01:17, 1.18s/it] Processing InternVL2-2B_counting-text-val.jsonl: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 65/130 [00:51<01:25, 1.31s/it] Processing InternVL2-2B_counting-text-val.jsonl: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 66/130 [00:52<01:21, 1.28s/it] Processing InternVL2-2B_counting-text-val.jsonl: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 67/130 [00:54<01:27, 1.39s/it] Processing InternVL2-2B_counting-text-val.jsonl: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/130 [00:55<01:24, 1.36s/it] Processin[2024-08-03 12:41:34] [Rank 1] totoal_tokens=16803, outputs='[0, 0, 0]'
[2024-08-03 12:41:35] [Rank 2] totoal_tokens=16107, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:35] [Rank 3] totoal_tokens=17984, outputs='```json\n{\n "sun_count": 2\n}\n```'
[2024-08-03 12:41:35] [Rank 1] totoal_tokens=17530, outputs='```json\n{\n "cup_count": 2\n}\n```'
[2024-08-03 12:41:35] [Rank 0] totoal_tokens=17349, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:41:36] [Rank 3] totoal_tokens=18068, outputs='[1, 2, 3]'
[2024-08-03 12:41:36] [Rank 2] totoal_tokens=16377, outputs='```json\n{\n "sun_count": 3\n}\n```'
[2024-08-03 12:41:37] [Rank 0] totoal_tokens=17358, outputs='[1, 1, 1]'
[2024-08-03 12:41:37] [Rank 1] totoal_tokens=17766, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:38] [Rank 2] totoal_tokens=17666, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:38] [Rank 3] totoal_tokens=18104, outputs='```json\n{\n "books": [\n "Harry Potter and the Philosopher\'s Stone",\n "Harry Potter and the Chamber of Secrets",'
[2024-08-03 12:41:39] [Rank 0] totoal_tokens=17739, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:39] [Rank 1] totoal_tokens=18826, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:40] [Rank 3] totoal_tokens=18561, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:41:40] [Rank 0] totoal_tokens=17931, outputs='```json\n{\n "Ship Count": 4\n}\n```'
[2024-08-03 12:41:41] [Rank 1] totoal_tokens=18872, outputs='```json\n{\n "questions": [\n {\n "question": "What is the name of the movie?",\n "answer": "The'
[2024-08-03 12:41:41] [Rank 2] totoal_tokens=18520, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:41] [Rank 3] totoal_tokens=18571, outputs='```json\n{\n "clouds": [\n {\n "x": 0,\n "y": 0,\n "width":'
[2024-08-03 12:41:42] [Rank 0] totoal_tokens=18065, outputs='```json\n{\n "clouds": [\n {\n "x": 0,\n "y": 0,\n "z":'
[2024-08-03 12:41:43] [Rank 1] totoal_tokens=19305, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:44] [Rank 3] totoal_tokens=19202, outputs='```json\n{\n "cup": 0\n}\n```'
[2024-08-03 12:41:44] [Rank 0] totoal_tokens=19091, outputs='```json\n{\n "cup_count": 3\n}\n```'
[2024-08-03 12:41:45] [Rank 1] totoal_tokens=19433, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:45] [Rank 2] totoal_tokens=19020, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:45] [Rank 3] totoal_tokens=19316, outputs='```json\n{\n "books": [\n "1",\n "2",\n "3",\n "4",\n "5",\n "'
[2024-08-03 12:41:46] [Rank 1] totoal_tokens=20207, outputs='[0, 0, 0]'
[2024-08-03 12:41:46] [Rank 0] totoal_tokens=20123, outputs='```json\n{\n "Exaktbox 6": {\n "Exakt": 6,\n "Master": 1,\n "Sl'
[2024-08-03 12:41:47] [Rank 2] totoal_tokens=19065, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:41:48] [Rank 3] totoal_tokens=20236, outputs='```json\n{\n "books": [\n "1",\n "2",\n "3",\n "4",\n "5",\n "'
[2024-08-03 12:41:48] [Rank 0] totoal_tokens=21003, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:48] [Rank 1] totoal_tokens=20402, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:41:48] [Rank 2] totoal_tokens=19531, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:49] [Rank 1] totoal_tokens=20420, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:50] [Rank 3] totoal_tokens=20756, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:50] [Rank 0] totoal_tokens=21109, outputs='```json\n{\n "sun_count": 1\n}\n```'
g InternVL2-2B_counting-text-val.jsonl: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 69/130 [00:57<01:19, 1.30s/it] Processing InternVL2-2B_counting-text-val.jsonl: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 70/130 [00:58<01:22, 1.38s/it] Processing InternVL2-2B_counting-text-val.jsonl: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/130 [01:00<01:26, 1.46s/it] Processing InternVL2-2B_counting-text-val.jsonl: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 72/130 [01:01<01:24, 1.45s/it] Processing InternVL2-2B_counting-text-val.jsonl: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/130 [01:03<01:27, 1.53s/it] Processing InternVL2-2B_counting-text-val.jsonl: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/130 [01:05<01:29, 1.60s/it] Processing InternVL2-2B_counting-text-val.jsonl: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/130 [01:06<01:31, 1.66s/it] Processing InternVL2-2B_counting-text-val.jsonl: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/130 [01:09<01:38, 1.83s/it] Processing InternVL2-2B_counting-text-val.jsonl: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/130 [01:11<01:37, 1.84s/it] Processing InternVL2-2B_counting-text-val.j[2024-08-03 12:41:51] [Rank 2] totoal_tokens=19609, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:41:51] [Rank 1] totoal_tokens=20443, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:52] [Rank 0] totoal_tokens=21321, outputs='```json\n{\n "number_of_books": 5\n}\n```'
[2024-08-03 12:41:52] [Rank 3] totoal_tokens=21151, outputs='```json\n{\n "capital": "T",\n "fav_5": "FAANG",\n "fav_5_1'
[2024-08-03 12:41:53] [Rank 1] totoal_tokens=20696, outputs='```json\n{\n "ship_count": 4\n}\n```'
[2024-08-03 12:41:53] [Rank 0] totoal_tokens=21555, outputs='```json\n{\n "heart_count": 3\n}\n```'
[2024-08-03 12:41:54] [Rank 2] totoal_tokens=20505, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:54] [Rank 3] totoal_tokens=21458, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:54] [Rank 1] totoal_tokens=22551, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:55] [Rank 0] totoal_tokens=22648, outputs='```json\n{\n "clouds": [\n {\n "position": "top left",\n "number": 1\n },\n {'
[2024-08-03 12:41:56] [Rank 2] totoal_tokens=20707, outputs='```json\n{\n "books": [\n "Mary Cope",\n "Oliver Cope",\n "Gilbert Cope",'
[2024-08-03 12:41:56] [Rank 1] totoal_tokens=22788, outputs='```json\n{\n "sun_count": 3\n}\n```'
[2024-08-03 12:41:57] [Rank 3] totoal_tokens=22200, outputs='{\n "signs_and_symptoms_of_lymphoma": [\n "swollen lymph nodes",\n "fatigue",\n "difficulty_sleep'
[2024-08-03 12:41:57] [Rank 2] totoal_tokens=22257, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:41:58] [Rank 0] totoal_tokens=23060, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:41:58] [Rank 3] totoal_tokens=23012, outputs='```json\n{\n "book_count": 2\n}\n```'
[2024-08-03 12:41:58] [Rank 1] totoal_tokens=23166, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:41:59] [Rank 2] totoal_tokens=22405, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:41:59] [Rank 0] totoal_tokens=24022, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:42:00] [Rank 1] totoal_tokens=23214, outputs='[1, 1, 1]'
[2024-08-03 12:42:00] [Rank 3] totoal_tokens=24941, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 12:42:01] [Rank 2] totoal_tokens=23104, outputs='```json\n{\n "ship": 24\n}\n```'
[2024-08-03 12:42:02] [Rank 0] totoal_tokens=24129, outputs='```json\n{\n "sun_count": 3\n}\n```'
[2024-08-03 12:42:02] [Rank 1] totoal_tokens=26084, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:42:03] [Rank 3] totoal_tokens=26057, outputs='```json\n{\n "clouds": [\n {\n "location": "South",\n "number_of_clouds": 1\n },'
[2024-08-03 12:42:03] [Rank 2] totoal_tokens=23180, outputs='```json\n{\n "sun_count": 2\n}\n```'
[2024-08-03 12:42:05] [Rank 1] totoal_tokens=26101, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:05] [Rank 0] totoal_tokens=26314, outputs='```json\n{\n "heart": 0\n}\n```'
[2024-08-03 12:42:05] [Rank 3] totoal_tokens=26089, outputs='```json\n{\n "book_count": 0\n}\n```'
[2024-08-03 12:42:05] [Rank 2] totoal_tokens=25438, outputs='```json\n{\n "number_of_hearts": 0\n}\n```'
[2024-08-03 12:42:07] [Rank 1] totoal_tokens=26395, outputs='```json\n{\n "sun_count": 5\n}\n```'
[2024-08-03 12:42:07] [Rank 0] totoal_tokens=27019, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:42:07] [Rank 2] totoal_tokens=25638, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:42:07] [Rank 3] totoal_tokens=26281, outputs='```json\n{\n "heart_count": 1\n}\n```'
[2024-08-03 12:42:09] [Rank 1] totoal_tokens=27184, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:42:09] [Rank 0] totoal_tokens=27541, outputs='```json\n{\n "pen_count": 0\n}\n```'
sonl: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 78/130 [01:13<01:44, 2.00s/it] Processing InternVL2-2B_counting-text-val.jsonl: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/130 [01:14<01:35, 1.87s/it] Processing InternVL2-2B_counting-text-val.jsonl: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/130 [01:16<01:27, 1.75s/it] Processing InternVL2-2B_counting-text-val.jsonl: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 81/130 [01:18<01:31, 1.87s/it] Processing InternVL2-2B_counting-text-val.jsonl: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 82/130 [01:20<01:35, 1.99s/it] Processing InternVL2-2B_counting-text-val.jsonl: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/130 [01:22<01:28, 1.89s/it] Processing InternVL2-2B_counting-text-val.jsonl: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 84/130 [01:25<01:40, 2.18s/it] Processing InternVL2-2B_counting-text-val.jsonl: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 85/130 [01:28<01:47, 2.40s/it] Processing InternVL2-2B_counting-text-val.jsonl: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 86/130 [01:30<01:40, 2.29s/it] Processing InternVL2-2B_counting-text-val.jsonl: 67%|β–ˆβ–ˆβ–ˆ[2024-08-03 12:42:10] [Rank 2] totoal_tokens=27120, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:42:11] [Rank 1] totoal_tokens=27417, outputs='1'
[2024-08-03 12:42:11] [Rank 3] totoal_tokens=27136, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:11] [Rank 0] totoal_tokens=28074, outputs='```json\n{\n "cloud": 1,\n "penguin": 1\n}\n```'
[2024-08-03 12:42:12] [Rank 2] totoal_tokens=27539, outputs='```json\n{\n "heart_count": 1\n}\n```'
[2024-08-03 12:42:13] [Rank 1] totoal_tokens=27748, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:13] [Rank 3] totoal_tokens=27218, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:14] [Rank 0] totoal_tokens=29038, outputs='```json\n{\n "ship_count": 1\n}\n```'
[2024-08-03 12:42:14] [Rank 2] totoal_tokens=28028, outputs='```json\n{\n "questions": [\n {\n "question": "What is the name of the German death metal band?",\n "answer":'
[2024-08-03 12:42:15] [Rank 1] totoal_tokens=27748, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:42:16] [Rank 0] totoal_tokens=30353, outputs='{\n "sun": 3\n}'
[2024-08-03 12:42:16] [Rank 2] totoal_tokens=28103, outputs='```json\n{\n "pen_count": 2\n}\n```'
[2024-08-03 12:42:16] [Rank 3] totoal_tokens=28382, outputs='```json\n{\n "clouds": [\n {\n "x": 0,\n "y": 0,\n "width":'
[2024-08-03 12:42:18] [Rank 1] totoal_tokens=28535, outputs='```json\n{\n "number_of_books": 13\n}\n```'
[2024-08-03 12:42:18] [Rank 2] totoal_tokens=28225, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:19] [Rank 3] totoal_tokens=30180, outputs='[1, 2, 3, 4, 5]'
[2024-08-03 12:42:19] [Rank 0] totoal_tokens=32034, outputs='```json\n{\n "clouds": [\n {\n "x": 0,\n "y": 0,\n "width":'
[2024-08-03 12:42:20] [Rank 2] totoal_tokens=29032, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:42:21] [Rank 1] totoal_tokens=30017, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:21] [Rank 3] totoal_tokens=30428, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:22] [Rank 0] totoal_tokens=32158, outputs='```json\n{\n "ship": [\n {\n "x": 1,\n "x": 1,\n "x": 1'
[2024-08-03 12:42:23] [Rank 1] totoal_tokens=31896, outputs='```json\n{\n "book": [\n "Magic Keyboard",\n "Magic Keyboard",\n "Magic Keyboard",\n "Magic Keyboard",\n "'
[2024-08-03 12:42:24] [Rank 2] totoal_tokens=30025, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:24] [Rank 3] totoal_tokens=32026, outputs='```json\n{\n "clouds": [\n {\n "x": 0,\n "y": 0,\n "z":'
[2024-08-03 12:42:25] [Rank 0] totoal_tokens=33113, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:26] [Rank 1] totoal_tokens=32095, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:42:26] [Rank 2] totoal_tokens=33521, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:42:27] [Rank 3] totoal_tokens=32642, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:27] [Rank 0] totoal_tokens=37420, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:42:28] [Rank 2] totoal_tokens=34294, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:42:29] [Rank 1] totoal_tokens=32183, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:29] [Rank 3] totoal_tokens=33261, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:42:30] [Rank 0] totoal_tokens=37784, outputs='```json\n{\n "sun_count": 3\n}\n```'
[2024-08-03 12:42:31] [Rank 1] totoal_tokens=33900, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:42:31] [Rank 2] totoal_tokens=35049, outputs='```json\n{\n "ship": [\n "Atlanta",\n "Sacramento",\n "Golden State",\n "Jonas",'
[2024-08-03 12:42:33] [Rank 0] totoal_tokens=37833, outputs='```json\n{\n "pen_count": 0\n}\n```'
β–ˆβ–ˆβ–ˆβ–‹ | 87/130 [01:32<01:34, 2.20s/it] Processing InternVL2-2B_counting-text-val.jsonl: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 88/130 [01:34<01:32, 2.20s/it] Processing InternVL2-2B_counting-text-val.jsonl: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 89/130 [01:36<01:32, 2.25s/it] Processing InternVL2-2B_counting-text-val.jsonl: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 90/130 [01:39<01:29, 2.23s/it] Processing InternVL2-2B_counting-text-val.jsonl: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 91/130 [01:41<01:34, 2.42s/it] Processing InternVL2-2B_counting-text-val.jsonl: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 92/130 [01:44<01:37, 2.57s/it] Processing InternVL2-2B_counting-text-val.jsonl: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/130 [01:47<01:39, 2.69s/it] Processing InternVL2-2B_counting-text-val.jsonl: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/130 [01:50<01:36, 2.68s/it] Processing InternVL2-2B_counting-text-val.jsonl: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 95/130 [01:53<01:33, 2.67s/it] Processing InternVL2-2B_counting-text-val.jsonl: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆοΏ½[2024-08-03 12:42:33] [Rank 2] totoal_tokens=35857, outputs='[1, 1, 1]'
[2024-08-03 12:42:33] [Rank 3] totoal_tokens=34073, outputs='```json\n{\n "clouds": [\n {\n "x": 0.1,\n "y": 0.1,'
[2024-08-03 12:42:35] [Rank 1] totoal_tokens=33903, outputs='```json\n{\n "sun_count": 1\n}\n```'
[2024-08-03 12:42:36] [Rank 2] totoal_tokens=36201, outputs='```json\n{\n "number_of_hearts": 0\n}\n```'
[2024-08-03 12:42:37] [Rank 3] totoal_tokens=35127, outputs='```json\n{\n "books": [\n "Sony SONY",\n "Sony SONY",\n "Sony SONY",'
[2024-08-03 12:42:37] [Rank 0] totoal_tokens=38152, outputs='```json\n{\n "ship": [\n {"x": 1, "x": 1, "x": 1},\n {"x'
[2024-08-03 12:42:38] [Rank 1] totoal_tokens=35037, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:42:40] [Rank 3] totoal_tokens=35535, outputs='[1, 1, 1]'
[2024-08-03 12:42:40] [Rank 0] totoal_tokens=38215, outputs='```json\n{\n "pen_count": 1\n}\n```'
[2024-08-03 12:42:40] [Rank 2] totoal_tokens=36502, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:42:41] [Rank 1] totoal_tokens=36153, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:42] [Rank 3] totoal_tokens=36249, outputs='[1, 2, 3]'
[2024-08-03 12:42:43] [Rank 0] totoal_tokens=38439, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:42:43] [Rank 2] totoal_tokens=36861, outputs='```json\n{\n "clouds": [\n {\n "number": 1,\n "description": "The sky is clear."\n },'
[2024-08-03 12:42:44] [Rank 1] totoal_tokens=37576, outputs='```json\n{\n "ship": [\n {\n "number": "A",\n "location": "South America"\n },\n {'
[2024-08-03 12:42:45] [Rank 3] totoal_tokens=36325, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:42:46] [Rank 2] totoal_tokens=38698, outputs='{"clouds": 2}'
[2024-08-03 12:42:47] [Rank 3] totoal_tokens=37398, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:42:47] [Rank 0] totoal_tokens=38520, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:48] [Rank 1] totoal_tokens=38035, outputs='```json\n{\n "heart": 0\n}\n```'
[2024-08-03 12:42:50] [Rank 3] totoal_tokens=38090, outputs='[1, 2, 3]'
[2024-08-03 12:42:50] [Rank 0] totoal_tokens=43415, outputs='```json\n{\n "cup_count": 1\n}\n```'
[2024-08-03 12:42:51] [Rank 2] totoal_tokens=40021, outputs='[1, 1, 1]'
[2024-08-03 12:42:52] [Rank 1] totoal_tokens=38481, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:53] [Rank 3] totoal_tokens=40657, outputs='[1, 1, 1]'
[2024-08-03 12:42:54] [Rank 0] totoal_tokens=45166, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:42:54] [Rank 2] totoal_tokens=40414, outputs='[1, 1, 1]'
[2024-08-03 12:42:55] [Rank 1] totoal_tokens=39338, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:42:56] [Rank 3] totoal_tokens=41361, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:42:58] [Rank 2] totoal_tokens=40599, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:42:59] [Rank 0] totoal_tokens=46555, outputs='[1, 1, 1]'
[2024-08-03 12:42:59] [Rank 1] totoal_tokens=42010, outputs='```json\n{\n "books": [\n {\n "title": "The Handmaid\'s Tale",\n "author": "Margaret Atwood'
[2024-08-03 12:43:00] [Rank 3] totoal_tokens=42021, outputs='```json\n{\n "pen": [\n "x",\n "x",\n "x"\n ]\n}\n```'
[2024-08-03 12:43:01] [Rank 2] totoal_tokens=41182, outputs='[0, 0, 0]'
[2024-08-03 12:43:02] [Rank 1] totoal_tokens=42189, outputs='```json\n{\n "cup_count": 0\n}\n```'
[2024-08-03 12:43:03] [Rank 3] totoal_tokens=44726, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:43:04] [Rank 2] totoal_tokens=43505, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:43:04] [Rank 0] totoal_tokens=47794, outputs='```json\n{\n "ship": [\n {\n "x": 1,\n "x": 2,\n "x": 3'
[2024-08-03 12:43:05] [Rank 1] totoal_tokens=43064, outputs='```json\n{\n "clouds": [\n {\n "position": "top left",\n "number": 1\n },\n {'
[2024-08-03 12:43:07] [Rank 3] totoal_tokens=45291, outputs='```json\n{\n "number_of_hearts": 2\n}\n```'
[2024-08-03 12:43:08] [Rank 2] totoal_tokens=45756, outputs='```json\n{\n "heart_count": 0\n}\n```'
[2024-08-03 12:43:08] [Rank 0] totoal_tokens=48874, outputs='```json\n{\n "ship": [\n "x",\n "x",\n "x"\n ]\n}\n```'
��▍ | 96/130 [01:56<01:33, 2.75s/it] Processing InternVL2-2B_counting-text-val.jsonl: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 97/130 [02:00<01:44, 3.17s/it] Processing InternVL2-2B_counting-text-val.jsonl: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 98/130 [02:03<01:37, 3.05s/it] Processing InternVL2-2B_counting-text-val.jsonl: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 99/130 [02:05<01:31, 2.96s/it] Processing InternVL2-2B_counting-text-val.jsonl: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 100/130 [02:10<01:44, 3.49s/it] Processing InternVL2-2B_counting-text-val.jsonl: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 101/130 [02:13<01:37, 3.37s/it] Processing InternVL2-2B_counting-text-val.jsonl: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 102/130 [02:17<01:34, 3.39s/it] Processing InternVL2-2B_counting-text-val.jsonl: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 103/130 [02:21<01:42, 3.79s/it] Processing InternVL2-2B_counting-text-val.jsonl: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 104/130 [02:27<01:52, 4.33s/it] Processing InternVL2-2B_counting-text-val.jsonl: 81%|β–ˆβ–ˆβ–ˆβ–ˆ[2024-08-03 12:43:10] [Rank 3] totoal_tokens=47874, outputs='[1, 2, 3]'
[2024-08-03 12:43:11] [Rank 1] totoal_tokens=46507, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:43:12] [Rank 2] totoal_tokens=47830, outputs='[1, 1, 1]'
[2024-08-03 12:43:13] [Rank 3] totoal_tokens=48191, outputs='[1, 1, 1]'
[2024-08-03 12:43:13] [Rank 0] totoal_tokens=49441, outputs='```json\n{\n "clouds": [\n "x",\n "x",\n "x"\n ]\n}\n```'
[2024-08-03 12:43:14] [Rank 1] totoal_tokens=46546, outputs='```json\n{\n "cup": 1,\n "cup": 2,\n "cup": 3,\n "cup": 4'
[2024-08-03 12:43:16] [Rank 2] totoal_tokens=48721, outputs='[1, 2, 3]'
[2024-08-03 12:43:17] [Rank 3] totoal_tokens=50465, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:43:17] [Rank 0] totoal_tokens=49502, outputs='{"x": 2, "x": 3, "x": 4}'
[2024-08-03 12:43:18] [Rank 1] totoal_tokens=47864, outputs='```json\n{\n "number_of_people": 0,\n "number_of_people_with_heart": 0\n}\n```'
[2024-08-03 12:43:19] [Rank 2] totoal_tokens=50103, outputs='```json\n{\n "clouds": [\n {\n "position": "top left",\n "number": 1,\n "color":'
[2024-08-03 12:43:22] [Rank 0] totoal_tokens=50767, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 12:43:22] [Rank 3] totoal_tokens=51663, outputs='```json\n{\n "places_to_visit": [\n "Amsterdam",\n "Dunes and Tulips",\n "King’s Day and S'
[2024-08-03 12:43:23] [Rank 2] totoal_tokens=51778, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:43:23] [Rank 1] totoal_tokens=50025, outputs='```json\n{\n "ship": [\n {\n "x": 1,\n "x": 1,\n "x": 1'
[2024-08-03 12:43:26] [Rank 0] totoal_tokens=51665, outputs='{"number_of_pens": 3}'
[2024-08-03 12:43:26] [Rank 3] totoal_tokens=52887, outputs='{"cloud": 3}'
[2024-08-03 12:43:28] [Rank 2] totoal_tokens=52208, outputs='```json\n{\n "questions": [\n {\n "question": "What is the name of the sniper?",\n "answer": "W'
[2024-08-03 12:43:29] [Rank 1] totoal_tokens=51220, outputs='```json\n{\n "cup": 0,\n "x": 0,\n "x": 0,\n "x": 0'
[2024-08-03 12:43:31] [Rank 0] totoal_tokens=55458, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:43:31] [Rank 3] totoal_tokens=54657, outputs='```json\n{\n "clouds": [\n "x",\n "x",\n "x"\n ]\n}\n```'
[2024-08-03 12:43:33] [Rank 2] totoal_tokens=53555, outputs='```json\n{\n "clouds": [\n "x",\n "x",\n "x"\n ]\n}\n```'
[2024-08-03 12:43:34] [Rank 1] totoal_tokens=51316, outputs='{"cloud": 3}'
[2024-08-03 12:43:36] [Rank 3] totoal_tokens=54978, outputs='[1, 1, 1]'
[2024-08-03 12:43:36] [Rank 0] totoal_tokens=55604, outputs='[1, 2, 3]'
[2024-08-03 12:43:38] [Rank 1] totoal_tokens=53034, outputs='```json\n{\n "cup": 3\n}\n```'
[2024-08-03 12:43:38] [Rank 2] totoal_tokens=55414, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:43:40] [Rank 0] totoal_tokens=56647, outputs='{"x": 3}'
[2024-08-03 12:43:41] [Rank 3] totoal_tokens=57185, outputs='```json\n{\n "sun": 3\n}\n```'
[2024-08-03 12:43:42] [Rank 1] totoal_tokens=53871, outputs='[1, 2, 3]'
[2024-08-03 12:43:44] [Rank 2] totoal_tokens=56140, outputs='```json\n{\n "clouds": [\n {\n "location": "Southwest",\n "number": 1,\n "color":'
[2024-08-03 12:43:44] [Rank 0] totoal_tokens=57008, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:43:48] [Rank 1] totoal_tokens=55039, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 12:43:48] [Rank 2] totoal_tokens=56751, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:43:49] [Rank 3] totoal_tokens=59529, outputs='```json\n{\n "ship_count": 0\n}\n```'
[2024-08-03 12:43:51] [Rank 0] totoal_tokens=58536, outputs='```json\n{\n "questions": [\n {\n "question": "What is the name of the first place where Alfred Hitchcock directed a'
β–ˆβ–ˆβ–ˆβ–ˆ | 105/130 [02:31<01:43, 4.15s/it] Processing InternVL2-2B_counting-text-val.jsonl: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 106/130 [02:36<01:49, 4.56s/it] Processing InternVL2-2B_counting-text-val.jsonl: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 107/130 [02:40<01:38, 4.29s/it] Processing InternVL2-2B_counting-text-val.jsonl: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 108/130 [02:44<01:36, 4.40s/it] Processing InternVL2-2B_counting-text-val.jsonl: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 109/130 [02:49<01:32, 4.41s/it] Processing InternVL2-2B_counting-text-val.jsonl: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 110/130 [02:54<01:30, 4.55s/it] Processing InternVL2-2B_counting-text-val.jsonl: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 111/130 [02:59<01:30, 4.76s/it] Processing InternVL2-2B_counting-text-val.jsonl: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 112/130 [03:03<01:21, 4.50s/it] Processing InternVL2-2B_counting-text-val.jsonl: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 113/130 [03:07<01:15, 4.45s/it] Processing InternVL2-2B_counting-text-v[2024-08-03 12:43:52] [Rank 1] totoal_tokens=56127, outputs='[1, 1, 1]'
[2024-08-03 12:43:54] [Rank 2] totoal_tokens=57604, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 12:43:54] [Rank 3] totoal_tokens=62714, outputs='[1, 2, 3]'
[2024-08-03 12:43:55] [Rank 0] totoal_tokens=59134, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:43:58] [Rank 1] totoal_tokens=58404, outputs='[1, 1, 1]'
[2024-08-03 12:44:00] [Rank 2] totoal_tokens=59352, outputs='{"name":"Soma Seeds","description":"A seed bank that specializes in growing cannabis seeds and cultivating the plantation of the seeds. The seeds are'
[2024-08-03 12:44:00] [Rank 0] totoal_tokens=59255, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 12:44:00] [Rank 3] totoal_tokens=63578, outputs='{"sun": 3, "x": 3, "x": 3}'
[2024-08-03 12:44:06] [Rank 0] totoal_tokens=60173, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:44:06] [Rank 1] totoal_tokens=58807, outputs='```json\n{\n "questions": [\n {\n "question": "What is the definition of vulnerability?",\n "answer": "Vulnerability'
[2024-08-03 12:44:06] [Rank 2] totoal_tokens=59443, outputs='{"name":"Treyarch","year":2020,"games":["Cold War","Call of Duty: Black Ops 2","Cold War","'
[2024-08-03 12:44:06] [Rank 3] totoal_tokens=65042, outputs='```json\n{\n "sun_count": 0\n}\n```'
[2024-08-03 12:44:11] [Rank 0] totoal_tokens=60534, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 12:44:11] [Rank 2] totoal_tokens=60522, outputs='```json\n{\n "pen_count": 0\n}\n```'
[2024-08-03 12:44:12] [Rank 1] totoal_tokens=63550, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:44:12] [Rank 3] totoal_tokens=65323, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:44:15] [Rank 0] totoal_tokens=61028, outputs='[1, 1, 1]'
[2024-08-03 12:44:17] [Rank 3] totoal_tokens=65757, outputs='{"x": 3}'
[2024-08-03 12:44:18] [Rank 2] totoal_tokens=63963, outputs='{"cloud": 3, "number": 3}'
[2024-08-03 12:44:18] [Rank 1] totoal_tokens=65554, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:44:21] [Rank 0] totoal_tokens=64200, outputs='{"name":"Morrison\'s Rogue River Lodge","description":"A 1968, when the Rogue River was designated β€œWild and Scenic” by'
[2024-08-03 12:44:22] [Rank 3] totoal_tokens=66212, outputs='```json\n{\n "cup_count": 3\n}\n```'
[2024-08-03 12:44:23] [Rank 2] totoal_tokens=65386, outputs='```json\n{\n "number_of_pens": [\n {"x": 1, "x": 2, "x": 3,'
[2024-08-03 12:44:24] [Rank 1] totoal_tokens=69293, outputs='[1, 1, 1]'
[2024-08-03 12:44:27] [Rank 0] totoal_tokens=64616, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 12:44:29] [Rank 3] totoal_tokens=66609, outputs='{"x": 3, "x": 3, "x": 3}'
[2024-08-03 12:44:29] [Rank 1] totoal_tokens=69798, outputs='[1, 2, 3]'
[2024-08-03 12:44:32] [Rank 2] totoal_tokens=66087, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 12:44:33] [Rank 0] totoal_tokens=65117, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 12:44:34] [Rank 1] totoal_tokens=69859, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:44:34] [Rank 3] totoal_tokens=66856, outputs='{"number_of_suns": 3}'
[2024-08-03 12:44:38] [Rank 2] totoal_tokens=66244, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:44:41] [Rank 0] totoal_tokens=70106, outputs='```json\n{\n "number_of_ships": 23\n}\n```'
al.jsonl: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 114/130 [03:13<01:19, 4.95s/it] Processing InternVL2-2B_counting-text-val.jsonl: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 115/130 [03:18<01:12, 4.81s/it] Processing InternVL2-2B_counting-text-val.jsonl: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 116/130 [03:23<01:08, 4.87s/it] Processing InternVL2-2B_counting-text-val.jsonl: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 117/130 [03:28<01:05, 5.07s/it] Processing InternVL2-2B_counting-text-val.jsonl: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 118/130 [03:33<01:00, 5.03s/it] Processing InternVL2-2B_counting-text-val.jsonl: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 119/130 [03:38<00:53, 4.90s/it] Processing InternVL2-2B_counting-text-val.jsonl: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 120/130 [03:44<00:52, 5.24s/it] Processing InternVL2-2B_counting-text-val.jsonl: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 121/130 [03:50<00:49, 5.52s/it] Processing InternVL2-2B_counting-text-val.jsonl: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 122/130 [03:56<00:44, 5.52s/it] Pr[2024-08-03 12:44:42] [Rank 1] totoal_tokens=69918, outputs='[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11'
[2024-08-03 12:44:42] [Rank 3] totoal_tokens=67226, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 12:44:44] [Rank 2] totoal_tokens=66700, outputs='{\n "title": "The Persistence",\n "description": "The Persistence is a 5-foot-10-inch bot that learned to throw a'
[2024-08-03 12:44:48] [Rank 0] totoal_tokens=71587, outputs='{"x": 3}'
[2024-08-03 12:44:48] [Rank 3] totoal_tokens=70287, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:44:49] [Rank 1] totoal_tokens=70789, outputs='[1, 2, 3]'
[2024-08-03 12:44:50] [Rank 2] totoal_tokens=67184, outputs='[1, 2, 3]'
[2024-08-03 12:44:55] [Rank 1] totoal_tokens=71601, outputs='[1, 2, 3]'
[2024-08-03 12:44:55] [Rank 2] totoal_tokens=67363, outputs='{"heart": 3}'
[2024-08-03 12:44:55] [Rank 0] totoal_tokens=72788, outputs='[1, 1, 1]'
[2024-08-03 12:44:56] [Rank 3] totoal_tokens=72854, outputs="I'm not someone who is reflexively opposed to higher taxes for those with high incomes, but these kinds of concerns over the future of the middle class are unlikely"
[2024-08-03 12:45:01] [Rank 0] totoal_tokens=73802, outputs='[1, 2, 3]'
[2024-08-03 12:45:01] [Rank 1] totoal_tokens=71751, outputs='{"x": 3, "x": 2, "x": 1}'
[2024-08-03 12:45:02] [Rank 2] totoal_tokens=71074, outputs="I'm sorry, I can't help with that."
[2024-08-03 12:45:02] [Rank 3] totoal_tokens=73377, outputs="I'm sorry, I can't help with that."
[2024-08-03 12:45:07] [Rank 1] totoal_tokens=72572, outputs='The Democratic Party has moved leftward amid its presidential primary. The data is not available.'
[2024-08-03 12:45:08] [Rank 0] totoal_tokens=74535, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 12:45:09] [Rank 2] totoal_tokens=71928, outputs='{"x": 1, "x": 1, "x": 1}'
[2024-08-03 12:45:10] [Rank 3] totoal_tokens=74011, outputs='{"x": 0, "x": 0, "x": 0}'
[2024-08-03 12:45:15] [Rank 1] totoal_tokens=74096, outputs='The answer is 0.'
[2024-08-03 12:45:15] [Rank 0] totoal_tokens=76468, outputs='The answer is 0.'
[2024-08-03 12:45:17] [Rank 2] totoal_tokens=73830, outputs='I am not able to answer that question.'
[2024-08-03 12:45:19] [Rank 3] totoal_tokens=74916, outputs='[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1'
[2024-08-03 12:45:21] [Rank 1] totoal_tokens=74812, outputs='[1, 2, 3]'
[2024-08-03 12:45:21] [Rank 0] totoal_tokens=77633, outputs='I am a fan of Mod Culture.'
[2024-08-03 12:45:23] [Rank 2] totoal_tokens=75623, outputs='[1, 2, 3]'
[2024-08-03 12:45:25] [Rank 3] totoal_tokens=77455, outputs='Praise'
[2024-08-03 12:45:30] [Rank 0] totoal_tokens=78340, outputs='[1, 2, 3]'
ocessing InternVL2-2B_counting-text-val.jsonl: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 123/130 [04:04<00:43, 6.26s/it] Processing InternVL2-2B_counting-text-val.jsonl: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 124/130 [04:11<00:38, 6.48s/it] Processing InternVL2-2B_counting-text-val.jsonl: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 125/130 [04:18<00:33, 6.78s/it] Processing InternVL2-2B_counting-text-val.jsonl: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 126/130 [04:24<00:25, 6.42s/it] Processing InternVL2-2B_counting-text-val.jsonl: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 127/130 [04:31<00:19, 6.56s/it] Processing InternVL2-2B_counting-text-val.jsonl: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 128/130 [04:38<00:13, 6.73s/it] Processing InternVL2-2B_counting-text-val.jsonl: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 129/130 [04:44<00:06, 6.66s/it] Processing InternVL2-2B_counting-text-val.jsonl: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 130/130 [04:52<00:00, 7.15s/it] Processing InternVL2-2B_counting-text-val.jsonl: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 130/130 [04:52<00:00, 2.25s/it]
[2024-08-03 12:45:30] Rank 0 Finish
[2024-08-03 12:45:30] [Rank 1] totoal_tokens=78745, outputs="I'm sorry, I can't help with that."
[2024-08-03 12:45:30] [Rank 2] totoal_tokens=76066, outputs='Chevallier malt'
[2024-08-03 12:45:32] [Rank 3] totoal_tokens=78475, outputs='{"x": 1, "x": 2, "x": 3}'
[2024-08-03 12:45:32] Rank 3 Finish
[2024-08-03 12:45:38] [Rank 1] totoal_tokens=78806, outputs='[0, 0, 0]'
[2024-08-03 12:45:38] Rank 1 Finish
[2024-08-03 12:45:38] [Rank 2] totoal_tokens=78826, outputs='[0, 0, 0]'
[2024-08-03 12:45:38] Rank 2 Finish
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/temp_InternVL2-2B_counting-text-val/* > work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/InternVL2-2B_counting-text-val.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/temp_InternVL2-2B_counting-text-val/* > work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/InternVL2-2B_counting-text-val.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/temp_InternVL2-2B_counting-text-val/* > work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/InternVL2-2B_counting-text-val.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/temp_InternVL2-2B_counting-text-val/* > work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/InternVL2-2B_counting-text-val.jsonl
python eval/mm_niah/calculate_scores.py --outputs-dir work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val
python eval/mm_niah/calculate_scores.py --outputs-dir work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val
python eval/mm_niah/calculate_scores.py --outputs-dir work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val
python eval/mm_niah/calculate_scores.py --outputs-dir work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.
results on val split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/results/InternVL2-2B/scores_val.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.
results on val split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/results/InternVL2-2B/scores_val.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.
results on val split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/results/InternVL2-2B/scores_val.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.
results on val split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/counting-text-val/results/InternVL2-2B/scores_val.json