Hugging Face's logo

OpenGVLab
/
InternVL2-2B

Image-Text-to-Text
Transformers
Safetensors
multilingual
internvl_chat
feature-extraction
internvl
custom_code
conversational
Model card Files
xet
 Community
7
InternVL2-2B / eval_mm_niah /reasoning-text-val.log
cuierfei's picture
cuierfei
Upload folder using huggingface_hub
b537a0f verified
raw
history blame
58.6 kB
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
language_model.model.layers.0 4
language_model.model.layers.1 4
language_model.model.layers.2 4
language_model.model.layers.3 4
language_model.model.layers.4 4
language_model.model.layers.5 4
language_model.model.layers.6 4
language_model.model.layers.7 4
language_model.model.layers.8 4
language_model.model.layers.9 4
language_model.model.layers.10 4
language_model.model.layers.11 4
language_model.model.layers.12 4
language_model.model.layers.13 4
language_model.model.layers.14 4
language_model.model.layers.15 4
language_model.model.layers.16 4
language_model.model.layers.17 4
language_model.model.layers.18 4
language_model.model.layers.19 4
language_model.model.layers.20 4
language_model.model.layers.21 4
language_model.model.layers.22 4
language_model.model.layers.23 4
vision_model.encoder.layers.0 0
vision_model.encoder.layers.1 0
vision_model.encoder.layers.2 0
vision_model.encoder.layers.3 0
vision_model.encoder.layers.4 0
vision_model.encoder.layers.5 0
vision_model.encoder.layers.6 0
vision_model.encoder.layers.7 0
vision_model.encoder.layers.8 0
vision_model.encoder.layers.9 0
vision_model.encoder.layers.10 0
vision_model.encoder.layers.11 0
vision_model.encoder.layers.12 0
vision_model.encoder.layers.13 0
vision_model.encoder.layers.14 0
vision_model.encoder.layers.15 0
vision_model.encoder.layers.16 0
vision_model.encoder.layers.17 0
vision_model.encoder.layers.18 0
vision_model.encoder.layers.19 0
vision_model.encoder.layers.20 0
vision_model.encoder.layers.21 0
vision_model.encoder.layers.22 0
vision_model.encoder.layers.23 0
vision_model.embeddings 0
mlp1 0
language_model.model.tok_embeddings 4
language_model.model.norm 4
language_model.output 4
language_model.model.embed_tokens 4
language_model.lm_head 4
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [0] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task reasoning-text-val, devices: {device(type='cuda', index=0), device(type='cuda', index=4)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [2] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task reasoning-text-val, devices: {device(type='cuda', index=2), device(type='cuda', index=6)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [1] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task reasoning-text-val, devices: {device(type='cuda', index=1), device(type='cuda', index=5)}
Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
Rank [3] Begin to eval model work_dirs/share_internvl/InternVL2-2B on task reasoning-text-val, devices: {device(type='cuda', index=3), device(type='cuda', index=7)}
Rank 3 len(skip_idx)=0
Rank 1 len(skip_idx)=0
Rank 0 len(skip_idx)=0
Rank 2 len(skip_idx)=0
[2024-08-03 12:51:54] [Rank 3] totoal_tokens=655, outputs='Phone'
[2024-08-03 12:51:54] [Rank 0] totoal_tokens=631, outputs='Red'
[2024-08-03 12:51:54] [Rank 2] totoal_tokens=676, outputs='London'
[2024-08-03 12:51:54] [Rank 1] totoal_tokens=512, outputs='Main course'
[2024-08-03 12:51:54] [Rank 3] totoal_tokens=700, outputs='Xiao Zhang'
[2024-08-03 12:51:54] [Rank 0] totoal_tokens=639, outputs='Appetizer'
[2024-08-03 12:51:54] [Rank 1] totoal_tokens=633, outputs='Xiaoming'
[2024-08-03 12:51:54] [Rank 2] totoal_tokens=702, outputs='Appetizer'
[2024-08-03 12:51:54] [Rank 3] totoal_tokens=946, outputs='Mr. Li'
[2024-08-03 12:51:54] [Rank 1] totoal_tokens=677, outputs='Workshop'
[2024-08-03 12:51:54] [Rank 0] totoal_tokens=668, outputs='Mr. Zhang'
[2024-08-03 12:51:55] [Rank 2] totoal_tokens=775, outputs='Mr. Li'
[2024-08-03 12:51:55] [Rank 3] totoal_tokens=997, outputs='Appetizer'
[2024-08-03 12:51:55] [Rank 1] totoal_tokens=932, outputs='Lettuce'
[2024-08-03 12:51:55] [Rank 0] totoal_tokens=736, outputs='Mr. Li'
[2024-08-03 12:51:55] [Rank 3] totoal_tokens=1045, outputs='Tom'
[2024-08-03 12:51:55] [Rank 2] totoal_tokens=812, outputs='The student goes home.'
[2024-08-03 12:51:55] [Rank 1] totoal_tokens=1026, outputs='Red'
[2024-08-03 12:51:55] [Rank 2] totoal_tokens=917, outputs='Alice'
[2024-08-03 12:51:55] [Rank 0] totoal_tokens=892, outputs='Xiaohong'
[2024-08-03 12:51:55] [Rank 3] totoal_tokens=1094, outputs='Mr. Li'
[2024-08-03 12:51:55] [Rank 1] totoal_tokens=1044, outputs='Mr. Li'
[2024-08-03 12:51:55] [Rank 2] totoal_tokens=924, outputs='Tom'
[2024-08-03 12:51:55] [Rank 3] totoal_tokens=1137, outputs='Xiao Li'
[2024-08-03 12:51:55] [Rank 0] totoal_tokens=893, outputs='Xiaowen'
[2024-08-03 12:51:55] [Rank 2] totoal_tokens=933, outputs='Cucumber'
[2024-08-03 12:51:55] [Rank 1] totoal_tokens=1057, outputs='Mr. Zhang'
[2024-08-03 12:51:55] [Rank 0] totoal_tokens=1022, outputs='Bob'
[2024-08-03 12:51:55] [Rank 2] totoal_tokens=1001, outputs='Bicycle'
[2024-08-03 12:51:55] [Rank 3] totoal_tokens=1257, outputs='Xiaowen'
[2024-08-03 12:51:55] [Rank 2] totoal_tokens=1045, outputs='Mary'
[2024-08-03 12:51:55] [Rank 1] totoal_tokens=1088, outputs='Xiaohong'
[2024-08-03 12:51:55] [Rank 0] totoal_tokens=1073, outputs='Bunker Hill'
[2024-08-03 12:51:55] [Rank 3] totoal_tokens=1265, outputs='Xiaoming'
[2024-08-03 12:51:55] [Rank 2] totoal_tokens=1077, outputs='Oranges'
[2024-08-03 12:51:55] [Rank 1] totoal_tokens=1204, outputs='Tea'
[2024-08-03 12:51:55] [Rank 0] totoal_tokens=1136, outputs='Strawberries'
[2024-08-03 12:51:55] [Rank 3] totoal_tokens=1339, outputs='Bob'
[2024-08-03 12:51:56] [Rank 2] totoal_tokens=1078, outputs='Workshop'
[2024-08-03 12:51:56] [Rank 1] totoal_tokens=1207, outputs='Bob'
[2024-08-03 12:51:56] [Rank 3] totoal_tokens=1454, outputs='Tom'
[2024-08-03 12:51:56] [Rank 0] totoal_tokens=1177, outputs='Strawberries'
[2024-08-03 12:51:56] [Rank 2] totoal_tokens=1221, outputs='Mike'
[2024-08-03 12:51:56] [Rank 1] totoal_tokens=1240, outputs='red'
[2024-08-03 12:51:56] [Rank 3] totoal_tokens=1455, outputs='headphones'
[2024-08-03 12:51:56] [Rank 1] totoal_tokens=1260, outputs='Mr. Li'
[2024-08-03 12:51:56] [Rank 0] totoal_tokens=1269, outputs='Xiaohong'
 Processing InternVL2-2B_reasoning-text-val.jsonl: 0%| | 0/130 [00:00<?, ?it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 1%| | 1/130 [00:00<01:49, 1.18it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 2%|▏ | 2/130 [00:01<00:56, 2.25it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 2%|▏ | 3/130 [00:01<00:39, 3.19it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 3%|β–Ž | 4/130 [00:01<00:32, 3.91it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 4%|▍ | 5/130 [00:01<00:28, 4.36it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 5%|▍ | 6/130 [00:01<00:26, 4.74it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 6%|β–Œ | 8/130 [00:01<00:21, 5.69it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 7%|β–‹ | 9/130 [00:02<00:20, 5.90it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 8%|β–Š | 10/130 [00:02<00:20, 5.94it/s] Processing InternVL2-2B_reasoning-[2024-08-03 12:51:56] [Rank 2] totoal_tokens=1855, outputs='Lettuce'
[2024-08-03 12:51:56] [Rank 3] totoal_tokens=1545, outputs='Mr. Li'
[2024-08-03 12:51:56] [Rank 0] totoal_tokens=1364, outputs='tea'
[2024-08-03 12:51:56] [Rank 1] totoal_tokens=1350, outputs='Xiaoqiang'
[2024-08-03 12:51:56] [Rank 2] totoal_tokens=1883, outputs='Xiao Zhang'
[2024-08-03 12:51:56] [Rank 3] totoal_tokens=1631, outputs='London'
[2024-08-03 12:51:56] [Rank 0] totoal_tokens=1450, outputs='Tea'
[2024-08-03 12:51:56] [Rank 0] totoal_tokens=1578, outputs='red'
[2024-08-03 12:51:56] [Rank 1] totoal_tokens=1843, outputs='Headphones'
[2024-08-03 12:51:56] [Rank 2] totoal_tokens=1918, outputs='strawberries'
[2024-08-03 12:51:56] [Rank 3] totoal_tokens=1638, outputs='stapler'
[2024-08-03 12:51:56] [Rank 0] totoal_tokens=1587, outputs='London'
[2024-08-03 12:51:56] [Rank 2] totoal_tokens=2060, outputs='London'
[2024-08-03 12:51:56] [Rank 1] totoal_tokens=2020, outputs='Azolok'
[2024-08-03 12:51:57] [Rank 3] totoal_tokens=1706, outputs='Xiaohong'
[2024-08-03 12:51:57] [Rank 2] totoal_tokens=2103, outputs='Bob'
[2024-08-03 12:51:57] [Rank 0] totoal_tokens=1641, outputs='Xiaoqiang'
[2024-08-03 12:51:57] [Rank 1] totoal_tokens=2027, outputs='Dr. Li'
[2024-08-03 12:51:57] [Rank 3] totoal_tokens=1744, outputs='motorcycle'
[2024-08-03 12:51:57] [Rank 0] totoal_tokens=1745, outputs='Movie screening'
[2024-08-03 12:51:57] [Rank 2] totoal_tokens=2131, outputs='Mr. Li'
[2024-08-03 12:51:57] [Rank 0] totoal_tokens=1963, outputs='Bob'
[2024-08-03 12:51:57] [Rank 3] totoal_tokens=2077, outputs='Xiao Zhang'
[2024-08-03 12:51:57] [Rank 2] totoal_tokens=2132, outputs='pen'
[2024-08-03 12:51:57] [Rank 1] totoal_tokens=2031, outputs='The student finishes homework.'
[2024-08-03 12:51:57] [Rank 0] totoal_tokens=2019, outputs='Tea'
[2024-08-03 12:51:57] [Rank 3] totoal_tokens=2144, outputs='Workshop'
[2024-08-03 12:51:57] [Rank 2] totoal_tokens=2247, outputs='dessert'
[2024-08-03 12:51:57] [Rank 1] totoal_tokens=2128, outputs='Main course'
[2024-08-03 12:51:57] [Rank 0] totoal_tokens=2096, outputs='Dr. Wang'
[2024-08-03 12:51:57] [Rank 3] totoal_tokens=2173, outputs='A movie screening'
[2024-08-03 12:51:57] [Rank 0] totoal_tokens=2152, outputs='Red'
text-val.jsonl: 8%|β–Š | 11/130 [00:02<00:20, 5.86it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 9%|β–‰ | 12/130 [00:02<00:19, 6.20it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 10%|β–ˆ | 13/130 [00:02<00:18, 6.38it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 11%|β–ˆ | 14/130 [00:02<00:17, 6.70it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 12%|β–ˆβ– | 15/130 [00:03<00:16, 7.05it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 12%|β–ˆβ– | 16/130 [00:03<00:18, 6.31it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 13%|β–ˆβ–Ž | 17/130 [00:03<00:17, 6.40it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 14%|β–ˆβ– | 18/130 [00:03<00:16, 6.84it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 15%|β–ˆβ– | 19/130 [00:03<00:16, 6.72it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 15%|β–ˆβ–Œ | 20/130 [00:03<00:18, 5.86it/s] Processing InternVL2-2B_reasoning-te[2024-08-03 12:51:57] [Rank 2] totoal_tokens=2503, outputs='Mr. Li'
[2024-08-03 12:51:57] [Rank 1] totoal_tokens=2129, outputs='Berlin'
[2024-08-03 12:51:57] [Rank 3] totoal_tokens=2185, outputs='Xiao Li'
[2024-08-03 12:51:57] [Rank 0] totoal_tokens=2300, outputs='Cucumber'
[2024-08-03 12:51:58] [Rank 1] totoal_tokens=2212, outputs='Xiaoming'
[2024-08-03 12:51:58] [Rank 2] totoal_tokens=2538, outputs='Xiaoming'
[2024-08-03 12:51:58] [Rank 3] totoal_tokens=2186, outputs='lettuce'
[2024-08-03 12:51:58] [Rank 0] totoal_tokens=2649, outputs='Dr. Wang'
[2024-08-03 12:51:58] [Rank 2] totoal_tokens=2673, outputs='Mr. Li'
[2024-08-03 12:51:58] [Rank 1] totoal_tokens=2217, outputs='Dr. Zhang'
[2024-08-03 12:51:58] [Rank 0] totoal_tokens=2884, outputs='Red'
[2024-08-03 12:51:58] [Rank 3] totoal_tokens=2472, outputs='The student finishes homework after coming home.'
[2024-08-03 12:51:58] [Rank 1] totoal_tokens=2249, outputs='lamp'
[2024-08-03 12:51:58] [Rank 2] totoal_tokens=2691, outputs='A movie screening'
[2024-08-03 12:51:58] [Rank 3] totoal_tokens=2748, outputs='Movie screening'
[2024-08-03 12:51:58] [Rank 1] totoal_tokens=2504, outputs='Movie screening'
[2024-08-03 12:51:58] [Rank 2] totoal_tokens=3071, outputs='lettuce'
[2024-08-03 12:51:58] [Rank 3] totoal_tokens=2864, outputs='main course'
[2024-08-03 12:51:58] [Rank 1] totoal_tokens=2672, outputs='Mr. Li'
[2024-08-03 12:51:58] [Rank 0] totoal_tokens=3052, outputs='Increasing levels of carbon dioxide increase the rate of photosynthesis.'
[2024-08-03 12:51:58] [Rank 3] totoal_tokens=3165, outputs='Mary'
[2024-08-03 12:51:59] [Rank 2] totoal_tokens=3197, outputs='The slowest vehicle is the bicycle.'
[2024-08-03 12:51:59] [Rank 1] totoal_tokens=3038, outputs='Bicycle'
[2024-08-03 12:51:59] [Rank 0] totoal_tokens=3584, outputs='Bob'
[2024-08-03 12:51:59] [Rank 3] totoal_tokens=3560, outputs='Berlin'
[2024-08-03 12:51:59] [Rank 2] totoal_tokens=3440, outputs='lamp'
[2024-08-03 12:51:59] [Rank 1] totoal_tokens=3073, outputs='The Sellout'
[2024-08-03 12:51:59] [Rank 0] totoal_tokens=3661, outputs='Xiaoqiang'
[2024-08-03 12:51:59] [Rank 3] totoal_tokens=3695, outputs='Bob Weir'
[2024-08-03 12:51:59] [Rank 2] totoal_tokens=3668, outputs='Mr. Zhang'
[2024-08-03 12:51:59] [Rank 1] totoal_tokens=3429, outputs='Xiao Li'
[2024-08-03 12:51:59] [Rank 3] totoal_tokens=3805, outputs='Xiaowen'
[2024-08-03 12:51:59] [Rank 0] totoal_tokens=3880, outputs='PokΓ©mon CafΓ© Mix'
[2024-08-03 12:51:59] [Rank 1] totoal_tokens=3601, outputs='Movie screening'
[2024-08-03 12:52:00] [Rank 3] totoal_tokens=4556, outputs='Mr. Zhang'
[2024-08-03 12:52:00] [Rank 0] totoal_tokens=3938, outputs='Dessert'
[2024-08-03 12:52:00] [Rank 1] totoal_tokens=3625, outputs='Xiaoming'
[2024-08-03 12:52:00] [Rank 2] totoal_tokens=4499, outputs='The League of Explorers has taken up the challenge and are prepared to save'
[2024-08-03 12:52:00] [Rank 1] totoal_tokens=3648, outputs='Xiao Zhang'
[2024-08-03 12:52:00] [Rank 0] totoal_tokens=3957, outputs='Xiaoming'
[2024-08-03 12:52:00] [Rank 3] totoal_tokens=4817, outputs='Xiaowen'
[2024-08-03 12:52:00] [Rank 2] totoal_tokens=4518, outputs='Xiao Zhang'
[2024-08-03 12:52:00] [Rank 1] totoal_tokens=3696, outputs='Xiao Li'
[2024-08-03 12:52:00] [Rank 3] totoal_tokens=4885, outputs='Mary'
[2024-08-03 12:52:00] [Rank 2] totoal_tokens=4663, outputs='C'
[2024-08-03 12:52:00] [Rank 0] totoal_tokens=4158, outputs='dessert'
xt-val.jsonl: 16%|β–ˆβ–Œ | 21/130 [00:03<00:17, 6.31it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 17%|β–ˆβ–‹ | 22/130 [00:04<00:17, 6.08it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 18%|β–ˆβ–Š | 23/130 [00:04<00:19, 5.53it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 18%|β–ˆβ–Š | 24/130 [00:04<00:18, 5.76it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 19%|β–ˆβ–‰ | 25/130 [00:05<00:28, 3.64it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 20%|β–ˆβ–ˆ | 26/130 [00:05<00:27, 3.82it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 21%|β–ˆβ–ˆ | 27/130 [00:05<00:27, 3.77it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 22%|β–ˆβ–ˆβ– | 28/130 [00:05<00:32, 3.14it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 22%|β–ˆβ–ˆβ– | 29/130 [00:06<00:30, 3.35it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 23%|β–ˆβ–ˆβ–Ž | 30/130 [00:06<00:30, 3.23it/s] Processing InternVL2-2B_[2024-08-03 12:52:00] [Rank 1] totoal_tokens=4011, outputs='Xiaoming'
[2024-08-03 12:52:01] [Rank 0] totoal_tokens=4230, outputs='The dessert'
[2024-08-03 12:52:01] [Rank 2] totoal_tokens=5141, outputs='Nature'
[2024-08-03 12:52:01] [Rank 3] totoal_tokens=5054, outputs='Mr. Li'
[2024-08-03 12:52:01] [Rank 1] totoal_tokens=4096, outputs='finish homework'
[2024-08-03 12:52:01] [Rank 0] totoal_tokens=4394, outputs='Mr. Li'
[2024-08-03 12:52:01] [Rank 2] totoal_tokens=5220, outputs='Movie screening'
[2024-08-03 12:52:01] [Rank 3] totoal_tokens=5134, outputs='Keynote'
[2024-08-03 12:52:01] [Rank 1] totoal_tokens=4544, outputs='Mr. Li'
[2024-08-03 12:52:01] [Rank 0] totoal_tokens=4804, outputs='Xiaoqiang'
[2024-08-03 12:52:01] [Rank 3] totoal_tokens=5160, outputs='Red'
[2024-08-03 12:52:01] [Rank 1] totoal_tokens=4603, outputs='Tea'
[2024-08-03 12:52:01] [Rank 2] totoal_tokens=5712, outputs='Juice'
[2024-08-03 12:52:02] [Rank 0] totoal_tokens=5429, outputs='Xiaoqiang'
[2024-08-03 12:52:02] [Rank 1] totoal_tokens=4868, outputs='Xiaoming'
[2024-08-03 12:52:02] [Rank 3] totoal_tokens=5929, outputs='Xiaoming'
[2024-08-03 12:52:02] [Rank 2] totoal_tokens=5911, outputs='Xiao Li'
[2024-08-03 12:52:02] [Rank 0] totoal_tokens=5534, outputs='strawberry'
[2024-08-03 12:52:02] [Rank 1] totoal_tokens=5132, outputs='The student goes home.'
[2024-08-03 12:52:02] [Rank 2] totoal_tokens=5926, outputs='Dinosaur'
[2024-08-03 12:52:02] [Rank 3] totoal_tokens=6065, outputs='Xiaowen'
[2024-08-03 12:52:02] [Rank 0] totoal_tokens=5609, outputs='Xiao Zhang'
[2024-08-03 12:52:02] [Rank 2] totoal_tokens=6076, outputs='Dr. Zhang'
[2024-08-03 12:52:03] [Rank 1] totoal_tokens=5191, outputs='Xiao Li'
[2024-08-03 12:52:03] [Rank 0] totoal_tokens=5634, outputs='lettuce'
[2024-08-03 12:52:03] [Rank 3] totoal_tokens=6268, outputs='Xiaoqiang'
[2024-08-03 12:52:03] [Rank 1] totoal_tokens=6165, outputs='Sarah'
[2024-08-03 12:52:03] [Rank 3] totoal_tokens=6335, outputs='Appetizer'
[2024-08-03 12:52:03] [Rank 2] totoal_tokens=6493, outputs='tea'
[2024-08-03 12:52:03] [Rank 1] totoal_tokens=6299, outputs='They get a job'
[2024-08-03 12:52:04] [Rank 3] totoal_tokens=6421, outputs='Xiaoqiang'
[2024-08-03 12:52:04] [Rank 0] totoal_tokens=6333, outputs='Xiaoqiang'
[2024-08-03 12:52:04] [Rank 2] totoal_tokens=7347, outputs='Xiao Li'
[2024-08-03 12:52:04] [Rank 1] totoal_tokens=6863, outputs='Mr. Li'
[2024-08-03 12:52:04] [Rank 3] totoal_tokens=6838, outputs='Mary'
[2024-08-03 12:52:04] [Rank 0] totoal_tokens=6710, outputs='Mr. Zhang'
reasoning-text-val.jsonl: 24%|β–ˆβ–ˆβ– | 31/130 [00:06<00:32, 3.09it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 25%|β–ˆβ–ˆβ– | 32/130 [00:07<00:29, 3.29it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 25%|β–ˆβ–ˆβ–Œ | 33/130 [00:07<00:29, 3.31it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 26%|β–ˆβ–ˆβ–Œ | 34/130 [00:07<00:29, 3.20it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 27%|β–ˆβ–ˆβ–‹ | 35/130 [00:08<00:31, 3.02it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 28%|β–ˆβ–ˆβ–Š | 36/130 [00:08<00:32, 2.89it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 28%|β–ˆβ–ˆβ–Š | 37/130 [00:09<00:36, 2.53it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 29%|β–ˆβ–ˆβ–‰ | 38/130 [00:09<00:34, 2.71it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 30%|β–ˆβ–ˆβ–ˆ | 39/130 [00:10<00:47, 1.94it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 31%|β–ˆβ–ˆβ–ˆ | 40/130 [00:10<00:46, 1.94it/s[2024-08-03 12:52:04] [Rank 3] totoal_tokens=7925, outputs='car'
[2024-08-03 12:52:04] [Rank 1] totoal_tokens=6883, outputs='Charlie'
[2024-08-03 12:52:04] [Rank 2] totoal_tokens=7600, outputs='Cucumbers'
[2024-08-03 12:52:04] [Rank 0] totoal_tokens=6738, outputs='Xiaoming'
[2024-08-03 12:52:05] [Rank 1] totoal_tokens=7260, outputs='Tea'
[2024-08-03 12:52:05] [Rank 0] totoal_tokens=6867, outputs='Xiao Li'
[2024-08-03 12:52:05] [Rank 2] totoal_tokens=7922, outputs='Xiaoqiang'
[2024-08-03 12:52:05] [Rank 3] totoal_tokens=8229, outputs='Xiao Zhang'
[2024-08-03 12:52:05] [Rank 1] totoal_tokens=7542, outputs='The Washington Post'
[2024-08-03 12:52:05] [Rank 0] totoal_tokens=7091, outputs='Tom'
[2024-08-03 12:52:05] [Rank 1] totoal_tokens=8036, outputs='Headphones'
[2024-08-03 12:52:06] [Rank 2] totoal_tokens=8020, outputs='Red'
[2024-08-03 12:52:06] [Rank 1] totoal_tokens=8971, outputs='Red'
[2024-08-03 12:52:06] [Rank 0] totoal_tokens=7610, outputs='The Senate and House are both in marathon sessions to finish their business before the midnight'
[2024-08-03 12:52:06] [Rank 2] totoal_tokens=8173, outputs='Movie screening'
[2024-08-03 12:52:06] [Rank 1] totoal_tokens=9171, outputs='Lamp'
[2024-08-03 12:52:07] [Rank 3] totoal_tokens=8391, outputs='Xiao Zhang'
[2024-08-03 12:52:07] [Rank 0] totoal_tokens=8363, outputs='A movie screening'
[2024-08-03 12:52:07] [Rank 2] totoal_tokens=8509, outputs='Sarah'
[2024-08-03 12:52:07] [Rank 3] totoal_tokens=8466, outputs='lamp'
[2024-08-03 12:52:07] [Rank 0] totoal_tokens=8880, outputs='Cucumbers'
[2024-08-03 12:52:07] [Rank 1] totoal_tokens=9858, outputs='Xiaoqiang'
[2024-08-03 12:52:07] [Rank 2] totoal_tokens=8665, outputs='Cucumbers'
[2024-08-03 12:52:07] [Rank 3] totoal_tokens=8506, outputs='GPD Win'
[2024-08-03 12:52:08] [Rank 0] totoal_tokens=9282, outputs='Go home'
[2024-08-03 12:52:08] [Rank 2] totoal_tokens=8823, outputs='Headphones'
[2024-08-03 12:52:08] [Rank 3] totoal_tokens=8863, outputs='Tea'
[2024-08-03 12:52:08] [Rank 1] totoal_tokens=10061, outputs='The student finishes homework after going to the library.'
[2024-08-03 12:52:08] [Rank 0] totoal_tokens=9375, outputs='Red'
[2024-08-03 12:52:08] [Rank 3] totoal_tokens=8867, outputs='Workshop'
[2024-08-03 12:52:08] [Rank 2] totoal_tokens=9521, outputs='Mr. Zhang'
[2024-08-03 12:52:09] [Rank 0] totoal_tokens=9615, outputs='Dessert'
[2024-08-03 12:52:09] [Rank 1] totoal_tokens=10109, outputs='Xiaoqiang'
[2024-08-03 12:52:09] [Rank 3] totoal_tokens=9723, outputs='Mr. Zhang'
[2024-08-03 12:52:09] [Rank 2] totoal_tokens=9723, outputs='Tom'
[2024-08-03 12:52:09] [Rank 0] totoal_tokens=10211, outputs='Xiaoming'
] Processing InternVL2-2B_reasoning-text-val.jsonl: 32%|β–ˆβ–ˆβ–ˆβ– | 41/130 [00:11<00:42, 2.11it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 32%|β–ˆβ–ˆβ–ˆβ– | 42/130 [00:11<00:40, 2.16it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 43/130 [00:11<00:38, 2.26it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 34%|β–ˆβ–ˆβ–ˆβ– | 44/130 [00:12<00:47, 1.80it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 35%|β–ˆβ–ˆβ–ˆβ– | 45/130 [00:13<00:44, 1.89it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 35%|β–ˆβ–ˆβ–ˆβ–Œ | 46/130 [00:13<00:45, 1.86it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 47/130 [00:14<00:43, 1.91it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 48/130 [00:14<00:40, 2.00it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 38%|β–ˆβ–ˆβ–ˆβ–Š | 49/130 [00:15<00:46, 1.74it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 38%|β–ˆοΏ½[2024-08-03 12:52:10] [Rank 3] totoal_tokens=10075, outputs='Xiao Li'
[2024-08-03 12:52:10] [Rank 1] totoal_tokens=10495, outputs='DeAndre Ayton'
[2024-08-03 12:52:10] [Rank 0] totoal_tokens=10287, outputs='Work'
[2024-08-03 12:52:10] [Rank 2] totoal_tokens=9737, outputs='Coca-Cola'
[2024-08-03 12:52:10] [Rank 1] totoal_tokens=10763, outputs='Dessert'
[2024-08-03 12:52:10] [Rank 3] totoal_tokens=10248, outputs='Dr. Li'
[2024-08-03 12:52:10] [Rank 2] totoal_tokens=10211, outputs='Science'
[2024-08-03 12:52:11] [Rank 0] totoal_tokens=10320, outputs='Headphones'
[2024-08-03 12:52:11] [Rank 1] totoal_tokens=11243, outputs='London'
[2024-08-03 12:52:11] [Rank 3] totoal_tokens=11131, outputs='Mr. Li'
[2024-08-03 12:52:11] [Rank 2] totoal_tokens=10782, outputs='Xiao Zhang'
[2024-08-03 12:52:11] [Rank 1] totoal_tokens=11643, outputs='The student goes home.'
[2024-08-03 12:52:12] [Rank 3] totoal_tokens=11151, outputs='Xiao Li'
[2024-08-03 12:52:12] [Rank 2] totoal_tokens=11120, outputs='Xiao Zhang'
[2024-08-03 12:52:12] [Rank 0] totoal_tokens=10512, outputs='Lemon'
[2024-08-03 12:52:12] [Rank 2] totoal_tokens=11209, outputs='Cucumber'
[2024-08-03 12:52:12] [Rank 1] totoal_tokens=12166, outputs='Xiaowen'
[2024-08-03 12:52:12] [Rank 0] totoal_tokens=10758, outputs='Red'
[2024-08-03 12:52:13] [Rank 3] totoal_tokens=12007, outputs='Burlington'
[2024-08-03 12:52:13] [Rank 2] totoal_tokens=11259, outputs='Triple Triad Cards'
[2024-08-03 12:52:13] [Rank 1] totoal_tokens=12829, outputs='Xiaowen'
[2024-08-03 12:52:13] [Rank 0] totoal_tokens=11153, outputs='Xiaoqiang'
[2024-08-03 12:52:13] [Rank 3] totoal_tokens=12176, outputs='Wired'
[2024-08-03 12:52:13] [Rank 2] totoal_tokens=11275, outputs='Cucumbers'
[2024-08-03 12:52:14] [Rank 0] totoal_tokens=11333, outputs='Red'
[2024-08-03 12:52:14] [Rank 1] totoal_tokens=12884, outputs='Xiao Zhang'
[2024-08-03 12:52:14] [Rank 2] totoal_tokens=11448, outputs='car'
[2024-08-03 12:52:14] [Rank 3] totoal_tokens=12811, outputs='mashed potato and rehydrated pasta'
[2024-08-03 12:52:14] [Rank 0] totoal_tokens=11893, outputs='Johns Hopkins University'
[2024-08-03 12:52:15] [Rank 1] totoal_tokens=13024, outputs='Adobe'
[2024-08-03 12:52:15] [Rank 3] totoal_tokens=13013, outputs='Mr. Zhang'
[2024-08-03 12:52:15] [Rank 2] totoal_tokens=12361, outputs='Dr. Dorothea Jenkins'
[2024-08-03 12:52:15] [Rank 0] totoal_tokens=12412, outputs='Xiao Li'
[2024-08-03 12:52:15] [Rank 1] totoal_tokens=13112, outputs='Finish homework'
[2024-08-03 12:52:16] [Rank 3] totoal_tokens=13098, outputs='Audi Q4 e-tron'
[2024-08-03 12:52:16] [Rank 2] totoal_tokens=12707, outputs='Go to the beach'
[2024-08-03 12:52:16] [Rank 0] totoal_tokens=12413, outputs='Xiaoming'
[2024-08-03 12:52:16] [Rank 1] totoal_tokens=13575, outputs='Dr. Li'
[2024-08-03 12:52:16] [Rank 3] totoal_tokens=13114, outputs='Daniel'
[2024-08-03 12:52:16] [Rank 2] totoal_tokens=12757, outputs='Xiaowen'
[2024-08-03 12:52:17] [Rank 0] totoal_tokens=13436, outputs='Xiaoqiang'
οΏ½οΏ½β–ˆβ–Š | 50/130 [00:16<00:47, 1.70it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 39%|β–ˆβ–ˆβ–ˆβ–‰ | 51/130 [00:16<00:44, 1.79it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 52/130 [00:17<00:44, 1.75it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 53/130 [00:18<01:01, 1.25it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 54/130 [00:19<00:54, 1.41it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 55/130 [00:19<00:52, 1.43it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 56/130 [00:20<00:52, 1.41it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 57/130 [00:21<00:50, 1.44it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 58/130 [00:21<00:51, 1.39it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 59/130 [00:22<00:50, 1.42it/s] P[2024-08-03 12:52:17] [Rank 1] totoal_tokens=13802, outputs='Cucumber'
[2024-08-03 12:52:17] [Rank 3] totoal_tokens=13380, outputs='Mary'
[2024-08-03 12:52:17] [Rank 2] totoal_tokens=12768, outputs='Xiaohong'
[2024-08-03 12:52:18] [Rank 0] totoal_tokens=13807, outputs='Yoshi'
[2024-08-03 12:52:18] [Rank 3] totoal_tokens=13522, outputs='Xiao Zhang'
[2024-08-03 12:52:18] [Rank 2] totoal_tokens=13372, outputs='Red'
[2024-08-03 12:52:18] [Rank 1] totoal_tokens=14142, outputs='Appetizer'
[2024-08-03 12:52:19] [Rank 3] totoal_tokens=13947, outputs='apple'
[2024-08-03 12:52:19] [Rank 0] totoal_tokens=13956, outputs='The Justice Center was built'
[2024-08-03 12:52:19] [Rank 1] totoal_tokens=14309, outputs='Workshop'
[2024-08-03 12:52:19] [Rank 2] totoal_tokens=13579, outputs='First Draft'
[2024-08-03 12:52:20] [Rank 0] totoal_tokens=13968, outputs='Tea'
[2024-08-03 12:52:20] [Rank 3] totoal_tokens=14462, outputs='Xiaoqiang'
[2024-08-03 12:52:20] [Rank 1] totoal_tokens=14573, outputs='Johns Hopkins University'
[2024-08-03 12:52:20] [Rank 2] totoal_tokens=14457, outputs='Coca-Cola'
[2024-08-03 12:52:20] [Rank 3] totoal_tokens=15314, outputs='Berlin'
[2024-08-03 12:52:20] [Rank 0] totoal_tokens=15114, outputs='red'
[2024-08-03 12:52:21] [Rank 2] totoal_tokens=14580, outputs='Kiwi'
[2024-08-03 12:52:21] [Rank 1] totoal_tokens=14850, outputs='Who publishes their research first?'
[2024-08-03 12:52:21] [Rank 3] totoal_tokens=15357, outputs='Coca-Cola'
[2024-08-03 12:52:21] [Rank 0] totoal_tokens=15366, outputs='Nail plate'
[2024-08-03 12:52:22] [Rank 2] totoal_tokens=14614, outputs='Xiaoqiang'
[2024-08-03 12:52:22] [Rank 1] totoal_tokens=15025, outputs='Paris'
[2024-08-03 12:52:22] [Rank 3] totoal_tokens=16115, outputs='Alice'
[2024-08-03 12:52:22] [Rank 0] totoal_tokens=15367, outputs='Xiao Zhang'
[2024-08-03 12:52:23] [Rank 2] totoal_tokens=14673, outputs='The final answer is CTE.'
[2024-08-03 12:52:23] [Rank 1] totoal_tokens=15097, outputs='Tram'
[2024-08-03 12:52:23] [Rank 3] totoal_tokens=16124, outputs='Go home'
[2024-08-03 12:52:23] [Rank 0] totoal_tokens=16535, outputs='Sarah'
[2024-08-03 12:52:23] [Rank 2] totoal_tokens=15179, outputs='Xiaoqiang'
[2024-08-03 12:52:24] [Rank 1] totoal_tokens=15209, outputs='Xiao Wang'
[2024-08-03 12:52:24] [Rank 0] totoal_tokens=16633, outputs='Coca-Cola'
[2024-08-03 12:52:24] [Rank 3] totoal_tokens=16125, outputs='Ziyad Almaayouf'
[2024-08-03 12:52:24] [Rank 2] totoal_tokens=15682, outputs='Xiao Wang'
[2024-08-03 12:52:25] [Rank 2] totoal_tokens=15913, outputs='Mr. Li'
[2024-08-03 12:52:25] [Rank 0] totoal_tokens=17180, outputs='Guy Bushnell'
rocessing InternVL2-2B_reasoning-text-val.jsonl: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 60/130 [00:23<00:57, 1.21it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 61/130 [00:24<00:57, 1.20it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 62/130 [00:25<00:59, 1.14it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 63/130 [00:26<00:55, 1.20it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 64/130 [00:27<00:55, 1.20it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 65/130 [00:27<00:54, 1.19it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 66/130 [00:29<01:00, 1.07it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 67/130 [00:29<00:56, 1.12it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 68/130 [00:30<00:56, 1.09it/s] Processing InternVL2-2B_reasoning-text-v[2024-08-03 12:52:25] [Rank 1] totoal_tokens=15569, outputs='fries'
[2024-08-03 12:52:26] [Rank 3] totoal_tokens=17505, outputs='He finishes homework'
[2024-08-03 12:52:26] [Rank 2] totoal_tokens=16089, outputs='Xiaoqiang'
[2024-08-03 12:52:26] [Rank 0] totoal_tokens=17756, outputs='Charlie'
[2024-08-03 12:52:26] [Rank 1] totoal_tokens=16393, outputs='There is a movie screening.'
[2024-08-03 12:52:27] [Rank 3] totoal_tokens=17665, outputs='Xiaoqiang'
[2024-08-03 12:52:29] [Rank 0] totoal_tokens=19285, outputs='Ozayr Saloojee'
[2024-08-03 12:52:29] [Rank 1] totoal_tokens=16948, outputs='Xiaowen'
[2024-08-03 12:52:29] [Rank 2] totoal_tokens=18080, outputs='Cucumbers'
[2024-08-03 12:52:29] [Rank 3] totoal_tokens=18081, outputs='The student finishes homework after coming home.'
[2024-08-03 12:52:30] [Rank 1] totoal_tokens=17044, outputs='banana'
[2024-08-03 12:52:30] [Rank 2] totoal_tokens=18329, outputs='Berlin'
[2024-08-03 12:52:30] [Rank 0] totoal_tokens=19341, outputs='The car'
[2024-08-03 12:52:30] [Rank 3] totoal_tokens=18082, outputs='Xiao Li'
[2024-08-03 12:52:31] [Rank 1] totoal_tokens=18188, outputs='Apple iPhone 12'
[2024-08-03 12:52:31] [Rank 2] totoal_tokens=18331, outputs='Xiaoqiang'
[2024-08-03 12:52:31] [Rank 0] totoal_tokens=20109, outputs='Xiao Zhang'
[2024-08-03 12:52:32] [Rank 3] totoal_tokens=19708, outputs='Mr. Li'
[2024-08-03 12:52:32] [Rank 1] totoal_tokens=19709, outputs='Xiao Wang'
[2024-08-03 12:52:33] [Rank 0] totoal_tokens=20195, outputs='Chris Davis'
[2024-08-03 12:52:33] [Rank 2] totoal_tokens=20296, outputs="The Backyard Scientist's sword"
[2024-08-03 12:52:34] [Rank 3] totoal_tokens=20180, outputs='Diet Coke'
[2024-08-03 12:52:34] [Rank 1] totoal_tokens=19938, outputs='London'
[2024-08-03 12:52:34] [Rank 0] totoal_tokens=20218, outputs='Cucumbers'
[2024-08-03 12:52:34] [Rank 2] totoal_tokens=20422, outputs='Jonathan Joseph'
[2024-08-03 12:52:35] [Rank 3] totoal_tokens=20297, outputs='Mr. Li'
[2024-08-03 12:52:35] [Rank 0] totoal_tokens=20678, outputs='Push'
[2024-08-03 12:52:35] [Rank 2] totoal_tokens=21676, outputs='Lamp'
[2024-08-03 12:52:35] [Rank 1] totoal_tokens=20680, outputs='The Gherkin'
[2024-08-03 12:52:36] [Rank 0] totoal_tokens=20719, outputs='Dessert'
[2024-08-03 12:52:37] [Rank 1] totoal_tokens=20897, outputs='Dustin Behlmann'
[2024-08-03 12:52:37] [Rank 3] totoal_tokens=21036, outputs='Lighthouse Ventures'
[2024-08-03 12:52:37] [Rank 2] totoal_tokens=22079, outputs='The cast of Jersey Shore is shown on the screen.'
[2024-08-03 12:52:38] [Rank 1] totoal_tokens=21203, outputs='Daniel'
[2024-08-03 12:52:38] [Rank 3] totoal_tokens=21258, outputs='Xiaoqiang'
[2024-08-03 12:52:38] [Rank 2] totoal_tokens=22403, outputs='Coca-Cola'
[2024-08-03 12:52:38] [Rank 0] totoal_tokens=22179, outputs='Micor Defense Leader 50'
al.jsonl: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 69/130 [00:32<01:00, 1.01it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 70/130 [00:33<00:59, 1.01it/s] Processing InternVL2-2B_reasoning-text-val.jsonl: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 71/130 [00:35<01:24, 1.43s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 72/130 [00:36<01:18, 1.35s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 73/130 [00:38<01:19, 1.40s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 74/130 [00:39<01:14, 1.33s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 75/130 [00:40<01:10, 1.29s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 76/130 [00:41<01:11, 1.32s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 77/130 [00:43<01:07, 1.27s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 60%|β–ˆβ–ˆβ–ˆοΏ½[2024-08-03 12:52:39] [Rank 1] totoal_tokens=22721, outputs='Bob'
[2024-08-03 12:52:39] [Rank 3] totoal_tokens=23477, outputs='London'
[2024-08-03 12:52:39] [Rank 2] totoal_tokens=23119, outputs='Xiao Li'
[2024-08-03 12:52:39] [Rank 0] totoal_tokens=23112, outputs='Jeff Duncanson'
[2024-08-03 12:52:40] [Rank 1] totoal_tokens=23474, outputs='Xiaoming'
[2024-08-03 12:52:41] [Rank 2] totoal_tokens=23683, outputs='Tulip'
[2024-08-03 12:52:41] [Rank 3] totoal_tokens=24116, outputs='Charlie'
[2024-08-03 12:52:41] [Rank 0] totoal_tokens=24395, outputs='She finishes homework'
[2024-08-03 12:52:42] [Rank 1] totoal_tokens=24249, outputs='Billy'
[2024-08-03 12:52:42] [Rank 3] totoal_tokens=24255, outputs='Sarah'
[2024-08-03 12:52:42] [Rank 2] totoal_tokens=24334, outputs='Jim'
[2024-08-03 12:52:43] [Rank 0] totoal_tokens=24616, outputs='Danvers'
[2024-08-03 12:52:43] [Rank 1] totoal_tokens=24285, outputs='Alice'
[2024-08-03 12:52:43] [Rank 2] totoal_tokens=24550, outputs='Tomato'
[2024-08-03 12:52:44] [Rank 3] totoal_tokens=24419, outputs='The Star'
[2024-08-03 12:52:44] [Rank 0] totoal_tokens=25315, outputs='Dessert'
[2024-08-03 12:52:45] [Rank 1] totoal_tokens=25721, outputs='David'
[2024-08-03 12:52:45] [Rank 2] totoal_tokens=25616, outputs='Kim Kardashian'
[2024-08-03 12:52:45] [Rank 0] totoal_tokens=25624, outputs='Alexa'
[2024-08-03 12:52:46] [Rank 3] totoal_tokens=24497, outputs='pen'
[2024-08-03 12:52:46] [Rank 2] totoal_tokens=26255, outputs='car'
[2024-08-03 12:52:47] [Rank 1] totoal_tokens=26058, outputs='Markus'
[2024-08-03 12:52:47] [Rank 3] totoal_tokens=24877, outputs='Karynne'
[2024-08-03 12:52:47] [Rank 0] totoal_tokens=25823, outputs='The Brave Little Tailor'
[2024-08-03 12:52:49] [Rank 0] totoal_tokens=26073, outputs='Xiaoqiang'
[2024-08-03 12:52:49] [Rank 3] totoal_tokens=26176, outputs='Dessert'
[2024-08-03 12:52:49] [Rank 1] totoal_tokens=26344, outputs='Lee Kwang Soo'
[2024-08-03 12:52:49] [Rank 2] totoal_tokens=26698, outputs='Zach'
[2024-08-03 12:52:51] [Rank 1] totoal_tokens=27044, outputs='Xiao Zhang'
[2024-08-03 12:52:51] [Rank 3] totoal_tokens=27185, outputs='Wang'
[2024-08-03 12:52:51] [Rank 0] totoal_tokens=27292, outputs='The Ever Given is being moved'
[2024-08-03 12:52:52] [Rank 2] totoal_tokens=27815, outputs='Jerusalem'
[2024-08-03 12:52:52] [Rank 1] totoal_tokens=27228, outputs='Peter'
[2024-08-03 12:52:53] [Rank 3] totoal_tokens=27295, outputs='The car is the slowest.'
[2024-08-03 12:52:53] [Rank 0] totoal_tokens=27509, outputs='The Women Who Dared'
οΏ½οΏ½β–ˆβ–ˆ | 78/130 [00:44<01:14, 1.43s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 79/130 [00:46<01:10, 1.39s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 80/130 [00:47<01:14, 1.48s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 81/130 [00:49<01:11, 1.46s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 82/130 [00:50<01:11, 1.49s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 83/130 [00:52<01:07, 1.45s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 84/130 [00:53<01:10, 1.52s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 85/130 [00:55<01:08, 1.51s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 86/130 [00:57<01:21, 1.85s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹[2024-08-03 12:52:54] [Rank 2] totoal_tokens=28141, outputs='Dan'
[2024-08-03 12:52:54] [Rank 1] totoal_tokens=28605, outputs='Peach'
[2024-08-03 12:52:54] [Rank 3] totoal_tokens=28061, outputs='Mary'
[2024-08-03 12:52:55] [Rank 0] totoal_tokens=28103, outputs='Mr. Zhang'
[2024-08-03 12:52:55] [Rank 2] totoal_tokens=30150, outputs='Ken Ham'
[2024-08-03 12:52:56] [Rank 3] totoal_tokens=30119, outputs='Kia'
[2024-08-03 12:52:56] [Rank 1] totoal_tokens=31048, outputs='Gaytheist'
[2024-08-03 12:52:57] [Rank 0] totoal_tokens=32071, outputs='White'
[2024-08-03 12:52:57] [Rank 2] totoal_tokens=30227, outputs='Dice'
[2024-08-03 12:52:59] [Rank 1] totoal_tokens=31246, outputs='Jason Fraser'
[2024-08-03 12:52:59] [Rank 2] totoal_tokens=30537, outputs='Go to the library'
[2024-08-03 12:52:59] [Rank 0] totoal_tokens=33210, outputs='The MG4 EV'
[2024-08-03 12:53:00] [Rank 3] totoal_tokens=31007, outputs='Mr. Li'
[2024-08-03 12:53:01] [Rank 2] totoal_tokens=33116, outputs='Plan International Australia'
[2024-08-03 12:53:01] [Rank 0] totoal_tokens=36065, outputs='The traveler visited Sydney first.'
[2024-08-03 12:53:02] [Rank 3] totoal_tokens=31061, outputs='The camera'
[2024-08-03 12:53:02] [Rank 1] totoal_tokens=32091, outputs='A Portrait of a Lifeartist'
[2024-08-03 12:53:03] [Rank 2] totoal_tokens=33210, outputs='The most expensive item is the 2012 film "Woman in Gold."'
[2024-08-03 12:53:04] [Rank 0] totoal_tokens=37483, outputs='Djy Ross'
[2024-08-03 12:53:05] [Rank 1] totoal_tokens=32208, outputs='pen'
[2024-08-03 12:53:05] [Rank 3] totoal_tokens=31118, outputs='Headphones'
[2024-08-03 12:53:06] [Rank 2] totoal_tokens=35104, outputs='lamp'
[2024-08-03 12:53:07] [Rank 3] totoal_tokens=32071, outputs='C4 Engine World'
[2024-08-03 12:53:08] [Rank 1] totoal_tokens=33596, outputs='Neel Jani'
[2024-08-03 12:53:08] [Rank 0] totoal_tokens=37847, outputs='Share the Road license plate'
[2024-08-03 12:53:10] [Rank 2] totoal_tokens=35533, outputs='bicycle'
[2024-08-03 12:53:10] [Rank 1] totoal_tokens=35105, outputs='The journal Nature'
[2024-08-03 12:53:10] [Rank 3] totoal_tokens=33166, outputs='The student goes home.'
[2024-08-03 12:53:11] [Rank 0] totoal_tokens=37949, outputs='MaryJanesFarm'
[2024-08-03 12:53:12] [Rank 2] totoal_tokens=35907, outputs='Tomato'
[2024-08-03 12:53:12] [Rank 1] totoal_tokens=35121, outputs='The Overwatch Summer Games event'
[2024-08-03 12:53:12] [Rank 3] totoal_tokens=33874, outputs='Coca-Cola'
[2024-08-03 12:53:13] [Rank 0] totoal_tokens=38189, outputs='Mr. Wang'
[2024-08-03 12:53:14] [Rank 2] totoal_tokens=36804, outputs='Xiao Li'
[2024-08-03 12:53:14] [Rank 3] totoal_tokens=34484, outputs='Nymphs'
[2024-08-03 12:53:15] [Rank 1] totoal_tokens=35190, outputs='Johns Hopkins University'
[2024-08-03 12:53:15] [Rank 0] totoal_tokens=38691, outputs='Cucumber'
 | 87/130 [00:59<01:19, 1.85s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 88/130 [01:01<01:14, 1.79s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 89/130 [01:03<01:13, 1.79s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 90/130 [01:05<01:22, 2.07s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 91/130 [01:08<01:20, 2.06s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 92/130 [01:10<01:19, 2.09s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 93/130 [01:14<01:46, 2.88s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 94/130 [01:17<01:37, 2.70s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 95/130 [01:19<01:34, 2.70s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆοΏ½[2024-08-03 12:53:16] [Rank 2] totoal_tokens=37030, outputs='Coca-Cola'
[2024-08-03 12:53:16] [Rank 3] totoal_tokens=36944, outputs='Perry'
[2024-08-03 12:53:17] [Rank 1] totoal_tokens=36768, outputs='Jesus'
[2024-08-03 12:53:18] [Rank 0] totoal_tokens=38927, outputs='Alex'
[2024-08-03 12:53:18] [Rank 2] totoal_tokens=37324, outputs='Corn'
[2024-08-03 12:53:19] [Rank 3] totoal_tokens=38225, outputs='Jay Chou'
[2024-08-03 12:53:20] [Rank 1] totoal_tokens=37043, outputs='Ben'
[2024-08-03 12:53:20] [Rank 0] totoal_tokens=39207, outputs='Read'
[2024-08-03 12:53:21] [Rank 2] totoal_tokens=38694, outputs='Lunch'
[2024-08-03 12:53:21] [Rank 3] totoal_tokens=38525, outputs='The car.'
[2024-08-03 12:53:23] [Rank 1] totoal_tokens=38425, outputs='Grilled meat'
[2024-08-03 12:53:24] [Rank 2] totoal_tokens=40421, outputs='Johns Hopkins University'
[2024-08-03 12:53:24] [Rank 3] totoal_tokens=38860, outputs='The winner'
[2024-08-03 12:53:24] [Rank 0] totoal_tokens=40089, outputs='Javazen Road Crew'
[2024-08-03 12:53:26] [Rank 1] totoal_tokens=40175, outputs='Red'
[2024-08-03 12:53:26] [Rank 2] totoal_tokens=41809, outputs='Wiley'
[2024-08-03 12:53:26] [Rank 3] totoal_tokens=40249, outputs='Xiaoqiang'
[2024-08-03 12:53:27] [Rank 0] totoal_tokens=40487, outputs='Science Daily'
[2024-08-03 12:53:29] [Rank 1] totoal_tokens=41585, outputs='Paul Trodd'
[2024-08-03 12:53:29] [Rank 2] totoal_tokens=43032, outputs='San Francisco'
[2024-08-03 12:53:29] [Rank 0] totoal_tokens=42751, outputs='Paris'
[2024-08-03 12:53:30] [Rank 3] totoal_tokens=42247, outputs='Lantus'
[2024-08-03 12:53:32] [Rank 1] totoal_tokens=43096, outputs='Grapeland Sandiettes'
[2024-08-03 12:53:33] [Rank 2] totoal_tokens=46134, outputs="The Earth's magnetic field"
[2024-08-03 12:53:34] [Rank 3] totoal_tokens=43571, outputs='The car that is the slowest is the 1970s Ford Mustang.'
[2024-08-03 12:53:34] [Rank 0] totoal_tokens=44977, outputs='Xiao Zhang'
[2024-08-03 12:53:36] [Rank 2] totoal_tokens=47550, outputs='Dr. Wang'
[2024-08-03 12:53:36] [Rank 1] totoal_tokens=46442, outputs='Red'
[2024-08-03 12:53:37] [Rank 0] totoal_tokens=45956, outputs='Jamun Honey'
[2024-08-03 12:53:37] [Rank 3] totoal_tokens=43690, outputs='Tomato'
[2024-08-03 12:53:39] [Rank 2] totoal_tokens=48238, outputs='Siska'
[2024-08-03 12:53:39] [Rank 1] totoal_tokens=47299, outputs='Xiaohong'
[2024-08-03 12:53:40] [Rank 3] totoal_tokens=43854, outputs='I am teaching more women’s self defense classes.'
[2024-08-03 12:53:41] [Rank 0] totoal_tokens=47402, outputs='Julie Cline'
[2024-08-03 12:53:42] [Rank 2] totoal_tokens=48744, outputs='Xiao Wang'
[2024-08-03 12:53:43] [Rank 1] totoal_tokens=47608, outputs='Mining'
[2024-08-03 12:53:43] [Rank 3] totoal_tokens=49608, outputs='Eddie Howe'
[2024-08-03 12:53:44] [Rank 0] totoal_tokens=48593, outputs='The water is flowing in the river.'
οΏ½οΏ½ | 96/130 [01:22<01:26, 2.55s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 97/130 [01:24<01:21, 2.47s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 98/130 [01:26<01:19, 2.50s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 99/130 [01:30<01:28, 2.84s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 100/130 [01:33<01:24, 2.81s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 101/130 [01:36<01:21, 2.80s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 102/130 [01:40<01:32, 3.29s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 103/130 [01:43<01:25, 3.16s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 104/130 [01:47<01:30, 3.49s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 81%|β–ˆβ–ˆ[2024-08-03 12:53:45] [Rank 2] totoal_tokens=49006, outputs='DIPOL'
[2024-08-03 12:53:46] [Rank 1] totoal_tokens=47736, outputs='Lunch'
[2024-08-03 12:53:48] [Rank 0] totoal_tokens=48985, outputs='Red'
[2024-08-03 12:53:48] [Rank 2] totoal_tokens=49387, outputs='Tony McLean'
[2024-08-03 12:53:50] [Rank 3] totoal_tokens=50906, outputs='Ferran Garcia-Pichel'
[2024-08-03 12:53:51] [Rank 1] totoal_tokens=50151, outputs='Red'
[2024-08-03 12:53:52] [Rank 0] totoal_tokens=50327, outputs='@Bobette'
[2024-08-03 12:53:52] [Rank 2] totoal_tokens=49472, outputs='Jonah'
[2024-08-03 12:53:54] [Rank 3] totoal_tokens=52804, outputs='Toyota Prius'
[2024-08-03 12:53:54] [Rank 1] totoal_tokens=50686, outputs='Xiao Zhang'
[2024-08-03 12:53:55] [Rank 0] totoal_tokens=51494, outputs='Ellen Hyatt and Mary Sue Sanderson'
[2024-08-03 12:53:57] [Rank 2] totoal_tokens=51192, outputs='David'
[2024-08-03 12:53:57] [Rank 3] totoal_tokens=52877, outputs='Good Morning America'
[2024-08-03 12:53:57] [Rank 1] totoal_tokens=51082, outputs='Get a book'
[2024-08-03 12:54:00] [Rank 0] totoal_tokens=52005, outputs='The car'
[2024-08-03 12:54:00] [Rank 2] totoal_tokens=51414, outputs='JNS'
[2024-08-03 12:54:01] [Rank 3] totoal_tokens=53223, outputs='The car with the slowest speed is the Tesla Model S.'
[2024-08-03 12:54:02] [Rank 1] totoal_tokens=52234, outputs='Gary'
[2024-08-03 12:54:03] [Rank 0] totoal_tokens=52067, outputs='Stereophonics'
[2024-08-03 12:54:04] [Rank 2] totoal_tokens=55809, outputs='Jerusalem'
[2024-08-03 12:54:05] [Rank 1] totoal_tokens=52360, outputs='Xiao Wang'
[2024-08-03 12:54:06] [Rank 3] totoal_tokens=54852, outputs='Mary'
[2024-08-03 12:54:06] [Rank 0] totoal_tokens=52215, outputs='Go to the library'
[2024-08-03 12:54:09] [Rank 1] totoal_tokens=56477, outputs='Hopsie'
[2024-08-03 12:54:09] [Rank 2] totoal_tokens=58291, outputs='Amanda Owen'
[2024-08-03 12:54:09] [Rank 3] totoal_tokens=54881, outputs='Appetizer'
[2024-08-03 12:54:11] [Rank 0] totoal_tokens=54187, outputs='Salad'
[2024-08-03 12:54:13] [Rank 2] totoal_tokens=58688, outputs='Red'
[2024-08-03 12:54:13] [Rank 1] totoal_tokens=56611, outputs='Buck'
[2024-08-03 12:54:14] [Rank 3] totoal_tokens=56617, outputs='Tequila'
[2024-08-03 12:54:15] [Rank 0] totoal_tokens=54490, outputs='Doo'
[2024-08-03 12:54:17] [Rank 2] totoal_tokens=59191, outputs='Tequila'
[2024-08-03 12:54:17] [Rank 1] totoal_tokens=60042, outputs='Black'
[2024-08-03 12:54:18] [Rank 3] totoal_tokens=58280, outputs='Paris'
[2024-08-03 12:54:20] [Rank 0] totoal_tokens=61132, outputs='Alexander Durtka'
β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 105/130 [01:51<01:26, 3.45s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 106/130 [01:55<01:27, 3.63s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 107/130 [01:58<01:20, 3.51s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 108/130 [02:01<01:17, 3.51s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 109/130 [02:06<01:19, 3.79s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 110/130 [02:09<01:14, 3.70s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 111/130 [02:13<01:08, 3.61s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 112/130 [02:17<01:10, 3.89s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 113/130 [02:21<01:06, 3.89s/it] Processing InternVL2-2B_r[2024-08-03 12:54:22] [Rank 1] totoal_tokens=61627, outputs='London'
[2024-08-03 12:54:23] [Rank 3] totoal_tokens=58941, outputs='Cucumber'
[2024-08-03 12:54:23] [Rank 2] totoal_tokens=60057, outputs='The 4th of July'
[2024-08-03 12:54:26] [Rank 0] totoal_tokens=61769, outputs='Read'
[2024-08-03 12:54:27] [Rank 1] totoal_tokens=63725, outputs='Pink'
[2024-08-03 12:54:27] [Rank 2] totoal_tokens=60120, outputs='Mr. Wang'
[2024-08-03 12:54:27] [Rank 3] totoal_tokens=60764, outputs='Bolsover Cruise Club'
[2024-08-03 12:54:30] [Rank 0] totoal_tokens=62105, outputs='rice'
[2024-08-03 12:54:32] [Rank 2] totoal_tokens=60223, outputs='The event is scheduled at 11:30 AM.'
[2024-08-03 12:54:32] [Rank 1] totoal_tokens=63979, outputs='Koutsounari'
[2024-08-03 12:54:33] [Rank 3] totoal_tokens=60920, outputs='New York'
[2024-08-03 12:54:36] [Rank 0] totoal_tokens=64286, outputs='Bob'
[2024-08-03 12:54:36] [Rank 1] totoal_tokens=64879, outputs='Red'
[2024-08-03 12:54:38] [Rank 2] totoal_tokens=63994, outputs='Amy Ambulette'
[2024-08-03 12:54:38] [Rank 3] totoal_tokens=62505, outputs='Lovelyz’s lightstick comes in an adorable baby pink color'
[2024-08-03 12:54:40] [Rank 0] totoal_tokens=64389, outputs='I am a student.'
[2024-08-03 12:54:42] [Rank 1] totoal_tokens=65754, outputs='Oiji muchim'
[2024-08-03 12:54:42] [Rank 2] totoal_tokens=64690, outputs='Coca-Cola'
[2024-08-03 12:54:44] [Rank 3] totoal_tokens=63167, outputs='Louisiana'
[2024-08-03 12:54:45] [Rank 0] totoal_tokens=64748, outputs='The course is served after the main course.'
[2024-08-03 12:54:47] [Rank 1] totoal_tokens=65931, outputs='I'
[2024-08-03 12:54:49] [Rank 2] totoal_tokens=65219, outputs='The course served last.'
[2024-08-03 12:54:49] [Rank 3] totoal_tokens=66152, outputs='Tomato'
[2024-08-03 12:54:50] [Rank 0] totoal_tokens=65324, outputs='City of Light'
[2024-08-03 12:54:53] [Rank 1] totoal_tokens=68763, outputs='CNN MoneyStream'
[2024-08-03 12:54:53] [Rank 2] totoal_tokens=65428, outputs='apple'
[2024-08-03 12:54:54] [Rank 3] totoal_tokens=66300, outputs='Glen'
[2024-08-03 12:54:56] [Rank 0] totoal_tokens=65811, outputs='Costel Pantilimon'
[2024-08-03 12:54:58] [Rank 1] totoal_tokens=70517, outputs='red'
[2024-08-03 12:55:00] [Rank 3] totoal_tokens=69642, outputs='The T-Rex'
[2024-08-03 12:55:01] [Rank 2] totoal_tokens=69202, outputs='Thomas McGuirk'
[2024-08-03 12:55:01] [Rank 0] totoal_tokens=66201, outputs='Coca-Cola'
easoning-text-val.jsonl: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 114/130 [02:27<01:09, 4.36s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 115/130 [02:32<01:11, 4.77s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 116/130 [02:36<01:03, 4.56s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 117/130 [02:42<01:03, 4.92s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 118/130 [02:46<00:56, 4.74s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 119/130 [02:51<00:51, 4.70s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 120/130 [02:57<00:49, 4.99s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 121/130 [03:02<00:46, 5.21s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 122/130 [03:[2024-08-03 12:55:05] [Rank 1] totoal_tokens=71908, outputs='Jenna Fischer'
[2024-08-03 12:55:06] [Rank 2] totoal_tokens=70838, outputs='Xiao Li'
[2024-08-03 12:55:07] [Rank 0] totoal_tokens=66997, outputs='The Prime Minister'
[2024-08-03 12:55:07] [Rank 3] totoal_tokens=71319, outputs='Banana'
[2024-08-03 12:55:11] [Rank 1] totoal_tokens=73388, outputs='Lewis Dunk'
[2024-08-03 12:55:11] [Rank 0] totoal_tokens=67206, outputs='Rick Volner'
[2024-08-03 12:55:12] [Rank 2] totoal_tokens=72063, outputs='White'
[2024-08-03 12:55:13] [Rank 3] totoal_tokens=72728, outputs='Jia Zhao'
[2024-08-03 12:55:17] [Rank 1] totoal_tokens=73618, outputs='Beowulf'
[2024-08-03 12:55:17] [Rank 0] totoal_tokens=72041, outputs='Hairstreak butterfly'
[2024-08-03 12:55:17] [Rank 2] totoal_tokens=74393, outputs='The student goes to the library.'
[2024-08-03 12:55:19] [Rank 3] totoal_tokens=72795, outputs='I am not sure'
[2024-08-03 12:55:23] [Rank 1] totoal_tokens=74115, outputs='Coconut'
[2024-08-03 12:55:25] [Rank 0] totoal_tokens=74062, outputs='dessert'
[2024-08-03 12:55:25] [Rank 2] totoal_tokens=75471, outputs='Yoon'
[2024-08-03 12:55:26] [Rank 3] totoal_tokens=72922, outputs='Dan Mitrofan'
[2024-08-03 12:55:29] [Rank 1] totoal_tokens=74801, outputs='Apple'
[2024-08-03 12:55:31] [Rank 0] totoal_tokens=74411, outputs='Apple'
[2024-08-03 12:55:32] [Rank 2] totoal_tokens=75529, outputs='Del Johnston'
[2024-08-03 12:55:32] [Rank 3] totoal_tokens=73958, outputs='Coca-Cola'
[2024-08-03 12:55:35] [Rank 1] totoal_tokens=75228, outputs='Damon Sharpe'
[2024-08-03 12:55:37] [Rank 2] totoal_tokens=77205, outputs='Catherine Gegout'
[2024-08-03 12:55:39] [Rank 0] totoal_tokens=74824, outputs='Dallas'
[2024-08-03 12:55:40] [Rank 3] totoal_tokens=75089, outputs='Brian Fenton'
[2024-08-03 12:55:41] [Rank 1] totoal_tokens=76362, outputs='Tomato'
[2024-08-03 12:55:44] [Rank 2] totoal_tokens=78990, outputs='Worship'
[2024-08-03 12:55:44] Rank 2 Finish
[2024-08-03 12:55:47] [Rank 0] totoal_tokens=78136, outputs='Red'
[2024-08-03 12:55:47] [Rank 3] totoal_tokens=76858, outputs='Jamie Theakston'
[Rank 1] OutOfMemoryError occurs! totoal_tokens=77877
[2024-08-03 12:55:47] [Rank 1] totoal_tokens=77877, outputs='None'
[2024-08-03 12:55:47] Rank 1 Finish
[2024-08-03 12:55:52] [Rank 3] totoal_tokens=77396, outputs='car'
[2024-08-03 12:55:53] [Rank 0] totoal_tokens=78493, outputs='New York'
07<00:40, 5.06s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 123/130 [03:13<00:37, 5.32s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 124/130 [03:18<00:30, 5.07s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 125/130 [03:23<00:26, 5.30s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 126/130 [03:31<00:24, 6.06s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 127/130 [03:38<00:18, 6.17s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 128/130 [03:46<00:13, 6.73s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 129/130 [03:53<00:06, 6.86s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 130/130 [04:00<00:00, 6.84s/it] Processing InternVL2-2B_reasoning-text-val.jsonl: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 130/130 [04:00<00:00, 1.85s/it]
[2024-08-03 12:55:53] Rank 0 Finish
[Rank 3] OutOfMemoryError occurs! totoal_tokens=79333
[2024-08-03 12:55:58] [Rank 3] totoal_tokens=79333, outputs='None'
[2024-08-03 12:55:58] Rank 3 Finish
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/temp_InternVL2-2B_reasoning-text-val/* > work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/InternVL2-2B_reasoning-text-val.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/temp_InternVL2-2B_reasoning-text-val/* > work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/InternVL2-2B_reasoning-text-val.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/temp_InternVL2-2B_reasoning-text-val/* > work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/InternVL2-2B_reasoning-text-val.jsonl
cat work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/temp_InternVL2-2B_reasoning-text-val/* > work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/InternVL2-2B_reasoning-text-val.jsonl
python eval/mm_niah/calculate_scores.py --outputs-dir work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val
python eval/mm_niah/calculate_scores.py --outputs-dir work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val
python eval/mm_niah/calculate_scores.py --outputs-dir work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val
python eval/mm_niah/calculate_scores.py --outputs-dir work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.
results on val split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/results/InternVL2-2B/scores_val.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.
results on val split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/results/InternVL2-2B/scores_val.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.
results on val split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/results/InternVL2-2B/scores_val.json
[Warning] Since len(res)=1 is not equal to 6, the overall score will be ignored. Please ensure that you correctly organize the directory structure.
results on val split of InternVL2-2B are save in work_dirs/share_internvl/InternVL2-2B/eval_mm_niah/reasoning-text-val/results/InternVL2-2B/scores_val.json