Hugging Face's logo

zooblastlbz
/
id-align

Safetensors
llama
Model card Files
xet
Community
id-align / eval /eval.out
zooblastlbz's picture
zooblastlbz
Upload folder using huggingface_hub
a9e1e1a verified
raw
history blame contribute delete
191 kB
 nohup: ignoring input
+ CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7
+ DATA_ROOT=/jizhicfs/bojoli
+ VISION_TOWER_NAME=clip-vit-large-patch14-336
+ MODEL_NAME=vicuna-7b-1.5
+ VISION_TOWER=/jizhicfs/bojoli/clip-vit-large-patch14-336
+ MODEL_PATH=/jizhicfs/bojoli/vicuna-7b-1.5
+ BASE_RUN_NAME=mmpe_vicuna-7b-1.5_clip-vit-large-patch14-336
+ RUN_NAME=final_mmpe_finetune_vicuna-7b-1.5_clip-vit-large-patch14-336
+ PROMPT_VERSION=v1
+ EVAL_MODEL=../checkpoints/final_mmpe_finetune_vicuna-7b-1.5_clip-vit-large-patch14-336
+ BENCHMARKS=mmbench_en
+ python3 -m accelerate.commands.launch --num_processes=8 --main_process_port 12899 -m lmms_eval --model llava --model_args pretrained=../checkpoints/final_mmpe_finetune_vicuna-7b-1.5_clip-vit-large-patch14-336,conv_template=v1 --tasks mmbench_en --batch_size 1 --log_samples --log_samples_suffix final_mmpe_finetune_vicuna-7b-1.5_clip-vit-large-patch14-336 --output_path ./logs/
The following values were not passed to `accelerate launch` and had defaults used instead:
More than one GPU was found, enabling multi-GPU training.
If this was unintended please pass in `--num_processes=1`.
`--num_machines` was set to a value of `1`
`--mixed_precision` was set to a value of `'no'`
`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.
2025-05-19 01:44:28.140 | INFO  | __main__:cli_evaluate:294 - Verbosity set to INFO
2025-05-19 01:44:28.206 | INFO  | __main__:cli_evaluate:294 - Verbosity set to INFO
2025-05-19 01:44:28.914 | INFO  | __main__:cli_evaluate:294 - Verbosity set to INFO
2025-05-19 01:44:28.916 | INFO  | __main__:cli_evaluate:294 - Verbosity set to INFO
2025-05-19 01:44:28.922 | INFO  | __main__:cli_evaluate:294 - Verbosity set to INFO
2025-05-19 01:44:28.923 | INFO  | __main__:cli_evaluate:294 - Verbosity set to INFO
2025-05-19 01:44:28.931 | INFO  | __main__:cli_evaluate:294 - Verbosity set to INFO
2025-05-19 01:44:28.941 | INFO  | __main__:cli_evaluate:294 - Verbosity set to INFO
Detected kernel version 5.4.119, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
2025-05-19 01:44:31.949 | INFO  | __main__:cli_evaluate_single:377 - Evaluation tracker args: {'output_path': './logs/'}
2025-05-19 01:44:31.950 | INFO  | __main__:cli_evaluate_single:466 - Selected Tasks: ['mmbench_en']
2025-05-19 01:44:31.955 | INFO  | lmms_eval.evaluator:simple_evaluate:155 - Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
2025-05-19 01:44:32.253 | INFO  | __main__:cli_evaluate_single:377 - Evaluation tracker args: {'output_path': './logs/'}
2025-05-19 01:44:32.253 | INFO  | __main__:cli_evaluate_single:466 - Selected Tasks: ['mmbench_en']
2025-05-19 01:44:32.260 | INFO  | lmms_eval.evaluator:simple_evaluate:155 - Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
2025-05-19 01:44:32.902 | INFO  | __main__:cli_evaluate_single:377 - Evaluation tracker args: {'output_path': './logs/'}
2025-05-19 01:44:32.902 | INFO  | __main__:cli_evaluate_single:466 - Selected Tasks: ['mmbench_en']
2025-05-19 01:44:32.907 | INFO  | lmms_eval.evaluator:simple_evaluate:155 - Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
2025-05-19 01:44:32.960 | INFO  | __main__:cli_evaluate_single:377 - Evaluation tracker args: {'output_path': './logs/'}
2025-05-19 01:44:32.960 | INFO  | __main__:cli_evaluate_single:466 - Selected Tasks: ['mmbench_en']
2025-05-19 01:44:32.964 | INFO  | __main__:cli_evaluate_single:377 - Evaluation tracker args: {'output_path': './logs/'}
2025-05-19 01:44:32.965 | INFO  | __main__:cli_evaluate_single:466 - Selected Tasks: ['mmbench_en']
2025-05-19 01:44:32.966 | INFO  | lmms_eval.evaluator:simple_evaluate:155 - Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
2025-05-19 01:44:32.969 | INFO  | __main__:cli_evaluate_single:377 - Evaluation tracker args: {'output_path': './logs/'}
2025-05-19 01:44:32.970 | INFO  | __main__:cli_evaluate_single:466 - Selected Tasks: ['mmbench_en']
2025-05-19 01:44:32.971 | INFO  | lmms_eval.evaluator:simple_evaluate:155 - Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
2025-05-19 01:44:32.972 | INFO  | __main__:cli_evaluate_single:377 - Evaluation tracker args: {'output_path': './logs/'}
2025-05-19 01:44:32.972 | INFO  | __main__:cli_evaluate_single:377 - Evaluation tracker args: {'output_path': './logs/'}
2025-05-19 01:44:32.973 | INFO  | __main__:cli_evaluate_single:466 - Selected Tasks: ['mmbench_en']
2025-05-19 01:44:32.973 | INFO  | __main__:cli_evaluate_single:466 - Selected Tasks: ['mmbench_en']
2025-05-19 01:44:32.977 | INFO  | lmms_eval.evaluator:simple_evaluate:155 - Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
2025-05-19 01:44:32.982 | INFO  | lmms_eval.evaluator:simple_evaluate:155 - Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
2025-05-19 01:44:32.982 | INFO  | lmms_eval.evaluator:simple_evaluate:155 - Setting random seed to 0 | Setting numpy seed to 1234 | Setting torch manual seed to 1234
You are using a model of type llama to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.
Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s]You are using a model of type llama to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.
Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s]Detected kernel version 5.4.119, which is below the recommended minimum of 5.5.0; this can cause the process to hang. It is recommended to upgrade the kernel to the minimum version or higher.
Rank 0: Loaded LLaVA model: ../checkpoints/final_mmpe_finetune_vicuna-7b-1.5_clip-vit-large-patch14-336
You are using a model of type llama to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.
You are using a model of type llama to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.
You are using a model of type llama to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.
You are using a model of type llama to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.
You are using a model of type llama to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.
Rank 0: Loading vision tower: /jizhicfs/bojoli/clip-vit-large-patch14-336
Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s]You are using a model of type llama to instantiate a model of type llava_llama. This is not supported for all configurations of models and can yield errors.
Loading checkpoint shards: 0%| | 0/3 [00:00<?, ?it/s] Loading checkpoint shards: 33%|███▎ | 1/3 [00:04<00:09, 4.86s/it] Loading checkpoint shards: 33%|███▎ | 1/3 [00:04<00:09, 4.87s/it] Loading checkpoint shards: 33%|███▎ | 1/3 [00:04<00:09, 4.96s/it] Loading checkpoint shards: 33%|███▎ | 1/3 [00:04<00:09, 4.91s/it] Loading checkpoint shards: 33%|███▎ | 1/3 [00:04<00:09, 4.95s/it] Loading checkpoint shards: 33%|███▎ | 1/3 [00:05<00:10, 5.02s/it] Loading checkpoint shards: 33%|███▎ | 1/3 [00:05<00:10, 5.19s/it] Loading checkpoint shards: 33%|███▎ | 1/3 [00:05<00:10, 5.01s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:09<00:04, 4.97s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:09<00:04, 4.93s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:10<00:05, 5.02s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:09<00:04, 5.00s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:10<00:05, 5.02s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:10<00:05, 5.10s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:10<00:05, 5.11s/it] Loading checkpoint shards: 67%|██████▋ | 2/3 [00:10<00:05, 5.13s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:14<00:00, 4.62s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:14<00:00, 4.70s/it]
[2025-05-19 01:45:00,372] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  async_io: please install the libaio-dev package with apt
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
 [WARNING]  using untested triton version (2.3.1), only 1.0.0 is known to be compatible
Loading checkpoint shards: 100%|██████████| 3/3 [00:14<00:00, 4.62s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:14<00:00, 4.70s/it]
[2025-05-19 01:45:01,621] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  async_io: please install the libaio-dev package with apt
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
2025-05-19 01:45:02.002 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_dev on rank 2...
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
 [WARNING]  using untested triton version (2.3.1), only 1.0.0 is known to be compatible
2025-05-19 01:45:03.150 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_dev on rank 6...
Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.11s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.08s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.10s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.06s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.13s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.10s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.15s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.13s/it]
Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.16s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.15s/it]
[2025-05-19 01:45:03,657] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-19 01:45:03,662] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-19 01:45:03,670] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Rank 0: Model Class: LlavaLlamaForCausalLM
[2025-05-19 01:45:03,857] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
[2025-05-19 01:45:03,970] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  async_io: please install the libaio-dev package with apt
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
 [WARNING]  async_io: please install the libaio-dev package with apt
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
 [WARNING]  async_io: please install the libaio-dev package with apt
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  async_io: please install the libaio-dev package with apt
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  async_io: please install the libaio-dev package with apt
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
 [WARNING]  using untested triton version (2.3.1), only 1.0.0 is known to be compatible
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
 [WARNING]  using untested triton version (2.3.1), only 1.0.0 is known to be compatible
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
 [WARNING]  using untested triton version (2.3.1), only 1.0.0 is known to be compatible
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
 [WARNING]  using untested triton version (2.3.1), only 1.0.0 is known to be compatible
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
 [WARNING]  using untested triton version (2.3.1), only 1.0.0 is known to be compatible
Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.11s/it] Loading checkpoint shards: 100%|██████████| 3/3 [00:15<00:00, 5.10s/it]
[2025-05-19 01:45:05,606] [INFO] [real_accelerator.py:203:get_accelerator] Setting ds_accelerator to cuda (auto detect)
0%| | 0/541 [00:00<?, ?it/s] 100%|██████████| 541/541 [00:00<00:00, 46768.59it/s]
 [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
 [WARNING]  async_io: please install the libaio-dev package with apt
 [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
 [WARNING]  Please specify the CUTLASS repo directory as environment variable $CUTLASS_PATH
2025-05-19 01:45:06.189 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_dev on rank 4...
2025-05-19 01:45:06.198 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_dev on rank 3...
2025-05-19 01:45:06.199 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_dev on rank 5...
2025-05-19 01:45:06.286 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_dev on rank 1...
2025-05-19 01:45:06.341 | INFO  | lmms_eval.models.llava:__init__:134 - Using 8 devices with data parallelism
2025-05-19 01:45:06.342 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_dev on rank 0...
 [WARNING]  sparse_attn requires a torch version >= 1.5 and < 2.0 but detected 2.3
 [WARNING]  using untested triton version (2.3.1), only 1.0.0 is known to be compatible
0%| | 0/541 [00:00<?, ?it/s] 100%|██████████| 541/541 [00:00<00:00, 47273.30it/s]
2025-05-19 01:45:07.288 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_dev on rank 7...
0%| | 0/541 [00:00<?, ?it/s] 100%|██████████| 541/541 [00:00<00:00, 46672.39it/s]
0%| | 0/541 [00:00<?, ?it/s] 0%| | 0/541 [00:00<?, ?it/s] 100%|██████████| 541/541 [00:00<00:00, 46311.38it/s]
100%|██████████| 541/541 [00:00<00:00, 47050.79it/s]
0%| | 0/541 [00:00<?, ?it/s] 100%|██████████| 541/541 [00:00<00:00, 46038.88it/s]
0%| | 0/542 [00:00<?, ?it/s] 100%|██████████| 542/542 [00:00<00:00, 47074.31it/s]
TENCENT64:79953:79953 [0] NCCL INFO Bootstrap : Using bond1:30.207.96.97<0>
TENCENT64:79953:79953 [0] NCCL INFO NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so), using internal implementation
TENCENT64:79953:79953 [0] NCCL INFO cudaDriverVersion 12020
NCCL version 2.20.5+cuda12.4
TENCENT64:79959:79959 [6] NCCL INFO cudaDriverVersion 12020
TENCENT64:79959:79959 [6] NCCL INFO Bootstrap : Using bond1:30.207.96.97<0>
TENCENT64:79958:79958 [5] NCCL INFO cudaDriverVersion 12020
TENCENT64:79955:79955 [2] NCCL INFO cudaDriverVersion 12020
TENCENT64:79954:79954 [1] NCCL INFO cudaDriverVersion 12020
TENCENT64:79956:79956 [3] NCCL INFO cudaDriverVersion 12020
TENCENT64:79957:79957 [4] NCCL INFO cudaDriverVersion 12020
TENCENT64:79958:79958 [5] NCCL INFO Bootstrap : Using bond1:30.207.96.97<0>
TENCENT64:79955:79955 [2] NCCL INFO Bootstrap : Using bond1:30.207.96.97<0>
TENCENT64:79954:79954 [1] NCCL INFO Bootstrap : Using bond1:30.207.96.97<0>
TENCENT64:79957:79957 [4] NCCL INFO Bootstrap : Using bond1:30.207.96.97<0>
TENCENT64:79956:79956 [3] NCCL INFO Bootstrap : Using bond1:30.207.96.97<0>
TENCENT64:79959:79959 [6] NCCL INFO NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so), using internal implementation
TENCENT64:79958:79958 [5] NCCL INFO NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so), using internal implementation
TENCENT64:79955:79955 [2] NCCL INFO NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so), using internal implementation
TENCENT64:79956:79956 [3] NCCL INFO NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so), using internal implementation
TENCENT64:79954:79954 [1] NCCL INFO NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so), using internal implementation
TENCENT64:79957:79957 [4] NCCL INFO NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so), using internal implementation
TENCENT64:79953:80265 [0] NCCL INFO NET/IB : Using [0]mlx5_bond_0:1/RoCE [1]mlx5_bond_1:1/RoCE [2]mlx5_bond_2:1/RoCE [3]mlx5_bond_3:1/RoCE [4]mlx5_bond_4:1/RoCE [5]mlx5_bond_5:1/RoCE [6]mlx5_bond_6:1/RoCE [7]mlx5_bond_7:1/RoCE [8]mlx5_bond_8:1/RoCE [RO]; OOB bond1:30.207.96.97<0>
TENCENT64:79953:80265 [0] NCCL INFO Using non-device net plugin version 0
TENCENT64:79953:80265 [0] NCCL INFO Using network IB
TENCENT64:79959:80266 [6] NCCL INFO NET/IB : Using [0]mlx5_bond_0:1/RoCE [1]mlx5_bond_1:1/RoCE [2]mlx5_bond_2:1/RoCE [3]mlx5_bond_3:1/RoCE [4]mlx5_bond_4:1/RoCE [5]mlx5_bond_5:1/RoCE [6]mlx5_bond_6:1/RoCE [7]mlx5_bond_7:1/RoCE [8]mlx5_bond_8:1/RoCE [RO]; OOB bond1:30.207.96.97<0>
TENCENT64:79959:80266 [6] NCCL INFO Using non-device net plugin version 0
TENCENT64:79959:80266 [6] NCCL INFO Using network IB
TENCENT64:79958:80267 [5] NCCL INFO NET/IB : Using [0]mlx5_bond_0:1/RoCE [1]mlx5_bond_1:1/RoCE [2]mlx5_bond_2:1/RoCE [3]mlx5_bond_3:1/RoCE [4]mlx5_bond_4:1/RoCE [5]mlx5_bond_5:1/RoCE [6]mlx5_bond_6:1/RoCE [7]mlx5_bond_7:1/RoCE [8]mlx5_bond_8:1/RoCE [RO]; OOB bond1:30.207.96.97<0>
TENCENT64:79958:80267 [5] NCCL INFO Using non-device net plugin version 0
TENCENT64:79958:80267 [5] NCCL INFO Using network IB
TENCENT64:79954:80270 [1] NCCL INFO NET/IB : Using [0]mlx5_bond_0:1/RoCE [1]mlx5_bond_1:1/RoCE [2]mlx5_bond_2:1/RoCE [3]mlx5_bond_3:1/RoCE [4]mlx5_bond_4:1/RoCE [5]mlx5_bond_5:1/RoCE [6]mlx5_bond_6:1/RoCE [7]mlx5_bond_7:1/RoCE [8]mlx5_bond_8:1/RoCE [RO]; OOB bond1:30.207.96.97<0>
TENCENT64:79954:80270 [1] NCCL INFO Using non-device net plugin version 0
TENCENT64:79954:80270 [1] NCCL INFO Using network IB
TENCENT64:79956:80269 [3] NCCL INFO NET/IB : Using [0]mlx5_bond_0:1/RoCE [1]mlx5_bond_1:1/RoCE [2]mlx5_bond_2:1/RoCE [3]mlx5_bond_3:1/RoCE [4]mlx5_bond_4:1/RoCE [5]mlx5_bond_5:1/RoCE [6]mlx5_bond_6:1/RoCE [7]mlx5_bond_7:1/RoCE [8]mlx5_bond_8:1/RoCE [RO]; OOB bond1:30.207.96.97<0>
TENCENT64:79956:80269 [3] NCCL INFO Using non-device net plugin version 0
TENCENT64:79956:80269 [3] NCCL INFO Using network IB
TENCENT64:79957:80271 [4] NCCL INFO NET/IB : Using [0]mlx5_bond_0:1/RoCE [1]mlx5_bond_1:1/RoCE [2]mlx5_bond_2:1/RoCE [3]mlx5_bond_3:1/RoCE [4]mlx5_bond_4:1/RoCE [5]mlx5_bond_5:1/RoCE [6]mlx5_bond_6:1/RoCE [7]mlx5_bond_7:1/RoCE [8]mlx5_bond_8:1/RoCE [RO]; OOB bond1:30.207.96.97<0>
TENCENT64:79955:80268 [2] NCCL INFO NET/IB : Using [0]mlx5_bond_0:1/RoCE [1]mlx5_bond_1:1/RoCE [2]mlx5_bond_2:1/RoCE [3]mlx5_bond_3:1/RoCE [4]mlx5_bond_4:1/RoCE [5]mlx5_bond_5:1/RoCE [6]mlx5_bond_6:1/RoCE [7]mlx5_bond_7:1/RoCE [8]mlx5_bond_8:1/RoCE [RO]; OOB bond1:30.207.96.97<0>
TENCENT64:79957:80271 [4] NCCL INFO Using non-device net plugin version 0
TENCENT64:79957:80271 [4] NCCL INFO Using network IB
TENCENT64:79955:80268 [2] NCCL INFO Using non-device net plugin version 0
TENCENT64:79955:80268 [2] NCCL INFO Using network IB
0%| | 0/541 [00:00<?, ?it/s] 100%|██████████| 541/541 [00:00<00:00, 46238.71it/s]
TENCENT64:79960:79960 [7] NCCL INFO cudaDriverVersion 12020
TENCENT64:79960:79960 [7] NCCL INFO Bootstrap : Using bond1:30.207.96.97<0>
TENCENT64:79960:79960 [7] NCCL INFO NET/Plugin : dlerror=libnccl-net.so: cannot open shared object file: No such file or directory No plugin found (libnccl-net.so), using internal implementation
TENCENT64:79960:80336 [7] NCCL INFO NET/IB : Using [0]mlx5_bond_0:1/RoCE [1]mlx5_bond_1:1/RoCE [2]mlx5_bond_2:1/RoCE [3]mlx5_bond_3:1/RoCE [4]mlx5_bond_4:1/RoCE [5]mlx5_bond_5:1/RoCE [6]mlx5_bond_6:1/RoCE [7]mlx5_bond_7:1/RoCE [8]mlx5_bond_8:1/RoCE [RO]; OOB bond1:30.207.96.97<0>
TENCENT64:79960:80336 [7] NCCL INFO Using non-device net plugin version 0
TENCENT64:79960:80336 [7] NCCL INFO Using network IB
TENCENT64:79956:80269 [3] NCCL INFO comm 0xcd6dc30 rank 3 nranks 8 cudaDev 3 nvmlDev 3 busId 4d000 commId 0x402b4d0350a71a1b - Init START
TENCENT64:79955:80268 [2] NCCL INFO comm 0xb2ff1f0 rank 2 nranks 8 cudaDev 2 nvmlDev 2 busId 49000 commId 0x402b4d0350a71a1b - Init START
TENCENT64:79954:80270 [1] NCCL INFO comm 0x1d2d43f0 rank 1 nranks 8 cudaDev 1 nvmlDev 1 busId 16000 commId 0x402b4d0350a71a1b - Init START
TENCENT64:79953:80265 [0] NCCL INFO comm 0xd3ff140 rank 0 nranks 8 cudaDev 0 nvmlDev 0 busId 10000 commId 0x402b4d0350a71a1b - Init START
TENCENT64:79960:80336 [7] NCCL INFO comm 0xe630280 rank 7 nranks 8 cudaDev 7 nvmlDev 7 busId c9000 commId 0x402b4d0350a71a1b - Init START
TENCENT64:79957:80271 [4] NCCL INFO comm 0xf018850 rank 4 nranks 8 cudaDev 4 nvmlDev 4 busId 89000 commId 0x402b4d0350a71a1b - Init START
TENCENT64:79958:80267 [5] NCCL INFO comm 0x11e9ea30 rank 5 nranks 8 cudaDev 5 nvmlDev 5 busId 8e000 commId 0x402b4d0350a71a1b - Init START
TENCENT64:79959:80266 [6] NCCL INFO comm 0xf3037b0 rank 6 nranks 8 cudaDev 6 nvmlDev 6 busId c5000 commId 0x402b4d0350a71a1b - Init START
TENCENT64:79954:80270 [1] NCCL INFO Setting affinity for GPU 1 to 0fff,ffffff00,0000000f,ffffffff
TENCENT64:79954:80270 [1] NCCL INFO NVLS multicast support is not available on dev 1
TENCENT64:79955:80268 [2] NCCL INFO Setting affinity for GPU 2 to 0fff,ffffff00,0000000f,ffffffff
TENCENT64:79955:80268 [2] NCCL INFO NVLS multicast support is not available on dev 2
TENCENT64:79953:80265 [0] NCCL INFO Setting affinity for GPU 0 to 0fff,ffffff00,0000000f,ffffffff
TENCENT64:79953:80265 [0] NCCL INFO NVLS multicast support is not available on dev 0
TENCENT64:79957:80271 [4] NCCL INFO Setting affinity for GPU 4 to ffff,fffff000,000000ff,fffffff0,00000000
TENCENT64:79957:80271 [4] NCCL INFO NVLS multicast support is not available on dev 4
TENCENT64:79956:80269 [3] NCCL INFO Setting affinity for GPU 3 to 0fff,ffffff00,0000000f,ffffffff
TENCENT64:79956:80269 [3] NCCL INFO NVLS multicast support is not available on dev 3
TENCENT64:79960:80336 [7] NCCL INFO Setting affinity for GPU 7 to ffff,fffff000,000000ff,fffffff0,00000000
TENCENT64:79960:80336 [7] NCCL INFO NVLS multicast support is not available on dev 7
TENCENT64:79958:80267 [5] NCCL INFO Setting affinity for GPU 5 to ffff,fffff000,000000ff,fffffff0,00000000
TENCENT64:79959:80266 [6] NCCL INFO Setting affinity for GPU 6 to ffff,fffff000,000000ff,fffffff0,00000000
TENCENT64:79959:80266 [6] NCCL INFO NVLS multicast support is not available on dev 6
TENCENT64:79958:80267 [5] NCCL INFO NVLS multicast support is not available on dev 5
TENCENT64:79957:80271 [4] NCCL INFO comm 0xf018850 rank 4 nRanks 8 nNodes 1 localRanks 8 localRank 4 MNNVL 0
TENCENT64:79956:80269 [3] NCCL INFO comm 0xcd6dc30 rank 3 nRanks 8 nNodes 1 localRanks 8 localRank 3 MNNVL 0
TENCENT64:79959:80266 [6] NCCL INFO comm 0xf3037b0 rank 6 nRanks 8 nNodes 1 localRanks 8 localRank 6 MNNVL 0
TENCENT64:79958:80267 [5] NCCL INFO comm 0x11e9ea30 rank 5 nRanks 8 nNodes 1 localRanks 8 localRank 5 MNNVL 0
TENCENT64:79955:80268 [2] NCCL INFO comm 0xb2ff1f0 rank 2 nRanks 8 nNodes 1 localRanks 8 localRank 2 MNNVL 0
TENCENT64:79960:80336 [7] NCCL INFO comm 0xe630280 rank 7 nRanks 8 nNodes 1 localRanks 8 localRank 7 MNNVL 0
TENCENT64:79954:80270 [1] NCCL INFO comm 0x1d2d43f0 rank 1 nRanks 8 nNodes 1 localRanks 8 localRank 1 MNNVL 0
TENCENT64:79953:80265 [0] NCCL INFO comm 0xd3ff140 rank 0 nRanks 8 nNodes 1 localRanks 8 localRank 0 MNNVL 0
TENCENT64:79957:80271 [4] NCCL INFO Trees [0] 5/-1/-1->4->3 [1] 5/-1/-1->4->3 [2] 5/-1/-1->4->3 [3] 5/-1/-1->4->3 [4] 5/-1/-1->4->3 [5] 5/-1/-1->4->3 [6] 5/-1/-1->4->3 [7] 5/-1/-1->4->3 [8] 5/-1/-1->4->3 [9] 5/-1/-1->4->3 [10] 5/-1/-1->4->3 [11] 5/-1/-1->4->3 [12] 5/-1/-1->4->3 [13] 5/-1/-1->4->3 [14] 5/-1/-1->4->3 [15] 5/-1/-1->4->3
TENCENT64:79956:80269 [3] NCCL INFO Trees [0] 4/-1/-1->3->2 [1] 4/-1/-1->3->2 [2] 4/-1/-1->3->2 [3] 4/-1/-1->3->2 [4] 4/-1/-1->3->2 [5] 4/-1/-1->3->2 [6] 4/-1/-1->3->2 [7] 4/-1/-1->3->2 [8] 4/-1/-1->3->2 [9] 4/-1/-1->3->2 [10] 4/-1/-1->3->2 [11] 4/-1/-1->3->2 [12] 4/-1/-1->3->2 [13] 4/-1/-1->3->2 [14] 4/-1/-1->3->2 [15] 4/-1/-1->3->2
TENCENT64:79956:80269 [3] NCCL INFO P2P Chunksize set to 524288
TENCENT64:79959:80266 [6] NCCL INFO Trees [0] 7/-1/-1->6->5 [1] 7/-1/-1->6->5 [2] 7/-1/-1->6->5 [3] 7/-1/-1->6->5 [4] 7/-1/-1->6->5 [5] 7/-1/-1->6->5 [6] 7/-1/-1->6->5 [7] 7/-1/-1->6->5 [8] 7/-1/-1->6->5 [9] 7/-1/-1->6->5 [10] 7/-1/-1->6->5 [11] 7/-1/-1->6->5 [12] 7/-1/-1->6->5 [13] 7/-1/-1->6->5 [14] 7/-1/-1->6->5 [15] 7/-1/-1->6->5
TENCENT64:79958:80267 [5] NCCL INFO Trees [0] 6/-1/-1->5->4 [1] 6/-1/-1->5->4 [2] 6/-1/-1->5->4 [3] 6/-1/-1->5->4 [4] 6/-1/-1->5->4 [5] 6/-1/-1->5->4 [6] 6/-1/-1->5->4 [7] 6/-1/-1->5->4 [8] 6/-1/-1->5->4 [9] 6/-1/-1->5->4 [10] 6/-1/-1->5->4 [11] 6/-1/-1->5->4 [12] 6/-1/-1->5->4 [13] 6/-1/-1->5->4 [14] 6/-1/-1->5->4 [15] 6/-1/-1->5->4
TENCENT64:79958:80267 [5] NCCL INFO P2P Chunksize set to 524288
TENCENT64:79955:80268 [2] NCCL INFO Trees [0] 3/-1/-1->2->1 [1] 3/-1/-1->2->1 [2] 3/-1/-1->2->1 [3] 3/-1/-1->2->1 [4] 3/-1/-1->2->1 [5] 3/-1/-1->2->1 [6] 3/-1/-1->2->1 [7] 3/-1/-1->2->1 [8] 3/-1/-1->2->1 [9] 3/-1/-1->2->1 [10] 3/-1/-1->2->1 [11] 3/-1/-1->2->1 [12] 3/-1/-1->2->1 [13] 3/-1/-1->2->1 [14] 3/-1/-1->2->1 [15] 3/-1/-1->2->1
TENCENT64:79955:80268 [2] NCCL INFO P2P Chunksize set to 524288
TENCENT64:79960:80336 [7] NCCL INFO Trees [0] -1/-1/-1->7->6 [1] -1/-1/-1->7->6 [2] -1/-1/-1->7->6 [3] -1/-1/-1->7->6 [4] -1/-1/-1->7->6 [5] -1/-1/-1->7->6 [6] -1/-1/-1->7->6 [7] -1/-1/-1->7->6 [8] -1/-1/-1->7->6 [9] -1/-1/-1->7->6 [10] -1/-1/-1->7->6 [11] -1/-1/-1->7->6 [12] -1/-1/-1->7->6 [13] -1/-1/-1->7->6 [14] -1/-1/-1->7->6 [15] -1/-1/-1->7->6
TENCENT64:79960:80336 [7] NCCL INFO P2P Chunksize set to 524288
TENCENT64:79954:80270 [1] NCCL INFO Trees [0] 2/-1/-1->1->0 [1] 2/-1/-1->1->0 [2] 2/-1/-1->1->0 [3] 2/-1/-1->1->0 [4] 2/-1/-1->1->0 [5] 2/-1/-1->1->0 [6] 2/-1/-1->1->0 [7] 2/-1/-1->1->0 [8] 2/-1/-1->1->0 [9] 2/-1/-1->1->0 [10] 2/-1/-1->1->0 [11] 2/-1/-1->1->0 [12] 2/-1/-1->1->0 [13] 2/-1/-1->1->0 [14] 2/-1/-1->1->0 [15] 2/-1/-1->1->0
TENCENT64:79953:80265 [0] NCCL INFO Channel 00/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 01/16 : 0 1 2 3 4 5 6 7
TENCENT64:79957:80271 [4] NCCL INFO P2P Chunksize set to 524288
TENCENT64:79959:80266 [6] NCCL INFO P2P Chunksize set to 524288
TENCENT64:79954:80270 [1] NCCL INFO P2P Chunksize set to 524288
TENCENT64:79953:80265 [0] NCCL INFO Channel 02/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 03/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 04/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 05/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 06/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 07/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 08/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 09/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 10/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 11/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 12/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 13/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 14/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Channel 15/16 : 0 1 2 3 4 5 6 7
TENCENT64:79953:80265 [0] NCCL INFO Trees [0] 1/-1/-1->0->-1 [1] 1/-1/-1->0->-1 [2] 1/-1/-1->0->-1 [3] 1/-1/-1->0->-1 [4] 1/-1/-1->0->-1 [5] 1/-1/-1->0->-1 [6] 1/-1/-1->0->-1 [7] 1/-1/-1->0->-1 [8] 1/-1/-1->0->-1 [9] 1/-1/-1->0->-1 [10] 1/-1/-1->0->-1 [11] 1/-1/-1->0->-1 [12] 1/-1/-1->0->-1 [13] 1/-1/-1->0->-1 [14] 1/-1/-1->0->-1 [15] 1/-1/-1->0->-1
TENCENT64:79953:80265 [0] NCCL INFO P2P Chunksize set to 524288
TENCENT64:79956:80269 [3] NCCL INFO Channel 00/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 00/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 00/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 00/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 00/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 00/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 00/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 00/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 01/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 01/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 01/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 01/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 01/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 01/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 01/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 01/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 02/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 02/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 02/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 02/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 02/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 02/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 02/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 02/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 03/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 03/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 03/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 03/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 03/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 03/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 03/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 03/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 04/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 04/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 04/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 04/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 04/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 04/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 04/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 04/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 05/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 05/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 05/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 05/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 05/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 05/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 05/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 05/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 06/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 06/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 06/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 06/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 06/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 06/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 06/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 06/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 07/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 07/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 07/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 07/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 07/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 07/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 07/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 07/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 08/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 08/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 08/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 08/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 08/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 08/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 08/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 08/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 09/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 09/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 09/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 09/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 09/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 09/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 09/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 09/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 10/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 10/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 10/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 10/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 10/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 10/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 10/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 10/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 11/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 11/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 11/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 11/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 11/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 11/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 11/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 11/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 12/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 12/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 12/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 12/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 12/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 12/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 12/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 12/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 13/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 13/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 13/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 13/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 13/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 13/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 13/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 13/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 14/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 14/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 14/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 14/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 14/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 14/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 14/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 14/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 15/0 : 3[3] -> 4[4] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 15/0 : 5[5] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 15/0 : 2[2] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 15/0 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 15/0 : 4[4] -> 5[5] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 15/0 : 6[6] -> 7[7] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 15/0 : 1[1] -> 2[2] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Channel 15/0 : 0[0] -> 1[1] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Connected all rings
TENCENT64:79954:80270 [1] NCCL INFO Connected all rings
TENCENT64:79953:80265 [0] NCCL INFO Connected all rings
TENCENT64:79956:80269 [3] NCCL INFO Connected all rings
TENCENT64:79957:80271 [4] NCCL INFO Connected all rings
TENCENT64:79960:80336 [7] NCCL INFO Connected all rings
TENCENT64:79958:80267 [5] NCCL INFO Connected all rings
TENCENT64:79959:80266 [6] NCCL INFO Connected all rings
TENCENT64:79960:80336 [7] NCCL INFO Channel 00/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 01/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 02/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 03/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 04/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 05/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 06/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 07/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 00/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 08/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 01/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 09/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 02/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 10/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 03/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 11/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 04/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 12/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 05/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 00/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 13/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 06/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 01/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 00/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 14/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 07/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 02/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 01/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 00/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79960:80336 [7] NCCL INFO Channel 15/0 : 7[7] -> 6[6] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 08/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 00/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 00/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 03/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 02/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 01/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 09/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 01/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 01/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 04/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 03/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 02/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 10/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 02/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 02/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 05/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 04/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 03/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 11/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 03/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 03/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 06/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 05/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 04/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 12/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 04/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 04/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 07/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 06/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 05/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 13/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 05/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 05/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 08/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 07/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 06/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 14/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 06/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 06/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 09/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 08/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 07/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79955:80268 [2] NCCL INFO Channel 15/0 : 2[2] -> 1[1] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 07/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 07/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 10/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 09/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 08/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 08/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 08/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 11/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 10/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 09/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 09/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 09/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 12/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 11/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 10/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 10/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 10/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 13/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 12/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 11/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 11/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 11/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 14/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 13/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 12/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 12/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 12/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79954:80270 [1] NCCL INFO Channel 15/0 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 14/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 13/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 13/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 13/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79956:80269 [3] NCCL INFO Channel 15/0 : 3[3] -> 2[2] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 14/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 14/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 14/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79957:80271 [4] NCCL INFO Channel 15/0 : 4[4] -> 3[3] via P2P/CUMEM/read
TENCENT64:79958:80267 [5] NCCL INFO Channel 15/0 : 5[5] -> 4[4] via P2P/CUMEM/read
TENCENT64:79959:80266 [6] NCCL INFO Channel 15/0 : 6[6] -> 5[5] via P2P/CUMEM/read
TENCENT64:79953:80265 [0] NCCL INFO Connected all trees
TENCENT64:79953:80265 [0] NCCL INFO threadThresholds 8/8/64 | 64/8/64 | 512 | 512
TENCENT64:79953:80265 [0] NCCL INFO 16 coll channels, 0 collnet channels, 0 nvls channels, 16 p2p channels, 16 p2p channels per peer
TENCENT64:79954:80270 [1] NCCL INFO Connected all trees
TENCENT64:79954:80270 [1] NCCL INFO threadThresholds 8/8/64 | 64/8/64 | 512 | 512
TENCENT64:79954:80270 [1] NCCL INFO 16 coll channels, 0 collnet channels, 0 nvls channels, 16 p2p channels, 16 p2p channels per peer
TENCENT64:79955:80268 [2] NCCL INFO Connected all trees
TENCENT64:79955:80268 [2] NCCL INFO threadThresholds 8/8/64 | 64/8/64 | 512 | 512
TENCENT64:79955:80268 [2] NCCL INFO 16 coll channels, 0 collnet channels, 0 nvls channels, 16 p2p channels, 16 p2p channels per peer
TENCENT64:79956:80269 [3] NCCL INFO Connected all trees
TENCENT64:79956:80269 [3] NCCL INFO threadThresholds 8/8/64 | 64/8/64 | 512 | 512
TENCENT64:79956:80269 [3] NCCL INFO 16 coll channels, 0 collnet channels, 0 nvls channels, 16 p2p channels, 16 p2p channels per peer
TENCENT64:79957:80271 [4] NCCL INFO Connected all trees
TENCENT64:79957:80271 [4] NCCL INFO threadThresholds 8/8/64 | 64/8/64 | 512 | 512
TENCENT64:79957:80271 [4] NCCL INFO 16 coll channels, 0 collnet channels, 0 nvls channels, 16 p2p channels, 16 p2p channels per peer
TENCENT64:79958:80267 [5] NCCL INFO Connected all trees
TENCENT64:79959:80266 [6] NCCL INFO Connected all trees
TENCENT64:79960:80336 [7] NCCL INFO Connected all trees
TENCENT64:79958:80267 [5] NCCL INFO threadThresholds 8/8/64 | 64/8/64 | 512 | 512
TENCENT64:79958:80267 [5] NCCL INFO 16 coll channels, 0 collnet channels, 0 nvls channels, 16 p2p channels, 16 p2p channels per peer
TENCENT64:79959:80266 [6] NCCL INFO threadThresholds 8/8/64 | 64/8/64 | 512 | 512
TENCENT64:79960:80336 [7] NCCL INFO threadThresholds 8/8/64 | 64/8/64 | 512 | 512
TENCENT64:79959:80266 [6] NCCL INFO 16 coll channels, 0 collnet channels, 0 nvls channels, 16 p2p channels, 16 p2p channels per peer
TENCENT64:79960:80336 [7] NCCL INFO 16 coll channels, 0 collnet channels, 0 nvls channels, 16 p2p channels, 16 p2p channels per peer
TENCENT64:79957:80271 [4] NCCL INFO comm 0xf018850 rank 4 nranks 8 cudaDev 4 nvmlDev 4 busId 89000 commId 0x402b4d0350a71a1b - Init COMPLETE
TENCENT64:79960:80336 [7] NCCL INFO comm 0xe630280 rank 7 nranks 8 cudaDev 7 nvmlDev 7 busId c9000 commId 0x402b4d0350a71a1b - Init COMPLETE
TENCENT64:79958:80267 [5] NCCL INFO comm 0x11e9ea30 rank 5 nranks 8 cudaDev 5 nvmlDev 5 busId 8e000 commId 0x402b4d0350a71a1b - Init COMPLETE
TENCENT64:79956:80269 [3] NCCL INFO comm 0xcd6dc30 rank 3 nranks 8 cudaDev 3 nvmlDev 3 busId 4d000 commId 0x402b4d0350a71a1b - Init COMPLETE
TENCENT64:79959:80266 [6] NCCL INFO comm 0xf3037b0 rank 6 nranks 8 cudaDev 6 nvmlDev 6 busId c5000 commId 0x402b4d0350a71a1b - Init COMPLETE
TENCENT64:79955:80268 [2] NCCL INFO comm 0xb2ff1f0 rank 2 nranks 8 cudaDev 2 nvmlDev 2 busId 49000 commId 0x402b4d0350a71a1b - Init COMPLETE
TENCENT64:79953:80265 [0] NCCL INFO comm 0xd3ff140 rank 0 nranks 8 cudaDev 0 nvmlDev 0 busId 10000 commId 0x402b4d0350a71a1b - Init COMPLETE
TENCENT64:79954:80270 [1] NCCL INFO comm 0x1d2d43f0 rank 1 nranks 8 cudaDev 1 nvmlDev 1 busId 16000 commId 0x402b4d0350a71a1b - Init COMPLETE
2025-05-19 01:45:13.639 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_test on rank 0...
2025-05-19 01:45:13.640 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_test on rank 7...
2025-05-19 01:45:13.640 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_test on rank 2...
2025-05-19 01:45:13.640 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_test on rank 6...
2025-05-19 01:45:13.640 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_test on rank 3...
2025-05-19 01:45:13.640 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_test on rank 4...
2025-05-19 01:45:13.640 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_test on rank 1...
2025-05-19 01:45:13.640 | INFO  | lmms_eval.api.task:build_all_requests:425 - Building contexts for mmbench_en_test on rank 5...
0%| | 0/833 [00:00<?, ?it/s] 0%| | 0/833 [00:00<?, ?it/s] 0%| | 0/833 [00:00<?, ?it/s] 0%| | 0/833 [00:00<?, ?it/s] 0%| | 0/834 [00:00<?, ?it/s] 0%| | 0/833 [00:00<?, ?it/s] 76%|███████▌ | 634/833 [00:00<00:00, 2825.12it/s] 100%|██████████| 833/833 [00:00<00:00, 3641.91it/s]
0%| | 0/833 [00:00<?, ?it/s] 0%| | 0/834 [00:00<?, ?it/s] 76%|███████▌ | 634/833 [00:00<00:00, 2577.54it/s] 100%|██████████| 833/833 [00:00<00:00, 3328.33it/s]
76%|███████▌ | 634/833 [00:00<00:00, 2494.36it/s] 100%|██████████| 833/833 [00:00<00:00, 3223.39it/s]
76%|███████▌ | 631/833 [00:00<00:00, 2451.51it/s] 100%|██████████| 833/833 [00:00<00:00, 3181.34it/s]
76%|███████▌ | 631/833 [00:00<00:00, 2722.81it/s] 100%|██████████| 833/833 [00:00<00:00, 3527.31it/s]
76%|███████▌ | 631/834 [00:00<00:00, 2613.76it/s] 100%|██████████| 834/834 [00:00<00:00, 3394.76it/s]
76%|███████▌ | 634/833 [00:00<00:00, 2736.93it/s] 100%|██████████| 833/833 [00:00<00:00, 3532.22it/s]
76%|███████▌ | 630/834 [00:00<00:00, 2640.00it/s] 100%|██████████| 834/834 [00:00<00:00, 3433.64it/s]
2025-05-19 01:45:19.562 | INFO  | lmms_eval.evaluator:evaluate:446 - Running generate_until requests
2025-05-19 01:45:19.562 | INFO  | lmms_eval.evaluator:evaluate:446 - Running generate_until requests
2025-05-19 01:45:19.562 | INFO  | lmms_eval.evaluator:evaluate:446 - Running generate_until requests
2025-05-19 01:45:19.562 | INFO  | lmms_eval.evaluator:evaluate:446 - Running generate_until requests
2025-05-19 01:45:19.562 | INFO  | lmms_eval.evaluator:evaluate:446 - Running generate_until requests
2025-05-19 01:45:19.562 | INFO  | lmms_eval.evaluator:evaluate:446 - Running generate_until requests
2025-05-19 01:45:19.562 | INFO  | lmms_eval.evaluator:evaluate:446 - Running generate_until requests
2025-05-19 01:45:19.562 | INFO  | lmms_eval.evaluator:evaluate:446 - Running generate_until requests
Model Responding: 0%| | 0/1376 [00:00<?, ?it/s] Model Responding: 0%| | 1/1376 [00:01<35:46, 1.56s/it] Model Responding: 0%| | 2/1376 [00:01<17:17, 1.32it/s] Model Responding: 0%| | 3/1376 [00:01<11:36, 1.97it/s] Model Responding: 0%| | 4/1376 [00:02<08:39, 2.64it/s] Model Responding: 0%| | 5/1376 [00:02<07:59, 2.86it/s] Model Responding: 0%| | 6/1376 [00:02<07:35, 3.01it/s] Model Responding: 1%| | 7/1376 [00:03<07:19, 3.12it/s] Model Responding: 1%| | 8/1376 [00:03<06:30, 3.50it/s] Model Responding: 1%| | 9/1376 [00:03<05:47, 3.93it/s] Model Responding: 1%| | 10/1376 [00:03<05:17, 4.30it/s] Model Responding: 1%| | 11/1376 [00:03<04:56, 4.60it/s] Model Responding: 1%| | 12/1376 [00:03<04:36, 4.92it/s] Model Responding: 1%| | 13/1376 [00:04<04:23, 5.18it/s] Model Responding: 1%| | 14/1376 [00:04<04:30, 5.03it/s] Model Responding: 1%| | 15/1376 [00:04<04:23, 5.16it/s] Model Responding: 1%| | 16/1376 [00:04<04:18, 5.26it/s] Model Responding: 1%| | 17/1376 [00:04<04:15, 5.31it/s] Model Responding: 1%|▏ | 18/1376 [00:05<05:19, 4.25it/s] Model Responding: 1%|▏ | 19/1376 [00:05<04:53, 4.62it/s] Model Responding: 1%|▏ | 20/1376 [00:05<04:36, 4.91it/s] Model Responding: 2%|▏ | 21/1376 [00:05<04:22, 5.16it/s] Model Responding: 2%|▏ | 22/1376 [00:05<04:02, 5.57it/s] Model Responding: 2%|▏ | 23/1376 [00:06<03:52, 5.83it/s] Model Responding: 2%|▏ | 24/1376 [00:06<03:43, 6.04it/s] Model Responding: 2%|▏ | 25/1376 [00:06<03:38, 6.20it/s] Model Responding: 2%|▏ | 26/1376 [00:06<03:43, 6.04it/s] Model Responding: 2%|▏ | 27/1376 [00:06<03:45, 5.98it/s] Model Responding: 2%|▏ | 28/1376 [00:06<03:46, 5.95it/s] Model Responding: 2%|▏ | 29/1376 [00:07<03:46, 5.94it/s] Model Responding: 2%|▏ | 30/1376 [00:07<03:47, 5.92it/s] Model Responding: 2%|▏ | 31/1376 [00:07<03:47, 5.91it/s] Model Responding: 2%|▏ | 32/1376 [00:07<03:47, 5.91it/s] Model Responding: 2%|▏ | 33/1376 [00:07<03:47, 5.90it/s] Model Responding: 2%|▏ | 34/1376 [00:07<03:47, 5.90it/s] Model Responding: 3%|▎ | 35/1376 [00:08<03:47, 5.89it/s] Model Responding: 3%|▎ | 36/1376 [00:08<04:07, 5.42it/s] Model Responding: 3%|▎ | 37/1376 [00:08<04:21, 5.12it/s] Model Responding: 3%|▎ | 38/1376 [00:08<04:25, 5.03it/s] Model Responding: 3%|▎ | 39/1376 [00:08<04:29, 4.96it/s] Model Responding: 3%|▎ | 40/1376 [00:09<04:19, 5.15it/s] Model Responding: 3%|▎ | 41/1376 [00:09<04:12, 5.29it/s] Model Responding: 3%|▎ | 42/1376 [00:09<04:56, 4.50it/s] Model Responding: 3%|▎ | 43/1376 [00:09<04:29, 4.94it/s] Model Responding: 3%|▎ | 44/1376 [00:09<04:12, 5.28it/s] Model Responding: 3%|▎ | 45/1376 [00:10<03:58, 5.59it/s] Model Responding: 3%|▎ | 46/1376 [00:10<04:09, 5.33it/s] Model Responding: 3%|▎ | 47/1376 [00:10<04:04, 5.42it/s] Model Responding: 3%|▎ | 48/1376 [00:10<04:16, 5.19it/s] Model Responding: 4%|▎ | 49/1376 [00:10<04:23, 5.03it/s] Model Responding: 4%|▎ | 50/1376 [00:11<04:29, 4.93it/s] Model Responding: 4%|▎ | 51/1376 [00:11<04:15, 5.19it/s] Model Responding: 4%|▍ | 52/1376 [00:11<04:05, 5.40it/s] Model Responding: 4%|▍ | 53/1376 [00:11<04:12, 5.23it/s] Model Responding: 4%|▍ | 54/1376 [00:11<04:07, 5.34it/s] Model Responding: 4%|▍ | 55/1376 [00:11<04:02, 5.44it/s] Model Responding: 4%|▍ | 56/1376 [00:12<03:59, 5.51it/s] Model Responding: 4%|▍ | 57/1376 [00:12<03:57, 5.55it/s] Model Responding: 4%|▍ | 58/1376 [00:12<03:52, 5.67it/s] Model Responding: 4%|▍ | 59/1376 [00:12<03:57, 5.56it/s] Model Responding: 4%|▍ | 60/1376 [00:12<04:06, 5.34it/s] Model Responding: 4%|▍ | 61/1376 [00:13<04:01, 5.44it/s] Model Responding: 5%|▍ | 62/1376 [00:13<04:09, 5.27it/s] Model Responding: 5%|▍ | 63/1376 [00:13<04:01, 5.43it/s] Model Responding: 5%|▍ | 64/1376 [00:13<04:35, 4.75it/s] Model Responding: 5%|▍ | 65/1376 [00:13<04:59, 4.38it/s] Model Responding: 5%|▍ | 66/1376 [00:14<05:15, 4.15it/s] Model Responding: 5%|▍ | 67/1376 [00:14<04:49, 4.53it/s] Model Responding: 5%|▍ | 68/1376 [00:14<04:29, 4.86it/s] Model Responding: 5%|▌ | 69/1376 [00:14<04:15, 5.12it/s] Model Responding: 5%|▌ | 70/1376 [00:14<04:22, 4.98it/s] Model Responding: 5%|▌ | 71/1376 [00:15<04:03, 5.35it/s] Model Responding: 5%|▌ | 72/1376 [00:15<03:56, 5.51it/s] Model Responding: 5%|▌ | 73/1376 [00:15<03:58, 5.47it/s] Model Responding: 5%|▌ | 74/1376 [00:15<03:58, 5.45it/s] Model Responding: 5%|▌ | 75/1376 [00:15<03:59, 5.43it/s] Model Responding: 6%|▌ | 76/1376 [00:16<03:47, 5.71it/s] Model Responding: 6%|▌ | 77/1376 [00:16<03:45, 5.77it/s] Model Responding: 6%|▌ | 78/1376 [00:16<03:43, 5.80it/s] Model Responding: 6%|▌ | 79/1376 [00:16<03:42, 5.83it/s] Model Responding: 6%|▌ | 80/1376 [00:16<03:32, 6.09it/s] Model Responding: 6%|▌ | 81/1376 [00:16<03:28, 6.22it/s] Model Responding: 6%|▌ | 82/1376 [00:16<03:25, 6.30it/s] Model Responding: 6%|▌ | 83/1376 [00:17<03:37, 5.94it/s] Model Responding: 6%|▌ | 84/1376 [00:17<03:51, 5.59it/s] Model Responding: 6%|▌ | 85/1376 [00:17<04:03, 5.29it/s] Model Responding: 6%|▋ | 86/1376 [00:17<04:04, 5.29it/s] Model Responding: 6%|▋ | 87/1376 [00:17<03:50, 5.59it/s] Model Responding: 6%|▋ | 88/1376 [00:18<03:46, 5.70it/s] Model Responding: 6%|▋ | 89/1376 [00:18<03:42, 5.78it/s] Model Responding: 7%|▋ | 90/1376 [00:18<03:29, 6.14it/s] Model Responding: 7%|▋ | 91/1376 [00:18<03:45, 5.69it/s] Model Responding: 7%|▋ | 92/1376 [00:18<04:43, 4.53it/s] Model Responding: 7%|▋ | 93/1376 [00:19<04:23, 4.87it/s] Model Responding: 7%|▋ | 94/1376 [00:19<04:12, 5.08it/s] Model Responding: 7%|▋ | 95/1376 [00:19<04:01, 5.31it/s] Model Responding: 7%|▋ | 96/1376 [00:19<03:53, 5.49it/s] Model Responding: 7%|▋ | 97/1376 [00:19<04:33, 4.68it/s] Model Responding: 7%|▋ | 98/1376 [00:20<05:18, 4.02it/s] Model Responding: 7%|▋ | 99/1376 [00:20<05:00, 4.25it/s] Model Responding: 7%|▋ | 100/1376 [00:20<04:49, 4.41it/s] Model Responding: 7%|▋ | 101/1376 [00:20<04:39, 4.56it/s] Model Responding: 7%|▋ | 102/1376 [00:21<04:37, 4.59it/s] Model Responding: 7%|▋ | 103/1376 [00:21<05:05, 4.17it/s] Model Responding: 8%|▊ | 104/1376 [00:21<05:13, 4.05it/s] Model Responding: 8%|▊ | 105/1376 [00:21<05:22, 3.95it/s] Model Responding: 8%|▊ | 106/1376 [00:22<05:25, 3.91it/s] Model Responding: 8%|▊ | 107/1376 [00:22<05:11, 4.07it/s] Model Responding: 8%|▊ | 108/1376 [00:22<05:02, 4.19it/s] Model Responding: 8%|▊ | 109/1376 [00:22<04:57, 4.26it/s] Model Responding: 8%|▊ | 110/1376 [00:22<04:33, 4.63it/s] Model Responding: 8%|▊ | 111/1376 [00:23<04:33, 4.63it/s] Model Responding: 8%|▊ | 112/1376 [00:23<04:35, 4.60it/s] Model Responding: 8%|▊ | 113/1376 [00:23<04:55, 4.28it/s] Model Responding: 8%|▊ | 114/1376 [00:23<04:47, 4.39it/s] Model Responding: 8%|▊ | 115/1376 [00:24<04:32, 4.62it/s] Model Responding: 8%|▊ | 116/1376 [00:24<04:20, 4.83it/s] Model Responding: 9%|▊ | 117/1376 [00:24<04:12, 4.98it/s] Model Responding: 9%|▊ | 118/1376 [00:24<04:38, 4.52it/s] Model Responding: 9%|▊ | 119/1376 [00:25<05:16, 3.97it/s] Model Responding: 9%|▊ | 120/1376 [00:25<05:31, 3.79it/s] Model Responding: 9%|▉ | 121/1376 [00:25<05:45, 3.64it/s] Model Responding: 9%|▉ | 122/1376 [00:25<05:19, 3.92it/s] Model Responding: 9%|▉ | 123/1376 [00:26<05:34, 3.75it/s] Model Responding: 9%|▉ | 124/1376 [00:26<04:52, 4.28it/s] Model Responding: 9%|▉ | 125/1376 [00:26<05:22, 3.88it/s] Model Responding: 9%|▉ | 126/1376 [00:26<05:37, 3.70it/s] Model Responding: 9%|▉ | 127/1376 [00:27<05:02, 4.13it/s] Model Responding: 9%|▉ | 128/1376 [00:27<05:29, 3.79it/s] Model Responding: 9%|▉ | 129/1376 [00:27<05:38, 3.68it/s] Model Responding: 9%|▉ | 130/1376 [00:27<05:01, 4.14it/s] Model Responding: 10%|▉ | 131/1376 [00:28<04:29, 4.62it/s] Model Responding: 10%|▉ | 132/1376 [00:28<04:12, 4.93it/s] Model Responding: 10%|▉ | 133/1376 [00:28<03:59, 5.19it/s] Model Responding: 10%|▉ | 134/1376 [00:28<03:58, 5.21it/s] Model Responding: 10%|▉ | 135/1376 [00:28<03:44, 5.53it/s] Model Responding: 10%|▉ | 136/1376 [00:28<03:34, 5.78it/s] Model Responding: 10%|▉ | 137/1376 [00:29<03:27, 5.98it/s] Model Responding: 10%|█ | 138/1376 [00:29<03:35, 5.75it/s] Model Responding: 10%|█ | 139/1376 [00:29<04:08, 4.98it/s] Model Responding: 10%|█ | 140/1376 [00:29<03:51, 5.34it/s] Model Responding: 10%|█ | 141/1376 [00:29<03:52, 5.31it/s] Model Responding: 10%|█ | 142/1376 [00:29<03:46, 5.45it/s] Model Responding: 10%|█ | 143/1376 [00:30<03:46, 5.45it/s] Model Responding: 10%|█ | 144/1376 [00:30<04:38, 4.42it/s] Model Responding: 11%|█ | 145/1376 [00:30<05:05, 4.03it/s] Model Responding: 11%|█ | 146/1376 [00:31<05:16, 3.89it/s] Model Responding: 11%|█ | 147/1376 [00:31<05:22, 3.82it/s] Model Responding: 11%|█ | 148/1376 [00:31<05:28, 3.74it/s] Model Responding: 11%|█ | 149/1376 [00:31<05:06, 4.00it/s] Model Responding: 11%|█ | 150/1376 [00:32<04:42, 4.34it/s] Model Responding: 11%|█ | 151/1376 [00:32<04:10, 4.88it/s] Model Responding: 11%|█ | 152/1376 [00:32<04:32, 4.50it/s] Model Responding: 11%|█ | 153/1376 [00:32<04:57, 4.12it/s] Model Responding: 11%|█ | 154/1376 [00:33<05:07, 3.98it/s] Model Responding: 11%|█▏ | 155/1376 [00:33<05:14, 3.88it/s] Model Responding: 11%|█▏ | 156/1376 [00:33<05:21, 3.80it/s] Model Responding: 11%|█▏ | 157/1376 [00:33<05:25, 3.74it/s] Model Responding: 11%|█▏ | 158/1376 [00:34<05:27, 3.72it/s] Model Responding: 12%|█▏ | 159/1376 [00:34<05:26, 3.73it/s] Model Responding: 12%|█▏ | 160/1376 [00:34<05:23, 3.75it/s] Model Responding: 12%|█▏ | 161/1376 [00:34<05:22, 3.77it/s] Model Responding: 12%|█▏ | 162/1376 [00:35<04:39, 4.35it/s] Model Responding: 12%|█▏ | 163/1376 [00:35<04:08, 4.89it/s] Model Responding: 12%|█▏ | 164/1376 [00:35<03:45, 5.36it/s] Model Responding: 12%|█▏ | 165/1376 [00:35<03:53, 5.18it/s] Model Responding: 12%|█▏ | 166/1376 [00:35<04:22, 4.61it/s] Model Responding: 12%|█▏ | 167/1376 [00:36<04:41, 4.29it/s] Model Responding: 12%|█▏ | 168/1376 [00:36<04:13, 4.76it/s] Model Responding: 12%|█▏ | 169/1376 [00:36<03:59, 5.03it/s] Model Responding: 12%|█▏ | 170/1376 [00:36<03:48, 5.27it/s] Model Responding: 12%|█▏ | 171/1376 [00:36<03:42, 5.42it/s] Model Responding: 12%|█▎ | 172/1376 [00:37<04:13, 4.75it/s] Model Responding: 13%|█▎ | 173/1376 [00:37<04:33, 4.39it/s] Model Responding: 13%|█▎ | 174/1376 [00:37<04:26, 4.52it/s] Model Responding: 13%|█▎ | 175/1376 [00:37<04:19, 4.62it/s] Model Responding: 13%|█▎ | 176/1376 [00:37<04:15, 4.69it/s] Model Responding: 13%|█▎ | 177/1376 [00:38<04:13, 4.74it/s] Model Responding: 13%|█▎ | 178/1376 [00:38<04:10, 4.78it/s] Model Responding: 13%|█▎ | 179/1376 [00:38<04:29, 4.45it/s] Model Responding: 13%|█▎ | 180/1376 [00:38<04:42, 4.23it/s] Model Responding: 13%|█▎ | 181/1376 [00:39<04:52, 4.09it/s] Model Responding: 13%|█▎ | 182/1376 [00:39<05:03, 3.94it/s] Model Responding: 13%|█▎ | 183/1376 [00:39<05:04, 3.92it/s] Model Responding: 13%|█▎ | 184/1376 [00:39<04:46, 4.16it/s] Model Responding: 13%|█▎ | 185/1376 [00:40<04:27, 4.46it/s] Model Responding: 14%|█▎ | 186/1376 [00:40<04:21, 4.55it/s] Model Responding: 14%|█▎ | 187/1376 [00:40<04:17, 4.62it/s] Model Responding: 14%|█▎ | 188/1376 [00:40<04:14, 4.67it/s] Model Responding: 14%|█▎ | 189/1376 [00:40<04:03, 4.87it/s] Model Responding: 14%|█▍ | 190/1376 [00:41<04:38, 4.26it/s] Model Responding: 14%|█▍ | 191/1376 [00:41<05:01, 3.92it/s] Model Responding: 14%|█▍ | 192/1376 [00:41<05:18, 3.72it/s] Model Responding: 14%|█▍ | 193/1376 [00:42<05:15, 3.75it/s] Model Responding: 14%|█▍ | 194/1376 [00:42<05:20, 3.69it/s] Model Responding: 14%|█▍ | 195/1376 [00:42<04:38, 4.24it/s] Model Responding: 14%|█▍ | 196/1376 [00:42<04:27, 4.41it/s] Model Responding: 14%|█▍ | 197/1376 [00:42<04:42, 4.17it/s] Model Responding: 14%|█▍ | 198/1376 [00:43<04:50, 4.06it/s] Model Responding: 14%|█▍ | 199/1376 [00:43<04:13, 4.65it/s] Model Responding: 15%|█▍ | 200/1376 [00:43<04:05, 4.78it/s] Model Responding: 15%|█▍ | 201/1376 [00:43<04:28, 4.37it/s] Model Responding: 15%|█▍ | 202/1376 [00:44<04:21, 4.48it/s] Model Responding: 15%|█▍ | 203/1376 [00:44<04:35, 4.26it/s] Model Responding: 15%|█▍ | 204/1376 [00:44<05:06, 3.82it/s] Model Responding: 15%|█▍ | 205/1376 [00:44<05:29, 3.55it/s] Model Responding: 15%|█▍ | 206/1376 [00:45<05:46, 3.37it/s] Model Responding: 15%|█▌ | 207/1376 [00:45<05:37, 3.46it/s] Model Responding: 15%|█▌ | 208/1376 [00:45<05:32, 3.51it/s] Model Responding: 15%|█▌ | 209/1376 [00:46<05:27, 3.56it/s] Model Responding: 15%|█▌ | 210/1376 [00:46<05:23, 3.60it/s] Model Responding: 15%|█▌ | 211/1376 [00:46<05:16, 3.68it/s] Model Responding: 15%|█▌ | 212/1376 [00:46<04:31, 4.29it/s] Model Responding: 15%|█▌ | 213/1376 [00:46<04:09, 4.66it/s] Model Responding: 16%|█▌ | 214/1376 [00:47<04:26, 4.36it/s] Model Responding: 16%|█▌ | 215/1376 [00:47<04:36, 4.19it/s] Model Responding: 16%|█▌ | 216/1376 [00:47<04:45, 4.07it/s] Model Responding: 16%|█▌ | 217/1376 [00:48<05:14, 3.69it/s] Model Responding: 16%|█▌ | 218/1376 [00:48<05:11, 3.72it/s] Model Responding: 16%|█▌ | 219/1376 [00:48<05:34, 3.46it/s] Model Responding: 16%|█▌ | 220/1376 [00:48<05:48, 3.32it/s] Model Responding: 16%|█▌ | 221/1376 [00:49<05:59, 3.21it/s] Model Responding: 16%|█▌ | 222/1376 [00:49<05:42, 3.37it/s] Model Responding: 16%|█▌ | 223/1376 [00:49<05:35, 3.44it/s] Model Responding: 16%|█▋ | 224/1376 [00:50<05:28, 3.50it/s] Model Responding: 16%|█▋ | 225/1376 [00:50<05:23, 3.56it/s] Model Responding: 16%|█▋ | 226/1376 [00:50<05:20, 3.59it/s] Model Responding: 16%|█▋ | 227/1376 [00:50<05:15, 3.64it/s] Model Responding: 17%|█▋ | 228/1376 [00:51<05:32, 3.45it/s] Model Responding: 17%|█▋ | 229/1376 [00:51<04:59, 3.83it/s] Model Responding: 17%|█▋ | 230/1376 [00:51<05:04, 3.76it/s] Model Responding: 17%|█▋ | 231/1376 [00:51<05:06, 3.74it/s] Model Responding: 17%|█▋ | 232/1376 [00:52<05:18, 3.59it/s] Model Responding: 17%|█▋ | 233/1376 [00:52<05:16, 3.61it/s] Model Responding: 17%|█▋ | 234/1376 [00:52<04:53, 3.89it/s] Model Responding: 17%|█▋ | 235/1376 [00:53<05:06, 3.72it/s] Model Responding: 17%|█▋ | 236/1376 [00:53<05:14, 3.63it/s] Model Responding: 17%|█▋ | 237/1376 [00:53<05:21, 3.54it/s] Model Responding: 17%|█▋ | 238/1376 [00:53<05:14, 3.62it/s] Model Responding: 17%|█▋ | 239/1376 [00:54<05:14, 3.62it/s] Model Responding: 17%|█▋ | 240/1376 [00:54<05:12, 3.64it/s] Model Responding: 18%|█▊ | 241/1376 [00:54<05:11, 3.65it/s] Model Responding: 18%|█▊ | 242/1376 [00:55<05:11, 3.64it/s] Model Responding: 18%|█▊ | 243/1376 [00:55<04:44, 3.98it/s] Model Responding: 18%|█▊ | 244/1376 [00:55<04:53, 3.86it/s] Model Responding: 18%|█▊ | 245/1376 [00:55<04:57, 3.80it/s] Model Responding: 18%|█▊ | 246/1376 [00:56<04:56, 3.81it/s] Model Responding: 18%|█▊ | 247/1376 [00:56<04:20, 4.33it/s] Model Responding: 18%|█▊ | 248/1376 [00:56<03:58, 4.72it/s] Model Responding: 18%|█▊ | 249/1376 [00:56<04:19, 4.35it/s] Model Responding: 18%|█▊ | 250/1376 [00:56<04:29, 4.18it/s] Model Responding: 18%|█▊ | 251/1376 [00:57<04:41, 3.99it/s] Model Responding: 18%|█▊ | 252/1376 [00:57<04:48, 3.90it/s] Model Responding: 18%|█▊ | 253/1376 [00:57<04:53, 3.82it/s] Model Responding: 18%|█▊ | 254/1376 [00:57<04:57, 3.77it/s] Model Responding: 19%|█▊ | 255/1376 [00:58<04:25, 4.22it/s] Model Responding: 19%|█▊ | 256/1376 [00:58<04:02, 4.62it/s] Model Responding: 19%|█▊ | 257/1376 [00:58<04:16, 4.36it/s] Model Responding: 19%|█▉ | 258/1376 [00:58<04:30, 4.13it/s] Model Responding: 19%|█▉ | 259/1376 [00:59<04:13, 4.41it/s] Model Responding: 19%|█▉ | 260/1376 [00:59<04:30, 4.13it/s] Model Responding: 19%|█▉ | 261/1376 [00:59<04:37, 4.02it/s] Model Responding: 19%|█▉ | 262/1376 [00:59<04:11, 4.44it/s] Model Responding: 19%|█▉ | 263/1376 [00:59<03:48, 4.87it/s] Model Responding: 19%|█▉ | 264/1376 [01:00<03:36, 5.14it/s] Model Responding: 19%|█▉ | 265/1376 [01:00<03:27, 5.35it/s] Model Responding: 19%|█▉ | 266/1376 [01:00<03:52, 4.78it/s] Model Responding: 19%|█▉ | 267/1376 [01:00<04:09, 4.45it/s] Model Responding: 19%|█▉ | 268/1376 [01:01<04:22, 4.22it/s] Model Responding: 20%|█▉ | 269/1376 [01:01<04:29, 4.11it/s] Model Responding: 20%|█▉ | 270/1376 [01:01<04:57, 3.72it/s] Model Responding: 20%|█▉ | 271/1376 [01:01<05:14, 3.51it/s] Model Responding: 20%|█▉ | 272/1376 [01:02<05:27, 3.37it/s] Model Responding: 20%|█▉ | 273/1376 [01:02<05:16, 3.48it/s] Model Responding: 20%|█▉ | 274/1376 [01:02<04:51, 3.78it/s] Model Responding: 20%|█▉ | 275/1376 [01:03<04:54, 3.74it/s] Model Responding: 20%|██ | 276/1376 [01:03<05:01, 3.64it/s] Model Responding: 20%|██ | 277/1376 [01:03<05:02, 3.64it/s] Model Responding: 20%|██ | 278/1376 [01:03<05:00, 3.65it/s] Model Responding: 20%|██ | 279/1376 [01:04<04:20, 4.21it/s] Model Responding: 20%|██ | 280/1376 [01:04<03:52, 4.71it/s] Model Responding: 20%|██ | 281/1376 [01:04<03:32, 5.15it/s] Model Responding: 20%|██ | 282/1376 [01:04<03:18, 5.51it/s] Model Responding: 21%|██ | 283/1376 [01:04<03:07, 5.82it/s] Model Responding: 21%|██ | 284/1376 [01:04<02:59, 6.08it/s] Model Responding: 21%|██ | 285/1376 [01:04<02:53, 6.27it/s] Model Responding: 21%|██ | 286/1376 [01:05<02:49, 6.42it/s] Model Responding: 21%|██ | 287/1376 [01:05<03:00, 6.03it/s] Model Responding: 21%|██ | 288/1376 [01:05<03:01, 6.01it/s] Model Responding: 21%|██ | 289/1376 [01:05<03:01, 6.00it/s] Model Responding: 21%|██ | 290/1376 [01:05<03:01, 5.98it/s] Model Responding: 21%|██ | 291/1376 [01:06<03:50, 4.71it/s] Model Responding: 21%|██ | 292/1376 [01:06<04:05, 4.41it/s] Model Responding: 21%|██▏ | 293/1376 [01:06<03:55, 4.60it/s] Model Responding: 21%|██▏ | 294/1376 [01:06<03:47, 4.76it/s] Model Responding: 21%|██▏ | 295/1376 [01:06<03:41, 4.88it/s] Model Responding: 22%|██▏ | 296/1376 [01:07<04:03, 4.44it/s] Model Responding: 22%|██▏ | 297/1376 [01:07<04:18, 4.17it/s] Model Responding: 22%|██▏ | 298/1376 [01:07<04:26, 4.04it/s] Model Responding: 22%|██▏ | 299/1376 [01:07<04:30, 3.99it/s] Model Responding: 22%|██▏ | 300/1376 [01:08<04:33, 3.94it/s] Model Responding: 22%|██▏ | 301/1376 [01:08<04:36, 3.89it/s] Model Responding: 22%|██▏ | 302/1376 [01:08<04:37, 3.88it/s] Model Responding: 22%|██▏ | 303/1376 [01:09<04:41, 3.81it/s] Model Responding: 22%|██▏ | 304/1376 [01:09<04:58, 3.59it/s] Model Responding: 22%|██▏ | 305/1376 [01:09<05:09, 3.46it/s] Model Responding: 22%|██▏ | 306/1376 [01:09<05:18, 3.36it/s] Model Responding: 22%|██▏ | 307/1376 [01:10<05:17, 3.37it/s] Model Responding: 22%|██▏ | 308/1376 [01:10<04:37, 3.86it/s] Model Responding: 22%|██▏ | 309/1376 [01:10<04:39, 3.81it/s] Model Responding: 23%|██▎ | 310/1376 [01:10<04:41, 3.79it/s] Model Responding: 23%|██▎ | 311/1376 [01:11<04:42, 3.77it/s] Model Responding: 23%|██▎ | 312/1376 [01:11<04:44, 3.74it/s] Model Responding: 23%|██▎ | 313/1376 [01:11<04:42, 3.77it/s] Model Responding: 23%|██▎ | 314/1376 [01:12<04:45, 3.72it/s] Model Responding: 23%|██▎ | 315/1376 [01:12<04:46, 3.70it/s] Model Responding: 23%|██▎ | 316/1376 [01:12<04:46, 3.69it/s] Model Responding: 23%|██▎ | 317/1376 [01:12<04:47, 3.68it/s] Model Responding: 23%|██▎ | 318/1376 [01:13<04:21, 4.04it/s] Model Responding: 23%|██▎ | 319/1376 [01:13<04:05, 4.31it/s] Model Responding: 23%|██▎ | 320/1376 [01:13<03:53, 4.53it/s] Model Responding: 23%|██▎ | 321/1376 [01:13<04:13, 4.16it/s] Model Responding: 23%|██▎ | 322/1376 [01:14<04:19, 4.07it/s] Model Responding: 23%|██▎ | 323/1376 [01:14<04:23, 4.00it/s] Model Responding: 24%|██▎ | 324/1376 [01:14<04:31, 3.88it/s] Model Responding: 24%|██▎ | 325/1376 [01:14<04:35, 3.82it/s] Model Responding: 24%|██▎ | 326/1376 [01:15<04:38, 3.77it/s] Model Responding: 24%|██▍ | 327/1376 [01:15<04:37, 3.78it/s] Model Responding: 24%|██▍ | 328/1376 [01:15<04:35, 3.81it/s] Model Responding: 24%|██▍ | 329/1376 [01:15<04:33, 3.82it/s] Model Responding: 24%|██▍ | 330/1376 [01:16<04:38, 3.76it/s] Model Responding: 24%|██▍ | 331/1376 [01:16<04:35, 3.79it/s] Model Responding: 24%|██▍ | 332/1376 [01:16<04:55, 3.54it/s] Model Responding: 24%|██▍ | 333/1376 [01:16<04:48, 3.62it/s] Model Responding: 24%|██▍ | 334/1376 [01:17<04:43, 3.67it/s] Model Responding: 24%|██▍ | 335/1376 [01:17<04:41, 3.69it/s] Model Responding: 24%|██▍ | 336/1376 [01:17<04:38, 3.74it/s] Model Responding: 24%|██▍ | 337/1376 [01:18<04:36, 3.75it/s] Model Responding: 25%|██▍ | 338/1376 [01:18<04:34, 3.78it/s] Model Responding: 25%|██▍ | 339/1376 [01:18<04:34, 3.78it/s] Model Responding: 25%|██▍ | 340/1376 [01:18<04:36, 3.75it/s] Model Responding: 25%|██▍ | 341/1376 [01:19<04:18, 4.00it/s] Model Responding: 25%|██▍ | 342/1376 [01:19<04:42, 3.66it/s] Model Responding: 25%|██▍ | 343/1376 [01:19<04:57, 3.48it/s] Model Responding: 25%|██▌ | 344/1376 [01:20<05:08, 3.35it/s] Model Responding: 25%|██▌ | 345/1376 [01:20<05:00, 3.43it/s] Model Responding: 25%|██▌ | 346/1376 [01:20<04:54, 3.50it/s] Model Responding: 25%|██▌ | 347/1376 [01:20<04:50, 3.54it/s] Model Responding: 25%|██▌ | 348/1376 [01:21<04:43, 3.63it/s] Model Responding: 25%|██▌ | 349/1376 [01:21<04:18, 3.98it/s] Model Responding: 25%|██▌ | 350/1376 [01:21<04:04, 4.19it/s] Model Responding: 26%|██▌ | 351/1376 [01:21<04:11, 4.08it/s] Model Responding: 26%|██▌ | 352/1376 [01:22<04:15, 4.00it/s] Model Responding: 26%|██▌ | 353/1376 [01:22<03:58, 4.29it/s] Model Responding: 26%|██▌ | 354/1376 [01:22<03:38, 4.68it/s] Model Responding: 26%|██▌ | 355/1376 [01:22<03:52, 4.39it/s] Model Responding: 26%|██▌ | 356/1376 [01:22<04:04, 4.17it/s] Model Responding: 26%|██▌ | 357/1376 [01:23<04:10, 4.06it/s] Model Responding: 26%|██▌ | 358/1376 [01:23<04:16, 3.98it/s] Model Responding: 26%|██▌ | 359/1376 [01:23<04:18, 3.94it/s] Model Responding: 26%|██▌ | 360/1376 [01:23<04:21, 3.89it/s] Model Responding: 26%|██▌ | 361/1376 [01:24<04:21, 3.88it/s] Model Responding: 26%|██▋ | 362/1376 [01:24<04:23, 3.85it/s] Model Responding: 26%|██▋ | 363/1376 [01:24<03:49, 4.42it/s] Model Responding: 26%|██▋ | 364/1376 [01:24<03:27, 4.87it/s] Model Responding: 27%|██▋ | 365/1376 [01:24<03:10, 5.32it/s] Model Responding: 27%|██▋ | 366/1376 [01:25<03:36, 4.67it/s] Model Responding: 27%|██▋ | 367/1376 [01:25<03:29, 4.82it/s] Model Responding: 27%|██▋ | 368/1376 [01:25<03:24, 4.92it/s] Model Responding: 27%|██▋ | 369/1376 [01:25<03:20, 5.02it/s] Model Responding: 27%|██▋ | 370/1376 [01:26<03:42, 4.51it/s] Model Responding: 27%|██▋ | 371/1376 [01:26<04:14, 3.95it/s] Model Responding: 27%|██▋ | 372/1376 [01:26<04:19, 3.87it/s] Model Responding: 27%|██▋ | 373/1376 [01:26<04:20, 3.84it/s] Model Responding: 27%|██▋ | 374/1376 [01:27<04:20, 3.85it/s] Model Responding: 27%|██▋ | 375/1376 [01:27<04:20, 3.85it/s] Model Responding: 27%|██▋ | 376/1376 [01:27<04:19, 3.85it/s] Model Responding: 27%|██▋ | 377/1376 [01:27<04:20, 3.83it/s] Model Responding: 27%|██▋ | 378/1376 [01:28<04:19, 3.85it/s] Model Responding: 28%|██▊ | 379/1376 [01:28<04:19, 3.85it/s] Model Responding: 28%|██▊ | 380/1376 [01:28<04:20, 3.83it/s] Model Responding: 28%|██▊ | 381/1376 [01:28<03:52, 4.28it/s] Model Responding: 28%|██▊ | 382/1376 [01:29<03:26, 4.80it/s] Model Responding: 28%|██▊ | 383/1376 [01:29<03:08, 5.27it/s] Model Responding: 28%|██▊ | 384/1376 [01:29<02:55, 5.65it/s] Model Responding: 28%|██▊ | 385/1376 [01:29<02:59, 5.52it/s] Model Responding: 28%|██▊ | 386/1376 [01:29<03:23, 4.87it/s] Model Responding: 28%|██▊ | 387/1376 [01:30<03:55, 4.20it/s] Model Responding: 28%|██▊ | 388/1376 [01:30<03:42, 4.44it/s] Model Responding: 28%|██▊ | 389/1376 [01:30<03:53, 4.24it/s] Model Responding: 28%|██▊ | 390/1376 [01:30<03:59, 4.12it/s] Model Responding: 28%|██▊ | 391/1376 [01:31<03:44, 4.38it/s] Model Responding: 28%|██▊ | 392/1376 [01:31<03:26, 4.75it/s] Model Responding: 29%|██▊ | 393/1376 [01:31<03:51, 4.24it/s] Model Responding: 29%|██▊ | 394/1376 [01:31<03:58, 4.12it/s] Model Responding: 29%|██▊ | 395/1376 [01:32<04:21, 3.75it/s] Model Responding: 29%|██▉ | 396/1376 [01:32<04:19, 3.78it/s] Model Responding: 29%|██▉ | 397/1376 [01:32<04:38, 3.51it/s] Model Responding: 29%|██▉ | 398/1376 [01:33<04:50, 3.36it/s] Model Responding: 29%|██▉ | 399/1376 [01:33<05:00, 3.25it/s] Model Responding: 29%|██▉ | 400/1376 [01:33<04:27, 3.65it/s] Model Responding: 29%|██▉ | 401/1376 [01:33<04:03, 4.00it/s] Model Responding: 29%|██▉ | 402/1376 [01:33<03:46, 4.29it/s] Model Responding: 29%|██▉ | 403/1376 [01:34<03:21, 4.83it/s] Model Responding: 29%|██▉ | 404/1376 [01:34<03:36, 4.49it/s] Model Responding: 29%|██▉ | 405/1376 [01:34<03:47, 4.28it/s] Model Responding: 30%|██▉ | 406/1376 [01:34<03:54, 4.14it/s] Model Responding: 30%|██▉ | 407/1376 [01:35<03:44, 4.31it/s] Model Responding: 30%|██▉ | 408/1376 [01:35<03:26, 4.69it/s] Model Responding: 30%|██▉ | 409/1376 [01:35<03:41, 4.37it/s] Model Responding: 30%|██▉ | 410/1376 [01:35<03:49, 4.20it/s] Model Responding: 30%|██▉ | 411/1376 [01:36<03:55, 4.10it/s] Model Responding: 30%|██▉ | 412/1376 [01:36<03:59, 4.03it/s] Model Responding: 30%|███ | 413/1376 [01:36<04:05, 3.92it/s] Model Responding: 30%|███ | 414/1376 [01:36<04:10, 3.84it/s] Model Responding: 30%|███ | 415/1376 [01:37<04:11, 3.82it/s] Model Responding: 30%|███ | 416/1376 [01:37<03:56, 4.06it/s] Model Responding: 30%|███ | 417/1376 [01:37<03:28, 4.60it/s] Model Responding: 30%|███ | 418/1376 [01:37<03:40, 4.34it/s] Model Responding: 30%|███ | 419/1376 [01:37<03:34, 4.47it/s] Model Responding: 31%|███ | 420/1376 [01:38<03:22, 4.73it/s] Model Responding: 31%|███ | 421/1376 [01:38<03:21, 4.73it/s] Model Responding: 31%|███ | 422/1376 [01:38<03:36, 4.42it/s] Model Responding: 31%|███ | 423/1376 [01:38<03:45, 4.23it/s] Model Responding: 31%|███ | 424/1376 [01:38<03:25, 4.62it/s] Model Responding: 31%|███ | 425/1376 [01:39<03:24, 4.66it/s] Model Responding: 31%|███ | 426/1376 [01:39<03:02, 5.22it/s] Model Responding: 31%|███ | 427/1376 [01:39<03:05, 5.12it/s] Model Responding: 31%|███ | 428/1376 [01:39<03:25, 4.61it/s] Model Responding: 31%|███ | 429/1376 [01:40<03:49, 4.13it/s] Model Responding: 31%|███▏ | 430/1376 [01:40<04:07, 3.82it/s] Model Responding: 31%|███▏ | 431/1376 [01:40<04:18, 3.66it/s] Model Responding: 31%|███▏ | 432/1376 [01:40<04:15, 3.70it/s] Model Responding: 31%|███▏ | 433/1376 [01:41<04:14, 3.70it/s] Model Responding: 32%|███▏ | 434/1376 [01:41<04:14, 3.70it/s] Model Responding: 32%|███▏ | 435/1376 [01:41<04:13, 3.71it/s] Model Responding: 32%|███▏ | 436/1376 [01:42<04:29, 3.49it/s] Model Responding: 32%|███▏ | 437/1376 [01:42<04:07, 3.80it/s] Model Responding: 32%|███▏ | 438/1376 [01:42<03:53, 4.02it/s] Model Responding: 32%|███▏ | 439/1376 [01:42<03:42, 4.22it/s] Model Responding: 32%|███▏ | 440/1376 [01:42<03:24, 4.59it/s] Model Responding: 32%|███▏ | 441/1376 [01:43<03:11, 4.88it/s] Model Responding: 32%|███▏ | 442/1376 [01:43<03:02, 5.11it/s] Model Responding: 32%|███▏ | 443/1376 [01:43<02:59, 5.19it/s] Model Responding: 32%|███▏ | 444/1376 [01:43<02:55, 5.31it/s] Model Responding: 32%|███▏ | 445/1376 [01:43<02:51, 5.43it/s] Model Responding: 32%|███▏ | 446/1376 [01:44<03:16, 4.74it/s] Model Responding: 32%|███▏ | 447/1376 [01:44<03:31, 4.38it/s] Model Responding: 33%|███▎ | 448/1376 [01:44<03:40, 4.21it/s] Model Responding: 33%|███▎ | 449/1376 [01:44<03:26, 4.50it/s] Model Responding: 33%|███▎ | 450/1376 [01:45<03:36, 4.28it/s] Model Responding: 33%|███▎ | 451/1376 [01:45<03:46, 4.08it/s] Model Responding: 33%|███▎ | 452/1376 [01:45<03:51, 3.99it/s] Model Responding: 33%|███▎ | 453/1376 [01:45<03:58, 3.87it/s] Model Responding: 33%|███▎ | 454/1376 [01:46<04:02, 3.81it/s] Model Responding: 33%|███▎ | 455/1376 [01:46<04:05, 3.75it/s] Model Responding: 33%|███▎ | 456/1376 [01:46<03:50, 3.99it/s] Model Responding: 33%|███▎ | 457/1376 [01:46<04:09, 3.69it/s] Model Responding: 33%|███▎ | 458/1376 [01:47<04:05, 3.73it/s] Model Responding: 33%|███▎ | 459/1376 [01:47<04:04, 3.74it/s] Model Responding: 33%|███▎ | 460/1376 [01:47<04:14, 3.60it/s] Model Responding: 34%|███▎ | 461/1376 [01:48<04:11, 3.63it/s] Model Responding: 34%|███▎ | 462/1376 [01:48<04:11, 3.63it/s] Model Responding: 34%|███▎ | 463/1376 [01:48<04:10, 3.65it/s] Model Responding: 34%|███▎ | 464/1376 [01:48<04:08, 3.67it/s] Model Responding: 34%|███▍ | 465/1376 [01:49<04:07, 3.68it/s] Model Responding: 34%|███▍ | 466/1376 [01:49<04:07, 3.68it/s] Model Responding: 34%|███▍ | 467/1376 [01:49<04:17, 3.53it/s] Model Responding: 34%|███▍ | 468/1376 [01:50<04:25, 3.43it/s] Model Responding: 34%|███▍ | 469/1376 [01:50<03:47, 3.99it/s] Model Responding: 34%|███▍ | 470/1376 [01:50<03:20, 4.53it/s] Model Responding: 34%|███▍ | 471/1376 [01:50<03:00, 5.00it/s] Model Responding: 34%|███▍ | 472/1376 [01:50<03:35, 4.20it/s] Model Responding: 34%|███▍ | 473/1376 [01:50<03:11, 4.71it/s] Model Responding: 34%|███▍ | 474/1376 [01:51<02:55, 5.15it/s] Model Responding: 35%|███▍ | 475/1376 [01:51<02:42, 5.53it/s] Model Responding: 35%|███▍ | 476/1376 [01:51<03:07, 4.80it/s] Model Responding: 35%|███▍ | 477/1376 [01:51<03:02, 4.94it/s] Model Responding: 35%|███▍ | 478/1376 [01:51<02:58, 5.02it/s] Model Responding: 35%|███▍ | 479/1376 [01:52<03:15, 4.59it/s] Model Responding: 35%|███▍ | 480/1376 [01:52<03:26, 4.33it/s] Model Responding: 35%|███▍ | 481/1376 [01:52<03:06, 4.80it/s] Model Responding: 35%|███▌ | 482/1376 [01:52<02:51, 5.20it/s] Model Responding: 35%|███▌ | 483/1376 [01:52<02:41, 5.52it/s] Model Responding: 35%|███▌ | 484/1376 [01:53<03:02, 4.88it/s] Model Responding: 35%|███▌ | 485/1376 [01:53<03:31, 4.22it/s] Model Responding: 35%|███▌ | 486/1376 [01:53<03:51, 3.84it/s] Model Responding: 35%|███▌ | 487/1376 [01:53<03:22, 4.39it/s] Model Responding: 35%|███▌ | 488/1376 [01:54<03:01, 4.89it/s] Model Responding: 36%|███▌ | 489/1376 [01:54<03:30, 4.21it/s] Model Responding: 36%|███▌ | 490/1376 [01:54<03:07, 4.72it/s] Model Responding: 36%|███▌ | 491/1376 [01:54<02:56, 5.00it/s] Model Responding: 36%|███▌ | 492/1376 [01:54<02:48, 5.25it/s] Model Responding: 36%|███▌ | 493/1376 [01:55<02:42, 5.44it/s] Model Responding: 36%|███▌ | 494/1376 [01:55<03:16, 4.49it/s] Model Responding: 36%|███▌ | 495/1376 [01:55<03:25, 4.28it/s] Model Responding: 36%|███▌ | 496/1376 [01:55<03:32, 4.15it/s] Model Responding: 36%|███▌ | 497/1376 [01:56<03:37, 4.04it/s] Model Responding: 36%|███▌ | 498/1376 [01:56<03:22, 4.34it/s] Model Responding: 36%|███▋ | 499/1376 [01:56<03:11, 4.57it/s] Model Responding: 36%|███▋ | 500/1376 [01:56<03:03, 4.77it/s] Model Responding: 36%|███▋ | 501/1376 [01:56<02:58, 4.91it/s] Model Responding: 36%|███▋ | 502/1376 [01:57<02:54, 5.02it/s] Model Responding: 37%|███▋ | 503/1376 [01:57<03:26, 4.22it/s] Model Responding: 37%|███▋ | 504/1376 [01:57<03:14, 4.47it/s] Model Responding: 37%|███▋ | 505/1376 [01:57<03:01, 4.81it/s] Model Responding: 37%|███▋ | 506/1376 [01:57<02:46, 5.21it/s] Model Responding: 37%|███▋ | 507/1376 [01:58<02:40, 5.42it/s] Model Responding: 37%|███▋ | 508/1376 [01:58<02:35, 5.57it/s] Model Responding: 37%|███▋ | 509/1376 [01:58<02:59, 4.82it/s] Model Responding: 37%|███▋ | 510/1376 [01:58<02:55, 4.94it/s] Model Responding: 37%|███▋ | 511/1376 [01:58<02:56, 4.91it/s] Model Responding: 37%|███▋ | 512/1376 [01:59<03:10, 4.54it/s] Model Responding: 37%|███▋ | 513/1376 [01:59<03:23, 4.25it/s] Model Responding: 37%|███▋ | 514/1376 [01:59<03:31, 4.07it/s] Model Responding: 37%|███▋ | 515/1376 [01:59<03:21, 4.27it/s] Model Responding: 38%|███▊ | 516/1376 [02:00<03:14, 4.41it/s] Model Responding: 38%|███▊ | 517/1376 [02:00<03:09, 4.54it/s] Model Responding: 38%|███▊ | 518/1376 [02:00<03:20, 4.28it/s] Model Responding: 38%|███▊ | 519/1376 [02:00<03:30, 4.08it/s] Model Responding: 38%|███▊ | 520/1376 [02:01<03:38, 3.93it/s] Model Responding: 38%|███▊ | 521/1376 [02:01<03:41, 3.85it/s] Model Responding: 38%|███▊ | 522/1376 [02:01<03:19, 4.28it/s] Model Responding: 38%|███▊ | 523/1376 [02:01<03:30, 4.05it/s] Model Responding: 38%|███▊ | 524/1376 [02:02<03:36, 3.94it/s] Model Responding: 38%|███▊ | 525/1376 [02:02<03:40, 3.87it/s] Model Responding: 38%|███▊ | 526/1376 [02:02<03:42, 3.81it/s] Model Responding: 38%|███▊ | 527/1376 [02:03<03:44, 3.78it/s] Model Responding: 38%|███▊ | 528/1376 [02:03<03:23, 4.16it/s] Model Responding: 38%|███▊ | 529/1376 [02:03<03:38, 3.88it/s] Model Responding: 39%|███▊ | 530/1376 [02:03<03:25, 4.11it/s] Model Responding: 39%|███▊ | 531/1376 [02:03<03:30, 4.01it/s] Model Responding: 39%|███▊ | 532/1376 [02:04<03:32, 3.96it/s] Model Responding: 39%|███▊ | 533/1376 [02:04<03:34, 3.94it/s] Model Responding: 39%|███▉ | 534/1376 [02:04<03:13, 4.36it/s] Model Responding: 39%|███▉ | 535/1376 [02:04<03:01, 4.62it/s] Model Responding: 39%|███▉ | 536/1376 [02:05<02:50, 4.93it/s] Model Responding: 39%|███▉ | 537/1376 [02:05<02:47, 5.02it/s] Model Responding: 39%|███▉ | 538/1376 [02:05<03:05, 4.52it/s] Model Responding: 39%|███▉ | 539/1376 [02:05<03:03, 4.55it/s] Model Responding: 39%|███▉ | 540/1376 [02:05<03:03, 4.56it/s] Model Responding: 39%|███▉ | 541/1376 [02:06<03:01, 4.59it/s] Model Responding: 39%|███▉ | 542/1376 [02:06<02:54, 4.78it/s] Model Responding: 39%|███▉ | 543/1376 [02:06<02:44, 5.05it/s] Model Responding: 40%|███▉ | 544/1376 [02:06<02:38, 5.26it/s] Model Responding: 40%|███▉ | 545/1376 [02:06<02:33, 5.41it/s] Model Responding: 40%|███▉ | 546/1376 [02:06<02:30, 5.53it/s] Model Responding: 40%|███▉ | 547/1376 [02:07<02:36, 5.31it/s] Model Responding: 40%|███▉ | 548/1376 [02:07<02:40, 5.15it/s] Model Responding: 40%|███▉ | 549/1376 [02:07<02:43, 5.06it/s] Model Responding: 40%|███▉ | 550/1376 [02:07<02:45, 5.00it/s] Model Responding: 40%|████ | 551/1376 [02:08<02:47, 4.93it/s] Model Responding: 40%|████ | 552/1376 [02:08<02:28, 5.54it/s] Model Responding: 40%|████ | 553/1376 [02:08<02:51, 4.81it/s] Model Responding: 40%|████ | 554/1376 [02:08<03:04, 4.45it/s] Model Responding: 40%|████ | 555/1376 [02:08<03:14, 4.22it/s] Model Responding: 40%|████ | 556/1376 [02:09<03:19, 4.10it/s] Model Responding: 40%|████ | 557/1376 [02:09<03:26, 3.97it/s] Model Responding: 41%|████ | 558/1376 [02:09<03:27, 3.94it/s] Model Responding: 41%|████ | 559/1376 [02:09<03:16, 4.15it/s] Model Responding: 41%|████ | 560/1376 [02:10<03:07, 4.34it/s] Model Responding: 41%|████ | 561/1376 [02:10<03:01, 4.48it/s] Model Responding: 41%|████ | 562/1376 [02:10<03:12, 4.23it/s] Model Responding: 41%|████ | 563/1376 [02:10<03:19, 4.07it/s] Model Responding: 41%|████ | 564/1376 [02:11<03:25, 3.95it/s] Model Responding: 41%|████ | 565/1376 [02:11<03:36, 3.74it/s] Model Responding: 41%|████ | 566/1376 [02:11<03:13, 4.19it/s] Model Responding: 41%|████ | 567/1376 [02:11<02:57, 4.56it/s] Model Responding: 41%|████▏ | 568/1376 [02:11<02:40, 5.04it/s] Model Responding: 41%|████▏ | 569/1376 [02:12<02:33, 5.27it/s] Model Responding: 41%|████▏ | 570/1376 [02:12<02:52, 4.66it/s] Model Responding: 41%|████▏ | 571/1376 [02:12<03:06, 4.32it/s] Model Responding: 42%|████▏ | 572/1376 [02:12<03:15, 4.11it/s] Model Responding: 42%|████▏ | 573/1376 [02:13<03:18, 4.04it/s] Model Responding: 42%|████▏ | 574/1376 [02:13<03:21, 3.98it/s] Model Responding: 42%|████▏ | 575/1376 [02:13<03:24, 3.91it/s] Model Responding: 42%|████▏ | 576/1376 [02:14<03:24, 3.90it/s] Model Responding: 42%|████▏ | 577/1376 [02:14<03:25, 3.89it/s] Model Responding: 42%|████▏ | 578/1376 [02:14<03:15, 4.08it/s] Model Responding: 42%|████▏ | 579/1376 [02:14<03:18, 4.01it/s] Model Responding: 42%|████▏ | 580/1376 [02:14<03:20, 3.98it/s] Model Responding: 42%|████▏ | 581/1376 [02:15<03:21, 3.95it/s] Model Responding: 42%|████▏ | 582/1376 [02:15<03:38, 3.64it/s] Model Responding: 42%|████▏ | 583/1376 [02:15<03:34, 3.70it/s] Model Responding: 42%|████▏ | 584/1376 [02:16<03:35, 3.68it/s] Model Responding: 43%|████▎ | 585/1376 [02:16<03:34, 3.68it/s] Model Responding: 43%|████▎ | 586/1376 [02:16<03:35, 3.67it/s] Model Responding: 43%|████▎ | 587/1376 [02:16<03:31, 3.73it/s] Model Responding: 43%|████▎ | 588/1376 [02:17<03:42, 3.54it/s] Model Responding: 43%|████▎ | 589/1376 [02:17<03:49, 3.43it/s] Model Responding: 43%|████▎ | 590/1376 [02:17<03:54, 3.35it/s] Model Responding: 43%|████▎ | 591/1376 [02:18<03:46, 3.47it/s] Model Responding: 43%|████▎ | 592/1376 [02:18<03:40, 3.56it/s] Model Responding: 43%|████▎ | 593/1376 [02:18<03:34, 3.65it/s] Model Responding: 43%|████▎ | 594/1376 [02:18<03:30, 3.71it/s] Model Responding: 43%|████▎ | 595/1376 [02:19<03:15, 3.99it/s] Model Responding: 43%|████▎ | 596/1376 [02:19<03:30, 3.71it/s] Model Responding: 43%|████▎ | 597/1376 [02:19<03:27, 3.75it/s] Model Responding: 43%|████▎ | 598/1376 [02:19<03:26, 3.76it/s] Model Responding: 44%|████▎ | 599/1376 [02:20<03:24, 3.80it/s] Model Responding: 44%|████▎ | 600/1376 [02:20<03:33, 3.64it/s] Model Responding: 44%|████▎ | 601/1376 [02:20<03:39, 3.54it/s] Model Responding: 44%|████▍ | 602/1376 [02:21<03:43, 3.46it/s] Model Responding: 44%|████▍ | 603/1376 [02:21<03:36, 3.57it/s] Model Responding: 44%|████▍ | 604/1376 [02:21<03:32, 3.63it/s] Model Responding: 44%|████▍ | 605/1376 [02:21<03:03, 4.20it/s] Model Responding: 44%|████▍ | 606/1376 [02:21<02:43, 4.72it/s] Model Responding: 44%|████▍ | 607/1376 [02:22<02:28, 5.19it/s] Model Responding: 44%|████▍ | 608/1376 [02:22<02:46, 4.62it/s] Model Responding: 44%|████▍ | 609/1376 [02:22<02:43, 4.69it/s] Model Responding: 44%|████▍ | 610/1376 [02:22<02:30, 5.10it/s] Model Responding: 44%|████▍ | 611/1376 [02:22<02:32, 5.00it/s] Model Responding: 44%|████▍ | 612/1376 [02:23<02:29, 5.10it/s] Model Responding: 45%|████▍ | 613/1376 [02:23<02:45, 4.60it/s] Model Responding: 45%|████▍ | 614/1376 [02:23<02:37, 4.83it/s] Model Responding: 45%|████▍ | 615/1376 [02:23<02:39, 4.79it/s] Model Responding: 45%|████▍ | 616/1376 [02:23<02:25, 5.24it/s] Model Responding: 45%|████▍ | 617/1376 [02:24<02:15, 5.62it/s] Model Responding: 45%|████▍ | 618/1376 [02:24<02:33, 4.95it/s] Model Responding: 45%|████▍ | 619/1376 [02:24<02:30, 5.04it/s] Model Responding: 45%|████▌ | 620/1376 [02:24<02:19, 5.44it/s] Model Responding: 45%|████▌ | 621/1376 [02:24<02:11, 5.76it/s] Model Responding: 45%|████▌ | 622/1376 [02:25<02:30, 5.01it/s] Model Responding: 45%|████▌ | 623/1376 [02:25<02:28, 5.09it/s] Model Responding: 45%|████▌ | 624/1376 [02:25<02:50, 4.42it/s] Model Responding: 45%|████▌ | 625/1376 [02:25<02:33, 4.90it/s] Model Responding: 45%|████▌ | 626/1376 [02:25<02:31, 4.96it/s] Model Responding: 46%|████▌ | 627/1376 [02:26<02:25, 5.14it/s] Model Responding: 46%|████▌ | 628/1376 [02:26<02:43, 4.59it/s] Model Responding: 46%|████▌ | 629/1376 [02:26<02:37, 4.73it/s] Model Responding: 46%|████▌ | 630/1376 [02:26<02:23, 5.19it/s] Model Responding: 46%|████▌ | 631/1376 [02:26<02:13, 5.59it/s] Model Responding: 46%|████▌ | 632/1376 [02:27<02:30, 4.93it/s] Model Responding: 46%|████▌ | 633/1376 [02:27<02:27, 5.05it/s] Model Responding: 46%|████▌ | 634/1376 [02:27<02:25, 5.12it/s] Model Responding: 46%|████▌ | 635/1376 [02:27<02:14, 5.52it/s] Model Responding: 46%|████▌ | 636/1376 [02:27<02:15, 5.47it/s] Model Responding: 46%|████▋ | 637/1376 [02:27<02:09, 5.73it/s] Model Responding: 46%|████▋ | 638/1376 [02:28<02:30, 4.90it/s] Model Responding: 46%|████▋ | 639/1376 [02:28<02:28, 4.98it/s] Model Responding: 47%|████▋ | 640/1376 [02:28<02:25, 5.06it/s] Model Responding: 47%|████▋ | 641/1376 [02:28<02:24, 5.10it/s] Model Responding: 47%|████▋ | 642/1376 [02:29<02:26, 5.02it/s] Model Responding: 47%|████▋ | 643/1376 [02:29<02:27, 4.97it/s] Model Responding: 47%|████▋ | 644/1376 [02:29<02:42, 4.50it/s] Model Responding: 47%|████▋ | 645/1376 [02:29<02:36, 4.68it/s] Model Responding: 47%|████▋ | 646/1376 [02:29<02:34, 4.73it/s] Model Responding: 47%|████▋ | 647/1376 [02:30<02:45, 4.41it/s] Model Responding: 47%|████▋ | 648/1376 [02:30<02:52, 4.23it/s] Model Responding: 47%|████▋ | 649/1376 [02:30<02:56, 4.11it/s] Model Responding: 47%|████▋ | 650/1376 [02:30<02:36, 4.64it/s] Model Responding: 47%|████▋ | 651/1376 [02:31<02:30, 4.82it/s] Model Responding: 47%|████▋ | 652/1376 [02:31<02:15, 5.36it/s] Model Responding: 47%|████▋ | 653/1376 [02:31<02:06, 5.73it/s] Model Responding: 48%|████▊ | 654/1376 [02:31<02:24, 5.01it/s] Model Responding: 48%|████▊ | 655/1376 [02:31<02:36, 4.60it/s] Model Responding: 48%|████▊ | 656/1376 [02:32<02:45, 4.36it/s] Model Responding: 48%|████▊ | 657/1376 [02:32<02:53, 4.13it/s] Model Responding: 48%|████▊ | 658/1376 [02:32<02:35, 4.62it/s] Model Responding: 48%|████▊ | 659/1376 [02:32<02:34, 4.63it/s] Model Responding: 48%|████▊ | 660/1376 [02:32<02:35, 4.62it/s] Model Responding: 48%|████▊ | 661/1376 [02:33<02:34, 4.63it/s] Model Responding: 48%|████▊ | 662/1376 [02:33<02:43, 4.37it/s] Model Responding: 48%|████▊ | 663/1376 [02:33<02:38, 4.51it/s] Model Responding: 48%|████▊ | 664/1376 [02:33<02:45, 4.30it/s] Model Responding: 48%|████▊ | 665/1376 [02:34<02:36, 4.54it/s] Model Responding: 48%|████▊ | 666/1376 [02:34<02:43, 4.33it/s] Model Responding: 48%|████▊ | 667/1376 [02:34<02:52, 4.12it/s] Model Responding: 49%|████▊ | 668/1376 [02:34<02:55, 4.02it/s] Model Responding: 49%|████▊ | 669/1376 [02:35<02:58, 3.97it/s] Model Responding: 49%|████▊ | 670/1376 [02:35<03:01, 3.90it/s] Model Responding: 49%|████▉ | 671/1376 [02:35<03:01, 3.89it/s] Model Responding: 49%|████▉ | 672/1376 [02:35<02:51, 4.11it/s] Model Responding: 49%|████▉ | 673/1376 [02:36<02:54, 4.03it/s] Model Responding: 49%|████▉ | 674/1376 [02:36<02:56, 3.99it/s] Model Responding: 49%|████▉ | 675/1376 [02:36<02:57, 3.96it/s] Model Responding: 49%|████▉ | 676/1376 [02:36<02:57, 3.93it/s] Model Responding: 49%|████▉ | 677/1376 [02:37<02:58, 3.92it/s] Model Responding: 49%|████▉ | 678/1376 [02:37<02:58, 3.90it/s] Model Responding: 49%|████▉ | 679/1376 [02:37<02:58, 3.91it/s] Model Responding: 49%|████▉ | 680/1376 [02:37<03:07, 3.72it/s] Model Responding: 49%|████▉ | 681/1376 [02:38<03:19, 3.48it/s] Model Responding: 50%|████▉ | 682/1376 [02:38<03:16, 3.54it/s] Model Responding: 50%|████▉ | 683/1376 [02:38<02:49, 4.08it/s] Model Responding: 50%|████▉ | 684/1376 [02:38<02:53, 3.99it/s] Model Responding: 50%|████▉ | 685/1376 [02:39<02:54, 3.96it/s] Model Responding: 50%|████▉ | 686/1376 [02:39<02:55, 3.93it/s] Model Responding: 50%|████▉ | 687/1376 [02:39<02:57, 3.89it/s] Model Responding: 50%|█████ | 688/1376 [02:40<02:57, 3.89it/s] Model Responding: 50%|█████ | 689/1376 [02:40<02:59, 3.83it/s] Model Responding: 50%|█████ | 690/1376 [02:40<02:59, 3.82it/s] Model Responding: 50%|█████ | 691/1376 [02:40<03:12, 3.56it/s] Model Responding: 50%|█████ | 692/1376 [02:41<03:07, 3.65it/s] Model Responding: 50%|█████ | 693/1376 [02:41<02:51, 3.98it/s] Model Responding: 50%|█████ | 694/1376 [02:41<02:59, 3.79it/s] Model Responding: 51%|█████ | 695/1376 [02:41<03:05, 3.67it/s] Model Responding: 51%|█████ | 696/1376 [02:42<03:10, 3.57it/s] Model Responding: 51%|█████ | 697/1376 [02:42<02:43, 4.14it/s] Model Responding: 51%|█████ | 698/1376 [02:42<02:25, 4.65it/s] Model Responding: 51%|█████ | 699/1376 [02:42<02:35, 4.36it/s] Model Responding: 51%|█████ | 700/1376 [02:43<02:41, 4.20it/s] Model Responding: 51%|█████ | 701/1376 [02:43<02:31, 4.45it/s] Model Responding: 51%|█████ | 702/1376 [02:43<02:39, 4.23it/s] Model Responding: 51%|█████ | 703/1376 [02:43<02:43, 4.12it/s] Model Responding: 51%|█████ | 704/1376 [02:44<02:47, 4.01it/s] Model Responding: 51%|█████ | 705/1376 [02:44<02:28, 4.51it/s] Model Responding: 51%|█████▏ | 706/1376 [02:44<02:15, 4.95it/s] Model Responding: 51%|█████▏ | 707/1376 [02:44<02:27, 4.53it/s] Model Responding: 51%|█████▏ | 708/1376 [02:44<02:48, 3.96it/s] Model Responding: 52%|█████▏ | 709/1376 [02:45<02:36, 4.26it/s] Model Responding: 52%|█████▏ | 710/1376 [02:45<02:24, 4.62it/s] Model Responding: 52%|█████▏ | 711/1376 [02:45<02:32, 4.36it/s] Model Responding: 52%|█████▏ | 712/1376 [02:45<02:38, 4.20it/s] Model Responding: 52%|█████▏ | 713/1376 [02:46<02:42, 4.08it/s] Model Responding: 52%|█████▏ | 714/1376 [02:46<02:45, 4.00it/s] Model Responding: 52%|█████▏ | 715/1376 [02:46<02:46, 3.97it/s] Model Responding: 52%|█████▏ | 716/1376 [02:46<02:48, 3.93it/s] Model Responding: 52%|█████▏ | 717/1376 [02:47<02:49, 3.88it/s] Model Responding: 52%|█████▏ | 718/1376 [02:47<02:35, 4.22it/s] Model Responding: 52%|█████▏ | 719/1376 [02:47<02:23, 4.58it/s] Model Responding: 52%|█████▏ | 720/1376 [02:47<02:15, 4.84it/s] Model Responding: 52%|█████▏ | 721/1376 [02:47<02:08, 5.08it/s] Model Responding: 52%|█████▏ | 722/1376 [02:48<02:21, 4.63it/s] Model Responding: 53%|█████▎ | 723/1376 [02:48<02:29, 4.37it/s] Model Responding: 53%|█████▎ | 724/1376 [02:48<02:34, 4.22it/s] Model Responding: 53%|█████▎ | 725/1376 [02:48<02:28, 4.39it/s] Model Responding: 53%|█████▎ | 726/1376 [02:49<02:23, 4.52it/s] Model Responding: 53%|█████▎ | 727/1376 [02:49<02:21, 4.59it/s] Model Responding: 53%|█████▎ | 728/1376 [02:49<02:09, 5.02it/s] Model Responding: 53%|█████▎ | 729/1376 [02:49<01:59, 5.40it/s] Model Responding: 53%|█████▎ | 730/1376 [02:49<01:53, 5.69it/s] Model Responding: 53%|█████▎ | 731/1376 [02:50<02:22, 4.52it/s] Model Responding: 53%|█████▎ | 732/1376 [02:50<02:32, 4.24it/s] Model Responding: 53%|█████▎ | 733/1376 [02:50<02:26, 4.40it/s] Model Responding: 53%|█████▎ | 734/1376 [02:50<02:46, 3.87it/s] Model Responding: 53%|█████▎ | 735/1376 [02:50<02:25, 4.41it/s] Model Responding: 53%|█████▎ | 736/1376 [02:51<02:31, 4.22it/s] Model Responding: 54%|█████▎ | 737/1376 [02:51<02:15, 4.73it/s] Model Responding: 54%|█████▎ | 738/1376 [02:51<02:03, 5.16it/s] Model Responding: 54%|█████▎ | 739/1376 [02:51<02:18, 4.60it/s] Model Responding: 54%|█████▍ | 740/1376 [02:52<02:15, 4.69it/s] Model Responding: 54%|█████▍ | 741/1376 [02:52<02:14, 4.74it/s] Model Responding: 54%|█████▍ | 742/1376 [02:52<02:12, 4.79it/s] Model Responding: 54%|█████▍ | 743/1376 [02:52<02:10, 4.83it/s] Model Responding: 54%|█████▍ | 744/1376 [02:52<02:07, 4.95it/s] Model Responding: 54%|█████▍ | 745/1376 [02:53<02:08, 4.92it/s] Model Responding: 54%|█████▍ | 746/1376 [02:53<02:08, 4.91it/s] Model Responding: 54%|█████▍ | 747/1376 [02:53<02:21, 4.45it/s] Model Responding: 54%|█████▍ | 748/1376 [02:53<02:08, 4.87it/s] Model Responding: 54%|█████▍ | 749/1376 [02:53<01:58, 5.29it/s] Model Responding: 55%|█████▍ | 750/1376 [02:54<02:17, 4.55it/s] Model Responding: 55%|█████▍ | 751/1376 [02:54<02:05, 5.00it/s] Model Responding: 55%|█████▍ | 752/1376 [02:54<01:59, 5.22it/s] Model Responding: 55%|█████▍ | 753/1376 [02:54<01:57, 5.32it/s] Model Responding: 55%|█████▍ | 754/1376 [02:54<01:49, 5.66it/s] Model Responding: 55%|█████▍ | 755/1376 [02:54<01:42, 6.04it/s] Model Responding: 55%|█████▍ | 756/1376 [02:55<02:02, 5.06it/s] Model Responding: 55%|█████▌ | 757/1376 [02:55<02:19, 4.42it/s] Model Responding: 55%|█████▌ | 758/1376 [02:55<02:17, 4.51it/s] Model Responding: 55%|█████▌ | 759/1376 [02:55<02:26, 4.22it/s] Model Responding: 55%|█████▌ | 760/1376 [02:56<02:40, 3.85it/s] Model Responding: 55%|█████▌ | 761/1376 [02:56<02:27, 4.18it/s] Model Responding: 55%|█████▌ | 762/1376 [02:56<02:17, 4.46it/s] Model Responding: 55%|█████▌ | 763/1376 [02:56<02:11, 4.67it/s] Model Responding: 56%|█████▌ | 764/1376 [02:57<02:21, 4.32it/s] Model Responding: 56%|█████▌ | 765/1376 [02:57<02:07, 4.80it/s] Model Responding: 56%|█████▌ | 766/1376 [02:57<02:18, 4.39it/s] Model Responding: 56%|█████▌ | 767/1376 [02:57<02:05, 4.86it/s] Model Responding: 56%|█████▌ | 768/1376 [02:58<02:21, 4.30it/s] Model Responding: 56%|█████▌ | 769/1376 [02:58<02:31, 4.01it/s] Model Responding: 56%|█████▌ | 770/1376 [02:58<02:38, 3.82it/s] Model Responding: 56%|█████▌ | 771/1376 [02:58<02:26, 4.14it/s] Model Responding: 56%|█████▌ | 772/1376 [02:58<02:18, 4.36it/s] Model Responding: 56%|█████▌ | 773/1376 [02:59<02:13, 4.51it/s] Model Responding: 56%|█████▋ | 774/1376 [02:59<02:19, 4.30it/s] Model Responding: 56%|█████▋ | 775/1376 [02:59<02:11, 4.55it/s] Model Responding: 56%|█████▋ | 776/1376 [02:59<02:18, 4.34it/s] Model Responding: 56%|█████▋ | 777/1376 [03:00<02:22, 4.20it/s] Model Responding: 57%|█████▋ | 778/1376 [03:00<02:14, 4.45it/s] Model Responding: 57%|█████▋ | 779/1376 [03:00<02:19, 4.28it/s] Model Responding: 57%|█████▋ | 780/1376 [03:00<02:23, 4.16it/s] Model Responding: 57%|█████▋ | 781/1376 [03:01<02:14, 4.44it/s] Model Responding: 57%|█████▋ | 782/1376 [03:01<02:20, 4.24it/s] Model Responding: 57%|█████▋ | 783/1376 [03:01<02:23, 4.13it/s] Model Responding: 57%|█████▋ | 784/1376 [03:01<02:08, 4.62it/s] Model Responding: 57%|█████▋ | 785/1376 [03:01<01:53, 5.20it/s] Model Responding: 57%|█████▋ | 786/1376 [03:01<01:46, 5.55it/s] Model Responding: 57%|█████▋ | 787/1376 [03:02<01:41, 5.82it/s] Model Responding: 57%|█████▋ | 788/1376 [03:02<01:36, 6.10it/s] Model Responding: 57%|█████▋ | 789/1376 [03:02<01:32, 6.32it/s] Model Responding: 57%|█████▋ | 790/1376 [03:02<01:30, 6.48it/s] Model Responding: 57%|█████▋ | 791/1376 [03:02<01:28, 6.60it/s] Model Responding: 58%|█████▊ | 792/1376 [03:02<01:47, 5.44it/s] Model Responding: 58%|█████▊ | 793/1376 [03:03<01:59, 4.87it/s] Model Responding: 58%|█████▊ | 794/1376 [03:03<02:08, 4.52it/s] Model Responding: 58%|█████▊ | 795/1376 [03:03<02:15, 4.29it/s] Model Responding: 58%|█████▊ | 796/1376 [03:04<02:19, 4.16it/s] Model Responding: 58%|█████▊ | 797/1376 [03:04<02:22, 4.08it/s] Model Responding: 58%|█████▊ | 798/1376 [03:04<02:24, 4.00it/s] Model Responding: 58%|█████▊ | 799/1376 [03:04<02:37, 3.67it/s] Model Responding: 58%|█████▊ | 800/1376 [03:05<02:34, 3.73it/s] Model Responding: 58%|█████▊ | 801/1376 [03:05<02:33, 3.74it/s] Model Responding: 58%|█████▊ | 802/1376 [03:05<02:32, 3.76it/s] Model Responding: 58%|█████▊ | 803/1376 [03:05<02:32, 3.75it/s] Model Responding: 58%|█████▊ | 804/1376 [03:06<02:32, 3.75it/s] Model Responding: 59%|█████▊ | 805/1376 [03:06<02:30, 3.79it/s] Model Responding: 59%|█████▊ | 806/1376 [03:06<02:21, 4.02it/s] Model Responding: 59%|█████▊ | 807/1376 [03:06<02:15, 4.20it/s] Model Responding: 59%|█████▊ | 808/1376 [03:07<02:10, 4.34it/s] Model Responding: 59%|█████▉ | 809/1376 [03:07<02:15, 4.18it/s] Model Responding: 59%|█████▉ | 810/1376 [03:07<02:18, 4.09it/s] Model Responding: 59%|█████▉ | 811/1376 [03:07<02:20, 4.03it/s] Model Responding: 59%|█████▉ | 812/1376 [03:08<02:04, 4.53it/s] Model Responding: 59%|█████▉ | 813/1376 [03:08<02:11, 4.30it/s] Model Responding: 59%|█████▉ | 814/1376 [03:08<02:14, 4.17it/s] Model Responding: 59%|█████▉ | 815/1376 [03:08<02:05, 4.46it/s] Model Responding: 59%|█████▉ | 816/1376 [03:08<02:11, 4.27it/s] Model Responding: 59%|█████▉ | 817/1376 [03:09<01:54, 4.87it/s] Model Responding: 59%|█████▉ | 818/1376 [03:09<02:06, 4.40it/s] Model Responding: 60%|█████▉ | 819/1376 [03:09<02:13, 4.16it/s] Model Responding: 60%|█████▉ | 820/1376 [03:09<02:18, 4.00it/s] Model Responding: 60%|█████▉ | 821/1376 [03:10<02:03, 4.51it/s] Model Responding: 60%|█████▉ | 822/1376 [03:10<01:50, 5.02it/s] Model Responding: 60%|█████▉ | 823/1376 [03:10<01:46, 5.20it/s] Model Responding: 60%|█████▉ | 824/1376 [03:10<01:38, 5.59it/s] Model Responding: 60%|█████▉ | 825/1376 [03:10<01:33, 5.90it/s] Model Responding: 60%|██████ | 826/1376 [03:10<01:50, 4.99it/s] Model Responding: 60%|██████ | 827/1376 [03:11<01:41, 5.40it/s] Model Responding: 60%|██████ | 828/1376 [03:11<01:45, 5.21it/s] Model Responding: 60%|██████ | 829/1376 [03:11<01:46, 5.12it/s] Model Responding: 60%|██████ | 830/1376 [03:11<01:43, 5.27it/s] Model Responding: 60%|██████ | 831/1376 [03:11<01:41, 5.39it/s] Model Responding: 60%|██████ | 832/1376 [03:12<01:39, 5.48it/s] Model Responding: 61%|██████ | 833/1376 [03:12<01:37, 5.55it/s] Model Responding: 61%|██████ | 834/1376 [03:12<01:31, 5.89it/s] Model Responding: 61%|██████ | 835/1376 [03:12<01:45, 5.11it/s] Model Responding: 61%|██████ | 836/1376 [03:12<01:55, 4.69it/s] Model Responding: 61%|██████ | 837/1376 [03:13<02:03, 4.35it/s] Model Responding: 61%|██████ | 838/1376 [03:13<01:50, 4.86it/s] Model Responding: 61%|██████ | 839/1376 [03:13<02:01, 4.44it/s] Model Responding: 61%|██████ | 840/1376 [03:13<02:05, 4.26it/s] Model Responding: 61%|██████ | 841/1376 [03:14<02:10, 4.09it/s] Model Responding: 61%|██████ | 842/1376 [03:14<02:11, 4.05it/s] Model Responding: 61%|██████▏ | 843/1376 [03:14<02:15, 3.94it/s] Model Responding: 61%|██████▏ | 844/1376 [03:14<02:17, 3.86it/s] Model Responding: 61%|██████▏ | 845/1376 [03:15<02:17, 3.86it/s] Model Responding: 61%|██████▏ | 846/1376 [03:15<02:16, 3.87it/s] Model Responding: 62%|██████▏ | 847/1376 [03:15<02:19, 3.80it/s] Model Responding: 62%|██████▏ | 848/1376 [03:15<02:20, 3.76it/s] Model Responding: 62%|██████▏ | 849/1376 [03:16<02:19, 3.78it/s] Model Responding: 62%|██████▏ | 850/1376 [03:16<02:17, 3.81it/s] Model Responding: 62%|██████▏ | 851/1376 [03:16<02:17, 3.82it/s] Model Responding: 62%|██████▏ | 852/1376 [03:17<02:15, 3.86it/s] Model Responding: 62%|██████▏ | 853/1376 [03:17<02:14, 3.88it/s] Model Responding: 62%|██████▏ | 854/1376 [03:17<02:14, 3.89it/s] Model Responding: 62%|██████▏ | 855/1376 [03:17<02:14, 3.87it/s] Model Responding: 62%|██████▏ | 856/1376 [03:18<02:13, 3.88it/s] Model Responding: 62%|██████▏ | 857/1376 [03:18<02:15, 3.84it/s] Model Responding: 62%|██████▏ | 858/1376 [03:18<02:14, 3.86it/s] Model Responding: 62%|██████▏ | 859/1376 [03:18<02:14, 3.85it/s] Model Responding: 62%|██████▎ | 860/1376 [03:19<02:13, 3.87it/s] Model Responding: 63%|██████▎ | 861/1376 [03:19<02:13, 3.86it/s] Model Responding: 63%|██████▎ | 862/1376 [03:19<02:21, 3.62it/s] Model Responding: 63%|██████▎ | 863/1376 [03:19<02:29, 3.43it/s] Model Responding: 63%|██████▎ | 864/1376 [03:20<02:16, 3.76it/s] Model Responding: 63%|██████▎ | 865/1376 [03:20<02:25, 3.52it/s] Model Responding: 63%|██████▎ | 866/1376 [03:20<02:12, 3.84it/s] Model Responding: 63%|██████▎ | 867/1376 [03:21<02:23, 3.55it/s] Model Responding: 63%|██████▎ | 868/1376 [03:21<02:11, 3.87it/s] Model Responding: 63%|██████▎ | 869/1376 [03:21<02:13, 3.80it/s] Model Responding: 63%|██████▎ | 870/1376 [03:21<01:55, 4.38it/s] Model Responding: 63%|██████▎ | 871/1376 [03:21<02:05, 4.03it/s] Model Responding: 63%|██████▎ | 872/1376 [03:22<01:51, 4.54it/s] Model Responding: 63%|██████▎ | 873/1376 [03:22<01:39, 5.03it/s] Model Responding: 64%|██████▎ | 874/1376 [03:22<01:31, 5.47it/s] Model Responding: 64%|██████▎ | 875/1376 [03:22<01:26, 5.82it/s] Model Responding: 64%|██████▎ | 876/1376 [03:22<01:22, 6.10it/s] Model Responding: 64%|██████▎ | 877/1376 [03:22<01:35, 5.21it/s] Model Responding: 64%|██████▍ | 878/1376 [03:23<01:45, 4.74it/s] Model Responding: 64%|██████▍ | 879/1376 [03:23<01:51, 4.46it/s] Model Responding: 64%|██████▍ | 880/1376 [03:23<01:56, 4.28it/s] Model Responding: 64%|██████▍ | 881/1376 [03:23<01:58, 4.16it/s] Model Responding: 64%|██████▍ | 882/1376 [03:24<02:02, 4.02it/s] Model Responding: 64%|██████▍ | 883/1376 [03:24<01:56, 4.25it/s] Model Responding: 64%|██████▍ | 884/1376 [03:24<01:51, 4.40it/s] Model Responding: 64%|██████▍ | 885/1376 [03:24<01:43, 4.73it/s] Model Responding: 64%|██████▍ | 886/1376 [03:25<01:37, 5.01it/s] Model Responding: 64%|██████▍ | 887/1376 [03:25<01:33, 5.22it/s] Model Responding: 65%|██████▍ | 888/1376 [03:25<01:45, 4.65it/s] Model Responding: 65%|██████▍ | 889/1376 [03:25<01:52, 4.33it/s] Model Responding: 65%|██████▍ | 890/1376 [03:25<01:57, 4.13it/s] Model Responding: 65%|██████▍ | 891/1376 [03:26<02:01, 4.01it/s] Model Responding: 65%|██████▍ | 892/1376 [03:26<01:50, 4.37it/s] Model Responding: 65%|██████▍ | 893/1376 [03:26<01:38, 4.88it/s] Model Responding: 65%|██████▍ | 894/1376 [03:26<01:34, 5.10it/s] Model Responding: 65%|██████▌ | 895/1376 [03:26<01:31, 5.26it/s] Model Responding: 65%|██████▌ | 896/1376 [03:27<01:25, 5.58it/s] Model Responding: 65%|██████▌ | 897/1376 [03:27<01:37, 4.94it/s] Model Responding: 65%|██████▌ | 898/1376 [03:27<01:46, 4.48it/s] Model Responding: 65%|██████▌ | 899/1376 [03:27<01:53, 4.22it/s] Model Responding: 65%|██████▌ | 900/1376 [03:28<02:06, 3.78it/s] Model Responding: 65%|██████▌ | 901/1376 [03:28<02:06, 3.76it/s] Model Responding: 66%|██████▌ | 902/1376 [03:28<01:59, 3.96it/s] Model Responding: 66%|██████▌ | 903/1376 [03:28<01:43, 4.59it/s] Model Responding: 66%|██████▌ | 904/1376 [03:29<01:41, 4.64it/s] Model Responding: 66%|██████▌ | 905/1376 [03:29<01:40, 4.69it/s] Model Responding: 66%|██████▌ | 906/1376 [03:29<01:39, 4.71it/s] Model Responding: 66%|██████▌ | 907/1376 [03:29<01:47, 4.35it/s] Model Responding: 66%|██████▌ | 908/1376 [03:29<01:41, 4.59it/s] Model Responding: 66%|██████▌ | 909/1376 [03:30<01:57, 3.97it/s] Model Responding: 66%|██████▌ | 910/1376 [03:30<02:07, 3.65it/s] Model Responding: 66%|██████▌ | 911/1376 [03:30<02:15, 3.44it/s] Model Responding: 66%|██████▋ | 912/1376 [03:31<02:10, 3.56it/s] Model Responding: 66%|██████▋ | 913/1376 [03:31<01:59, 3.87it/s] Model Responding: 66%|██████▋ | 914/1376 [03:31<02:08, 3.59it/s] Model Responding: 66%|██████▋ | 915/1376 [03:32<02:14, 3.42it/s] Model Responding: 67%|██████▋ | 916/1376 [03:32<02:18, 3.31it/s] Model Responding: 67%|██████▋ | 917/1376 [03:32<01:57, 3.91it/s] Model Responding: 67%|██████▋ | 918/1376 [03:32<01:47, 4.25it/s] Model Responding: 67%|██████▋ | 919/1376 [03:33<01:58, 3.85it/s] Model Responding: 67%|██████▋ | 920/1376 [03:33<01:49, 4.18it/s] Model Responding: 67%|██████▋ | 921/1376 [03:33<01:52, 4.05it/s] Model Responding: 67%|██████▋ | 922/1376 [03:33<01:54, 3.95it/s] Model Responding: 67%|██████▋ | 923/1376 [03:33<01:40, 4.52it/s] Model Responding: 67%|██████▋ | 924/1376 [03:34<01:31, 4.96it/s] Model Responding: 67%|██████▋ | 925/1376 [03:34<01:38, 4.59it/s] Model Responding: 67%|██████▋ | 926/1376 [03:34<01:32, 4.86it/s] Model Responding: 67%|██████▋ | 927/1376 [03:34<01:40, 4.46it/s] Model Responding: 67%|██████▋ | 928/1376 [03:34<01:30, 4.96it/s] Model Responding: 68%|██████▊ | 929/1376 [03:35<01:28, 5.05it/s] Model Responding: 68%|██████▊ | 930/1376 [03:35<01:21, 5.49it/s] Model Responding: 68%|██████▊ | 931/1376 [03:35<01:31, 4.88it/s] Model Responding: 68%|██████▊ | 932/1376 [03:35<01:37, 4.55it/s] Model Responding: 68%|██████▊ | 933/1376 [03:35<01:27, 5.05it/s] Model Responding: 68%|██████▊ | 934/1376 [03:36<01:21, 5.45it/s] Model Responding: 68%|██████▊ | 935/1376 [03:36<01:15, 5.82it/s] Model Responding: 68%|██████▊ | 936/1376 [03:36<01:26, 5.07it/s] Model Responding: 68%|██████▊ | 937/1376 [03:36<01:34, 4.66it/s] Model Responding: 68%|██████▊ | 938/1376 [03:36<01:39, 4.41it/s] Model Responding: 68%|██████▊ | 939/1376 [03:37<01:36, 4.52it/s] Model Responding: 68%|██████▊ | 940/1376 [03:37<01:34, 4.62it/s] Model Responding: 68%|██████▊ | 941/1376 [03:37<01:32, 4.70it/s] Model Responding: 68%|██████▊ | 942/1376 [03:37<01:29, 4.87it/s] Model Responding: 69%|██████▊ | 943/1376 [03:37<01:26, 4.99it/s] Model Responding: 69%|██████▊ | 944/1376 [03:38<01:25, 5.08it/s] Model Responding: 69%|██████▊ | 945/1376 [03:38<01:16, 5.60it/s] Model Responding: 69%|██████▉ | 946/1376 [03:38<01:11, 6.05it/s] Model Responding: 69%|██████▉ | 947/1376 [03:38<01:06, 6.42it/s] Model Responding: 69%|██████▉ | 948/1376 [03:38<01:04, 6.68it/s] Model Responding: 69%|██████▉ | 949/1376 [03:38<01:01, 6.89it/s] Model Responding: 69%|██████▉ | 950/1376 [03:38<01:00, 7.03it/s] Model Responding: 69%|██████▉ | 951/1376 [03:39<00:59, 7.11it/s] Model Responding: 69%|██████▉ | 952/1376 [03:39<01:14, 5.69it/s] Model Responding: 69%|██████▉ | 953/1376 [03:39<01:26, 4.90it/s] Model Responding: 69%|██████▉ | 954/1376 [03:39<01:34, 4.47it/s] Model Responding: 69%|██████▉ | 955/1376 [03:40<01:32, 4.55it/s] Model Responding: 69%|██████▉ | 956/1376 [03:40<01:28, 4.76it/s] Model Responding: 70%|██████▉ | 957/1376 [03:40<01:24, 4.93it/s] Model Responding: 70%|██████▉ | 958/1376 [03:40<01:40, 4.17it/s] Model Responding: 70%|██████▉ | 959/1376 [03:41<01:50, 3.78it/s] Model Responding: 70%|██████▉ | 960/1376 [03:41<01:48, 3.82it/s] Model Responding: 70%|██████▉ | 961/1376 [03:41<01:48, 3.82it/s] Model Responding: 70%|██████▉ | 962/1376 [03:41<01:47, 3.85it/s] Model Responding: 70%|██████▉ | 963/1376 [03:42<01:47, 3.85it/s] Model Responding: 70%|███████ | 964/1376 [03:42<01:50, 3.72it/s] Model Responding: 70%|███████ | 965/1376 [03:42<01:48, 3.77it/s] Model Responding: 70%|███████ | 966/1376 [03:42<01:48, 3.78it/s] Model Responding: 70%|███████ | 967/1376 [03:43<01:47, 3.82it/s] Model Responding: 70%|███████ | 968/1376 [03:43<01:54, 3.56it/s] Model Responding: 70%|███████ | 969/1376 [03:43<01:45, 3.87it/s] Model Responding: 70%|███████ | 970/1376 [03:43<01:31, 4.41it/s] Model Responding: 71%|███████ | 971/1376 [03:44<01:24, 4.79it/s] Model Responding: 71%|███████ | 972/1376 [03:44<01:17, 5.21it/s] Model Responding: 71%|███████ | 973/1376 [03:44<01:12, 5.54it/s] Model Responding: 71%|███████ | 974/1376 [03:44<01:09, 5.81it/s] Model Responding: 71%|███████ | 975/1376 [03:44<01:27, 4.58it/s] Model Responding: 71%|███████ | 976/1376 [03:45<01:33, 4.29it/s] Model Responding: 71%|███████ | 977/1376 [03:45<01:29, 4.45it/s] Model Responding: 71%|███████ | 978/1376 [03:45<01:39, 4.00it/s] Model Responding: 71%|███████ | 979/1376 [03:45<01:29, 4.43it/s] Model Responding: 71%|███████ | 980/1376 [03:46<01:34, 4.18it/s] Model Responding: 71%|███████▏ | 981/1376 [03:46<01:37, 4.04it/s] Model Responding: 71%|███████▏ | 982/1376 [03:46<01:40, 3.94it/s] Model Responding: 71%|███████▏ | 983/1376 [03:46<01:32, 4.27it/s] Model Responding: 72%|███████▏ | 984/1376 [03:47<01:38, 3.99it/s] Model Responding: 72%|███████▏ | 985/1376 [03:47<01:42, 3.81it/s] Model Responding: 72%|███████▏ | 986/1376 [03:47<01:49, 3.56it/s] Model Responding: 72%|███████▏ | 987/1376 [03:47<01:50, 3.51it/s] Model Responding: 72%|███████▏ | 988/1376 [03:48<01:48, 3.56it/s] Model Responding: 72%|███████▏ | 989/1376 [03:48<01:53, 3.40it/s] Model Responding: 72%|███████▏ | 990/1376 [03:48<01:50, 3.50it/s] Model Responding: 72%|███████▏ | 991/1376 [03:49<01:38, 3.89it/s] Model Responding: 72%|███████▏ | 992/1376 [03:49<01:38, 3.89it/s] Model Responding: 72%|███████▏ | 993/1376 [03:49<01:46, 3.61it/s] Model Responding: 72%|███████▏ | 994/1376 [03:49<01:37, 3.92it/s] Model Responding: 72%|███████▏ | 995/1376 [03:50<01:31, 4.16it/s] Model Responding: 72%|███████▏ | 996/1376 [03:50<01:34, 4.01it/s] Model Responding: 72%|███████▏ | 997/1376 [03:50<01:36, 3.91it/s] Model Responding: 73%|███████▎ | 998/1376 [03:50<01:23, 4.53it/s] Model Responding: 73%|███████▎ | 999/1376 [03:50<01:13, 5.10it/s] Model Responding: 73%|███████▎ | 1000/1376 [03:50<01:07, 5.60it/s] Model Responding: 73%|███████▎ | 1001/1376 [03:51<01:07, 5.55it/s] Model Responding: 73%|███████▎ | 1002/1376 [03:51<01:16, 4.91it/s] Model Responding: 73%|███████▎ | 1003/1376 [03:51<01:26, 4.29it/s] Model Responding: 73%|███████▎ | 1004/1376 [03:51<01:22, 4.53it/s] Model Responding: 73%|███████▎ | 1005/1376 [03:52<01:26, 4.31it/s] Model Responding: 73%|███████▎ | 1006/1376 [03:52<01:34, 3.90it/s] Model Responding: 73%|███████▎ | 1007/1376 [03:52<01:42, 3.61it/s] Model Responding: 73%|███████▎ | 1008/1376 [03:53<01:44, 3.52it/s] Model Responding: 73%|███████▎ | 1009/1376 [03:53<01:29, 4.10it/s] Model Responding: 73%|███████▎ | 1010/1376 [03:53<01:18, 4.67it/s] Model Responding: 73%|███████▎ | 1011/1376 [03:53<01:10, 5.17it/s] Model Responding: 74%|███████▎ | 1012/1376 [03:53<01:04, 5.65it/s] Model Responding: 74%|███████▎ | 1013/1376 [03:53<01:01, 5.93it/s] Model Responding: 74%|███████▎ | 1014/1376 [03:53<00:57, 6.28it/s] Model Responding: 74%|███████▍ | 1015/1376 [03:54<00:55, 6.54it/s] Model Responding: 74%|███████▍ | 1016/1376 [03:54<00:57, 6.21it/s] Model Responding: 74%|███████▍ | 1017/1376 [03:54<00:59, 6.05it/s] Model Responding: 74%|███████▍ | 1018/1376 [03:54<00:57, 6.18it/s] Model Responding: 74%|███████▍ | 1019/1376 [03:54<01:14, 4.82it/s] Model Responding: 74%|███████▍ | 1020/1376 [03:55<01:26, 4.14it/s] Model Responding: 74%|███████▍ | 1021/1376 [03:55<01:20, 4.42it/s] Model Responding: 74%|███████▍ | 1022/1376 [03:55<01:14, 4.75it/s] Model Responding: 74%|███████▍ | 1023/1376 [03:55<01:11, 4.90it/s] Model Responding: 74%|███████▍ | 1024/1376 [03:55<01:08, 5.10it/s] Model Responding: 74%|███████▍ | 1025/1376 [03:56<01:16, 4.59it/s] Model Responding: 75%|███████▍ | 1026/1376 [03:56<01:13, 4.78it/s] Model Responding: 75%|███████▍ | 1027/1376 [03:56<01:23, 4.16it/s] Model Responding: 75%|███████▍ | 1028/1376 [03:56<01:13, 4.74it/s] Model Responding: 75%|███████▍ | 1029/1376 [03:57<01:05, 5.29it/s] Model Responding: 75%|███████▍ | 1030/1376 [03:57<01:00, 5.75it/s] Model Responding: 75%|███████▍ | 1031/1376 [03:57<01:03, 5.42it/s] Model Responding: 75%|███████▌ | 1032/1376 [03:57<01:03, 5.40it/s] Model Responding: 75%|███████▌ | 1033/1376 [03:57<01:06, 5.18it/s] Model Responding: 75%|███████▌ | 1034/1376 [03:57<01:05, 5.24it/s] Model Responding: 75%|███████▌ | 1035/1376 [03:58<01:07, 5.09it/s] Model Responding: 75%|███████▌ | 1036/1376 [03:58<01:05, 5.17it/s] Model Responding: 75%|███████▌ | 1037/1376 [03:58<01:04, 5.24it/s] Model Responding: 75%|███████▌ | 1038/1376 [03:58<01:03, 5.28it/s] Model Responding: 76%|███████▌ | 1039/1376 [03:58<01:03, 5.31it/s] Model Responding: 76%|███████▌ | 1040/1376 [03:59<01:03, 5.31it/s] Model Responding: 76%|███████▌ | 1041/1376 [03:59<01:03, 5.30it/s] Model Responding: 76%|███████▌ | 1042/1376 [03:59<01:02, 5.31it/s] Model Responding: 76%|███████▌ | 1043/1376 [03:59<01:04, 5.19it/s] Model Responding: 76%|███████▌ | 1044/1376 [03:59<00:59, 5.56it/s] Model Responding: 76%|███████▌ | 1045/1376 [03:59<00:56, 5.87it/s] Model Responding: 76%|███████▌ | 1046/1376 [04:00<00:53, 6.12it/s] Model Responding: 76%|███████▌ | 1047/1376 [04:00<00:52, 6.28it/s] Model Responding: 76%|███████▌ | 1048/1376 [04:00<00:50, 6.43it/s] Model Responding: 76%|███████▌ | 1049/1376 [04:00<00:50, 6.53it/s] Model Responding: 76%|███████▋ | 1050/1376 [04:00<00:54, 5.96it/s] Model Responding: 76%|███████▋ | 1051/1376 [04:01<01:10, 4.64it/s] Model Responding: 76%|███████▋ | 1052/1376 [04:01<01:15, 4.31it/s] Model Responding: 77%|███████▋ | 1053/1376 [04:01<01:19, 4.08it/s] Model Responding: 77%|███████▋ | 1054/1376 [04:01<01:20, 3.99it/s] Model Responding: 77%|███████▋ | 1055/1376 [04:02<01:22, 3.87it/s] Model Responding: 77%|███████▋ | 1056/1376 [04:02<01:28, 3.60it/s] Model Responding: 77%|███████▋ | 1057/1376 [04:02<01:32, 3.45it/s] Model Responding: 77%|███████▋ | 1058/1376 [04:03<01:22, 3.85it/s] Model Responding: 77%|███████▋ | 1059/1376 [04:03<01:29, 3.56it/s] Model Responding: 77%|███████▋ | 1060/1376 [04:03<01:32, 3.41it/s] Model Responding: 77%|███████▋ | 1061/1376 [04:03<01:34, 3.34it/s] Model Responding: 77%|███████▋ | 1062/1376 [04:04<01:30, 3.47it/s] Model Responding: 77%|███████▋ | 1063/1376 [04:04<01:34, 3.33it/s] Model Responding: 77%|███████▋ | 1064/1376 [04:04<01:35, 3.28it/s] Model Responding: 77%|███████▋ | 1065/1376 [04:05<01:31, 3.41it/s] Model Responding: 77%|███████▋ | 1066/1376 [04:05<01:27, 3.52it/s] Model Responding: 78%|███████▊ | 1067/1376 [04:05<01:14, 4.14it/s] Model Responding: 78%|███████▊ | 1068/1376 [04:05<01:21, 3.76it/s] Model Responding: 78%|███████▊ | 1069/1376 [04:06<01:16, 4.04it/s] Model Responding: 78%|███████▊ | 1070/1376 [04:06<01:23, 3.67it/s] Model Responding: 78%|███████▊ | 1071/1376 [04:06<01:22, 3.68it/s] Model Responding: 78%|███████▊ | 1072/1376 [04:06<01:22, 3.68it/s] Model Responding: 78%|███████▊ | 1073/1376 [04:07<01:10, 4.27it/s] Model Responding: 78%|███████▊ | 1074/1376 [04:07<01:08, 4.41it/s] Model Responding: 78%|███████▊ | 1075/1376 [04:07<01:06, 4.54it/s] Model Responding: 78%|███████▊ | 1076/1376 [04:07<01:04, 4.62it/s] Model Responding: 78%|███████▊ | 1077/1376 [04:07<01:08, 4.38it/s] Model Responding: 78%|███████▊ | 1078/1376 [04:08<01:06, 4.51it/s] Model Responding: 78%|███████▊ | 1079/1376 [04:08<01:01, 4.83it/s] Model Responding: 78%|███████▊ | 1080/1376 [04:08<01:10, 4.17it/s] Model Responding: 79%|███████▊ | 1081/1376 [04:08<01:13, 4.03it/s] Model Responding: 79%|███████▊ | 1082/1376 [04:09<01:14, 3.94it/s] Model Responding: 79%|███████▊ | 1083/1376 [04:09<01:15, 3.90it/s] Model Responding: 79%|███████▉ | 1084/1376 [04:09<01:15, 3.86it/s] Model Responding: 79%|███████▉ | 1085/1376 [04:09<01:10, 4.12it/s] Model Responding: 79%|███████▉ | 1086/1376 [04:10<01:02, 4.61it/s] Model Responding: 79%|███████▉ | 1087/1376 [04:10<01:06, 4.36it/s] Model Responding: 79%|███████▉ | 1088/1376 [04:10<01:02, 4.62it/s] Model Responding: 79%|███████▉ | 1089/1376 [04:10<01:06, 4.33it/s] Model Responding: 79%|███████▉ | 1090/1376 [04:11<01:08, 4.15it/s] Model Responding: 79%|███████▉ | 1091/1376 [04:11<01:10, 4.02it/s] Model Responding: 79%|███████▉ | 1092/1376 [04:11<01:12, 3.94it/s] Model Responding: 79%|███████▉ | 1093/1376 [04:11<01:13, 3.86it/s] Model Responding: 80%|███████▉ | 1094/1376 [04:12<01:14, 3.79it/s] Model Responding: 80%|███████▉ | 1095/1376 [04:12<01:19, 3.53it/s] Model Responding: 80%|███████▉ | 1096/1376 [04:12<01:17, 3.61it/s] Model Responding: 80%|███████▉ | 1097/1376 [04:13<01:17, 3.61it/s] Model Responding: 80%|███████▉ | 1098/1376 [04:13<01:16, 3.63it/s] Model Responding: 80%|███████▉ | 1099/1376 [04:13<01:16, 3.64it/s] Model Responding: 80%|███████▉ | 1100/1376 [04:13<01:19, 3.45it/s] Model Responding: 80%|████████ | 1101/1376 [04:14<01:22, 3.33it/s] Model Responding: 80%|████████ | 1102/1376 [04:14<01:24, 3.24it/s] Model Responding: 80%|████████ | 1103/1376 [04:14<01:10, 3.88it/s] Model Responding: 80%|████████ | 1104/1376 [04:14<01:00, 4.49it/s] Model Responding: 80%|████████ | 1105/1376 [04:14<00:53, 5.07it/s] Model Responding: 80%|████████ | 1106/1376 [04:15<00:51, 5.22it/s] Model Responding: 80%|████████ | 1107/1376 [04:15<00:56, 4.73it/s] Model Responding: 81%|████████ | 1108/1376 [04:15<01:00, 4.46it/s] Model Responding: 81%|████████ | 1109/1376 [04:15<01:02, 4.29it/s] Model Responding: 81%|████████ | 1110/1376 [04:16<01:09, 3.84it/s] Model Responding: 81%|████████ | 1111/1376 [04:16<01:14, 3.57it/s] Model Responding: 81%|████████ | 1112/1376 [04:16<01:17, 3.39it/s] Model Responding: 81%|████████ | 1113/1376 [04:17<01:09, 3.80it/s] Model Responding: 81%|████████ | 1114/1376 [04:17<01:04, 4.04it/s] Model Responding: 81%|████████ | 1115/1376 [04:17<01:01, 4.25it/s] Model Responding: 81%|████████ | 1116/1376 [04:17<01:02, 4.14it/s] Model Responding: 81%|████████ | 1117/1376 [04:18<01:03, 4.06it/s] Model Responding: 81%|████████▏ | 1118/1376 [04:18<01:04, 4.00it/s] Model Responding: 81%|████████▏ | 1119/1376 [04:18<01:01, 4.21it/s] Model Responding: 81%|████████▏ | 1120/1376 [04:18<00:59, 4.32it/s] Model Responding: 81%|████████▏ | 1121/1376 [04:18<00:57, 4.46it/s] Model Responding: 82%|████████▏ | 1122/1376 [04:19<00:55, 4.57it/s] Model Responding: 82%|████████▏ | 1123/1376 [04:19<00:59, 4.25it/s] Model Responding: 82%|████████▏ | 1124/1376 [04:19<00:52, 4.84it/s] Model Responding: 82%|████████▏ | 1125/1376 [04:19<00:47, 5.34it/s] Model Responding: 82%|████████▏ | 1126/1376 [04:19<00:43, 5.80it/s] Model Responding: 82%|████████▏ | 1127/1376 [04:20<00:50, 4.95it/s] Model Responding: 82%|████████▏ | 1128/1376 [04:20<00:54, 4.52it/s] Model Responding: 82%|████████▏ | 1129/1376 [04:20<00:58, 4.26it/s] Model Responding: 82%|████████▏ | 1130/1376 [04:20<01:00, 4.07it/s] Model Responding: 82%|████████▏ | 1131/1376 [04:21<01:00, 4.02it/s] Model Responding: 82%|████████▏ | 1132/1376 [04:21<01:01, 3.96it/s] Model Responding: 82%|████████▏ | 1133/1376 [04:21<01:01, 3.94it/s] Model Responding: 82%|████████▏ | 1134/1376 [04:21<01:01, 3.91it/s] Model Responding: 82%|████████▏ | 1135/1376 [04:22<00:57, 4.23it/s] Model Responding: 83%|████████▎ | 1136/1376 [04:22<00:58, 4.09it/s] Model Responding: 83%|████████▎ | 1137/1376 [04:22<00:53, 4.50it/s] Model Responding: 83%|████████▎ | 1138/1376 [04:22<00:55, 4.28it/s] Model Responding: 83%|████████▎ | 1139/1376 [04:23<00:57, 4.15it/s] Model Responding: 83%|████████▎ | 1140/1376 [04:23<01:01, 3.87it/s] Model Responding: 83%|████████▎ | 1141/1376 [04:23<01:05, 3.58it/s] Model Responding: 83%|████████▎ | 1142/1376 [04:23<00:56, 4.17it/s] Model Responding: 83%|████████▎ | 1143/1376 [04:24<00:52, 4.45it/s] Model Responding: 83%|████████▎ | 1144/1376 [04:24<00:46, 4.98it/s] Model Responding: 83%|████████▎ | 1145/1376 [04:24<00:45, 5.11it/s] Model Responding: 83%|████████▎ | 1146/1376 [04:24<00:41, 5.53it/s] Model Responding: 83%|████████▎ | 1147/1376 [04:24<00:41, 5.49it/s] Model Responding: 83%|████████▎ | 1148/1376 [04:24<00:47, 4.81it/s] Model Responding: 84%|████████▎ | 1149/1376 [04:25<00:51, 4.43it/s] Model Responding: 84%|████████▎ | 1150/1376 [04:25<00:53, 4.20it/s] Model Responding: 84%|████████▎ | 1151/1376 [04:25<00:55, 4.06it/s] Model Responding: 84%|████████▎ | 1152/1376 [04:26<00:56, 3.96it/s] Model Responding: 84%|████████▍ | 1153/1376 [04:26<00:57, 3.89it/s] Model Responding: 84%|████████▍ | 1154/1376 [04:26<00:57, 3.85it/s] Model Responding: 84%|████████▍ | 1155/1376 [04:26<00:57, 3.86it/s] Model Responding: 84%|████████▍ | 1156/1376 [04:26<00:52, 4.23it/s] Model Responding: 84%|████████▍ | 1157/1376 [04:27<00:48, 4.51it/s] Model Responding: 84%|████████▍ | 1158/1376 [04:27<00:43, 5.02it/s] Model Responding: 84%|████████▍ | 1159/1376 [04:27<00:39, 5.46it/s] Model Responding: 84%|████████▍ | 1160/1376 [04:27<00:37, 5.73it/s] Model Responding: 84%|████████▍ | 1161/1376 [04:27<00:42, 5.02it/s] Model Responding: 84%|████████▍ | 1162/1376 [04:28<00:42, 5.07it/s] Model Responding: 85%|████████▍ | 1163/1376 [04:28<00:38, 5.56it/s] Model Responding: 85%|████████▍ | 1164/1376 [04:28<00:36, 5.88it/s] Model Responding: 85%|████████▍ | 1165/1376 [04:28<00:33, 6.23it/s] Model Responding: 85%|████████▍ | 1166/1376 [04:28<00:39, 5.27it/s] Model Responding: 85%|████████▍ | 1167/1376 [04:29<00:43, 4.77it/s] Model Responding: 85%|████████▍ | 1168/1376 [04:29<00:46, 4.47it/s] Model Responding: 85%|████████▍ | 1169/1376 [04:29<00:43, 4.73it/s] Model Responding: 85%|████████▌ | 1170/1376 [04:29<00:42, 4.88it/s] Model Responding: 85%|████████▌ | 1171/1376 [04:29<00:38, 5.35it/s] Model Responding: 85%|████████▌ | 1172/1376 [04:29<00:35, 5.73it/s] Model Responding: 85%|████████▌ | 1173/1376 [04:30<00:34, 5.94it/s] Model Responding: 85%|████████▌ | 1174/1376 [04:30<00:39, 5.12it/s] Model Responding: 85%|████████▌ | 1175/1376 [04:30<00:38, 5.22it/s] Model Responding: 85%|████████▌ | 1176/1376 [04:30<00:38, 5.23it/s] Model Responding: 86%|████████▌ | 1177/1376 [04:30<00:35, 5.62it/s] Model Responding: 86%|████████▌ | 1178/1376 [04:31<00:33, 5.95it/s] Model Responding: 86%|████████▌ | 1179/1376 [04:31<00:32, 6.11it/s] Model Responding: 86%|████████▌ | 1180/1376 [04:31<00:37, 5.22it/s] Model Responding: 86%|████████▌ | 1181/1376 [04:31<00:41, 4.74it/s] Model Responding: 86%|████████▌ | 1182/1376 [04:31<00:40, 4.79it/s] Model Responding: 86%|████████▌ | 1183/1376 [04:32<00:40, 4.81it/s] Model Responding: 86%|████████▌ | 1184/1376 [04:32<00:39, 4.81it/s] Model Responding: 86%|████████▌ | 1185/1376 [04:32<00:39, 4.82it/s] Model Responding: 86%|████████▌ | 1186/1376 [04:32<00:45, 4.16it/s] Model Responding: 86%|████████▋ | 1187/1376 [04:33<00:49, 3.81it/s] Model Responding: 86%|████████▋ | 1188/1376 [04:33<00:53, 3.53it/s] Model Responding: 86%|████████▋ | 1189/1376 [04:33<00:54, 3.42it/s] Model Responding: 86%|████████▋ | 1190/1376 [04:34<00:55, 3.33it/s] Model Responding: 87%|████████▋ | 1191/1376 [04:34<00:56, 3.29it/s] Model Responding: 87%|████████▋ | 1192/1376 [04:34<00:56, 3.24it/s] Model Responding: 87%|████████▋ | 1193/1376 [04:35<00:56, 3.22it/s] Model Responding: 87%|████████▋ | 1194/1376 [04:35<00:50, 3.58it/s] Model Responding: 87%|████████▋ | 1195/1376 [04:35<00:50, 3.60it/s] Model Responding: 87%|████████▋ | 1196/1376 [04:35<00:46, 3.90it/s] Model Responding: 87%|████████▋ | 1197/1376 [04:35<00:39, 4.50it/s] Model Responding: 87%|████████▋ | 1198/1376 [04:36<00:35, 4.98it/s] Model Responding: 87%|████████▋ | 1199/1376 [04:36<00:32, 5.49it/s] Model Responding: 87%|████████▋ | 1200/1376 [04:36<00:35, 4.89it/s] Model Responding: 87%|████████▋ | 1201/1376 [04:36<00:38, 4.55it/s] Model Responding: 87%|████████▋ | 1202/1376 [04:36<00:40, 4.33it/s] Model Responding: 87%|████████▋ | 1203/1376 [04:37<00:38, 4.48it/s] Model Responding: 88%|████████▊ | 1204/1376 [04:37<00:40, 4.21it/s] Model Responding: 88%|████████▊ | 1205/1376 [04:37<00:42, 4.04it/s] Model Responding: 88%|████████▊ | 1206/1376 [04:37<00:43, 3.92it/s] Model Responding: 88%|████████▊ | 1207/1376 [04:38<00:43, 3.86it/s] Model Responding: 88%|████████▊ | 1208/1376 [04:38<00:44, 3.79it/s] Model Responding: 88%|████████▊ | 1209/1376 [04:38<00:41, 4.06it/s] Model Responding: 88%|████████▊ | 1210/1376 [04:39<00:45, 3.67it/s] Model Responding: 88%|████████▊ | 1211/1376 [04:39<00:46, 3.56it/s] Model Responding: 88%|████████▊ | 1212/1376 [04:39<00:44, 3.65it/s] Model Responding: 88%|████████▊ | 1213/1376 [04:39<00:40, 4.01it/s] Model Responding: 88%|████████▊ | 1214/1376 [04:40<00:43, 3.76it/s] Model Responding: 88%|████████▊ | 1215/1376 [04:40<00:42, 3.76it/s] Model Responding: 88%|████████▊ | 1216/1376 [04:40<00:42, 3.79it/s] Model Responding: 88%|████████▊ | 1217/1376 [04:40<00:43, 3.64it/s] Model Responding: 89%|████████▊ | 1218/1376 [04:41<00:42, 3.71it/s] Model Responding: 89%|████████▊ | 1219/1376 [04:41<00:42, 3.70it/s] Model Responding: 89%|████████▊ | 1220/1376 [04:41<00:42, 3.69it/s] Model Responding: 89%|████████▊ | 1221/1376 [04:41<00:36, 4.25it/s] Model Responding: 89%|████████▉ | 1222/1376 [04:42<00:32, 4.71it/s] Model Responding: 89%|████████▉ | 1223/1376 [04:42<00:36, 4.21it/s] Model Responding: 89%|████████▉ | 1224/1376 [04:42<00:38, 3.94it/s] Model Responding: 89%|████████▉ | 1225/1376 [04:42<00:40, 3.74it/s] Model Responding: 89%|████████▉ | 1226/1376 [04:43<00:37, 3.99it/s] Model Responding: 89%|████████▉ | 1227/1376 [04:43<00:37, 3.93it/s] Model Responding: 89%|████████▉ | 1228/1376 [04:43<00:38, 3.88it/s] Model Responding: 89%|████████▉ | 1229/1376 [04:43<00:38, 3.83it/s] Model Responding: 89%|████████▉ | 1230/1376 [04:44<00:38, 3.80it/s] Model Responding: 89%|████████▉ | 1231/1376 [04:44<00:38, 3.80it/s] Model Responding: 90%|████████▉ | 1232/1376 [04:44<00:38, 3.79it/s] Model Responding: 90%|████████▉ | 1233/1376 [04:44<00:37, 3.77it/s] Model Responding: 90%|████████▉ | 1234/1376 [04:45<00:37, 3.77it/s] Model Responding: 90%|████████▉ | 1235/1376 [04:45<00:37, 3.76it/s] Model Responding: 90%|████████▉ | 1236/1376 [04:45<00:36, 3.80it/s] Model Responding: 90%|████████▉ | 1237/1376 [04:46<00:36, 3.80it/s] Model Responding: 90%|████████▉ | 1238/1376 [04:46<00:37, 3.69it/s] Model Responding: 90%|█████████ | 1239/1376 [04:46<00:36, 3.74it/s] Model Responding: 90%|█████████ | 1240/1376 [04:46<00:36, 3.76it/s] Model Responding: 90%|█████████ | 1241/1376 [04:47<00:37, 3.57it/s] Model Responding: 90%|█████████ | 1242/1376 [04:47<00:36, 3.65it/s] Model Responding: 90%|█████████ | 1243/1376 [04:47<00:35, 3.70it/s] Model Responding: 90%|█████████ | 1244/1376 [04:47<00:35, 3.76it/s] Model Responding: 90%|█████████ | 1245/1376 [04:48<00:34, 3.80it/s] Model Responding: 91%|█████████ | 1246/1376 [04:48<00:31, 4.13it/s] Model Responding: 91%|█████████ | 1247/1376 [04:48<00:32, 3.98it/s] Model Responding: 91%|█████████ | 1248/1376 [04:48<00:29, 4.30it/s] Model Responding: 91%|█████████ | 1249/1376 [04:49<00:33, 3.81it/s] Model Responding: 91%|█████████ | 1250/1376 [04:49<00:32, 3.83it/s] Model Responding: 91%|█████████ | 1251/1376 [04:49<00:33, 3.68it/s] Model Responding: 91%|█████████ | 1252/1376 [04:50<00:33, 3.74it/s] Model Responding: 91%|█████████ | 1253/1376 [04:50<00:33, 3.70it/s] Model Responding: 91%|█████████ | 1254/1376 [04:50<00:30, 4.07it/s] Model Responding: 91%|█████████ | 1255/1376 [04:50<00:30, 3.98it/s] Model Responding: 91%|█████████▏| 1256/1376 [04:50<00:30, 3.95it/s] Model Responding: 91%|█████████▏| 1257/1376 [04:51<00:31, 3.78it/s] Model Responding: 91%|█████████▏| 1258/1376 [04:51<00:30, 3.81it/s] Model Responding: 91%|█████████▏| 1259/1376 [04:51<00:27, 4.20it/s] Model Responding: 92%|█████████▏| 1260/1376 [04:51<00:28, 4.02it/s] Model Responding: 92%|█████████▏| 1261/1376 [04:52<00:29, 3.93it/s] Model Responding: 92%|█████████▏| 1262/1376 [04:52<00:27, 4.16it/s] Model Responding: 92%|█████████▏| 1263/1376 [04:52<00:30, 3.76it/s] Model Responding: 92%|█████████▏| 1264/1376 [04:53<00:31, 3.58it/s] Model Responding: 92%|█████████▏| 1265/1376 [04:53<00:30, 3.65it/s] Model Responding: 92%|█████████▏| 1266/1376 [04:53<00:27, 4.02it/s] Model Responding: 92%|█████████▏| 1267/1376 [04:53<00:27, 3.99it/s] Model Responding: 92%|█████████▏| 1268/1376 [04:54<00:25, 4.21it/s] Model Responding: 92%|█████████▏| 1269/1376 [04:54<00:24, 4.39it/s] Model Responding: 92%|█████████▏| 1270/1376 [04:54<00:25, 4.14it/s] Model Responding: 92%|█████████▏| 1271/1376 [04:54<00:24, 4.30it/s] Model Responding: 92%|█████████▏| 1272/1376 [04:54<00:21, 4.83it/s] Model Responding: 93%|█████████▎| 1273/1376 [04:55<00:25, 4.10it/s] Model Responding: 93%|█████████▎| 1274/1376 [04:55<00:22, 4.59it/s] Model Responding: 93%|█████████▎| 1275/1376 [04:55<00:19, 5.07it/s] Model Responding: 93%|█████████▎| 1276/1376 [04:55<00:18, 5.49it/s] Model Responding: 93%|█████████▎| 1277/1376 [04:55<00:16, 5.92it/s] Model Responding: 93%|█████████▎| 1278/1376 [04:55<00:15, 6.29it/s] Model Responding: 93%|█████████▎| 1279/1376 [04:56<00:14, 6.54it/s] Model Responding: 93%|█████████▎| 1280/1376 [04:56<00:14, 6.63it/s] Model Responding: 93%|█████████▎| 1281/1376 [04:56<00:14, 6.71it/s] Model Responding: 93%|█████████▎| 1282/1376 [04:56<00:13, 6.75it/s] Model Responding: 93%|█████████▎| 1283/1376 [04:56<00:13, 6.77it/s] Model Responding: 93%|█████████▎| 1284/1376 [04:56<00:18, 4.95it/s] Model Responding: 93%|█████████▎| 1285/1376 [04:57<00:21, 4.20it/s] Model Responding: 93%|█████████▎| 1286/1376 [04:57<00:22, 3.93it/s] Model Responding: 94%|█████████▎| 1287/1376 [04:57<00:24, 3.68it/s] Model Responding: 94%|█████████▎| 1288/1376 [04:58<00:24, 3.53it/s] Model Responding: 94%|█████████▎| 1289/1376 [04:58<00:25, 3.42it/s] Model Responding: 94%|█████████▍| 1290/1376 [04:58<00:24, 3.51it/s] Model Responding: 94%|█████████▍| 1291/1376 [04:59<00:23, 3.61it/s] Model Responding: 94%|█████████▍| 1292/1376 [04:59<00:21, 3.97it/s] Model Responding: 94%|█████████▍| 1293/1376 [04:59<00:19, 4.33it/s] Model Responding: 94%|█████████▍| 1294/1376 [04:59<00:19, 4.15it/s] Model Responding: 94%|█████████▍| 1295/1376 [05:00<00:21, 3.75it/s] Model Responding: 94%|█████████▍| 1296/1376 [05:00<00:21, 3.75it/s] Model Responding: 94%|█████████▍| 1297/1376 [05:00<00:21, 3.76it/s] Model Responding: 94%|█████████▍| 1298/1376 [05:00<00:21, 3.60it/s] Model Responding: 94%|█████████▍| 1299/1376 [05:01<00:21, 3.66it/s] Model Responding: 94%|█████████▍| 1300/1376 [05:01<00:20, 3.68it/s] Model Responding: 95%|█████████▍| 1301/1376 [05:01<00:20, 3.68it/s] Model Responding: 95%|█████████▍| 1302/1376 [05:01<00:20, 3.67it/s] Model Responding: 95%|█████████▍| 1303/1376 [05:02<00:17, 4.09it/s] Model Responding: 95%|█████████▍| 1304/1376 [05:02<00:16, 4.43it/s] Model Responding: 95%|█████████▍| 1305/1376 [05:02<00:15, 4.72it/s] Model Responding: 95%|█████████▍| 1306/1376 [05:02<00:17, 4.05it/s] Model Responding: 95%|█████████▍| 1307/1376 [05:02<00:15, 4.57it/s] Model Responding: 95%|█████████▌| 1308/1376 [05:03<00:13, 5.00it/s] Model Responding: 95%|█████████▌| 1309/1376 [05:03<00:13, 4.97it/s] Model Responding: 95%|█████████▌| 1310/1376 [05:03<00:15, 4.19it/s] Model Responding: 95%|█████████▌| 1311/1376 [05:03<00:15, 4.33it/s] Model Responding: 95%|█████████▌| 1312/1376 [05:04<00:15, 4.09it/s] Model Responding: 95%|█████████▌| 1313/1376 [05:04<00:14, 4.28it/s] Model Responding: 95%|█████████▌| 1314/1376 [05:04<00:15, 4.11it/s] Model Responding: 96%|█████████▌| 1315/1376 [05:04<00:14, 4.29it/s] Model Responding: 96%|█████████▌| 1316/1376 [05:04<00:12, 4.80it/s] Model Responding: 96%|█████████▌| 1317/1376 [05:05<00:11, 5.27it/s] Model Responding: 96%|█████████▌| 1318/1376 [05:05<00:10, 5.68it/s] Model Responding: 96%|█████████▌| 1319/1376 [05:05<00:09, 5.99it/s] Model Responding: 96%|█████████▌| 1320/1376 [05:05<00:09, 6.18it/s] Model Responding: 96%|█████████▌| 1321/1376 [05:05<00:08, 6.45it/s] Model Responding: 96%|█████████▌| 1322/1376 [05:05<00:08, 6.48it/s] Model Responding: 96%|█████████▌| 1323/1376 [05:05<00:07, 6.69it/s] Model Responding: 96%|█████████▌| 1324/1376 [05:06<00:07, 6.84it/s] Model Responding: 96%|█████████▋| 1325/1376 [05:06<00:07, 6.97it/s] Model Responding: 96%|█████████▋| 1326/1376 [05:06<00:09, 5.51it/s] Model Responding: 96%|█████████▋| 1327/1376 [05:06<00:10, 4.82it/s] Model Responding: 97%|█████████▋| 1328/1376 [05:07<00:10, 4.49it/s] Model Responding: 97%|█████████▋| 1329/1376 [05:07<00:11, 3.92it/s] Model Responding: 97%|█████████▋| 1330/1376 [05:07<00:12, 3.62it/s] Model Responding: 97%|█████████▋| 1331/1376 [05:08<00:13, 3.41it/s] Model Responding: 97%|█████████▋| 1332/1376 [05:08<00:12, 3.55it/s] Model Responding: 97%|█████████▋| 1333/1376 [05:08<00:12, 3.56it/s] Model Responding: 97%|█████████▋| 1334/1376 [05:08<00:10, 3.93it/s] Model Responding: 97%|█████████▋| 1335/1376 [05:09<00:10, 3.90it/s] Model Responding: 97%|█████████▋| 1336/1376 [05:09<00:10, 3.85it/s] Model Responding: 97%|█████████▋| 1337/1376 [05:09<00:09, 4.25it/s] Model Responding: 97%|█████████▋| 1338/1376 [05:09<00:09, 4.14it/s] Model Responding: 97%|█████████▋| 1339/1376 [05:09<00:09, 4.03it/s] Model Responding: 97%|█████████▋| 1340/1376 [05:10<00:09, 3.69it/s] Model Responding: 97%|█████████▋| 1341/1376 [05:10<00:10, 3.46it/s] Model Responding: 98%|█████████▊| 1342/1376 [05:10<00:09, 3.54it/s] Model Responding: 98%|█████████▊| 1343/1376 [05:11<00:09, 3.37it/s] Model Responding: 98%|█████████▊| 1344/1376 [05:11<00:09, 3.51it/s] Model Responding: 98%|█████████▊| 1345/1376 [05:11<00:08, 3.60it/s] Model Responding: 98%|█████████▊| 1346/1376 [05:11<00:07, 4.15it/s] Model Responding: 98%|█████████▊| 1347/1376 [05:12<00:07, 4.05it/s] Model Responding: 98%|█████████▊| 1348/1376 [05:12<00:07, 3.70it/s] Model Responding: 98%|█████████▊| 1349/1376 [05:12<00:07, 3.76it/s] Model Responding: 98%|█████████▊| 1350/1376 [05:13<00:07, 3.50it/s] Model Responding: 98%|█████████▊| 1351/1376 [05:13<00:07, 3.48it/s] Model Responding: 98%|█████████▊| 1352/1376 [05:13<00:06, 3.56it/s] Model Responding: 98%|█████████▊| 1353/1376 [05:13<00:06, 3.63it/s] Model Responding: 98%|█████████▊| 1354/1376 [05:14<00:05, 3.68it/s] Model Responding: 98%|█████████▊| 1355/1376 [05:14<00:05, 3.72it/s] Model Responding: 99%|█████████▊| 1356/1376 [05:14<00:05, 3.73it/s] Model Responding: 99%|█████████▊| 1357/1376 [05:14<00:04, 4.07it/s] Model Responding: 99%|█████████▊| 1358/1376 [05:15<00:04, 3.93it/s] Model Responding: 99%|█████████▉| 1359/1376 [05:15<00:04, 3.91it/s] Model Responding: 99%|█████████▉| 1360/1376 [05:15<00:04, 3.83it/s] Model Responding: 99%|█████████▉| 1361/1376 [05:15<00:03, 4.27it/s] Model Responding: 99%|█████████▉| 1362/1376 [05:16<00:03, 4.52it/s] Model Responding: 99%|█████████▉| 1363/1376 [05:16<00:02, 4.76it/s] Model Responding: 99%|█████████▉| 1364/1376 [05:16<00:02, 4.93it/s] Model Responding: 99%|█████████▉| 1365/1376 [05:16<00:02, 5.07it/s] Model Responding: 99%|█████████▉| 1366/1376 [05:16<00:01, 5.16it/s] Model Responding: 99%|█████████▉| 1367/1376 [05:16<00:01, 5.23it/s] Model Responding: 99%|█████████▉| 1368/1376 [05:17<00:01, 5.27it/s] Model Responding: 99%|█████████▉| 1369/1376 [05:17<00:01, 5.31it/s] Model Responding: 100%|█████████▉| 1370/1376 [05:17<00:01, 5.35it/s] Model Responding: 100%|█████████▉| 1371/1376 [05:17<00:00, 5.37it/s] Model Responding: 100%|█████████▉| 1372/1376 [05:17<00:00, 5.39it/s] Model Responding: 100%|█████████▉| 1373/1376 [05:18<00:00, 5.40it/s] Model Responding: 100%|█████████▉| 1374/1376 [05:18<00:00, 5.40it/s] Model Responding: 100%|█████████▉| 1375/1376 [05:18<00:00, 5.41it/s] Model Responding: 100%|██████████| 1376/1376 [05:18<00:00, 4.85it/s] Model Responding: 100%|██████████| 1376/1376 [05:18<00:00, 4.32it/s]
Postprocessing: 0%| | 0/542 [00:00<?, ?it/s] Postprocessing: 4%|▎ | 19/542 [00:00<00:02, 189.82it/s] Postprocessing: 7%|▋ | 38/542 [00:00<00:03, 153.70it/s] Postprocessing: 10%|▉ | 54/542 [00:00<00:03, 143.34it/s] Postprocessing: 13%|█▎ | 69/542 [00:00<00:03, 138.56it/s] Postprocessing: 15%|█▌ | 83/542 [00:00<00:03, 136.65it/s] Postprocessing: 18%|█▊ | 97/542 [00:00<00:03, 136.38it/s] Postprocessing: 21%|██ | 112/542 [00:00<00:03, 137.54it/s] Postprocessing: 24%|██▍ | 130/542 [00:00<00:02, 149.03it/s] Postprocessing: 27%|██▋ | 145/542 [00:01<00:02, 145.72it/s] Postprocessing: 30%|███ | 165/542 [00:01<00:02, 161.03it/s] Postprocessing: 34%|███▎ | 182/542 [00:01<00:02, 155.64it/s] Postprocessing: 37%|███▋ | 198/542 [00:01<00:02, 153.20it/s] Postprocessing: 39%|███▉ | 214/542 [00:01<00:02, 147.57it/s] Postprocessing: 42%|████▏ | 229/542 [00:01<00:02, 143.90it/s] Postprocessing: 45%|████▌ | 244/542 [00:01<00:02, 141.39it/s] Postprocessing: 48%|████▊ | 259/542 [00:01<00:01, 142.46it/s] Postprocessing: 51%|█████ | 277/542 [00:01<00:01, 152.80it/s] Postprocessing: 54%|█████▍ | 293/542 [00:01<00:01, 148.46it/s] Postprocessing: 57%|█████▋ | 310/542 [00:02<00:01, 154.14it/s] Postprocessing: 60%|██████ | 326/542 [00:02<00:01, 147.05it/s] Postprocessing: 63%|██████▎ | 341/542 [00:02<00:01, 146.17it/s] Postprocessing: 66%|██████▌ | 356/542 [00:02<00:01, 146.81it/s] Postprocessing: 68%|██████▊ | 371/542 [00:02<00:01, 140.88it/s] Postprocessing: 71%|███████▏ | 387/542 [00:02<00:01, 144.06it/s] Postprocessing: 74%|███████▍ | 403/542 [00:02<00:00, 147.01it/s] Postprocessing: 77%|███████▋ | 418/542 [00:02<00:00, 147.06it/s] Postprocessing: 80%|███████▉ | 433/542 [00:02<00:00, 143.78it/s] Postprocessing: 83%|████████▎ | 448/542 [00:03<00:00, 143.67it/s] Postprocessing: 85%|████████▌ | 463/542 [00:03<00:00, 142.24it/s] Postprocessing: 88%|████████▊ | 478/542 [00:03<00:00, 140.24it/s] Postprocessing: 91%|█████████ | 493/542 [00:03<00:00, 138.03it/s] Postprocessing: 94%|█████████▎| 508/542 [00:03<00:00, 139.49it/s] Postprocessing: 97%|█████████▋| 526/542 [00:03<00:00, 150.07it/s] Postprocessing: 100%|██████████| 542/542 [00:03<00:00, 146.31it/s] Postprocessing: 100%|██████████| 542/542 [00:03<00:00, 145.96it/s]
Postprocessing: 0%| | 0/834 [00:00<?, ?it/s] Postprocessing: 3%|▎ | 21/834 [00:00<00:04, 199.69it/s] Postprocessing: 5%|▍ | 41/834 [00:00<00:04, 184.37it/s] Postprocessing: 7%|▋ | 60/834 [00:00<00:04, 164.33it/s] Postprocessing: 9%|▉ | 77/834 [00:00<00:04, 157.80it/s] Postprocessing: 11%|█ | 93/834 [00:00<00:04, 154.03it/s] Postprocessing: 13%|█▎ | 109/834 [00:00<00:04, 149.90it/s] Postprocessing: 15%|█▍ | 125/834 [00:00<00:04, 149.09it/s] Postprocessing: 17%|█▋ | 141/834 [00:00<00:04, 149.59it/s] Postprocessing: 19%|█▉ | 158/834 [00:01<00:04, 154.29it/s] Postprocessing: 21%|██ | 174/834 [00:01<00:04, 146.88it/s] Postprocessing: 23%|██▎ | 190/834 [00:01<00:04, 149.75it/s] Postprocessing: 25%|██▍ | 207/834 [00:01<00:04, 154.21it/s] Postprocessing: 27%|██▋ | 224/834 [00:01<00:03, 158.64it/s] Postprocessing: 29%|██▉ | 244/834 [00:01<00:03, 170.05it/s] Postprocessing: 31%|███▏ | 262/834 [00:01<00:03, 171.09it/s] Postprocessing: 34%|███▎ | 280/834 [00:01<00:03, 165.92it/s] Postprocessing: 36%|███▌ | 297/834 [00:01<00:03, 158.87it/s] Postprocessing: 38%|███▊ | 313/834 [00:01<00:03, 156.29it/s] Postprocessing: 39%|███▉ | 329/834 [00:02<00:03, 151.05it/s] Postprocessing: 41%|████▏ | 345/834 [00:02<00:03, 149.04it/s] Postprocessing: 43%|████▎ | 361/834 [00:02<00:03, 150.47it/s] Postprocessing: 45%|████▌ | 377/834 [00:02<00:03, 149.01it/s] Postprocessing: 47%|████▋ | 393/834 [00:02<00:02, 150.06it/s] Postprocessing: 49%|████▉ | 409/834 [00:02<00:02, 146.17it/s] Postprocessing: 51%|█████▏ | 428/834 [00:02<00:02, 157.54it/s] Postprocessing: 53%|█████▎ | 445/834 [00:02<00:02, 159.86it/s] Postprocessing: 56%|█████▌ | 464/834 [00:02<00:02, 167.10it/s] Postprocessing: 58%|█████▊ | 481/834 [00:03<00:02, 166.03it/s] Postprocessing: 60%|█████▉ | 498/834 [00:03<00:02, 157.86it/s] Postprocessing: 62%|██████▏ | 514/834 [00:03<00:02, 155.05it/s] Postprocessing: 64%|██████▎ | 530/834 [00:03<00:02, 151.76it/s] Postprocessing: 65%|██████▌ | 546/834 [00:03<00:01, 148.52it/s] Postprocessing: 67%|██████▋ | 561/834 [00:03<00:01, 148.14it/s] Postprocessing: 69%|██████▉ | 577/834 [00:03<00:01, 148.44it/s] Postprocessing: 71%|███████ | 593/834 [00:03<00:01, 150.38it/s] Postprocessing: 73%|███████▎ | 609/834 [00:03<00:01, 145.71it/s] Postprocessing: 75%|███████▍ | 624/834 [00:04<00:01, 146.31it/s] Postprocessing: 77%|███████▋ | 642/834 [00:04<00:01, 155.61it/s] Postprocessing: 79%|███████▉ | 659/834 [00:04<00:01, 158.21it/s] Postprocessing: 81%|████████ | 675/834 [00:04<00:01, 150.97it/s] Postprocessing: 83%|████████▎ | 691/834 [00:04<00:00, 148.90it/s] Postprocessing: 85%|████████▍ | 706/834 [00:04<00:00, 146.80it/s] Postprocessing: 86%|████████▋ | 721/834 [00:04<00:00, 145.78it/s] Postprocessing: 88%|████████▊ | 736/834 [00:04<00:00, 146.67it/s] Postprocessing: 90%|█████████ | 752/834 [00:04<00:00, 148.15it/s] Postprocessing: 92%|█████████▏| 769/834 [00:04<00:00, 154.11it/s] Postprocessing: 94%|█████████▍| 785/834 [00:05<00:00, 146.41it/s] Postprocessing: 96%|█████████▌| 802/834 [00:05<00:00, 152.08it/s] Postprocessing: 98%|█████████▊| 818/834 [00:05<00:00, 154.24it/s] Postprocessing: 100%|██████████| 834/834 [00:05<00:00, 154.30it/s]
TENCENT64:79959:80373 [6] NCCL INFO Channel 00/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 00/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 00/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 00/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 00/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 00/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 00/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 01/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 01/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 01/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 01/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 01/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 01/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 01/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 02/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 02/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 02/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 02/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 02/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 02/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 02/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 03/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 03/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 03/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 03/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 03/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 03/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 03/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 04/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 04/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 04/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 04/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 04/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 04/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 04/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 05/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 05/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 05/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 05/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 05/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 05/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 05/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 06/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 06/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 06/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 06/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 06/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 06/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 06/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 07/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 07/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 07/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 07/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 07/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 07/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 07/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 08/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 08/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 08/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 08/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 08/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 08/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 08/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 09/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 09/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 09/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 09/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 09/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 09/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 09/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 10/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 10/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 10/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 10/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 10/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 10/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 10/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 11/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 11/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 11/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 11/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 11/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 11/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 11/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 12/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 12/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 12/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 12/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 12/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 12/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 12/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 13/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 13/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 13/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 13/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 13/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 13/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 13/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 14/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 14/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 14/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 14/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 14/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 14/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 14/1 : 1[1] -> 0[0] via P2P/CUMEM/read
TENCENT64:79959:80373 [6] NCCL INFO Channel 15/1 : 6[6] -> 0[0] via P2P/CUMEM/read
TENCENT64:79956:80374 [3] NCCL INFO Channel 15/1 : 3[3] -> 0[0] via P2P/CUMEM/read
TENCENT64:79958:80375 [5] NCCL INFO Channel 15/1 : 5[5] -> 0[0] via P2P/CUMEM/read
TENCENT64:79957:80377 [4] NCCL INFO Channel 15/1 : 4[4] -> 0[0] via P2P/CUMEM/read
TENCENT64:79955:80376 [2] NCCL INFO Channel 15/1 : 2[2] -> 0[0] via P2P/CUMEM/read
TENCENT64:79960:80378 [7] NCCL INFO Channel 15/1 : 7[7] -> 0[0] via P2P/CUMEM/read
TENCENT64:79954:80380 [1] NCCL INFO Channel 15/1 : 1[1] -> 0[0] via P2P/CUMEM/read
============= MMBench-EN(Dev) Detailed Results =============
Category Acc. (dev):
action_recognition: 88.889
attribute_comparison: 63.636
attribute_recognition: 89.189
celebrity_recognition: 80.808
function_reasoning: 73.418
future_prediction: 42.500
identity_reasoning: 97.778
image_emotion: 80.000
image_quality: 52.830
image_scene: 96.154
image_style: 86.792
image_topic: 77.778
nature_relation: 56.250
object_localization: 46.914
ocr: 66.667
physical_property_reasoning: 49.333
physical_relation: 41.667
social_relation: 93.023
spatial_relationship: 20.000
structuralized_imagetext_understanding: 30.769
L2-category Acc. (dev):
attribute_reasoning: 69.849
coarse_perception: 81.757
finegrained_perception (cross-instance): 59.441
finegrained_perception (instance-level): 71.672
logic_reasoning: 34.746
relation_reasoning: 66.957
2025-05-19 01:50:54.491 | INFO  | en_utils:mmbench_aggregate_dev_results_submission:121 - Saved results to /jizhicfs/bojoli/mmpe/mmpe-main/eval/logs/submissions/mmbench_en_dev_results.xlsx
2025-05-19 01:50:55.933 | INFO  | en_utils:mmbench_aggregate_test_results:129 - Saved results to /jizhicfs/bojoli/mmpe/mmpe-main/eval/logs/submissions/mmbench_en_test_results.xlsx
fatal: not a git repository (or any parent up to mount point /)
Stopping at filesystem boundary (GIT_DISCOVERY_ACROSS_FILESYSTEM not set).
2025-05-19 01:50:56.096 | INFO  | lmms_eval.loggers.evaluation_tracker:save_results_aggregated:188 - Saving results aggregated
2025-05-19 01:50:56.105 | INFO  | lmms_eval.loggers.evaluation_tracker:save_results_samples:255 - Saving per-sample results for: mmbench_en_dev
2025-05-19 01:50:57.564 | INFO  | lmms_eval.loggers.evaluation_tracker:save_results_samples:255 - Saving per-sample results for: mmbench_en_test
llava (pretrained=../checkpoints/final_mmpe_finetune_vicuna-7b-1.5_clip-vit-large-patch14-336,conv_template=v1), gen_kwargs: (), limit: None, num_fewshot: None, batch_size: 1
| Tasks |Version|Filter|n-shot| Metric | | Value | |Stderr|
|------------------|-------|------|-----:|--------------|---|-------|---|------|
|mmbench_en | N/A| | | | | | | |
| - mmbench_en_dev |Yaml |none | 0|gpt_eval_score|↑ |68.2131|± | N/A|
| - mmbench_en_dev |Yaml |none | 0|submission |↑ |N/A |± | N/A|
| - mmbench_en_test|Yaml |none | 0|submission |↑ |N/A |± | N/A|