| [38;5;127mmpi[0m/[38;5;172mopenmpi[0m/[38;5;67m4.1.5[0m/[38;5;68mgcc-4.8.5[0m | |
| | -- [38;5;127mlibs[0m/[38;5;172mgcc[0m/[38;5;67msystem[0m | |
| | * --> [0;32mOK[0m | |
| | | |
| [0;32mOK[0m | |
| [38;5;127mmpi[0m/[38;5;172mopenmpi[0m/[38;5;67m4.1.5[0m/[38;5;68mgcc-4.8.5[0m ... UNLOADING --> [0;32mOK[0m | |
| [38;5;127mlibs[0m/[38;5;172mgcc[0m/[38;5;67msystem[0m ... UNLOADING --> [0;32mOK[0m | |
| The following values were not passed to `accelerate launch` and had defaults used instead: | |
| `--num_processes` was set to a value of `1` | |
| `--num_machines` was set to a value of `1` | |
| `--mixed_precision` was set to a value of `'no'` | |
| `--dynamo_backend` was set to a value of `'no'` | |
| To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`. | |
| Tokenizing Prompts (num_proc=64): 0%| | 0/111 [00:00<?, ? examples/s] Tokenizing Prompts (num_proc=64): 2%|▏ | 2/111 [00:00<00:20, 5.25 examples/s] Tokenizing Prompts (num_proc=64): 5%|▌ | 6/111 [00:00<00:07, 13.91 examples/s] Tokenizing Prompts (num_proc=64): 9%|▉ | 10/111 [00:00<00:05, 17.30 examples/s] Tokenizing Prompts (num_proc=64): 13%|█▎ | 14/111 [00:00<00:04, 20.80 examples/s] Tokenizing Prompts (num_proc=64): 18%|█▊ | 20/111 [00:00<00:03, 29.55 examples/s] Tokenizing Prompts (num_proc=64): 22%|██▏ | 24/111 [00:01<00:02, 30.95 examples/s] Tokenizing Prompts (num_proc=64): 25%|██▌ | 28/111 [00:01<00:02, 32.54 examples/s] Tokenizing Prompts (num_proc=64): 29%|██▉ | 32/111 [00:01<00:02, 32.69 examples/s] Tokenizing Prompts (num_proc=64): 32%|███▏ | 36/111 [00:01<00:02, 33.43 examples/s] Tokenizing Prompts (num_proc=64): 36%|███▌ | 40/111 [00:01<00:02, 33.16 examples/s] Tokenizing Prompts (num_proc=64): 40%|███▉ | 44/111 [00:01<00:01, 34.80 examples/s] Tokenizing Prompts (num_proc=64): 58%|█████▊ | 64/111 [00:01<00:00, 78.99 examples/s] Tokenizing Prompts (num_proc=64): 79%|███████▉ | 88/111 [00:01<00:00, 122.86 examples/s] Tokenizing Prompts (num_proc=64): 93%|█████████▎| 103/111 [00:01<00:00, 127.47 examples/s] Tokenizing Prompts (num_proc=64): 100%|██████████| 111/111 [00:02<00:00, 53.99 examples/s] | |
| Dropping Long Sequences (num_proc=64): 0%| | 0/111 [00:00<?, ? examples/s] Dropping Long Sequences (num_proc=64): 2%|▏ | 2/111 [00:00<00:17, 6.28 examples/s] Dropping Long Sequences (num_proc=64): 7%|▋ | 8/111 [00:00<00:05, 20.12 examples/s] Dropping Long Sequences (num_proc=64): 22%|██▏ | 24/111 [00:00<00:01, 58.49 examples/s] Dropping Long Sequences (num_proc=64): 76%|███████▌ | 84/111 [00:00<00:00, 211.25 examples/s] Dropping Long Sequences (num_proc=64): 100%|██████████| 111/111 [00:00<00:00, 136.77 examples/s] | |
| Saving the dataset (0/1 shards): 0%| | 0/111 [00:00<?, ? examples/s] Saving the dataset (1/1 shards): 100%|██████████| 111/111 [00:00<00:00, 8411.95 examples/s] Saving the dataset (1/1 shards): 100%|██████████| 111/111 [00:00<00:00, 8309.70 examples/s] | |
| Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 50%|█████ | 1/2 [00:09<00:09, 9.93s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:14<00:00, 6.77s/it] Loading checkpoint shards: 100%|██████████| 2/2 [00:14<00:00, 7.24s/it] | |
| 0%| | 0/62 [00:00<?, ?it/s] 2%|▏ | 1/62 [00:03<03:15, 3.20s/it] 2%|▏ | 1/62 [00:03<03:15, 3.20s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.95it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.32it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.47it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.07it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.86it/s] | |
| 2%|▏ | 1/62 [00:04<03:15, 3.20s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.86it/s] | |
| 3%|▎ | 2/62 [00:07<03:49, 3.82s/it] 3%|▎ | 2/62 [00:07<03:49, 3.82s/it] 5%|▍ | 3/62 [00:10<03:20, 3.40s/it] 5%|▍ | 3/62 [00:10<03:20, 3.40s/it] 6%|▋ | 4/62 [00:13<03:05, 3.20s/it] 6%|▋ | 4/62 [00:13<03:05, 3.20s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.91it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.29it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.45it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.06it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.84it/s] | |
| 6%|▋ | 4/62 [00:14<03:05, 3.20s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.84it/s] | |
| 8%|▊ | 5/62 [00:17<03:24, 3.58s/it] 8%|▊ | 5/62 [00:17<03:24, 3.58s/it] 10%|▉ | 6/62 [00:20<03:07, 3.35s/it] 10%|▉ | 6/62 [00:20<03:07, 3.35s/it] 11%|█▏ | 7/62 [00:23<02:56, 3.20s/it] 11%|█▏ | 7/62 [00:23<02:56, 3.20s/it] 13%|█▎ | 8/62 [00:26<02:47, 3.10s/it] 13%|█▎ | 8/62 [00:26<02:47, 3.10s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.92it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.28it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.44it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.04it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.83it/s] | |
| 13%|█▎ | 8/62 [00:27<02:47, 3.10s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.83it/s] | |
| 15%|█▍ | 9/62 [00:30<03:03, 3.47s/it] 15%|█▍ | 9/62 [00:30<03:03, 3.47s/it] 16%|█▌ | 10/62 [00:33<02:51, 3.29s/it] 16%|█▌ | 10/62 [00:33<02:51, 3.29s/it] 18%|█▊ | 11/62 [00:36<02:41, 3.17s/it] 18%|█▊ | 11/62 [00:36<02:41, 3.17s/it] 19%|█▉ | 12/62 [00:39<02:34, 3.09s/it] 19%|█▉ | 12/62 [00:39<02:34, 3.09s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.89it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.27it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.43it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.03it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.82it/s] | |
| 19%|█▉ | 12/62 [00:40<02:34, 3.09s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.82it/s] | |
| 21%|██ | 13/62 [00:43<02:46, 3.40s/it] 21%|██ | 13/62 [00:43<02:46, 3.40s/it] 23%|██▎ | 14/62 [00:47<02:49, 3.53s/it] 23%|██▎ | 14/62 [00:47<02:49, 3.53s/it] 24%|██▍ | 15/62 [00:50<02:37, 3.35s/it] 24%|██▍ | 15/62 [00:50<02:37, 3.35s/it] 26%|██▌ | 16/62 [00:52<02:27, 3.21s/it] 26%|██▌ | 16/62 [00:52<02:27, 3.21s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.86it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.24it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.41it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.02it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.81it/s] | |
| 26%|██▌ | 16/62 [00:54<02:27, 3.21s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.81it/s] | |
| 27%|██▋ | 17/62 [00:57<02:39, 3.54s/it] 27%|██▋ | 17/62 [00:57<02:39, 3.54s/it] 29%|██▉ | 18/62 [01:00<02:27, 3.35s/it] 29%|██▉ | 18/62 [01:00<02:27, 3.35s/it] 31%|███ | 19/62 [01:03<02:18, 3.22s/it] 31%|███ | 19/62 [01:03<02:18, 3.22s/it] 32%|███▏ | 20/62 [01:05<02:11, 3.13s/it] 32%|███▏ | 20/62 [01:05<02:11, 3.13s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.83it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.24it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.41it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.01it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.80it/s] | |
| 32%|███▏ | 20/62 [01:07<02:11, 3.13s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.80it/s] | |
| 34%|███▍ | 21/62 [01:10<02:22, 3.48s/it] 34%|███▍ | 21/62 [01:10<02:22, 3.48s/it] 35%|███▌ | 22/62 [01:13<02:12, 3.31s/it] 35%|███▌ | 22/62 [01:13<02:12, 3.31s/it] 37%|███▋ | 23/62 [01:16<02:04, 3.19s/it] 37%|███▋ | 23/62 [01:16<02:04, 3.19s/it] 39%|███▊ | 24/62 [01:18<01:58, 3.11s/it] 39%|███▊ | 24/62 [01:19<01:58, 3.11s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.83it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.23it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.39it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.00it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.79it/s] | |
| 39%|███▊ | 24/62 [01:20<01:58, 3.11s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.79it/s] | |
| 40%|████ | 25/62 [01:23<02:06, 3.42s/it] 40%|████ | 25/62 [01:23<02:06, 3.42s/it] 42%|████▏ | 26/62 [01:26<01:57, 3.27s/it] 42%|████▏ | 26/62 [01:26<01:57, 3.27s/it] 44%|████▎ | 27/62 [01:29<01:58, 3.39s/it] 44%|████▎ | 27/62 [01:29<01:58, 3.39s/it] 45%|████▌ | 28/62 [01:32<01:50, 3.25s/it] 45%|████▌ | 28/62 [01:32<01:50, 3.25s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.84it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.23it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.40it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.00it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.79it/s] | |
| 45%|████▌ | 28/62 [01:34<01:50, 3.25s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.79it/s] | |
| 47%|████▋ | 29/62 [01:36<01:57, 3.57s/it] 47%|████▋ | 29/62 [01:36<01:57, 3.57s/it] 48%|████▊ | 30/62 [01:39<01:47, 3.37s/it] 48%|████▊ | 30/62 [01:39<01:47, 3.37s/it] 50%|█████ | 31/62 [01:42<01:40, 3.24s/it] 50%|█████ | 31/62 [01:42<01:40, 3.24s/it] 52%|█████▏ | 32/62 [01:45<01:34, 3.14s/it] 52%|█████▏ | 32/62 [01:45<01:34, 3.14s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.81it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.21it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.39it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.00it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.79it/s] | |
| 52%|█████▏ | 32/62 [01:47<01:34, 3.14s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.79it/s] | |
| 53%|█████▎ | 33/62 [01:50<01:41, 3.49s/it] 53%|█████▎ | 33/62 [01:50<01:41, 3.49s/it] 55%|█████▍ | 34/62 [01:52<01:32, 3.32s/it] 55%|█████▍ | 34/62 [01:52<01:32, 3.32s/it] 56%|█████▋ | 35/62 [01:55<01:26, 3.20s/it] 56%|█████▋ | 35/62 [01:55<01:26, 3.20s/it] 58%|█████▊ | 36/62 [01:58<01:20, 3.11s/it] 58%|█████▊ | 36/62 [01:58<01:20, 3.11s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.82it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.22it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.39it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.00it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.78it/s] | |
| 58%|█████▊ | 36/62 [02:00<01:20, 3.11s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.78it/s] | |
| 60%|█████▉ | 37/62 [02:03<01:26, 3.47s/it] 60%|█████▉ | 37/62 [02:03<01:26, 3.47s/it] 61%|██████▏ | 38/62 [02:05<01:18, 3.26s/it] 61%|██████▏ | 38/62 [02:05<01:18, 3.26s/it] 63%|██████▎ | 39/62 [02:08<01:12, 3.15s/it] 63%|██████▎ | 39/62 [02:08<01:12, 3.15s/it] 65%|██████▍ | 40/62 [02:12<01:12, 3.32s/it] 65%|██████▍ | 40/62 [02:12<01:12, 3.32s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.84it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.23it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.40it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 5.00it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.79it/s] | |
| 65%|██████▍ | 40/62 [02:13<01:12, 3.32s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.79it/s] | |
| 66%|██████▌ | 41/62 [02:16<01:15, 3.61s/it] 66%|██████▌ | 41/62 [02:16<01:15, 3.61s/it] 68%|██████▊ | 42/62 [02:19<01:08, 3.40s/it] 68%|██████▊ | 42/62 [02:19<01:08, 3.40s/it] 69%|██████▉ | 43/62 [02:22<01:01, 3.26s/it] 69%|██████▉ | 43/62 [02:22<01:01, 3.26s/it] 71%|███████ | 44/62 [02:25<00:56, 3.16s/it] 71%|███████ | 44/62 [02:25<00:56, 3.16s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.80it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.21it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.38it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 4.99it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.78it/s] | |
| 71%|███████ | 44/62 [02:26<00:56, 3.16s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.78it/s] | |
| 73%|███████▎ | 45/62 [02:29<00:59, 3.50s/it] 73%|███████▎ | 45/62 [02:29<00:59, 3.50s/it] 74%|███████▍ | 46/62 [02:32<00:53, 3.33s/it] 74%|███████▍ | 46/62 [02:32<00:53, 3.33s/it] 76%|███████▌ | 47/62 [02:35<00:48, 3.20s/it] 76%|███████▌ | 47/62 [02:35<00:48, 3.20s/it] 77%|███████▋ | 48/62 [02:38<00:43, 3.12s/it] 77%|███████▋ | 48/62 [02:38<00:43, 3.12s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.80it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.21it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.38it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 4.98it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.77it/s] | |
| 77%|███████▋ | 48/62 [02:39<00:43, 3.12s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.77it/s] | |
| 79%|███████▉ | 49/62 [02:42<00:45, 3.48s/it] 79%|███████▉ | 49/62 [02:42<00:45, 3.48s/it] 81%|████████ | 50/62 [02:45<00:39, 3.26s/it] 81%|████████ | 50/62 [02:45<00:39, 3.26s/it] 82%|████████▏ | 51/62 [02:48<00:34, 3.16s/it] 82%|████████▏ | 51/62 [02:48<00:34, 3.16s/it] 84%|████████▍ | 52/62 [02:51<00:30, 3.09s/it] 84%|████████▍ | 52/62 [02:51<00:30, 3.09s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.78it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.18it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.37it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 4.98it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.77it/s] | |
| 84%|████████▍ | 52/62 [02:52<00:30, 3.09s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.77it/s] | |
| 85%|████████▌ | 53/62 [02:56<00:33, 3.74s/it] 85%|████████▌ | 53/62 [02:56<00:33, 3.74s/it] 87%|████████▋ | 54/62 [02:59<00:27, 3.49s/it] 87%|████████▋ | 54/62 [02:59<00:27, 3.49s/it] 89%|████████▊ | 55/62 [03:02<00:23, 3.32s/it] 89%|████████▊ | 55/62 [03:02<00:23, 3.32s/it] 90%|█████████ | 56/62 [03:05<00:19, 3.20s/it] 90%|█████████ | 56/62 [03:05<00:19, 3.20s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.79it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.19it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.37it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 4.99it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.78it/s] | |
| 90%|█████████ | 56/62 [03:06<00:19, 3.20s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.78it/s] | |
| 92%|█████████▏| 57/62 [03:09<00:17, 3.53s/it] 92%|█████████▏| 57/62 [03:09<00:17, 3.53s/it] 94%|█████████▎| 58/62 [03:12<00:13, 3.35s/it] 94%|█████████▎| 58/62 [03:12<00:13, 3.35s/it] 95%|█████████▌| 59/62 [03:15<00:09, 3.22s/it] 95%|█████████▌| 59/62 [03:15<00:09, 3.22s/it] 97%|█████████▋| 60/62 [03:18<00:06, 3.13s/it] 97%|█████████▋| 60/62 [03:18<00:06, 3.13s/it] | |
| 0%| | 0/6 [00:00<?, ?it/s] | |
| 33%|███▎ | 2/6 [00:00<00:00, 8.81it/s] | |
| 50%|█████ | 3/6 [00:00<00:00, 6.22it/s] | |
| 67%|██████▋ | 4/6 [00:00<00:00, 5.39it/s] | |
| 83%|████████▎ | 5/6 [00:00<00:00, 4.99it/s] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.77it/s] | |
| 97%|█████████▋| 60/62 [03:19<00:06, 3.13s/it] | |
| 100%|██████████| 6/6 [00:01<00:00, 4.77it/s] | |
| 98%|█████████▊| 61/62 [03:22<00:03, 3.49s/it] 98%|█████████▊| 61/62 [03:22<00:03, 3.49s/it] 100%|██████████| 62/62 [03:25<00:00, 3.32s/it] 100%|██████████| 62/62 [03:25<00:00, 3.32s/it] 100%|██████████| 62/62 [03:25<00:00, 3.32s/it] 100%|██████████| 62/62 [03:25<00:00, 3.32s/it] | |