mpi/openmpi/4.1.5/gcc-4.8.5
 | -- libs/gcc/system
 |    * --> OK
 |
 OK
             mpi/openmpi/4.1.5/gcc-4.8.5 ... UNLOADING --> OK
                         libs/gcc/system ... UNLOADING --> OK
The following values were not passed to `accelerate launch` and had defaults used instead:
	`--num_processes` was set to a value of `1`
	`--num_machines` was set to a value of `1`
	`--mixed_precision` was set to a value of `'no'`
	`--dynamo_backend` was set to a value of `'no'`
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`.

Tokenizing Prompts (num_proc=64):   0%|          | 0/111 [00:00<?, ? examples/s]
Tokenizing Prompts (num_proc=64):   2%|▏         | 2/111 [00:00<00:20,  5.25 examples/s]
Tokenizing Prompts (num_proc=64):   5%|▌         | 6/111 [00:00<00:07, 13.91 examples/s]
Tokenizing Prompts (num_proc=64):   9%|▉         | 10/111 [00:00<00:05, 17.30 examples/s]
Tokenizing Prompts (num_proc=64):  13%|█▎        | 14/111 [00:00<00:04, 20.80 examples/s]
Tokenizing Prompts (num_proc=64):  18%|█▊        | 20/111 [00:00<00:03, 29.55 examples/s]
Tokenizing Prompts (num_proc=64):  22%|██▏       | 24/111 [00:01<00:02, 30.95 examples/s]
Tokenizing Prompts (num_proc=64):  25%|██▌       | 28/111 [00:01<00:02, 32.54 examples/s]
Tokenizing Prompts (num_proc=64):  29%|██▉       | 32/111 [00:01<00:02, 32.69 examples/s]
Tokenizing Prompts (num_proc=64):  32%|███▏      | 36/111 [00:01<00:02, 33.43 examples/s]
Tokenizing Prompts (num_proc=64):  36%|███▌      | 40/111 [00:01<00:02, 33.16 examples/s]
Tokenizing Prompts (num_proc=64):  40%|███▉      | 44/111 [00:01<00:01, 34.80 examples/s]
Tokenizing Prompts (num_proc=64):  58%|█████▊    | 64/111 [00:01<00:00, 78.99 examples/s]
Tokenizing Prompts (num_proc=64):  79%|███████▉  | 88/111 [00:01<00:00, 122.86 examples/s]
Tokenizing Prompts (num_proc=64):  93%|█████████▎| 103/111 [00:01<00:00, 127.47 examples/s]
Tokenizing Prompts (num_proc=64): 100%|██████████| 111/111 [00:02<00:00, 53.99 examples/s] 

Dropping Long Sequences (num_proc=64):   0%|          | 0/111 [00:00<?, ? examples/s]
Dropping Long Sequences (num_proc=64):   2%|▏         | 2/111 [00:00<00:17,  6.28 examples/s]
Dropping Long Sequences (num_proc=64):   7%|▋         | 8/111 [00:00<00:05, 20.12 examples/s]
Dropping Long Sequences (num_proc=64):  22%|██▏       | 24/111 [00:00<00:01, 58.49 examples/s]
Dropping Long Sequences (num_proc=64):  76%|███████▌  | 84/111 [00:00<00:00, 211.25 examples/s]
Dropping Long Sequences (num_proc=64): 100%|██████████| 111/111 [00:00<00:00, 136.77 examples/s]

Saving the dataset (0/1 shards):   0%|          | 0/111 [00:00<?, ? examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 111/111 [00:00<00:00, 8411.95 examples/s]
Saving the dataset (1/1 shards): 100%|██████████| 111/111 [00:00<00:00, 8309.70 examples/s]

Loading checkpoint shards:   0%|          | 0/2 [00:00<?, ?it/s]
Loading checkpoint shards:  50%|█████     | 1/2 [00:09<00:09,  9.93s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:14<00:00,  6.77s/it]
Loading checkpoint shards: 100%|██████████| 2/2 [00:14<00:00,  7.24s/it]

  0%|          | 0/62 [00:00<?, ?it/s]
  2%|▏         | 1/62 [00:03<03:15,  3.20s/it]
                                              

  2%|▏         | 1/62 [00:03<03:15,  3.20s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.95it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.32it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.47it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.07it/s]

100%|██████████| 6/6 [00:01<00:00,  4.86it/s]
                                              

                                             

  2%|▏         | 1/62 [00:04<03:15,  3.20s/it]

100%|██████████| 6/6 [00:01<00:00,  4.86it/s]

                                             
  3%|▎         | 2/62 [00:07<03:49,  3.82s/it]
                                              

  3%|▎         | 2/62 [00:07<03:49,  3.82s/it]
  5%|▍         | 3/62 [00:10<03:20,  3.40s/it]
                                              

  5%|▍         | 3/62 [00:10<03:20,  3.40s/it]
  6%|▋         | 4/62 [00:13<03:05,  3.20s/it]
                                              

  6%|▋         | 4/62 [00:13<03:05,  3.20s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.91it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.29it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.45it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.06it/s]

100%|██████████| 6/6 [00:01<00:00,  4.84it/s]
                                              

                                             

  6%|▋         | 4/62 [00:14<03:05,  3.20s/it]

100%|██████████| 6/6 [00:01<00:00,  4.84it/s]

                                             
  8%|▊         | 5/62 [00:17<03:24,  3.58s/it]
                                              

  8%|▊         | 5/62 [00:17<03:24,  3.58s/it]
 10%|▉         | 6/62 [00:20<03:07,  3.35s/it]
                                              

 10%|▉         | 6/62 [00:20<03:07,  3.35s/it]
 11%|█▏        | 7/62 [00:23<02:56,  3.20s/it]
                                              

 11%|█▏        | 7/62 [00:23<02:56,  3.20s/it]
 13%|█▎        | 8/62 [00:26<02:47,  3.10s/it]
                                              

 13%|█▎        | 8/62 [00:26<02:47,  3.10s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.92it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.28it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.44it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.04it/s]

100%|██████████| 6/6 [00:01<00:00,  4.83it/s]
                                              

                                             

 13%|█▎        | 8/62 [00:27<02:47,  3.10s/it]

100%|██████████| 6/6 [00:01<00:00,  4.83it/s]

                                             
 15%|█▍        | 9/62 [00:30<03:03,  3.47s/it]
                                              

 15%|█▍        | 9/62 [00:30<03:03,  3.47s/it]
 16%|█▌        | 10/62 [00:33<02:51,  3.29s/it]
                                               

 16%|█▌        | 10/62 [00:33<02:51,  3.29s/it]
 18%|█▊        | 11/62 [00:36<02:41,  3.17s/it]
                                               

 18%|█▊        | 11/62 [00:36<02:41,  3.17s/it]
 19%|█▉        | 12/62 [00:39<02:34,  3.09s/it]
                                               

 19%|█▉        | 12/62 [00:39<02:34,  3.09s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.89it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.27it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.43it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.03it/s]

100%|██████████| 6/6 [00:01<00:00,  4.82it/s]
                                               

                                             

 19%|█▉        | 12/62 [00:40<02:34,  3.09s/it]

100%|██████████| 6/6 [00:01<00:00,  4.82it/s]

                                             
 21%|██        | 13/62 [00:43<02:46,  3.40s/it]
                                               

 21%|██        | 13/62 [00:43<02:46,  3.40s/it]
 23%|██▎       | 14/62 [00:47<02:49,  3.53s/it]
                                               

 23%|██▎       | 14/62 [00:47<02:49,  3.53s/it]
 24%|██▍       | 15/62 [00:50<02:37,  3.35s/it]
                                               

 24%|██▍       | 15/62 [00:50<02:37,  3.35s/it]
 26%|██▌       | 16/62 [00:52<02:27,  3.21s/it]
                                               

 26%|██▌       | 16/62 [00:52<02:27,  3.21s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.86it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.24it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.41it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.02it/s]

100%|██████████| 6/6 [00:01<00:00,  4.81it/s]
                                               

                                             

 26%|██▌       | 16/62 [00:54<02:27,  3.21s/it]

100%|██████████| 6/6 [00:01<00:00,  4.81it/s]

                                             
 27%|██▋       | 17/62 [00:57<02:39,  3.54s/it]
                                               

 27%|██▋       | 17/62 [00:57<02:39,  3.54s/it]
 29%|██▉       | 18/62 [01:00<02:27,  3.35s/it]
                                               

 29%|██▉       | 18/62 [01:00<02:27,  3.35s/it]
 31%|███       | 19/62 [01:03<02:18,  3.22s/it]
                                               

 31%|███       | 19/62 [01:03<02:18,  3.22s/it]
 32%|███▏      | 20/62 [01:05<02:11,  3.13s/it]
                                               

 32%|███▏      | 20/62 [01:05<02:11,  3.13s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.83it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.24it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.41it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.01it/s]

100%|██████████| 6/6 [00:01<00:00,  4.80it/s]
                                               

                                             

 32%|███▏      | 20/62 [01:07<02:11,  3.13s/it]

100%|██████████| 6/6 [00:01<00:00,  4.80it/s]

                                             
 34%|███▍      | 21/62 [01:10<02:22,  3.48s/it]
                                               

 34%|███▍      | 21/62 [01:10<02:22,  3.48s/it]
 35%|███▌      | 22/62 [01:13<02:12,  3.31s/it]
                                               

 35%|███▌      | 22/62 [01:13<02:12,  3.31s/it]
 37%|███▋      | 23/62 [01:16<02:04,  3.19s/it]
                                               

 37%|███▋      | 23/62 [01:16<02:04,  3.19s/it]
 39%|███▊      | 24/62 [01:18<01:58,  3.11s/it]
                                               

 39%|███▊      | 24/62 [01:19<01:58,  3.11s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.83it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.23it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.39it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.00it/s]

100%|██████████| 6/6 [00:01<00:00,  4.79it/s]
                                               

                                             

 39%|███▊      | 24/62 [01:20<01:58,  3.11s/it]

100%|██████████| 6/6 [00:01<00:00,  4.79it/s]

                                             
 40%|████      | 25/62 [01:23<02:06,  3.42s/it]
                                               

 40%|████      | 25/62 [01:23<02:06,  3.42s/it]
 42%|████▏     | 26/62 [01:26<01:57,  3.27s/it]
                                               

 42%|████▏     | 26/62 [01:26<01:57,  3.27s/it]
 44%|████▎     | 27/62 [01:29<01:58,  3.39s/it]
                                               

 44%|████▎     | 27/62 [01:29<01:58,  3.39s/it]
 45%|████▌     | 28/62 [01:32<01:50,  3.25s/it]
                                               

 45%|████▌     | 28/62 [01:32<01:50,  3.25s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.84it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.23it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.40it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.00it/s]

100%|██████████| 6/6 [00:01<00:00,  4.79it/s]
                                               

                                             

 45%|████▌     | 28/62 [01:34<01:50,  3.25s/it]

100%|██████████| 6/6 [00:01<00:00,  4.79it/s]

                                             
 47%|████▋     | 29/62 [01:36<01:57,  3.57s/it]
                                               

 47%|████▋     | 29/62 [01:36<01:57,  3.57s/it]
 48%|████▊     | 30/62 [01:39<01:47,  3.37s/it]
                                               

 48%|████▊     | 30/62 [01:39<01:47,  3.37s/it]
 50%|█████     | 31/62 [01:42<01:40,  3.24s/it]
                                               

 50%|█████     | 31/62 [01:42<01:40,  3.24s/it]
 52%|█████▏    | 32/62 [01:45<01:34,  3.14s/it]
                                               

 52%|█████▏    | 32/62 [01:45<01:34,  3.14s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.81it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.21it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.39it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.00it/s]

100%|██████████| 6/6 [00:01<00:00,  4.79it/s]
                                               

                                             

 52%|█████▏    | 32/62 [01:47<01:34,  3.14s/it]

100%|██████████| 6/6 [00:01<00:00,  4.79it/s]

                                             
 53%|█████▎    | 33/62 [01:50<01:41,  3.49s/it]
                                               

 53%|█████▎    | 33/62 [01:50<01:41,  3.49s/it]
 55%|█████▍    | 34/62 [01:52<01:32,  3.32s/it]
                                               

 55%|█████▍    | 34/62 [01:52<01:32,  3.32s/it]
 56%|█████▋    | 35/62 [01:55<01:26,  3.20s/it]
                                               

 56%|█████▋    | 35/62 [01:55<01:26,  3.20s/it]
 58%|█████▊    | 36/62 [01:58<01:20,  3.11s/it]
                                               

 58%|█████▊    | 36/62 [01:58<01:20,  3.11s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.82it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.22it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.39it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.00it/s]

100%|██████████| 6/6 [00:01<00:00,  4.78it/s]
                                               

                                             

 58%|█████▊    | 36/62 [02:00<01:20,  3.11s/it]

100%|██████████| 6/6 [00:01<00:00,  4.78it/s]

                                             
 60%|█████▉    | 37/62 [02:03<01:26,  3.47s/it]
                                               

 60%|█████▉    | 37/62 [02:03<01:26,  3.47s/it]
 61%|██████▏   | 38/62 [02:05<01:18,  3.26s/it]
                                               

 61%|██████▏   | 38/62 [02:05<01:18,  3.26s/it]
 63%|██████▎   | 39/62 [02:08<01:12,  3.15s/it]
                                               

 63%|██████▎   | 39/62 [02:08<01:12,  3.15s/it]
 65%|██████▍   | 40/62 [02:12<01:12,  3.32s/it]
                                               

 65%|██████▍   | 40/62 [02:12<01:12,  3.32s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.84it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.23it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.40it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  5.00it/s]

100%|██████████| 6/6 [00:01<00:00,  4.79it/s]
                                               

                                             

 65%|██████▍   | 40/62 [02:13<01:12,  3.32s/it]

100%|██████████| 6/6 [00:01<00:00,  4.79it/s]

                                             
 66%|██████▌   | 41/62 [02:16<01:15,  3.61s/it]
                                               

 66%|██████▌   | 41/62 [02:16<01:15,  3.61s/it]
 68%|██████▊   | 42/62 [02:19<01:08,  3.40s/it]
                                               

 68%|██████▊   | 42/62 [02:19<01:08,  3.40s/it]
 69%|██████▉   | 43/62 [02:22<01:01,  3.26s/it]
                                               

 69%|██████▉   | 43/62 [02:22<01:01,  3.26s/it]
 71%|███████   | 44/62 [02:25<00:56,  3.16s/it]
                                               

 71%|███████   | 44/62 [02:25<00:56,  3.16s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.80it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.21it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.38it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  4.99it/s]

100%|██████████| 6/6 [00:01<00:00,  4.78it/s]
                                               

                                             

 71%|███████   | 44/62 [02:26<00:56,  3.16s/it]

100%|██████████| 6/6 [00:01<00:00,  4.78it/s]

                                             
 73%|███████▎  | 45/62 [02:29<00:59,  3.50s/it]
                                               

 73%|███████▎  | 45/62 [02:29<00:59,  3.50s/it]
 74%|███████▍  | 46/62 [02:32<00:53,  3.33s/it]
                                               

 74%|███████▍  | 46/62 [02:32<00:53,  3.33s/it]
 76%|███████▌  | 47/62 [02:35<00:48,  3.20s/it]
                                               

 76%|███████▌  | 47/62 [02:35<00:48,  3.20s/it]
 77%|███████▋  | 48/62 [02:38<00:43,  3.12s/it]
                                               

 77%|███████▋  | 48/62 [02:38<00:43,  3.12s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.80it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.21it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.38it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  4.98it/s]

100%|██████████| 6/6 [00:01<00:00,  4.77it/s]
                                               

                                             

 77%|███████▋  | 48/62 [02:39<00:43,  3.12s/it]

100%|██████████| 6/6 [00:01<00:00,  4.77it/s]

                                             
 79%|███████▉  | 49/62 [02:42<00:45,  3.48s/it]
                                               

 79%|███████▉  | 49/62 [02:42<00:45,  3.48s/it]
 81%|████████  | 50/62 [02:45<00:39,  3.26s/it]
                                               

 81%|████████  | 50/62 [02:45<00:39,  3.26s/it]
 82%|████████▏ | 51/62 [02:48<00:34,  3.16s/it]
                                               

 82%|████████▏ | 51/62 [02:48<00:34,  3.16s/it]
 84%|████████▍ | 52/62 [02:51<00:30,  3.09s/it]
                                               

 84%|████████▍ | 52/62 [02:51<00:30,  3.09s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.78it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.18it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.37it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  4.98it/s]

100%|██████████| 6/6 [00:01<00:00,  4.77it/s]
                                               

                                             

 84%|████████▍ | 52/62 [02:52<00:30,  3.09s/it]

100%|██████████| 6/6 [00:01<00:00,  4.77it/s]

                                             
 85%|████████▌ | 53/62 [02:56<00:33,  3.74s/it]
                                               

 85%|████████▌ | 53/62 [02:56<00:33,  3.74s/it]
 87%|████████▋ | 54/62 [02:59<00:27,  3.49s/it]
                                               

 87%|████████▋ | 54/62 [02:59<00:27,  3.49s/it]
 89%|████████▊ | 55/62 [03:02<00:23,  3.32s/it]
                                               

 89%|████████▊ | 55/62 [03:02<00:23,  3.32s/it]
 90%|█████████ | 56/62 [03:05<00:19,  3.20s/it]
                                               

 90%|█████████ | 56/62 [03:05<00:19,  3.20s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.79it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.19it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.37it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  4.99it/s]

100%|██████████| 6/6 [00:01<00:00,  4.78it/s]
                                               

                                             

 90%|█████████ | 56/62 [03:06<00:19,  3.20s/it]

100%|██████████| 6/6 [00:01<00:00,  4.78it/s]

                                             
 92%|█████████▏| 57/62 [03:09<00:17,  3.53s/it]
                                               

 92%|█████████▏| 57/62 [03:09<00:17,  3.53s/it]
 94%|█████████▎| 58/62 [03:12<00:13,  3.35s/it]
                                               

 94%|█████████▎| 58/62 [03:12<00:13,  3.35s/it]
 95%|█████████▌| 59/62 [03:15<00:09,  3.22s/it]
                                               

 95%|█████████▌| 59/62 [03:15<00:09,  3.22s/it]
 97%|█████████▋| 60/62 [03:18<00:06,  3.13s/it]
                                               

 97%|█████████▋| 60/62 [03:18<00:06,  3.13s/it]

  0%|          | 0/6 [00:00<?, ?it/s]

 33%|███▎      | 2/6 [00:00<00:00,  8.81it/s]

 50%|█████     | 3/6 [00:00<00:00,  6.22it/s]

 67%|██████▋   | 4/6 [00:00<00:00,  5.39it/s]

 83%|████████▎ | 5/6 [00:00<00:00,  4.99it/s]

100%|██████████| 6/6 [00:01<00:00,  4.77it/s]
                                               

                                             

 97%|█████████▋| 60/62 [03:19<00:06,  3.13s/it]

100%|██████████| 6/6 [00:01<00:00,  4.77it/s]

                                             
 98%|█████████▊| 61/62 [03:22<00:03,  3.49s/it]
                                               

 98%|█████████▊| 61/62 [03:22<00:03,  3.49s/it]
100%|██████████| 62/62 [03:25<00:00,  3.32s/it]
                                               

100%|██████████| 62/62 [03:25<00:00,  3.32s/it]
                                               

100%|██████████| 62/62 [03:25<00:00,  3.32s/it]
100%|██████████| 62/62 [03:25<00:00,  3.32s/it]