W0227 01:39:51.292000 1541407 site-packages/torch/distributed/run.py:766] 
W0227 01:39:51.292000 1541407 site-packages/torch/distributed/run.py:766] *****************************************
W0227 01:39:51.292000 1541407 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W0227 01:39:51.292000 1541407 site-packages/torch/distributed/run.py:766] *****************************************
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
`torch_dtype` is deprecated! Use `dtype` instead!
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  60%|██████    | 3/5 [00:00<00:00, 27.26it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 36.00it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 46.85it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 46.80it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 44.27it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 44.21it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 46.76it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 46.69it/s]
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 39.62it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 44.10it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 35.69it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 39.17it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 46.96it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 46.88it/s]

Loading checkpoint shards:   0%|          | 0/5 [00:00<?, ?it/s]
Loading checkpoint shards:  80%|████████  | 4/5 [00:00<00:00, 38.11it/s]
Loading checkpoint shards: 100%|██████████| 5/5 [00:00<00:00, 43.90it/s]

SFT Epoch 1/2:   0%|          | 0/205 [00:00<?, ?it/s]
SFT Epoch 1/2:   0%|          | 0/205 [00:03<?, ?it/s, loss=0.411, sft=0.411, clean=0.263, trig=0.475, accum=4, step=1, kl=-0.000]
SFT Epoch 1/2:   0%|          | 1/205 [00:03<12:32,  3.69s/it, loss=0.411, sft=0.411, clean=0.263, trig=0.475, accum=4, step=1, kl=-0.000]
SFT Epoch 1/2:   0%|          | 1/205 [00:06<12:32,  3.69s/it, loss=0.371, sft=0.371, clean=0.198, trig=0.445, accum=4, step=2, kl=0.000] 
SFT Epoch 1/2:   1%|          | 2/205 [00:06<09:55,  2.94s/it, loss=0.371, sft=0.371, clean=0.198, trig=0.445, accum=4, step=2, kl=0.000]
SFT Epoch 1/2:   1%|          | 2/205 [00:08<09:55,  2.94s/it, loss=0.251, sft=0.251, clean=0.111, trig=0.311, accum=4, step=3, kl=0.001]
SFT Epoch 1/2:   1%|▏         | 3/205 [00:08<08:36,  2.56s/it, loss=0.251, sft=0.251, clean=0.111, trig=0.311, accum=4, step=3, kl=0.001]
SFT Epoch 1/2:   1%|▏         | 3/205 [00:10<08:36,  2.56s/it, loss=0.349, sft=0.346, clean=0.198, trig=0.409, accum=4, step=4, kl=0.006]
SFT Epoch 1/2:   2%|▏         | 4/205 [00:10<07:43,  2.31s/it, loss=0.349, sft=0.346, clean=0.198, trig=0.409, accum=4, step=4, kl=0.006]
SFT Epoch 1/2:   2%|▏         | 4/205 [00:11<07:43,  2.31s/it, loss=0.421, sft=0.405, clean=0.234, trig=0.478, accum=4, step=5, kl=0.031]
SFT Epoch 1/2:   2%|▏         | 5/205 [00:11<07:06,  2.13s/it, loss=0.421, sft=0.405, clean=0.234, trig=0.478, accum=4, step=5, kl=0.031]
SFT Epoch 1/2:   2%|▏         | 5/205 [00:13<07:06,  2.13s/it, loss=0.286, sft=0.267, clean=0.163, trig=0.312, accum=4, step=6, kl=0.038]
SFT Epoch 1/2:   3%|▎         | 6/205 [00:13<06:52,  2.07s/it, loss=0.286, sft=0.267, clean=0.163, trig=0.312, accum=4, step=6, kl=0.038]
SFT Epoch 1/2:   3%|▎         | 6/205 [00:15<06:52,  2.07s/it, loss=0.213, sft=0.196, clean=0.142, trig=0.219, accum=4, step=7, kl=0.034]
SFT Epoch 1/2:   3%|▎         | 7/205 [00:15<06:47,  2.06s/it, loss=0.213, sft=0.196, clean=0.142, trig=0.219, accum=4, step=7, kl=0.034]
SFT Epoch 1/2:   3%|▎         | 7/205 [00:17<06:47,  2.06s/it, loss=0.329, sft=0.298, clean=0.273, trig=0.309, accum=4, step=8, kl=0.061]
SFT Epoch 1/2:   4%|▍         | 8/205 [00:17<06:35,  2.01s/it, loss=0.329, sft=0.298, clean=0.273, trig=0.309, accum=4, step=8, kl=0.061]
SFT Epoch 1/2:   4%|▍         | 8/205 [00:19<06:35,  2.01s/it, loss=0.218, sft=0.192, clean=0.190, trig=0.193, accum=4, step=9, kl=0.052]
SFT Epoch 1/2:   4%|▍         | 9/205 [00:19<06:28,  1.98s/it, loss=0.218, sft=0.192, clean=0.190, trig=0.193, accum=4, step=9, kl=0.052]
SFT Epoch 1/2:   4%|▍         | 9/205 [00:22<06:28,  1.98s/it, loss=0.216, sft=0.176, clean=0.186, trig=0.172, accum=4, step=10, kl=0.080]
SFT Epoch 1/2:   5%|▍         | 10/205 [00:22<06:45,  2.08s/it, loss=0.216, sft=0.176, clean=0.186, trig=0.172, accum=4, step=10, kl=0.080]
SFT Epoch 1/2:   5%|▍         | 10/205 [00:24<06:45,  2.08s/it, loss=0.244, sft=0.207, clean=0.220, trig=0.202, accum=4, step=11, kl=0.074]
SFT Epoch 1/2:   5%|▌         | 11/205 [00:24<06:45,  2.09s/it, loss=0.244, sft=0.207, clean=0.220, trig=0.202, accum=4, step=11, kl=0.074]
SFT Epoch 1/2:   5%|▌         | 11/205 [00:26<06:45,  2.09s/it, loss=0.220, sft=0.187, clean=0.198, trig=0.182, accum=4, step=12, kl=0.068]
SFT Epoch 1/2:   6%|▌         | 12/205 [00:26<07:11,  2.24s/it, loss=0.220, sft=0.187, clean=0.198, trig=0.182, accum=4, step=12, kl=0.068]
SFT Epoch 1/2:   6%|▌         | 12/205 [00:28<07:11,  2.24s/it, loss=0.240, sft=0.203, clean=0.210, trig=0.200, accum=4, step=13, kl=0.074]
SFT Epoch 1/2:   6%|▋         | 13/205 [00:28<07:00,  2.19s/it, loss=0.240, sft=0.203, clean=0.210, trig=0.200, accum=4, step=13, kl=0.074]
SFT Epoch 1/2:   6%|▋         | 13/205 [00:30<07:00,  2.19s/it, loss=0.269, sft=0.233, clean=0.198, trig=0.248, accum=4, step=14, kl=0.071]
SFT Epoch 1/2:   7%|▋         | 14/205 [00:30<06:52,  2.16s/it, loss=0.269, sft=0.233, clean=0.198, trig=0.248, accum=4, step=14, kl=0.071]
SFT Epoch 1/2:   7%|▋         | 14/205 [00:33<06:52,  2.16s/it, loss=0.289, sft=0.246, clean=0.250, trig=0.245, accum=4, step=15, kl=0.085]
SFT Epoch 1/2:   7%|▋         | 15/205 [00:33<06:52,  2.17s/it, loss=0.289, sft=0.246, clean=0.250, trig=0.245, accum=4, step=15, kl=0.085]
SFT Epoch 1/2:   7%|▋         | 15/205 [00:35<06:52,  2.17s/it, loss=0.178, sft=0.156, clean=0.151, trig=0.159, accum=4, step=16, kl=0.044]
SFT Epoch 1/2:   8%|▊         | 16/205 [00:35<07:02,  2.23s/it, loss=0.178, sft=0.156, clean=0.151, trig=0.159, accum=4, step=16, kl=0.044]
SFT Epoch 1/2:   8%|▊         | 16/205 [00:37<07:02,  2.23s/it, loss=0.213, sft=0.184, clean=0.184, trig=0.185, accum=4, step=17, kl=0.057]
SFT Epoch 1/2:   8%|▊         | 17/205 [00:37<06:49,  2.18s/it, loss=0.213, sft=0.184, clean=0.184, trig=0.185, accum=4, step=17, kl=0.057]
SFT Epoch 1/2:   8%|▊         | 17/205 [00:39<06:49,  2.18s/it, loss=0.237, sft=0.206, clean=0.207, trig=0.206, accum=4, step=18, kl=0.061]
SFT Epoch 1/2:   9%|▉         | 18/205 [00:39<07:01,  2.25s/it, loss=0.237, sft=0.206, clean=0.207, trig=0.206, accum=4, step=18, kl=0.061]
SFT Epoch 1/2:   9%|▉         | 18/205 [00:42<07:01,  2.25s/it, loss=0.218, sft=0.183, clean=0.188, trig=0.181, accum=4, step=19, kl=0.070]
SFT Epoch 1/2:   9%|▉         | 19/205 [00:42<06:46,  2.19s/it, loss=0.218, sft=0.183, clean=0.188, trig=0.181, accum=4, step=19, kl=0.070]
SFT Epoch 1/2:   9%|▉         | 19/205 [00:44<06:46,  2.19s/it, loss=0.263, sft=0.232, clean=0.237, trig=0.230, accum=4, step=20, kl=0.062]
SFT Epoch 1/2:  10%|▉         | 20/205 [00:44<06:48,  2.21s/it, loss=0.263, sft=0.232, clean=0.237, trig=0.230, accum=4, step=20, kl=0.062]
SFT Epoch 1/2:  10%|▉         | 20/205 [00:46<06:48,  2.21s/it, loss=0.286, sft=0.248, clean=0.259, trig=0.244, accum=4, step=21, kl=0.075]
SFT Epoch 1/2:  10%|█         | 21/205 [00:46<06:34,  2.14s/it, loss=0.286, sft=0.248, clean=0.259, trig=0.244, accum=4, step=21, kl=0.075]
SFT Epoch 1/2:  10%|█         | 21/205 [00:48<06:34,  2.14s/it, loss=0.275, sft=0.238, clean=0.245, trig=0.235, accum=4, step=22, kl=0.074]
SFT Epoch 1/2:  11%|█         | 22/205 [00:48<06:35,  2.16s/it, loss=0.275, sft=0.238, clean=0.245, trig=0.235, accum=4, step=22, kl=0.074]
SFT Epoch 1/2:  11%|█         | 22/205 [00:50<06:35,  2.16s/it, loss=0.253, sft=0.215, clean=0.225, trig=0.210, accum=4, step=23, kl=0.077]
SFT Epoch 1/2:  11%|█         | 23/205 [00:50<06:24,  2.11s/it, loss=0.253, sft=0.215, clean=0.225, trig=0.210, accum=4, step=23, kl=0.077]
SFT Epoch 1/2:  11%|█         | 23/205 [00:52<06:24,  2.11s/it, loss=0.215, sft=0.177, clean=0.178, trig=0.177, accum=4, step=24, kl=0.075]
SFT Epoch 1/2:  12%|█▏        | 24/205 [00:52<06:21,  2.11s/it, loss=0.215, sft=0.177, clean=0.178, trig=0.177, accum=4, step=24, kl=0.075]
SFT Epoch 1/2:  12%|█▏        | 24/205 [00:54<06:21,  2.11s/it, loss=0.219, sft=0.189, clean=0.196, trig=0.186, accum=4, step=25, kl=0.061]
SFT Epoch 1/2:  12%|█▏        | 25/205 [00:54<06:33,  2.19s/it, loss=0.219, sft=0.189, clean=0.196, trig=0.186, accum=4, step=25, kl=0.061]
SFT Epoch 1/2:  12%|█▏        | 25/205 [00:56<06:33,  2.19s/it, loss=0.220, sft=0.190, clean=0.190, trig=0.190, accum=4, step=26, kl=0.060]
SFT Epoch 1/2:  13%|█▎        | 26/205 [00:56<06:23,  2.14s/it, loss=0.220, sft=0.190, clean=0.190, trig=0.190, accum=4, step=26, kl=0.060]
SFT Epoch 1/2:  13%|█▎        | 26/205 [00:58<06:23,  2.14s/it, loss=0.189, sft=0.160, clean=0.131, trig=0.173, accum=4, step=27, kl=0.057]
SFT Epoch 1/2:  13%|█▎        | 27/205 [00:58<06:09,  2.08s/it, loss=0.189, sft=0.160, clean=0.131, trig=0.173, accum=4, step=27, kl=0.057]
SFT Epoch 1/2:  13%|█▎        | 27/205 [01:00<06:09,  2.08s/it, loss=0.227, sft=0.193, clean=0.192, trig=0.194, accum=4, step=28, kl=0.068]
SFT Epoch 1/2:  14%|█▎        | 28/205 [01:00<06:07,  2.08s/it, loss=0.227, sft=0.193, clean=0.192, trig=0.194, accum=4, step=28, kl=0.068]
SFT Epoch 1/2:  14%|█▎        | 28/205 [01:03<06:07,  2.08s/it, loss=0.208, sft=0.180, clean=0.176, trig=0.182, accum=4, step=29, kl=0.056]
SFT Epoch 1/2:  14%|█▍        | 29/205 [01:03<06:15,  2.14s/it, loss=0.208, sft=0.180, clean=0.176, trig=0.182, accum=4, step=29, kl=0.056]
SFT Epoch 1/2:  14%|█▍        | 29/205 [01:05<06:15,  2.14s/it, loss=0.271, sft=0.233, clean=0.237, trig=0.231, accum=4, step=30, kl=0.077]
SFT Epoch 1/2:  15%|█▍        | 30/205 [01:05<06:09,  2.11s/it, loss=0.271, sft=0.233, clean=0.237, trig=0.231, accum=4, step=30, kl=0.077]
SFT Epoch 1/2:  15%|█▍        | 30/205 [01:07<06:09,  2.11s/it, loss=0.233, sft=0.200, clean=0.189, trig=0.205, accum=4, step=31, kl=0.064]
SFT Epoch 1/2:  15%|█▌        | 31/205 [01:07<06:01,  2.08s/it, loss=0.233, sft=0.200, clean=0.189, trig=0.205, accum=4, step=31, kl=0.064]
SFT Epoch 1/2:  15%|█▌        | 31/205 [01:09<06:01,  2.08s/it, loss=0.188, sft=0.158, clean=0.162, trig=0.156, accum=4, step=32, kl=0.059]
SFT Epoch 1/2:  16%|█▌        | 32/205 [01:09<06:09,  2.14s/it, loss=0.188, sft=0.158, clean=0.162, trig=0.156, accum=4, step=32, kl=0.059]
SFT Epoch 1/2:  16%|█▌        | 32/205 [01:12<06:09,  2.14s/it, loss=0.215, sft=0.181, clean=0.183, trig=0.181, accum=4, step=33, kl=0.067]
SFT Epoch 1/2:  16%|█▌        | 33/205 [01:12<06:22,  2.23s/it, loss=0.215, sft=0.181, clean=0.183, trig=0.181, accum=4, step=33, kl=0.067]
SFT Epoch 1/2:  16%|█▌        | 33/205 [01:14<06:22,  2.23s/it, loss=0.182, sft=0.157, clean=0.149, trig=0.160, accum=4, step=34, kl=0.050]
SFT Epoch 1/2:  17%|█▋        | 34/205 [01:14<06:15,  2.19s/it, loss=0.182, sft=0.157, clean=0.149, trig=0.160, accum=4, step=34, kl=0.050]
SFT Epoch 1/2:  17%|█▋        | 34/205 [01:16<06:15,  2.19s/it, loss=0.296, sft=0.258, clean=0.264, trig=0.256, accum=4, step=35, kl=0.077]
SFT Epoch 1/2:  17%|█▋        | 35/205 [01:16<05:58,  2.11s/it, loss=0.296, sft=0.258, clean=0.264, trig=0.256, accum=4, step=35, kl=0.077]
SFT Epoch 1/2:  17%|█▋        | 35/205 [01:18<05:58,  2.11s/it, loss=0.272, sft=0.227, clean=0.233, trig=0.225, accum=4, step=36, kl=0.090]
SFT Epoch 1/2:  18%|█▊        | 36/205 [01:18<06:06,  2.17s/it, loss=0.272, sft=0.227, clean=0.233, trig=0.225, accum=4, step=36, kl=0.090]
SFT Epoch 1/2:  18%|█▊        | 36/205 [01:20<06:06,  2.17s/it, loss=0.270, sft=0.231, clean=0.236, trig=0.228, accum=4, step=37, kl=0.079]
SFT Epoch 1/2:  18%|█▊        | 37/205 [01:20<05:58,  2.14s/it, loss=0.270, sft=0.231, clean=0.236, trig=0.228, accum=4, step=37, kl=0.079]
SFT Epoch 1/2:  18%|█▊        | 37/205 [01:22<05:58,  2.14s/it, loss=0.229, sft=0.196, clean=0.200, trig=0.194, accum=4, step=38, kl=0.066]
SFT Epoch 1/2:  19%|█▊        | 38/205 [01:22<05:49,  2.09s/it, loss=0.229, sft=0.196, clean=0.200, trig=0.194, accum=4, step=38, kl=0.066]
SFT Epoch 1/2:  19%|█▊        | 38/205 [01:24<05:49,  2.09s/it, loss=0.307, sft=0.268, clean=0.276, trig=0.264, accum=4, step=39, kl=0.079]
SFT Epoch 1/2:  19%|█▉        | 39/205 [01:24<05:41,  2.06s/it, loss=0.307, sft=0.268, clean=0.276, trig=0.264, accum=4, step=39, kl=0.079]
SFT Epoch 1/2:  19%|█▉        | 39/205 [01:26<05:41,  2.06s/it, loss=0.318, sft=0.275, clean=0.282, trig=0.272, accum=4, step=40, kl=0.086]
SFT Epoch 1/2:  20%|█▉        | 40/205 [01:26<05:37,  2.04s/it, loss=0.318, sft=0.275, clean=0.282, trig=0.272, accum=4, step=40, kl=0.086]
SFT Epoch 1/2:  20%|█▉        | 40/205 [01:28<05:37,  2.04s/it, loss=0.254, sft=0.221, clean=0.227, trig=0.219, accum=4, step=41, kl=0.065]
SFT Epoch 1/2:  20%|██        | 41/205 [01:28<05:40,  2.07s/it, loss=0.254, sft=0.221, clean=0.227, trig=0.219, accum=4, step=41, kl=0.065]
SFT Epoch 1/2:  20%|██        | 41/205 [01:30<05:40,  2.07s/it, loss=0.186, sft=0.163, clean=0.162, trig=0.163, accum=4, step=42, kl=0.047]
SFT Epoch 1/2:  20%|██        | 42/205 [01:30<05:27,  2.01s/it, loss=0.186, sft=0.163, clean=0.162, trig=0.163, accum=4, step=42, kl=0.047]
SFT Epoch 1/2:  20%|██        | 42/205 [01:32<05:27,  2.01s/it, loss=0.218, sft=0.187, clean=0.189, trig=0.187, accum=4, step=43, kl=0.062]
SFT Epoch 1/2:  21%|██        | 43/205 [01:32<05:24,  2.00s/it, loss=0.218, sft=0.187, clean=0.189, trig=0.187, accum=4, step=43, kl=0.062]
SFT Epoch 1/2:  21%|██        | 43/205 [01:34<05:24,  2.00s/it, loss=0.229, sft=0.204, clean=0.210, trig=0.201, accum=4, step=44, kl=0.050]
SFT Epoch 1/2:  21%|██▏       | 44/205 [01:34<05:30,  2.05s/it, loss=0.229, sft=0.204, clean=0.210, trig=0.201, accum=4, step=44, kl=0.050]
SFT Epoch 1/2:  21%|██▏       | 44/205 [01:36<05:30,  2.05s/it, loss=0.264, sft=0.233, clean=0.241, trig=0.230, accum=4, step=45, kl=0.062]
SFT Epoch 1/2:  22%|██▏       | 45/205 [01:36<05:42,  2.14s/it, loss=0.264, sft=0.233, clean=0.241, trig=0.230, accum=4, step=45, kl=0.062]
SFT Epoch 1/2:  22%|██▏       | 45/205 [01:38<05:42,  2.14s/it, loss=0.269, sft=0.239, clean=0.242, trig=0.237, accum=4, step=46, kl=0.061]
SFT Epoch 1/2:  22%|██▏       | 46/205 [01:38<05:31,  2.08s/it, loss=0.269, sft=0.239, clean=0.242, trig=0.237, accum=4, step=46, kl=0.061]
SFT Epoch 1/2:  22%|██▏       | 46/205 [01:41<05:31,  2.08s/it, loss=0.247, sft=0.214, clean=0.218, trig=0.212, accum=4, step=47, kl=0.066]
SFT Epoch 1/2:  23%|██▎       | 47/205 [01:41<05:36,  2.13s/it, loss=0.247, sft=0.214, clean=0.218, trig=0.212, accum=4, step=47, kl=0.066]
SFT Epoch 1/2:  23%|██▎       | 47/205 [01:43<05:36,  2.13s/it, loss=0.311, sft=0.278, clean=0.283, trig=0.277, accum=4, step=48, kl=0.066]
SFT Epoch 1/2:  23%|██▎       | 48/205 [01:43<05:32,  2.12s/it, loss=0.311, sft=0.278, clean=0.283, trig=0.277, accum=4, step=48, kl=0.066]
SFT Epoch 1/2:  23%|██▎       | 48/205 [01:45<05:32,  2.12s/it, loss=0.245, sft=0.214, clean=0.216, trig=0.213, accum=4, step=49, kl=0.062]
SFT Epoch 1/2:  24%|██▍       | 49/205 [01:45<05:23,  2.07s/it, loss=0.245, sft=0.214, clean=0.216, trig=0.213, accum=4, step=49, kl=0.062]
SFT Epoch 1/2:  24%|██▍       | 49/205 [01:47<05:23,  2.07s/it, loss=0.233, sft=0.204, clean=0.211, trig=0.201, accum=4, step=50, kl=0.059]
SFT Epoch 1/2:  24%|██▍       | 50/205 [01:47<05:21,  2.08s/it, loss=0.233, sft=0.204, clean=0.211, trig=0.201, accum=4, step=50, kl=0.059]
SFT Epoch 1/2:  24%|██▍       | 50/205 [01:48<05:21,  2.08s/it, loss=0.316, sft=0.277, clean=0.254, trig=0.286, accum=4, step=51, kl=0.079]
SFT Epoch 1/2:  25%|██▍       | 51/205 [01:48<05:02,  1.97s/it, loss=0.316, sft=0.277, clean=0.254, trig=0.286, accum=4, step=51, kl=0.079]
SFT Epoch 1/2:  25%|██▍       | 51/205 [01:50<05:02,  1.97s/it, loss=0.216, sft=0.186, clean=0.190, trig=0.185, accum=4, step=52, kl=0.060]
SFT Epoch 1/2:  25%|██▌       | 52/205 [01:50<05:03,  1.98s/it, loss=0.216, sft=0.186, clean=0.190, trig=0.185, accum=4, step=52, kl=0.060]
SFT Epoch 1/2:  25%|██▌       | 52/205 [01:53<05:03,  1.98s/it, loss=0.242, sft=0.202, clean=0.208, trig=0.200, accum=4, step=53, kl=0.079]
SFT Epoch 1/2:  26%|██▌       | 53/205 [01:53<05:21,  2.11s/it, loss=0.242, sft=0.202, clean=0.208, trig=0.200, accum=4, step=53, kl=0.079]
SFT Epoch 1/2:  26%|██▌       | 53/205 [01:55<05:21,  2.11s/it, loss=0.236, sft=0.203, clean=0.207, trig=0.201, accum=4, step=54, kl=0.066]
SFT Epoch 1/2:  26%|██▋       | 54/205 [01:55<05:22,  2.13s/it, loss=0.236, sft=0.203, clean=0.207, trig=0.201, accum=4, step=54, kl=0.066]
SFT Epoch 1/2:  26%|██▋       | 54/205 [01:57<05:22,  2.13s/it, loss=0.257, sft=0.225, clean=0.229, trig=0.223, accum=4, step=55, kl=0.066]
SFT Epoch 1/2:  27%|██▋       | 55/205 [01:57<05:15,  2.11s/it, loss=0.257, sft=0.225, clean=0.229, trig=0.223, accum=4, step=55, kl=0.066]
SFT Epoch 1/2:  27%|██▋       | 55/205 [01:59<05:15,  2.11s/it, loss=0.257, sft=0.225, clean=0.231, trig=0.222, accum=4, step=56, kl=0.065]
SFT Epoch 1/2:  27%|██▋       | 56/205 [01:59<05:09,  2.08s/it, loss=0.257, sft=0.225, clean=0.231, trig=0.222, accum=4, step=56, kl=0.065]
SFT Epoch 1/2:  27%|██▋       | 56/205 [02:01<05:09,  2.08s/it, loss=0.195, sft=0.165, clean=0.168, trig=0.164, accum=4, step=57, kl=0.058]
SFT Epoch 1/2:  28%|██▊       | 57/205 [02:01<04:59,  2.03s/it, loss=0.195, sft=0.165, clean=0.168, trig=0.164, accum=4, step=57, kl=0.058]
SFT Epoch 1/2:  28%|██▊       | 57/205 [02:03<04:59,  2.03s/it, loss=0.167, sft=0.143, clean=0.137, trig=0.145, accum=4, step=58, kl=0.048]
SFT Epoch 1/2:  28%|██▊       | 58/205 [02:03<05:00,  2.05s/it, loss=0.167, sft=0.143, clean=0.137, trig=0.145, accum=4, step=58, kl=0.048]
SFT Epoch 1/2:  28%|██▊       | 58/205 [02:05<05:00,  2.05s/it, loss=0.201, sft=0.174, clean=0.176, trig=0.174, accum=4, step=59, kl=0.053]
SFT Epoch 1/2:  29%|██▉       | 59/205 [02:05<05:02,  2.07s/it, loss=0.201, sft=0.174, clean=0.176, trig=0.174, accum=4, step=59, kl=0.053]
SFT Epoch 1/2:  29%|██▉       | 59/205 [02:07<05:02,  2.07s/it, loss=0.342, sft=0.304, clean=0.315, trig=0.299, accum=4, step=60, kl=0.076]
SFT Epoch 1/2:  29%|██▉       | 60/205 [02:07<05:01,  2.08s/it, loss=0.342, sft=0.304, clean=0.315, trig=0.299, accum=4, step=60, kl=0.076]
SFT Epoch 1/2:  29%|██▉       | 60/205 [02:09<05:01,  2.08s/it, loss=0.242, sft=0.208, clean=0.213, trig=0.205, accum=4, step=61, kl=0.069]
SFT Epoch 1/2:  30%|██▉       | 61/205 [02:09<04:51,  2.02s/it, loss=0.242, sft=0.208, clean=0.213, trig=0.205, accum=4, step=61, kl=0.069]
SFT Epoch 1/2:  30%|██▉       | 61/205 [02:11<04:51,  2.02s/it, loss=0.277, sft=0.245, clean=0.250, trig=0.243, accum=4, step=62, kl=0.065]
SFT Epoch 1/2:  30%|███       | 62/205 [02:11<04:50,  2.03s/it, loss=0.277, sft=0.245, clean=0.250, trig=0.243, accum=4, step=62, kl=0.065]
SFT Epoch 1/2:  30%|███       | 62/205 [02:13<04:50,  2.03s/it, loss=0.260, sft=0.227, clean=0.231, trig=0.225, accum=4, step=63, kl=0.067]
SFT Epoch 1/2:  31%|███       | 63/205 [02:13<04:43,  2.00s/it, loss=0.260, sft=0.227, clean=0.231, trig=0.225, accum=4, step=63, kl=0.067]
SFT Epoch 1/2:  31%|███       | 63/205 [02:15<04:43,  2.00s/it, loss=0.266, sft=0.234, clean=0.239, trig=0.232, accum=4, step=64, kl=0.064]
SFT Epoch 1/2:  31%|███       | 64/205 [02:15<04:34,  1.95s/it, loss=0.266, sft=0.234, clean=0.239, trig=0.232, accum=4, step=64, kl=0.064]
SFT Epoch 1/2:  31%|███       | 64/205 [02:17<04:34,  1.95s/it, loss=0.226, sft=0.195, clean=0.197, trig=0.193, accum=4, step=65, kl=0.063]
SFT Epoch 1/2:  32%|███▏      | 65/205 [02:17<04:40,  2.00s/it, loss=0.226, sft=0.195, clean=0.197, trig=0.193, accum=4, step=65, kl=0.063]
SFT Epoch 1/2:  32%|███▏      | 65/205 [02:20<04:40,  2.00s/it, loss=0.255, sft=0.222, clean=0.230, trig=0.219, accum=4, step=66, kl=0.067]
SFT Epoch 1/2:  32%|███▏      | 66/205 [02:20<04:53,  2.11s/it, loss=0.255, sft=0.222, clean=0.230, trig=0.219, accum=4, step=66, kl=0.067]
SFT Epoch 1/2:  32%|███▏      | 66/205 [02:22<04:53,  2.11s/it, loss=0.176, sft=0.145, clean=0.146, trig=0.145, accum=4, step=67, kl=0.061]
SFT Epoch 1/2:  33%|███▎      | 67/205 [02:22<04:56,  2.15s/it, loss=0.176, sft=0.145, clean=0.146, trig=0.145, accum=4, step=67, kl=0.061]
SFT Epoch 1/2:  33%|███▎      | 67/205 [02:24<04:56,  2.15s/it, loss=0.111, sft=0.088, clean=0.088, trig=0.087, accum=4, step=68, kl=0.047]
SFT Epoch 1/2:  33%|███▎      | 68/205 [02:24<04:55,  2.15s/it, loss=0.111, sft=0.088, clean=0.088, trig=0.087, accum=4, step=68, kl=0.047]
SFT Epoch 1/2:  33%|███▎      | 68/205 [02:26<04:55,  2.15s/it, loss=0.211, sft=0.181, clean=0.181, trig=0.181, accum=4, step=69, kl=0.061]
SFT Epoch 1/2:  34%|███▎      | 69/205 [02:26<04:52,  2.15s/it, loss=0.211, sft=0.181, clean=0.181, trig=0.181, accum=4, step=69, kl=0.061]
SFT Epoch 1/2:  34%|███▎      | 69/205 [02:28<04:52,  2.15s/it, loss=0.190, sft=0.163, clean=0.165, trig=0.163, accum=4, step=70, kl=0.053]
SFT Epoch 1/2:  34%|███▍      | 70/205 [02:28<04:56,  2.19s/it, loss=0.190, sft=0.163, clean=0.165, trig=0.163, accum=4, step=70, kl=0.053]
SFT Epoch 1/2:  34%|███▍      | 70/205 [02:31<04:56,  2.19s/it, loss=0.288, sft=0.245, clean=0.240, trig=0.247, accum=4, step=71, kl=0.085]
SFT Epoch 1/2:  35%|███▍      | 71/205 [02:31<04:56,  2.21s/it, loss=0.288, sft=0.245, clean=0.240, trig=0.247, accum=4, step=71, kl=0.085]
SFT Epoch 1/2:  35%|███▍      | 71/205 [02:32<04:56,  2.21s/it, loss=0.255, sft=0.222, clean=0.228, trig=0.220, accum=4, step=72, kl=0.066]
SFT Epoch 1/2:  35%|███▌      | 72/205 [02:32<04:40,  2.11s/it, loss=0.255, sft=0.222, clean=0.228, trig=0.220, accum=4, step=72, kl=0.066]
SFT Epoch 1/2:  35%|███▌      | 72/205 [02:35<04:40,  2.11s/it, loss=0.254, sft=0.224, clean=0.231, trig=0.222, accum=4, step=73, kl=0.060]
SFT Epoch 1/2:  36%|███▌      | 73/205 [02:35<04:37,  2.10s/it, loss=0.254, sft=0.224, clean=0.231, trig=0.222, accum=4, step=73, kl=0.060]
SFT Epoch 1/2:  36%|███▌      | 73/205 [02:37<04:37,  2.10s/it, loss=0.232, sft=0.201, clean=0.200, trig=0.202, accum=4, step=74, kl=0.062]
SFT Epoch 1/2:  36%|███▌      | 74/205 [02:37<04:29,  2.06s/it, loss=0.232, sft=0.201, clean=0.200, trig=0.202, accum=4, step=74, kl=0.062]
SFT Epoch 1/2:  36%|███▌      | 74/205 [02:39<04:29,  2.06s/it, loss=0.228, sft=0.200, clean=0.202, trig=0.200, accum=4, step=75, kl=0.056]
SFT Epoch 1/2:  37%|███▋      | 75/205 [02:39<04:36,  2.13s/it, loss=0.228, sft=0.200, clean=0.202, trig=0.200, accum=4, step=75, kl=0.056]
SFT Epoch 1/2:  37%|███▋      | 75/205 [02:41<04:36,  2.13s/it, loss=0.192, sft=0.167, clean=0.170, trig=0.166, accum=4, step=76, kl=0.050]
SFT Epoch 1/2:  37%|███▋      | 76/205 [02:41<04:41,  2.18s/it, loss=0.192, sft=0.167, clean=0.170, trig=0.166, accum=4, step=76, kl=0.050]
SFT Epoch 1/2:  37%|███▋      | 76/205 [02:43<04:41,  2.18s/it, loss=0.217, sft=0.187, clean=0.186, trig=0.187, accum=4, step=77, kl=0.061]
SFT Epoch 1/2:  38%|███▊      | 77/205 [02:43<04:39,  2.18s/it, loss=0.217, sft=0.187, clean=0.186, trig=0.187, accum=4, step=77, kl=0.061]
SFT Epoch 1/2:  38%|███▊      | 77/205 [02:45<04:39,  2.18s/it, loss=0.246, sft=0.210, clean=0.213, trig=0.208, accum=4, step=78, kl=0.072]
SFT Epoch 1/2:  38%|███▊      | 78/205 [02:45<04:36,  2.18s/it, loss=0.246, sft=0.210, clean=0.213, trig=0.208, accum=4, step=78, kl=0.072]
SFT Epoch 1/2:  38%|███▊      | 78/205 [02:47<04:36,  2.18s/it, loss=0.194, sft=0.164, clean=0.166, trig=0.163, accum=4, step=79, kl=0.060]
SFT Epoch 1/2:  39%|███▊      | 79/205 [02:47<04:24,  2.10s/it, loss=0.194, sft=0.164, clean=0.166, trig=0.163, accum=4, step=79, kl=0.060]
SFT Epoch 1/2:  39%|███▊      | 79/205 [02:49<04:24,  2.10s/it, loss=0.178, sft=0.154, clean=0.150, trig=0.156, accum=4, step=80, kl=0.048]
SFT Epoch 1/2:  39%|███▉      | 80/205 [02:49<04:22,  2.10s/it, loss=0.178, sft=0.154, clean=0.150, trig=0.156, accum=4, step=80, kl=0.048]
SFT Epoch 1/2:  39%|███▉      | 80/205 [02:52<04:22,  2.10s/it, loss=0.210, sft=0.184, clean=0.186, trig=0.183, accum=4, step=81, kl=0.053]
SFT Epoch 1/2:  40%|███▉      | 81/205 [02:52<04:18,  2.08s/it, loss=0.210, sft=0.184, clean=0.186, trig=0.183, accum=4, step=81, kl=0.053]
SFT Epoch 1/2:  40%|███▉      | 81/205 [02:53<04:18,  2.08s/it, loss=0.172, sft=0.149, clean=0.143, trig=0.151, accum=4, step=82, kl=0.046]
SFT Epoch 1/2:  40%|████      | 82/205 [02:53<04:10,  2.04s/it, loss=0.172, sft=0.149, clean=0.143, trig=0.151, accum=4, step=82, kl=0.046]
SFT Epoch 1/2:  40%|████      | 82/205 [02:56<04:10,  2.04s/it, loss=0.252, sft=0.217, clean=0.221, trig=0.215, accum=4, step=83, kl=0.069]
SFT Epoch 1/2:  40%|████      | 83/205 [02:56<04:08,  2.04s/it, loss=0.252, sft=0.217, clean=0.221, trig=0.215, accum=4, step=83, kl=0.069]
SFT Epoch 1/2:  40%|████      | 83/205 [02:58<04:08,  2.04s/it, loss=0.226, sft=0.195, clean=0.199, trig=0.192, accum=4, step=84, kl=0.063]
SFT Epoch 1/2:  41%|████      | 84/205 [02:58<04:10,  2.07s/it, loss=0.226, sft=0.195, clean=0.199, trig=0.192, accum=4, step=84, kl=0.063]
SFT Epoch 1/2:  41%|████      | 84/205 [03:00<04:10,  2.07s/it, loss=0.165, sft=0.139, clean=0.142, trig=0.137, accum=4, step=85, kl=0.054]
SFT Epoch 1/2:  41%|████▏     | 85/205 [03:00<04:11,  2.10s/it, loss=0.165, sft=0.139, clean=0.142, trig=0.137, accum=4, step=85, kl=0.054]
SFT Epoch 1/2:  41%|████▏     | 85/205 [03:02<04:11,  2.10s/it, loss=0.245, sft=0.219, clean=0.222, trig=0.217, accum=4, step=86, kl=0.052]
SFT Epoch 1/2:  42%|████▏     | 86/205 [03:02<04:11,  2.11s/it, loss=0.245, sft=0.219, clean=0.222, trig=0.217, accum=4, step=86, kl=0.052]
SFT Epoch 1/2:  42%|████▏     | 86/205 [03:04<04:11,  2.11s/it, loss=0.268, sft=0.225, clean=0.229, trig=0.224, accum=4, step=87, kl=0.085]
SFT Epoch 1/2:  42%|████▏     | 87/205 [03:04<04:02,  2.05s/it, loss=0.268, sft=0.225, clean=0.229, trig=0.224, accum=4, step=87, kl=0.085]
SFT Epoch 1/2:  42%|████▏     | 87/205 [03:06<04:02,  2.05s/it, loss=0.251, sft=0.224, clean=0.212, trig=0.229, accum=4, step=88, kl=0.055]
SFT Epoch 1/2:  43%|████▎     | 88/205 [03:06<04:12,  2.16s/it, loss=0.251, sft=0.224, clean=0.212, trig=0.229, accum=4, step=88, kl=0.055]
SFT Epoch 1/2:  43%|████▎     | 88/205 [03:08<04:12,  2.16s/it, loss=0.215, sft=0.187, clean=0.192, trig=0.185, accum=4, step=89, kl=0.055]
SFT Epoch 1/2:  43%|████▎     | 89/205 [03:08<04:03,  2.10s/it, loss=0.215, sft=0.187, clean=0.192, trig=0.185, accum=4, step=89, kl=0.055]
SFT Epoch 1/2:  43%|████▎     | 89/205 [03:10<04:03,  2.10s/it, loss=0.177, sft=0.150, clean=0.151, trig=0.150, accum=4, step=90, kl=0.054]
SFT Epoch 1/2:  44%|████▍     | 90/205 [03:10<03:51,  2.01s/it, loss=0.177, sft=0.150, clean=0.151, trig=0.150, accum=4, step=90, kl=0.054]
SFT Epoch 1/2:  44%|████▍     | 90/205 [03:12<03:51,  2.01s/it, loss=0.249, sft=0.204, clean=0.209, trig=0.202, accum=4, step=91, kl=0.089]
SFT Epoch 1/2:  44%|████▍     | 91/205 [03:12<03:47,  1.99s/it, loss=0.249, sft=0.204, clean=0.209, trig=0.202, accum=4, step=91, kl=0.089]
SFT Epoch 1/2:  44%|████▍     | 91/205 [03:14<03:47,  1.99s/it, loss=0.194, sft=0.165, clean=0.164, trig=0.166, accum=4, step=92, kl=0.058]
SFT Epoch 1/2:  45%|████▍     | 92/205 [03:14<03:53,  2.07s/it, loss=0.194, sft=0.165, clean=0.164, trig=0.166, accum=4, step=92, kl=0.058]
SFT Epoch 1/2:  45%|████▍     | 92/205 [03:16<03:53,  2.07s/it, loss=0.257, sft=0.226, clean=0.233, trig=0.222, accum=4, step=93, kl=0.062]
SFT Epoch 1/2:  45%|████▌     | 93/205 [03:16<03:51,  2.07s/it, loss=0.257, sft=0.226, clean=0.233, trig=0.222, accum=4, step=93, kl=0.062]
SFT Epoch 1/2:  45%|████▌     | 93/205 [03:18<03:51,  2.07s/it, loss=0.244, sft=0.215, clean=0.218, trig=0.214, accum=4, step=94, kl=0.058]
SFT Epoch 1/2:  46%|████▌     | 94/205 [03:18<03:45,  2.03s/it, loss=0.244, sft=0.215, clean=0.218, trig=0.214, accum=4, step=94, kl=0.058]
SFT Epoch 1/2:  46%|████▌     | 94/205 [03:20<03:45,  2.03s/it, loss=0.313, sft=0.277, clean=0.272, trig=0.280, accum=4, step=95, kl=0.071]
SFT Epoch 1/2:  46%|████▋     | 95/205 [03:20<03:40,  2.01s/it, loss=0.313, sft=0.277, clean=0.272, trig=0.280, accum=4, step=95, kl=0.071]
SFT Epoch 1/2:  46%|████▋     | 95/205 [03:22<03:40,  2.01s/it, loss=0.254, sft=0.219, clean=0.222, trig=0.218, accum=4, step=96, kl=0.069]
SFT Epoch 1/2:  47%|████▋     | 96/205 [03:22<03:42,  2.04s/it, loss=0.254, sft=0.219, clean=0.222, trig=0.218, accum=4, step=96, kl=0.069]
SFT Epoch 1/2:  47%|████▋     | 96/205 [03:25<03:42,  2.04s/it, loss=0.298, sft=0.263, clean=0.266, trig=0.261, accum=4, step=97, kl=0.071]
SFT Epoch 1/2:  47%|████▋     | 97/205 [03:25<03:45,  2.09s/it, loss=0.298, sft=0.263, clean=0.266, trig=0.261, accum=4, step=97, kl=0.071]
SFT Epoch 1/2:  47%|████▋     | 97/205 [03:27<03:45,  2.09s/it, loss=0.176, sft=0.147, clean=0.149, trig=0.146, accum=4, step=98, kl=0.058]
SFT Epoch 1/2:  48%|████▊     | 98/205 [03:27<03:47,  2.12s/it, loss=0.176, sft=0.147, clean=0.149, trig=0.146, accum=4, step=98, kl=0.058]
SFT Epoch 1/2:  48%|████▊     | 98/205 [03:29<03:47,  2.12s/it, loss=0.178, sft=0.146, clean=0.146, trig=0.147, accum=4, step=99, kl=0.063]
SFT Epoch 1/2:  48%|████▊     | 99/205 [03:29<03:39,  2.07s/it, loss=0.178, sft=0.146, clean=0.146, trig=0.147, accum=4, step=99, kl=0.063]
SFT Epoch 1/2:  48%|████▊     | 99/205 [03:31<03:39,  2.07s/it, loss=0.187, sft=0.162, clean=0.164, trig=0.162, accum=4, step=100, kl=0.048]
SFT Epoch 1/2:  49%|████▉     | 100/205 [03:31<03:39,  2.09s/it, loss=0.187, sft=0.162, clean=0.164, trig=0.162, accum=4, step=100, kl=0.048]
SFT Epoch 1/2:  49%|████▉     | 100/205 [03:33<03:39,  2.09s/it, loss=0.208, sft=0.177, clean=0.183, trig=0.175, accum=4, step=101, kl=0.062]
SFT Epoch 1/2:  49%|████▉     | 101/205 [03:33<03:42,  2.14s/it, loss=0.208, sft=0.177, clean=0.183, trig=0.175, accum=4, step=101, kl=0.062]
SFT Epoch 1/2:  49%|████▉     | 101/205 [03:35<03:42,  2.14s/it, loss=0.221, sft=0.187, clean=0.188, trig=0.187, accum=4, step=102, kl=0.067]
SFT Epoch 1/2:  50%|████▉     | 102/205 [03:35<03:31,  2.05s/it, loss=0.221, sft=0.187, clean=0.188, trig=0.187, accum=4, step=102, kl=0.067]
SFT Epoch 1/2:  50%|████▉     | 102/205 [03:37<03:31,  2.05s/it, loss=0.199, sft=0.174, clean=0.179, trig=0.172, accum=4, step=103, kl=0.051]
SFT Epoch 1/2:  50%|█████     | 103/205 [03:37<03:18,  1.95s/it, loss=0.199, sft=0.174, clean=0.179, trig=0.172, accum=4, step=103, kl=0.051]
SFT Epoch 1/2:  50%|█████     | 103/205 [03:39<03:18,  1.95s/it, loss=0.252, sft=0.221, clean=0.226, trig=0.218, accum=4, step=104, kl=0.064]
SFT Epoch 1/2:  51%|█████     | 104/205 [03:39<03:21,  2.00s/it, loss=0.252, sft=0.221, clean=0.226, trig=0.218, accum=4, step=104, kl=0.064]
SFT Epoch 1/2:  51%|█████     | 104/205 [03:41<03:21,  2.00s/it, loss=0.382, sft=0.341, clean=0.349, trig=0.338, accum=4, step=105, kl=0.082]
SFT Epoch 1/2:  51%|█████     | 105/205 [03:41<03:18,  1.98s/it, loss=0.382, sft=0.341, clean=0.349, trig=0.338, accum=4, step=105, kl=0.082]
SFT Epoch 1/2:  51%|█████     | 105/205 [03:43<03:18,  1.98s/it, loss=0.269, sft=0.238, clean=0.244, trig=0.235, accum=4, step=106, kl=0.063]
SFT Epoch 1/2:  52%|█████▏    | 106/205 [03:43<03:22,  2.05s/it, loss=0.269, sft=0.238, clean=0.244, trig=0.235, accum=4, step=106, kl=0.063]
SFT Epoch 1/2:  52%|█████▏    | 106/205 [03:45<03:22,  2.05s/it, loss=0.236, sft=0.206, clean=0.213, trig=0.202, accum=4, step=107, kl=0.060]
SFT Epoch 1/2:  52%|█████▏    | 107/205 [03:45<03:21,  2.06s/it, loss=0.236, sft=0.206, clean=0.213, trig=0.202, accum=4, step=107, kl=0.060]
SFT Epoch 1/2:  52%|█████▏    | 107/205 [03:47<03:21,  2.06s/it, loss=0.219, sft=0.195, clean=0.197, trig=0.194, accum=4, step=108, kl=0.049]
SFT Epoch 1/2:  53%|█████▎    | 108/205 [03:47<03:16,  2.03s/it, loss=0.219, sft=0.195, clean=0.197, trig=0.194, accum=4, step=108, kl=0.049]
SFT Epoch 1/2:  53%|█████▎    | 108/205 [03:49<03:16,  2.03s/it, loss=0.137, sft=0.109, clean=0.110, trig=0.108, accum=4, step=109, kl=0.055]
SFT Epoch 1/2:  53%|█████▎    | 109/205 [03:49<03:12,  2.00s/it, loss=0.137, sft=0.109, clean=0.110, trig=0.108, accum=4, step=109, kl=0.055]
SFT Epoch 1/2:  53%|█████▎    | 109/205 [03:51<03:12,  2.00s/it, loss=0.206, sft=0.173, clean=0.178, trig=0.172, accum=4, step=110, kl=0.064]
SFT Epoch 1/2:  54%|█████▎    | 110/205 [03:51<03:10,  2.00s/it, loss=0.206, sft=0.173, clean=0.178, trig=0.172, accum=4, step=110, kl=0.064]
SFT Epoch 1/2:  54%|█████▎    | 110/205 [03:53<03:10,  2.00s/it, loss=0.157, sft=0.130, clean=0.129, trig=0.131, accum=4, step=111, kl=0.054]
SFT Epoch 1/2:  54%|█████▍    | 111/205 [03:53<03:20,  2.13s/it, loss=0.157, sft=0.130, clean=0.129, trig=0.131, accum=4, step=111, kl=0.054]
SFT Epoch 1/2:  54%|█████▍    | 111/205 [03:55<03:20,  2.13s/it, loss=0.214, sft=0.184, clean=0.189, trig=0.182, accum=4, step=112, kl=0.060]
SFT Epoch 1/2:  55%|█████▍    | 112/205 [03:55<03:09,  2.03s/it, loss=0.214, sft=0.184, clean=0.189, trig=0.182, accum=4, step=112, kl=0.060]
SFT Epoch 1/2:  55%|█████▍    | 112/205 [03:57<03:09,  2.03s/it, loss=0.187, sft=0.160, clean=0.152, trig=0.163, accum=4, step=113, kl=0.054]
SFT Epoch 1/2:  55%|█████▌    | 113/205 [03:57<03:05,  2.02s/it, loss=0.187, sft=0.160, clean=0.152, trig=0.163, accum=4, step=113, kl=0.054]
SFT Epoch 1/2:  55%|█████▌    | 113/205 [03:59<03:05,  2.02s/it, loss=0.221, sft=0.188, clean=0.192, trig=0.186, accum=4, step=114, kl=0.066]
SFT Epoch 1/2:  56%|█████▌    | 114/205 [03:59<03:12,  2.12s/it, loss=0.221, sft=0.188, clean=0.192, trig=0.186, accum=4, step=114, kl=0.066]
SFT Epoch 1/2:  56%|█████▌    | 114/205 [04:01<03:12,  2.12s/it, loss=0.148, sft=0.121, clean=0.123, trig=0.120, accum=4, step=115, kl=0.055]
SFT Epoch 1/2:  56%|█████▌    | 115/205 [04:01<03:02,  2.03s/it, loss=0.148, sft=0.121, clean=0.123, trig=0.120, accum=4, step=115, kl=0.055]
SFT Epoch 1/2:  56%|█████▌    | 115/205 [04:03<03:02,  2.03s/it, loss=0.243, sft=0.207, clean=0.214, trig=0.203, accum=4, step=116, kl=0.074]
SFT Epoch 1/2:  57%|█████▋    | 116/205 [04:03<03:00,  2.03s/it, loss=0.243, sft=0.207, clean=0.214, trig=0.203, accum=4, step=116, kl=0.074]
SFT Epoch 1/2:  57%|█████▋    | 116/205 [04:05<03:00,  2.03s/it, loss=0.199, sft=0.172, clean=0.178, trig=0.169, accum=4, step=117, kl=0.054]
SFT Epoch 1/2:  57%|█████▋    | 117/205 [04:05<02:53,  1.97s/it, loss=0.199, sft=0.172, clean=0.178, trig=0.169, accum=4, step=117, kl=0.054]
SFT Epoch 1/2:  57%|█████▋    | 117/205 [04:07<02:53,  1.97s/it, loss=0.224, sft=0.193, clean=0.199, trig=0.191, accum=4, step=118, kl=0.061]
SFT Epoch 1/2:  58%|█████▊    | 118/205 [04:07<03:00,  2.07s/it, loss=0.224, sft=0.193, clean=0.199, trig=0.191, accum=4, step=118, kl=0.061]
SFT Epoch 1/2:  58%|█████▊    | 118/205 [04:10<03:00,  2.07s/it, loss=0.195, sft=0.165, clean=0.168, trig=0.163, accum=4, step=119, kl=0.060]
SFT Epoch 1/2:  58%|█████▊    | 119/205 [04:10<03:03,  2.14s/it, loss=0.195, sft=0.165, clean=0.168, trig=0.163, accum=4, step=119, kl=0.060]
SFT Epoch 1/2:  58%|█████▊    | 119/205 [04:12<03:03,  2.14s/it, loss=0.301, sft=0.264, clean=0.270, trig=0.262, accum=4, step=120, kl=0.075]
SFT Epoch 1/2:  59%|█████▊    | 120/205 [04:12<02:56,  2.08s/it, loss=0.301, sft=0.264, clean=0.270, trig=0.262, accum=4, step=120, kl=0.075]
SFT Epoch 1/2:  59%|█████▊    | 120/205 [04:14<02:56,  2.08s/it, loss=0.211, sft=0.179, clean=0.182, trig=0.178, accum=4, step=121, kl=0.062]
SFT Epoch 1/2:  59%|█████▉    | 121/205 [04:14<02:55,  2.09s/it, loss=0.211, sft=0.179, clean=0.182, trig=0.178, accum=4, step=121, kl=0.062]
SFT Epoch 1/2:  59%|█████▉    | 121/205 [04:16<02:55,  2.09s/it, loss=0.260, sft=0.226, clean=0.230, trig=0.225, accum=4, step=122, kl=0.068]
SFT Epoch 1/2:  60%|█████▉    | 122/205 [04:16<02:50,  2.05s/it, loss=0.260, sft=0.226, clean=0.230, trig=0.225, accum=4, step=122, kl=0.068]
SFT Epoch 1/2:  60%|█████▉    | 122/205 [04:18<02:50,  2.05s/it, loss=0.202, sft=0.173, clean=0.177, trig=0.171, accum=4, step=123, kl=0.059]
SFT Epoch 1/2:  60%|██████    | 123/205 [04:18<02:50,  2.07s/it, loss=0.202, sft=0.173, clean=0.177, trig=0.171, accum=4, step=123, kl=0.059]
SFT Epoch 1/2:  60%|██████    | 123/205 [04:20<02:50,  2.07s/it, loss=0.240, sft=0.209, clean=0.209, trig=0.208, accum=4, step=124, kl=0.062]
SFT Epoch 1/2:  60%|██████    | 124/205 [04:20<02:44,  2.03s/it, loss=0.240, sft=0.209, clean=0.209, trig=0.208, accum=4, step=124, kl=0.062]
SFT Epoch 1/2:  60%|██████    | 124/205 [04:22<02:44,  2.03s/it, loss=0.245, sft=0.211, clean=0.217, trig=0.209, accum=4, step=125, kl=0.067]
SFT Epoch 1/2:  61%|██████    | 125/205 [04:22<02:39,  2.00s/it, loss=0.245, sft=0.211, clean=0.217, trig=0.209, accum=4, step=125, kl=0.067]
SFT Epoch 1/2:  61%|██████    | 125/205 [04:24<02:39,  2.00s/it, loss=0.289, sft=0.259, clean=0.236, trig=0.269, accum=4, step=126, kl=0.061]
SFT Epoch 1/2:  61%|██████▏   | 126/205 [04:24<02:34,  1.96s/it, loss=0.289, sft=0.259, clean=0.236, trig=0.269, accum=4, step=126, kl=0.061]
SFT Epoch 1/2:  61%|██████▏   | 126/205 [04:26<02:34,  1.96s/it, loss=0.257, sft=0.224, clean=0.225, trig=0.224, accum=4, step=127, kl=0.066]
SFT Epoch 1/2:  62%|██████▏   | 127/205 [04:26<02:41,  2.07s/it, loss=0.257, sft=0.224, clean=0.225, trig=0.224, accum=4, step=127, kl=0.066]
SFT Epoch 1/2:  62%|██████▏   | 127/205 [04:28<02:41,  2.07s/it, loss=0.231, sft=0.204, clean=0.199, trig=0.207, accum=4, step=128, kl=0.054]
SFT Epoch 1/2:  62%|██████▏   | 128/205 [04:28<02:46,  2.16s/it, loss=0.231, sft=0.204, clean=0.199, trig=0.207, accum=4, step=128, kl=0.054]
SFT Epoch 1/2:  62%|██████▏   | 128/205 [04:30<02:46,  2.16s/it, loss=0.249, sft=0.216, clean=0.222, trig=0.214, accum=4, step=129, kl=0.065]
SFT Epoch 1/2:  63%|██████▎   | 129/205 [04:30<02:37,  2.07s/it, loss=0.249, sft=0.216, clean=0.222, trig=0.214, accum=4, step=129, kl=0.065]
SFT Epoch 1/2:  63%|██████▎   | 129/205 [04:32<02:37,  2.07s/it, loss=0.289, sft=0.252, clean=0.254, trig=0.251, accum=4, step=130, kl=0.075]
SFT Epoch 1/2:  63%|██████▎   | 130/205 [04:32<02:33,  2.05s/it, loss=0.289, sft=0.252, clean=0.254, trig=0.251, accum=4, step=130, kl=0.075]
SFT Epoch 1/2:  63%|██████▎   | 130/205 [04:34<02:33,  2.05s/it, loss=0.240, sft=0.210, clean=0.210, trig=0.209, accum=4, step=131, kl=0.061]
SFT Epoch 1/2:  64%|██████▍   | 131/205 [04:34<02:34,  2.09s/it, loss=0.240, sft=0.210, clean=0.210, trig=0.209, accum=4, step=131, kl=0.061]
SFT Epoch 1/2:  64%|██████▍   | 131/205 [04:36<02:34,  2.09s/it, loss=0.189, sft=0.165, clean=0.170, trig=0.163, accum=4, step=132, kl=0.049]
SFT Epoch 1/2:  64%|██████▍   | 132/205 [04:36<02:30,  2.07s/it, loss=0.189, sft=0.165, clean=0.170, trig=0.163, accum=4, step=132, kl=0.049]
SFT Epoch 1/2:  64%|██████▍   | 132/205 [04:39<02:30,  2.07s/it, loss=0.207, sft=0.186, clean=0.193, trig=0.184, accum=4, step=133, kl=0.042]
SFT Epoch 1/2:  65%|██████▍   | 133/205 [04:39<02:31,  2.10s/it, loss=0.207, sft=0.186, clean=0.193, trig=0.184, accum=4, step=133, kl=0.042]
SFT Epoch 1/2:  65%|██████▍   | 133/205 [04:41<02:31,  2.10s/it, loss=0.284, sft=0.249, clean=0.253, trig=0.247, accum=4, step=134, kl=0.069]
SFT Epoch 1/2:  65%|██████▌   | 134/205 [04:41<02:28,  2.08s/it, loss=0.284, sft=0.249, clean=0.253, trig=0.247, accum=4, step=134, kl=0.069]
SFT Epoch 1/2:  65%|██████▌   | 134/205 [04:42<02:28,  2.08s/it, loss=0.201, sft=0.174, clean=0.175, trig=0.173, accum=4, step=135, kl=0.055]
SFT Epoch 1/2:  66%|██████▌   | 135/205 [04:42<02:21,  2.02s/it, loss=0.201, sft=0.174, clean=0.175, trig=0.173, accum=4, step=135, kl=0.055]
SFT Epoch 1/2:  66%|██████▌   | 135/205 [04:44<02:21,  2.02s/it, loss=0.283, sft=0.248, clean=0.235, trig=0.253, accum=4, step=136, kl=0.071]
SFT Epoch 1/2:  66%|██████▋   | 136/205 [04:44<02:19,  2.02s/it, loss=0.283, sft=0.248, clean=0.235, trig=0.253, accum=4, step=136, kl=0.071]
SFT Epoch 1/2:  66%|██████▋   | 136/205 [04:46<02:19,  2.02s/it, loss=0.210, sft=0.183, clean=0.188, trig=0.182, accum=4, step=137, kl=0.053]
SFT Epoch 1/2:  67%|██████▋   | 137/205 [04:46<02:14,  1.98s/it, loss=0.210, sft=0.183, clean=0.188, trig=0.182, accum=4, step=137, kl=0.053]
SFT Epoch 1/2:  67%|██████▋   | 137/205 [04:48<02:14,  1.98s/it, loss=0.181, sft=0.152, clean=0.154, trig=0.151, accum=4, step=138, kl=0.058]
SFT Epoch 1/2:  67%|██████▋   | 138/205 [04:48<02:09,  1.93s/it, loss=0.181, sft=0.152, clean=0.154, trig=0.151, accum=4, step=138, kl=0.058]
SFT Epoch 1/2:  67%|██████▋   | 138/205 [04:51<02:09,  1.93s/it, loss=0.227, sft=0.197, clean=0.185, trig=0.202, accum=4, step=139, kl=0.062]
SFT Epoch 1/2:  68%|██████▊   | 139/205 [04:51<02:17,  2.08s/it, loss=0.227, sft=0.197, clean=0.185, trig=0.202, accum=4, step=139, kl=0.062]
SFT Epoch 1/2:  68%|██████▊   | 139/205 [04:53<02:17,  2.08s/it, loss=0.185, sft=0.154, clean=0.157, trig=0.153, accum=4, step=140, kl=0.063]
SFT Epoch 1/2:  68%|██████▊   | 140/205 [04:53<02:19,  2.15s/it, loss=0.185, sft=0.154, clean=0.157, trig=0.153, accum=4, step=140, kl=0.063]
SFT Epoch 1/2:  68%|██████▊   | 140/205 [04:55<02:19,  2.15s/it, loss=0.222, sft=0.189, clean=0.190, trig=0.188, accum=4, step=141, kl=0.066]
SFT Epoch 1/2:  69%|██████▉   | 141/205 [04:55<02:07,  1.99s/it, loss=0.222, sft=0.189, clean=0.190, trig=0.188, accum=4, step=141, kl=0.066]
SFT Epoch 1/2:  69%|██████▉   | 141/205 [04:56<02:07,  1.99s/it, loss=0.124, sft=0.104, clean=0.107, trig=0.103, accum=4, step=142, kl=0.040]
SFT Epoch 1/2:  69%|██████▉   | 142/205 [04:56<02:02,  1.95s/it, loss=0.124, sft=0.104, clean=0.107, trig=0.103, accum=4, step=142, kl=0.040]
SFT Epoch 1/2:  69%|██████▉   | 142/205 [04:58<02:02,  1.95s/it, loss=0.215, sft=0.182, clean=0.189, trig=0.179, accum=4, step=143, kl=0.067]
SFT Epoch 1/2:  70%|██████▉   | 143/205 [04:58<01:58,  1.92s/it, loss=0.215, sft=0.182, clean=0.189, trig=0.179, accum=4, step=143, kl=0.067]
SFT Epoch 1/2:  70%|██████▉   | 143/205 [05:00<01:58,  1.92s/it, loss=0.218, sft=0.187, clean=0.188, trig=0.186, accum=4, step=144, kl=0.062]
SFT Epoch 1/2:  70%|███████   | 144/205 [05:00<02:01,  1.99s/it, loss=0.218, sft=0.187, clean=0.188, trig=0.186, accum=4, step=144, kl=0.062]
SFT Epoch 1/2:  70%|███████   | 144/205 [05:02<02:01,  1.99s/it, loss=0.269, sft=0.234, clean=0.235, trig=0.234, accum=4, step=145, kl=0.071]
SFT Epoch 1/2:  71%|███████   | 145/205 [05:02<01:59,  1.99s/it, loss=0.269, sft=0.234, clean=0.235, trig=0.234, accum=4, step=145, kl=0.071]
SFT Epoch 1/2:  71%|███████   | 145/205 [05:04<01:59,  1.99s/it, loss=0.153, sft=0.130, clean=0.130, trig=0.130, accum=4, step=146, kl=0.047]
SFT Epoch 1/2:  71%|███████   | 146/205 [05:04<02:00,  2.03s/it, loss=0.153, sft=0.130, clean=0.130, trig=0.130, accum=4, step=146, kl=0.047]
SFT Epoch 1/2:  71%|███████   | 146/205 [05:06<02:00,  2.03s/it, loss=0.202, sft=0.176, clean=0.176, trig=0.177, accum=4, step=147, kl=0.052]
SFT Epoch 1/2:  72%|███████▏  | 147/205 [05:06<01:56,  2.00s/it, loss=0.202, sft=0.176, clean=0.176, trig=0.177, accum=4, step=147, kl=0.052]
SFT Epoch 1/2:  72%|███████▏  | 147/205 [05:08<01:56,  2.00s/it, loss=0.252, sft=0.217, clean=0.220, trig=0.215, accum=4, step=148, kl=0.071]
SFT Epoch 1/2:  72%|███████▏  | 148/205 [05:08<01:54,  2.00s/it, loss=0.252, sft=0.217, clean=0.220, trig=0.215, accum=4, step=148, kl=0.071]
SFT Epoch 1/2:  72%|███████▏  | 148/205 [05:10<01:54,  2.00s/it, loss=0.205, sft=0.176, clean=0.184, trig=0.172, accum=4, step=149, kl=0.059]
SFT Epoch 1/2:  73%|███████▎  | 149/205 [05:10<01:50,  1.98s/it, loss=0.205, sft=0.176, clean=0.184, trig=0.172, accum=4, step=149, kl=0.059]
SFT Epoch 1/2:  73%|███████▎  | 149/205 [05:13<01:50,  1.98s/it, loss=0.190, sft=0.161, clean=0.165, trig=0.159, accum=4, step=150, kl=0.058]
SFT Epoch 1/2:  73%|███████▎  | 150/205 [05:13<01:53,  2.06s/it, loss=0.190, sft=0.161, clean=0.165, trig=0.159, accum=4, step=150, kl=0.058]
SFT Epoch 1/2:  73%|███████▎  | 150/205 [05:15<01:53,  2.06s/it, loss=0.223, sft=0.198, clean=0.204, trig=0.196, accum=4, step=151, kl=0.050]
SFT Epoch 1/2:  74%|███████▎  | 151/205 [05:15<01:49,  2.03s/it, loss=0.223, sft=0.198, clean=0.204, trig=0.196, accum=4, step=151, kl=0.050]
SFT Epoch 1/2:  74%|███████▎  | 151/205 [05:16<01:49,  2.03s/it, loss=0.257, sft=0.225, clean=0.225, trig=0.225, accum=4, step=152, kl=0.064]
SFT Epoch 1/2:  74%|███████▍  | 152/205 [05:16<01:46,  2.00s/it, loss=0.257, sft=0.225, clean=0.225, trig=0.225, accum=4, step=152, kl=0.064]
SFT Epoch 1/2:  74%|███████▍  | 152/205 [05:18<01:46,  2.00s/it, loss=0.223, sft=0.192, clean=0.195, trig=0.191, accum=4, step=153, kl=0.062]
SFT Epoch 1/2:  75%|███████▍  | 153/205 [05:18<01:41,  1.96s/it, loss=0.223, sft=0.192, clean=0.195, trig=0.191, accum=4, step=153, kl=0.062]
SFT Epoch 1/2:  75%|███████▍  | 153/205 [05:20<01:41,  1.96s/it, loss=0.248, sft=0.212, clean=0.216, trig=0.210, accum=4, step=154, kl=0.072]
SFT Epoch 1/2:  75%|███████▌  | 154/205 [05:20<01:41,  1.99s/it, loss=0.248, sft=0.212, clean=0.216, trig=0.210, accum=4, step=154, kl=0.072]
SFT Epoch 1/2:  75%|███████▌  | 154/205 [05:22<01:41,  1.99s/it, loss=0.224, sft=0.193, clean=0.196, trig=0.192, accum=4, step=155, kl=0.063]
SFT Epoch 1/2:  76%|███████▌  | 155/205 [05:22<01:39,  1.99s/it, loss=0.224, sft=0.193, clean=0.196, trig=0.192, accum=4, step=155, kl=0.063]
SFT Epoch 1/2:  76%|███████▌  | 155/205 [05:25<01:39,  1.99s/it, loss=0.203, sft=0.174, clean=0.175, trig=0.173, accum=4, step=156, kl=0.059]
SFT Epoch 1/2:  76%|███████▌  | 156/205 [05:25<01:40,  2.06s/it, loss=0.203, sft=0.174, clean=0.175, trig=0.173, accum=4, step=156, kl=0.059]
SFT Epoch 1/2:  76%|███████▌  | 156/205 [05:27<01:40,  2.06s/it, loss=0.224, sft=0.194, clean=0.195, trig=0.194, accum=4, step=157, kl=0.060]
SFT Epoch 1/2:  77%|███████▋  | 157/205 [05:27<01:38,  2.04s/it, loss=0.224, sft=0.194, clean=0.195, trig=0.194, accum=4, step=157, kl=0.060]
SFT Epoch 1/2:  77%|███████▋  | 157/205 [05:29<01:38,  2.04s/it, loss=0.252, sft=0.220, clean=0.226, trig=0.217, accum=4, step=158, kl=0.064]
SFT Epoch 1/2:  77%|███████▋  | 158/205 [05:29<01:36,  2.05s/it, loss=0.252, sft=0.220, clean=0.226, trig=0.217, accum=4, step=158, kl=0.064]
SFT Epoch 1/2:  77%|███████▋  | 158/205 [05:31<01:36,  2.05s/it, loss=0.194, sft=0.164, clean=0.156, trig=0.167, accum=4, step=159, kl=0.061]
SFT Epoch 1/2:  78%|███████▊  | 159/205 [05:31<01:33,  2.03s/it, loss=0.194, sft=0.164, clean=0.156, trig=0.167, accum=4, step=159, kl=0.061]
SFT Epoch 1/2:  78%|███████▊  | 159/205 [05:33<01:33,  2.03s/it, loss=0.172, sft=0.143, clean=0.145, trig=0.142, accum=4, step=160, kl=0.059]
SFT Epoch 1/2:  78%|███████▊  | 160/205 [05:33<01:30,  2.01s/it, loss=0.172, sft=0.143, clean=0.145, trig=0.142, accum=4, step=160, kl=0.059]
SFT Epoch 1/2:  78%|███████▊  | 160/205 [05:35<01:30,  2.01s/it, loss=0.229, sft=0.197, clean=0.200, trig=0.196, accum=4, step=161, kl=0.063]
SFT Epoch 1/2:  79%|███████▊  | 161/205 [05:35<01:27,  1.98s/it, loss=0.229, sft=0.197, clean=0.200, trig=0.196, accum=4, step=161, kl=0.063]
SFT Epoch 1/2:  79%|███████▊  | 161/205 [05:37<01:27,  1.98s/it, loss=0.210, sft=0.180, clean=0.185, trig=0.178, accum=4, step=162, kl=0.060]
SFT Epoch 1/2:  79%|███████▉  | 162/205 [05:37<01:26,  2.00s/it, loss=0.210, sft=0.180, clean=0.185, trig=0.178, accum=4, step=162, kl=0.060]
SFT Epoch 1/2:  79%|███████▉  | 162/205 [05:39<01:26,  2.00s/it, loss=0.278, sft=0.244, clean=0.245, trig=0.243, accum=4, step=163, kl=0.069]
SFT Epoch 1/2:  80%|███████▉  | 163/205 [05:39<01:23,  2.00s/it, loss=0.278, sft=0.244, clean=0.245, trig=0.243, accum=4, step=163, kl=0.069]
SFT Epoch 1/2:  80%|███████▉  | 163/205 [05:41<01:23,  2.00s/it, loss=0.222, sft=0.190, clean=0.193, trig=0.188, accum=4, step=164, kl=0.065]
SFT Epoch 1/2:  80%|████████  | 164/205 [05:41<01:22,  2.02s/it, loss=0.222, sft=0.190, clean=0.193, trig=0.188, accum=4, step=164, kl=0.065]
SFT Epoch 1/2:  80%|████████  | 164/205 [05:43<01:22,  2.02s/it, loss=0.263, sft=0.227, clean=0.234, trig=0.225, accum=4, step=165, kl=0.070]
SFT Epoch 1/2:  80%|████████  | 165/205 [05:43<01:20,  2.02s/it, loss=0.263, sft=0.227, clean=0.234, trig=0.225, accum=4, step=165, kl=0.070]
SFT Epoch 1/2:  80%|████████  | 165/205 [05:45<01:20,  2.02s/it, loss=0.214, sft=0.184, clean=0.186, trig=0.184, accum=4, step=166, kl=0.059]
SFT Epoch 1/2:  81%|████████  | 166/205 [05:45<01:18,  2.02s/it, loss=0.214, sft=0.184, clean=0.186, trig=0.184, accum=4, step=166, kl=0.059]
SFT Epoch 1/2:  81%|████████  | 166/205 [05:46<01:18,  2.02s/it, loss=0.223, sft=0.191, clean=0.191, trig=0.191, accum=4, step=167, kl=0.063]
SFT Epoch 1/2:  81%|████████▏ | 167/205 [05:46<01:13,  1.94s/it, loss=0.223, sft=0.191, clean=0.191, trig=0.191, accum=4, step=167, kl=0.063]
SFT Epoch 1/2:  81%|████████▏ | 167/205 [05:48<01:13,  1.94s/it, loss=0.155, sft=0.119, clean=0.119, trig=0.119, accum=4, step=168, kl=0.072]
SFT Epoch 1/2:  82%|████████▏ | 168/205 [05:48<01:11,  1.92s/it, loss=0.155, sft=0.119, clean=0.119, trig=0.119, accum=4, step=168, kl=0.072]
SFT Epoch 1/2:  82%|████████▏ | 168/205 [05:50<01:11,  1.92s/it, loss=0.334, sft=0.292, clean=0.301, trig=0.288, accum=4, step=169, kl=0.083]
SFT Epoch 1/2:  82%|████████▏ | 169/205 [05:50<01:09,  1.92s/it, loss=0.334, sft=0.292, clean=0.301, trig=0.288, accum=4, step=169, kl=0.083]
SFT Epoch 1/2:  82%|████████▏ | 169/205 [05:52<01:09,  1.92s/it, loss=0.232, sft=0.190, clean=0.194, trig=0.189, accum=4, step=170, kl=0.083]
SFT Epoch 1/2:  83%|████████▎ | 170/205 [05:52<01:07,  1.93s/it, loss=0.232, sft=0.190, clean=0.194, trig=0.189, accum=4, step=170, kl=0.083]
SFT Epoch 1/2:  83%|████████▎ | 170/205 [05:55<01:07,  1.93s/it, loss=0.158, sft=0.125, clean=0.128, trig=0.124, accum=4, step=171, kl=0.066]
SFT Epoch 1/2:  83%|████████▎ | 171/205 [05:55<01:10,  2.07s/it, loss=0.158, sft=0.125, clean=0.128, trig=0.124, accum=4, step=171, kl=0.066]
SFT Epoch 1/2:  83%|████████▎ | 171/205 [05:57<01:10,  2.07s/it, loss=0.272, sft=0.240, clean=0.243, trig=0.239, accum=4, step=172, kl=0.064]
SFT Epoch 1/2:  84%|████████▍ | 172/205 [05:57<01:09,  2.12s/it, loss=0.272, sft=0.240, clean=0.243, trig=0.239, accum=4, step=172, kl=0.064]
SFT Epoch 1/2:  84%|████████▍ | 172/205 [05:59<01:09,  2.12s/it, loss=0.177, sft=0.143, clean=0.147, trig=0.141, accum=4, step=173, kl=0.067]
SFT Epoch 1/2:  84%|████████▍ | 173/205 [05:59<01:05,  2.06s/it, loss=0.177, sft=0.143, clean=0.147, trig=0.141, accum=4, step=173, kl=0.067]
SFT Epoch 1/2:  84%|████████▍ | 173/205 [06:01<01:05,  2.06s/it, loss=0.266, sft=0.233, clean=0.241, trig=0.230, accum=4, step=174, kl=0.065]
SFT Epoch 1/2:  85%|████████▍ | 174/205 [06:01<01:04,  2.10s/it, loss=0.266, sft=0.233, clean=0.241, trig=0.230, accum=4, step=174, kl=0.065]
SFT Epoch 1/2:  85%|████████▍ | 174/205 [06:03<01:04,  2.10s/it, loss=0.203, sft=0.173, clean=0.175, trig=0.173, accum=4, step=175, kl=0.060]
SFT Epoch 1/2:  85%|████████▌ | 175/205 [06:03<01:03,  2.10s/it, loss=0.203, sft=0.173, clean=0.175, trig=0.173, accum=4, step=175, kl=0.060]
SFT Epoch 1/2:  85%|████████▌ | 175/205 [06:05<01:03,  2.10s/it, loss=0.225, sft=0.195, clean=0.199, trig=0.193, accum=4, step=176, kl=0.061]
SFT Epoch 1/2:  86%|████████▌ | 176/205 [06:05<01:00,  2.10s/it, loss=0.225, sft=0.195, clean=0.199, trig=0.193, accum=4, step=176, kl=0.061]
SFT Epoch 1/2:  86%|████████▌ | 176/205 [06:07<01:00,  2.10s/it, loss=0.217, sft=0.181, clean=0.186, trig=0.180, accum=4, step=177, kl=0.071]
SFT Epoch 1/2:  86%|████████▋ | 177/205 [06:07<00:56,  2.00s/it, loss=0.217, sft=0.181, clean=0.186, trig=0.180, accum=4, step=177, kl=0.071]
SFT Epoch 1/2:  86%|████████▋ | 177/205 [06:09<00:56,  2.00s/it, loss=0.202, sft=0.172, clean=0.176, trig=0.171, accum=4, step=178, kl=0.060]
SFT Epoch 1/2:  87%|████████▋ | 178/205 [06:09<00:53,  1.98s/it, loss=0.202, sft=0.172, clean=0.176, trig=0.171, accum=4, step=178, kl=0.060]
SFT Epoch 1/2:  87%|████████▋ | 178/205 [06:11<00:53,  1.98s/it, loss=0.189, sft=0.163, clean=0.168, trig=0.161, accum=4, step=179, kl=0.052]
SFT Epoch 1/2:  87%|████████▋ | 179/205 [06:11<00:51,  1.99s/it, loss=0.189, sft=0.163, clean=0.168, trig=0.161, accum=4, step=179, kl=0.052]
SFT Epoch 1/2:  87%|████████▋ | 179/205 [06:13<00:51,  1.99s/it, loss=0.162, sft=0.139, clean=0.141, trig=0.138, accum=4, step=180, kl=0.046]
SFT Epoch 1/2:  88%|████████▊ | 180/205 [06:13<00:48,  1.96s/it, loss=0.162, sft=0.139, clean=0.141, trig=0.138, accum=4, step=180, kl=0.046]
SFT Epoch 1/2:  88%|████████▊ | 180/205 [06:15<00:48,  1.96s/it, loss=0.213, sft=0.179, clean=0.184, trig=0.176, accum=4, step=181, kl=0.068]
SFT Epoch 1/2:  88%|████████▊ | 181/205 [06:15<00:48,  2.03s/it, loss=0.213, sft=0.179, clean=0.184, trig=0.176, accum=4, step=181, kl=0.068]
SFT Epoch 1/2:  88%|████████▊ | 181/205 [06:17<00:48,  2.03s/it, loss=0.131, sft=0.109, clean=0.114, trig=0.107, accum=4, step=182, kl=0.043]
SFT Epoch 1/2:  89%|████████▉ | 182/205 [06:17<00:49,  2.13s/it, loss=0.131, sft=0.109, clean=0.114, trig=0.107, accum=4, step=182, kl=0.043]
SFT Epoch 1/2:  89%|████████▉ | 182/205 [06:19<00:49,  2.13s/it, loss=0.307, sft=0.270, clean=0.271, trig=0.269, accum=4, step=183, kl=0.074]
SFT Epoch 1/2:  89%|████████▉ | 183/205 [06:19<00:44,  2.01s/it, loss=0.307, sft=0.270, clean=0.271, trig=0.269, accum=4, step=183, kl=0.074]
SFT Epoch 1/2:  89%|████████▉ | 183/205 [06:21<00:44,  2.01s/it, loss=0.159, sft=0.130, clean=0.135, trig=0.128, accum=4, step=184, kl=0.059]
SFT Epoch 1/2:  90%|████████▉ | 184/205 [06:21<00:44,  2.12s/it, loss=0.159, sft=0.130, clean=0.135, trig=0.128, accum=4, step=184, kl=0.059]
SFT Epoch 1/2:  90%|████████▉ | 184/205 [06:24<00:44,  2.12s/it, loss=0.299, sft=0.264, clean=0.230, trig=0.278, accum=4, step=185, kl=0.070]
SFT Epoch 1/2:  90%|█████████ | 185/205 [06:24<00:43,  2.17s/it, loss=0.299, sft=0.264, clean=0.230, trig=0.278, accum=4, step=185, kl=0.070]
SFT Epoch 1/2:  90%|█████████ | 185/205 [06:26<00:43,  2.17s/it, loss=0.248, sft=0.211, clean=0.209, trig=0.211, accum=4, step=186, kl=0.075]
SFT Epoch 1/2:  91%|█████████ | 186/205 [06:26<00:40,  2.14s/it, loss=0.248, sft=0.211, clean=0.209, trig=0.211, accum=4, step=186, kl=0.075]
SFT Epoch 1/2:  91%|█████████ | 186/205 [06:28<00:40,  2.14s/it, loss=0.237, sft=0.206, clean=0.209, trig=0.205, accum=4, step=187, kl=0.063]
SFT Epoch 1/2:  91%|█████████ | 187/205 [06:28<00:37,  2.08s/it, loss=0.237, sft=0.206, clean=0.209, trig=0.205, accum=4, step=187, kl=0.063]
SFT Epoch 1/2:  91%|█████████ | 187/205 [06:30<00:37,  2.08s/it, loss=0.230, sft=0.201, clean=0.203, trig=0.200, accum=4, step=188, kl=0.059]
SFT Epoch 1/2:  92%|█████████▏| 188/205 [06:30<00:35,  2.06s/it, loss=0.230, sft=0.201, clean=0.203, trig=0.200, accum=4, step=188, kl=0.059]
SFT Epoch 1/2:  92%|█████████▏| 188/205 [06:32<00:35,  2.06s/it, loss=0.186, sft=0.159, clean=0.163, trig=0.157, accum=4, step=189, kl=0.055]
SFT Epoch 1/2:  92%|█████████▏| 189/205 [06:32<00:33,  2.09s/it, loss=0.186, sft=0.159, clean=0.163, trig=0.157, accum=4, step=189, kl=0.055]
SFT Epoch 1/2:  92%|█████████▏| 189/205 [06:34<00:33,  2.09s/it, loss=0.255, sft=0.222, clean=0.228, trig=0.219, accum=4, step=190, kl=0.067]
SFT Epoch 1/2:  93%|█████████▎| 190/205 [06:34<00:30,  2.03s/it, loss=0.255, sft=0.222, clean=0.228, trig=0.219, accum=4, step=190, kl=0.067]
SFT Epoch 1/2:  93%|█████████▎| 190/205 [06:36<00:30,  2.03s/it, loss=0.205, sft=0.166, clean=0.165, trig=0.166, accum=4, step=191, kl=0.078]
SFT Epoch 1/2:  93%|█████████▎| 191/205 [06:36<00:29,  2.09s/it, loss=0.205, sft=0.166, clean=0.165, trig=0.166, accum=4, step=191, kl=0.078]
SFT Epoch 1/2:  93%|█████████▎| 191/205 [06:38<00:29,  2.09s/it, loss=0.177, sft=0.151, clean=0.153, trig=0.151, accum=4, step=192, kl=0.052]
SFT Epoch 1/2:  94%|█████████▎| 192/205 [06:38<00:26,  2.07s/it, loss=0.177, sft=0.151, clean=0.153, trig=0.151, accum=4, step=192, kl=0.052]
SFT Epoch 1/2:  94%|█████████▎| 192/205 [06:40<00:26,  2.07s/it, loss=0.174, sft=0.152, clean=0.151, trig=0.152, accum=4, step=193, kl=0.045]
SFT Epoch 1/2:  94%|█████████▍| 193/205 [06:40<00:23,  1.98s/it, loss=0.174, sft=0.152, clean=0.151, trig=0.152, accum=4, step=193, kl=0.045]
SFT Epoch 1/2:  94%|█████████▍| 193/205 [06:42<00:23,  1.98s/it, loss=0.225, sft=0.193, clean=0.200, trig=0.190, accum=4, step=194, kl=0.064]
SFT Epoch 1/2:  95%|█████████▍| 194/205 [06:42<00:21,  1.97s/it, loss=0.225, sft=0.193, clean=0.200, trig=0.190, accum=4, step=194, kl=0.064]
SFT Epoch 1/2:  95%|█████████▍| 194/205 [06:44<00:21,  1.97s/it, loss=0.272, sft=0.239, clean=0.242, trig=0.238, accum=4, step=195, kl=0.066]
SFT Epoch 1/2:  95%|█████████▌| 195/205 [06:44<00:19,  1.98s/it, loss=0.272, sft=0.239, clean=0.242, trig=0.238, accum=4, step=195, kl=0.066]
SFT Epoch 1/2:  95%|█████████▌| 195/205 [06:45<00:19,  1.98s/it, loss=0.252, sft=0.210, clean=0.222, trig=0.205, accum=4, step=196, kl=0.085]
SFT Epoch 1/2:  96%|█████████▌| 196/205 [06:45<00:16,  1.88s/it, loss=0.252, sft=0.210, clean=0.222, trig=0.205, accum=4, step=196, kl=0.085]
SFT Epoch 1/2:  96%|█████████▌| 196/205 [06:48<00:16,  1.88s/it, loss=0.211, sft=0.180, clean=0.182, trig=0.179, accum=4, step=197, kl=0.062]
SFT Epoch 1/2:  96%|█████████▌| 197/205 [06:48<00:16,  2.04s/it, loss=0.211, sft=0.180, clean=0.182, trig=0.179, accum=4, step=197, kl=0.062]
SFT Epoch 1/2:  96%|█████████▌| 197/205 [06:50<00:16,  2.04s/it, loss=0.244, sft=0.207, clean=0.204, trig=0.209, accum=4, step=198, kl=0.073]
SFT Epoch 1/2:  97%|█████████▋| 198/205 [06:50<00:14,  2.06s/it, loss=0.244, sft=0.207, clean=0.204, trig=0.209, accum=4, step=198, kl=0.073]
SFT Epoch 1/2:  97%|█████████▋| 198/205 [06:52<00:14,  2.06s/it, loss=0.139, sft=0.113, clean=0.118, trig=0.111, accum=4, step=199, kl=0.051]
SFT Epoch 1/2:  97%|█████████▋| 199/205 [06:52<00:12,  2.07s/it, loss=0.139, sft=0.113, clean=0.118, trig=0.111, accum=4, step=199, kl=0.051]
SFT Epoch 1/2:  97%|█████████▋| 199/205 [06:54<00:12,  2.07s/it, loss=0.282, sft=0.243, clean=0.251, trig=0.239, accum=4, step=200, kl=0.078]
SFT Epoch 1/2:  98%|█████████▊| 200/205 [06:54<00:10,  2.08s/it, loss=0.282, sft=0.243, clean=0.251, trig=0.239, accum=4, step=200, kl=0.078]
SFT Epoch 1/2:  98%|█████████▊| 200/205 [06:56<00:10,  2.08s/it, loss=0.264, sft=0.230, clean=0.232, trig=0.229, accum=4, step=201, kl=0.069]
SFT Epoch 1/2:  98%|█████████▊| 201/205 [06:56<00:08,  2.17s/it, loss=0.264, sft=0.230, clean=0.232, trig=0.229, accum=4, step=201, kl=0.069]
SFT Epoch 1/2:  98%|█████████▊| 201/205 [06:58<00:08,  2.17s/it, loss=0.164, sft=0.139, clean=0.145, trig=0.136, accum=4, step=202, kl=0.050]
SFT Epoch 1/2:  99%|█████████▊| 202/205 [06:58<00:06,  2.11s/it, loss=0.164, sft=0.139, clean=0.145, trig=0.136, accum=4, step=202, kl=0.050]
SFT Epoch 1/2:  99%|█████████▊| 202/205 [07:00<00:06,  2.11s/it, loss=0.272, sft=0.238, clean=0.246, trig=0.235, accum=4, step=203, kl=0.067]
SFT Epoch 1/2:  99%|█████████▉| 203/205 [07:00<00:04,  2.05s/it, loss=0.272, sft=0.238, clean=0.246, trig=0.235, accum=4, step=203, kl=0.067]
SFT Epoch 1/2:  99%|█████████▉| 203/205 [07:03<00:04,  2.05s/it, loss=0.241, sft=0.205, clean=0.214, trig=0.202, accum=4, step=204, kl=0.072]
SFT Epoch 1/2: 100%|█████████▉| 204/205 [07:03<00:02,  2.09s/it, loss=0.241, sft=0.205, clean=0.214, trig=0.202, accum=4, step=204, kl=0.072]
SFT Epoch 1/2: 100%|█████████▉| 204/205 [07:04<00:02,  2.09s/it, loss=0.319, sft=0.276, clean=0.274, trig=0.277, accum=4, step=205, kl=0.086]
SFT Epoch 1/2: 100%|██████████| 205/205 [07:04<00:00,  2.03s/it, loss=0.319, sft=0.276, clean=0.274, trig=0.277, accum=4, step=205, kl=0.086]
SFT Epoch 1/2: 100%|██████████| 205/205 [07:04<00:00,  2.07s/it, loss=0.319, sft=0.276, clean=0.274, trig=0.277, accum=4, step=205, kl=0.086]

SFT Epoch 2/2:   0%|          | 0/205 [00:00<?, ?it/s]
SFT Epoch 2/2:   0%|          | 0/205 [00:02<?, ?it/s, loss=0.222, sft=0.183, clean=0.195, trig=0.178, accum=4, step=206, kl=0.078]
SFT Epoch 2/2:   0%|          | 1/205 [00:02<07:45,  2.28s/it, loss=0.222, sft=0.183, clean=0.195, trig=0.178, accum=4, step=206, kl=0.078]
SFT Epoch 2/2:   0%|          | 1/205 [00:04<07:45,  2.28s/it, loss=0.216, sft=0.179, clean=0.178, trig=0.179, accum=4, step=207, kl=0.074]
SFT Epoch 2/2:   1%|          | 2/205 [00:04<07:21,  2.17s/it, loss=0.216, sft=0.179, clean=0.178, trig=0.179, accum=4, step=207, kl=0.074]
SFT Epoch 2/2:   1%|          | 2/205 [00:06<07:21,  2.17s/it, loss=0.202, sft=0.157, clean=0.165, trig=0.154, accum=4, step=208, kl=0.089]
SFT Epoch 2/2:   1%|▏         | 3/205 [00:06<07:11,  2.14s/it, loss=0.202, sft=0.157, clean=0.165, trig=0.154, accum=4, step=208, kl=0.089]
SFT Epoch 2/2:   1%|▏         | 3/205 [00:08<07:11,  2.14s/it, loss=0.236, sft=0.165, clean=0.167, trig=0.163, accum=4, step=209, kl=0.143]
SFT Epoch 2/2:   2%|▏         | 4/205 [00:08<06:53,  2.06s/it, loss=0.236, sft=0.165, clean=0.167, trig=0.163, accum=4, step=209, kl=0.143]
SFT Epoch 2/2:   2%|▏         | 4/205 [00:10<06:53,  2.06s/it, loss=0.168, sft=0.114, clean=0.120, trig=0.112, accum=4, step=210, kl=0.108]
SFT Epoch 2/2:   2%|▏         | 5/205 [00:10<07:00,  2.10s/it, loss=0.168, sft=0.114, clean=0.120, trig=0.112, accum=4, step=210, kl=0.108]
SFT Epoch 2/2:   2%|▏         | 5/205 [00:12<07:00,  2.10s/it, loss=0.197, sft=0.156, clean=0.161, trig=0.154, accum=4, step=211, kl=0.083]
SFT Epoch 2/2:   3%|▎         | 6/205 [00:12<06:23,  1.93s/it, loss=0.197, sft=0.156, clean=0.161, trig=0.154, accum=4, step=211, kl=0.083]
SFT Epoch 2/2:   3%|▎         | 6/205 [00:14<06:23,  1.93s/it, loss=0.194, sft=0.137, clean=0.142, trig=0.135, accum=4, step=212, kl=0.114]
SFT Epoch 2/2:   3%|▎         | 7/205 [00:14<06:24,  1.94s/it, loss=0.194, sft=0.137, clean=0.142, trig=0.135, accum=4, step=212, kl=0.114]
SFT Epoch 2/2:   3%|▎         | 7/205 [00:16<06:24,  1.94s/it, loss=0.174, sft=0.132, clean=0.137, trig=0.130, accum=4, step=213, kl=0.084]
SFT Epoch 2/2:   4%|▍         | 8/205 [00:16<06:24,  1.95s/it, loss=0.174, sft=0.132, clean=0.137, trig=0.130, accum=4, step=213, kl=0.084]
SFT Epoch 2/2:   4%|▍         | 8/205 [00:18<06:24,  1.95s/it, loss=0.269, sft=0.232, clean=0.238, trig=0.229, accum=4, step=214, kl=0.075]
SFT Epoch 2/2:   4%|▍         | 9/205 [00:18<06:27,  1.98s/it, loss=0.269, sft=0.232, clean=0.238, trig=0.229, accum=4, step=214, kl=0.075]
SFT Epoch 2/2:   4%|▍         | 9/205 [00:19<06:27,  1.98s/it, loss=0.168, sft=0.127, clean=0.131, trig=0.125, accum=4, step=215, kl=0.083]
SFT Epoch 2/2:   5%|▍         | 10/205 [00:19<06:08,  1.89s/it, loss=0.168, sft=0.127, clean=0.131, trig=0.125, accum=4, step=215, kl=0.083]
SFT Epoch 2/2:   5%|▍         | 10/205 [00:21<06:08,  1.89s/it, loss=0.233, sft=0.186, clean=0.201, trig=0.180, accum=4, step=216, kl=0.093]
SFT Epoch 2/2:   5%|▌         | 11/205 [00:21<05:59,  1.85s/it, loss=0.233, sft=0.186, clean=0.201, trig=0.180, accum=4, step=216, kl=0.093]
SFT Epoch 2/2:   5%|▌         | 11/205 [00:24<05:59,  1.85s/it, loss=0.162, sft=0.118, clean=0.127, trig=0.114, accum=4, step=217, kl=0.089]
SFT Epoch 2/2:   6%|▌         | 12/205 [00:24<06:31,  2.03s/it, loss=0.162, sft=0.118, clean=0.127, trig=0.114, accum=4, step=217, kl=0.089]
SFT Epoch 2/2:   6%|▌         | 12/205 [00:26<06:31,  2.03s/it, loss=0.211, sft=0.170, clean=0.179, trig=0.166, accum=4, step=218, kl=0.083]
SFT Epoch 2/2:   6%|▋         | 13/205 [00:26<06:29,  2.03s/it, loss=0.211, sft=0.170, clean=0.179, trig=0.166, accum=4, step=218, kl=0.083]
SFT Epoch 2/2:   6%|▋         | 13/205 [00:27<06:29,  2.03s/it, loss=0.226, sft=0.189, clean=0.198, trig=0.186, accum=4, step=219, kl=0.074]
SFT Epoch 2/2:   7%|▋         | 14/205 [00:27<06:20,  1.99s/it, loss=0.226, sft=0.189, clean=0.198, trig=0.186, accum=4, step=219, kl=0.074]
SFT Epoch 2/2:   7%|▋         | 14/205 [00:29<06:20,  1.99s/it, loss=0.212, sft=0.151, clean=0.159, trig=0.147, accum=4, step=220, kl=0.122]
SFT Epoch 2/2:   7%|▋         | 15/205 [00:29<06:01,  1.90s/it, loss=0.212, sft=0.151, clean=0.159, trig=0.147, accum=4, step=220, kl=0.122]
SFT Epoch 2/2:   7%|▋         | 15/205 [00:31<06:01,  1.90s/it, loss=0.211, sft=0.168, clean=0.180, trig=0.163, accum=4, step=221, kl=0.086]
SFT Epoch 2/2:   8%|▊         | 16/205 [00:31<06:04,  1.93s/it, loss=0.211, sft=0.168, clean=0.180, trig=0.163, accum=4, step=221, kl=0.086]
SFT Epoch 2/2:   8%|▊         | 16/205 [00:33<06:04,  1.93s/it, loss=0.198, sft=0.165, clean=0.176, trig=0.160, accum=4, step=222, kl=0.067]
SFT Epoch 2/2:   8%|▊         | 17/205 [00:33<06:01,  1.92s/it, loss=0.198, sft=0.165, clean=0.176, trig=0.160, accum=4, step=222, kl=0.067]
SFT Epoch 2/2:   8%|▊         | 17/205 [00:35<06:01,  1.92s/it, loss=0.139, sft=0.097, clean=0.104, trig=0.094, accum=4, step=223, kl=0.084]
SFT Epoch 2/2:   9%|▉         | 18/205 [00:35<06:00,  1.93s/it, loss=0.139, sft=0.097, clean=0.104, trig=0.094, accum=4, step=223, kl=0.084]
SFT Epoch 2/2:   9%|▉         | 18/205 [00:37<06:00,  1.93s/it, loss=0.139, sft=0.116, clean=0.127, trig=0.111, accum=4, step=224, kl=0.046]
SFT Epoch 2/2:   9%|▉         | 19/205 [00:37<05:55,  1.91s/it, loss=0.139, sft=0.116, clean=0.127, trig=0.111, accum=4, step=224, kl=0.046]
SFT Epoch 2/2:   9%|▉         | 19/205 [00:39<05:55,  1.91s/it, loss=0.230, sft=0.200, clean=0.231, trig=0.186, accum=4, step=225, kl=0.061]
SFT Epoch 2/2:  10%|▉         | 20/205 [00:39<05:46,  1.87s/it, loss=0.230, sft=0.200, clean=0.231, trig=0.186, accum=4, step=225, kl=0.061]
SFT Epoch 2/2:  10%|▉         | 20/205 [00:41<05:46,  1.87s/it, loss=0.170, sft=0.133, clean=0.159, trig=0.121, accum=4, step=226, kl=0.074]
SFT Epoch 2/2:  10%|█         | 21/205 [00:41<05:58,  1.95s/it, loss=0.170, sft=0.133, clean=0.159, trig=0.121, accum=4, step=226, kl=0.074]
SFT Epoch 2/2:  10%|█         | 21/205 [00:43<05:58,  1.95s/it, loss=0.172, sft=0.148, clean=0.166, trig=0.141, accum=4, step=227, kl=0.048]
SFT Epoch 2/2:  11%|█         | 22/205 [00:43<05:58,  1.96s/it, loss=0.172, sft=0.148, clean=0.166, trig=0.141, accum=4, step=227, kl=0.048]
SFT Epoch 2/2:  11%|█         | 22/205 [00:44<05:58,  1.96s/it, loss=0.126, sft=0.089, clean=0.113, trig=0.079, accum=4, step=228, kl=0.073]
SFT Epoch 2/2:  11%|█         | 23/205 [00:44<05:39,  1.87s/it, loss=0.126, sft=0.089, clean=0.113, trig=0.079, accum=4, step=228, kl=0.073]
SFT Epoch 2/2:  11%|█         | 23/205 [00:46<05:39,  1.87s/it, loss=0.303, sft=0.274, clean=0.298, trig=0.263, accum=4, step=229, kl=0.059]
SFT Epoch 2/2:  12%|█▏        | 24/205 [00:46<05:38,  1.87s/it, loss=0.303, sft=0.274, clean=0.298, trig=0.263, accum=4, step=229, kl=0.059]
SFT Epoch 2/2:  12%|█▏        | 24/205 [00:48<05:38,  1.87s/it, loss=0.157, sft=0.123, clean=0.170, trig=0.103, accum=4, step=230, kl=0.069]
SFT Epoch 2/2:  12%|█▏        | 25/205 [00:48<05:37,  1.87s/it, loss=0.157, sft=0.123, clean=0.170, trig=0.103, accum=4, step=230, kl=0.069]
SFT Epoch 2/2:  12%|█▏        | 25/205 [00:51<05:37,  1.87s/it, loss=0.179, sft=0.133, clean=0.163, trig=0.120, accum=4, step=231, kl=0.092]
SFT Epoch 2/2:  13%|█▎        | 26/205 [00:51<06:01,  2.02s/it, loss=0.179, sft=0.133, clean=0.163, trig=0.120, accum=4, step=231, kl=0.092]
SFT Epoch 2/2:  13%|█▎        | 26/205 [00:53<06:01,  2.02s/it, loss=0.149, sft=0.113, clean=0.132, trig=0.104, accum=4, step=232, kl=0.072]
SFT Epoch 2/2:  13%|█▎        | 27/205 [00:53<06:04,  2.05s/it, loss=0.149, sft=0.113, clean=0.132, trig=0.104, accum=4, step=232, kl=0.072]
SFT Epoch 2/2:  13%|█▎        | 27/205 [00:55<06:04,  2.05s/it, loss=0.151, sft=0.135, clean=0.150, trig=0.129, accum=4, step=233, kl=0.030]
SFT Epoch 2/2:  14%|█▎        | 28/205 [00:55<06:13,  2.11s/it, loss=0.151, sft=0.135, clean=0.150, trig=0.129, accum=4, step=233, kl=0.030]
SFT Epoch 2/2:  14%|█▎        | 28/205 [00:57<06:13,  2.11s/it, loss=0.172, sft=0.142, clean=0.173, trig=0.129, accum=4, step=234, kl=0.059]
SFT Epoch 2/2:  14%|█▍        | 29/205 [00:57<05:55,  2.02s/it, loss=0.172, sft=0.142, clean=0.173, trig=0.129, accum=4, step=234, kl=0.059]
SFT Epoch 2/2:  14%|█▍        | 29/205 [00:59<05:55,  2.02s/it, loss=0.207, sft=0.176, clean=0.197, trig=0.167, accum=4, step=235, kl=0.063]
SFT Epoch 2/2:  15%|█▍        | 30/205 [00:59<05:42,  1.95s/it, loss=0.207, sft=0.176, clean=0.197, trig=0.167, accum=4, step=235, kl=0.063]
SFT Epoch 2/2:  15%|█▍        | 30/205 [01:00<05:42,  1.95s/it, loss=0.068, sft=0.056, clean=0.084, trig=0.044, accum=4, step=236, kl=0.024]
SFT Epoch 2/2:  15%|█▌        | 31/205 [01:00<05:39,  1.95s/it, loss=0.068, sft=0.056, clean=0.084, trig=0.044, accum=4, step=236, kl=0.024]
SFT Epoch 2/2:  15%|█▌        | 31/205 [01:02<05:39,  1.95s/it, loss=0.165, sft=0.137, clean=0.197, trig=0.112, accum=4, step=237, kl=0.056]
SFT Epoch 2/2:  16%|█▌        | 32/205 [01:02<05:31,  1.91s/it, loss=0.165, sft=0.137, clean=0.197, trig=0.112, accum=4, step=237, kl=0.056]
SFT Epoch 2/2:  16%|█▌        | 32/205 [01:04<05:31,  1.91s/it, loss=0.187, sft=0.156, clean=0.192, trig=0.140, accum=4, step=238, kl=0.062]
SFT Epoch 2/2:  16%|█▌        | 33/205 [01:04<05:41,  1.98s/it, loss=0.187, sft=0.156, clean=0.192, trig=0.140, accum=4, step=238, kl=0.062]
SFT Epoch 2/2:  16%|█▌        | 33/205 [01:06<05:41,  1.98s/it, loss=0.163, sft=0.136, clean=0.182, trig=0.117, accum=4, step=239, kl=0.054]
SFT Epoch 2/2:  17%|█▋        | 34/205 [01:06<05:30,  1.93s/it, loss=0.163, sft=0.136, clean=0.182, trig=0.117, accum=4, step=239, kl=0.054]
SFT Epoch 2/2:  17%|█▋        | 34/205 [01:08<05:30,  1.93s/it, loss=0.242, sft=0.213, clean=0.193, trig=0.222, accum=4, step=240, kl=0.057]
SFT Epoch 2/2:  17%|█▋        | 35/205 [01:08<05:22,  1.89s/it, loss=0.242, sft=0.213, clean=0.193, trig=0.222, accum=4, step=240, kl=0.057]
SFT Epoch 2/2:  17%|█▋        | 35/205 [01:10<05:22,  1.89s/it, loss=0.172, sft=0.135, clean=0.158, trig=0.126, accum=4, step=241, kl=0.074]
SFT Epoch 2/2:  18%|█▊        | 36/205 [01:10<05:14,  1.86s/it, loss=0.172, sft=0.135, clean=0.158, trig=0.126, accum=4, step=241, kl=0.074]
SFT Epoch 2/2:  18%|█▊        | 36/205 [01:11<05:14,  1.86s/it, loss=0.153, sft=0.135, clean=0.163, trig=0.123, accum=4, step=242, kl=0.035]
SFT Epoch 2/2:  18%|█▊        | 37/205 [01:11<05:01,  1.80s/it, loss=0.153, sft=0.135, clean=0.163, trig=0.123, accum=4, step=242, kl=0.035]
SFT Epoch 2/2:  18%|█▊        | 37/205 [01:13<05:01,  1.80s/it, loss=0.173, sft=0.151, clean=0.195, trig=0.132, accum=4, step=243, kl=0.045]
SFT Epoch 2/2:  19%|█▊        | 38/205 [01:13<05:08,  1.85s/it, loss=0.173, sft=0.151, clean=0.195, trig=0.132, accum=4, step=243, kl=0.045]
SFT Epoch 2/2:  19%|█▊        | 38/205 [01:16<05:08,  1.85s/it, loss=0.102, sft=0.078, clean=0.129, trig=0.056, accum=4, step=244, kl=0.048]
SFT Epoch 2/2:  19%|█▉        | 39/205 [01:16<05:26,  1.97s/it, loss=0.102, sft=0.078, clean=0.129, trig=0.056, accum=4, step=244, kl=0.048]
SFT Epoch 2/2:  19%|█▉        | 39/205 [01:18<05:26,  1.97s/it, loss=0.178, sft=0.145, clean=0.171, trig=0.134, accum=4, step=245, kl=0.067]
SFT Epoch 2/2:  20%|█▉        | 40/205 [01:18<05:32,  2.02s/it, loss=0.178, sft=0.145, clean=0.171, trig=0.134, accum=4, step=245, kl=0.067]
SFT Epoch 2/2:  20%|█▉        | 40/205 [01:20<05:32,  2.02s/it, loss=0.127, sft=0.095, clean=0.113, trig=0.088, accum=4, step=246, kl=0.063]
SFT Epoch 2/2:  20%|██        | 41/205 [01:20<05:45,  2.11s/it, loss=0.127, sft=0.095, clean=0.113, trig=0.088, accum=4, step=246, kl=0.063]
SFT Epoch 2/2:  20%|██        | 41/205 [01:22<05:45,  2.11s/it, loss=0.180, sft=0.149, clean=0.201, trig=0.126, accum=4, step=247, kl=0.063]
SFT Epoch 2/2:  20%|██        | 42/205 [01:22<05:45,  2.12s/it, loss=0.180, sft=0.149, clean=0.201, trig=0.126, accum=4, step=247, kl=0.063]
SFT Epoch 2/2:  20%|██        | 42/205 [01:24<05:45,  2.12s/it, loss=0.148, sft=0.107, clean=0.162, trig=0.084, accum=4, step=248, kl=0.081]
SFT Epoch 2/2:  21%|██        | 43/205 [01:24<05:28,  2.03s/it, loss=0.148, sft=0.107, clean=0.162, trig=0.084, accum=4, step=248, kl=0.081]
SFT Epoch 2/2:  21%|██        | 43/205 [01:26<05:28,  2.03s/it, loss=0.217, sft=0.196, clean=0.249, trig=0.173, accum=4, step=249, kl=0.042]
SFT Epoch 2/2:  21%|██▏       | 44/205 [01:26<05:26,  2.03s/it, loss=0.217, sft=0.196, clean=0.249, trig=0.173, accum=4, step=249, kl=0.042]
SFT Epoch 2/2:  21%|██▏       | 44/205 [01:28<05:26,  2.03s/it, loss=0.148, sft=0.121, clean=0.170, trig=0.100, accum=4, step=250, kl=0.053]
SFT Epoch 2/2:  22%|██▏       | 45/205 [01:28<05:16,  1.98s/it, loss=0.148, sft=0.121, clean=0.170, trig=0.100, accum=4, step=250, kl=0.053]
SFT Epoch 2/2:  22%|██▏       | 45/205 [01:30<05:16,  1.98s/it, loss=0.144, sft=0.091, clean=0.146, trig=0.068, accum=4, step=251, kl=0.105]
SFT Epoch 2/2:  22%|██▏       | 46/205 [01:30<05:25,  2.05s/it, loss=0.144, sft=0.091, clean=0.146, trig=0.068, accum=4, step=251, kl=0.105]
SFT Epoch 2/2:  22%|██▏       | 46/205 [01:32<05:25,  2.05s/it, loss=0.147, sft=0.116, clean=0.156, trig=0.098, accum=4, step=252, kl=0.062]
SFT Epoch 2/2:  23%|██▎       | 47/205 [01:32<05:18,  2.01s/it, loss=0.147, sft=0.116, clean=0.156, trig=0.098, accum=4, step=252, kl=0.062]
SFT Epoch 2/2:  23%|██▎       | 47/205 [01:34<05:18,  2.01s/it, loss=0.095, sft=0.078, clean=0.101, trig=0.067, accum=4, step=253, kl=0.035]
SFT Epoch 2/2:  23%|██▎       | 48/205 [01:34<05:17,  2.03s/it, loss=0.095, sft=0.078, clean=0.101, trig=0.067, accum=4, step=253, kl=0.035]
SFT Epoch 2/2:  23%|██▎       | 48/205 [01:36<05:17,  2.03s/it, loss=0.169, sft=0.122, clean=0.183, trig=0.096, accum=4, step=254, kl=0.093]
SFT Epoch 2/2:  24%|██▍       | 49/205 [01:36<04:56,  1.90s/it, loss=0.169, sft=0.122, clean=0.183, trig=0.096, accum=4, step=254, kl=0.093]
SFT Epoch 2/2:  24%|██▍       | 49/205 [01:38<04:56,  1.90s/it, loss=0.208, sft=0.184, clean=0.253, trig=0.155, accum=4, step=255, kl=0.046]
SFT Epoch 2/2:  24%|██▍       | 50/205 [01:38<05:15,  2.04s/it, loss=0.208, sft=0.184, clean=0.253, trig=0.155, accum=4, step=255, kl=0.046]
SFT Epoch 2/2:  24%|██▍       | 50/205 [01:40<05:15,  2.04s/it, loss=0.137, sft=0.118, clean=0.162, trig=0.099, accum=4, step=256, kl=0.038]
SFT Epoch 2/2:  25%|██▍       | 51/205 [01:40<05:21,  2.09s/it, loss=0.137, sft=0.118, clean=0.162, trig=0.099, accum=4, step=256, kl=0.038]
SFT Epoch 2/2:  25%|██▍       | 51/205 [01:42<05:21,  2.09s/it, loss=0.131, sft=0.121, clean=0.172, trig=0.099, accum=4, step=257, kl=0.021]
SFT Epoch 2/2:  25%|██▌       | 52/205 [01:42<05:08,  2.02s/it, loss=0.131, sft=0.121, clean=0.172, trig=0.099, accum=4, step=257, kl=0.021]
SFT Epoch 2/2:  25%|██▌       | 52/205 [01:44<05:08,  2.02s/it, loss=0.153, sft=0.137, clean=0.177, trig=0.120, accum=4, step=258, kl=0.031]
SFT Epoch 2/2:  26%|██▌       | 53/205 [01:44<04:54,  1.94s/it, loss=0.153, sft=0.137, clean=0.177, trig=0.120, accum=4, step=258, kl=0.031]
SFT Epoch 2/2:  26%|██▌       | 53/205 [01:46<04:54,  1.94s/it, loss=0.217, sft=0.203, clean=0.242, trig=0.186, accum=4, step=259, kl=0.028]
SFT Epoch 2/2:  26%|██▋       | 54/205 [01:46<04:56,  1.97s/it, loss=0.217, sft=0.203, clean=0.242, trig=0.186, accum=4, step=259, kl=0.028]
SFT Epoch 2/2:  26%|██▋       | 54/205 [01:48<04:56,  1.97s/it, loss=0.152, sft=0.133, clean=0.170, trig=0.117, accum=4, step=260, kl=0.038]
SFT Epoch 2/2:  27%|██▋       | 55/205 [01:48<04:51,  1.94s/it, loss=0.152, sft=0.133, clean=0.170, trig=0.117, accum=4, step=260, kl=0.038]
SFT Epoch 2/2:  27%|██▋       | 55/205 [01:50<04:51,  1.94s/it, loss=0.200, sft=0.179, clean=0.255, trig=0.146, accum=4, step=261, kl=0.043]
SFT Epoch 2/2:  27%|██▋       | 56/205 [01:50<04:41,  1.89s/it, loss=0.200, sft=0.179, clean=0.255, trig=0.146, accum=4, step=261, kl=0.043]
SFT Epoch 2/2:  27%|██▋       | 56/205 [01:51<04:41,  1.89s/it, loss=0.150, sft=0.127, clean=0.188, trig=0.101, accum=4, step=262, kl=0.044]
SFT Epoch 2/2:  28%|██▊       | 57/205 [01:51<04:31,  1.84s/it, loss=0.150, sft=0.127, clean=0.188, trig=0.101, accum=4, step=262, kl=0.044]
SFT Epoch 2/2:  28%|██▊       | 57/205 [01:53<04:31,  1.84s/it, loss=0.154, sft=0.135, clean=0.170, trig=0.120, accum=4, step=263, kl=0.039]
SFT Epoch 2/2:  28%|██▊       | 58/205 [01:53<04:32,  1.85s/it, loss=0.154, sft=0.135, clean=0.170, trig=0.120, accum=4, step=263, kl=0.039]
SFT Epoch 2/2:  28%|██▊       | 58/205 [01:55<04:32,  1.85s/it, loss=0.163, sft=0.136, clean=0.190, trig=0.113, accum=4, step=264, kl=0.053]
SFT Epoch 2/2:  29%|██▉       | 59/205 [01:55<04:31,  1.86s/it, loss=0.163, sft=0.136, clean=0.190, trig=0.113, accum=4, step=264, kl=0.053]
SFT Epoch 2/2:  29%|██▉       | 59/205 [01:57<04:31,  1.86s/it, loss=0.160, sft=0.142, clean=0.195, trig=0.119, accum=4, step=265, kl=0.036]
SFT Epoch 2/2:  29%|██▉       | 60/205 [01:57<04:26,  1.84s/it, loss=0.160, sft=0.142, clean=0.195, trig=0.119, accum=4, step=265, kl=0.036]
SFT Epoch 2/2:  29%|██▉       | 60/205 [01:59<04:26,  1.84s/it, loss=0.200, sft=0.169, clean=0.218, trig=0.148, accum=4, step=266, kl=0.062]
SFT Epoch 2/2:  30%|██▉       | 61/205 [01:59<04:30,  1.88s/it, loss=0.200, sft=0.169, clean=0.218, trig=0.148, accum=4, step=266, kl=0.062]
SFT Epoch 2/2:  30%|██▉       | 61/205 [02:01<04:30,  1.88s/it, loss=0.166, sft=0.144, clean=0.178, trig=0.129, accum=4, step=267, kl=0.045]
SFT Epoch 2/2:  30%|███       | 62/205 [02:01<04:31,  1.90s/it, loss=0.166, sft=0.144, clean=0.178, trig=0.129, accum=4, step=267, kl=0.045]
SFT Epoch 2/2:  30%|███       | 62/205 [02:03<04:31,  1.90s/it, loss=0.160, sft=0.129, clean=0.203, trig=0.097, accum=4, step=268, kl=0.061]
SFT Epoch 2/2:  31%|███       | 63/205 [02:03<04:41,  1.98s/it, loss=0.160, sft=0.129, clean=0.203, trig=0.097, accum=4, step=268, kl=0.061]
SFT Epoch 2/2:  31%|███       | 63/205 [02:05<04:41,  1.98s/it, loss=0.113, sft=0.081, clean=0.127, trig=0.062, accum=4, step=269, kl=0.064]
SFT Epoch 2/2:  31%|███       | 64/205 [02:05<04:32,  1.94s/it, loss=0.113, sft=0.081, clean=0.127, trig=0.062, accum=4, step=269, kl=0.064]
SFT Epoch 2/2:  31%|███       | 64/205 [02:07<04:32,  1.94s/it, loss=0.199, sft=0.171, clean=0.216, trig=0.152, accum=4, step=270, kl=0.056]
SFT Epoch 2/2:  32%|███▏      | 65/205 [02:07<04:37,  1.98s/it, loss=0.199, sft=0.171, clean=0.216, trig=0.152, accum=4, step=270, kl=0.056]
SFT Epoch 2/2:  32%|███▏      | 65/205 [02:09<04:37,  1.98s/it, loss=0.111, sft=0.097, clean=0.115, trig=0.089, accum=4, step=271, kl=0.027]
SFT Epoch 2/2:  32%|███▏      | 66/205 [02:09<04:29,  1.94s/it, loss=0.111, sft=0.097, clean=0.115, trig=0.089, accum=4, step=271, kl=0.027]
SFT Epoch 2/2:  32%|███▏      | 66/205 [02:11<04:29,  1.94s/it, loss=0.269, sft=0.249, clean=0.266, trig=0.241, accum=4, step=272, kl=0.041]
SFT Epoch 2/2:  33%|███▎      | 67/205 [02:11<04:20,  1.89s/it, loss=0.269, sft=0.249, clean=0.266, trig=0.241, accum=4, step=272, kl=0.041]
SFT Epoch 2/2:  33%|███▎      | 67/205 [02:12<04:20,  1.89s/it, loss=0.200, sft=0.173, clean=0.215, trig=0.156, accum=4, step=273, kl=0.054]
SFT Epoch 2/2:  33%|███▎      | 68/205 [02:12<04:10,  1.83s/it, loss=0.200, sft=0.173, clean=0.215, trig=0.156, accum=4, step=273, kl=0.054]
SFT Epoch 2/2:  33%|███▎      | 68/205 [02:14<04:10,  1.83s/it, loss=0.156, sft=0.132, clean=0.163, trig=0.118, accum=4, step=274, kl=0.048]
SFT Epoch 2/2:  34%|███▎      | 69/205 [02:14<04:17,  1.89s/it, loss=0.156, sft=0.132, clean=0.163, trig=0.118, accum=4, step=274, kl=0.048]
SFT Epoch 2/2:  34%|███▎      | 69/205 [02:16<04:17,  1.89s/it, loss=0.151, sft=0.136, clean=0.168, trig=0.122, accum=4, step=275, kl=0.030]
SFT Epoch 2/2:  34%|███▍      | 70/205 [02:16<04:11,  1.87s/it, loss=0.151, sft=0.136, clean=0.168, trig=0.122, accum=4, step=275, kl=0.030]
SFT Epoch 2/2:  34%|███▍      | 70/205 [02:18<04:11,  1.87s/it, loss=0.174, sft=0.142, clean=0.176, trig=0.127, accum=4, step=276, kl=0.064]
SFT Epoch 2/2:  35%|███▍      | 71/205 [02:18<04:23,  1.97s/it, loss=0.174, sft=0.142, clean=0.176, trig=0.127, accum=4, step=276, kl=0.064]
SFT Epoch 2/2:  35%|███▍      | 71/205 [02:20<04:23,  1.97s/it, loss=0.160, sft=0.146, clean=0.192, trig=0.126, accum=4, step=277, kl=0.028]
SFT Epoch 2/2:  35%|███▌      | 72/205 [02:20<04:28,  2.02s/it, loss=0.160, sft=0.146, clean=0.192, trig=0.126, accum=4, step=277, kl=0.028]
SFT Epoch 2/2:  35%|███▌      | 72/205 [02:22<04:28,  2.02s/it, loss=0.152, sft=0.131, clean=0.173, trig=0.113, accum=4, step=278, kl=0.041]
SFT Epoch 2/2:  36%|███▌      | 73/205 [02:22<04:22,  1.99s/it, loss=0.152, sft=0.131, clean=0.173, trig=0.113, accum=4, step=278, kl=0.041]
SFT Epoch 2/2:  36%|███▌      | 73/205 [02:24<04:22,  1.99s/it, loss=0.200, sft=0.185, clean=0.225, trig=0.168, accum=4, step=279, kl=0.031]
SFT Epoch 2/2:  36%|███▌      | 74/205 [02:24<04:16,  1.95s/it, loss=0.200, sft=0.185, clean=0.225, trig=0.168, accum=4, step=279, kl=0.031]
SFT Epoch 2/2:  36%|███▌      | 74/205 [02:26<04:16,  1.95s/it, loss=0.143, sft=0.117, clean=0.164, trig=0.096, accum=4, step=280, kl=0.052]
SFT Epoch 2/2:  37%|███▋      | 75/205 [02:26<04:10,  1.93s/it, loss=0.143, sft=0.117, clean=0.164, trig=0.096, accum=4, step=280, kl=0.052]
SFT Epoch 2/2:  37%|███▋      | 75/205 [02:28<04:10,  1.93s/it, loss=0.163, sft=0.125, clean=0.178, trig=0.102, accum=4, step=281, kl=0.076]
SFT Epoch 2/2:  37%|███▋      | 76/205 [02:28<03:59,  1.86s/it, loss=0.163, sft=0.125, clean=0.178, trig=0.102, accum=4, step=281, kl=0.076]
SFT Epoch 2/2:  37%|███▋      | 76/205 [02:30<03:59,  1.86s/it, loss=0.185, sft=0.159, clean=0.208, trig=0.138, accum=4, step=282, kl=0.052]
SFT Epoch 2/2:  38%|███▊      | 77/205 [02:30<04:05,  1.92s/it, loss=0.185, sft=0.159, clean=0.208, trig=0.138, accum=4, step=282, kl=0.052]
SFT Epoch 2/2:  38%|███▊      | 77/205 [02:32<04:05,  1.92s/it, loss=0.202, sft=0.174, clean=0.230, trig=0.149, accum=4, step=283, kl=0.057]
SFT Epoch 2/2:  38%|███▊      | 78/205 [02:32<03:58,  1.88s/it, loss=0.202, sft=0.174, clean=0.230, trig=0.149, accum=4, step=283, kl=0.057]
SFT Epoch 2/2:  38%|███▊      | 78/205 [02:34<03:58,  1.88s/it, loss=0.159, sft=0.127, clean=0.178, trig=0.106, accum=4, step=284, kl=0.063]
SFT Epoch 2/2:  39%|███▊      | 79/205 [02:34<04:11,  2.00s/it, loss=0.159, sft=0.127, clean=0.178, trig=0.106, accum=4, step=284, kl=0.063]
SFT Epoch 2/2:  39%|███▊      | 79/205 [02:36<04:11,  2.00s/it, loss=0.101, sft=0.073, clean=0.110, trig=0.056, accum=4, step=285, kl=0.058]
SFT Epoch 2/2:  39%|███▉      | 80/205 [02:36<04:17,  2.06s/it, loss=0.101, sft=0.073, clean=0.110, trig=0.056, accum=4, step=285, kl=0.058]
SFT Epoch 2/2:  39%|███▉      | 80/205 [02:38<04:17,  2.06s/it, loss=0.115, sft=0.090, clean=0.130, trig=0.074, accum=4, step=286, kl=0.048]
SFT Epoch 2/2:  40%|███▉      | 81/205 [02:38<04:09,  2.02s/it, loss=0.115, sft=0.090, clean=0.130, trig=0.074, accum=4, step=286, kl=0.048]
SFT Epoch 2/2:  40%|███▉      | 81/205 [02:40<04:09,  2.02s/it, loss=0.162, sft=0.141, clean=0.181, trig=0.124, accum=4, step=287, kl=0.042]
SFT Epoch 2/2:  40%|████      | 82/205 [02:40<03:55,  1.92s/it, loss=0.162, sft=0.141, clean=0.181, trig=0.124, accum=4, step=287, kl=0.042]
SFT Epoch 2/2:  40%|████      | 82/205 [02:42<03:55,  1.92s/it, loss=0.169, sft=0.134, clean=0.191, trig=0.109, accum=4, step=288, kl=0.071]
SFT Epoch 2/2:  40%|████      | 83/205 [02:42<03:55,  1.93s/it, loss=0.169, sft=0.134, clean=0.191, trig=0.109, accum=4, step=288, kl=0.071]
SFT Epoch 2/2:  40%|████      | 83/205 [02:43<03:55,  1.93s/it, loss=0.171, sft=0.152, clean=0.185, trig=0.138, accum=4, step=289, kl=0.038]
SFT Epoch 2/2:  41%|████      | 84/205 [02:43<03:48,  1.89s/it, loss=0.171, sft=0.152, clean=0.185, trig=0.138, accum=4, step=289, kl=0.038]
SFT Epoch 2/2:  41%|████      | 84/205 [02:45<03:48,  1.89s/it, loss=0.184, sft=0.147, clean=0.185, trig=0.130, accum=4, step=290, kl=0.074]
SFT Epoch 2/2:  41%|████▏     | 85/205 [02:45<03:41,  1.85s/it, loss=0.184, sft=0.147, clean=0.185, trig=0.130, accum=4, step=290, kl=0.074]
SFT Epoch 2/2:  41%|████▏     | 85/205 [02:47<03:41,  1.85s/it, loss=0.163, sft=0.141, clean=0.163, trig=0.131, accum=4, step=291, kl=0.044]
SFT Epoch 2/2:  42%|████▏     | 86/205 [02:47<03:47,  1.91s/it, loss=0.163, sft=0.141, clean=0.163, trig=0.131, accum=4, step=291, kl=0.044]
SFT Epoch 2/2:  42%|████▏     | 86/205 [02:49<03:47,  1.91s/it, loss=0.135, sft=0.094, clean=0.164, trig=0.064, accum=4, step=292, kl=0.082]
SFT Epoch 2/2:  42%|████▏     | 87/205 [02:49<03:54,  1.99s/it, loss=0.135, sft=0.094, clean=0.164, trig=0.064, accum=4, step=292, kl=0.082]
SFT Epoch 2/2:  42%|████▏     | 87/205 [02:52<03:54,  1.99s/it, loss=0.138, sft=0.118, clean=0.156, trig=0.101, accum=4, step=293, kl=0.041]
SFT Epoch 2/2:  43%|████▎     | 88/205 [02:52<04:04,  2.09s/it, loss=0.138, sft=0.118, clean=0.156, trig=0.101, accum=4, step=293, kl=0.041]
SFT Epoch 2/2:  43%|████▎     | 88/205 [02:53<04:04,  2.09s/it, loss=0.247, sft=0.230, clean=0.259, trig=0.218, accum=4, step=294, kl=0.033]
SFT Epoch 2/2:  43%|████▎     | 89/205 [02:53<03:45,  1.95s/it, loss=0.247, sft=0.230, clean=0.259, trig=0.218, accum=4, step=294, kl=0.033]
SFT Epoch 2/2:  43%|████▎     | 89/205 [02:55<03:45,  1.95s/it, loss=0.198, sft=0.163, clean=0.211, trig=0.142, accum=4, step=295, kl=0.070]
SFT Epoch 2/2:  44%|████▍     | 90/205 [02:55<03:42,  1.93s/it, loss=0.198, sft=0.163, clean=0.211, trig=0.142, accum=4, step=295, kl=0.070]
SFT Epoch 2/2:  44%|████▍     | 90/205 [02:57<03:42,  1.93s/it, loss=0.161, sft=0.145, clean=0.179, trig=0.130, accum=4, step=296, kl=0.032]
SFT Epoch 2/2:  44%|████▍     | 91/205 [02:57<03:41,  1.95s/it, loss=0.161, sft=0.145, clean=0.179, trig=0.130, accum=4, step=296, kl=0.032]
SFT Epoch 2/2:  44%|████▍     | 91/205 [02:59<03:41,  1.95s/it, loss=0.238, sft=0.188, clean=0.235, trig=0.168, accum=4, step=297, kl=0.100]
SFT Epoch 2/2:  45%|████▍     | 92/205 [02:59<03:44,  1.98s/it, loss=0.238, sft=0.188, clean=0.235, trig=0.168, accum=4, step=297, kl=0.100]
SFT Epoch 2/2:  45%|████▍     | 92/205 [03:01<03:44,  1.98s/it, loss=0.144, sft=0.120, clean=0.179, trig=0.095, accum=4, step=298, kl=0.048]
SFT Epoch 2/2:  45%|████▌     | 93/205 [03:01<03:45,  2.02s/it, loss=0.144, sft=0.120, clean=0.179, trig=0.095, accum=4, step=298, kl=0.048]
SFT Epoch 2/2:  45%|████▌     | 93/205 [03:04<03:45,  2.02s/it, loss=0.217, sft=0.199, clean=0.251, trig=0.177, accum=4, step=299, kl=0.037]
SFT Epoch 2/2:  46%|████▌     | 94/205 [03:04<03:59,  2.16s/it, loss=0.217, sft=0.199, clean=0.251, trig=0.177, accum=4, step=299, kl=0.037]
SFT Epoch 2/2:  46%|████▌     | 94/205 [03:06<03:59,  2.16s/it, loss=0.167, sft=0.144, clean=0.197, trig=0.121, accum=4, step=300, kl=0.047]
SFT Epoch 2/2:  46%|████▋     | 95/205 [03:06<03:40,  2.00s/it, loss=0.167, sft=0.144, clean=0.197, trig=0.121, accum=4, step=300, kl=0.047]
SFT Epoch 2/2:  46%|████▋     | 95/205 [03:08<03:40,  2.00s/it, loss=0.158, sft=0.141, clean=0.170, trig=0.129, accum=4, step=301, kl=0.033]
SFT Epoch 2/2:  47%|████▋     | 96/205 [03:08<03:37,  2.00s/it, loss=0.158, sft=0.141, clean=0.170, trig=0.129, accum=4, step=301, kl=0.033]
SFT Epoch 2/2:  47%|████▋     | 96/205 [03:09<03:37,  2.00s/it, loss=0.139, sft=0.098, clean=0.159, trig=0.072, accum=4, step=302, kl=0.081]
SFT Epoch 2/2:  47%|████▋     | 97/205 [03:09<03:28,  1.93s/it, loss=0.139, sft=0.098, clean=0.159, trig=0.072, accum=4, step=302, kl=0.081]
SFT Epoch 2/2:  47%|████▋     | 97/205 [03:11<03:28,  1.93s/it, loss=0.164, sft=0.146, clean=0.188, trig=0.128, accum=4, step=303, kl=0.035]
SFT Epoch 2/2:  48%|████▊     | 98/205 [03:11<03:28,  1.95s/it, loss=0.164, sft=0.146, clean=0.188, trig=0.128, accum=4, step=303, kl=0.035]
SFT Epoch 2/2:  48%|████▊     | 98/205 [03:13<03:28,  1.95s/it, loss=0.129, sft=0.089, clean=0.139, trig=0.067, accum=4, step=304, kl=0.080]
SFT Epoch 2/2:  48%|████▊     | 99/205 [03:13<03:28,  1.96s/it, loss=0.129, sft=0.089, clean=0.139, trig=0.067, accum=4, step=304, kl=0.080]
SFT Epoch 2/2:  48%|████▊     | 99/205 [03:15<03:28,  1.96s/it, loss=0.145, sft=0.122, clean=0.123, trig=0.122, accum=4, step=305, kl=0.046]
SFT Epoch 2/2:  49%|████▉     | 100/205 [03:15<03:31,  2.02s/it, loss=0.145, sft=0.122, clean=0.123, trig=0.122, accum=4, step=305, kl=0.046]
SFT Epoch 2/2:  49%|████▉     | 100/205 [03:17<03:31,  2.02s/it, loss=0.136, sft=0.103, clean=0.145, trig=0.086, accum=4, step=306, kl=0.065]
SFT Epoch 2/2:  49%|████▉     | 101/205 [03:17<03:22,  1.95s/it, loss=0.136, sft=0.103, clean=0.145, trig=0.086, accum=4, step=306, kl=0.065]
SFT Epoch 2/2:  49%|████▉     | 101/205 [03:19<03:22,  1.95s/it, loss=0.210, sft=0.192, clean=0.243, trig=0.170, accum=4, step=307, kl=0.036]
SFT Epoch 2/2:  50%|████▉     | 102/205 [03:19<03:15,  1.90s/it, loss=0.210, sft=0.192, clean=0.243, trig=0.170, accum=4, step=307, kl=0.036]
SFT Epoch 2/2:  50%|████▉     | 102/205 [03:21<03:15,  1.90s/it, loss=0.154, sft=0.127, clean=0.176, trig=0.106, accum=4, step=308, kl=0.055]
SFT Epoch 2/2:  50%|█████     | 103/205 [03:21<03:19,  1.96s/it, loss=0.154, sft=0.127, clean=0.176, trig=0.106, accum=4, step=308, kl=0.055]
SFT Epoch 2/2:  50%|█████     | 103/205 [03:23<03:19,  1.96s/it, loss=0.151, sft=0.126, clean=0.176, trig=0.105, accum=4, step=309, kl=0.050]
SFT Epoch 2/2:  51%|█████     | 104/205 [03:23<03:22,  2.00s/it, loss=0.151, sft=0.126, clean=0.176, trig=0.105, accum=4, step=309, kl=0.050]
SFT Epoch 2/2:  51%|█████     | 104/205 [03:25<03:22,  2.00s/it, loss=0.222, sft=0.192, clean=0.242, trig=0.170, accum=4, step=310, kl=0.060]
SFT Epoch 2/2:  51%|█████     | 105/205 [03:25<03:17,  1.98s/it, loss=0.222, sft=0.192, clean=0.242, trig=0.170, accum=4, step=310, kl=0.060]
SFT Epoch 2/2:  51%|█████     | 105/205 [03:27<03:17,  1.98s/it, loss=0.188, sft=0.160, clean=0.230, trig=0.130, accum=4, step=311, kl=0.055]
SFT Epoch 2/2:  52%|█████▏    | 106/205 [03:27<03:10,  1.93s/it, loss=0.188, sft=0.160, clean=0.230, trig=0.130, accum=4, step=311, kl=0.055]
SFT Epoch 2/2:  52%|█████▏    | 106/205 [03:29<03:10,  1.93s/it, loss=0.149, sft=0.123, clean=0.169, trig=0.103, accum=4, step=312, kl=0.052]
SFT Epoch 2/2:  52%|█████▏    | 107/205 [03:29<03:10,  1.94s/it, loss=0.149, sft=0.123, clean=0.169, trig=0.103, accum=4, step=312, kl=0.052]
SFT Epoch 2/2:  52%|█████▏    | 107/205 [03:31<03:10,  1.94s/it, loss=0.158, sft=0.133, clean=0.184, trig=0.112, accum=4, step=313, kl=0.050]
SFT Epoch 2/2:  53%|█████▎    | 108/205 [03:31<03:06,  1.93s/it, loss=0.158, sft=0.133, clean=0.184, trig=0.112, accum=4, step=313, kl=0.050]
SFT Epoch 2/2:  53%|█████▎    | 108/205 [03:33<03:06,  1.93s/it, loss=0.095, sft=0.073, clean=0.102, trig=0.060, accum=4, step=314, kl=0.045]
SFT Epoch 2/2:  53%|█████▎    | 109/205 [03:33<03:11,  2.00s/it, loss=0.095, sft=0.073, clean=0.102, trig=0.060, accum=4, step=314, kl=0.045]
SFT Epoch 2/2:  53%|█████▎    | 109/205 [03:35<03:11,  2.00s/it, loss=0.122, sft=0.085, clean=0.125, trig=0.069, accum=4, step=315, kl=0.073]
SFT Epoch 2/2:  54%|█████▎    | 110/205 [03:35<03:06,  1.97s/it, loss=0.122, sft=0.085, clean=0.125, trig=0.069, accum=4, step=315, kl=0.073]
SFT Epoch 2/2:  54%|█████▎    | 110/205 [03:37<03:06,  1.97s/it, loss=0.116, sft=0.096, clean=0.132, trig=0.080, accum=4, step=316, kl=0.040]
SFT Epoch 2/2:  54%|█████▍    | 111/205 [03:37<03:01,  1.94s/it, loss=0.116, sft=0.096, clean=0.132, trig=0.080, accum=4, step=316, kl=0.040]
SFT Epoch 2/2:  54%|█████▍    | 111/205 [03:39<03:01,  1.94s/it, loss=0.090, sft=0.075, clean=0.119, trig=0.056, accum=4, step=317, kl=0.029]
SFT Epoch 2/2:  55%|█████▍    | 112/205 [03:39<03:00,  1.94s/it, loss=0.090, sft=0.075, clean=0.119, trig=0.056, accum=4, step=317, kl=0.029]
SFT Epoch 2/2:  55%|█████▍    | 112/205 [03:41<03:00,  1.94s/it, loss=0.202, sft=0.184, clean=0.219, trig=0.169, accum=4, step=318, kl=0.036]
SFT Epoch 2/2:  55%|█████▌    | 113/205 [03:41<03:00,  1.96s/it, loss=0.202, sft=0.184, clean=0.219, trig=0.169, accum=4, step=318, kl=0.036]
SFT Epoch 2/2:  55%|█████▌    | 113/205 [03:43<03:00,  1.96s/it, loss=0.146, sft=0.093, clean=0.144, trig=0.071, accum=4, step=319, kl=0.106]
SFT Epoch 2/2:  56%|█████▌    | 114/205 [03:43<02:56,  1.94s/it, loss=0.146, sft=0.093, clean=0.144, trig=0.071, accum=4, step=319, kl=0.106]
SFT Epoch 2/2:  56%|█████▌    | 114/205 [03:44<02:56,  1.94s/it, loss=0.207, sft=0.168, clean=0.208, trig=0.151, accum=4, step=320, kl=0.078]
SFT Epoch 2/2:  56%|█████▌    | 115/205 [03:44<02:53,  1.93s/it, loss=0.207, sft=0.168, clean=0.208, trig=0.151, accum=4, step=320, kl=0.078]
SFT Epoch 2/2:  56%|█████▌    | 115/205 [03:46<02:53,  1.93s/it, loss=0.203, sft=0.173, clean=0.213, trig=0.155, accum=4, step=321, kl=0.061]
SFT Epoch 2/2:  57%|█████▋    | 116/205 [03:46<02:53,  1.95s/it, loss=0.203, sft=0.173, clean=0.213, trig=0.155, accum=4, step=321, kl=0.061]
SFT Epoch 2/2:  57%|█████▋    | 116/205 [03:48<02:53,  1.95s/it, loss=0.159, sft=0.140, clean=0.206, trig=0.111, accum=4, step=322, kl=0.038]
SFT Epoch 2/2:  57%|█████▋    | 117/205 [03:48<02:48,  1.91s/it, loss=0.159, sft=0.140, clean=0.206, trig=0.111, accum=4, step=322, kl=0.038]
SFT Epoch 2/2:  57%|█████▋    | 117/205 [03:50<02:48,  1.91s/it, loss=0.209, sft=0.193, clean=0.244, trig=0.170, accum=4, step=323, kl=0.032]
SFT Epoch 2/2:  58%|█████▊    | 118/205 [03:50<02:47,  1.92s/it, loss=0.209, sft=0.193, clean=0.244, trig=0.170, accum=4, step=323, kl=0.032]
SFT Epoch 2/2:  58%|█████▊    | 118/205 [03:52<02:47,  1.92s/it, loss=0.172, sft=0.149, clean=0.189, trig=0.132, accum=4, step=324, kl=0.046]
SFT Epoch 2/2:  58%|█████▊    | 119/205 [03:52<02:48,  1.96s/it, loss=0.172, sft=0.149, clean=0.189, trig=0.132, accum=4, step=324, kl=0.046]
SFT Epoch 2/2:  58%|█████▊    | 119/205 [03:54<02:48,  1.96s/it, loss=0.162, sft=0.125, clean=0.169, trig=0.106, accum=4, step=325, kl=0.073]
SFT Epoch 2/2:  59%|█████▊    | 120/205 [03:54<02:48,  1.98s/it, loss=0.162, sft=0.125, clean=0.169, trig=0.106, accum=4, step=325, kl=0.073]
SFT Epoch 2/2:  59%|█████▊    | 120/205 [03:57<02:48,  1.98s/it, loss=0.181, sft=0.149, clean=0.210, trig=0.123, accum=4, step=326, kl=0.063]
SFT Epoch 2/2:  59%|█████▉    | 121/205 [03:57<02:51,  2.04s/it, loss=0.181, sft=0.149, clean=0.210, trig=0.123, accum=4, step=326, kl=0.063]
SFT Epoch 2/2:  59%|█████▉    | 121/205 [03:59<02:51,  2.04s/it, loss=0.102, sft=0.083, clean=0.104, trig=0.074, accum=4, step=327, kl=0.039]
SFT Epoch 2/2:  60%|█████▉    | 122/205 [03:59<02:58,  2.15s/it, loss=0.102, sft=0.083, clean=0.104, trig=0.074, accum=4, step=327, kl=0.039]
SFT Epoch 2/2:  60%|█████▉    | 122/205 [04:01<02:58,  2.15s/it, loss=0.171, sft=0.153, clean=0.202, trig=0.132, accum=4, step=328, kl=0.036]
SFT Epoch 2/2:  60%|██████    | 123/205 [04:01<03:02,  2.23s/it, loss=0.171, sft=0.153, clean=0.202, trig=0.132, accum=4, step=328, kl=0.036]
SFT Epoch 2/2:  60%|██████    | 123/205 [04:03<03:02,  2.23s/it, loss=0.153, sft=0.111, clean=0.163, trig=0.088, accum=4, step=329, kl=0.085]
SFT Epoch 2/2:  60%|██████    | 124/205 [04:03<02:53,  2.14s/it, loss=0.153, sft=0.111, clean=0.163, trig=0.088, accum=4, step=329, kl=0.085]
SFT Epoch 2/2:  60%|██████    | 124/205 [04:05<02:53,  2.14s/it, loss=0.194, sft=0.148, clean=0.204, trig=0.124, accum=4, step=330, kl=0.091]
SFT Epoch 2/2:  61%|██████    | 125/205 [04:05<02:45,  2.07s/it, loss=0.194, sft=0.148, clean=0.204, trig=0.124, accum=4, step=330, kl=0.091]
SFT Epoch 2/2:  61%|██████    | 125/205 [04:07<02:45,  2.07s/it, loss=0.229, sft=0.210, clean=0.276, trig=0.181, accum=4, step=331, kl=0.039]
SFT Epoch 2/2:  61%|██████▏   | 126/205 [04:07<02:37,  2.00s/it, loss=0.229, sft=0.210, clean=0.276, trig=0.181, accum=4, step=331, kl=0.039]
SFT Epoch 2/2:  61%|██████▏   | 126/205 [04:09<02:37,  2.00s/it, loss=0.122, sft=0.092, clean=0.152, trig=0.066, accum=4, step=332, kl=0.061]
SFT Epoch 2/2:  62%|██████▏   | 127/205 [04:09<02:40,  2.05s/it, loss=0.122, sft=0.092, clean=0.152, trig=0.066, accum=4, step=332, kl=0.061]
SFT Epoch 2/2:  62%|██████▏   | 127/205 [04:11<02:40,  2.05s/it, loss=0.151, sft=0.121, clean=0.160, trig=0.104, accum=4, step=333, kl=0.062]
SFT Epoch 2/2:  62%|██████▏   | 128/205 [04:11<02:34,  2.00s/it, loss=0.151, sft=0.121, clean=0.160, trig=0.104, accum=4, step=333, kl=0.062]
SFT Epoch 2/2:  62%|██████▏   | 128/205 [04:13<02:34,  2.00s/it, loss=0.146, sft=0.120, clean=0.171, trig=0.099, accum=4, step=334, kl=0.051]
SFT Epoch 2/2:  63%|██████▎   | 129/205 [04:13<02:28,  1.95s/it, loss=0.146, sft=0.120, clean=0.171, trig=0.099, accum=4, step=334, kl=0.051]
SFT Epoch 2/2:  63%|██████▎   | 129/205 [04:15<02:28,  1.95s/it, loss=0.152, sft=0.134, clean=0.183, trig=0.113, accum=4, step=335, kl=0.036]
SFT Epoch 2/2:  63%|██████▎   | 130/205 [04:15<02:34,  2.07s/it, loss=0.152, sft=0.134, clean=0.183, trig=0.113, accum=4, step=335, kl=0.036]
SFT Epoch 2/2:  63%|██████▎   | 130/205 [04:17<02:34,  2.07s/it, loss=0.151, sft=0.136, clean=0.182, trig=0.116, accum=4, step=336, kl=0.029]
SFT Epoch 2/2:  64%|██████▍   | 131/205 [04:17<02:25,  1.97s/it, loss=0.151, sft=0.136, clean=0.182, trig=0.116, accum=4, step=336, kl=0.029]
SFT Epoch 2/2:  64%|██████▍   | 131/205 [04:19<02:25,  1.97s/it, loss=0.210, sft=0.193, clean=0.241, trig=0.173, accum=4, step=337, kl=0.033]
SFT Epoch 2/2:  64%|██████▍   | 132/205 [04:19<02:22,  1.95s/it, loss=0.210, sft=0.193, clean=0.241, trig=0.173, accum=4, step=337, kl=0.033]
SFT Epoch 2/2:  64%|██████▍   | 132/205 [04:21<02:22,  1.95s/it, loss=0.178, sft=0.151, clean=0.202, trig=0.129, accum=4, step=338, kl=0.054]
SFT Epoch 2/2:  65%|██████▍   | 133/205 [04:21<02:15,  1.89s/it, loss=0.178, sft=0.151, clean=0.202, trig=0.129, accum=4, step=338, kl=0.054]
SFT Epoch 2/2:  65%|██████▍   | 133/205 [04:23<02:15,  1.89s/it, loss=0.131, sft=0.102, clean=0.144, trig=0.084, accum=4, step=339, kl=0.058]
SFT Epoch 2/2:  65%|██████▌   | 134/205 [04:23<02:16,  1.93s/it, loss=0.131, sft=0.102, clean=0.144, trig=0.084, accum=4, step=339, kl=0.058]
SFT Epoch 2/2:  65%|██████▌   | 134/205 [04:24<02:16,  1.93s/it, loss=0.154, sft=0.107, clean=0.152, trig=0.088, accum=4, step=340, kl=0.093]
SFT Epoch 2/2:  66%|██████▌   | 135/205 [04:24<02:13,  1.90s/it, loss=0.154, sft=0.107, clean=0.152, trig=0.088, accum=4, step=340, kl=0.093]
SFT Epoch 2/2:  66%|██████▌   | 135/205 [04:26<02:13,  1.90s/it, loss=0.128, sft=0.100, clean=0.147, trig=0.080, accum=4, step=341, kl=0.056]
SFT Epoch 2/2:  66%|██████▋   | 136/205 [04:26<02:09,  1.88s/it, loss=0.128, sft=0.100, clean=0.147, trig=0.080, accum=4, step=341, kl=0.056]
SFT Epoch 2/2:  66%|██████▋   | 136/205 [04:28<02:09,  1.88s/it, loss=0.242, sft=0.202, clean=0.245, trig=0.184, accum=4, step=342, kl=0.079]
SFT Epoch 2/2:  67%|██████▋   | 137/205 [04:28<02:03,  1.81s/it, loss=0.242, sft=0.202, clean=0.245, trig=0.184, accum=4, step=342, kl=0.079]
SFT Epoch 2/2:  67%|██████▋   | 137/205 [04:30<02:03,  1.81s/it, loss=0.182, sft=0.143, clean=0.203, trig=0.118, accum=4, step=343, kl=0.078]
SFT Epoch 2/2:  67%|██████▋   | 138/205 [04:30<02:01,  1.82s/it, loss=0.182, sft=0.143, clean=0.203, trig=0.118, accum=4, step=343, kl=0.078]
SFT Epoch 2/2:  67%|██████▋   | 138/205 [04:32<02:01,  1.82s/it, loss=0.147, sft=0.107, clean=0.149, trig=0.089, accum=4, step=344, kl=0.079]
SFT Epoch 2/2:  68%|██████▊   | 139/205 [04:32<02:05,  1.90s/it, loss=0.147, sft=0.107, clean=0.149, trig=0.089, accum=4, step=344, kl=0.079]
SFT Epoch 2/2:  68%|██████▊   | 139/205 [04:34<02:05,  1.90s/it, loss=0.167, sft=0.148, clean=0.191, trig=0.129, accum=4, step=345, kl=0.039]
SFT Epoch 2/2:  68%|██████▊   | 140/205 [04:34<02:01,  1.87s/it, loss=0.167, sft=0.148, clean=0.191, trig=0.129, accum=4, step=345, kl=0.039]
SFT Epoch 2/2:  68%|██████▊   | 140/205 [04:36<02:01,  1.87s/it, loss=0.114, sft=0.097, clean=0.142, trig=0.078, accum=4, step=346, kl=0.034]
SFT Epoch 2/2:  69%|██████▉   | 141/205 [04:36<02:02,  1.91s/it, loss=0.114, sft=0.097, clean=0.142, trig=0.078, accum=4, step=346, kl=0.034]
SFT Epoch 2/2:  69%|██████▉   | 141/205 [04:38<02:02,  1.91s/it, loss=0.174, sft=0.157, clean=0.209, trig=0.135, accum=4, step=347, kl=0.034]
SFT Epoch 2/2:  69%|██████▉   | 142/205 [04:38<02:01,  1.93s/it, loss=0.174, sft=0.157, clean=0.209, trig=0.135, accum=4, step=347, kl=0.034]
SFT Epoch 2/2:  69%|██████▉   | 142/205 [04:40<02:01,  1.93s/it, loss=0.188, sft=0.164, clean=0.206, trig=0.146, accum=4, step=348, kl=0.049]
SFT Epoch 2/2:  70%|██████▉   | 143/205 [04:40<02:06,  2.05s/it, loss=0.188, sft=0.164, clean=0.206, trig=0.146, accum=4, step=348, kl=0.049]
SFT Epoch 2/2:  70%|██████▉   | 143/205 [04:42<02:06,  2.05s/it, loss=0.167, sft=0.144, clean=0.179, trig=0.129, accum=4, step=349, kl=0.045]
SFT Epoch 2/2:  70%|███████   | 144/205 [04:42<02:01,  1.99s/it, loss=0.167, sft=0.144, clean=0.179, trig=0.129, accum=4, step=349, kl=0.045]
SFT Epoch 2/2:  70%|███████   | 144/205 [04:44<02:01,  1.99s/it, loss=0.093, sft=0.078, clean=0.119, trig=0.060, accum=4, step=350, kl=0.030]
SFT Epoch 2/2:  71%|███████   | 145/205 [04:44<01:58,  1.98s/it, loss=0.093, sft=0.078, clean=0.119, trig=0.060, accum=4, step=350, kl=0.030]
SFT Epoch 2/2:  71%|███████   | 145/205 [04:46<01:58,  1.98s/it, loss=0.140, sft=0.121, clean=0.163, trig=0.103, accum=4, step=351, kl=0.039]
SFT Epoch 2/2:  71%|███████   | 146/205 [04:46<01:54,  1.94s/it, loss=0.140, sft=0.121, clean=0.163, trig=0.103, accum=4, step=351, kl=0.039]
SFT Epoch 2/2:  71%|███████   | 146/205 [04:48<01:54,  1.94s/it, loss=0.166, sft=0.135, clean=0.188, trig=0.112, accum=4, step=352, kl=0.062]
SFT Epoch 2/2:  72%|███████▏  | 147/205 [04:48<01:57,  2.02s/it, loss=0.166, sft=0.135, clean=0.188, trig=0.112, accum=4, step=352, kl=0.062]
SFT Epoch 2/2:  72%|███████▏  | 147/205 [04:50<01:57,  2.02s/it, loss=0.193, sft=0.161, clean=0.208, trig=0.141, accum=4, step=353, kl=0.064]
SFT Epoch 2/2:  72%|███████▏  | 148/205 [04:50<01:55,  2.02s/it, loss=0.193, sft=0.161, clean=0.208, trig=0.141, accum=4, step=353, kl=0.064]
SFT Epoch 2/2:  72%|███████▏  | 148/205 [04:52<01:55,  2.02s/it, loss=0.156, sft=0.115, clean=0.151, trig=0.099, accum=4, step=354, kl=0.082]
SFT Epoch 2/2:  73%|███████▎  | 149/205 [04:52<01:53,  2.03s/it, loss=0.156, sft=0.115, clean=0.151, trig=0.099, accum=4, step=354, kl=0.082]
SFT Epoch 2/2:  73%|███████▎  | 149/205 [04:54<01:53,  2.03s/it, loss=0.067, sft=0.052, clean=0.082, trig=0.040, accum=4, step=355, kl=0.030]
SFT Epoch 2/2:  73%|███████▎  | 150/205 [04:54<01:53,  2.07s/it, loss=0.067, sft=0.052, clean=0.082, trig=0.040, accum=4, step=355, kl=0.030]
SFT Epoch 2/2:  73%|███████▎  | 150/205 [04:56<01:53,  2.07s/it, loss=0.082, sft=0.065, clean=0.106, trig=0.048, accum=4, step=356, kl=0.034]
SFT Epoch 2/2:  74%|███████▎  | 151/205 [04:56<01:45,  1.96s/it, loss=0.082, sft=0.065, clean=0.106, trig=0.048, accum=4, step=356, kl=0.034]
SFT Epoch 2/2:  74%|███████▎  | 151/205 [04:58<01:45,  1.96s/it, loss=0.102, sft=0.092, clean=0.122, trig=0.079, accum=4, step=357, kl=0.021]
SFT Epoch 2/2:  74%|███████▍  | 152/205 [04:58<01:48,  2.05s/it, loss=0.102, sft=0.092, clean=0.122, trig=0.079, accum=4, step=357, kl=0.021]
SFT Epoch 2/2:  74%|███████▍  | 152/205 [05:00<01:48,  2.05s/it, loss=0.125, sft=0.109, clean=0.161, trig=0.086, accum=4, step=358, kl=0.033]
SFT Epoch 2/2:  75%|███████▍  | 153/205 [05:00<01:43,  1.98s/it, loss=0.125, sft=0.109, clean=0.161, trig=0.086, accum=4, step=358, kl=0.033]
SFT Epoch 2/2:  75%|███████▍  | 153/205 [05:02<01:43,  1.98s/it, loss=0.220, sft=0.200, clean=0.215, trig=0.193, accum=4, step=359, kl=0.040]
SFT Epoch 2/2:  75%|███████▌  | 154/205 [05:02<01:37,  1.91s/it, loss=0.220, sft=0.200, clean=0.215, trig=0.193, accum=4, step=359, kl=0.040]
SFT Epoch 2/2:  75%|███████▌  | 154/205 [05:03<01:37,  1.91s/it, loss=0.153, sft=0.138, clean=0.153, trig=0.131, accum=4, step=360, kl=0.031]
SFT Epoch 2/2:  76%|███████▌  | 155/205 [05:03<01:34,  1.89s/it, loss=0.153, sft=0.138, clean=0.153, trig=0.131, accum=4, step=360, kl=0.031]
SFT Epoch 2/2:  76%|███████▌  | 155/205 [05:05<01:34,  1.89s/it, loss=0.131, sft=0.102, clean=0.126, trig=0.092, accum=4, step=361, kl=0.059]
SFT Epoch 2/2:  76%|███████▌  | 156/205 [05:05<01:33,  1.91s/it, loss=0.131, sft=0.102, clean=0.126, trig=0.092, accum=4, step=361, kl=0.059]
SFT Epoch 2/2:  76%|███████▌  | 156/205 [05:07<01:33,  1.91s/it, loss=0.133, sft=0.107, clean=0.141, trig=0.092, accum=4, step=362, kl=0.052]
SFT Epoch 2/2:  77%|███████▋  | 157/205 [05:07<01:32,  1.93s/it, loss=0.133, sft=0.107, clean=0.141, trig=0.092, accum=4, step=362, kl=0.052]
SFT Epoch 2/2:  77%|███████▋  | 157/205 [05:10<01:32,  1.93s/it, loss=0.139, sft=0.105, clean=0.149, trig=0.087, accum=4, step=363, kl=0.067]
SFT Epoch 2/2:  77%|███████▋  | 158/205 [05:10<01:36,  2.04s/it, loss=0.139, sft=0.105, clean=0.149, trig=0.087, accum=4, step=363, kl=0.067]
SFT Epoch 2/2:  77%|███████▋  | 158/205 [05:11<01:36,  2.04s/it, loss=0.116, sft=0.101, clean=0.150, trig=0.080, accum=4, step=364, kl=0.030]
SFT Epoch 2/2:  78%|███████▊  | 159/205 [05:11<01:29,  1.95s/it, loss=0.116, sft=0.101, clean=0.150, trig=0.080, accum=4, step=364, kl=0.030]
SFT Epoch 2/2:  78%|███████▊  | 159/205 [05:13<01:29,  1.95s/it, loss=0.164, sft=0.141, clean=0.194, trig=0.118, accum=4, step=365, kl=0.047]
SFT Epoch 2/2:  78%|███████▊  | 160/205 [05:13<01:28,  1.97s/it, loss=0.164, sft=0.141, clean=0.194, trig=0.118, accum=4, step=365, kl=0.047]
SFT Epoch 2/2:  78%|███████▊  | 160/205 [05:16<01:28,  1.97s/it, loss=0.153, sft=0.131, clean=0.190, trig=0.106, accum=4, step=366, kl=0.044]
SFT Epoch 2/2:  79%|███████▊  | 161/205 [05:16<01:33,  2.13s/it, loss=0.153, sft=0.131, clean=0.190, trig=0.106, accum=4, step=366, kl=0.044]
SFT Epoch 2/2:  79%|███████▊  | 161/205 [05:18<01:33,  2.13s/it, loss=0.128, sft=0.117, clean=0.147, trig=0.104, accum=4, step=367, kl=0.022]
SFT Epoch 2/2:  79%|███████▉  | 162/205 [05:18<01:34,  2.19s/it, loss=0.128, sft=0.117, clean=0.147, trig=0.104, accum=4, step=367, kl=0.022]
SFT Epoch 2/2:  79%|███████▉  | 162/205 [05:20<01:34,  2.19s/it, loss=0.181, sft=0.165, clean=0.215, trig=0.143, accum=4, step=368, kl=0.033]
SFT Epoch 2/2:  80%|███████▉  | 163/205 [05:20<01:32,  2.20s/it, loss=0.181, sft=0.165, clean=0.215, trig=0.143, accum=4, step=368, kl=0.033]
SFT Epoch 2/2:  80%|███████▉  | 163/205 [05:23<01:32,  2.20s/it, loss=0.132, sft=0.109, clean=0.157, trig=0.089, accum=4, step=369, kl=0.046]
SFT Epoch 2/2:  80%|████████  | 164/205 [05:23<01:31,  2.23s/it, loss=0.132, sft=0.109, clean=0.157, trig=0.089, accum=4, step=369, kl=0.046]
SFT Epoch 2/2:  80%|████████  | 164/205 [05:25<01:31,  2.23s/it, loss=0.173, sft=0.146, clean=0.227, trig=0.112, accum=4, step=370, kl=0.054]
SFT Epoch 2/2:  80%|████████  | 165/205 [05:25<01:30,  2.26s/it, loss=0.173, sft=0.146, clean=0.227, trig=0.112, accum=4, step=370, kl=0.054]
SFT Epoch 2/2:  80%|████████  | 165/205 [05:27<01:30,  2.26s/it, loss=0.185, sft=0.165, clean=0.208, trig=0.147, accum=4, step=371, kl=0.041]
SFT Epoch 2/2:  81%|████████  | 166/205 [05:27<01:26,  2.21s/it, loss=0.185, sft=0.165, clean=0.208, trig=0.147, accum=4, step=371, kl=0.041]
SFT Epoch 2/2:  81%|████████  | 166/205 [05:29<01:26,  2.21s/it, loss=0.243, sft=0.217, clean=0.268, trig=0.195, accum=4, step=372, kl=0.051]
SFT Epoch 2/2:  81%|████████▏ | 167/205 [05:29<01:20,  2.11s/it, loss=0.243, sft=0.217, clean=0.268, trig=0.195, accum=4, step=372, kl=0.051]
SFT Epoch 2/2:  81%|████████▏ | 167/205 [05:31<01:20,  2.11s/it, loss=0.130, sft=0.112, clean=0.164, trig=0.089, accum=4, step=373, kl=0.038]
SFT Epoch 2/2:  82%|████████▏ | 168/205 [05:31<01:19,  2.14s/it, loss=0.130, sft=0.112, clean=0.164, trig=0.089, accum=4, step=373, kl=0.038]
SFT Epoch 2/2:  82%|████████▏ | 168/205 [05:33<01:19,  2.14s/it, loss=0.173, sft=0.153, clean=0.183, trig=0.140, accum=4, step=374, kl=0.040]
SFT Epoch 2/2:  82%|████████▏ | 169/205 [05:33<01:15,  2.09s/it, loss=0.173, sft=0.153, clean=0.183, trig=0.140, accum=4, step=374, kl=0.040]
SFT Epoch 2/2:  82%|████████▏ | 169/205 [05:35<01:15,  2.09s/it, loss=0.131, sft=0.098, clean=0.143, trig=0.079, accum=4, step=375, kl=0.065]
SFT Epoch 2/2:  83%|████████▎ | 170/205 [05:35<01:08,  1.97s/it, loss=0.131, sft=0.098, clean=0.143, trig=0.079, accum=4, step=375, kl=0.065]
SFT Epoch 2/2:  83%|████████▎ | 170/205 [05:37<01:08,  1.97s/it, loss=0.083, sft=0.063, clean=0.112, trig=0.043, accum=4, step=376, kl=0.039]
SFT Epoch 2/2:  83%|████████▎ | 171/205 [05:37<01:05,  1.91s/it, loss=0.083, sft=0.063, clean=0.112, trig=0.043, accum=4, step=376, kl=0.039]
SFT Epoch 2/2:  83%|████████▎ | 171/205 [05:39<01:05,  1.91s/it, loss=0.199, sft=0.183, clean=0.230, trig=0.163, accum=4, step=377, kl=0.032]
SFT Epoch 2/2:  84%|████████▍ | 172/205 [05:39<01:04,  1.96s/it, loss=0.199, sft=0.183, clean=0.230, trig=0.163, accum=4, step=377, kl=0.032]
SFT Epoch 2/2:  84%|████████▍ | 172/205 [05:41<01:04,  1.96s/it, loss=0.121, sft=0.088, clean=0.147, trig=0.063, accum=4, step=378, kl=0.066]
SFT Epoch 2/2:  84%|████████▍ | 173/205 [05:41<01:02,  1.95s/it, loss=0.121, sft=0.088, clean=0.147, trig=0.063, accum=4, step=378, kl=0.066]
SFT Epoch 2/2:  84%|████████▍ | 173/205 [05:43<01:02,  1.95s/it, loss=0.157, sft=0.141, clean=0.185, trig=0.123, accum=4, step=379, kl=0.031]
SFT Epoch 2/2:  85%|████████▍ | 174/205 [05:43<01:00,  1.95s/it, loss=0.157, sft=0.141, clean=0.185, trig=0.123, accum=4, step=379, kl=0.031]
SFT Epoch 2/2:  85%|████████▍ | 174/205 [05:44<01:00,  1.95s/it, loss=0.122, sft=0.104, clean=0.151, trig=0.084, accum=4, step=380, kl=0.035]
SFT Epoch 2/2:  85%|████████▌ | 175/205 [05:44<00:55,  1.85s/it, loss=0.122, sft=0.104, clean=0.151, trig=0.084, accum=4, step=380, kl=0.035]
SFT Epoch 2/2:  85%|████████▌ | 175/205 [05:46<00:55,  1.85s/it, loss=0.179, sft=0.160, clean=0.206, trig=0.140, accum=4, step=381, kl=0.038]
SFT Epoch 2/2:  86%|████████▌ | 176/205 [05:46<00:53,  1.85s/it, loss=0.179, sft=0.160, clean=0.206, trig=0.140, accum=4, step=381, kl=0.038]
SFT Epoch 2/2:  86%|████████▌ | 176/205 [05:48<00:53,  1.85s/it, loss=0.186, sft=0.158, clean=0.190, trig=0.144, accum=4, step=382, kl=0.057]
SFT Epoch 2/2:  86%|████████▋ | 177/205 [05:48<00:55,  1.96s/it, loss=0.186, sft=0.158, clean=0.190, trig=0.144, accum=4, step=382, kl=0.057]
SFT Epoch 2/2:  86%|████████▋ | 177/205 [05:50<00:55,  1.96s/it, loss=0.211, sft=0.176, clean=0.231, trig=0.152, accum=4, step=383, kl=0.071]
SFT Epoch 2/2:  87%|████████▋ | 178/205 [05:50<00:53,  2.00s/it, loss=0.211, sft=0.176, clean=0.231, trig=0.152, accum=4, step=383, kl=0.071]
SFT Epoch 2/2:  87%|████████▋ | 178/205 [05:52<00:53,  2.00s/it, loss=0.156, sft=0.131, clean=0.174, trig=0.113, accum=4, step=384, kl=0.051]
SFT Epoch 2/2:  87%|████████▋ | 179/205 [05:52<00:50,  1.95s/it, loss=0.156, sft=0.131, clean=0.174, trig=0.113, accum=4, step=384, kl=0.051]
SFT Epoch 2/2:  87%|████████▋ | 179/205 [05:55<00:50,  1.95s/it, loss=0.117, sft=0.091, clean=0.122, trig=0.078, accum=4, step=385, kl=0.052]
SFT Epoch 2/2:  88%|████████▊ | 180/205 [05:55<00:50,  2.02s/it, loss=0.117, sft=0.091, clean=0.122, trig=0.078, accum=4, step=385, kl=0.052]
SFT Epoch 2/2:  88%|████████▊ | 180/205 [05:57<00:50,  2.02s/it, loss=0.195, sft=0.155, clean=0.220, trig=0.127, accum=4, step=386, kl=0.080]
SFT Epoch 2/2:  88%|████████▊ | 181/205 [05:57<00:50,  2.09s/it, loss=0.195, sft=0.155, clean=0.220, trig=0.127, accum=4, step=386, kl=0.080]
SFT Epoch 2/2:  88%|████████▊ | 181/205 [05:59<00:50,  2.09s/it, loss=0.139, sft=0.109, clean=0.159, trig=0.087, accum=4, step=387, kl=0.060]
SFT Epoch 2/2:  89%|████████▉ | 182/205 [05:59<00:46,  2.01s/it, loss=0.139, sft=0.109, clean=0.159, trig=0.087, accum=4, step=387, kl=0.060]
SFT Epoch 2/2:  89%|████████▉ | 182/205 [06:00<00:46,  2.01s/it, loss=0.136, sft=0.112, clean=0.179, trig=0.083, accum=4, step=388, kl=0.047]
SFT Epoch 2/2:  89%|████████▉ | 183/205 [06:00<00:42,  1.92s/it, loss=0.136, sft=0.112, clean=0.179, trig=0.083, accum=4, step=388, kl=0.047]
SFT Epoch 2/2:  89%|████████▉ | 183/205 [06:02<00:42,  1.92s/it, loss=0.205, sft=0.186, clean=0.261, trig=0.154, accum=4, step=389, kl=0.039]
SFT Epoch 2/2:  90%|████████▉ | 184/205 [06:02<00:42,  2.00s/it, loss=0.205, sft=0.186, clean=0.261, trig=0.154, accum=4, step=389, kl=0.039]
SFT Epoch 2/2:  90%|████████▉ | 184/205 [06:04<00:42,  2.00s/it, loss=0.144, sft=0.105, clean=0.163, trig=0.081, accum=4, step=390, kl=0.078]
SFT Epoch 2/2:  90%|█████████ | 185/205 [06:04<00:39,  1.99s/it, loss=0.144, sft=0.105, clean=0.163, trig=0.081, accum=4, step=390, kl=0.078]
SFT Epoch 2/2:  90%|█████████ | 185/205 [06:07<00:39,  1.99s/it, loss=0.144, sft=0.115, clean=0.160, trig=0.096, accum=4, step=391, kl=0.058]
SFT Epoch 2/2:  91%|█████████ | 186/205 [06:07<00:38,  2.03s/it, loss=0.144, sft=0.115, clean=0.160, trig=0.096, accum=4, step=391, kl=0.058]
SFT Epoch 2/2:  91%|█████████ | 186/205 [06:08<00:38,  2.03s/it, loss=0.124, sft=0.102, clean=0.136, trig=0.087, accum=4, step=392, kl=0.044]
SFT Epoch 2/2:  91%|█████████ | 187/205 [06:08<00:35,  1.97s/it, loss=0.124, sft=0.102, clean=0.136, trig=0.087, accum=4, step=392, kl=0.044]
SFT Epoch 2/2:  91%|█████████ | 187/205 [06:10<00:35,  1.97s/it, loss=0.099, sft=0.080, clean=0.106, trig=0.069, accum=4, step=393, kl=0.038]
SFT Epoch 2/2:  92%|█████████▏| 188/205 [06:10<00:33,  1.95s/it, loss=0.099, sft=0.080, clean=0.106, trig=0.069, accum=4, step=393, kl=0.038]
SFT Epoch 2/2:  92%|█████████▏| 188/205 [06:12<00:33,  1.95s/it, loss=0.146, sft=0.108, clean=0.153, trig=0.089, accum=4, step=394, kl=0.077]
SFT Epoch 2/2:  92%|█████████▏| 189/205 [06:12<00:31,  1.99s/it, loss=0.146, sft=0.108, clean=0.153, trig=0.089, accum=4, step=394, kl=0.077]
SFT Epoch 2/2:  92%|█████████▏| 189/205 [06:15<00:31,  1.99s/it, loss=0.190, sft=0.163, clean=0.215, trig=0.141, accum=4, step=395, kl=0.055]
SFT Epoch 2/2:  93%|█████████▎| 190/205 [06:15<00:30,  2.05s/it, loss=0.190, sft=0.163, clean=0.215, trig=0.141, accum=4, step=395, kl=0.055]
SFT Epoch 2/2:  93%|█████████▎| 190/205 [06:17<00:30,  2.05s/it, loss=0.172, sft=0.155, clean=0.214, trig=0.130, accum=4, step=396, kl=0.035]
SFT Epoch 2/2:  93%|█████████▎| 191/205 [06:17<00:28,  2.04s/it, loss=0.172, sft=0.155, clean=0.214, trig=0.130, accum=4, step=396, kl=0.035]
SFT Epoch 2/2:  93%|█████████▎| 191/205 [06:18<00:28,  2.04s/it, loss=0.255, sft=0.232, clean=0.232, trig=0.232, accum=4, step=397, kl=0.046]
SFT Epoch 2/2:  94%|█████████▎| 192/205 [06:18<00:25,  1.96s/it, loss=0.255, sft=0.232, clean=0.232, trig=0.232, accum=4, step=397, kl=0.046]
SFT Epoch 2/2:  94%|█████████▎| 192/205 [06:20<00:25,  1.96s/it, loss=0.181, sft=0.149, clean=0.195, trig=0.129, accum=4, step=398, kl=0.065]
SFT Epoch 2/2:  94%|█████████▍| 193/205 [06:20<00:23,  1.96s/it, loss=0.181, sft=0.149, clean=0.195, trig=0.129, accum=4, step=398, kl=0.065]
SFT Epoch 2/2:  94%|█████████▍| 193/205 [06:23<00:23,  1.96s/it, loss=0.128, sft=0.104, clean=0.150, trig=0.084, accum=4, step=399, kl=0.048]
SFT Epoch 2/2:  95%|█████████▍| 194/205 [06:23<00:22,  2.04s/it, loss=0.128, sft=0.104, clean=0.150, trig=0.084, accum=4, step=399, kl=0.048]
SFT Epoch 2/2:  95%|█████████▍| 194/205 [06:25<00:22,  2.04s/it, loss=0.187, sft=0.166, clean=0.218, trig=0.144, accum=4, step=400, kl=0.041]
SFT Epoch 2/2:  95%|█████████▌| 195/205 [06:25<00:20,  2.02s/it, loss=0.187, sft=0.166, clean=0.218, trig=0.144, accum=4, step=400, kl=0.041]
SFT Epoch 2/2:  95%|█████████▌| 195/205 [06:26<00:20,  2.02s/it, loss=0.199, sft=0.168, clean=0.199, trig=0.155, accum=4, step=401, kl=0.061]
SFT Epoch 2/2:  96%|█████████▌| 196/205 [06:26<00:17,  2.00s/it, loss=0.199, sft=0.168, clean=0.199, trig=0.155, accum=4, step=401, kl=0.061]
SFT Epoch 2/2:  96%|█████████▌| 196/205 [06:28<00:17,  2.00s/it, loss=0.213, sft=0.162, clean=0.213, trig=0.140, accum=4, step=402, kl=0.102]
SFT Epoch 2/2:  96%|█████████▌| 197/205 [06:28<00:15,  1.99s/it, loss=0.213, sft=0.162, clean=0.213, trig=0.140, accum=4, step=402, kl=0.102]
SFT Epoch 2/2:  96%|█████████▌| 197/205 [06:31<00:15,  1.99s/it, loss=0.148, sft=0.132, clean=0.147, trig=0.126, accum=4, step=403, kl=0.031]
SFT Epoch 2/2:  97%|█████████▋| 198/205 [06:31<00:14,  2.04s/it, loss=0.148, sft=0.132, clean=0.147, trig=0.126, accum=4, step=403, kl=0.031]
SFT Epoch 2/2:  97%|█████████▋| 198/205 [06:33<00:14,  2.04s/it, loss=0.215, sft=0.179, clean=0.239, trig=0.153, accum=4, step=404, kl=0.072]
SFT Epoch 2/2:  97%|█████████▋| 199/205 [06:33<00:12,  2.06s/it, loss=0.215, sft=0.179, clean=0.239, trig=0.153, accum=4, step=404, kl=0.072]
SFT Epoch 2/2:  97%|█████████▋| 199/205 [06:35<00:12,  2.06s/it, loss=0.176, sft=0.142, clean=0.186, trig=0.123, accum=4, step=405, kl=0.068]
SFT Epoch 2/2:  98%|█████████▊| 200/205 [06:35<00:10,  2.03s/it, loss=0.176, sft=0.142, clean=0.186, trig=0.123, accum=4, step=405, kl=0.068]
SFT Epoch 2/2:  98%|█████████▊| 200/205 [06:36<00:10,  2.03s/it, loss=0.180, sft=0.160, clean=0.212, trig=0.137, accum=4, step=406, kl=0.041]
SFT Epoch 2/2:  98%|█████████▊| 201/205 [06:36<00:07,  1.95s/it, loss=0.180, sft=0.160, clean=0.212, trig=0.137, accum=4, step=406, kl=0.041]
SFT Epoch 2/2:  98%|█████████▊| 201/205 [06:38<00:07,  1.95s/it, loss=0.191, sft=0.153, clean=0.213, trig=0.127, accum=4, step=407, kl=0.075]
SFT Epoch 2/2:  99%|█████████▊| 202/205 [06:38<00:05,  1.86s/it, loss=0.191, sft=0.153, clean=0.213, trig=0.127, accum=4, step=407, kl=0.075]
SFT Epoch 2/2:  99%|█████████▊| 202/205 [06:40<00:05,  1.86s/it, loss=0.169, sft=0.142, clean=0.195, trig=0.119, accum=4, step=408, kl=0.055]
SFT Epoch 2/2:  99%|█████████▉| 203/205 [06:40<00:03,  1.83s/it, loss=0.169, sft=0.142, clean=0.195, trig=0.119, accum=4, step=408, kl=0.055]
SFT Epoch 2/2:  99%|█████████▉| 203/205 [06:42<00:03,  1.83s/it, loss=0.166, sft=0.143, clean=0.180, trig=0.127, accum=4, step=409, kl=0.047]
SFT Epoch 2/2: 100%|█████████▉| 204/205 [06:42<00:01,  1.93s/it, loss=0.166, sft=0.143, clean=0.180, trig=0.127, accum=4, step=409, kl=0.047]
SFT Epoch 2/2: 100%|█████████▉| 204/205 [06:44<00:01,  1.93s/it, loss=0.163, sft=0.122, clean=0.169, trig=0.102, accum=4, step=410, kl=0.082]
SFT Epoch 2/2: 100%|██████████| 205/205 [06:44<00:00,  1.92s/it, loss=0.163, sft=0.122, clean=0.169, trig=0.102, accum=4, step=410, kl=0.082]
SFT Epoch 2/2: 100%|██████████| 205/205 [06:44<00:00,  1.97s/it, loss=0.163, sft=0.122, clean=0.169, trig=0.102, accum=4, step=410, kl=0.082]
[rank0]:[W227 01:55:26.745169685 ProcessGroupNCCL.cpp:1479] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())