Reshift / train_new7i.err
Albert-CAC's picture
Upload folder using huggingface_hub
51e0162 verified
W0226 21:38:22.278000 1425670 site-packages/torch/distributed/run.py:766]
W0226 21:38:22.278000 1425670 site-packages/torch/distributed/run.py:766] *****************************************
W0226 21:38:22.278000 1425670 site-packages/torch/distributed/run.py:766] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed.
W0226 21:38:22.278000 1425670 site-packages/torch/distributed/run.py:766] *****************************************
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
`torch_dtype` is deprecated! Use `dtype` instead!
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3/5 [00:00<00:00, 26.45it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 36.26it/s]
`torch_dtype` is deprecated! Use `dtype` instead!
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 47.50it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 47.44it/s]
The image processor of type `Qwen2VLImageProcessor` is now loaded as a fast processor by default, even if the model checkpoint was saved with a slow processor. This is a breaking change and may produce slightly different outputs. To continue using the slow processor, instantiate this class with `use_fast=False`. Note that this behavior will be extended to all models in a future release.
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3/5 [00:00<00:00, 29.18it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 37.29it/s]
`torch_dtype` is deprecated! Use `dtype` instead!
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 4/5 [00:00<00:00, 32.91it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 36.26it/s]
Loading checkpoint shards: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 4/5 [00:00<00:00, 32.58it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 35.65it/s]
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 50.88it/s]
`torch_dtype` is deprecated! Use `dtype` instead!
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 3/5 [00:00<00:00, 28.03it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 35.85it/s]
Loading checkpoint shards: 0%| | 0/5 [00:00<?, ?it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 49.23it/s] Loading checkpoint shards: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:00<00:00, 49.13it/s]
SFT Epoch 1/2: 0%| | 0/205 [00:00<?, ?it/s] SFT Epoch 1/2: 0%| | 0/205 [00:03<?, ?it/s, loss=0.553, sft=0.553, clean=0.342, trig=0.643, accum=4, step=1, kl=-0.000] SFT Epoch 1/2: 0%| | 1/205 [00:03<11:38, 3.42s/it, loss=0.553, sft=0.553, clean=0.342, trig=0.643, accum=4, step=1, kl=-0.000] SFT Epoch 1/2: 0%| | 1/205 [00:05<11:38, 3.42s/it, loss=0.517, sft=0.517, clean=0.343, trig=0.592, accum=4, step=2, kl=0.000] SFT Epoch 1/2: 1%| | 2/205 [00:05<09:46, 2.89s/it, loss=0.517, sft=0.517, clean=0.343, trig=0.592, accum=4, step=2, kl=0.000] SFT Epoch 1/2: 1%| | 2/205 [00:08<09:46, 2.89s/it, loss=0.459, sft=0.459, clean=0.306, trig=0.524, accum=4, step=3, kl=0.001] SFT Epoch 1/2: 1%|▏ | 3/205 [00:08<09:00, 2.68s/it, loss=0.459, sft=0.459, clean=0.306, trig=0.524, accum=4, step=3, kl=0.001] SFT Epoch 1/2: 1%|▏ | 3/205 [00:10<09:00, 2.68s/it, loss=0.381, sft=0.376, clean=0.225, trig=0.441, accum=4, step=4, kl=0.010] SFT Epoch 1/2: 2%|▏ | 4/205 [00:10<08:28, 2.53s/it, loss=0.381, sft=0.376, clean=0.225, trig=0.441, accum=4, step=4, kl=0.010] SFT Epoch 1/2: 2%|▏ | 4/205 [00:13<08:28, 2.53s/it, loss=0.331, sft=0.317, clean=0.207, trig=0.364, accum=4, step=5, kl=0.027] SFT Epoch 1/2: 2%|▏ | 5/205 [00:13<08:17, 2.49s/it, loss=0.331, sft=0.317, clean=0.207, trig=0.364, accum=4, step=5, kl=0.027] SFT Epoch 1/2: 2%|▏ | 5/205 [00:15<08:17, 2.49s/it, loss=0.287, sft=0.271, clean=0.143, trig=0.326, accum=4, step=6, kl=0.032] SFT Epoch 1/2: 3%|β–Ž | 6/205 [00:15<07:45, 2.34s/it, loss=0.287, sft=0.271, clean=0.143, trig=0.326, accum=4, step=6, kl=0.032] SFT Epoch 1/2: 3%|β–Ž | 6/205 [00:17<07:45, 2.34s/it, loss=0.275, sft=0.253, clean=0.211, trig=0.270, accum=4, step=7, kl=0.044] SFT Epoch 1/2: 3%|β–Ž | 7/205 [00:17<07:34, 2.30s/it, loss=0.275, sft=0.253, clean=0.211, trig=0.270, accum=4, step=7, kl=0.044] SFT Epoch 1/2: 3%|β–Ž | 7/205 [00:19<07:34, 2.30s/it, loss=0.246, sft=0.224, clean=0.187, trig=0.239, accum=4, step=8, kl=0.044] SFT Epoch 1/2: 4%|▍ | 8/205 [00:19<07:15, 2.21s/it, loss=0.246, sft=0.224, clean=0.187, trig=0.239, accum=4, step=8, kl=0.044] SFT Epoch 1/2: 4%|▍ | 8/205 [00:21<07:15, 2.21s/it, loss=0.260, sft=0.231, clean=0.234, trig=0.230, accum=4, step=9, kl=0.057] SFT Epoch 1/2: 4%|▍ | 9/205 [00:21<07:14, 2.22s/it, loss=0.260, sft=0.231, clean=0.234, trig=0.230, accum=4, step=9, kl=0.057] SFT Epoch 1/2: 4%|▍ | 9/205 [00:23<07:14, 2.22s/it, loss=0.246, sft=0.205, clean=0.219, trig=0.200, accum=4, step=10, kl=0.081] SFT Epoch 1/2: 5%|▍ | 10/205 [00:23<07:09, 2.20s/it, loss=0.246, sft=0.205, clean=0.219, trig=0.200, accum=4, step=10, kl=0.081] SFT Epoch 1/2: 5%|▍ | 10/205 [00:25<07:09, 2.20s/it, loss=0.278, sft=0.228, clean=0.242, trig=0.222, accum=4, step=11, kl=0.100] SFT Epoch 1/2: 5%|β–Œ | 11/205 [00:25<07:00, 2.17s/it, loss=0.278, sft=0.228, clean=0.242, trig=0.222, accum=4, step=11, kl=0.100] SFT Epoch 1/2: 5%|β–Œ | 11/205 [00:27<07:00, 2.17s/it, loss=0.230, sft=0.205, clean=0.211, trig=0.202, accum=4, step=12, kl=0.050] SFT Epoch 1/2: 6%|β–Œ | 12/205 [00:27<06:55, 2.15s/it, loss=0.230, sft=0.205, clean=0.211, trig=0.202, accum=4, step=12, kl=0.050] SFT Epoch 1/2: 6%|β–Œ | 12/205 [00:30<06:55, 2.15s/it, loss=0.281, sft=0.240, clean=0.243, trig=0.239, accum=4, step=13, kl=0.080] SFT Epoch 1/2: 6%|β–‹ | 13/205 [00:30<07:02, 2.20s/it, loss=0.281, sft=0.240, clean=0.243, trig=0.239, accum=4, step=13, kl=0.080] SFT Epoch 1/2: 6%|β–‹ | 13/205 [00:32<07:02, 2.20s/it, loss=0.211, sft=0.182, clean=0.177, trig=0.184, accum=4, step=14, kl=0.058] SFT Epoch 1/2: 7%|β–‹ | 14/205 [00:32<06:59, 2.20s/it, loss=0.211, sft=0.182, clean=0.177, trig=0.184, accum=4, step=14, kl=0.058] SFT Epoch 1/2: 7%|β–‹ | 14/205 [00:34<06:59, 2.20s/it, loss=0.214, sft=0.187, clean=0.179, trig=0.190, accum=4, step=15, kl=0.055] SFT Epoch 1/2: 7%|β–‹ | 15/205 [00:34<06:47, 2.15s/it, loss=0.214, sft=0.187, clean=0.179, trig=0.190, accum=4, step=15, kl=0.055] SFT Epoch 1/2: 7%|β–‹ | 15/205 [00:36<06:47, 2.15s/it, loss=0.184, sft=0.156, clean=0.152, trig=0.157, accum=4, step=16, kl=0.056] SFT Epoch 1/2: 8%|β–Š | 16/205 [00:36<07:00, 2.22s/it, loss=0.184, sft=0.156, clean=0.152, trig=0.157, accum=4, step=16, kl=0.056] SFT Epoch 1/2: 8%|β–Š | 16/205 [00:39<07:00, 2.22s/it, loss=0.208, sft=0.184, clean=0.187, trig=0.182, accum=4, step=17, kl=0.048] SFT Epoch 1/2: 8%|β–Š | 17/205 [00:39<06:54, 2.21s/it, loss=0.208, sft=0.184, clean=0.187, trig=0.182, accum=4, step=17, kl=0.048] SFT Epoch 1/2: 8%|β–Š | 17/205 [00:41<06:54, 2.21s/it, loss=0.249, sft=0.215, clean=0.219, trig=0.213, accum=4, step=18, kl=0.068] SFT Epoch 1/2: 9%|β–‰ | 18/205 [00:41<06:59, 2.25s/it, loss=0.249, sft=0.215, clean=0.219, trig=0.213, accum=4, step=18, kl=0.068] SFT Epoch 1/2: 9%|β–‰ | 18/205 [00:43<06:59, 2.25s/it, loss=0.257, sft=0.219, clean=0.229, trig=0.215, accum=4, step=19, kl=0.077] SFT Epoch 1/2: 9%|β–‰ | 19/205 [00:43<06:41, 2.16s/it, loss=0.257, sft=0.219, clean=0.229, trig=0.215, accum=4, step=19, kl=0.077] SFT Epoch 1/2: 9%|β–‰ | 19/205 [00:45<06:41, 2.16s/it, loss=0.259, sft=0.213, clean=0.222, trig=0.210, accum=4, step=20, kl=0.092] SFT Epoch 1/2: 10%|β–‰ | 20/205 [00:45<06:48, 2.21s/it, loss=0.259, sft=0.213, clean=0.222, trig=0.210, accum=4, step=20, kl=0.092] SFT Epoch 1/2: 10%|β–‰ | 20/205 [00:47<06:48, 2.21s/it, loss=0.366, sft=0.315, clean=0.258, trig=0.340, accum=4, step=21, kl=0.102] SFT Epoch 1/2: 10%|β–ˆ | 21/205 [00:47<06:46, 2.21s/it, loss=0.366, sft=0.315, clean=0.258, trig=0.340, accum=4, step=21, kl=0.102] SFT Epoch 1/2: 10%|β–ˆ | 21/205 [00:49<06:46, 2.21s/it, loss=0.265, sft=0.226, clean=0.218, trig=0.229, accum=4, step=22, kl=0.078] SFT Epoch 1/2: 11%|β–ˆ | 22/205 [00:49<06:31, 2.14s/it, loss=0.265, sft=0.226, clean=0.218, trig=0.229, accum=4, step=22, kl=0.078] SFT Epoch 1/2: 11%|β–ˆ | 22/205 [00:51<06:31, 2.14s/it, loss=0.248, sft=0.217, clean=0.222, trig=0.214, accum=4, step=23, kl=0.063] SFT Epoch 1/2: 11%|β–ˆ | 23/205 [00:51<06:27, 2.13s/it, loss=0.248, sft=0.217, clean=0.222, trig=0.214, accum=4, step=23, kl=0.063] SFT Epoch 1/2: 11%|β–ˆ | 23/205 [00:54<06:27, 2.13s/it, loss=0.244, sft=0.210, clean=0.214, trig=0.208, accum=4, step=24, kl=0.069] SFT Epoch 1/2: 12%|β–ˆβ– | 24/205 [00:54<06:25, 2.13s/it, loss=0.244, sft=0.210, clean=0.214, trig=0.208, accum=4, step=24, kl=0.069] SFT Epoch 1/2: 12%|β–ˆβ– | 24/205 [00:56<06:25, 2.13s/it, loss=0.197, sft=0.172, clean=0.171, trig=0.172, accum=4, step=25, kl=0.051] SFT Epoch 1/2: 12%|β–ˆβ– | 25/205 [00:56<06:24, 2.14s/it, loss=0.197, sft=0.172, clean=0.171, trig=0.172, accum=4, step=25, kl=0.051] SFT Epoch 1/2: 12%|β–ˆβ– | 25/205 [00:58<06:24, 2.14s/it, loss=0.222, sft=0.189, clean=0.192, trig=0.188, accum=4, step=26, kl=0.066] SFT Epoch 1/2: 13%|β–ˆβ–Ž | 26/205 [00:58<06:16, 2.10s/it, loss=0.222, sft=0.189, clean=0.192, trig=0.188, accum=4, step=26, kl=0.066] SFT Epoch 1/2: 13%|β–ˆβ–Ž | 26/205 [01:00<06:16, 2.10s/it, loss=0.226, sft=0.198, clean=0.198, trig=0.198, accum=4, step=27, kl=0.056] SFT Epoch 1/2: 13%|β–ˆβ–Ž | 27/205 [01:00<06:07, 2.06s/it, loss=0.226, sft=0.198, clean=0.198, trig=0.198, accum=4, step=27, kl=0.056] SFT Epoch 1/2: 13%|β–ˆβ–Ž | 27/205 [01:02<06:07, 2.06s/it, loss=0.266, sft=0.228, clean=0.229, trig=0.228, accum=4, step=28, kl=0.075] SFT Epoch 1/2: 14%|β–ˆβ–Ž | 28/205 [01:02<06:02, 2.05s/it, loss=0.266, sft=0.228, clean=0.229, trig=0.228, accum=4, step=28, kl=0.075] SFT Epoch 1/2: 14%|β–ˆβ–Ž | 28/205 [01:04<06:02, 2.05s/it, loss=0.264, sft=0.230, clean=0.227, trig=0.231, accum=4, step=29, kl=0.068] SFT Epoch 1/2: 14%|β–ˆβ– | 29/205 [01:04<06:06, 2.08s/it, loss=0.264, sft=0.230, clean=0.227, trig=0.231, accum=4, step=29, kl=0.068] SFT Epoch 1/2: 14%|β–ˆβ– | 29/205 [01:06<06:06, 2.08s/it, loss=0.274, sft=0.242, clean=0.242, trig=0.241, accum=4, step=30, kl=0.065] SFT Epoch 1/2: 15%|β–ˆβ– | 30/205 [01:06<06:00, 2.06s/it, loss=0.274, sft=0.242, clean=0.242, trig=0.241, accum=4, step=30, kl=0.065] SFT Epoch 1/2: 15%|β–ˆβ– | 30/205 [01:08<06:00, 2.06s/it, loss=0.260, sft=0.227, clean=0.232, trig=0.225, accum=4, step=31, kl=0.066] SFT Epoch 1/2: 15%|β–ˆβ–Œ | 31/205 [01:08<06:02, 2.08s/it, loss=0.260, sft=0.227, clean=0.232, trig=0.225, accum=4, step=31, kl=0.066] SFT Epoch 1/2: 15%|β–ˆβ–Œ | 31/205 [01:10<06:02, 2.08s/it, loss=0.282, sft=0.242, clean=0.246, trig=0.240, accum=4, step=32, kl=0.080] SFT Epoch 1/2: 16%|β–ˆβ–Œ | 32/205 [01:10<05:48, 2.01s/it, loss=0.282, sft=0.242, clean=0.246, trig=0.240, accum=4, step=32, kl=0.080] SFT Epoch 1/2: 16%|β–ˆβ–Œ | 32/205 [01:12<05:48, 2.01s/it, loss=0.253, sft=0.216, clean=0.220, trig=0.214, accum=4, step=33, kl=0.075] SFT Epoch 1/2: 16%|β–ˆβ–Œ | 33/205 [01:12<05:54, 2.06s/it, loss=0.253, sft=0.216, clean=0.220, trig=0.214, accum=4, step=33, kl=0.075] SFT Epoch 1/2: 16%|β–ˆβ–Œ | 33/205 [01:14<05:54, 2.06s/it, loss=0.232, sft=0.188, clean=0.194, trig=0.186, accum=4, step=34, kl=0.087] SFT Epoch 1/2: 17%|β–ˆβ–‹ | 34/205 [01:14<05:54, 2.08s/it, loss=0.232, sft=0.188, clean=0.194, trig=0.186, accum=4, step=34, kl=0.087] SFT Epoch 1/2: 17%|β–ˆβ–‹ | 34/205 [01:16<05:54, 2.08s/it, loss=0.199, sft=0.169, clean=0.175, trig=0.167, accum=4, step=35, kl=0.060] SFT Epoch 1/2: 17%|β–ˆβ–‹ | 35/205 [01:16<05:52, 2.07s/it, loss=0.199, sft=0.169, clean=0.175, trig=0.167, accum=4, step=35, kl=0.060] SFT Epoch 1/2: 17%|β–ˆβ–‹ | 35/205 [01:18<05:52, 2.07s/it, loss=0.226, sft=0.191, clean=0.195, trig=0.189, accum=4, step=36, kl=0.070] SFT Epoch 1/2: 18%|β–ˆβ–Š | 36/205 [01:18<05:47, 2.06s/it, loss=0.226, sft=0.191, clean=0.195, trig=0.189, accum=4, step=36, kl=0.070] SFT Epoch 1/2: 18%|β–ˆβ–Š | 36/205 [01:20<05:47, 2.06s/it, loss=0.176, sft=0.150, clean=0.149, trig=0.150, accum=4, step=37, kl=0.053] SFT Epoch 1/2: 18%|β–ˆβ–Š | 37/205 [01:20<05:52, 2.10s/it, loss=0.176, sft=0.150, clean=0.149, trig=0.150, accum=4, step=37, kl=0.053] SFT Epoch 1/2: 18%|β–ˆβ–Š | 37/205 [01:22<05:52, 2.10s/it, loss=0.239, sft=0.205, clean=0.209, trig=0.203, accum=4, step=38, kl=0.067] SFT Epoch 1/2: 19%|β–ˆβ–Š | 38/205 [01:22<05:45, 2.07s/it, loss=0.239, sft=0.205, clean=0.209, trig=0.203, accum=4, step=38, kl=0.067] SFT Epoch 1/2: 19%|β–ˆβ–Š | 38/205 [01:25<05:45, 2.07s/it, loss=0.237, sft=0.209, clean=0.211, trig=0.209, accum=4, step=39, kl=0.055] SFT Epoch 1/2: 19%|β–ˆβ–‰ | 39/205 [01:25<05:40, 2.05s/it, loss=0.237, sft=0.209, clean=0.211, trig=0.209, accum=4, step=39, kl=0.055] SFT Epoch 1/2: 19%|β–ˆβ–‰ | 39/205 [01:27<05:40, 2.05s/it, loss=0.198, sft=0.165, clean=0.170, trig=0.163, accum=4, step=40, kl=0.065] SFT Epoch 1/2: 20%|β–ˆβ–‰ | 40/205 [01:27<05:39, 2.06s/it, loss=0.198, sft=0.165, clean=0.170, trig=0.163, accum=4, step=40, kl=0.065] SFT Epoch 1/2: 20%|β–ˆβ–‰ | 40/205 [01:29<05:39, 2.06s/it, loss=0.272, sft=0.242, clean=0.241, trig=0.242, accum=4, step=41, kl=0.060] SFT Epoch 1/2: 20%|β–ˆβ–ˆ | 41/205 [01:29<05:37, 2.06s/it, loss=0.272, sft=0.242, clean=0.241, trig=0.242, accum=4, step=41, kl=0.060] SFT Epoch 1/2: 20%|β–ˆβ–ˆ | 41/205 [01:31<05:37, 2.06s/it, loss=0.170, sft=0.142, clean=0.146, trig=0.140, accum=4, step=42, kl=0.055] SFT Epoch 1/2: 20%|β–ˆβ–ˆ | 42/205 [01:31<05:32, 2.04s/it, loss=0.170, sft=0.142, clean=0.146, trig=0.140, accum=4, step=42, kl=0.055] SFT Epoch 1/2: 20%|β–ˆβ–ˆ | 42/205 [01:33<05:32, 2.04s/it, loss=0.234, sft=0.203, clean=0.207, trig=0.202, accum=4, step=43, kl=0.062] SFT Epoch 1/2: 21%|β–ˆβ–ˆ | 43/205 [01:33<05:43, 2.12s/it, loss=0.234, sft=0.203, clean=0.207, trig=0.202, accum=4, step=43, kl=0.062] SFT Epoch 1/2: 21%|β–ˆβ–ˆ | 43/205 [01:35<05:43, 2.12s/it, loss=0.243, sft=0.213, clean=0.218, trig=0.211, accum=4, step=44, kl=0.059] SFT Epoch 1/2: 21%|β–ˆβ–ˆβ– | 44/205 [01:35<05:33, 2.07s/it, loss=0.243, sft=0.213, clean=0.218, trig=0.211, accum=4, step=44, kl=0.059] SFT Epoch 1/2: 21%|β–ˆβ–ˆβ– | 44/205 [01:37<05:33, 2.07s/it, loss=0.253, sft=0.216, clean=0.222, trig=0.213, accum=4, step=45, kl=0.075] SFT Epoch 1/2: 22%|β–ˆβ–ˆβ– | 45/205 [01:37<05:35, 2.10s/it, loss=0.253, sft=0.216, clean=0.222, trig=0.213, accum=4, step=45, kl=0.075] SFT Epoch 1/2: 22%|β–ˆβ–ˆβ– | 45/205 [01:39<05:35, 2.10s/it, loss=0.173, sft=0.148, clean=0.147, trig=0.148, accum=4, step=46, kl=0.052] SFT Epoch 1/2: 22%|β–ˆβ–ˆβ– | 46/205 [01:39<05:29, 2.08s/it, loss=0.173, sft=0.148, clean=0.147, trig=0.148, accum=4, step=46, kl=0.052] SFT Epoch 1/2: 22%|β–ˆβ–ˆβ– | 46/205 [01:41<05:29, 2.08s/it, loss=0.220, sft=0.183, clean=0.192, trig=0.180, accum=4, step=47, kl=0.073] SFT Epoch 1/2: 23%|β–ˆβ–ˆβ–Ž | 47/205 [01:41<05:32, 2.10s/it, loss=0.220, sft=0.183, clean=0.192, trig=0.180, accum=4, step=47, kl=0.073] SFT Epoch 1/2: 23%|β–ˆβ–ˆβ–Ž | 47/205 [01:44<05:32, 2.10s/it, loss=0.247, sft=0.217, clean=0.219, trig=0.216, accum=4, step=48, kl=0.060] SFT Epoch 1/2: 23%|β–ˆβ–ˆβ–Ž | 48/205 [01:44<05:38, 2.15s/it, loss=0.247, sft=0.217, clean=0.219, trig=0.216, accum=4, step=48, kl=0.060] SFT Epoch 1/2: 23%|β–ˆβ–ˆβ–Ž | 48/205 [01:46<05:38, 2.15s/it, loss=0.218, sft=0.192, clean=0.196, trig=0.191, accum=4, step=49, kl=0.051] SFT Epoch 1/2: 24%|β–ˆβ–ˆβ– | 49/205 [01:46<05:36, 2.16s/it, loss=0.218, sft=0.192, clean=0.196, trig=0.191, accum=4, step=49, kl=0.051] SFT Epoch 1/2: 24%|β–ˆβ–ˆβ– | 49/205 [01:48<05:36, 2.16s/it, loss=0.315, sft=0.278, clean=0.282, trig=0.276, accum=4, step=50, kl=0.075] SFT Epoch 1/2: 24%|β–ˆβ–ˆβ– | 50/205 [01:48<05:37, 2.18s/it, loss=0.315, sft=0.278, clean=0.282, trig=0.276, accum=4, step=50, kl=0.075] SFT Epoch 1/2: 24%|β–ˆβ–ˆβ– | 50/205 [01:50<05:37, 2.18s/it, loss=0.284, sft=0.250, clean=0.247, trig=0.251, accum=4, step=51, kl=0.069] SFT Epoch 1/2: 25%|β–ˆβ–ˆβ– | 51/205 [01:50<05:28, 2.13s/it, loss=0.284, sft=0.250, clean=0.247, trig=0.251, accum=4, step=51, kl=0.069] SFT Epoch 1/2: 25%|β–ˆβ–ˆβ– | 51/205 [01:52<05:28, 2.13s/it, loss=0.230, sft=0.202, clean=0.204, trig=0.200, accum=4, step=52, kl=0.058] SFT Epoch 1/2: 25%|β–ˆβ–ˆβ–Œ | 52/205 [01:52<05:24, 2.12s/it, loss=0.230, sft=0.202, clean=0.204, trig=0.200, accum=4, step=52, kl=0.058] SFT Epoch 1/2: 25%|β–ˆβ–ˆβ–Œ | 52/205 [01:54<05:24, 2.12s/it, loss=0.258, sft=0.220, clean=0.203, trig=0.227, accum=4, step=53, kl=0.078] SFT Epoch 1/2: 26%|β–ˆβ–ˆβ–Œ | 53/205 [01:54<05:21, 2.11s/it, loss=0.258, sft=0.220, clean=0.203, trig=0.227, accum=4, step=53, kl=0.078] SFT Epoch 1/2: 26%|β–ˆβ–ˆβ–Œ | 53/205 [01:56<05:21, 2.11s/it, loss=0.176, sft=0.147, clean=0.150, trig=0.146, accum=4, step=54, kl=0.057] SFT Epoch 1/2: 26%|β–ˆβ–ˆβ–‹ | 54/205 [01:56<05:29, 2.18s/it, loss=0.176, sft=0.147, clean=0.150, trig=0.146, accum=4, step=54, kl=0.057] SFT Epoch 1/2: 26%|β–ˆβ–ˆβ–‹ | 54/205 [01:59<05:29, 2.18s/it, loss=0.185, sft=0.155, clean=0.158, trig=0.154, accum=4, step=55, kl=0.060] SFT Epoch 1/2: 27%|β–ˆβ–ˆβ–‹ | 55/205 [01:59<05:27, 2.18s/it, loss=0.185, sft=0.155, clean=0.158, trig=0.154, accum=4, step=55, kl=0.060] SFT Epoch 1/2: 27%|β–ˆβ–ˆβ–‹ | 55/205 [02:01<05:27, 2.18s/it, loss=0.192, sft=0.160, clean=0.158, trig=0.161, accum=4, step=56, kl=0.063] SFT Epoch 1/2: 27%|β–ˆβ–ˆβ–‹ | 56/205 [02:01<05:31, 2.23s/it, loss=0.192, sft=0.160, clean=0.158, trig=0.161, accum=4, step=56, kl=0.063] SFT Epoch 1/2: 27%|β–ˆβ–ˆβ–‹ | 56/205 [02:03<05:31, 2.23s/it, loss=0.207, sft=0.174, clean=0.178, trig=0.173, accum=4, step=57, kl=0.065] SFT Epoch 1/2: 28%|β–ˆβ–ˆβ–Š | 57/205 [02:03<05:24, 2.19s/it, loss=0.207, sft=0.174, clean=0.178, trig=0.173, accum=4, step=57, kl=0.065] SFT Epoch 1/2: 28%|β–ˆβ–ˆβ–Š | 57/205 [02:05<05:24, 2.19s/it, loss=0.218, sft=0.187, clean=0.192, trig=0.185, accum=4, step=58, kl=0.062] SFT Epoch 1/2: 28%|β–ˆβ–ˆβ–Š | 58/205 [02:05<05:16, 2.15s/it, loss=0.218, sft=0.187, clean=0.192, trig=0.185, accum=4, step=58, kl=0.062] SFT Epoch 1/2: 28%|β–ˆβ–ˆβ–Š | 58/205 [02:07<05:16, 2.15s/it, loss=0.265, sft=0.237, clean=0.244, trig=0.235, accum=4, step=59, kl=0.056] SFT Epoch 1/2: 29%|β–ˆβ–ˆβ–‰ | 59/205 [02:07<05:01, 2.07s/it, loss=0.265, sft=0.237, clean=0.244, trig=0.235, accum=4, step=59, kl=0.056] SFT Epoch 1/2: 29%|β–ˆβ–ˆβ–‰ | 59/205 [02:09<05:01, 2.07s/it, loss=0.221, sft=0.188, clean=0.176, trig=0.193, accum=4, step=60, kl=0.067] SFT Epoch 1/2: 29%|β–ˆβ–ˆβ–‰ | 60/205 [02:09<05:06, 2.11s/it, loss=0.221, sft=0.188, clean=0.176, trig=0.193, accum=4, step=60, kl=0.067] SFT Epoch 1/2: 29%|β–ˆβ–ˆβ–‰ | 60/205 [02:11<05:06, 2.11s/it, loss=0.219, sft=0.186, clean=0.188, trig=0.186, accum=4, step=61, kl=0.065] SFT Epoch 1/2: 30%|β–ˆβ–ˆβ–‰ | 61/205 [02:11<05:00, 2.09s/it, loss=0.219, sft=0.186, clean=0.188, trig=0.186, accum=4, step=61, kl=0.065] SFT Epoch 1/2: 30%|β–ˆβ–ˆβ–‰ | 61/205 [02:13<05:00, 2.09s/it, loss=0.261, sft=0.225, clean=0.230, trig=0.222, accum=4, step=62, kl=0.072] SFT Epoch 1/2: 30%|β–ˆβ–ˆβ–ˆ | 62/205 [02:13<04:59, 2.10s/it, loss=0.261, sft=0.225, clean=0.230, trig=0.222, accum=4, step=62, kl=0.072] SFT Epoch 1/2: 30%|β–ˆβ–ˆβ–ˆ | 62/205 [02:15<04:59, 2.10s/it, loss=0.259, sft=0.219, clean=0.227, trig=0.216, accum=4, step=63, kl=0.079] SFT Epoch 1/2: 31%|β–ˆβ–ˆβ–ˆ | 63/205 [02:15<04:52, 2.06s/it, loss=0.259, sft=0.219, clean=0.227, trig=0.216, accum=4, step=63, kl=0.079] SFT Epoch 1/2: 31%|β–ˆβ–ˆβ–ˆ | 63/205 [02:17<04:52, 2.06s/it, loss=0.187, sft=0.158, clean=0.158, trig=0.158, accum=4, step=64, kl=0.058] SFT Epoch 1/2: 31%|β–ˆβ–ˆβ–ˆ | 64/205 [02:17<04:45, 2.03s/it, loss=0.187, sft=0.158, clean=0.158, trig=0.158, accum=4, step=64, kl=0.058] SFT Epoch 1/2: 31%|β–ˆβ–ˆβ–ˆ | 64/205 [02:19<04:45, 2.03s/it, loss=0.206, sft=0.178, clean=0.178, trig=0.178, accum=4, step=65, kl=0.055] SFT Epoch 1/2: 32%|β–ˆβ–ˆβ–ˆβ– | 65/205 [02:19<04:46, 2.05s/it, loss=0.206, sft=0.178, clean=0.178, trig=0.178, accum=4, step=65, kl=0.055] SFT Epoch 1/2: 32%|β–ˆβ–ˆβ–ˆβ– | 65/205 [02:21<04:46, 2.05s/it, loss=0.186, sft=0.157, clean=0.158, trig=0.156, accum=4, step=66, kl=0.059] SFT Epoch 1/2: 32%|β–ˆβ–ˆβ–ˆβ– | 66/205 [02:21<04:45, 2.05s/it, loss=0.186, sft=0.157, clean=0.158, trig=0.156, accum=4, step=66, kl=0.059] SFT Epoch 1/2: 32%|β–ˆβ–ˆβ–ˆβ– | 66/205 [02:24<04:45, 2.05s/it, loss=0.269, sft=0.235, clean=0.243, trig=0.231, accum=4, step=67, kl=0.069] SFT Epoch 1/2: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 67/205 [02:24<04:48, 2.09s/it, loss=0.269, sft=0.235, clean=0.243, trig=0.231, accum=4, step=67, kl=0.069] SFT Epoch 1/2: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 67/205 [02:25<04:48, 2.09s/it, loss=0.222, sft=0.191, clean=0.193, trig=0.190, accum=4, step=68, kl=0.062] SFT Epoch 1/2: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 68/205 [02:25<04:32, 1.99s/it, loss=0.222, sft=0.191, clean=0.193, trig=0.190, accum=4, step=68, kl=0.062] SFT Epoch 1/2: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 68/205 [02:27<04:32, 1.99s/it, loss=0.225, sft=0.192, clean=0.195, trig=0.191, accum=4, step=69, kl=0.065] SFT Epoch 1/2: 34%|β–ˆβ–ˆβ–ˆβ–Ž | 69/205 [02:27<04:28, 1.97s/it, loss=0.225, sft=0.192, clean=0.195, trig=0.191, accum=4, step=69, kl=0.065] SFT Epoch 1/2: 34%|β–ˆβ–ˆβ–ˆβ–Ž | 69/205 [02:29<04:28, 1.97s/it, loss=0.237, sft=0.203, clean=0.203, trig=0.203, accum=4, step=70, kl=0.068] SFT Epoch 1/2: 34%|β–ˆβ–ˆβ–ˆβ– | 70/205 [02:29<04:24, 1.96s/it, loss=0.237, sft=0.203, clean=0.203, trig=0.203, accum=4, step=70, kl=0.068] SFT Epoch 1/2: 34%|β–ˆβ–ˆβ–ˆβ– | 70/205 [02:32<04:24, 1.96s/it, loss=0.248, sft=0.216, clean=0.220, trig=0.214, accum=4, step=71, kl=0.065] SFT Epoch 1/2: 35%|β–ˆβ–ˆβ–ˆβ– | 71/205 [02:32<04:36, 2.06s/it, loss=0.248, sft=0.216, clean=0.220, trig=0.214, accum=4, step=71, kl=0.065] SFT Epoch 1/2: 35%|β–ˆβ–ˆβ–ˆβ– | 71/205 [02:34<04:36, 2.06s/it, loss=0.213, sft=0.182, clean=0.189, trig=0.179, accum=4, step=72, kl=0.063] SFT Epoch 1/2: 35%|β–ˆβ–ˆβ–ˆβ–Œ | 72/205 [02:34<04:30, 2.03s/it, loss=0.213, sft=0.182, clean=0.189, trig=0.179, accum=4, step=72, kl=0.063] SFT Epoch 1/2: 35%|β–ˆβ–ˆβ–ˆβ–Œ | 72/205 [02:36<04:30, 2.03s/it, loss=0.224, sft=0.192, clean=0.200, trig=0.189, accum=4, step=73, kl=0.064] SFT Epoch 1/2: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 73/205 [02:36<04:33, 2.07s/it, loss=0.224, sft=0.192, clean=0.200, trig=0.189, accum=4, step=73, kl=0.064] SFT Epoch 1/2: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 73/205 [02:38<04:33, 2.07s/it, loss=0.258, sft=0.225, clean=0.227, trig=0.224, accum=4, step=74, kl=0.065] SFT Epoch 1/2: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 74/205 [02:38<04:23, 2.01s/it, loss=0.258, sft=0.225, clean=0.227, trig=0.224, accum=4, step=74, kl=0.065] SFT Epoch 1/2: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 74/205 [02:40<04:23, 2.01s/it, loss=0.255, sft=0.220, clean=0.204, trig=0.227, accum=4, step=75, kl=0.070] SFT Epoch 1/2: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 75/205 [02:40<04:25, 2.05s/it, loss=0.255, sft=0.220, clean=0.204, trig=0.227, accum=4, step=75, kl=0.070] SFT Epoch 1/2: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 75/205 [02:42<04:25, 2.05s/it, loss=0.210, sft=0.185, clean=0.188, trig=0.184, accum=4, step=76, kl=0.049] SFT Epoch 1/2: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 76/205 [02:42<04:29, 2.09s/it, loss=0.210, sft=0.185, clean=0.188, trig=0.184, accum=4, step=76, kl=0.049] SFT Epoch 1/2: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 76/205 [02:44<04:29, 2.09s/it, loss=0.204, sft=0.169, clean=0.174, trig=0.167, accum=4, step=77, kl=0.071] SFT Epoch 1/2: 38%|β–ˆβ–ˆβ–ˆβ–Š | 77/205 [02:44<04:13, 1.98s/it, loss=0.204, sft=0.169, clean=0.174, trig=0.167, accum=4, step=77, kl=0.071] SFT Epoch 1/2: 38%|β–ˆβ–ˆβ–ˆβ–Š | 77/205 [02:45<04:13, 1.98s/it, loss=0.191, sft=0.164, clean=0.165, trig=0.164, accum=4, step=78, kl=0.053] SFT Epoch 1/2: 38%|β–ˆβ–ˆβ–ˆβ–Š | 78/205 [02:45<04:06, 1.94s/it, loss=0.191, sft=0.164, clean=0.165, trig=0.164, accum=4, step=78, kl=0.053] SFT Epoch 1/2: 38%|β–ˆβ–ˆβ–ˆβ–Š | 78/205 [02:47<04:06, 1.94s/it, loss=0.196, sft=0.169, clean=0.171, trig=0.168, accum=4, step=79, kl=0.054] SFT Epoch 1/2: 39%|β–ˆβ–ˆβ–ˆβ–Š | 79/205 [02:47<04:08, 1.97s/it, loss=0.196, sft=0.169, clean=0.171, trig=0.168, accum=4, step=79, kl=0.054] SFT Epoch 1/2: 39%|β–ˆβ–ˆβ–ˆβ–Š | 79/205 [02:50<04:08, 1.97s/it, loss=0.193, sft=0.161, clean=0.163, trig=0.160, accum=4, step=80, kl=0.064] SFT Epoch 1/2: 39%|β–ˆβ–ˆβ–ˆβ–‰ | 80/205 [02:50<04:10, 2.01s/it, loss=0.193, sft=0.161, clean=0.163, trig=0.160, accum=4, step=80, kl=0.064] SFT Epoch 1/2: 39%|β–ˆβ–ˆβ–ˆβ–‰ | 80/205 [02:52<04:10, 2.01s/it, loss=0.251, sft=0.216, clean=0.219, trig=0.215, accum=4, step=81, kl=0.070] SFT Epoch 1/2: 40%|β–ˆβ–ˆβ–ˆβ–‰ | 81/205 [02:52<04:15, 2.06s/it, loss=0.251, sft=0.216, clean=0.219, trig=0.215, accum=4, step=81, kl=0.070] SFT Epoch 1/2: 40%|β–ˆβ–ˆβ–ˆβ–‰ | 81/205 [02:54<04:15, 2.06s/it, loss=0.228, sft=0.192, clean=0.195, trig=0.191, accum=4, step=82, kl=0.070] SFT Epoch 1/2: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 82/205 [02:54<04:16, 2.09s/it, loss=0.228, sft=0.192, clean=0.195, trig=0.191, accum=4, step=82, kl=0.070] SFT Epoch 1/2: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 82/205 [02:56<04:16, 2.09s/it, loss=0.193, sft=0.163, clean=0.166, trig=0.162, accum=4, step=83, kl=0.060] SFT Epoch 1/2: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 83/205 [02:56<04:19, 2.13s/it, loss=0.193, sft=0.163, clean=0.166, trig=0.162, accum=4, step=83, kl=0.060] SFT Epoch 1/2: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 83/205 [02:59<04:19, 2.13s/it, loss=0.166, sft=0.138, clean=0.143, trig=0.136, accum=4, step=84, kl=0.055] SFT Epoch 1/2: 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 84/205 [02:59<04:28, 2.22s/it, loss=0.166, sft=0.138, clean=0.143, trig=0.136, accum=4, step=84, kl=0.055] SFT Epoch 1/2: 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 84/205 [03:01<04:28, 2.22s/it, loss=0.247, sft=0.218, clean=0.220, trig=0.217, accum=4, step=85, kl=0.059] SFT Epoch 1/2: 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 85/205 [03:01<04:23, 2.19s/it, loss=0.247, sft=0.218, clean=0.220, trig=0.217, accum=4, step=85, kl=0.059] SFT Epoch 1/2: 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 85/205 [03:03<04:23, 2.19s/it, loss=0.267, sft=0.234, clean=0.234, trig=0.234, accum=4, step=86, kl=0.067] SFT Epoch 1/2: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 86/205 [03:03<04:17, 2.17s/it, loss=0.267, sft=0.234, clean=0.234, trig=0.234, accum=4, step=86, kl=0.067] SFT Epoch 1/2: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 86/205 [03:05<04:17, 2.17s/it, loss=0.260, sft=0.223, clean=0.225, trig=0.222, accum=4, step=87, kl=0.075] SFT Epoch 1/2: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 87/205 [03:05<04:10, 2.12s/it, loss=0.260, sft=0.223, clean=0.225, trig=0.222, accum=4, step=87, kl=0.075] SFT Epoch 1/2: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 87/205 [03:07<04:10, 2.12s/it, loss=0.259, sft=0.225, clean=0.232, trig=0.222, accum=4, step=88, kl=0.068] SFT Epoch 1/2: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 88/205 [03:07<04:04, 2.09s/it, loss=0.259, sft=0.225, clean=0.232, trig=0.222, accum=4, step=88, kl=0.068] SFT Epoch 1/2: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 88/205 [03:09<04:04, 2.09s/it, loss=0.192, sft=0.166, clean=0.162, trig=0.168, accum=4, step=89, kl=0.051] SFT Epoch 1/2: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 89/205 [03:09<03:57, 2.05s/it, loss=0.192, sft=0.166, clean=0.162, trig=0.168, accum=4, step=89, kl=0.051] SFT Epoch 1/2: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 89/205 [03:11<03:57, 2.05s/it, loss=0.230, sft=0.198, clean=0.200, trig=0.197, accum=4, step=90, kl=0.065] SFT Epoch 1/2: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 90/205 [03:11<03:54, 2.03s/it, loss=0.230, sft=0.198, clean=0.200, trig=0.197, accum=4, step=90, kl=0.065] SFT Epoch 1/2: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 90/205 [03:13<03:54, 2.03s/it, loss=0.246, sft=0.213, clean=0.217, trig=0.211, accum=4, step=91, kl=0.066] SFT Epoch 1/2: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 91/205 [03:13<03:53, 2.05s/it, loss=0.246, sft=0.213, clean=0.217, trig=0.211, accum=4, step=91, kl=0.066] SFT Epoch 1/2: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 91/205 [03:15<03:53, 2.05s/it, loss=0.232, sft=0.197, clean=0.199, trig=0.196, accum=4, step=92, kl=0.071] SFT Epoch 1/2: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 92/205 [03:15<03:51, 2.05s/it, loss=0.232, sft=0.197, clean=0.199, trig=0.196, accum=4, step=92, kl=0.071] SFT Epoch 1/2: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 92/205 [03:17<03:51, 2.05s/it, loss=0.242, sft=0.210, clean=0.213, trig=0.209, accum=4, step=93, kl=0.063] SFT Epoch 1/2: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 93/205 [03:17<03:49, 2.05s/it, loss=0.242, sft=0.210, clean=0.213, trig=0.209, accum=4, step=93, kl=0.063] SFT Epoch 1/2: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 93/205 [03:19<03:49, 2.05s/it, loss=0.220, sft=0.190, clean=0.201, trig=0.186, accum=4, step=94, kl=0.059] SFT Epoch 1/2: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 94/205 [03:19<03:50, 2.08s/it, loss=0.220, sft=0.190, clean=0.201, trig=0.186, accum=4, step=94, kl=0.059] SFT Epoch 1/2: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 94/205 [03:21<03:50, 2.08s/it, loss=0.251, sft=0.220, clean=0.217, trig=0.221, accum=4, step=95, kl=0.062] SFT Epoch 1/2: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 95/205 [03:21<03:41, 2.01s/it, loss=0.251, sft=0.220, clean=0.217, trig=0.221, accum=4, step=95, kl=0.062] SFT Epoch 1/2: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 95/205 [03:23<03:41, 2.01s/it, loss=0.186, sft=0.156, clean=0.159, trig=0.154, accum=4, step=96, kl=0.060] SFT Epoch 1/2: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/205 [03:23<03:40, 2.02s/it, loss=0.186, sft=0.156, clean=0.159, trig=0.154, accum=4, step=96, kl=0.060] SFT Epoch 1/2: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/205 [03:25<03:40, 2.02s/it, loss=0.235, sft=0.204, clean=0.210, trig=0.202, accum=4, step=97, kl=0.063] SFT Epoch 1/2: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/205 [03:25<03:45, 2.09s/it, loss=0.235, sft=0.204, clean=0.210, trig=0.202, accum=4, step=97, kl=0.063] SFT Epoch 1/2: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/205 [03:27<03:45, 2.09s/it, loss=0.204, sft=0.182, clean=0.181, trig=0.182, accum=4, step=98, kl=0.046] SFT Epoch 1/2: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/205 [03:27<03:36, 2.02s/it, loss=0.204, sft=0.182, clean=0.181, trig=0.182, accum=4, step=98, kl=0.046] SFT Epoch 1/2: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/205 [03:29<03:36, 2.02s/it, loss=0.229, sft=0.198, clean=0.200, trig=0.196, accum=4, step=99, kl=0.062] SFT Epoch 1/2: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 99/205 [03:29<03:30, 1.99s/it, loss=0.229, sft=0.198, clean=0.200, trig=0.196, accum=4, step=99, kl=0.062] SFT Epoch 1/2: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 99/205 [03:31<03:30, 1.99s/it, loss=0.329, sft=0.292, clean=0.285, trig=0.295, accum=4, step=100, kl=0.074] SFT Epoch 1/2: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 100/205 [03:31<03:23, 1.94s/it, loss=0.329, sft=0.292, clean=0.285, trig=0.295, accum=4, step=100, kl=0.074] SFT Epoch 1/2: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 100/205 [03:33<03:23, 1.94s/it, loss=0.180, sft=0.154, clean=0.157, trig=0.153, accum=4, step=101, kl=0.052] SFT Epoch 1/2: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 101/205 [03:33<03:30, 2.02s/it, loss=0.180, sft=0.154, clean=0.157, trig=0.153, accum=4, step=101, kl=0.052] SFT Epoch 1/2: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 101/205 [03:35<03:30, 2.02s/it, loss=0.221, sft=0.189, clean=0.192, trig=0.188, accum=4, step=102, kl=0.064] SFT Epoch 1/2: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 102/205 [03:35<03:28, 2.02s/it, loss=0.221, sft=0.189, clean=0.192, trig=0.188, accum=4, step=102, kl=0.064] SFT Epoch 1/2: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 102/205 [03:37<03:28, 2.02s/it, loss=0.143, sft=0.115, clean=0.112, trig=0.116, accum=4, step=103, kl=0.056] SFT Epoch 1/2: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 103/205 [03:37<03:24, 2.00s/it, loss=0.143, sft=0.115, clean=0.112, trig=0.116, accum=4, step=103, kl=0.056] SFT Epoch 1/2: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 103/205 [03:39<03:24, 2.00s/it, loss=0.187, sft=0.154, clean=0.157, trig=0.152, accum=4, step=104, kl=0.067] SFT Epoch 1/2: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 104/205 [03:39<03:14, 1.92s/it, loss=0.187, sft=0.154, clean=0.157, trig=0.152, accum=4, step=104, kl=0.067] SFT Epoch 1/2: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 104/205 [03:41<03:14, 1.92s/it, loss=0.153, sft=0.129, clean=0.130, trig=0.128, accum=4, step=105, kl=0.049] SFT Epoch 1/2: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 105/205 [03:41<03:12, 1.93s/it, loss=0.153, sft=0.129, clean=0.130, trig=0.128, accum=4, step=105, kl=0.049] SFT Epoch 1/2: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 105/205 [03:43<03:12, 1.93s/it, loss=0.309, sft=0.267, clean=0.271, trig=0.266, accum=4, step=106, kl=0.082] SFT Epoch 1/2: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 106/205 [03:43<03:25, 2.08s/it, loss=0.309, sft=0.267, clean=0.271, trig=0.266, accum=4, step=106, kl=0.082] SFT Epoch 1/2: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 106/205 [03:45<03:25, 2.08s/it, loss=0.253, sft=0.220, clean=0.226, trig=0.217, accum=4, step=107, kl=0.066] SFT Epoch 1/2: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 107/205 [03:45<03:18, 2.03s/it, loss=0.253, sft=0.220, clean=0.226, trig=0.217, accum=4, step=107, kl=0.066] SFT Epoch 1/2: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 107/205 [03:47<03:18, 2.03s/it, loss=0.219, sft=0.191, clean=0.190, trig=0.191, accum=4, step=108, kl=0.055] SFT Epoch 1/2: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 108/205 [03:47<03:20, 2.07s/it, loss=0.219, sft=0.191, clean=0.190, trig=0.191, accum=4, step=108, kl=0.055] SFT Epoch 1/2: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 108/205 [03:49<03:20, 2.07s/it, loss=0.209, sft=0.180, clean=0.182, trig=0.179, accum=4, step=109, kl=0.059] SFT Epoch 1/2: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 109/205 [03:49<03:14, 2.02s/it, loss=0.209, sft=0.180, clean=0.182, trig=0.179, accum=4, step=109, kl=0.059] SFT Epoch 1/2: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 109/205 [03:51<03:14, 2.02s/it, loss=0.204, sft=0.166, clean=0.167, trig=0.166, accum=4, step=110, kl=0.076] SFT Epoch 1/2: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 110/205 [03:51<03:11, 2.02s/it, loss=0.204, sft=0.166, clean=0.167, trig=0.166, accum=4, step=110, kl=0.076] SFT Epoch 1/2: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 110/205 [03:53<03:11, 2.02s/it, loss=0.327, sft=0.290, clean=0.298, trig=0.287, accum=4, step=111, kl=0.074] SFT Epoch 1/2: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 111/205 [03:53<03:04, 1.96s/it, loss=0.327, sft=0.290, clean=0.298, trig=0.287, accum=4, step=111, kl=0.074] SFT Epoch 1/2: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 111/205 [03:55<03:04, 1.96s/it, loss=0.212, sft=0.176, clean=0.183, trig=0.173, accum=4, step=112, kl=0.072] SFT Epoch 1/2: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 112/205 [03:55<03:02, 1.96s/it, loss=0.212, sft=0.176, clean=0.183, trig=0.173, accum=4, step=112, kl=0.072] SFT Epoch 1/2: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 112/205 [03:57<03:02, 1.96s/it, loss=0.184, sft=0.158, clean=0.164, trig=0.155, accum=4, step=113, kl=0.052] SFT Epoch 1/2: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 113/205 [03:57<03:06, 2.02s/it, loss=0.184, sft=0.158, clean=0.164, trig=0.155, accum=4, step=113, kl=0.052] SFT Epoch 1/2: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 113/205 [03:59<03:06, 2.02s/it, loss=0.252, sft=0.217, clean=0.218, trig=0.216, accum=4, step=114, kl=0.070] SFT Epoch 1/2: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 114/205 [03:59<03:14, 2.13s/it, loss=0.252, sft=0.217, clean=0.218, trig=0.216, accum=4, step=114, kl=0.070] SFT Epoch 1/2: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 114/205 [04:02<03:14, 2.13s/it, loss=0.244, sft=0.205, clean=0.212, trig=0.203, accum=4, step=115, kl=0.078] SFT Epoch 1/2: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 115/205 [04:02<03:09, 2.11s/it, loss=0.244, sft=0.205, clean=0.212, trig=0.203, accum=4, step=115, kl=0.078] SFT Epoch 1/2: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 115/205 [04:04<03:09, 2.11s/it, loss=0.239, sft=0.210, clean=0.213, trig=0.209, accum=4, step=116, kl=0.057] SFT Epoch 1/2: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 116/205 [04:04<03:06, 2.09s/it, loss=0.239, sft=0.210, clean=0.213, trig=0.209, accum=4, step=116, kl=0.057] SFT Epoch 1/2: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 116/205 [04:06<03:06, 2.09s/it, loss=0.172, sft=0.143, clean=0.145, trig=0.142, accum=4, step=117, kl=0.057] SFT Epoch 1/2: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 117/205 [04:06<03:02, 2.07s/it, loss=0.172, sft=0.143, clean=0.145, trig=0.142, accum=4, step=117, kl=0.057] SFT Epoch 1/2: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 117/205 [04:07<03:02, 2.07s/it, loss=0.154, sft=0.131, clean=0.131, trig=0.131, accum=4, step=118, kl=0.046] SFT Epoch 1/2: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 118/205 [04:07<02:53, 2.00s/it, loss=0.154, sft=0.131, clean=0.131, trig=0.131, accum=4, step=118, kl=0.046] SFT Epoch 1/2: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 118/205 [04:10<02:53, 2.00s/it, loss=0.224, sft=0.191, clean=0.188, trig=0.193, accum=4, step=119, kl=0.066] SFT Epoch 1/2: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 119/205 [04:10<02:57, 2.06s/it, loss=0.224, sft=0.191, clean=0.188, trig=0.193, accum=4, step=119, kl=0.066] SFT Epoch 1/2: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 119/205 [04:12<02:57, 2.06s/it, loss=0.183, sft=0.161, clean=0.158, trig=0.162, accum=4, step=120, kl=0.044] SFT Epoch 1/2: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 120/205 [04:12<03:01, 2.14s/it, loss=0.183, sft=0.161, clean=0.158, trig=0.162, accum=4, step=120, kl=0.044] SFT Epoch 1/2: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 120/205 [04:14<03:01, 2.14s/it, loss=0.266, sft=0.230, clean=0.232, trig=0.229, accum=4, step=121, kl=0.072] SFT Epoch 1/2: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 121/205 [04:14<02:51, 2.04s/it, loss=0.266, sft=0.230, clean=0.232, trig=0.229, accum=4, step=121, kl=0.072] SFT Epoch 1/2: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 121/205 [04:16<02:51, 2.04s/it, loss=0.198, sft=0.168, clean=0.169, trig=0.168, accum=4, step=122, kl=0.061] SFT Epoch 1/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 122/205 [04:16<02:48, 2.04s/it, loss=0.198, sft=0.168, clean=0.169, trig=0.168, accum=4, step=122, kl=0.061] SFT Epoch 1/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 122/205 [04:18<02:48, 2.04s/it, loss=0.213, sft=0.182, clean=0.190, trig=0.179, accum=4, step=123, kl=0.063] SFT Epoch 1/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 123/205 [04:18<02:51, 2.09s/it, loss=0.213, sft=0.182, clean=0.190, trig=0.179, accum=4, step=123, kl=0.063] SFT Epoch 1/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 123/205 [04:20<02:51, 2.09s/it, loss=0.158, sft=0.134, clean=0.134, trig=0.134, accum=4, step=124, kl=0.047] SFT Epoch 1/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 124/205 [04:20<02:49, 2.10s/it, loss=0.158, sft=0.134, clean=0.134, trig=0.134, accum=4, step=124, kl=0.047] SFT Epoch 1/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 124/205 [04:22<02:49, 2.10s/it, loss=0.172, sft=0.143, clean=0.143, trig=0.143, accum=4, step=125, kl=0.059] SFT Epoch 1/2: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 125/205 [04:22<02:43, 2.05s/it, loss=0.172, sft=0.143, clean=0.143, trig=0.143, accum=4, step=125, kl=0.059] SFT Epoch 1/2: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 125/205 [04:24<02:43, 2.05s/it, loss=0.209, sft=0.181, clean=0.184, trig=0.180, accum=4, step=126, kl=0.057] SFT Epoch 1/2: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 126/205 [04:24<02:41, 2.04s/it, loss=0.209, sft=0.181, clean=0.184, trig=0.180, accum=4, step=126, kl=0.057] SFT Epoch 1/2: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 126/205 [04:27<02:41, 2.04s/it, loss=0.203, sft=0.174, clean=0.181, trig=0.172, accum=4, step=127, kl=0.057] SFT Epoch 1/2: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 127/205 [04:27<02:48, 2.15s/it, loss=0.203, sft=0.174, clean=0.181, trig=0.172, accum=4, step=127, kl=0.057] SFT Epoch 1/2: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 127/205 [04:29<02:48, 2.15s/it, loss=0.220, sft=0.192, clean=0.193, trig=0.192, accum=4, step=128, kl=0.056] SFT Epoch 1/2: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 128/205 [04:29<02:46, 2.16s/it, loss=0.220, sft=0.192, clean=0.193, trig=0.192, accum=4, step=128, kl=0.056] SFT Epoch 1/2: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 128/205 [04:31<02:46, 2.16s/it, loss=0.184, sft=0.161, clean=0.164, trig=0.159, accum=4, step=129, kl=0.047] SFT Epoch 1/2: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 129/205 [04:31<02:48, 2.21s/it, loss=0.184, sft=0.161, clean=0.164, trig=0.159, accum=4, step=129, kl=0.047] SFT Epoch 1/2: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 129/205 [04:33<02:48, 2.21s/it, loss=0.196, sft=0.163, clean=0.166, trig=0.162, accum=4, step=130, kl=0.066] SFT Epoch 1/2: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 130/205 [04:33<02:48, 2.25s/it, loss=0.196, sft=0.163, clean=0.166, trig=0.162, accum=4, step=130, kl=0.066] SFT Epoch 1/2: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 130/205 [04:36<02:48, 2.25s/it, loss=0.188, sft=0.164, clean=0.164, trig=0.164, accum=4, step=131, kl=0.048] SFT Epoch 1/2: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 131/205 [04:36<02:47, 2.27s/it, loss=0.188, sft=0.164, clean=0.164, trig=0.164, accum=4, step=131, kl=0.048] SFT Epoch 1/2: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 131/205 [04:38<02:47, 2.27s/it, loss=0.237, sft=0.205, clean=0.208, trig=0.204, accum=4, step=132, kl=0.063] SFT Epoch 1/2: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 132/205 [04:38<02:52, 2.36s/it, loss=0.237, sft=0.205, clean=0.208, trig=0.204, accum=4, step=132, kl=0.063] SFT Epoch 1/2: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 132/205 [04:40<02:52, 2.36s/it, loss=0.221, sft=0.186, clean=0.188, trig=0.185, accum=4, step=133, kl=0.071] SFT Epoch 1/2: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 133/205 [04:40<02:39, 2.22s/it, loss=0.221, sft=0.186, clean=0.188, trig=0.185, accum=4, step=133, kl=0.071] SFT Epoch 1/2: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 133/205 [04:42<02:39, 2.22s/it, loss=0.273, sft=0.236, clean=0.242, trig=0.234, accum=4, step=134, kl=0.073] SFT Epoch 1/2: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 134/205 [04:42<02:33, 2.16s/it, loss=0.273, sft=0.236, clean=0.242, trig=0.234, accum=4, step=134, kl=0.073] SFT Epoch 1/2: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 134/205 [04:44<02:33, 2.16s/it, loss=0.188, sft=0.164, clean=0.166, trig=0.164, accum=4, step=135, kl=0.048] SFT Epoch 1/2: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 135/205 [04:44<02:28, 2.12s/it, loss=0.188, sft=0.164, clean=0.166, trig=0.164, accum=4, step=135, kl=0.048] SFT Epoch 1/2: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 135/205 [04:46<02:28, 2.12s/it, loss=0.236, sft=0.209, clean=0.216, trig=0.206, accum=4, step=136, kl=0.055] SFT Epoch 1/2: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 136/205 [04:46<02:22, 2.07s/it, loss=0.236, sft=0.209, clean=0.216, trig=0.206, accum=4, step=136, kl=0.055] SFT Epoch 1/2: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 136/205 [04:48<02:22, 2.07s/it, loss=0.212, sft=0.178, clean=0.177, trig=0.178, accum=4, step=137, kl=0.068] SFT Epoch 1/2: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 137/205 [04:48<02:22, 2.09s/it, loss=0.212, sft=0.178, clean=0.177, trig=0.178, accum=4, step=137, kl=0.068] SFT Epoch 1/2: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 137/205 [04:51<02:22, 2.09s/it, loss=0.239, sft=0.205, clean=0.205, trig=0.205, accum=4, step=138, kl=0.068] SFT Epoch 1/2: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 138/205 [04:51<02:24, 2.16s/it, loss=0.239, sft=0.205, clean=0.205, trig=0.205, accum=4, step=138, kl=0.068] SFT Epoch 1/2: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 138/205 [04:52<02:24, 2.16s/it, loss=0.104, sft=0.092, clean=0.092, trig=0.092, accum=4, step=139, kl=0.025] SFT Epoch 1/2: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 139/205 [04:52<02:15, 2.06s/it, loss=0.104, sft=0.092, clean=0.092, trig=0.092, accum=4, step=139, kl=0.025] SFT Epoch 1/2: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 139/205 [04:55<02:15, 2.06s/it, loss=0.203, sft=0.174, clean=0.185, trig=0.169, accum=4, step=140, kl=0.059] SFT Epoch 1/2: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 140/205 [04:55<02:17, 2.11s/it, loss=0.203, sft=0.174, clean=0.185, trig=0.169, accum=4, step=140, kl=0.059] SFT Epoch 1/2: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 140/205 [04:57<02:17, 2.11s/it, loss=0.177, sft=0.150, clean=0.150, trig=0.150, accum=4, step=141, kl=0.054] SFT Epoch 1/2: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 141/205 [04:57<02:16, 2.13s/it, loss=0.177, sft=0.150, clean=0.150, trig=0.150, accum=4, step=141, kl=0.054] SFT Epoch 1/2: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 141/205 [04:59<02:16, 2.13s/it, loss=0.199, sft=0.170, clean=0.176, trig=0.167, accum=4, step=142, kl=0.058] SFT Epoch 1/2: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 142/205 [04:59<02:17, 2.19s/it, loss=0.199, sft=0.170, clean=0.176, trig=0.167, accum=4, step=142, kl=0.058] SFT Epoch 1/2: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 142/205 [05:01<02:17, 2.19s/it, loss=0.210, sft=0.185, clean=0.188, trig=0.184, accum=4, step=143, kl=0.051] SFT Epoch 1/2: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 143/205 [05:01<02:09, 2.08s/it, loss=0.210, sft=0.185, clean=0.188, trig=0.184, accum=4, step=143, kl=0.051] SFT Epoch 1/2: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 143/205 [05:03<02:09, 2.08s/it, loss=0.259, sft=0.221, clean=0.224, trig=0.219, accum=4, step=144, kl=0.076] SFT Epoch 1/2: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 144/205 [05:03<02:03, 2.02s/it, loss=0.259, sft=0.221, clean=0.224, trig=0.219, accum=4, step=144, kl=0.076] SFT Epoch 1/2: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 144/205 [05:05<02:03, 2.02s/it, loss=0.182, sft=0.152, clean=0.151, trig=0.152, accum=4, step=145, kl=0.061] SFT Epoch 1/2: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 145/205 [05:05<02:07, 2.12s/it, loss=0.182, sft=0.152, clean=0.151, trig=0.152, accum=4, step=145, kl=0.061] SFT Epoch 1/2: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 145/205 [05:07<02:07, 2.12s/it, loss=0.266, sft=0.232, clean=0.239, trig=0.230, accum=4, step=146, kl=0.068] SFT Epoch 1/2: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 146/205 [05:07<01:57, 1.99s/it, loss=0.266, sft=0.232, clean=0.239, trig=0.230, accum=4, step=146, kl=0.068] SFT Epoch 1/2: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 146/205 [05:09<01:57, 1.99s/it, loss=0.204, sft=0.175, clean=0.177, trig=0.174, accum=4, step=147, kl=0.059] SFT Epoch 1/2: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 147/205 [05:09<01:58, 2.04s/it, loss=0.204, sft=0.175, clean=0.177, trig=0.174, accum=4, step=147, kl=0.059] SFT Epoch 1/2: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 147/205 [05:11<01:58, 2.04s/it, loss=0.257, sft=0.220, clean=0.223, trig=0.219, accum=4, step=148, kl=0.074] SFT Epoch 1/2: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 148/205 [05:11<01:54, 2.00s/it, loss=0.257, sft=0.220, clean=0.223, trig=0.219, accum=4, step=148, kl=0.074] SFT Epoch 1/2: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 148/205 [05:13<01:54, 2.00s/it, loss=0.283, sft=0.244, clean=0.248, trig=0.242, accum=4, step=149, kl=0.079] SFT Epoch 1/2: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 149/205 [05:13<01:50, 1.98s/it, loss=0.283, sft=0.244, clean=0.248, trig=0.242, accum=4, step=149, kl=0.079] SFT Epoch 1/2: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 149/205 [05:15<01:50, 1.98s/it, loss=0.183, sft=0.153, clean=0.157, trig=0.151, accum=4, step=150, kl=0.060] SFT Epoch 1/2: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 150/205 [05:15<01:49, 1.99s/it, loss=0.183, sft=0.153, clean=0.157, trig=0.151, accum=4, step=150, kl=0.060] SFT Epoch 1/2: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 150/205 [05:17<01:49, 1.99s/it, loss=0.176, sft=0.152, clean=0.150, trig=0.152, accum=4, step=151, kl=0.048] SFT Epoch 1/2: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 151/205 [05:17<01:54, 2.12s/it, loss=0.176, sft=0.152, clean=0.150, trig=0.152, accum=4, step=151, kl=0.048] SFT Epoch 1/2: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 151/205 [05:20<01:54, 2.12s/it, loss=0.182, sft=0.153, clean=0.156, trig=0.151, accum=4, step=152, kl=0.058] SFT Epoch 1/2: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 152/205 [05:20<01:54, 2.16s/it, loss=0.182, sft=0.153, clean=0.156, trig=0.151, accum=4, step=152, kl=0.058] SFT Epoch 1/2: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 152/205 [05:22<01:54, 2.16s/it, loss=0.228, sft=0.194, clean=0.200, trig=0.191, accum=4, step=153, kl=0.070] SFT Epoch 1/2: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 153/205 [05:22<01:51, 2.14s/it, loss=0.228, sft=0.194, clean=0.200, trig=0.191, accum=4, step=153, kl=0.070] SFT Epoch 1/2: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 153/205 [05:24<01:51, 2.14s/it, loss=0.258, sft=0.218, clean=0.222, trig=0.216, accum=4, step=154, kl=0.081] SFT Epoch 1/2: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 154/205 [05:24<01:46, 2.09s/it, loss=0.258, sft=0.218, clean=0.222, trig=0.216, accum=4, step=154, kl=0.081] SFT Epoch 1/2: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 154/205 [05:26<01:46, 2.09s/it, loss=0.288, sft=0.259, clean=0.265, trig=0.256, accum=4, step=155, kl=0.059] SFT Epoch 1/2: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 155/205 [05:26<01:43, 2.08s/it, loss=0.288, sft=0.259, clean=0.265, trig=0.256, accum=4, step=155, kl=0.059] SFT Epoch 1/2: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 155/205 [05:28<01:43, 2.08s/it, loss=0.215, sft=0.188, clean=0.188, trig=0.187, accum=4, step=156, kl=0.055] SFT Epoch 1/2: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 156/205 [05:28<01:39, 2.02s/it, loss=0.215, sft=0.188, clean=0.188, trig=0.187, accum=4, step=156, kl=0.055] SFT Epoch 1/2: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 156/205 [05:30<01:39, 2.02s/it, loss=0.183, sft=0.145, clean=0.147, trig=0.145, accum=4, step=157, kl=0.076] SFT Epoch 1/2: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 157/205 [05:30<01:36, 2.02s/it, loss=0.183, sft=0.145, clean=0.147, trig=0.145, accum=4, step=157, kl=0.076] SFT Epoch 1/2: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 157/205 [05:32<01:36, 2.02s/it, loss=0.243, sft=0.212, clean=0.217, trig=0.210, accum=4, step=158, kl=0.062] SFT Epoch 1/2: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 158/205 [05:32<01:37, 2.08s/it, loss=0.243, sft=0.212, clean=0.217, trig=0.210, accum=4, step=158, kl=0.062] SFT Epoch 1/2: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 158/205 [05:34<01:37, 2.08s/it, loss=0.210, sft=0.181, clean=0.184, trig=0.179, accum=4, step=159, kl=0.058] SFT Epoch 1/2: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 159/205 [05:34<01:39, 2.16s/it, loss=0.210, sft=0.181, clean=0.184, trig=0.179, accum=4, step=159, kl=0.058] SFT Epoch 1/2: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 159/205 [05:36<01:39, 2.16s/it, loss=0.215, sft=0.183, clean=0.182, trig=0.184, accum=4, step=160, kl=0.065] SFT Epoch 1/2: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 160/205 [05:36<01:31, 2.03s/it, loss=0.215, sft=0.183, clean=0.182, trig=0.184, accum=4, step=160, kl=0.065] SFT Epoch 1/2: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 160/205 [05:38<01:31, 2.03s/it, loss=0.267, sft=0.230, clean=0.234, trig=0.229, accum=4, step=161, kl=0.074] SFT Epoch 1/2: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 161/205 [05:38<01:27, 1.99s/it, loss=0.267, sft=0.230, clean=0.234, trig=0.229, accum=4, step=161, kl=0.074] SFT Epoch 1/2: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 161/205 [05:40<01:27, 1.99s/it, loss=0.195, sft=0.165, clean=0.167, trig=0.164, accum=4, step=162, kl=0.059] SFT Epoch 1/2: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 162/205 [05:40<01:25, 2.00s/it, loss=0.195, sft=0.165, clean=0.167, trig=0.164, accum=4, step=162, kl=0.059] SFT Epoch 1/2: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 162/205 [05:42<01:25, 2.00s/it, loss=0.243, sft=0.212, clean=0.219, trig=0.209, accum=4, step=163, kl=0.062] SFT Epoch 1/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 163/205 [05:42<01:24, 2.01s/it, loss=0.243, sft=0.212, clean=0.219, trig=0.209, accum=4, step=163, kl=0.062] SFT Epoch 1/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 163/205 [05:44<01:24, 2.01s/it, loss=0.191, sft=0.164, clean=0.166, trig=0.163, accum=4, step=164, kl=0.055] SFT Epoch 1/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 164/205 [05:44<01:21, 1.98s/it, loss=0.191, sft=0.164, clean=0.166, trig=0.163, accum=4, step=164, kl=0.055] SFT Epoch 1/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 164/205 [05:46<01:21, 1.98s/it, loss=0.178, sft=0.150, clean=0.151, trig=0.150, accum=4, step=165, kl=0.055] SFT Epoch 1/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 165/205 [05:46<01:18, 1.96s/it, loss=0.178, sft=0.150, clean=0.151, trig=0.150, accum=4, step=165, kl=0.055] SFT Epoch 1/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 165/205 [05:48<01:18, 1.96s/it, loss=0.158, sft=0.130, clean=0.134, trig=0.129, accum=4, step=166, kl=0.056] SFT Epoch 1/2: 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 166/205 [05:48<01:18, 2.01s/it, loss=0.158, sft=0.130, clean=0.134, trig=0.129, accum=4, step=166, kl=0.056] SFT Epoch 1/2: 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 166/205 [05:50<01:18, 2.01s/it, loss=0.176, sft=0.151, clean=0.154, trig=0.150, accum=4, step=167, kl=0.048] SFT Epoch 1/2: 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 167/205 [05:50<01:17, 2.03s/it, loss=0.176, sft=0.151, clean=0.154, trig=0.150, accum=4, step=167, kl=0.048] SFT Epoch 1/2: 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 167/205 [05:52<01:17, 2.03s/it, loss=0.199, sft=0.172, clean=0.175, trig=0.171, accum=4, step=168, kl=0.054] SFT Epoch 1/2: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 168/205 [05:52<01:14, 2.02s/it, loss=0.199, sft=0.172, clean=0.175, trig=0.171, accum=4, step=168, kl=0.054] SFT Epoch 1/2: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 168/205 [05:54<01:14, 2.02s/it, loss=0.189, sft=0.159, clean=0.164, trig=0.157, accum=4, step=169, kl=0.059] SFT Epoch 1/2: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 169/205 [05:54<01:11, 2.00s/it, loss=0.189, sft=0.159, clean=0.164, trig=0.157, accum=4, step=169, kl=0.059] SFT Epoch 1/2: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 169/205 [05:56<01:11, 2.00s/it, loss=0.231, sft=0.202, clean=0.202, trig=0.202, accum=4, step=170, kl=0.058] SFT Epoch 1/2: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 170/205 [05:56<01:11, 2.05s/it, loss=0.231, sft=0.202, clean=0.202, trig=0.202, accum=4, step=170, kl=0.058] SFT Epoch 1/2: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 170/205 [05:58<01:11, 2.05s/it, loss=0.245, sft=0.216, clean=0.219, trig=0.214, accum=4, step=171, kl=0.059] SFT Epoch 1/2: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 171/205 [05:58<01:08, 2.03s/it, loss=0.245, sft=0.216, clean=0.219, trig=0.214, accum=4, step=171, kl=0.059] SFT Epoch 1/2: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 171/205 [06:00<01:08, 2.03s/it, loss=0.229, sft=0.196, clean=0.179, trig=0.203, accum=4, step=172, kl=0.067] SFT Epoch 1/2: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 172/205 [06:00<01:09, 2.09s/it, loss=0.229, sft=0.196, clean=0.179, trig=0.203, accum=4, step=172, kl=0.067] SFT Epoch 1/2: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 172/205 [06:02<01:09, 2.09s/it, loss=0.277, sft=0.237, clean=0.245, trig=0.233, accum=4, step=173, kl=0.081] SFT Epoch 1/2: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 173/205 [06:02<01:02, 1.94s/it, loss=0.277, sft=0.237, clean=0.245, trig=0.233, accum=4, step=173, kl=0.081] SFT Epoch 1/2: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 173/205 [06:04<01:02, 1.94s/it, loss=0.251, sft=0.219, clean=0.217, trig=0.221, accum=4, step=174, kl=0.063] SFT Epoch 1/2: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 174/205 [06:04<01:01, 1.97s/it, loss=0.251, sft=0.219, clean=0.217, trig=0.221, accum=4, step=174, kl=0.063] SFT Epoch 1/2: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 174/205 [06:06<01:01, 1.97s/it, loss=0.215, sft=0.185, clean=0.188, trig=0.184, accum=4, step=175, kl=0.061] SFT Epoch 1/2: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 175/205 [06:06<01:00, 2.02s/it, loss=0.215, sft=0.185, clean=0.188, trig=0.184, accum=4, step=175, kl=0.061] SFT Epoch 1/2: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 175/205 [06:08<01:00, 2.02s/it, loss=0.310, sft=0.271, clean=0.274, trig=0.270, accum=4, step=176, kl=0.077] SFT Epoch 1/2: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 176/205 [06:08<00:56, 1.95s/it, loss=0.310, sft=0.271, clean=0.274, trig=0.270, accum=4, step=176, kl=0.077] SFT Epoch 1/2: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 176/205 [06:10<00:56, 1.95s/it, loss=0.289, sft=0.247, clean=0.244, trig=0.249, accum=4, step=177, kl=0.083] SFT Epoch 1/2: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 177/205 [06:10<00:55, 1.99s/it, loss=0.289, sft=0.247, clean=0.244, trig=0.249, accum=4, step=177, kl=0.083] SFT Epoch 1/2: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 177/205 [06:12<00:55, 1.99s/it, loss=0.206, sft=0.169, clean=0.169, trig=0.169, accum=4, step=178, kl=0.075] SFT Epoch 1/2: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 178/205 [06:12<00:53, 1.98s/it, loss=0.206, sft=0.169, clean=0.169, trig=0.169, accum=4, step=178, kl=0.075] SFT Epoch 1/2: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 178/205 [06:14<00:53, 1.98s/it, loss=0.169, sft=0.139, clean=0.141, trig=0.138, accum=4, step=179, kl=0.059] SFT Epoch 1/2: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 179/205 [06:14<00:53, 2.06s/it, loss=0.169, sft=0.139, clean=0.141, trig=0.138, accum=4, step=179, kl=0.059] SFT Epoch 1/2: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 179/205 [06:16<00:53, 2.06s/it, loss=0.213, sft=0.179, clean=0.181, trig=0.178, accum=4, step=180, kl=0.069] SFT Epoch 1/2: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 180/205 [06:16<00:51, 2.07s/it, loss=0.213, sft=0.179, clean=0.181, trig=0.178, accum=4, step=180, kl=0.069] SFT Epoch 1/2: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 180/205 [06:18<00:51, 2.07s/it, loss=0.183, sft=0.161, clean=0.163, trig=0.160, accum=4, step=181, kl=0.043] SFT Epoch 1/2: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 181/205 [06:18<00:49, 2.08s/it, loss=0.183, sft=0.161, clean=0.163, trig=0.160, accum=4, step=181, kl=0.043] SFT Epoch 1/2: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 181/205 [06:20<00:49, 2.08s/it, loss=0.170, sft=0.141, clean=0.145, trig=0.140, accum=4, step=182, kl=0.058] SFT Epoch 1/2: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 182/205 [06:20<00:46, 2.03s/it, loss=0.170, sft=0.141, clean=0.145, trig=0.140, accum=4, step=182, kl=0.058] SFT Epoch 1/2: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 182/205 [06:22<00:46, 2.03s/it, loss=0.171, sft=0.149, clean=0.149, trig=0.149, accum=4, step=183, kl=0.045] SFT Epoch 1/2: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 183/205 [06:22<00:42, 1.94s/it, loss=0.171, sft=0.149, clean=0.149, trig=0.149, accum=4, step=183, kl=0.045] SFT Epoch 1/2: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 183/205 [06:24<00:42, 1.94s/it, loss=0.212, sft=0.187, clean=0.191, trig=0.186, accum=4, step=184, kl=0.049] SFT Epoch 1/2: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 184/205 [06:24<00:40, 1.92s/it, loss=0.212, sft=0.187, clean=0.191, trig=0.186, accum=4, step=184, kl=0.049] SFT Epoch 1/2: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 184/205 [06:26<00:40, 1.92s/it, loss=0.218, sft=0.183, clean=0.185, trig=0.182, accum=4, step=185, kl=0.069] SFT Epoch 1/2: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 185/205 [06:26<00:39, 1.99s/it, loss=0.218, sft=0.183, clean=0.185, trig=0.182, accum=4, step=185, kl=0.069] SFT Epoch 1/2: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 185/205 [06:28<00:39, 1.99s/it, loss=0.189, sft=0.166, clean=0.168, trig=0.165, accum=4, step=186, kl=0.046] SFT Epoch 1/2: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 186/205 [06:28<00:36, 1.92s/it, loss=0.189, sft=0.166, clean=0.168, trig=0.165, accum=4, step=186, kl=0.046] SFT Epoch 1/2: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 186/205 [06:30<00:36, 1.92s/it, loss=0.169, sft=0.147, clean=0.151, trig=0.146, accum=4, step=187, kl=0.045] SFT Epoch 1/2: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 187/205 [06:30<00:34, 1.92s/it, loss=0.169, sft=0.147, clean=0.151, trig=0.146, accum=4, step=187, kl=0.045] SFT Epoch 1/2: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 187/205 [06:32<00:34, 1.92s/it, loss=0.280, sft=0.246, clean=0.248, trig=0.244, accum=4, step=188, kl=0.069] SFT Epoch 1/2: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 188/205 [06:32<00:33, 1.96s/it, loss=0.280, sft=0.246, clean=0.248, trig=0.244, accum=4, step=188, kl=0.069] SFT Epoch 1/2: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 188/205 [06:34<00:33, 1.96s/it, loss=0.181, sft=0.154, clean=0.155, trig=0.153, accum=4, step=189, kl=0.055] SFT Epoch 1/2: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 189/205 [06:34<00:30, 1.94s/it, loss=0.181, sft=0.154, clean=0.155, trig=0.153, accum=4, step=189, kl=0.055] SFT Epoch 1/2: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 189/205 [06:35<00:30, 1.94s/it, loss=0.242, sft=0.209, clean=0.207, trig=0.210, accum=4, step=190, kl=0.066] SFT Epoch 1/2: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 190/205 [06:35<00:28, 1.89s/it, loss=0.242, sft=0.209, clean=0.207, trig=0.210, accum=4, step=190, kl=0.066] SFT Epoch 1/2: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 190/205 [06:37<00:28, 1.89s/it, loss=0.261, sft=0.216, clean=0.221, trig=0.213, accum=4, step=191, kl=0.090] SFT Epoch 1/2: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 191/205 [06:37<00:26, 1.89s/it, loss=0.261, sft=0.216, clean=0.221, trig=0.213, accum=4, step=191, kl=0.090] SFT Epoch 1/2: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 191/205 [06:39<00:26, 1.89s/it, loss=0.309, sft=0.264, clean=0.265, trig=0.264, accum=4, step=192, kl=0.090] SFT Epoch 1/2: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 192/205 [06:39<00:26, 2.02s/it, loss=0.309, sft=0.264, clean=0.265, trig=0.264, accum=4, step=192, kl=0.090] SFT Epoch 1/2: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 192/205 [06:42<00:26, 2.02s/it, loss=0.201, sft=0.164, clean=0.168, trig=0.162, accum=4, step=193, kl=0.075] SFT Epoch 1/2: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 193/205 [06:42<00:24, 2.02s/it, loss=0.201, sft=0.164, clean=0.168, trig=0.162, accum=4, step=193, kl=0.075] SFT Epoch 1/2: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 193/205 [06:44<00:24, 2.02s/it, loss=0.159, sft=0.133, clean=0.134, trig=0.133, accum=4, step=194, kl=0.052] SFT Epoch 1/2: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 194/205 [06:44<00:22, 2.01s/it, loss=0.159, sft=0.133, clean=0.134, trig=0.133, accum=4, step=194, kl=0.052] SFT Epoch 1/2: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 194/205 [06:46<00:22, 2.01s/it, loss=0.267, sft=0.232, clean=0.220, trig=0.237, accum=4, step=195, kl=0.071] SFT Epoch 1/2: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 195/205 [06:46<00:20, 2.03s/it, loss=0.267, sft=0.232, clean=0.220, trig=0.237, accum=4, step=195, kl=0.071] SFT Epoch 1/2: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 195/205 [06:48<00:20, 2.03s/it, loss=0.223, sft=0.195, clean=0.199, trig=0.193, accum=4, step=196, kl=0.057] SFT Epoch 1/2: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 196/205 [06:48<00:18, 2.01s/it, loss=0.223, sft=0.195, clean=0.199, trig=0.193, accum=4, step=196, kl=0.057] SFT Epoch 1/2: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 196/205 [06:50<00:18, 2.01s/it, loss=0.188, sft=0.162, clean=0.156, trig=0.164, accum=4, step=197, kl=0.052] SFT Epoch 1/2: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 197/205 [06:50<00:16, 2.02s/it, loss=0.188, sft=0.162, clean=0.156, trig=0.164, accum=4, step=197, kl=0.052] SFT Epoch 1/2: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 197/205 [06:52<00:16, 2.02s/it, loss=0.213, sft=0.186, clean=0.187, trig=0.186, accum=4, step=198, kl=0.054] SFT Epoch 1/2: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 198/205 [06:52<00:14, 2.06s/it, loss=0.213, sft=0.186, clean=0.187, trig=0.186, accum=4, step=198, kl=0.054] SFT Epoch 1/2: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 198/205 [06:54<00:14, 2.06s/it, loss=0.181, sft=0.157, clean=0.162, trig=0.155, accum=4, step=199, kl=0.048] SFT Epoch 1/2: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 199/205 [06:54<00:12, 2.03s/it, loss=0.181, sft=0.157, clean=0.162, trig=0.155, accum=4, step=199, kl=0.048] SFT Epoch 1/2: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 199/205 [06:56<00:12, 2.03s/it, loss=0.246, sft=0.213, clean=0.214, trig=0.212, accum=4, step=200, kl=0.065] SFT Epoch 1/2: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 200/205 [06:56<00:10, 2.02s/it, loss=0.246, sft=0.213, clean=0.214, trig=0.212, accum=4, step=200, kl=0.065] SFT Epoch 1/2: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 200/205 [06:58<00:10, 2.02s/it, loss=0.261, sft=0.224, clean=0.227, trig=0.222, accum=4, step=201, kl=0.074] SFT Epoch 1/2: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 201/205 [06:58<00:07, 1.99s/it, loss=0.261, sft=0.224, clean=0.227, trig=0.222, accum=4, step=201, kl=0.074] SFT Epoch 1/2: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 201/205 [07:00<00:07, 1.99s/it, loss=0.308, sft=0.273, clean=0.270, trig=0.275, accum=4, step=202, kl=0.070] SFT Epoch 1/2: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 202/205 [07:00<00:06, 2.05s/it, loss=0.308, sft=0.273, clean=0.270, trig=0.275, accum=4, step=202, kl=0.070] SFT Epoch 1/2: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 202/205 [07:02<00:06, 2.05s/it, loss=0.151, sft=0.125, clean=0.128, trig=0.123, accum=4, step=203, kl=0.052] SFT Epoch 1/2: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 203/205 [07:02<00:04, 2.13s/it, loss=0.151, sft=0.125, clean=0.128, trig=0.123, accum=4, step=203, kl=0.052] SFT Epoch 1/2: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 203/205 [07:04<00:04, 2.13s/it, loss=0.229, sft=0.192, clean=0.193, trig=0.191, accum=4, step=204, kl=0.075] SFT Epoch 1/2: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 204/205 [07:04<00:02, 2.17s/it, loss=0.229, sft=0.192, clean=0.193, trig=0.191, accum=4, step=204, kl=0.075] SFT Epoch 1/2: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 204/205 [07:06<00:02, 2.17s/it, loss=0.208, sft=0.177, clean=0.180, trig=0.176, accum=4, step=205, kl=0.063] SFT Epoch 1/2: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 205/205 [07:06<00:00, 1.99s/it, loss=0.208, sft=0.177, clean=0.180, trig=0.176, accum=4, step=205, kl=0.063] SFT Epoch 1/2: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 205/205 [07:06<00:00, 2.08s/it, loss=0.208, sft=0.177, clean=0.180, trig=0.176, accum=4, step=205, kl=0.063]
SFT Epoch 2/2: 0%| | 0/205 [00:00<?, ?it/s] SFT Epoch 2/2: 0%| | 0/205 [00:02<?, ?it/s, loss=0.228, sft=0.189, clean=0.192, trig=0.188, accum=4, step=206, kl=0.077] SFT Epoch 2/2: 0%| | 1/205 [00:02<07:03, 2.08s/it, loss=0.228, sft=0.189, clean=0.192, trig=0.188, accum=4, step=206, kl=0.077] SFT Epoch 2/2: 0%| | 1/205 [00:03<07:03, 2.08s/it, loss=0.184, sft=0.135, clean=0.129, trig=0.137, accum=4, step=207, kl=0.099] SFT Epoch 2/2: 1%| | 2/205 [00:03<06:38, 1.96s/it, loss=0.184, sft=0.135, clean=0.129, trig=0.137, accum=4, step=207, kl=0.099] SFT Epoch 2/2: 1%| | 2/205 [00:06<06:38, 1.96s/it, loss=0.209, sft=0.166, clean=0.172, trig=0.164, accum=4, step=208, kl=0.085] SFT Epoch 2/2: 1%|▏ | 3/205 [00:06<06:49, 2.03s/it, loss=0.209, sft=0.166, clean=0.172, trig=0.164, accum=4, step=208, kl=0.085] SFT Epoch 2/2: 1%|▏ | 3/205 [00:07<06:49, 2.03s/it, loss=0.235, sft=0.184, clean=0.189, trig=0.183, accum=4, step=209, kl=0.101] SFT Epoch 2/2: 2%|▏ | 4/205 [00:07<06:35, 1.97s/it, loss=0.235, sft=0.184, clean=0.189, trig=0.183, accum=4, step=209, kl=0.101] SFT Epoch 2/2: 2%|▏ | 4/205 [00:10<06:35, 1.97s/it, loss=0.195, sft=0.167, clean=0.171, trig=0.165, accum=4, step=210, kl=0.055] SFT Epoch 2/2: 2%|▏ | 5/205 [00:10<06:41, 2.01s/it, loss=0.195, sft=0.167, clean=0.171, trig=0.165, accum=4, step=210, kl=0.055] SFT Epoch 2/2: 2%|▏ | 5/205 [00:11<06:41, 2.01s/it, loss=0.223, sft=0.161, clean=0.156, trig=0.163, accum=4, step=211, kl=0.124] SFT Epoch 2/2: 3%|β–Ž | 6/205 [00:11<06:25, 1.94s/it, loss=0.223, sft=0.161, clean=0.156, trig=0.163, accum=4, step=211, kl=0.124] SFT Epoch 2/2: 3%|β–Ž | 6/205 [00:13<06:25, 1.94s/it, loss=0.195, sft=0.169, clean=0.170, trig=0.169, accum=4, step=212, kl=0.051] SFT Epoch 2/2: 3%|β–Ž | 7/205 [00:13<06:32, 1.98s/it, loss=0.195, sft=0.169, clean=0.170, trig=0.169, accum=4, step=212, kl=0.051] SFT Epoch 2/2: 3%|β–Ž | 7/205 [00:15<06:32, 1.98s/it, loss=0.186, sft=0.151, clean=0.153, trig=0.150, accum=4, step=213, kl=0.070] SFT Epoch 2/2: 4%|▍ | 8/205 [00:15<06:26, 1.96s/it, loss=0.186, sft=0.151, clean=0.153, trig=0.150, accum=4, step=213, kl=0.070] SFT Epoch 2/2: 4%|▍ | 8/205 [00:17<06:26, 1.96s/it, loss=0.293, sft=0.249, clean=0.252, trig=0.248, accum=4, step=214, kl=0.088] SFT Epoch 2/2: 4%|▍ | 9/205 [00:17<06:31, 2.00s/it, loss=0.293, sft=0.249, clean=0.252, trig=0.248, accum=4, step=214, kl=0.088] SFT Epoch 2/2: 4%|▍ | 9/205 [00:20<06:31, 2.00s/it, loss=0.220, sft=0.179, clean=0.182, trig=0.178, accum=4, step=215, kl=0.080] SFT Epoch 2/2: 5%|▍ | 10/205 [00:20<06:40, 2.05s/it, loss=0.220, sft=0.179, clean=0.182, trig=0.178, accum=4, step=215, kl=0.080] SFT Epoch 2/2: 5%|▍ | 10/205 [00:22<06:40, 2.05s/it, loss=0.212, sft=0.178, clean=0.182, trig=0.176, accum=4, step=216, kl=0.067] SFT Epoch 2/2: 5%|β–Œ | 11/205 [00:22<06:43, 2.08s/it, loss=0.212, sft=0.178, clean=0.182, trig=0.176, accum=4, step=216, kl=0.067] SFT Epoch 2/2: 5%|β–Œ | 11/205 [00:23<06:43, 2.08s/it, loss=0.217, sft=0.162, clean=0.164, trig=0.162, accum=4, step=217, kl=0.109] SFT Epoch 2/2: 6%|β–Œ | 12/205 [00:23<06:16, 1.95s/it, loss=0.217, sft=0.162, clean=0.164, trig=0.162, accum=4, step=217, kl=0.109] SFT Epoch 2/2: 6%|β–Œ | 12/205 [00:25<06:16, 1.95s/it, loss=0.222, sft=0.169, clean=0.171, trig=0.169, accum=4, step=218, kl=0.105] SFT Epoch 2/2: 6%|β–‹ | 13/205 [00:25<06:21, 1.99s/it, loss=0.222, sft=0.169, clean=0.171, trig=0.169, accum=4, step=218, kl=0.105] SFT Epoch 2/2: 6%|β–‹ | 13/205 [00:28<06:21, 1.99s/it, loss=0.236, sft=0.175, clean=0.179, trig=0.173, accum=4, step=219, kl=0.123] SFT Epoch 2/2: 7%|β–‹ | 14/205 [00:28<06:24, 2.01s/it, loss=0.236, sft=0.175, clean=0.179, trig=0.173, accum=4, step=219, kl=0.123] SFT Epoch 2/2: 7%|β–‹ | 14/205 [00:30<06:24, 2.01s/it, loss=0.140, sft=0.105, clean=0.108, trig=0.103, accum=4, step=220, kl=0.072] SFT Epoch 2/2: 7%|β–‹ | 15/205 [00:30<06:24, 2.02s/it, loss=0.140, sft=0.105, clean=0.108, trig=0.103, accum=4, step=220, kl=0.072] SFT Epoch 2/2: 7%|β–‹ | 15/205 [00:32<06:24, 2.02s/it, loss=0.277, sft=0.217, clean=0.218, trig=0.216, accum=4, step=221, kl=0.120] SFT Epoch 2/2: 8%|β–Š | 16/205 [00:32<06:33, 2.08s/it, loss=0.277, sft=0.217, clean=0.218, trig=0.216, accum=4, step=221, kl=0.120] SFT Epoch 2/2: 8%|β–Š | 16/205 [00:34<06:33, 2.08s/it, loss=0.182, sft=0.150, clean=0.155, trig=0.148, accum=4, step=222, kl=0.064] SFT Epoch 2/2: 8%|β–Š | 17/205 [00:34<06:41, 2.14s/it, loss=0.182, sft=0.150, clean=0.155, trig=0.148, accum=4, step=222, kl=0.064] SFT Epoch 2/2: 8%|β–Š | 17/205 [00:36<06:41, 2.14s/it, loss=0.245, sft=0.170, clean=0.178, trig=0.166, accum=4, step=223, kl=0.151] SFT Epoch 2/2: 9%|β–‰ | 18/205 [00:36<06:33, 2.11s/it, loss=0.245, sft=0.170, clean=0.178, trig=0.166, accum=4, step=223, kl=0.151] SFT Epoch 2/2: 9%|β–‰ | 18/205 [00:38<06:33, 2.11s/it, loss=0.233, sft=0.171, clean=0.173, trig=0.170, accum=4, step=224, kl=0.123] SFT Epoch 2/2: 9%|β–‰ | 19/205 [00:38<06:24, 2.07s/it, loss=0.233, sft=0.171, clean=0.173, trig=0.170, accum=4, step=224, kl=0.123] SFT Epoch 2/2: 9%|β–‰ | 19/205 [00:40<06:24, 2.07s/it, loss=0.203, sft=0.157, clean=0.166, trig=0.153, accum=4, step=225, kl=0.091] SFT Epoch 2/2: 10%|β–‰ | 20/205 [00:40<06:13, 2.02s/it, loss=0.203, sft=0.157, clean=0.166, trig=0.153, accum=4, step=225, kl=0.091] SFT Epoch 2/2: 10%|β–‰ | 20/205 [00:42<06:13, 2.02s/it, loss=0.156, sft=0.105, clean=0.109, trig=0.103, accum=4, step=226, kl=0.101] SFT Epoch 2/2: 10%|β–ˆ | 21/205 [00:42<06:02, 1.97s/it, loss=0.156, sft=0.105, clean=0.109, trig=0.103, accum=4, step=226, kl=0.101] SFT Epoch 2/2: 10%|β–ˆ | 21/205 [00:44<06:02, 1.97s/it, loss=0.209, sft=0.176, clean=0.178, trig=0.175, accum=4, step=227, kl=0.067] SFT Epoch 2/2: 11%|β–ˆ | 22/205 [00:44<06:12, 2.03s/it, loss=0.209, sft=0.176, clean=0.178, trig=0.175, accum=4, step=227, kl=0.067] SFT Epoch 2/2: 11%|β–ˆ | 22/205 [00:46<06:12, 2.03s/it, loss=0.147, sft=0.125, clean=0.127, trig=0.123, accum=4, step=228, kl=0.045] SFT Epoch 2/2: 11%|β–ˆ | 23/205 [00:46<05:59, 1.97s/it, loss=0.147, sft=0.125, clean=0.127, trig=0.123, accum=4, step=228, kl=0.045] SFT Epoch 2/2: 11%|β–ˆ | 23/205 [00:48<05:59, 1.97s/it, loss=0.168, sft=0.127, clean=0.134, trig=0.124, accum=4, step=229, kl=0.083] SFT Epoch 2/2: 12%|β–ˆβ– | 24/205 [00:48<06:09, 2.04s/it, loss=0.168, sft=0.127, clean=0.134, trig=0.124, accum=4, step=229, kl=0.083] SFT Epoch 2/2: 12%|β–ˆβ– | 24/205 [00:50<06:09, 2.04s/it, loss=0.207, sft=0.154, clean=0.164, trig=0.150, accum=4, step=230, kl=0.105] SFT Epoch 2/2: 12%|β–ˆβ– | 25/205 [00:50<05:48, 1.94s/it, loss=0.207, sft=0.154, clean=0.164, trig=0.150, accum=4, step=230, kl=0.105] SFT Epoch 2/2: 12%|β–ˆβ– | 25/205 [00:52<05:48, 1.94s/it, loss=0.214, sft=0.169, clean=0.174, trig=0.166, accum=4, step=231, kl=0.090] SFT Epoch 2/2: 13%|β–ˆβ–Ž | 26/205 [00:52<06:09, 2.07s/it, loss=0.214, sft=0.169, clean=0.174, trig=0.166, accum=4, step=231, kl=0.090] SFT Epoch 2/2: 13%|β–ˆβ–Ž | 26/205 [00:54<06:09, 2.07s/it, loss=0.135, sft=0.108, clean=0.112, trig=0.107, accum=4, step=232, kl=0.053] SFT Epoch 2/2: 13%|β–ˆβ–Ž | 27/205 [00:54<05:48, 1.96s/it, loss=0.135, sft=0.108, clean=0.112, trig=0.107, accum=4, step=232, kl=0.053] SFT Epoch 2/2: 13%|β–ˆβ–Ž | 27/205 [00:56<05:48, 1.96s/it, loss=0.171, sft=0.126, clean=0.132, trig=0.123, accum=4, step=233, kl=0.091] SFT Epoch 2/2: 14%|β–ˆβ–Ž | 28/205 [00:56<05:49, 1.97s/it, loss=0.171, sft=0.126, clean=0.132, trig=0.123, accum=4, step=233, kl=0.091] SFT Epoch 2/2: 14%|β–ˆβ–Ž | 28/205 [00:58<05:49, 1.97s/it, loss=0.260, sft=0.220, clean=0.231, trig=0.216, accum=4, step=234, kl=0.079] SFT Epoch 2/2: 14%|β–ˆβ– | 29/205 [00:58<05:50, 1.99s/it, loss=0.260, sft=0.220, clean=0.231, trig=0.216, accum=4, step=234, kl=0.079] SFT Epoch 2/2: 14%|β–ˆβ– | 29/205 [01:00<05:50, 1.99s/it, loss=0.183, sft=0.150, clean=0.155, trig=0.148, accum=4, step=235, kl=0.067] SFT Epoch 2/2: 15%|β–ˆβ– | 30/205 [01:00<05:38, 1.94s/it, loss=0.183, sft=0.150, clean=0.155, trig=0.148, accum=4, step=235, kl=0.067] SFT Epoch 2/2: 15%|β–ˆβ– | 30/205 [01:01<05:38, 1.94s/it, loss=0.193, sft=0.156, clean=0.161, trig=0.154, accum=4, step=236, kl=0.073] SFT Epoch 2/2: 15%|β–ˆβ–Œ | 31/205 [01:01<05:31, 1.91s/it, loss=0.193, sft=0.156, clean=0.161, trig=0.154, accum=4, step=236, kl=0.073] SFT Epoch 2/2: 15%|β–ˆβ–Œ | 31/205 [01:04<05:31, 1.91s/it, loss=0.158, sft=0.128, clean=0.130, trig=0.127, accum=4, step=237, kl=0.061] SFT Epoch 2/2: 16%|β–ˆβ–Œ | 32/205 [01:04<05:42, 1.98s/it, loss=0.158, sft=0.128, clean=0.130, trig=0.127, accum=4, step=237, kl=0.061] SFT Epoch 2/2: 16%|β–ˆβ–Œ | 32/205 [01:06<05:42, 1.98s/it, loss=0.225, sft=0.181, clean=0.189, trig=0.177, accum=4, step=238, kl=0.088] SFT Epoch 2/2: 16%|β–ˆβ–Œ | 33/205 [01:06<05:37, 1.96s/it, loss=0.225, sft=0.181, clean=0.189, trig=0.177, accum=4, step=238, kl=0.088] SFT Epoch 2/2: 16%|β–ˆβ–Œ | 33/205 [01:07<05:37, 1.96s/it, loss=0.144, sft=0.110, clean=0.118, trig=0.107, accum=4, step=239, kl=0.066] SFT Epoch 2/2: 17%|β–ˆβ–‹ | 34/205 [01:07<05:24, 1.90s/it, loss=0.144, sft=0.110, clean=0.118, trig=0.107, accum=4, step=239, kl=0.066] SFT Epoch 2/2: 17%|β–ˆβ–‹ | 34/205 [01:09<05:24, 1.90s/it, loss=0.248, sft=0.215, clean=0.222, trig=0.212, accum=4, step=240, kl=0.065] SFT Epoch 2/2: 17%|β–ˆβ–‹ | 35/205 [01:09<05:27, 1.92s/it, loss=0.248, sft=0.215, clean=0.222, trig=0.212, accum=4, step=240, kl=0.065] SFT Epoch 2/2: 17%|β–ˆβ–‹ | 35/205 [01:11<05:27, 1.92s/it, loss=0.093, sft=0.055, clean=0.060, trig=0.053, accum=4, step=241, kl=0.077] SFT Epoch 2/2: 18%|β–ˆβ–Š | 36/205 [01:11<05:10, 1.84s/it, loss=0.093, sft=0.055, clean=0.060, trig=0.053, accum=4, step=241, kl=0.077] SFT Epoch 2/2: 18%|β–ˆβ–Š | 36/205 [01:13<05:10, 1.84s/it, loss=0.173, sft=0.121, clean=0.126, trig=0.118, accum=4, step=242, kl=0.104] SFT Epoch 2/2: 18%|β–ˆβ–Š | 37/205 [01:13<05:11, 1.85s/it, loss=0.173, sft=0.121, clean=0.126, trig=0.118, accum=4, step=242, kl=0.104] SFT Epoch 2/2: 18%|β–ˆβ–Š | 37/205 [01:15<05:11, 1.85s/it, loss=0.197, sft=0.149, clean=0.160, trig=0.145, accum=4, step=243, kl=0.095] SFT Epoch 2/2: 19%|β–ˆβ–Š | 38/205 [01:15<05:23, 1.93s/it, loss=0.197, sft=0.149, clean=0.160, trig=0.145, accum=4, step=243, kl=0.095] SFT Epoch 2/2: 19%|β–ˆβ–Š | 38/205 [01:17<05:23, 1.93s/it, loss=0.169, sft=0.105, clean=0.119, trig=0.099, accum=4, step=244, kl=0.128] SFT Epoch 2/2: 19%|β–ˆβ–‰ | 39/205 [01:17<05:28, 1.98s/it, loss=0.169, sft=0.105, clean=0.119, trig=0.099, accum=4, step=244, kl=0.128] SFT Epoch 2/2: 19%|β–ˆβ–‰ | 39/205 [01:19<05:28, 1.98s/it, loss=0.251, sft=0.212, clean=0.228, trig=0.205, accum=4, step=245, kl=0.079] SFT Epoch 2/2: 20%|β–ˆβ–‰ | 40/205 [01:19<05:19, 1.94s/it, loss=0.251, sft=0.212, clean=0.228, trig=0.205, accum=4, step=245, kl=0.079] SFT Epoch 2/2: 20%|β–ˆβ–‰ | 40/205 [01:21<05:19, 1.94s/it, loss=0.133, sft=0.105, clean=0.112, trig=0.102, accum=4, step=246, kl=0.055] SFT Epoch 2/2: 20%|β–ˆβ–ˆ | 41/205 [01:21<05:10, 1.89s/it, loss=0.133, sft=0.105, clean=0.112, trig=0.102, accum=4, step=246, kl=0.055] SFT Epoch 2/2: 20%|β–ˆβ–ˆ | 41/205 [01:23<05:10, 1.89s/it, loss=0.206, sft=0.166, clean=0.179, trig=0.161, accum=4, step=247, kl=0.079] SFT Epoch 2/2: 20%|β–ˆβ–ˆ | 42/205 [01:23<05:17, 1.95s/it, loss=0.206, sft=0.166, clean=0.179, trig=0.161, accum=4, step=247, kl=0.079] SFT Epoch 2/2: 20%|β–ˆβ–ˆ | 42/205 [01:25<05:17, 1.95s/it, loss=0.256, sft=0.189, clean=0.181, trig=0.192, accum=4, step=248, kl=0.134] SFT Epoch 2/2: 21%|β–ˆβ–ˆ | 43/205 [01:25<05:22, 1.99s/it, loss=0.256, sft=0.189, clean=0.181, trig=0.192, accum=4, step=248, kl=0.134] SFT Epoch 2/2: 21%|β–ˆβ–ˆ | 43/205 [01:27<05:22, 1.99s/it, loss=0.130, sft=0.104, clean=0.120, trig=0.097, accum=4, step=249, kl=0.053] SFT Epoch 2/2: 21%|β–ˆβ–ˆβ– | 44/205 [01:27<05:34, 2.08s/it, loss=0.130, sft=0.104, clean=0.120, trig=0.097, accum=4, step=249, kl=0.053] SFT Epoch 2/2: 21%|β–ˆβ–ˆβ– | 44/205 [01:29<05:34, 2.08s/it, loss=0.140, sft=0.101, clean=0.118, trig=0.094, accum=4, step=250, kl=0.078] SFT Epoch 2/2: 22%|β–ˆβ–ˆβ– | 45/205 [01:29<05:25, 2.04s/it, loss=0.140, sft=0.101, clean=0.118, trig=0.094, accum=4, step=250, kl=0.078] SFT Epoch 2/2: 22%|β–ˆβ–ˆβ– | 45/205 [01:31<05:25, 2.04s/it, loss=0.204, sft=0.176, clean=0.201, trig=0.166, accum=4, step=251, kl=0.056] SFT Epoch 2/2: 22%|β–ˆβ–ˆβ– | 46/205 [01:31<05:18, 2.00s/it, loss=0.204, sft=0.176, clean=0.201, trig=0.166, accum=4, step=251, kl=0.056] SFT Epoch 2/2: 22%|β–ˆβ–ˆβ– | 46/205 [01:33<05:18, 2.00s/it, loss=0.162, sft=0.145, clean=0.170, trig=0.135, accum=4, step=252, kl=0.033] SFT Epoch 2/2: 23%|β–ˆβ–ˆβ–Ž | 47/205 [01:33<05:19, 2.02s/it, loss=0.162, sft=0.145, clean=0.170, trig=0.135, accum=4, step=252, kl=0.033] SFT Epoch 2/2: 23%|β–ˆβ–ˆβ–Ž | 47/205 [01:35<05:19, 2.02s/it, loss=0.164, sft=0.105, clean=0.127, trig=0.096, accum=4, step=253, kl=0.118] SFT Epoch 2/2: 23%|β–ˆβ–ˆβ–Ž | 48/205 [01:35<05:19, 2.04s/it, loss=0.164, sft=0.105, clean=0.127, trig=0.096, accum=4, step=253, kl=0.118] SFT Epoch 2/2: 23%|β–ˆβ–ˆβ–Ž | 48/205 [01:37<05:19, 2.04s/it, loss=0.180, sft=0.143, clean=0.181, trig=0.127, accum=4, step=254, kl=0.075] SFT Epoch 2/2: 24%|β–ˆβ–ˆβ– | 49/205 [01:37<05:12, 2.00s/it, loss=0.180, sft=0.143, clean=0.181, trig=0.127, accum=4, step=254, kl=0.075] SFT Epoch 2/2: 24%|β–ˆβ–ˆβ– | 49/205 [01:39<05:12, 2.00s/it, loss=0.217, sft=0.182, clean=0.215, trig=0.168, accum=4, step=255, kl=0.070] SFT Epoch 2/2: 24%|β–ˆβ–ˆβ– | 50/205 [01:39<05:24, 2.10s/it, loss=0.217, sft=0.182, clean=0.215, trig=0.168, accum=4, step=255, kl=0.070] SFT Epoch 2/2: 24%|β–ˆβ–ˆβ– | 50/205 [01:41<05:24, 2.10s/it, loss=0.160, sft=0.140, clean=0.179, trig=0.123, accum=4, step=256, kl=0.040] SFT Epoch 2/2: 25%|β–ˆβ–ˆβ– | 51/205 [01:41<05:00, 1.95s/it, loss=0.160, sft=0.140, clean=0.179, trig=0.123, accum=4, step=256, kl=0.040] SFT Epoch 2/2: 25%|β–ˆβ–ˆβ– | 51/205 [01:43<05:00, 1.95s/it, loss=0.105, sft=0.078, clean=0.105, trig=0.066, accum=4, step=257, kl=0.055] SFT Epoch 2/2: 25%|β–ˆβ–ˆβ–Œ | 52/205 [01:43<05:12, 2.04s/it, loss=0.105, sft=0.078, clean=0.105, trig=0.066, accum=4, step=257, kl=0.055] SFT Epoch 2/2: 25%|β–ˆβ–ˆβ–Œ | 52/205 [01:45<05:12, 2.04s/it, loss=0.149, sft=0.116, clean=0.155, trig=0.099, accum=4, step=258, kl=0.066] SFT Epoch 2/2: 26%|β–ˆβ–ˆβ–Œ | 53/205 [01:45<05:10, 2.04s/it, loss=0.149, sft=0.116, clean=0.155, trig=0.099, accum=4, step=258, kl=0.066] SFT Epoch 2/2: 26%|β–ˆβ–ˆβ–Œ | 53/205 [01:47<05:10, 2.04s/it, loss=0.150, sft=0.128, clean=0.162, trig=0.113, accum=4, step=259, kl=0.045] SFT Epoch 2/2: 26%|β–ˆβ–ˆβ–‹ | 54/205 [01:47<05:01, 1.99s/it, loss=0.150, sft=0.128, clean=0.162, trig=0.113, accum=4, step=259, kl=0.045] SFT Epoch 2/2: 26%|β–ˆβ–ˆβ–‹ | 54/205 [01:49<05:01, 1.99s/it, loss=0.123, sft=0.085, clean=0.110, trig=0.074, accum=4, step=260, kl=0.077] SFT Epoch 2/2: 27%|β–ˆβ–ˆβ–‹ | 55/205 [01:49<04:57, 1.98s/it, loss=0.123, sft=0.085, clean=0.110, trig=0.074, accum=4, step=260, kl=0.077] SFT Epoch 2/2: 27%|β–ˆβ–ˆβ–‹ | 55/205 [01:51<04:57, 1.98s/it, loss=0.218, sft=0.171, clean=0.175, trig=0.169, accum=4, step=261, kl=0.094] SFT Epoch 2/2: 27%|β–ˆβ–ˆβ–‹ | 56/205 [01:51<04:54, 1.97s/it, loss=0.218, sft=0.171, clean=0.175, trig=0.169, accum=4, step=261, kl=0.094] SFT Epoch 2/2: 27%|β–ˆβ–ˆβ–‹ | 56/205 [01:53<04:54, 1.97s/it, loss=0.140, sft=0.121, clean=0.161, trig=0.104, accum=4, step=262, kl=0.038] SFT Epoch 2/2: 28%|β–ˆβ–ˆβ–Š | 57/205 [01:53<05:10, 2.10s/it, loss=0.140, sft=0.121, clean=0.161, trig=0.104, accum=4, step=262, kl=0.038] SFT Epoch 2/2: 28%|β–ˆβ–ˆβ–Š | 57/205 [01:55<05:10, 2.10s/it, loss=0.182, sft=0.152, clean=0.181, trig=0.139, accum=4, step=263, kl=0.061] SFT Epoch 2/2: 28%|β–ˆβ–ˆβ–Š | 58/205 [01:55<04:57, 2.03s/it, loss=0.182, sft=0.152, clean=0.181, trig=0.139, accum=4, step=263, kl=0.061] SFT Epoch 2/2: 28%|β–ˆβ–ˆβ–Š | 58/205 [01:57<04:57, 2.03s/it, loss=0.183, sft=0.146, clean=0.165, trig=0.137, accum=4, step=264, kl=0.074] SFT Epoch 2/2: 29%|β–ˆβ–ˆβ–‰ | 59/205 [01:57<05:00, 2.06s/it, loss=0.183, sft=0.146, clean=0.165, trig=0.137, accum=4, step=264, kl=0.074] SFT Epoch 2/2: 29%|β–ˆβ–ˆβ–‰ | 59/205 [02:00<05:00, 2.06s/it, loss=0.226, sft=0.179, clean=0.227, trig=0.158, accum=4, step=265, kl=0.094] SFT Epoch 2/2: 29%|β–ˆβ–ˆβ–‰ | 60/205 [02:00<05:02, 2.09s/it, loss=0.226, sft=0.179, clean=0.227, trig=0.158, accum=4, step=265, kl=0.094] SFT Epoch 2/2: 29%|β–ˆβ–ˆβ–‰ | 60/205 [02:02<05:02, 2.09s/it, loss=0.165, sft=0.129, clean=0.169, trig=0.112, accum=4, step=266, kl=0.071] SFT Epoch 2/2: 30%|β–ˆβ–ˆβ–‰ | 61/205 [02:02<05:00, 2.09s/it, loss=0.165, sft=0.129, clean=0.169, trig=0.112, accum=4, step=266, kl=0.071] SFT Epoch 2/2: 30%|β–ˆβ–ˆβ–‰ | 61/205 [02:03<05:00, 2.09s/it, loss=0.160, sft=0.140, clean=0.163, trig=0.130, accum=4, step=267, kl=0.040] SFT Epoch 2/2: 30%|β–ˆβ–ˆβ–ˆ | 62/205 [02:03<04:47, 2.01s/it, loss=0.160, sft=0.140, clean=0.163, trig=0.130, accum=4, step=267, kl=0.040] SFT Epoch 2/2: 30%|β–ˆβ–ˆβ–ˆ | 62/205 [02:06<04:47, 2.01s/it, loss=0.177, sft=0.126, clean=0.161, trig=0.111, accum=4, step=268, kl=0.102] SFT Epoch 2/2: 31%|β–ˆβ–ˆβ–ˆ | 63/205 [02:06<04:54, 2.07s/it, loss=0.177, sft=0.126, clean=0.161, trig=0.111, accum=4, step=268, kl=0.102] SFT Epoch 2/2: 31%|β–ˆβ–ˆβ–ˆ | 63/205 [02:08<04:54, 2.07s/it, loss=0.167, sft=0.125, clean=0.141, trig=0.119, accum=4, step=269, kl=0.083] SFT Epoch 2/2: 31%|β–ˆβ–ˆβ–ˆ | 64/205 [02:08<04:47, 2.04s/it, loss=0.167, sft=0.125, clean=0.141, trig=0.119, accum=4, step=269, kl=0.083] SFT Epoch 2/2: 31%|β–ˆβ–ˆβ–ˆ | 64/205 [02:10<04:47, 2.04s/it, loss=0.136, sft=0.104, clean=0.136, trig=0.089, accum=4, step=270, kl=0.066] SFT Epoch 2/2: 32%|β–ˆβ–ˆβ–ˆβ– | 65/205 [02:10<04:49, 2.07s/it, loss=0.136, sft=0.104, clean=0.136, trig=0.089, accum=4, step=270, kl=0.066] SFT Epoch 2/2: 32%|β–ˆβ–ˆβ–ˆβ– | 65/205 [02:12<04:49, 2.07s/it, loss=0.186, sft=0.130, clean=0.144, trig=0.125, accum=4, step=271, kl=0.111] SFT Epoch 2/2: 32%|β–ˆβ–ˆβ–ˆβ– | 66/205 [02:12<04:44, 2.05s/it, loss=0.186, sft=0.130, clean=0.144, trig=0.125, accum=4, step=271, kl=0.111] SFT Epoch 2/2: 32%|β–ˆβ–ˆβ–ˆβ– | 66/205 [02:14<04:44, 2.05s/it, loss=0.165, sft=0.136, clean=0.174, trig=0.119, accum=4, step=272, kl=0.060] SFT Epoch 2/2: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 67/205 [02:14<04:54, 2.13s/it, loss=0.165, sft=0.136, clean=0.174, trig=0.119, accum=4, step=272, kl=0.060] SFT Epoch 2/2: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 67/205 [02:16<04:54, 2.13s/it, loss=0.130, sft=0.108, clean=0.134, trig=0.097, accum=4, step=273, kl=0.045] SFT Epoch 2/2: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 68/205 [02:16<04:40, 2.05s/it, loss=0.130, sft=0.108, clean=0.134, trig=0.097, accum=4, step=273, kl=0.045] SFT Epoch 2/2: 33%|β–ˆβ–ˆβ–ˆβ–Ž | 68/205 [02:18<04:40, 2.05s/it, loss=0.171, sft=0.129, clean=0.159, trig=0.116, accum=4, step=274, kl=0.084] SFT Epoch 2/2: 34%|β–ˆβ–ˆβ–ˆβ–Ž | 69/205 [02:18<04:26, 1.96s/it, loss=0.171, sft=0.129, clean=0.159, trig=0.116, accum=4, step=274, kl=0.084] SFT Epoch 2/2: 34%|β–ˆβ–ˆβ–ˆβ–Ž | 69/205 [02:20<04:26, 1.96s/it, loss=0.197, sft=0.159, clean=0.194, trig=0.143, accum=4, step=275, kl=0.077] SFT Epoch 2/2: 34%|β–ˆβ–ˆβ–ˆβ– | 70/205 [02:20<04:42, 2.09s/it, loss=0.197, sft=0.159, clean=0.194, trig=0.143, accum=4, step=275, kl=0.077] SFT Epoch 2/2: 34%|β–ˆβ–ˆβ–ˆβ– | 70/205 [02:22<04:42, 2.09s/it, loss=0.236, sft=0.206, clean=0.232, trig=0.195, accum=4, step=276, kl=0.059] SFT Epoch 2/2: 35%|β–ˆβ–ˆβ–ˆβ– | 71/205 [02:22<04:34, 2.05s/it, loss=0.236, sft=0.206, clean=0.232, trig=0.195, accum=4, step=276, kl=0.059] SFT Epoch 2/2: 35%|β–ˆβ–ˆβ–ˆβ– | 71/205 [02:24<04:34, 2.05s/it, loss=0.157, sft=0.131, clean=0.161, trig=0.118, accum=4, step=277, kl=0.051] SFT Epoch 2/2: 35%|β–ˆβ–ˆβ–ˆβ–Œ | 72/205 [02:24<04:29, 2.02s/it, loss=0.157, sft=0.131, clean=0.161, trig=0.118, accum=4, step=277, kl=0.051] SFT Epoch 2/2: 35%|β–ˆβ–ˆβ–ˆβ–Œ | 72/205 [02:26<04:29, 2.02s/it, loss=0.169, sft=0.142, clean=0.180, trig=0.126, accum=4, step=278, kl=0.053] SFT Epoch 2/2: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 73/205 [02:26<04:14, 1.93s/it, loss=0.169, sft=0.142, clean=0.180, trig=0.126, accum=4, step=278, kl=0.053] SFT Epoch 2/2: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 73/205 [02:28<04:14, 1.93s/it, loss=0.138, sft=0.100, clean=0.140, trig=0.083, accum=4, step=279, kl=0.076] SFT Epoch 2/2: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 74/205 [02:28<04:17, 1.97s/it, loss=0.138, sft=0.100, clean=0.140, trig=0.083, accum=4, step=279, kl=0.076] SFT Epoch 2/2: 36%|β–ˆβ–ˆβ–ˆβ–Œ | 74/205 [02:30<04:17, 1.97s/it, loss=0.187, sft=0.151, clean=0.189, trig=0.135, accum=4, step=280, kl=0.071] SFT Epoch 2/2: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 75/205 [02:30<04:15, 1.97s/it, loss=0.187, sft=0.151, clean=0.189, trig=0.135, accum=4, step=280, kl=0.071] SFT Epoch 2/2: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 75/205 [02:32<04:15, 1.97s/it, loss=0.178, sft=0.140, clean=0.172, trig=0.126, accum=4, step=281, kl=0.077] SFT Epoch 2/2: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 76/205 [02:32<04:21, 2.03s/it, loss=0.178, sft=0.140, clean=0.172, trig=0.126, accum=4, step=281, kl=0.077] SFT Epoch 2/2: 37%|β–ˆβ–ˆβ–ˆβ–‹ | 76/205 [02:34<04:21, 2.03s/it, loss=0.184, sft=0.158, clean=0.182, trig=0.148, accum=4, step=282, kl=0.052] SFT Epoch 2/2: 38%|β–ˆβ–ˆβ–ˆβ–Š | 77/205 [02:34<04:19, 2.03s/it, loss=0.184, sft=0.158, clean=0.182, trig=0.148, accum=4, step=282, kl=0.052] SFT Epoch 2/2: 38%|β–ˆβ–ˆβ–ˆβ–Š | 77/205 [02:36<04:19, 2.03s/it, loss=0.076, sft=0.050, clean=0.070, trig=0.041, accum=4, step=283, kl=0.054] SFT Epoch 2/2: 38%|β–ˆβ–ˆβ–ˆβ–Š | 78/205 [02:36<04:26, 2.10s/it, loss=0.076, sft=0.050, clean=0.070, trig=0.041, accum=4, step=283, kl=0.054] SFT Epoch 2/2: 38%|β–ˆβ–ˆβ–ˆβ–Š | 78/205 [02:38<04:26, 2.10s/it, loss=0.216, sft=0.186, clean=0.196, trig=0.182, accum=4, step=284, kl=0.059] SFT Epoch 2/2: 39%|β–ˆβ–ˆβ–ˆβ–Š | 79/205 [02:38<04:14, 2.02s/it, loss=0.216, sft=0.186, clean=0.196, trig=0.182, accum=4, step=284, kl=0.059] SFT Epoch 2/2: 39%|β–ˆβ–ˆβ–ˆβ–Š | 79/205 [02:40<04:14, 2.02s/it, loss=0.233, sft=0.174, clean=0.214, trig=0.157, accum=4, step=285, kl=0.118] SFT Epoch 2/2: 39%|β–ˆβ–ˆβ–ˆβ–‰ | 80/205 [02:40<04:15, 2.04s/it, loss=0.233, sft=0.174, clean=0.214, trig=0.157, accum=4, step=285, kl=0.118] SFT Epoch 2/2: 39%|β–ˆβ–ˆβ–ˆβ–‰ | 80/205 [02:42<04:15, 2.04s/it, loss=0.121, sft=0.090, clean=0.117, trig=0.078, accum=4, step=286, kl=0.063] SFT Epoch 2/2: 40%|β–ˆβ–ˆβ–ˆβ–‰ | 81/205 [02:42<04:03, 1.96s/it, loss=0.121, sft=0.090, clean=0.117, trig=0.078, accum=4, step=286, kl=0.063] SFT Epoch 2/2: 40%|β–ˆβ–ˆβ–ˆβ–‰ | 81/205 [02:44<04:03, 1.96s/it, loss=0.167, sft=0.130, clean=0.174, trig=0.112, accum=4, step=287, kl=0.074] SFT Epoch 2/2: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 82/205 [02:44<04:04, 1.99s/it, loss=0.167, sft=0.130, clean=0.174, trig=0.112, accum=4, step=287, kl=0.074] SFT Epoch 2/2: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 82/205 [02:46<04:04, 1.99s/it, loss=0.192, sft=0.140, clean=0.163, trig=0.130, accum=4, step=288, kl=0.104] SFT Epoch 2/2: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 83/205 [02:46<04:08, 2.04s/it, loss=0.192, sft=0.140, clean=0.163, trig=0.130, accum=4, step=288, kl=0.104] SFT Epoch 2/2: 40%|β–ˆβ–ˆβ–ˆβ–ˆ | 83/205 [02:48<04:08, 2.04s/it, loss=0.158, sft=0.130, clean=0.162, trig=0.117, accum=4, step=289, kl=0.056] SFT Epoch 2/2: 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 84/205 [02:48<04:07, 2.04s/it, loss=0.158, sft=0.130, clean=0.162, trig=0.117, accum=4, step=289, kl=0.056] SFT Epoch 2/2: 41%|β–ˆβ–ˆβ–ˆβ–ˆ | 84/205 [02:50<04:07, 2.04s/it, loss=0.126, sft=0.091, clean=0.116, trig=0.080, accum=4, step=290, kl=0.071] SFT Epoch 2/2: 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 85/205 [02:50<04:03, 2.03s/it, loss=0.126, sft=0.091, clean=0.116, trig=0.080, accum=4, step=290, kl=0.071] SFT Epoch 2/2: 41%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 85/205 [02:52<04:03, 2.03s/it, loss=0.209, sft=0.173, clean=0.202, trig=0.161, accum=4, step=291, kl=0.071] SFT Epoch 2/2: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 86/205 [02:52<03:48, 1.92s/it, loss=0.209, sft=0.173, clean=0.202, trig=0.161, accum=4, step=291, kl=0.071] SFT Epoch 2/2: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 86/205 [02:54<03:48, 1.92s/it, loss=0.204, sft=0.162, clean=0.196, trig=0.148, accum=4, step=292, kl=0.082] SFT Epoch 2/2: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 87/205 [02:54<03:45, 1.91s/it, loss=0.204, sft=0.162, clean=0.196, trig=0.148, accum=4, step=292, kl=0.082] SFT Epoch 2/2: 42%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 87/205 [02:56<03:45, 1.91s/it, loss=0.175, sft=0.151, clean=0.189, trig=0.135, accum=4, step=293, kl=0.047] SFT Epoch 2/2: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 88/205 [02:56<03:45, 1.93s/it, loss=0.175, sft=0.151, clean=0.189, trig=0.135, accum=4, step=293, kl=0.047] SFT Epoch 2/2: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 88/205 [02:58<03:45, 1.93s/it, loss=0.204, sft=0.168, clean=0.218, trig=0.147, accum=4, step=294, kl=0.072] SFT Epoch 2/2: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 89/205 [02:58<03:45, 1.94s/it, loss=0.204, sft=0.168, clean=0.218, trig=0.147, accum=4, step=294, kl=0.072] SFT Epoch 2/2: 43%|β–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 89/205 [02:59<03:45, 1.94s/it, loss=0.138, sft=0.116, clean=0.135, trig=0.107, accum=4, step=295, kl=0.044] SFT Epoch 2/2: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 90/205 [02:59<03:37, 1.89s/it, loss=0.138, sft=0.116, clean=0.135, trig=0.107, accum=4, step=295, kl=0.044] SFT Epoch 2/2: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 90/205 [03:02<03:37, 1.89s/it, loss=0.054, sft=0.044, clean=0.061, trig=0.037, accum=4, step=296, kl=0.019] SFT Epoch 2/2: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 91/205 [03:02<03:48, 2.00s/it, loss=0.054, sft=0.044, clean=0.061, trig=0.037, accum=4, step=296, kl=0.019] SFT Epoch 2/2: 44%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 91/205 [03:04<03:48, 2.00s/it, loss=0.229, sft=0.181, clean=0.190, trig=0.177, accum=4, step=297, kl=0.097] SFT Epoch 2/2: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 92/205 [03:04<03:41, 1.96s/it, loss=0.229, sft=0.181, clean=0.190, trig=0.177, accum=4, step=297, kl=0.097] SFT Epoch 2/2: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ– | 92/205 [03:06<03:41, 1.96s/it, loss=0.113, sft=0.090, clean=0.112, trig=0.081, accum=4, step=298, kl=0.046] SFT Epoch 2/2: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 93/205 [03:06<03:42, 1.98s/it, loss=0.113, sft=0.090, clean=0.112, trig=0.081, accum=4, step=298, kl=0.046] SFT Epoch 2/2: 45%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 93/205 [03:07<03:42, 1.98s/it, loss=0.154, sft=0.130, clean=0.171, trig=0.113, accum=4, step=299, kl=0.049] SFT Epoch 2/2: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 94/205 [03:07<03:33, 1.93s/it, loss=0.154, sft=0.130, clean=0.171, trig=0.113, accum=4, step=299, kl=0.049] SFT Epoch 2/2: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 94/205 [03:09<03:33, 1.93s/it, loss=0.178, sft=0.145, clean=0.188, trig=0.126, accum=4, step=300, kl=0.066] SFT Epoch 2/2: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 95/205 [03:09<03:24, 1.86s/it, loss=0.178, sft=0.145, clean=0.188, trig=0.126, accum=4, step=300, kl=0.066] SFT Epoch 2/2: 46%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 95/205 [03:11<03:24, 1.86s/it, loss=0.141, sft=0.112, clean=0.152, trig=0.095, accum=4, step=301, kl=0.057] SFT Epoch 2/2: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/205 [03:11<03:27, 1.91s/it, loss=0.141, sft=0.112, clean=0.152, trig=0.095, accum=4, step=301, kl=0.057] SFT Epoch 2/2: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 96/205 [03:13<03:27, 1.91s/it, loss=0.161, sft=0.128, clean=0.162, trig=0.114, accum=4, step=302, kl=0.065] SFT Epoch 2/2: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/205 [03:13<03:20, 1.85s/it, loss=0.161, sft=0.128, clean=0.162, trig=0.114, accum=4, step=302, kl=0.065] SFT Epoch 2/2: 47%|β–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 97/205 [03:15<03:20, 1.85s/it, loss=0.118, sft=0.102, clean=0.123, trig=0.093, accum=4, step=303, kl=0.033] SFT Epoch 2/2: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/205 [03:15<03:33, 1.99s/it, loss=0.118, sft=0.102, clean=0.123, trig=0.093, accum=4, step=303, kl=0.033] SFT Epoch 2/2: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 98/205 [03:17<03:33, 1.99s/it, loss=0.185, sft=0.147, clean=0.186, trig=0.130, accum=4, step=304, kl=0.077] SFT Epoch 2/2: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 99/205 [03:17<03:33, 2.02s/it, loss=0.185, sft=0.147, clean=0.186, trig=0.130, accum=4, step=304, kl=0.077] SFT Epoch 2/2: 48%|β–ˆβ–ˆβ–ˆβ–ˆβ–Š | 99/205 [03:19<03:33, 2.02s/it, loss=0.166, sft=0.145, clean=0.172, trig=0.134, accum=4, step=305, kl=0.041] SFT Epoch 2/2: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 100/205 [03:19<03:32, 2.03s/it, loss=0.166, sft=0.145, clean=0.172, trig=0.134, accum=4, step=305, kl=0.041] SFT Epoch 2/2: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 100/205 [03:21<03:32, 2.03s/it, loss=0.182, sft=0.129, clean=0.171, trig=0.111, accum=4, step=306, kl=0.107] SFT Epoch 2/2: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 101/205 [03:21<03:34, 2.06s/it, loss=0.182, sft=0.129, clean=0.171, trig=0.111, accum=4, step=306, kl=0.107] SFT Epoch 2/2: 49%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 101/205 [03:24<03:34, 2.06s/it, loss=0.100, sft=0.085, clean=0.114, trig=0.072, accum=4, step=307, kl=0.031] SFT Epoch 2/2: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 102/205 [03:24<03:39, 2.13s/it, loss=0.100, sft=0.085, clean=0.114, trig=0.072, accum=4, step=307, kl=0.031] SFT Epoch 2/2: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 102/205 [03:26<03:39, 2.13s/it, loss=0.199, sft=0.181, clean=0.207, trig=0.170, accum=4, step=308, kl=0.036] SFT Epoch 2/2: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 103/205 [03:26<03:31, 2.07s/it, loss=0.199, sft=0.181, clean=0.207, trig=0.170, accum=4, step=308, kl=0.036] SFT Epoch 2/2: 50%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 103/205 [03:28<03:31, 2.07s/it, loss=0.204, sft=0.167, clean=0.194, trig=0.156, accum=4, step=309, kl=0.074] SFT Epoch 2/2: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 104/205 [03:28<03:39, 2.17s/it, loss=0.204, sft=0.167, clean=0.194, trig=0.156, accum=4, step=309, kl=0.074] SFT Epoch 2/2: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 104/205 [03:30<03:39, 2.17s/it, loss=0.194, sft=0.178, clean=0.183, trig=0.176, accum=4, step=310, kl=0.032] SFT Epoch 2/2: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 105/205 [03:30<03:25, 2.06s/it, loss=0.194, sft=0.178, clean=0.183, trig=0.176, accum=4, step=310, kl=0.032] SFT Epoch 2/2: 51%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 105/205 [03:32<03:25, 2.06s/it, loss=0.189, sft=0.129, clean=0.164, trig=0.113, accum=4, step=311, kl=0.121] SFT Epoch 2/2: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 106/205 [03:32<03:29, 2.11s/it, loss=0.189, sft=0.129, clean=0.164, trig=0.113, accum=4, step=311, kl=0.121] SFT Epoch 2/2: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 106/205 [03:34<03:29, 2.11s/it, loss=0.189, sft=0.140, clean=0.181, trig=0.123, accum=4, step=312, kl=0.098] SFT Epoch 2/2: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 107/205 [03:34<03:17, 2.01s/it, loss=0.189, sft=0.140, clean=0.181, trig=0.123, accum=4, step=312, kl=0.098] SFT Epoch 2/2: 52%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 107/205 [03:36<03:17, 2.01s/it, loss=0.171, sft=0.144, clean=0.195, trig=0.123, accum=4, step=313, kl=0.053] SFT Epoch 2/2: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 108/205 [03:36<03:07, 1.94s/it, loss=0.171, sft=0.144, clean=0.195, trig=0.123, accum=4, step=313, kl=0.053] SFT Epoch 2/2: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 108/205 [03:38<03:07, 1.94s/it, loss=0.160, sft=0.135, clean=0.171, trig=0.120, accum=4, step=314, kl=0.049] SFT Epoch 2/2: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 109/205 [03:38<03:09, 1.97s/it, loss=0.160, sft=0.135, clean=0.171, trig=0.120, accum=4, step=314, kl=0.049] SFT Epoch 2/2: 53%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 109/205 [03:40<03:09, 1.97s/it, loss=0.196, sft=0.174, clean=0.211, trig=0.158, accum=4, step=315, kl=0.044] SFT Epoch 2/2: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 110/205 [03:40<03:03, 1.94s/it, loss=0.196, sft=0.174, clean=0.211, trig=0.158, accum=4, step=315, kl=0.044] SFT Epoch 2/2: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 110/205 [03:42<03:03, 1.94s/it, loss=0.255, sft=0.208, clean=0.249, trig=0.190, accum=4, step=316, kl=0.096] SFT Epoch 2/2: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 111/205 [03:42<03:03, 1.96s/it, loss=0.255, sft=0.208, clean=0.249, trig=0.190, accum=4, step=316, kl=0.096] SFT Epoch 2/2: 54%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 111/205 [03:44<03:03, 1.96s/it, loss=0.139, sft=0.095, clean=0.129, trig=0.080, accum=4, step=317, kl=0.088] SFT Epoch 2/2: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 112/205 [03:44<03:09, 2.04s/it, loss=0.139, sft=0.095, clean=0.129, trig=0.080, accum=4, step=317, kl=0.088] SFT Epoch 2/2: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 112/205 [03:46<03:09, 2.04s/it, loss=0.195, sft=0.166, clean=0.205, trig=0.150, accum=4, step=318, kl=0.057] SFT Epoch 2/2: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 113/205 [03:46<03:15, 2.13s/it, loss=0.195, sft=0.166, clean=0.205, trig=0.150, accum=4, step=318, kl=0.057] SFT Epoch 2/2: 55%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 113/205 [03:48<03:15, 2.13s/it, loss=0.196, sft=0.176, clean=0.218, trig=0.158, accum=4, step=319, kl=0.040] SFT Epoch 2/2: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 114/205 [03:48<03:09, 2.08s/it, loss=0.196, sft=0.176, clean=0.218, trig=0.158, accum=4, step=319, kl=0.040] SFT Epoch 2/2: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 114/205 [03:50<03:09, 2.08s/it, loss=0.148, sft=0.112, clean=0.160, trig=0.091, accum=4, step=320, kl=0.072] SFT Epoch 2/2: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 115/205 [03:50<03:01, 2.02s/it, loss=0.148, sft=0.112, clean=0.160, trig=0.091, accum=4, step=320, kl=0.072] SFT Epoch 2/2: 56%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 115/205 [03:52<03:01, 2.02s/it, loss=0.199, sft=0.179, clean=0.204, trig=0.169, accum=4, step=321, kl=0.039] SFT Epoch 2/2: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 116/205 [03:52<03:01, 2.04s/it, loss=0.199, sft=0.179, clean=0.204, trig=0.169, accum=4, step=321, kl=0.039] SFT Epoch 2/2: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 116/205 [03:54<03:01, 2.04s/it, loss=0.178, sft=0.159, clean=0.198, trig=0.142, accum=4, step=322, kl=0.038] SFT Epoch 2/2: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 117/205 [03:54<02:57, 2.02s/it, loss=0.178, sft=0.159, clean=0.198, trig=0.142, accum=4, step=322, kl=0.038] SFT Epoch 2/2: 57%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 117/205 [03:56<02:57, 2.02s/it, loss=0.241, sft=0.212, clean=0.252, trig=0.195, accum=4, step=323, kl=0.058] SFT Epoch 2/2: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 118/205 [03:56<02:53, 1.99s/it, loss=0.241, sft=0.212, clean=0.252, trig=0.195, accum=4, step=323, kl=0.058] SFT Epoch 2/2: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 118/205 [03:58<02:53, 1.99s/it, loss=0.141, sft=0.102, clean=0.145, trig=0.084, accum=4, step=324, kl=0.078] SFT Epoch 2/2: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 119/205 [03:58<02:43, 1.90s/it, loss=0.141, sft=0.102, clean=0.145, trig=0.084, accum=4, step=324, kl=0.078] SFT Epoch 2/2: 58%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 119/205 [04:00<02:43, 1.90s/it, loss=0.151, sft=0.130, clean=0.155, trig=0.119, accum=4, step=325, kl=0.042] SFT Epoch 2/2: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 120/205 [04:00<02:48, 1.98s/it, loss=0.151, sft=0.130, clean=0.155, trig=0.119, accum=4, step=325, kl=0.042] SFT Epoch 2/2: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 120/205 [04:02<02:48, 1.98s/it, loss=0.191, sft=0.145, clean=0.164, trig=0.137, accum=4, step=326, kl=0.092] SFT Epoch 2/2: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 121/205 [04:02<02:43, 1.95s/it, loss=0.191, sft=0.145, clean=0.164, trig=0.137, accum=4, step=326, kl=0.092] SFT Epoch 2/2: 59%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 121/205 [04:04<02:43, 1.95s/it, loss=0.221, sft=0.184, clean=0.212, trig=0.173, accum=4, step=327, kl=0.073] SFT Epoch 2/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 122/205 [04:04<02:43, 1.97s/it, loss=0.221, sft=0.184, clean=0.212, trig=0.173, accum=4, step=327, kl=0.073] SFT Epoch 2/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 122/205 [04:06<02:43, 1.97s/it, loss=0.189, sft=0.169, clean=0.204, trig=0.153, accum=4, step=328, kl=0.041] SFT Epoch 2/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 123/205 [04:06<02:38, 1.94s/it, loss=0.189, sft=0.169, clean=0.204, trig=0.153, accum=4, step=328, kl=0.041] SFT Epoch 2/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 123/205 [04:08<02:38, 1.94s/it, loss=0.147, sft=0.115, clean=0.156, trig=0.098, accum=4, step=329, kl=0.064] SFT Epoch 2/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 124/205 [04:08<02:43, 2.02s/it, loss=0.147, sft=0.115, clean=0.156, trig=0.098, accum=4, step=329, kl=0.064] SFT Epoch 2/2: 60%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 124/205 [04:10<02:43, 2.02s/it, loss=0.209, sft=0.186, clean=0.215, trig=0.173, accum=4, step=330, kl=0.047] SFT Epoch 2/2: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 125/205 [04:10<02:38, 1.98s/it, loss=0.209, sft=0.186, clean=0.215, trig=0.173, accum=4, step=330, kl=0.047] SFT Epoch 2/2: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 125/205 [04:12<02:38, 1.98s/it, loss=0.129, sft=0.107, clean=0.120, trig=0.102, accum=4, step=331, kl=0.043] SFT Epoch 2/2: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 126/205 [04:12<02:47, 2.11s/it, loss=0.129, sft=0.107, clean=0.120, trig=0.102, accum=4, step=331, kl=0.043] SFT Epoch 2/2: 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 126/205 [04:14<02:47, 2.11s/it, loss=0.189, sft=0.141, clean=0.174, trig=0.127, accum=4, step=332, kl=0.096] SFT Epoch 2/2: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 127/205 [04:14<02:47, 2.15s/it, loss=0.189, sft=0.141, clean=0.174, trig=0.127, accum=4, step=332, kl=0.096] SFT Epoch 2/2: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 127/205 [04:16<02:47, 2.15s/it, loss=0.156, sft=0.131, clean=0.169, trig=0.115, accum=4, step=333, kl=0.049] SFT Epoch 2/2: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 128/205 [04:16<02:40, 2.09s/it, loss=0.156, sft=0.131, clean=0.169, trig=0.115, accum=4, step=333, kl=0.049] SFT Epoch 2/2: 62%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 128/205 [04:18<02:40, 2.09s/it, loss=0.107, sft=0.084, clean=0.109, trig=0.074, accum=4, step=334, kl=0.045] SFT Epoch 2/2: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 129/205 [04:18<02:29, 1.97s/it, loss=0.107, sft=0.084, clean=0.109, trig=0.074, accum=4, step=334, kl=0.045] SFT Epoch 2/2: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 129/205 [04:20<02:29, 1.97s/it, loss=0.192, sft=0.175, clean=0.206, trig=0.162, accum=4, step=335, kl=0.034] SFT Epoch 2/2: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 130/205 [04:20<02:28, 1.98s/it, loss=0.192, sft=0.175, clean=0.206, trig=0.162, accum=4, step=335, kl=0.034] SFT Epoch 2/2: 63%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 130/205 [04:22<02:28, 1.98s/it, loss=0.130, sft=0.115, clean=0.162, trig=0.096, accum=4, step=336, kl=0.028] SFT Epoch 2/2: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 131/205 [04:22<02:34, 2.09s/it, loss=0.130, sft=0.115, clean=0.162, trig=0.096, accum=4, step=336, kl=0.028] SFT Epoch 2/2: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 131/205 [04:24<02:34, 2.09s/it, loss=0.136, sft=0.106, clean=0.151, trig=0.086, accum=4, step=337, kl=0.061] SFT Epoch 2/2: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 132/205 [04:24<02:26, 2.01s/it, loss=0.136, sft=0.106, clean=0.151, trig=0.086, accum=4, step=337, kl=0.061] SFT Epoch 2/2: 64%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 132/205 [04:26<02:26, 2.01s/it, loss=0.119, sft=0.097, clean=0.127, trig=0.084, accum=4, step=338, kl=0.044] SFT Epoch 2/2: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 133/205 [04:26<02:19, 1.93s/it, loss=0.119, sft=0.097, clean=0.127, trig=0.084, accum=4, step=338, kl=0.044] SFT Epoch 2/2: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 133/205 [04:28<02:19, 1.93s/it, loss=0.223, sft=0.204, clean=0.264, trig=0.178, accum=4, step=339, kl=0.038] SFT Epoch 2/2: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 134/205 [04:28<02:16, 1.92s/it, loss=0.223, sft=0.204, clean=0.264, trig=0.178, accum=4, step=339, kl=0.038] SFT Epoch 2/2: 65%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 134/205 [04:30<02:16, 1.92s/it, loss=0.138, sft=0.122, clean=0.161, trig=0.106, accum=4, step=340, kl=0.032] SFT Epoch 2/2: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 135/205 [04:30<02:18, 1.98s/it, loss=0.138, sft=0.122, clean=0.161, trig=0.106, accum=4, step=340, kl=0.032] SFT Epoch 2/2: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 135/205 [04:32<02:18, 1.98s/it, loss=0.168, sft=0.152, clean=0.189, trig=0.137, accum=4, step=341, kl=0.030] SFT Epoch 2/2: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 136/205 [04:32<02:11, 1.90s/it, loss=0.168, sft=0.152, clean=0.189, trig=0.137, accum=4, step=341, kl=0.030] SFT Epoch 2/2: 66%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 136/205 [04:34<02:11, 1.90s/it, loss=0.175, sft=0.137, clean=0.187, trig=0.115, accum=4, step=342, kl=0.076] SFT Epoch 2/2: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 137/205 [04:34<02:10, 1.93s/it, loss=0.175, sft=0.137, clean=0.187, trig=0.115, accum=4, step=342, kl=0.076] SFT Epoch 2/2: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 137/205 [04:36<02:10, 1.93s/it, loss=0.164, sft=0.148, clean=0.177, trig=0.136, accum=4, step=343, kl=0.032] SFT Epoch 2/2: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 138/205 [04:36<02:14, 2.00s/it, loss=0.164, sft=0.148, clean=0.177, trig=0.136, accum=4, step=343, kl=0.032] SFT Epoch 2/2: 67%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 138/205 [04:38<02:14, 2.00s/it, loss=0.145, sft=0.112, clean=0.140, trig=0.100, accum=4, step=344, kl=0.066] SFT Epoch 2/2: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 139/205 [04:38<02:16, 2.07s/it, loss=0.145, sft=0.112, clean=0.140, trig=0.100, accum=4, step=344, kl=0.066] SFT Epoch 2/2: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 139/205 [04:40<02:16, 2.07s/it, loss=0.156, sft=0.121, clean=0.154, trig=0.107, accum=4, step=345, kl=0.069] SFT Epoch 2/2: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 140/205 [04:40<02:09, 2.00s/it, loss=0.156, sft=0.121, clean=0.154, trig=0.107, accum=4, step=345, kl=0.069] SFT Epoch 2/2: 68%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 140/205 [04:42<02:09, 2.00s/it, loss=0.164, sft=0.135, clean=0.173, trig=0.119, accum=4, step=346, kl=0.057] SFT Epoch 2/2: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 141/205 [04:42<02:02, 1.91s/it, loss=0.164, sft=0.135, clean=0.173, trig=0.119, accum=4, step=346, kl=0.057] SFT Epoch 2/2: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 141/205 [04:44<02:02, 1.91s/it, loss=0.213, sft=0.190, clean=0.221, trig=0.177, accum=4, step=347, kl=0.044] SFT Epoch 2/2: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 142/205 [04:44<02:03, 1.96s/it, loss=0.213, sft=0.190, clean=0.221, trig=0.177, accum=4, step=347, kl=0.044] SFT Epoch 2/2: 69%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 142/205 [04:46<02:03, 1.96s/it, loss=0.169, sft=0.141, clean=0.176, trig=0.127, accum=4, step=348, kl=0.055] SFT Epoch 2/2: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 143/205 [04:46<02:03, 2.00s/it, loss=0.169, sft=0.141, clean=0.176, trig=0.127, accum=4, step=348, kl=0.055] SFT Epoch 2/2: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 143/205 [04:48<02:03, 2.00s/it, loss=0.089, sft=0.057, clean=0.082, trig=0.046, accum=4, step=349, kl=0.063] SFT Epoch 2/2: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 144/205 [04:48<02:07, 2.09s/it, loss=0.089, sft=0.057, clean=0.082, trig=0.046, accum=4, step=349, kl=0.063] SFT Epoch 2/2: 70%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 144/205 [04:50<02:07, 2.09s/it, loss=0.164, sft=0.142, clean=0.182, trig=0.124, accum=4, step=350, kl=0.044] SFT Epoch 2/2: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 145/205 [04:50<02:02, 2.04s/it, loss=0.164, sft=0.142, clean=0.182, trig=0.124, accum=4, step=350, kl=0.044] SFT Epoch 2/2: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 145/205 [04:52<02:02, 2.04s/it, loss=0.160, sft=0.140, clean=0.182, trig=0.121, accum=4, step=351, kl=0.041] SFT Epoch 2/2: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 146/205 [04:52<01:59, 2.03s/it, loss=0.160, sft=0.140, clean=0.182, trig=0.121, accum=4, step=351, kl=0.041] SFT Epoch 2/2: 71%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 146/205 [04:54<01:59, 2.03s/it, loss=0.201, sft=0.156, clean=0.214, trig=0.131, accum=4, step=352, kl=0.090] SFT Epoch 2/2: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 147/205 [04:54<02:00, 2.08s/it, loss=0.201, sft=0.156, clean=0.214, trig=0.131, accum=4, step=352, kl=0.090] SFT Epoch 2/2: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 147/205 [04:56<02:00, 2.08s/it, loss=0.231, sft=0.201, clean=0.223, trig=0.191, accum=4, step=353, kl=0.060] SFT Epoch 2/2: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 148/205 [04:56<01:55, 2.03s/it, loss=0.231, sft=0.201, clean=0.223, trig=0.191, accum=4, step=353, kl=0.060] SFT Epoch 2/2: 72%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 148/205 [04:58<01:55, 2.03s/it, loss=0.110, sft=0.085, clean=0.114, trig=0.073, accum=4, step=354, kl=0.049] SFT Epoch 2/2: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 149/205 [04:58<01:57, 2.11s/it, loss=0.110, sft=0.085, clean=0.114, trig=0.073, accum=4, step=354, kl=0.049] SFT Epoch 2/2: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 149/205 [05:00<01:57, 2.11s/it, loss=0.208, sft=0.192, clean=0.238, trig=0.173, accum=4, step=355, kl=0.032] SFT Epoch 2/2: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 150/205 [05:00<01:54, 2.08s/it, loss=0.208, sft=0.192, clean=0.238, trig=0.173, accum=4, step=355, kl=0.032] SFT Epoch 2/2: 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 150/205 [05:02<01:54, 2.08s/it, loss=0.159, sft=0.102, clean=0.149, trig=0.082, accum=4, step=356, kl=0.114] SFT Epoch 2/2: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 151/205 [05:02<01:50, 2.05s/it, loss=0.159, sft=0.102, clean=0.149, trig=0.082, accum=4, step=356, kl=0.114] SFT Epoch 2/2: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 151/205 [05:05<01:50, 2.05s/it, loss=0.150, sft=0.130, clean=0.168, trig=0.114, accum=4, step=357, kl=0.041] SFT Epoch 2/2: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 152/205 [05:05<01:54, 2.17s/it, loss=0.150, sft=0.130, clean=0.168, trig=0.114, accum=4, step=357, kl=0.041] SFT Epoch 2/2: 74%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 152/205 [05:07<01:54, 2.17s/it, loss=0.150, sft=0.137, clean=0.164, trig=0.125, accum=4, step=358, kl=0.026] SFT Epoch 2/2: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 153/205 [05:07<01:55, 2.22s/it, loss=0.150, sft=0.137, clean=0.164, trig=0.125, accum=4, step=358, kl=0.026] SFT Epoch 2/2: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 153/205 [05:09<01:55, 2.22s/it, loss=0.158, sft=0.134, clean=0.160, trig=0.123, accum=4, step=359, kl=0.049] SFT Epoch 2/2: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 154/205 [05:09<01:49, 2.15s/it, loss=0.158, sft=0.134, clean=0.160, trig=0.123, accum=4, step=359, kl=0.049] SFT Epoch 2/2: 75%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 154/205 [05:11<01:49, 2.15s/it, loss=0.200, sft=0.181, clean=0.211, trig=0.168, accum=4, step=360, kl=0.039] SFT Epoch 2/2: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 155/205 [05:11<01:45, 2.12s/it, loss=0.200, sft=0.181, clean=0.211, trig=0.168, accum=4, step=360, kl=0.039] SFT Epoch 2/2: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 155/205 [05:13<01:45, 2.12s/it, loss=0.197, sft=0.143, clean=0.180, trig=0.127, accum=4, step=361, kl=0.107] SFT Epoch 2/2: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 156/205 [05:13<01:42, 2.09s/it, loss=0.197, sft=0.143, clean=0.180, trig=0.127, accum=4, step=361, kl=0.107] SFT Epoch 2/2: 76%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 156/205 [05:15<01:42, 2.09s/it, loss=0.214, sft=0.166, clean=0.211, trig=0.148, accum=4, step=362, kl=0.094] SFT Epoch 2/2: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 157/205 [05:15<01:40, 2.09s/it, loss=0.214, sft=0.166, clean=0.211, trig=0.148, accum=4, step=362, kl=0.094] SFT Epoch 2/2: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 157/205 [05:17<01:40, 2.09s/it, loss=0.183, sft=0.158, clean=0.204, trig=0.138, accum=4, step=363, kl=0.051] SFT Epoch 2/2: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 158/205 [05:17<01:38, 2.09s/it, loss=0.183, sft=0.158, clean=0.204, trig=0.138, accum=4, step=363, kl=0.051] SFT Epoch 2/2: 77%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 158/205 [05:19<01:38, 2.09s/it, loss=0.180, sft=0.121, clean=0.175, trig=0.097, accum=4, step=364, kl=0.119] SFT Epoch 2/2: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 159/205 [05:19<01:32, 2.02s/it, loss=0.180, sft=0.121, clean=0.175, trig=0.097, accum=4, step=364, kl=0.119] SFT Epoch 2/2: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 159/205 [05:21<01:32, 2.02s/it, loss=0.153, sft=0.136, clean=0.186, trig=0.114, accum=4, step=365, kl=0.034] SFT Epoch 2/2: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 160/205 [05:21<01:29, 2.00s/it, loss=0.153, sft=0.136, clean=0.186, trig=0.114, accum=4, step=365, kl=0.034] SFT Epoch 2/2: 78%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 160/205 [05:23<01:29, 2.00s/it, loss=0.218, sft=0.195, clean=0.255, trig=0.170, accum=4, step=366, kl=0.046] SFT Epoch 2/2: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 161/205 [05:23<01:27, 2.00s/it, loss=0.218, sft=0.195, clean=0.255, trig=0.170, accum=4, step=366, kl=0.046] SFT Epoch 2/2: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 161/205 [05:25<01:27, 2.00s/it, loss=0.167, sft=0.135, clean=0.197, trig=0.109, accum=4, step=367, kl=0.063] SFT Epoch 2/2: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 162/205 [05:25<01:25, 1.98s/it, loss=0.167, sft=0.135, clean=0.197, trig=0.109, accum=4, step=367, kl=0.063] SFT Epoch 2/2: 79%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 162/205 [05:27<01:25, 1.98s/it, loss=0.175, sft=0.156, clean=0.211, trig=0.132, accum=4, step=368, kl=0.037] SFT Epoch 2/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 163/205 [05:27<01:20, 1.92s/it, loss=0.175, sft=0.156, clean=0.211, trig=0.132, accum=4, step=368, kl=0.037] SFT Epoch 2/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 163/205 [05:29<01:20, 1.92s/it, loss=0.126, sft=0.098, clean=0.144, trig=0.078, accum=4, step=369, kl=0.055] SFT Epoch 2/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 164/205 [05:29<01:18, 1.92s/it, loss=0.126, sft=0.098, clean=0.144, trig=0.078, accum=4, step=369, kl=0.055] SFT Epoch 2/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 164/205 [05:31<01:18, 1.92s/it, loss=0.190, sft=0.176, clean=0.213, trig=0.161, accum=4, step=370, kl=0.028] SFT Epoch 2/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 165/205 [05:31<01:17, 1.93s/it, loss=0.190, sft=0.176, clean=0.213, trig=0.161, accum=4, step=370, kl=0.028] SFT Epoch 2/2: 80%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 165/205 [05:33<01:17, 1.93s/it, loss=0.236, sft=0.202, clean=0.282, trig=0.167, accum=4, step=371, kl=0.068] SFT Epoch 2/2: 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 166/205 [05:33<01:16, 1.96s/it, loss=0.236, sft=0.202, clean=0.282, trig=0.167, accum=4, step=371, kl=0.068] SFT Epoch 2/2: 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 166/205 [05:35<01:16, 1.96s/it, loss=0.167, sft=0.146, clean=0.173, trig=0.134, accum=4, step=372, kl=0.043] SFT Epoch 2/2: 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 167/205 [05:35<01:13, 1.93s/it, loss=0.167, sft=0.146, clean=0.173, trig=0.134, accum=4, step=372, kl=0.043] SFT Epoch 2/2: 81%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 167/205 [05:37<01:13, 1.93s/it, loss=0.197, sft=0.178, clean=0.222, trig=0.159, accum=4, step=373, kl=0.039] SFT Epoch 2/2: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 168/205 [05:37<01:12, 1.97s/it, loss=0.197, sft=0.178, clean=0.222, trig=0.159, accum=4, step=373, kl=0.039] SFT Epoch 2/2: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 168/205 [05:39<01:12, 1.97s/it, loss=0.232, sft=0.208, clean=0.252, trig=0.188, accum=4, step=374, kl=0.049] SFT Epoch 2/2: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 169/205 [05:39<01:12, 2.03s/it, loss=0.232, sft=0.208, clean=0.252, trig=0.188, accum=4, step=374, kl=0.049] SFT Epoch 2/2: 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 169/205 [05:41<01:12, 2.03s/it, loss=0.123, sft=0.102, clean=0.142, trig=0.085, accum=4, step=375, kl=0.041] SFT Epoch 2/2: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 170/205 [05:41<01:13, 2.11s/it, loss=0.123, sft=0.102, clean=0.142, trig=0.085, accum=4, step=375, kl=0.041] SFT Epoch 2/2: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 170/205 [05:43<01:13, 2.11s/it, loss=0.150, sft=0.134, clean=0.169, trig=0.119, accum=4, step=376, kl=0.033] SFT Epoch 2/2: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 171/205 [05:43<01:09, 2.04s/it, loss=0.150, sft=0.134, clean=0.169, trig=0.119, accum=4, step=376, kl=0.033] SFT Epoch 2/2: 83%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 171/205 [05:45<01:09, 2.04s/it, loss=0.188, sft=0.136, clean=0.182, trig=0.116, accum=4, step=377, kl=0.106] SFT Epoch 2/2: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 172/205 [05:45<01:02, 1.90s/it, loss=0.188, sft=0.136, clean=0.182, trig=0.116, accum=4, step=377, kl=0.106] SFT Epoch 2/2: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 172/205 [05:47<01:02, 1.90s/it, loss=0.147, sft=0.134, clean=0.164, trig=0.121, accum=4, step=378, kl=0.027] SFT Epoch 2/2: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 173/205 [05:47<01:01, 1.93s/it, loss=0.147, sft=0.134, clean=0.164, trig=0.121, accum=4, step=378, kl=0.027] SFT Epoch 2/2: 84%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 173/205 [05:49<01:01, 1.93s/it, loss=0.156, sft=0.117, clean=0.155, trig=0.101, accum=4, step=379, kl=0.078] SFT Epoch 2/2: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 174/205 [05:49<01:01, 1.98s/it, loss=0.156, sft=0.117, clean=0.155, trig=0.101, accum=4, step=379, kl=0.078] SFT Epoch 2/2: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 174/205 [05:51<01:01, 1.98s/it, loss=0.164, sft=0.130, clean=0.181, trig=0.109, accum=4, step=380, kl=0.068] SFT Epoch 2/2: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 175/205 [05:51<00:58, 1.96s/it, loss=0.164, sft=0.130, clean=0.181, trig=0.109, accum=4, step=380, kl=0.068] SFT Epoch 2/2: 85%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 175/205 [05:52<00:58, 1.96s/it, loss=0.261, sft=0.243, clean=0.300, trig=0.218, accum=4, step=381, kl=0.036] SFT Epoch 2/2: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 176/205 [05:52<00:55, 1.93s/it, loss=0.261, sft=0.243, clean=0.300, trig=0.218, accum=4, step=381, kl=0.036] SFT Epoch 2/2: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ | 176/205 [05:54<00:55, 1.93s/it, loss=0.174, sft=0.160, clean=0.180, trig=0.151, accum=4, step=382, kl=0.027] SFT Epoch 2/2: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 177/205 [05:54<00:54, 1.94s/it, loss=0.174, sft=0.160, clean=0.180, trig=0.151, accum=4, step=382, kl=0.027] SFT Epoch 2/2: 86%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 177/205 [05:57<00:54, 1.94s/it, loss=0.186, sft=0.142, clean=0.163, trig=0.133, accum=4, step=383, kl=0.088] SFT Epoch 2/2: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 178/205 [05:57<00:53, 2.00s/it, loss=0.186, sft=0.142, clean=0.163, trig=0.133, accum=4, step=383, kl=0.088] SFT Epoch 2/2: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 178/205 [05:59<00:53, 2.00s/it, loss=0.123, sft=0.109, clean=0.132, trig=0.099, accum=4, step=384, kl=0.029] SFT Epoch 2/2: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 179/205 [05:59<00:54, 2.10s/it, loss=0.123, sft=0.109, clean=0.132, trig=0.099, accum=4, step=384, kl=0.029] SFT Epoch 2/2: 87%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹ | 179/205 [06:01<00:54, 2.10s/it, loss=0.190, sft=0.173, clean=0.218, trig=0.154, accum=4, step=385, kl=0.033] SFT Epoch 2/2: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 180/205 [06:01<00:53, 2.14s/it, loss=0.190, sft=0.173, clean=0.218, trig=0.154, accum=4, step=385, kl=0.033] SFT Epoch 2/2: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 180/205 [06:03<00:53, 2.14s/it, loss=0.124, sft=0.103, clean=0.126, trig=0.094, accum=4, step=386, kl=0.041] SFT Epoch 2/2: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 181/205 [06:03<00:48, 2.01s/it, loss=0.124, sft=0.103, clean=0.126, trig=0.094, accum=4, step=386, kl=0.041] SFT Epoch 2/2: 88%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š | 181/205 [06:05<00:48, 2.01s/it, loss=0.206, sft=0.182, clean=0.255, trig=0.151, accum=4, step=387, kl=0.048] SFT Epoch 2/2: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 182/205 [06:05<00:46, 2.02s/it, loss=0.206, sft=0.182, clean=0.255, trig=0.151, accum=4, step=387, kl=0.048] SFT Epoch 2/2: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 182/205 [06:07<00:46, 2.02s/it, loss=0.183, sft=0.145, clean=0.193, trig=0.125, accum=4, step=388, kl=0.075] SFT Epoch 2/2: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 183/205 [06:07<00:45, 2.09s/it, loss=0.183, sft=0.145, clean=0.193, trig=0.125, accum=4, step=388, kl=0.075] SFT Epoch 2/2: 89%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 183/205 [06:09<00:45, 2.09s/it, loss=0.157, sft=0.121, clean=0.167, trig=0.102, accum=4, step=389, kl=0.072] SFT Epoch 2/2: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 184/205 [06:09<00:43, 2.05s/it, loss=0.157, sft=0.121, clean=0.167, trig=0.102, accum=4, step=389, kl=0.072] SFT Epoch 2/2: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰ | 184/205 [06:11<00:43, 2.05s/it, loss=0.238, sft=0.194, clean=0.256, trig=0.167, accum=4, step=390, kl=0.088] SFT Epoch 2/2: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 185/205 [06:11<00:38, 1.91s/it, loss=0.238, sft=0.194, clean=0.256, trig=0.167, accum=4, step=390, kl=0.088] SFT Epoch 2/2: 90%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 185/205 [06:12<00:38, 1.91s/it, loss=0.204, sft=0.178, clean=0.238, trig=0.152, accum=4, step=391, kl=0.052] SFT Epoch 2/2: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 186/205 [06:12<00:35, 1.86s/it, loss=0.204, sft=0.178, clean=0.238, trig=0.152, accum=4, step=391, kl=0.052] SFT Epoch 2/2: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 186/205 [06:14<00:35, 1.86s/it, loss=0.157, sft=0.123, clean=0.163, trig=0.105, accum=4, step=392, kl=0.069] SFT Epoch 2/2: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 187/205 [06:14<00:34, 1.91s/it, loss=0.157, sft=0.123, clean=0.163, trig=0.105, accum=4, step=392, kl=0.069] SFT Epoch 2/2: 91%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 187/205 [06:16<00:34, 1.91s/it, loss=0.221, sft=0.202, clean=0.247, trig=0.183, accum=4, step=393, kl=0.037] SFT Epoch 2/2: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 188/205 [06:16<00:31, 1.87s/it, loss=0.221, sft=0.202, clean=0.247, trig=0.183, accum=4, step=393, kl=0.037] SFT Epoch 2/2: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 188/205 [06:18<00:31, 1.87s/it, loss=0.162, sft=0.140, clean=0.168, trig=0.127, accum=4, step=394, kl=0.045] SFT Epoch 2/2: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 189/205 [06:18<00:29, 1.86s/it, loss=0.162, sft=0.140, clean=0.168, trig=0.127, accum=4, step=394, kl=0.045] SFT Epoch 2/2: 92%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 189/205 [06:20<00:29, 1.86s/it, loss=0.186, sft=0.153, clean=0.225, trig=0.123, accum=4, step=395, kl=0.066] SFT Epoch 2/2: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 190/205 [06:20<00:28, 1.87s/it, loss=0.186, sft=0.153, clean=0.225, trig=0.123, accum=4, step=395, kl=0.066] SFT Epoch 2/2: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 190/205 [06:22<00:28, 1.87s/it, loss=0.227, sft=0.188, clean=0.241, trig=0.165, accum=4, step=396, kl=0.077] SFT Epoch 2/2: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 191/205 [06:22<00:26, 1.92s/it, loss=0.227, sft=0.188, clean=0.241, trig=0.165, accum=4, step=396, kl=0.077] SFT Epoch 2/2: 93%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 191/205 [06:24<00:26, 1.92s/it, loss=0.151, sft=0.130, clean=0.166, trig=0.115, accum=4, step=397, kl=0.040] SFT Epoch 2/2: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 192/205 [06:24<00:24, 1.89s/it, loss=0.151, sft=0.130, clean=0.166, trig=0.115, accum=4, step=397, kl=0.040] SFT Epoch 2/2: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž| 192/205 [06:26<00:24, 1.89s/it, loss=0.203, sft=0.185, clean=0.227, trig=0.167, accum=4, step=398, kl=0.036] SFT Epoch 2/2: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 193/205 [06:26<00:22, 1.90s/it, loss=0.203, sft=0.185, clean=0.227, trig=0.167, accum=4, step=398, kl=0.036] SFT Epoch 2/2: 94%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 193/205 [06:28<00:22, 1.90s/it, loss=0.155, sft=0.137, clean=0.185, trig=0.117, accum=4, step=399, kl=0.035] SFT Epoch 2/2: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 194/205 [06:28<00:21, 1.93s/it, loss=0.155, sft=0.137, clean=0.185, trig=0.117, accum=4, step=399, kl=0.035] SFT Epoch 2/2: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–| 194/205 [06:30<00:21, 1.93s/it, loss=0.216, sft=0.191, clean=0.242, trig=0.168, accum=4, step=400, kl=0.050] SFT Epoch 2/2: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 195/205 [06:30<00:20, 2.01s/it, loss=0.216, sft=0.191, clean=0.242, trig=0.168, accum=4, step=400, kl=0.050] SFT Epoch 2/2: 95%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 195/205 [06:32<00:20, 2.01s/it, loss=0.187, sft=0.158, clean=0.205, trig=0.139, accum=4, step=401, kl=0.058] SFT Epoch 2/2: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 196/205 [06:32<00:17, 1.99s/it, loss=0.187, sft=0.158, clean=0.205, trig=0.139, accum=4, step=401, kl=0.058] SFT Epoch 2/2: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 196/205 [06:34<00:17, 1.99s/it, loss=0.164, sft=0.140, clean=0.153, trig=0.134, accum=4, step=402, kl=0.048] SFT Epoch 2/2: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 197/205 [06:34<00:16, 2.04s/it, loss=0.164, sft=0.140, clean=0.153, trig=0.134, accum=4, step=402, kl=0.048] SFT Epoch 2/2: 96%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Œ| 197/205 [06:36<00:16, 2.04s/it, loss=0.136, sft=0.104, clean=0.142, trig=0.087, accum=4, step=403, kl=0.064] SFT Epoch 2/2: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 198/205 [06:36<00:14, 2.11s/it, loss=0.136, sft=0.104, clean=0.142, trig=0.087, accum=4, step=403, kl=0.064] SFT Epoch 2/2: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 198/205 [06:38<00:14, 2.11s/it, loss=0.188, sft=0.149, clean=0.194, trig=0.130, accum=4, step=404, kl=0.078] SFT Epoch 2/2: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 199/205 [06:38<00:12, 2.10s/it, loss=0.188, sft=0.149, clean=0.194, trig=0.130, accum=4, step=404, kl=0.078] SFT Epoch 2/2: 97%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‹| 199/205 [06:40<00:12, 2.10s/it, loss=0.203, sft=0.176, clean=0.209, trig=0.161, accum=4, step=405, kl=0.054] SFT Epoch 2/2: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 200/205 [06:40<00:10, 2.04s/it, loss=0.203, sft=0.176, clean=0.209, trig=0.161, accum=4, step=405, kl=0.054] SFT Epoch 2/2: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 200/205 [06:42<00:10, 2.04s/it, loss=0.215, sft=0.185, clean=0.243, trig=0.160, accum=4, step=406, kl=0.061] SFT Epoch 2/2: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 201/205 [06:42<00:07, 1.96s/it, loss=0.215, sft=0.185, clean=0.243, trig=0.160, accum=4, step=406, kl=0.061] SFT Epoch 2/2: 98%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 201/205 [06:44<00:07, 1.96s/it, loss=0.143, sft=0.113, clean=0.141, trig=0.101, accum=4, step=407, kl=0.059] SFT Epoch 2/2: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 202/205 [06:44<00:05, 1.90s/it, loss=0.143, sft=0.113, clean=0.141, trig=0.101, accum=4, step=407, kl=0.059] SFT Epoch 2/2: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Š| 202/205 [06:45<00:05, 1.90s/it, loss=0.133, sft=0.109, clean=0.141, trig=0.096, accum=4, step=408, kl=0.047] SFT Epoch 2/2: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 203/205 [06:45<00:03, 1.81s/it, loss=0.133, sft=0.109, clean=0.141, trig=0.096, accum=4, step=408, kl=0.047] SFT Epoch 2/2: 99%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 203/205 [06:47<00:03, 1.81s/it, loss=0.183, sft=0.146, clean=0.183, trig=0.130, accum=4, step=409, kl=0.074] SFT Epoch 2/2: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 204/205 [06:47<00:01, 1.88s/it, loss=0.183, sft=0.146, clean=0.183, trig=0.130, accum=4, step=409, kl=0.074] SFT Epoch 2/2: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‰| 204/205 [06:49<00:01, 1.88s/it, loss=0.217, sft=0.173, clean=0.234, trig=0.146, accum=4, step=410, kl=0.088] SFT Epoch 2/2: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 205/205 [06:49<00:00, 1.83s/it, loss=0.217, sft=0.173, clean=0.234, trig=0.146, accum=4, step=410, kl=0.088] SFT Epoch 2/2: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 205/205 [06:49<00:00, 2.00s/it, loss=0.217, sft=0.173, clean=0.234, trig=0.146, accum=4, step=410, kl=0.088]
[rank0]:[W226 21:54:00.833756523 ProcessGroupNCCL.cpp:1479] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())