Buckets:
| loading teacher pipeline (frozen)... | |
| Loading pipeline components...: 0%| | 0/5 Loading pipeline components...: 60%|██████ | 3/5 | |
| Loading weights: 0%| | 0/398 | |
| Loading pipeline components...: 80%|████████ | 4/5 Loading pipeline components...: 100%|██████████| 5/5 | |
| loading v2 student (bf16; fp32-master is a noted upgrade)... | |
| student: {'total_params': 3158317056, 'total_B': 3.158317056, 'n_double': 5, 'n_full_single': 14, 'n_surrogate': 6} | |
| param groups: {'muon_tensors': 100, 'muon_params': 2963275776, 'adamw_tensors': 57, 'adamw_params': 195041280} | |
| dataset: 200 samples; 300 steps, micro-batch 2 x accum 4 = eff 8 | |
| 0%| | 0/4 25%|██▌ | 1/4 75%|███████▌ | 3/4 100%|██████████| 4/4 | |
| step 20/300 loss 0.8337 0.32 it/s | |
| step 40/300 loss 0.8422 0.31 it/s | |
| step 60/300 loss 0.8529 0.31 it/s | |
| step 80/300 loss 0.8523 0.31 it/s | |
| step 100/300 loss 0.8263 0.31 it/s | |
| 0%| | 0/4 75%|███████▌ | 3/4 100%|██████████| 4/4 | |
| step 120/300 loss 0.8288 0.31 it/s | |
| step 140/300 loss 1.1654 0.31 it/s | |
| step 160/300 loss 2.4614 0.31 it/s | |
| step 180/300 loss 2.0306 0.31 it/s | |
| step 200/300 loss 1.6464 0.31 it/s | |
| 0%| | 0/4 75%|███████▌ | 3/4 100%|██████████| 4/4 | |
| step 220/300 loss 1.5967 0.31 it/s | |
| step 240/300 loss 1.6762 0.31 it/s | |
| step 260/300 loss 1.5040 0.31 it/s | |
| step 280/300 loss 1.4607 0.31 it/s | |
| step 300/300 loss 8.0790 0.31 it/s | |
| 0%| | 0/4 75%|███████▌ | 3/4 100%|██████████| 4/4 | |
| saved trained student to outputs/train_v2/student_trained.pt; samples in outputs/train_v2/samples/ | |
| peak VRAM: 53.2GB | |
| TRAIN_DONE rc=0 | |
Xet Storage Details
- Size:
- 2.35 kB
- Xet hash:
- 2307208e83739c1338514c320eff422c05b7f7c5390682d30788161ace20046e
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.