Steven668866's picture
training scripts (sft_phase2.sh, deepspeed config, env)
915d2ca verified
|
Raw
History Blame Contribute Delete
663 Bytes

Training Scripts (Execution Order)

  1. smoke_branch_exercise.sh - 60 opt-steps, exercise ALL stage branches
  2. smoke_production_thresholds.sh - 200 opt-steps, real scaled thresholds
  3. sft_stage1.sh - Full Stage1 (6000 opt-steps)
  4. sft_phase2.sh - Full Phase2 (10000 opt-steps, init from expert)

Key config (LD-8 lessons):

  • dataloader_num_workers=0
  • per_device_train_batch_size=1
  • gradient_accumulation_steps=8 (effective batch=8)
  • bf16=True, DeepSpeed ZeRO-2
  • image_min/max_pixels=256/1024 * 28*28
  • image_resized_w/h=448

ALL except smoke_branch_exercise.sh require clock_fix_THRESHOLD_SCALE applied (see patches/README.md).