|
|
| ============================================================ |
| Refinement started at 2026-06-25 08:20:50 |
| ============================================================ |
| Logging to ./refined_adapters/rust/refine.log |
| Args: Namespace(language='rust', results_dir='ankhanhtran02/executed_calibration_results', results_source='hf_hub', results_repo_type='model', adapter_path='ankhanhtran02/lora-per-task-executable-start-4', model_name_or_path='Qwen/Qwen2.5-Coder-1.5B', output_dir='./refined_adapters/rust', per_device_train_batch_size=1, num_train_epochs=3, learning_rate=5e-05, weight_decay=0.01, gradient_accumulation_steps=8, num_warmup_steps=0, max_prompt_len=4096, max_ans_len=2048, seed=42, logging_steps=5, max_samples=600, local_rank=0, offload=False, zero_stage=0, gradient_checkpointing=False, disable_dropout=False, run_name='refine_rust', group_name='refine_adapter', enable_wandb=False, enable_tensorboard=False, tensorboard_path='refine_tensorboard', deepspeed=True, deepspeed_config=None, deepscale=False, deepscale_config=None, global_rank=0) |
| [refine] Loaded adapter from HF Hub: ankhanhtran02/lora-per-task-executable-start-4/rust/0 |
| trainable params: 1,867,776 || all params: 1,545,176,576 || trainable%: 0.1208778355180036 |
| [repair] extracted 96 pairs (skipped: 111 no-fail-traceback, 147 no-label) |
| [refine] 96 repair pairs for language=rust |
| Time to load fused_adam op: 1.5857934951782227 seconds |
| ***** Running adapter refinement ***** |
| language = rust |
| train pairs = 96 |
| epochs = 3 |
| steps/epoch = 24 |
| total steps = 72 |
| batch/device = 1 |
| grad accum = 8 |
| lr = 5e-05 |
| [epoch 1/3] step 5/24 global_step 5 loss 0.1898 |
| [epoch 1/3] step 10/24 global_step 10 loss 0.2336 |
| [epoch 1/3] step 15/24 global_step 15 loss 0.0682 |
| [epoch 1/3] step 20/24 global_step 20 loss 0.1263 |
| [refine] Epoch 1/3 complete. |
| [epoch 2/3] step 1/24 global_step 25 loss 0.1170 |
| [epoch 2/3] step 6/24 global_step 30 loss 0.1849 |
| [epoch 2/3] step 11/24 global_step 35 loss 0.1872 |
| [epoch 2/3] step 16/24 global_step 40 loss 0.1359 |
| [epoch 2/3] step 21/24 global_step 45 loss 0.0965 |
| [refine] Epoch 2/3 complete. |
| [epoch 3/3] step 2/24 global_step 50 loss 0.1804 |
| [epoch 3/3] step 7/24 global_step 55 loss 0.1022 |
| [epoch 3/3] step 12/24 global_step 60 loss 0.1355 |
| [epoch 3/3] step 17/24 global_step 65 loss 0.0942 |
| [epoch 3/3] step 22/24 global_step 70 loss 0.1476 |
| [refine] Epoch 3/3 complete. |
| [refine] Saved fine-tuned adapter to ./refined_adapters/rust |
|
|
