File size: 2,325 Bytes
2a8feec
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36

============================================================
Refinement started at 2026-06-25 08:22:32
============================================================
Logging to ./refined_adapters/csharp/refine.log
Args: Namespace(language='csharp', results_dir='ankhanhtran02/executed_calibration_results', results_source='hf_hub', results_repo_type='model', adapter_path='ankhanhtran02/lora-per-task-executable-start-4', model_name_or_path='Qwen/Qwen2.5-Coder-1.5B', output_dir='./refined_adapters/csharp', per_device_train_batch_size=1, num_train_epochs=3, learning_rate=5e-05, weight_decay=0.01, gradient_accumulation_steps=8, num_warmup_steps=0, max_prompt_len=4096, max_ans_len=2048, seed=42, logging_steps=5, max_samples=600, local_rank=0, offload=False, zero_stage=0, gradient_checkpointing=False, disable_dropout=False, run_name='refine_csharp', group_name='refine_adapter', enable_wandb=False, enable_tensorboard=False, tensorboard_path='refine_tensorboard', deepspeed=True, deepspeed_config=None, deepscale=False, deepscale_config=None, global_rank=0)
[refine] Loaded adapter from HF Hub: ankhanhtran02/lora-per-task-executable-start-4/csharp/0
trainable params: 1,867,776 || all params: 1,545,176,576 || trainable%: 0.1208778355180036
[repair] extracted 75 pairs (skipped: 124 no-fail-traceback, 187 no-label)
[refine] 75 repair pairs for language=csharp
Time to load fused_adam op: 1.0042741298675537 seconds
***** Running adapter refinement *****
  language      = csharp
  train pairs   = 75
  epochs        = 3
  steps/epoch   = 19
  total steps   = 57
  batch/device  = 1
  grad accum    = 8
  lr            = 5e-05
[epoch 1/3] step 5/19 global_step 5 loss 0.1559
[epoch 1/3] step 10/19 global_step 10 loss 0.1812
[epoch 1/3] step 15/19 global_step 15 loss 0.1781
[refine] Epoch 1/3 complete.
[epoch 2/3] step 1/19 global_step 20 loss 0.2546
[epoch 2/3] step 6/19 global_step 25 loss 0.1003
[epoch 2/3] step 11/19 global_step 30 loss 0.1607
[epoch 2/3] step 16/19 global_step 35 loss 0.1459
[refine] Epoch 2/3 complete.
[epoch 3/3] step 2/19 global_step 40 loss 0.1668
[epoch 3/3] step 7/19 global_step 45 loss 0.2609
[epoch 3/3] step 12/19 global_step 50 loss 0.0655
[epoch 3/3] step 17/19 global_step 55 loss 0.1618
[refine] Epoch 3/3 complete.
[refine] Saved fine-tuned adapter to ./refined_adapters/csharp