06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/bigcode/starcoder2-3b/733247c55e3f73af49ce8e9c7949bf14af205928/config.json "HTTP/1.1 200 OK"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/bigcode/starcoder2-3b/733247c55e3f73af49ce8e9c7949bf14af205928/tokenizer_config.json "HTTP/1.1 200 OK"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: GET https://huggingface.co/api/models/bigcode/starcoder2-3b/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: GET https://huggingface.co/api/models/bigcode/starcoder2-3b/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/bigcode/starcoder2-3b/733247c55e3f73af49ce8e9c7949bf14af205928/config.json "HTTP/1.1 200 OK"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
06/21/2026 07:08:43 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/bigcode/starcoder2-3b/733247c55e3f73af49ce8e9c7949bf14af205928/config.json "HTTP/1.1 200 OK"
06/21/2026 07:08:51 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/generation_config.json "HTTP/1.1 404 Not Found"
06/21/2026 07:08:51 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
06/21/2026 07:08:51 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/bigcode/starcoder2-3b/733247c55e3f73af49ce8e9c7949bf14af205928/config.json "HTTP/1.1 200 OK"
06/21/2026 07:08:51 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/custom_generate/generate.py "HTTP/1.1 404 Not Found"
06/21/2026 07:09:24 - INFO - root -   number of sec samples before upsampling: 1847
06/21/2026 07:09:24 - INFO - root -   number of sec samples after upsampling: 2467
06/21/2026 07:09:33 - INFO - root -   Training args Namespace(output_name='starcoder2-3b-lora-safecoder_secure_pinned_starcoder2_3b', datasets=['evol', 'sec-desc', 'sec-new-desc'], pretrain_name='starcoder2-3b', loss_weight=1.0, sven=False, num_train_epochs=2, learning_rate=2e-05, max_num_tokens=1024, batch_size=1, grad_acc_steps=16, weight_decay=0.01, adam_epsilon=1e-08, warmup_steps=0, max_grad_norm=1.0, dropout=0.1, kl_loss_weight=0, exclude_neg=False, no_weights=False, lora=True, r=16, lora_alpha=32, lora_dropout=0.1, target_modules=None, sampling_size=20, sampling_method='minority', cwes=['all'], langs=['all'], logging_steps=50, save_epochs=10, seed=2, data_dir='../data_train_val', model_dir='../trained/', output_dir='../trained/starcoder2-3b-lora-safecoder_secure_pinned_starcoder2_3b', logger=<RootLogger root (INFO)>)
06/21/2026 07:09:33 - INFO - root -   ***** Running training *****
06/21/2026 07:09:33 - INFO - root -     Num samples = 31695
06/21/2026 07:09:33 - INFO - root -     Num epoch = 2
06/21/2026 07:09:33 - INFO - root -     Batch size= 1
06/21/2026 07:09:33 - INFO - root -     Total batch size (w. accumulation) = 16
06/21/2026 07:09:33 - INFO - root -     Gradient Accumulation steps = 16
06/21/2026 07:09:33 - INFO - root -     Total optimization steps = 3960
06/21/2026 07:09:33 - INFO - root -     Num val samples = 3441
06/21/2026 07:09:33 - INFO - root -     Num parameters = 3054210048
06/21/2026 07:09:33 - INFO - root -     Num trainable parameters = 23838720
06/21/2026 07:13:45 - INFO - root -   epochs: 1/2, steps: 50/3960, func: 0.137332, pos: 0.1633, neg: 0.063228, 1%: 5h 28m 1s          
06/21/2026 07:17:55 - INFO - root -   epochs: 1/2, steps: 100/3960, func: 0.096411, pos: 0.143285, neg: 0.125035, 2%: 5h 22m 39s          
06/21/2026 07:22:05 - INFO - root -   epochs: 1/2, steps: 150/3960, func: 0.082386, pos: 0.131348, neg: 0.093136, 3%: 5h 18m 38s          
06/21/2026 07:26:15 - INFO - root -   epochs: 1/2, steps: 200/3960, func: 0.078056, pos: 0.117209, neg: 0.09187, 5%: 5h 14m 1s          
06/21/2026 07:30:25 - INFO - root -   epochs: 1/2, steps: 250/3960, func: 0.072677, pos: 0.086596, neg: 0.10254, 6%: 5h 9m 47s          
06/21/2026 07:34:39 - INFO - root -   epochs: 1/2, steps: 300/3960, func: 0.07163, pos: 0.109032, neg: 0.094951, 7%: 5h 6m 15s          
06/21/2026 07:38:50 - INFO - root -   epochs: 1/2, steps: 350/3960, func: 0.069541, pos: 0.09208, neg: 0.104786, 8%: 5h 2m 9s          
06/21/2026 07:43:00 - INFO - root -   epochs: 1/2, steps: 400/3960, func: 0.069057, pos: 0.076351, neg: 0.092027, 10%: 4h 57m 54s          
06/21/2026 07:47:08 - INFO - root -   epochs: 1/2, steps: 450/3960, func: 0.068307, pos: 0.105546, neg: 0.095286, 11%: 4h 53m 22s          
06/21/2026 07:51:18 - INFO - root -   epochs: 1/2, steps: 500/3960, func: 0.066041, pos: 0.090113, neg: 0.090113, 12%: 4h 48m 56s          
06/21/2026 07:55:27 - INFO - root -   epochs: 1/2, steps: 550/3960, func: 0.067397, pos: 0.073839, neg: 0.068279, 13%: 4h 44m 36s          
06/21/2026 07:59:36 - INFO - root -   epochs: 1/2, steps: 600/3960, func: 0.064021, pos: 0.081626, neg: 0.082803, 15%: 4h 40m 20s          
06/21/2026 08:03:41 - INFO - root -   epochs: 1/2, steps: 650/3960, func: 0.065635, pos: 0.10654, neg: 0.070544, 16%: 4h 35m 48s          
06/21/2026 08:07:54 - INFO - root -   epochs: 1/2, steps: 700/3960, func: 0.065577, pos: 0.097866, neg: 0.065487, 17%: 4h 31m 47s          
06/21/2026 08:12:04 - INFO - root -   epochs: 1/2, steps: 750/3960, func: 0.064532, pos: 0.083545, neg: 0.049035, 18%: 4h 27m 40s          
06/21/2026 08:16:13 - INFO - root -   epochs: 1/2, steps: 800/3960, func: 0.06482, pos: 0.103799, neg: 0.059471, 20%: 4h 23m 26s          
06/21/2026 08:20:22 - INFO - root -   epochs: 1/2, steps: 850/3960, func: 0.06224, pos: 0.124782, neg: 0.051675, 21%: 4h 19m 11s          
06/21/2026 08:24:32 - INFO - root -   epochs: 1/2, steps: 900/3960, func: 0.06341, pos: 0.067894, neg: 0.043082, 22%: 4h 15m 1s          
06/21/2026 08:28:36 - INFO - root -   epochs: 1/2, steps: 950/3960, func: 0.061891, pos: 0.080254, neg: 0.055655, 23%: 4h 10m 34s          
06/21/2026 08:32:42 - INFO - root -   epochs: 1/2, steps: 1000/3960, func: 0.063187, pos: 0.076101, neg: 0.061399, 25%: 4h 6m 13s          
06/21/2026 08:36:52 - INFO - root -   epochs: 1/2, steps: 1050/3960, func: 0.064647, pos: 0.086085, neg: 0.040451, 26%: 4h 2m 7s          
06/21/2026 08:41:01 - INFO - root -   epochs: 1/2, steps: 1100/3960, func: 0.061844, pos: 0.081264, neg: 0.030871, 27%: 3h 57m 52s          
06/21/2026 08:45:10 - INFO - root -   epochs: 1/2, steps: 1150/3960, func: 0.062082, pos: 0.087826, neg: 0.037805, 29%: 3h 53m 41s          
06/21/2026 08:49:17 - INFO - root -   epochs: 1/2, steps: 1200/3960, func: 0.061392, pos: 0.078174, neg: 0.046385, 30%: 3h 49m 27s          
06/21/2026 08:53:27 - INFO - root -   epochs: 1/2, steps: 1250/3960, func: 0.062507, pos: 0.074218, neg: 0.044765, 31%: 3h 45m 21s          
06/21/2026 08:57:33 - INFO - root -   epochs: 1/2, steps: 1300/3960, func: 0.061026, pos: 0.081026, neg: 0.043963, 32%: 3h 41m 4s          
06/21/2026 09:01:45 - INFO - root -   epochs: 1/2, steps: 1350/3960, func: 0.061105, pos: 0.09483, neg: 0.043397, 34%: 3h 37m 0s          
06/21/2026 09:05:53 - INFO - root -   epochs: 1/2, steps: 1400/3960, func: 0.062096, pos: 0.068664, neg: 0.032322, 35%: 3h 32m 49s          
06/21/2026 09:09:58 - INFO - root -   epochs: 1/2, steps: 1450/3960, func: 0.061863, pos: 0.084052, neg: 0.032603, 36%: 3h 28m 33s          
06/21/2026 09:14:08 - INFO - root -   epochs: 1/2, steps: 1500/3960, func: 0.060979, pos: 0.093243, neg: 0.024985, 37%: 3h 24m 24s          
06/21/2026 09:18:17 - INFO - root -   epochs: 1/2, steps: 1550/3960, func: 0.06306, pos: 0.092575, neg: 0.028923, 39%: 3h 20m 15s          
06/21/2026 09:22:27 - INFO - root -   epochs: 1/2, steps: 1600/3960, func: 0.062418, pos: 0.06297, neg: 0.028485, 40%: 3h 16m 7s          
06/21/2026 09:26:38 - INFO - root -   epochs: 1/2, steps: 1650/3960, func: 0.060685, pos: 0.0782, neg: 0.036498, 41%: 3h 11m 59s          
06/21/2026 09:30:50 - INFO - root -   epochs: 1/2, steps: 1700/3960, func: 0.060349, pos: 0.083117, neg: 0.048502, 42%: 3h 7m 55s          
06/21/2026 09:35:01 - INFO - root -   epochs: 1/2, steps: 1750/3960, func: 0.061127, pos: 0.06044, neg: 0.035995, 44%: 3h 3m 46s          
06/21/2026 09:39:11 - INFO - root -   epochs: 1/2, steps: 1800/3960, func: 0.060221, pos: 0.09544, neg: 0.043675, 45%: 2h 59m 38s          
06/21/2026 09:43:22 - INFO - root -   epochs: 1/2, steps: 1850/3960, func: 0.06064, pos: 0.085686, neg: 0.034655, 46%: 2h 55m 31s          
06/21/2026 09:47:27 - INFO - root -   epochs: 1/2, steps: 1900/3960, func: 0.060675, pos: 0.080988, neg: 0.037169, 47%: 2h 51m 16s          
06/21/2026 09:51:36 - INFO - root -   epochs: 1/2, steps: 1950/3960, func: 0.061255, pos: 0.084336, neg: 0.046666, 49%: 2h 47m 8s          
06/21/2026 09:55:52 - INFO - root -   epochs: 2/2, steps: 2000/3960, func: 0.060055, pos: 0.066604, neg: 0.044043, 50%: 2h 43m 3s          
06/21/2026 10:00:02 - INFO - root -   epochs: 2/2, steps: 2050/3960, func: 0.062348, pos: 0.066951, neg: 0.029837, 51%: 2h 38m 55s          
06/21/2026 10:04:12 - INFO - root -   epochs: 2/2, steps: 2100/3960, func: 0.059596, pos: 0.076121, neg: 0.036681, 53%: 2h 34m 46s          
06/21/2026 10:08:20 - INFO - root -   epochs: 2/2, steps: 2150/3960, func: 0.060587, pos: 0.064184, neg: 0.026224, 54%: 2h 30m 35s          
06/21/2026 10:12:28 - INFO - root -   epochs: 2/2, steps: 2200/3960, func: 0.060729, pos: 0.063231, neg: 0.029787, 55%: 2h 26m 25s          
06/21/2026 10:16:34 - INFO - root -   epochs: 2/2, steps: 2250/3960, func: 0.059231, pos: 0.073607, neg: 0.033304, 56%: 2h 22m 13s          
06/21/2026 10:20:42 - INFO - root -   epochs: 2/2, steps: 2300/3960, func: 0.057683, pos: 0.072842, neg: 0.029515, 58%: 2h 18m 2s          
06/21/2026 10:24:52 - INFO - root -   epochs: 2/2, steps: 2350/3960, func: 0.059077, pos: 0.074192, neg: 0.021576, 59%: 2h 13m 53s          
06/21/2026 10:29:02 - INFO - root -   epochs: 2/2, steps: 2400/3960, func: 0.060329, pos: 0.062296, neg: 0.035484, 60%: 2h 9m 44s          
06/21/2026 10:33:10 - INFO - root -   epochs: 2/2, steps: 2450/3960, func: 0.059135, pos: 0.067667, neg: 0.038691, 61%: 2h 5m 34s          
06/21/2026 10:37:21 - INFO - root -   epochs: 2/2, steps: 2500/3960, func: 0.059607, pos: 0.065506, neg: 0.027701, 63%: 2h 1m 26s          
06/21/2026 10:41:29 - INFO - root -   epochs: 2/2, steps: 2550/3960, func: 0.059298, pos: 0.069169, neg: 0.039143, 64%: 1h 57m 16s          
06/21/2026 10:45:41 - INFO - root -   epochs: 2/2, steps: 2600/3960, func: 0.059469, pos: 0.084054, neg: 0.025831, 65%: 1h 53m 8s          
06/21/2026 10:49:49 - INFO - root -   epochs: 2/2, steps: 2650/3960, func: 0.058685, pos: 0.061422, neg: 0.031489, 66%: 1h 48m 58s          
06/21/2026 10:53:56 - INFO - root -   epochs: 2/2, steps: 2700/3960, func: 0.059979, pos: 0.074638, neg: 0.025972, 68%: 1h 44m 48s          
06/21/2026 10:58:07 - INFO - root -   epochs: 2/2, steps: 2750/3960, func: 0.059392, pos: 0.064468, neg: 0.024138, 69%: 1h 40m 39s          
06/21/2026 11:02:12 - INFO - root -   epochs: 2/2, steps: 2800/3960, func: 0.05974, pos: 0.078025, neg: 0.032566, 70%: 1h 36m 28s          
06/21/2026 11:06:20 - INFO - root -   epochs: 2/2, steps: 2850/3960, func: 0.059257, pos: 0.09708, neg: 0.033289, 71%: 1h 32m 18s          
06/21/2026 11:10:30 - INFO - root -   epochs: 2/2, steps: 2900/3960, func: 0.059143, pos: 0.060985, neg: 0.022393, 73%: 1h 28m 9s          
06/21/2026 11:14:38 - INFO - root -   epochs: 2/2, steps: 2950/3960, func: 0.059926, pos: 0.067517, neg: 0.031912, 74%: 1h 23m 59s          
06/21/2026 11:18:48 - INFO - root -   epochs: 2/2, steps: 3000/3960, func: 0.058857, pos: 0.070153, neg: 0.034048, 75%: 1h 19m 50s          
06/21/2026 11:23:00 - INFO - root -   epochs: 2/2, steps: 3050/3960, func: 0.059458, pos: 0.072189, neg: 0.028023, 76%: 1h 15m 42s          
06/21/2026 11:27:08 - INFO - root -   epochs: 2/2, steps: 3100/3960, func: 0.058687, pos: 0.074451, neg: 0.016945, 78%: 1h 11m 32s          
06/21/2026 11:31:13 - INFO - root -   epochs: 2/2, steps: 3150/3960, func: 0.059848, pos: 0.073098, neg: 0.028693, 79%: 1h 7m 22s          
06/21/2026 11:35:22 - INFO - root -   epochs: 2/2, steps: 3200/3960, func: 0.059079, pos: 0.068613, neg: 0.02742, 80%: 1h 3m 13s          
06/21/2026 11:39:29 - INFO - root -   epochs: 2/2, steps: 3250/3960, func: 0.059019, pos: 0.054834, neg: 0.018808, 82%: 0h 59m 3s          
06/21/2026 11:43:38 - INFO - root -   epochs: 2/2, steps: 3300/3960, func: 0.057879, pos: 0.080009, neg: 0.027229, 83%: 0h 54m 53s          
06/21/2026 11:47:42 - INFO - root -   epochs: 2/2, steps: 3350/3960, func: 0.059251, pos: 0.069078, neg: 0.02089, 84%: 0h 50m 43s          
06/21/2026 11:51:53 - INFO - root -   epochs: 2/2, steps: 3400/3960, func: 0.059204, pos: 0.058004, neg: 0.017301, 85%: 0h 46m 35s          
06/21/2026 11:56:02 - INFO - root -   epochs: 2/2, steps: 3450/3960, func: 0.0596, pos: 0.058412, neg: 0.029129, 87%: 0h 42m 26s          
06/21/2026 12:00:14 - INFO - root -   epochs: 2/2, steps: 3500/3960, func: 0.06106, pos: 0.06218, neg: 0.033789, 88%: 0h 38m 17s          
06/21/2026 12:04:19 - INFO - root -   epochs: 2/2, steps: 3550/3960, func: 0.057808, pos: 0.05216, neg: 0.039029, 89%: 0h 34m 7s          
06/21/2026 12:08:25 - INFO - root -   epochs: 2/2, steps: 3600/3960, func: 0.059106, pos: 0.08078, neg: 0.021266, 90%: 0h 29m 58s          
06/21/2026 12:12:34 - INFO - root -   epochs: 2/2, steps: 3650/3960, func: 0.05752, pos: 0.074363, neg: 0.049819, 92%: 0h 25m 49s          
06/21/2026 12:16:41 - INFO - root -   epochs: 2/2, steps: 3700/3960, func: 0.058926, pos: 0.064105, neg: 0.019733, 93%: 0h 21m 39s          
06/21/2026 12:20:48 - INFO - root -   epochs: 2/2, steps: 3750/3960, func: 0.057729, pos: 0.051066, neg: 0.024999, 94%: 0h 17m 30s          
06/21/2026 12:24:57 - INFO - root -   epochs: 2/2, steps: 3800/3960, func: 0.059689, pos: 0.06482, neg: 0.023335, 95%: 0h 13m 21s          
06/21/2026 12:29:02 - INFO - root -   epochs: 2/2, steps: 3850/3960, func: 0.058311, pos: 0.072326, neg: 0.020429, 97%: 0h 9m 12s          
06/21/2026 12:33:15 - INFO - root -   epochs: 2/2, steps: 3900/3960, func: 0.060318, pos: 0.077994, neg: 0.021262, 98%: 0h 5m 3s          
06/21/2026 12:37:19 - INFO - root -   epochs: 2/2, steps: 3950/3960, func: 0.058583, pos: 0.058603, neg: 0.034509, 99%: 0h 0m 54s          
06/21/2026 12:42:58 - INFO - root -   final eval loss: func: 0.052565, pos: 0.061841, neg: 0.059916
06/21/2026 12:42:58 - INFO - root -   Saving model checkpoint to ../trained/starcoder2-3b-lora-safecoder_secure_pinned_starcoder2_3b/checkpoint-last
06/21/2026 12:42:59 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
06/21/2026 12:42:59 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/bigcode/starcoder2-3b/733247c55e3f73af49ce8e9c7949bf14af205928/config.json "HTTP/1.1 200 OK"
06/21/2026 12:42:59 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/bigcode/starcoder2-3b/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
06/21/2026 12:42:59 - INFO - httpx -   HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/bigcode/starcoder2-3b/733247c55e3f73af49ce8e9c7949bf14af205928/config.json "HTTP/1.1 200 OK"