pushpam14 commited on
Commit
ed332e1
·
verified ·
1 Parent(s): 5ac6a8d

Add proof and artifacts table to blog writeup

Browse files
Files changed (1) hide show
  1. BLOG.md +15 -0
BLOG.md CHANGED
@@ -141,6 +141,21 @@ The training curve and three-way before/after comparison are committed in the Gi
141
 
142
  ![Before vs after](https://raw.githubusercontent.com/kumarpushpam17-personal/Hackathon/main/api_contract_validator/results/before_after.png)
143
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
144
  ## 6) The honest trade-off
145
 
146
  GRPO heavily reinforced the high-reward action patterns from training (Phase 2/3 episodes give +2.0 fix rewards vs Phase 1's +1.0 per violation). The trained model now over-applies these patterns to Phase 1 tasks where they don't fit, causing regressions on `validate_response_schema`, `validate_cross_field_constraints`, and `validate_auth_request`. With task-balanced training and a "don't repeat" reward signal, this would close. But the headroom-task win is real and reproducible.
 
141
 
142
  ![Before vs after](https://raw.githubusercontent.com/kumarpushpam17-personal/Hackathon/main/api_contract_validator/results/before_after.png)
143
 
144
+ ### Proof and artifacts
145
+
146
+ The training run is backed by public, reproducible artifacts:
147
+
148
+ | Artifact | Link |
149
+ |---|---|
150
+ | Public WandB run | https://wandb.ai/pushpamsubscriptions-inn/openenv-contract-guardian/runs/gch0eg3k |
151
+ | Training proof summary | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/api_contract_validator/results/TRAINING_RUN_PROOF.md |
152
+ | Full training log | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/api_contract_validator/results/training_full_log.txt |
153
+ | Training state JSON | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/api_contract_validator/results/training_state.json |
154
+ | Trained scores | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/trained_scores.json |
155
+ | 7B baseline scores | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/baseline_7b_scores.json |
156
+ | 72B baseline scores | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/baseline_72b_v2_scores.json |
157
+ | Trained LoRA adapter | https://huggingface.co/pushpam14/api-contract-validator-grpo-7b |
158
+
159
  ## 6) The honest trade-off
160
 
161
  GRPO heavily reinforced the high-reward action patterns from training (Phase 2/3 episodes give +2.0 fix rewards vs Phase 1's +1.0 per violation). The trained model now over-applies these patterns to Phase 1 tasks where they don't fit, causing regressions on `validate_response_schema`, `validate_cross_field_constraints`, and `validate_auth_request`. With task-balanced training and a "don't repeat" reward signal, this would close. But the headroom-task win is real and reproducible.