Spaces:
Sleeping
Sleeping
Add proof and artifacts table to blog writeup
Browse files
BLOG.md
CHANGED
|
@@ -141,6 +141,21 @@ The training curve and three-way before/after comparison are committed in the Gi
|
|
| 141 |
|
| 142 |

|
| 143 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 144 |
## 6) The honest trade-off
|
| 145 |
|
| 146 |
GRPO heavily reinforced the high-reward action patterns from training (Phase 2/3 episodes give +2.0 fix rewards vs Phase 1's +1.0 per violation). The trained model now over-applies these patterns to Phase 1 tasks where they don't fit, causing regressions on `validate_response_schema`, `validate_cross_field_constraints`, and `validate_auth_request`. With task-balanced training and a "don't repeat" reward signal, this would close. But the headroom-task win is real and reproducible.
|
|
|
|
| 141 |
|
| 142 |

|
| 143 |
|
| 144 |
+
### Proof and artifacts
|
| 145 |
+
|
| 146 |
+
The training run is backed by public, reproducible artifacts:
|
| 147 |
+
|
| 148 |
+
| Artifact | Link |
|
| 149 |
+
|---|---|
|
| 150 |
+
| Public WandB run | https://wandb.ai/pushpamsubscriptions-inn/openenv-contract-guardian/runs/gch0eg3k |
|
| 151 |
+
| Training proof summary | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/api_contract_validator/results/TRAINING_RUN_PROOF.md |
|
| 152 |
+
| Full training log | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/api_contract_validator/results/training_full_log.txt |
|
| 153 |
+
| Training state JSON | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/api_contract_validator/results/training_state.json |
|
| 154 |
+
| Trained scores | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/trained_scores.json |
|
| 155 |
+
| 7B baseline scores | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/baseline_7b_scores.json |
|
| 156 |
+
| 72B baseline scores | https://github.com/kumarpushpam17-personal/Hackathon/blob/main/baseline_72b_v2_scores.json |
|
| 157 |
+
| Trained LoRA adapter | https://huggingface.co/pushpam14/api-contract-validator-grpo-7b |
|
| 158 |
+
|
| 159 |
## 6) The honest trade-off
|
| 160 |
|
| 161 |
GRPO heavily reinforced the high-reward action patterns from training (Phase 2/3 episodes give +2.0 fix rewards vs Phase 1's +1.0 per violation). The trained model now over-applies these patterns to Phase 1 tasks where they don't fit, causing regressions on `validate_response_schema`, `validate_cross_field_constraints`, and `validate_auth_request`. With task-balanced training and a "don't repeat" reward signal, this would close. But the headroom-task win is real and reproducible.
|