Humanlearning commited on
Commit
9b94607
·
verified ·
1 Parent(s): 7ce8a60

Add Trackio ablation notes to blog

Browse files
Files changed (1) hide show
  1. blog/blog.md +18 -0
blog/blog.md CHANGED
@@ -16,6 +16,16 @@ So I built **CyberSecurity_OWASP** around a different idea:
16
 
17
  The goal is not another benchmark where an LLM answers security trivia. The goal is an OpenEnv environment where a small open model can learn an actual defensive workflow: inspect an application, understand the intended authorization policy, discover a broken access control bug, patch the code, and preserve legitimate behavior.
18
 
 
 
 
 
 
 
 
 
 
 
19
  ## Why OWASP A01?
20
 
21
  The first target is **OWASP A01:2025 - Broken Access Control**.
@@ -52,6 +62,14 @@ The current MVP focuses on generated FastAPI-style invoice applications with inj
52
 
53
  This is not a static multiple-choice benchmark. It is an interactive environment with tools, state, hidden checks, and reward feedback.
54
 
 
 
 
 
 
 
 
 
55
  The agent can use tools such as:
56
 
57
  ```text
 
16
 
17
  The goal is not another benchmark where an LLM answers security trivia. The goal is an OpenEnv environment where a small open model can learn an actual defensive workflow: inspect an application, understand the intended authorization policy, discover a broken access control bug, patch the code, and preserve legitimate behavior.
18
 
19
+ ## Ablations: Where the Reward Started Working
20
+
21
+ I ran a lot of short ablations, and the full trail is in the [CyberSecurity_OWASP Trackio dashboard](https://huggingface.co/spaces/Humanlearning/CyberSecurity_OWASP-trackio).
22
+
23
+ ![CyberSecurity_OWASP reward ablations](../assets/trackio_reward_ablations.png)
24
+
25
+ The first plain-RL rubric looked promising on paper, but the agent learned a cheap loop: inspect the policy, collect shaping reward, and stall. Tightening the rubric helped, but reward still climbed too slowly.
26
+
27
+ The useful jump came from changing the recipe: first teach the model successful trajectories with SFT, then run GRPO on that LoRA. With the updated rubric, the SFT-warm-started agent spends less time gaming the interface and more time doing the real job: find the auth bug, patch it, and keep valid behavior alive.
28
+
29
  ## Why OWASP A01?
30
 
31
  The first target is **OWASP A01:2025 - Broken Access Control**.
 
62
 
63
  This is not a static multiple-choice benchmark. It is an interactive environment with tools, state, hidden checks, and reward feedback.
64
 
65
+ ## Architecture and Training Flow
66
+
67
+ [Architecture diagram](../assets/architecture_diagram.svg) | [RL training flow diagram](../assets/env_rl_training_flow_diagram.svg)
68
+
69
+ ![CyberSecurity_OWASP architecture](../assets/architecture_diagram.svg)
70
+
71
+ ![CyberSecurity_OWASP RL training flow](../assets/env_rl_training_flow_diagram.svg)
72
+
73
  The agent can use tools such as:
74
 
75
  ```text