Spaces:
Sleeping
Sleeping
Add Trackio ablation notes to blog
Browse files- blog/blog.md +18 -0
blog/blog.md
CHANGED
|
@@ -16,6 +16,16 @@ So I built **CyberSecurity_OWASP** around a different idea:
|
|
| 16 |
|
| 17 |
The goal is not another benchmark where an LLM answers security trivia. The goal is an OpenEnv environment where a small open model can learn an actual defensive workflow: inspect an application, understand the intended authorization policy, discover a broken access control bug, patch the code, and preserve legitimate behavior.
|
| 18 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
## Why OWASP A01?
|
| 20 |
|
| 21 |
The first target is **OWASP A01:2025 - Broken Access Control**.
|
|
@@ -52,6 +62,14 @@ The current MVP focuses on generated FastAPI-style invoice applications with inj
|
|
| 52 |
|
| 53 |
This is not a static multiple-choice benchmark. It is an interactive environment with tools, state, hidden checks, and reward feedback.
|
| 54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
The agent can use tools such as:
|
| 56 |
|
| 57 |
```text
|
|
|
|
| 16 |
|
| 17 |
The goal is not another benchmark where an LLM answers security trivia. The goal is an OpenEnv environment where a small open model can learn an actual defensive workflow: inspect an application, understand the intended authorization policy, discover a broken access control bug, patch the code, and preserve legitimate behavior.
|
| 18 |
|
| 19 |
+
## Ablations: Where the Reward Started Working
|
| 20 |
+
|
| 21 |
+
I ran a lot of short ablations, and the full trail is in the [CyberSecurity_OWASP Trackio dashboard](https://huggingface.co/spaces/Humanlearning/CyberSecurity_OWASP-trackio).
|
| 22 |
+
|
| 23 |
+

|
| 24 |
+
|
| 25 |
+
The first plain-RL rubric looked promising on paper, but the agent learned a cheap loop: inspect the policy, collect shaping reward, and stall. Tightening the rubric helped, but reward still climbed too slowly.
|
| 26 |
+
|
| 27 |
+
The useful jump came from changing the recipe: first teach the model successful trajectories with SFT, then run GRPO on that LoRA. With the updated rubric, the SFT-warm-started agent spends less time gaming the interface and more time doing the real job: find the auth bug, patch it, and keep valid behavior alive.
|
| 28 |
+
|
| 29 |
## Why OWASP A01?
|
| 30 |
|
| 31 |
The first target is **OWASP A01:2025 - Broken Access Control**.
|
|
|
|
| 62 |
|
| 63 |
This is not a static multiple-choice benchmark. It is an interactive environment with tools, state, hidden checks, and reward feedback.
|
| 64 |
|
| 65 |
+
## Architecture and Training Flow
|
| 66 |
+
|
| 67 |
+
[Architecture diagram](../assets/architecture_diagram.svg) | [RL training flow diagram](../assets/env_rl_training_flow_diagram.svg)
|
| 68 |
+
|
| 69 |
+

|
| 70 |
+
|
| 71 |
+

|
| 72 |
+
|
| 73 |
The agent can use tools such as:
|
| 74 |
|
| 75 |
```text
|