Fix README links and unignore placeholder eval plots

- Replace REPLACE_USER with shivam2k3 in README's "Try it" table.
- Drop video/blog URL placeholders (added when those deliverables land).
- Remove eval/results/ from .gitignore so the README's image references
resolve on the deployed Space; the placeholder plots are committed
today and will be overwritten by the post-training GPU run.

Made-with: Cursor

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.png filter=lfs diff=lfs merge=lfs -text
+*.pdf filter=lfs diff=lfs merge=lfs -text

.gitignore

@@ -17,4 +17,7 @@ wandb/
 *.bin
 *.safetensors
 .ipynb_checkpoints/
-eval/results/
+
+# eval/results/ is intentionally NOT ignored — the placeholder plots are
+# the README's images; the GPU run overwrites them with real numbers.
+.mplcache/

README.md

@@ -8,14 +8,12 @@ Humans cannot watch every alert in a Security Operations Center 24/7, and as str
 
 | Link | What it is |
 | --- | --- |
-| **HF Space** — [`<USER>-opensoc-env.hf.space`](https://huggingface.co/spaces/REPLACE_USER/opensoc-env) | Deployed env. OpenEnv judge can hit `/reset` `/step` `/state` `/grade`. |
-| **Live `/demo`** — [`<USER>-opensoc-env.hf.space/demo`](https://REPLACE_USER-opensoc-env.hf.space/demo) | Gradio "before vs after" UI. Click **Next incident** to compare baseline vs trained. |
-| **Walkthrough video** (90s) — [`youtu.be/<UNLISTED>`](https://youtu.be/REPLACE_VIDEO) | One-take demo + headline numbers. Script: [`docs/video_script.md`](docs/video_script.md). |
-| **Mini-blog** — [`huggingface.co/blog/<USER>/opensoc-rlvr-soc-triage`](https://huggingface.co/blog/REPLACE_USER/opensoc-rlvr-soc-triage) | ~600-word write-up. Source: [`docs/blog.md`](docs/blog.md). |
+| **HF Space** — [`shivam2k3-opensoc-env.hf.space`](https://huggingface.co/spaces/shivam2k3/opensoc-env) | Deployed env. OpenEnv judge can hit `/reset` `/step` `/state` `/grade`. |
+| **Live `/demo`** — [`shivam2k3-opensoc-env.hf.space/demo`](https://shivam2k3-opensoc-env.hf.space/demo) | Gradio "before vs after" UI. Click **Next incident** to compare baseline vs trained. |
+| **Walkthrough video** (90s) — _to be added after recording_ | One-take demo + headline numbers. Script: [`docs/video_script.md`](docs/video_script.md). |
+| **Mini-blog** — _to be added after publishing_ | ~600-word write-up. Source: [`docs/blog.md`](docs/blog.md). |
 | **Slide deck** — [`docs/slides.pdf`](docs/slides.pdf) | 5 slides; problem → env → results → demo. |
 
-> *Replace the four `REPLACE_*` placeholders above after deploy + recording. The slide PDF auto-rebuilds from `docs/build_slides.py`.*
-
 ## Table of contents
 
 1. [Architecture](#architecture)
@@ -242,7 +240,8 @@ Submission checklist:
 - [ ] Real demo data baked (re-run `python -m eval.bake_demo` post-training)
 - [ ] Video recorded + uploaded as unlisted (script in `docs/video_script.md`)
 - [ ] Blog post published on HF (source in `docs/blog.md`)
-- [ ] All four `REPLACE_*` placeholders at the top filled in
+- [ ] Video URL added to README's "Try it" table after recording
+- [ ] Blog URL added to README's "Try it" table after publishing
 
 ## License
 

eval/results/summary.json

@@ -0,0 +1,154 @@
+[
+  {
+    "label": "always_dismiss",
+    "accuracy": 0.13,
+    "macro_f1": 0.046017699115044254,
+    "dismiss_on_malicious": 1.0,
+    "over_react_rate": 0.0,
+    "per_class": {
+      "dismiss": {
+        "precision": 0.13,
+        "recall": 1.0,
+        "f1": 0.23008849557522126,
+        "support": 26
+      },
+      "monitor": {
+        "precision": 0.0,
+        "recall": 0.0,
+        "f1": 0.0,
+        "support": 72
+      },
+      "quarantine_host": {
+        "precision": 0.0,
+        "recall": 0.0,
+        "f1": 0.0,
+        "support": 46
+      },
+      "block_ip": {
+        "precision": 0.0,
+        "recall": 0.0,
+        "f1": 0.0,
+        "support": 40
+      },
+      "escalate": {
+        "precision": 0.0,
+        "recall": 0.0,
+        "f1": 0.0,
+        "support": 16
+      }
+    },
+    "confusion_matrix": {
+      "dismiss": {
+        "dismiss": 26,
+        "monitor": 0,
+        "quarantine_host": 0,
+        "block_ip": 0,
+        "escalate": 0
+      },
+      "monitor": {
+        "dismiss": 72,
+        "monitor": 0,
+        "quarantine_host": 0,
+        "block_ip": 0,
+        "escalate": 0
+      },
+      "quarantine_host": {
+        "dismiss": 46,
+        "monitor": 0,
+        "quarantine_host": 0,
+        "block_ip": 0,
+        "escalate": 0
+      },
+      "block_ip": {
+        "dismiss": 40,
+        "monitor": 0,
+        "quarantine_host": 0,
+        "block_ip": 0,
+        "escalate": 0
+      },
+      "escalate": {
+        "dismiss": 16,
+        "monitor": 0,
+        "quarantine_host": 0,
+        "block_ip": 0,
+        "escalate": 0
+      }
+    }
+  },
+  {
+    "label": "verifier_oracle",
+    "accuracy": 1.0,
+    "macro_f1": 1.0,
+    "dismiss_on_malicious": 0.0,
+    "over_react_rate": 0.0,
+    "per_class": {
+      "dismiss": {
+        "precision": 1.0,
+        "recall": 1.0,
+        "f1": 1.0,
+        "support": 26
+      },
+      "monitor": {
+        "precision": 1.0,
+        "recall": 1.0,
+        "f1": 1.0,
+        "support": 72
+      },
+      "quarantine_host": {
+        "precision": 1.0,
+        "recall": 1.0,
+        "f1": 1.0,
+        "support": 46
+      },
+      "block_ip": {
+        "precision": 1.0,
+        "recall": 1.0,
+        "f1": 1.0,
+        "support": 40
+      },
+      "escalate": {
+        "precision": 1.0,
+        "recall": 1.0,
+        "f1": 1.0,
+        "support": 16
+      }
+    },
+    "confusion_matrix": {
+      "dismiss": {
+        "dismiss": 26,
+        "monitor": 0,
+        "quarantine_host": 0,
+        "block_ip": 0,
+        "escalate": 0
+      },
+      "monitor": {
+        "dismiss": 0,
+        "monitor": 72,
+        "quarantine_host": 0,
+        "block_ip": 0,
+        "escalate": 0
+      },
+      "quarantine_host": {
+        "dismiss": 0,
+        "monitor": 0,
+        "quarantine_host": 46,
+        "block_ip": 0,
+        "escalate": 0
+      },
+      "block_ip": {
+        "dismiss": 0,
+        "monitor": 0,
+        "quarantine_host": 0,
+        "block_ip": 40,
+        "escalate": 0
+      },
+      "escalate": {
+        "dismiss": 0,
+        "monitor": 0,
+        "quarantine_host": 0,
+        "block_ip": 0,
+        "escalate": 16
+      }
+    }
+  }
+]