macmacmacmac commited on
Commit
0ea2a8e
·
verified ·
1 Parent(s): 0d511e7

Publish the counted chart. Card text and png only. Weights unchanged.

Browse files
Files changed (2) hide show
  1. README.md +1 -1
  2. jev_human_questions_chart.png +2 -2
README.md CHANGED
@@ -35,4 +35,4 @@ measurements, not deployment guarantees.
35
 
36
  ![Can Small Security Models Stop Prompt Injection — And Is Fine-Tuning Worth It?](jev_human_questions_chart.png)
37
 
38
- Chart corrected 2026-11-05 after two independent audits against primary records (live AgentDojo JSONL recounts and per-row score recomputes). One threshold and mode per row; summary-only cells are labeled on the chart. Replication report regenerated with zero diff before publication.
 
35
 
36
  ![Can Small Security Models Stop Prompt Injection — And Is Fine-Tuning Worth It?](jev_human_questions_chart.png)
37
 
38
+ Checked 2026-11-05 against the live run3 counts and the per-row score files. Q1 row 2 is stop replay at 0.99: 51/249 tasks finished, 7/249 hijacked, 35/37 normal tasks passed, adaptive 53/100. The judge normal rate is 141/148. No per-check timing is on the chart. CLEF-Screen caught 20098/20271 (99.1%). `build_replication_package.py` rerun matched the published AUCs. Two gaps stay labeled: CLEF-DualScreen has no local per-row test file, and the SecJev redo numbers are bench draws.
jev_human_questions_chart.png CHANGED

Git LFS Details

  • SHA256: ac3f3db75040ff551d24582ece07ed1f9f1849f81fba2c0c3e301c26dba25414
  • Pointer size: 131 Bytes
  • Size of remote file: 434 kB

Git LFS Details

  • SHA256: fbb16dcb4682eaddc6877713a0e4c5ae49ed81873218383cda7761bb67d6d2a1
  • Pointer size: 131 Bytes
  • Size of remote file: 527 kB