SecEBL / l2_artifacts /README.md
willchen0011's picture
Add public benchmark subset to model card
607b6c0
|
Raw
History Blame Contribute Delete
2.5 kB
# SecEBL-Rev20 L2 Artifact
This directory contains the minimal public L2 artifact bundle for SecEBL-Rev20.
It is included so the companion GitHub `scripts/run_examples.sh` can run the
public Linux benchmark-subset session scoring path by default when this Hugging
Face model snapshot is used as `MODEL_DIR`.
## Files
| Path | Purpose |
| --- | --- |
| `logreg.joblib` | Fitted logistic-regression L2 session-risk model. |
| `tag_risk_policy.rev20.json` | Matching L2 feature policy. Its tag-selection settings are internal to L2 feature extraction. |
| `train_summary.json` | Public aggregate training/evaluation summary with no raw rows or real session identifiers. |
The release does not include the L2 training JSONL, raw pressure-stream archive,
full internal sessions, per-session pressure results, alert JSONL, source-code
copies, or private run logs. This repository includes the public benchmark
subset under `examples/linux/`; use the companion GitHub repository for source
code and the one-command runner.
## Scope
L2 is an experimental session scorer. A session is a sequence of events grouped
by `session_id`. L1 labels each event independently; L2 scores the whole session
by aggregating cached L1 ranked tags, retrieval scores, tag diversity, behavior
transitions, and routine-operation context.
Runtime L2 does not use raw command text, user names, host names, or session ids
as scoring features. Session ids may appear in private data-prep workflows for
label assignment, but they are not runtime allow/deny lists.
For compatibility with the released L2 artifact, L2 derives its session
features from cached L1 `top_labels` using an internal selected-tag feature
path. This does not change L1 prediction output: users still receive ranked
`top_labels`, not a selected `behavior_tags` field.
## Public Summary
| Check | Result |
| --- | ---: |
| Fitted withheld Linux session benchmark | 663 sessions, 365 TP, 298 TN, 0 FP, 0 FN |
| 7M pressure-stream fit-check | 6,286,568 rows, 102,117 sessions, 61 alert sessions |
| OOF validation | 5,747 sessions, 99.39% accuracy, 96.44% attack precision, 95.31% attack recall |
The high session benchmark accuracy is scoped to the current fitted internal
experiment. It is evidence that this L2 setup works well on the current complex
internal benchmark and pressure-data fit-check, not an independent claim of
general production IDS accuracy.
Use the companion GitHub helpers so feature extraction matches the released L2
artifact.