update model card
Browse files
README.md
CHANGED
|
@@ -12,34 +12,51 @@ Colab from the private dataset repo `CipherSmit/critiq-v2-data` and served by th
|
|
| 12 |
|
| 13 |
| Folder | Model | Role (tier) | Format |
|
| 14 |
|---|---|---|---|
|
| 15 |
-
| `
|
|
|
|
| 16 |
| `vae/` | beta-VAE, 60→…→32 latent + aux P99 head | Tier 3: workload fingerprint, OOD scores | safetensors + JSON |
|
| 17 |
| `vae_plain/` | same architecture, β = 0, no aux loss | ablation only | safetensors + JSON |
|
| 18 |
| `mlp/` | Policy MLP 38→64→32→4 | Tier 5: priority P0–P3 per actor | safetensors |
|
| 19 |
|
| 20 |
-
Training is sequential (
|
| 21 |
-
and the MLP's input includes the
|
| 22 |
Architectures and feature order live in `critiq-colab/critiq_models/` of the project repository.
|
| 23 |
|
| 24 |
## Intended use and limits
|
| 25 |
|
| 26 |
Research use in trace-driven simulation (MSR Cambridge, FIU, Alibaba block traces).
|
| 27 |
-
Not validated on live systems.
|
| 28 |
-
process→class map; priority labels come from
|
| 29 |
-
approximate
|
| 30 |
calibration report in the project's `research/` folder).
|
| 31 |
|
| 32 |
## Metrics
|
| 33 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
### rf/
|
| 35 |
|
| 36 |
| metric | value |
|
| 37 |
|---|---|
|
| 38 |
-
| inference_ms_500_actors |
|
| 39 |
| label_source | msr_behavior_rules |
|
| 40 |
| latency_critical_recall | 0.9997 |
|
| 41 |
-
| macro_f1 | 0.
|
| 42 |
-
| macro_f1_holdout_traces | 0.
|
|
|
|
| 43 |
| train_dataset | msr |
|
| 44 |
|
| 45 |
|
|
|
|
| 12 |
|
| 13 |
| Folder | Model | Role (tier) | Format |
|
| 14 |
|---|---|---|---|
|
| 15 |
+
| `seq/` | Trace Transformer: causal Transformer over request tokens, pre-trained to predict the next request | Tier 2: actor class from its recent requests | safetensors |
|
| 16 |
+
| `rf/` | Random Forest (scikit-learn) on 12 hand-made features | baseline classifier (ablation only) | skops |
|
| 17 |
| `vae/` | beta-VAE, 60→…→32 latent + aux P99 head | Tier 3: workload fingerprint, OOD scores | safetensors + JSON |
|
| 18 |
| `vae_plain/` | same architecture, β = 0, no aux loss | ablation only | safetensors + JSON |
|
| 19 |
| `mlp/` | Policy MLP 38→64→32→4 | Tier 5: priority P0–P3 per actor | safetensors |
|
| 20 |
|
| 21 |
+
Training is sequential (classifier → beta-VAE → MLP): the VAE's input includes the classifier's
|
| 22 |
+
class mix, and the MLP's input includes the class, its confidence and the VAE fingerprint.
|
| 23 |
Architectures and feature order live in `critiq-colab/critiq_models/` of the project repository.
|
| 24 |
|
| 25 |
## Intended use and limits
|
| 26 |
|
| 27 |
Research use in trace-driven simulation (MSR Cambridge, FIU, Alibaba block traces).
|
| 28 |
+
Not validated on live systems. Class labels come from transparent behaviour rules over
|
| 29 |
+
actor features (or a hand-built FIU process→class map); priority labels come from
|
| 30 |
+
counterfactual simulation of an approximate mq-deadline scheduler with priority classes. Results depend on the simulator's fidelity (see the
|
| 31 |
calibration report in the project's `research/` folder).
|
| 32 |
|
| 33 |
## Metrics
|
| 34 |
|
| 35 |
+
### seq/
|
| 36 |
+
|
| 37 |
+
| metric | value |
|
| 38 |
+
|---|---|
|
| 39 |
+
| inference_ms_500_actors | 40.9555 |
|
| 40 |
+
| label_source | msr_behavior_rules |
|
| 41 |
+
| latency_critical_recall | 0.8923 |
|
| 42 |
+
| linear_probe_val_macro_f1 | 0.7794 |
|
| 43 |
+
| macro_f1 | 0.9267 |
|
| 44 |
+
| macro_f1_holdout_traces | 0.9249 |
|
| 45 |
+
| model | trace_transformer |
|
| 46 |
+
| parameters | 74345 |
|
| 47 |
+
| train_dataset | msr |
|
| 48 |
+
| val_macro_f1 | 0.9028 |
|
| 49 |
+
|
| 50 |
### rf/
|
| 51 |
|
| 52 |
| metric | value |
|
| 53 |
|---|---|
|
| 54 |
+
| inference_ms_500_actors | 37.2847 |
|
| 55 |
| label_source | msr_behavior_rules |
|
| 56 |
| latency_critical_recall | 0.9997 |
|
| 57 |
+
| macro_f1 | 0.9997 |
|
| 58 |
+
| macro_f1_holdout_traces | 0.9998 |
|
| 59 |
+
| model | random_forest_baseline |
|
| 60 |
| train_dataset | msr |
|
| 61 |
|
| 62 |
|