CipherSmit commited on
Commit
09181b4
·
verified ·
1 Parent(s): afd35e2

update model card

Browse files
Files changed (1) hide show
  1. README.md +26 -9
README.md CHANGED
@@ -12,34 +12,51 @@ Colab from the private dataset repo `CipherSmit/critiq-v2-data` and served by th
12
 
13
  | Folder | Model | Role (tier) | Format |
14
  |---|---|---|---|
15
- | `rf/` | Random Forest (scikit-learn) | Tier 2: actor class from 12 features | skops |
 
16
  | `vae/` | beta-VAE, 60→…→32 latent + aux P99 head | Tier 3: workload fingerprint, OOD scores | safetensors + JSON |
17
  | `vae_plain/` | same architecture, β = 0, no aux loss | ablation only | safetensors + JSON |
18
  | `mlp/` | Policy MLP 38→64→32→4 | Tier 5: priority P0–P3 per actor | safetensors |
19
 
20
- Training is sequential (RF → beta-VAE → MLP): the VAE's input includes the RF class mix,
21
- and the MLP's input includes the RF class, RF confidence and the VAE fingerprint.
22
  Architectures and feature order live in `critiq-colab/critiq_models/` of the project repository.
23
 
24
  ## Intended use and limits
25
 
26
  Research use in trace-driven simulation (MSR Cambridge, FIU, Alibaba block traces).
27
- Not validated on live systems. Labels for the RF come from a hand-built FIU
28
- process→class map; priority labels come from counterfactual simulation of an
29
- approximate BFQ scheduler. Results depend on the simulator's fidelity (see the
30
  calibration report in the project's `research/` folder).
31
 
32
  ## Metrics
33
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  ### rf/
35
 
36
  | metric | value |
37
  |---|---|
38
- | inference_ms_500_actors | 28.3510 |
39
  | label_source | msr_behavior_rules |
40
  | latency_critical_recall | 0.9997 |
41
- | macro_f1 | 0.9999 |
42
- | macro_f1_holdout_traces | 0.9999 |
 
43
  | train_dataset | msr |
44
 
45
 
 
12
 
13
  | Folder | Model | Role (tier) | Format |
14
  |---|---|---|---|
15
+ | `seq/` | Trace Transformer: causal Transformer over request tokens, pre-trained to predict the next request | Tier 2: actor class from its recent requests | safetensors |
16
+ | `rf/` | Random Forest (scikit-learn) on 12 hand-made features | baseline classifier (ablation only) | skops |
17
  | `vae/` | beta-VAE, 60→…→32 latent + aux P99 head | Tier 3: workload fingerprint, OOD scores | safetensors + JSON |
18
  | `vae_plain/` | same architecture, β = 0, no aux loss | ablation only | safetensors + JSON |
19
  | `mlp/` | Policy MLP 38→64→32→4 | Tier 5: priority P0–P3 per actor | safetensors |
20
 
21
+ Training is sequential (classifier → beta-VAE → MLP): the VAE's input includes the classifier's
22
+ class mix, and the MLP's input includes the class, its confidence and the VAE fingerprint.
23
  Architectures and feature order live in `critiq-colab/critiq_models/` of the project repository.
24
 
25
  ## Intended use and limits
26
 
27
  Research use in trace-driven simulation (MSR Cambridge, FIU, Alibaba block traces).
28
+ Not validated on live systems. Class labels come from transparent behaviour rules over
29
+ actor features (or a hand-built FIU process→class map); priority labels come from
30
+ counterfactual simulation of an approximate mq-deadline scheduler with priority classes. Results depend on the simulator's fidelity (see the
31
  calibration report in the project's `research/` folder).
32
 
33
  ## Metrics
34
 
35
+ ### seq/
36
+
37
+ | metric | value |
38
+ |---|---|
39
+ | inference_ms_500_actors | 40.9555 |
40
+ | label_source | msr_behavior_rules |
41
+ | latency_critical_recall | 0.8923 |
42
+ | linear_probe_val_macro_f1 | 0.7794 |
43
+ | macro_f1 | 0.9267 |
44
+ | macro_f1_holdout_traces | 0.9249 |
45
+ | model | trace_transformer |
46
+ | parameters | 74345 |
47
+ | train_dataset | msr |
48
+ | val_macro_f1 | 0.9028 |
49
+
50
  ### rf/
51
 
52
  | metric | value |
53
  |---|---|
54
+ | inference_ms_500_actors | 37.2847 |
55
  | label_source | msr_behavior_rules |
56
  | latency_critical_recall | 0.9997 |
57
+ | macro_f1 | 0.9997 |
58
+ | macro_f1_holdout_traces | 0.9998 |
59
+ | model | random_forest_baseline |
60
  | train_dataset | msr |
61
 
62