Text Classification
PEFT
Safetensors
English
safety
guardrail
constitutional-classifiers
jailbreak-detection
content-moderation
Instructions to use EuroSafeAI/EuroSafeGuard with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use EuroSafeAI/EuroSafeGuard with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
File size: 1,161 Bytes
b994f0b | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 | {
"probe_mu": -6.815694701503735,
"probe_sd": 3.444286874679132,
"gate_mu": 0.03268957031742354,
"gate_sd": 0.12878089011617874,
"exch_mu": 0.02559613844389501,
"exch_sd": 0.090324355434096,
"probe_escalation_z": 1.164447941601081,
"probe_escalation_quantile": 0.9,
"weights": {
"probe": 0.6,
"gate": 0.2,
"exchange": 0.2
},
"full_thr": 3.131896552703142,
"calibration": "EuroSafeGuard (Full), the configuration of the paper's end-to-end table. All z-scores use the mean and standard deviation on WildChat-clean (6,853 conversations); the exchange statistics use the exchange classifier's max-head probability on Llama-3-8B-Instruct replies to them. A request is escalated if its probe z exceeds probe_escalation_z (the WildChat-clean 90th percentile); an escalated exchange is blocked if 0.6*probe_z + 0.2*gate_z + 0.2*exchange_z > full_thr. full_thr is the smallest threshold that keeps every benign calibration set under its cap (fit half): WildChat-clean, MMLU, GSM8K, Alpaca, Dolly, OASST 0.5%; XSTest-safe, OR-Bench-80k 2%; OR-Bench-hard 5%; benign rows of styled jailbreak sets 40%. Reproduces scripts/e2e_compose_ext.py.",
"seed": 2
} |