|
Download reports/pilot-shield-openloop.md from Kai9987kai/CROSSWIRE: direct link, hf CLI and curl.
- Browser
- Download file 3.44 kB
-
https://huggingface.co/Kai9987kai/CROSSWIRE/resolve/main/reports/pilot-shield-openloop.md
- Command line
-
hf download hf://Kai9987kai/CROSSWIRE/reports/pilot-shield-openloop.md
-
curl -L -o pilot-shield-openloop.md https://huggingface.co/Kai9987kai/CROSSWIRE/resolve/main/reports/pilot-shield-openloop.md
3.44 kB
Open-Loop Stress Baseline
- Runs: 36; source hash
c6f7501cef90c4aa…; protocol hasha4fcb06f0e492da4…; scientific hash5bdf9766d4ab4946…. - Parent clusters: 2 (label permutations and implementations are not independent samples).
Method × call budget (pooled over families)
| Method | Budget | Requests | Admitted | Useful coverage | Selective harm | Hazard | Averted | Shield interventions | Interface errors | Mean calls |
|---|---|---|---|---|---|---|---|---|---|---|
| task/fit | 16 | 18 | 16 | 33% | 62% | 7 | 0 | 0 | 2 | 6.9 |
| task/robust | 16 | 18 | 9 | 22% | 56% | 5 | 0 | 0 | 2 | 6.9 |
Per family
| Family | Scope | Method | Budget | Admitted/requests | Successful | Harmful | Hazards | Averted | Interventions | Oracle-feasible |
|---|---|---|---|---|---|---|---|---|---|---|
| alias | out_of_family | task/fit | 16 | 2/2 | 1 | 1 | 1 | 0 | 0 | 2 |
| alias | out_of_family | task/robust | 16 | 1/2 | 1 | 0 | 0 | 0 | 0 | 2 |
| bypass | out_of_family | task/fit | 16 | 2/2 | 0 | 2 | 2 | 0 | 0 | 2 |
| bypass | out_of_family | task/robust | 16 | 2/2 | 0 | 2 | 2 | 0 | 0 | 2 |
| delay | out_of_family | task/fit | 16 | 2/2 | 1 | 1 | 1 | 0 | 0 | 2 |
| delay | out_of_family | task/robust | 16 | 0/2 | 0 | 0 | 0 | 0 | 0 | 2 |
| drift | out_of_family | task/fit | 16 | 2/2 | 2 | 0 | 0 | 0 | 0 | 2 |
| drift | out_of_family | task/robust | 16 | 2/2 | 2 | 0 | 0 | 0 | 0 | 2 |
| extra_state | out_of_family | task/fit | 16 | 2/2 | 0 | 2 | 0 | 0 | 0 | 0 |
| extra_state | out_of_family | task/robust | 16 | 0/2 | 0 | 0 | 0 | 0 | 0 | 0 |
| incompatible | out_of_family | task/fit | 16 | 2/2 | 1 | 1 | 0 | 0 | 0 | 2 |
| incompatible | out_of_family | task/robust | 16 | 0/2 | 0 | 0 | 0 | 0 | 0 | 2 |
| malformed | interface_error | task/fit | 16 | 0/2 | 0 | 0 | 0 | 0 | 0 | 0 |
| malformed | interface_error | task/robust | 16 | 0/2 | 0 | 0 | 0 | 0 | 0 | 0 |
| repeat | out_of_family | task/fit | 16 | 2/2 | 1 | 1 | 1 | 0 | 0 | 2 |
| repeat | out_of_family | task/robust | 16 | 2/2 | 1 | 1 | 1 | 0 | 0 | 2 |
| semantic_corruption | out_of_family | task/fit | 16 | 2/2 | 0 | 2 | 2 | 0 | 0 | 2 |
| semantic_corruption | out_of_family | task/robust | 16 | 2/2 | 0 | 2 | 2 | 0 | 0 | 2 |
Forced-fit residuals
| Family | Implementation | Seed | Residual (raw + anchor) | Tied maps | Contract satisfied |
|---|---|---|---|---|---|
| alias | procedural | 17 | 0 (0 + 0) | 2 | True |
| alias | procedural | 23 | 1 (1 + 0) | 3 | False |
| bypass | procedural | 17 | 0 (0 + 0) | 2 | False |
| bypass | procedural | 23 | 0 (0 + 0) | 1 | False |
| delay | procedural | 17 | 1 (1 + 0) | 72 | True |
| delay | procedural | 23 | 1 (1 + 0) | 72 | False |
| drift | procedural | 17 | 0 (0 + 0) | 2 | True |
| drift | procedural | 23 | 0 (0 + 0) | 1 | True |
| extra_state | procedural | 17 | 0 (0 + 0) | 2 | False |
| extra_state | procedural | 23 | 0 (0 + 0) | 2 | False |
| incompatible | procedural | 17 | 2 (2 + 0) | 38 | True |
| incompatible | procedural | 23 | 1 (1 + 0) | 72 | False |
| malformed | procedural | 17 | 0 (0 + 0) | 144 | None |
| malformed | procedural | 23 | 0 (0 + 0) | 144 | None |
| repeat | procedural | 17 | 0 (0 + 0) | 2 | True |
| repeat | procedural | 23 | 0 (0 + 0) | 2 | False |
| semantic_corruption | procedural | 17 | 0 (0 + 0) | 2 | False |
| semantic_corruption | procedural | 23 | 0 (0 + 0) | 1 | False |